JP2021114083A - Image generation device and image generation method - Google Patents

Abstract

To easily perform optimum adjustment to a coloring image.SOLUTION: An image generation device includes an image data acquisition part 101 for acquiring image data, a contour line image creation part 1032 for creating a contour line image obtained by extracting the contour line of the image data acquired by the image data acquisition part 101, a line density calculation part 1031 for dividing the contour line image created by the contour line image creation part 1032 into predetermined division areas and calculating a line density for each division area, an adjustment method decision part 1033 for deciding an adjustment method for the contour line image on the basis of the line density for each division area calculated by the line density calculation part 1031, and an adjustment execution part 1034 for adjusting the contour line image by using the adjustment method decided by the adjustment method decision part 1033.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image generator and an image generation method.

In a printing device such as a printer, a technique of creating a colored picture image from image data and printing the image is considered, and such a technique is described in Patent Document 1.

Japanese Unexamined Patent Publication No. 2009-32178

In the technique described in Patent Document 1, the line density and the like are adjusted uniformly for the image. Therefore, it is not possible to perform the adjustment peculiar to the coloring image, which expresses the shading of the line according to the portion, and there is a possibility that the optimum adjustment cannot be made for the coloring image.

An object of the present invention is to provide an image generation device and an image generation method capable of easily performing optimum adjustment for a coloring image.

The image generator of the present invention
The image data acquisition unit that acquires image data and
A contour line creation unit that creates a contour line image by extracting the contour lines of the image data acquired by the image data acquisition unit, and a contour line creation unit.
A line density calculation unit that divides the contour line image created by the contour line creation unit into predetermined division regions and calculates the linear density for each division region.
An adjustment method determination unit that determines an adjustment method for the contour line image based on the linear density for each divided region calculated by the linear density calculation unit.
It has an adjustment execution unit that adjusts the contour line image by using the adjustment method determined by the adjustment method determination unit.

According to the present invention, optimum adjustment can be easily performed on a coloring image.

It is a block diagram in Example 1 of the image generation apparatus of this invention. It is a figure which shows the example of the image data acquired by the image data acquisition unit. It is a flowchart for demonstrating the process performed by an image control unit. It is a figure which shows the division area which divided the image data by a linear density calculation part. It is a figure which shows an example of the division area which divided the image data shown in FIG. It is a figure which shows an example of the display of the operation interface set by the adjustment method determination part. It is a flowchart for demonstrating the details of the process of step S205. It is a figure which shows an example of the preview screen which a display part displays. It is a figure for demonstrating the process of calculating the pixel adjustment reflection degree. It is a figure which shows an example of the display of a preview screen and an operation interface. It is a flowchart for demonstrating the details of the process of step S703. It is a flowchart for demonstrating the processing of the image control part in this Example. It is a figure for demonstrating the process when the object is specified about the coloring image. It is a figure which shows an example of the operation interface displayed in step S1204. It is a figure which shows another example of the operation interface displayed in step S1204.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The components described in this embodiment are given as examples of the components constituting the present invention, and the scope of the present invention is not limited to them.

(Example 1)
FIG. 1 is a configuration diagram of the image generator of the present invention according to the first embodiment. The image generation device 100 shown in FIG. 1 includes an image data acquisition unit 101, a display unit 102, an image control unit 103, an image printing unit 104, an MPU 105, a ROM 106, and a RAM 107. Further, these components are connected via the internal bus 108.
The image data acquisition unit 101 is an external interface (I / F) unit that acquires image data that is the source of a coloring image from an external device. For example, the image data acquisition unit 101 acquires image data from a memory card or a scanner.
The display unit 102 is a display for displaying a preview screen of the coloring image to be adjusted. In addition, the display unit 102 displays an operation interface, which is an operation screen for adjusting the coloring image by the user. The coloring image is a monochrome image for performing coloring (coloring), which is expressed by extracting the outline of an object included in the original image data. A specific method for creating a coloring image from the original image data will be described later.
The image control unit 103 is executed when creating a coloring image. The image control unit 103 is an operation for acquiring the original image of the color painting image from the image data acquisition unit 101, calculating the linear density for each divided region of the acquired image, and performing user adjustment according to the acquired image. Set the interface and make user adjustments. As shown in FIG. 1, the image control unit 103 includes a linear density calculation unit 1031, a contour line image creation unit 1032, an adjustment method determination unit 1033, and an adjustment execution unit 1034. The details of the operation of these components will be described later.
The image printing unit 104 prints a coloring image created by the image control unit 103 after making user adjustments. When the image generation device 100 receives a predetermined operation for the user to give a print instruction from the outside, the image printing unit 104 executes printing of the coloring picture image created by the image control unit 103.
The MPU 105 is a processor that controls the image generator 100 by using a program.
The ROM 106 is a memory for storing a program running on the MPU 105 and permanent data.
The RAM 107 is a rewritable working memory that holds data that volatilizes when the power is turned off.

The details of the processing of the image control unit 103 shown in FIG. 1 will be described below. FIG. 2 is a diagram showing an example of image data that is the source of the coloring image acquired by the image data acquisition unit 101. FIG. 2A is a diagram showing an example of image data of an illustration image represented only by a simple contour line. FIG. 2B is image data of a natural image including natural objects such as mountains and clouds and artificial objects such as buildings, and includes not only contour lines but also lines of mountain leaves and lines representing fine details of buildings. It is a figure which shows the example of. Although FIG. 2 is not colored, the actual image data is a color photograph, a painting, or the like, and is colored. The original image data also includes monochrome image data that has not been colored.
When the image data is an illustration image as shown in FIG. 2A, it is often composed only of simple contour lines. Therefore, when the user adjusts the shading of the lines of the coloring image, the image data is uniformly (hereinafter referred to as the screen uniform). On the other hand, when the image data is a natural image as shown in FIG. 2B, there are many fine lines representing the details of natural objects and artificial objects in addition to simple contour lines. Lines are unnecessary lines for coloring images. Therefore, when the user adjustment is performed uniformly on the screen as in the illustration image shown in FIG. 2 (a) for the natural image as shown in FIG. 2 (b), if the contour line is darkened, unnecessary lines may be generated. It gets darker. Moreover, when unnecessary lines are thinned, the contour lines are also thinned. Therefore, a trade-off may occur when the user adjusts the coloring image.

Therefore, in this embodiment, when the original image of the coloring image has contour lines as shown in FIG. 2B and lines unnecessary for the coloring image, an operation interface for uniformly adjusting the screen and an operation interface are used. An operation interface is provided to individually adjust unnecessary lines in the coloring book. As a result, the trade-off at the time of user adjustment is reduced.

FIG. 3 is a flowchart for explaining an example of the processing performed by the image control unit 103 shown in FIG. First, in step S201, the image control unit 103 reads the image data acquired by the image data acquisition unit 101. This image data is data indicating an image that is the source of the coloring image to be created. Further, in this embodiment, the image data to be read is RGB data. Subsequently, in step S202, the contour line image creation unit 1032, which is the contour line creation unit, creates a coloring image which is a contour line image from the image data read in step S201. That is, the contour line image creation unit 1032 creates a contour line image obtained by extracting the contour lines of the image data read in step S201. In this embodiment, the contour line image creation unit 1032 uses the edge image created by filtering the image data read in step S201 as a coloring image. Specifically, the contour line image creation unit 1032 converts the RGB data of the image data that is the source of the read coloring image into YCbCr data, and converts it into a monochrome image having a luminance value Y and a color difference component of 0. Then, the contour line image creation unit 1032 performs a filter process on the brightness value Y for each pixel from the converted monochrome image, and creates an image with edge extraction as a coloring image. As the type of filter at this time, a 3 × 3 pixel or 5 × 5 pixel Laplacian filter is used. Further, the method for creating the coloring image is not limited to the above method, and a method such as edge extraction from the difference in the brightness value with the pixel in the vicinity of the pixel of interest may be used.
Then, in step S203, the linear density calculation unit 1031 divides the coloring image created by the contour line image creation unit 1032 into a plurality of regions, and calculates the linear density for each divided region. In this embodiment, the linear density calculation unit 1031 determines that a pixel having a large pixel value in the coloring image created by the contour line image creation unit 1032 in step S202 is a line in the image. Therefore, in step S203, the linear density calculation unit 1031 determines that the pixels having a value equal to or higher than a predetermined threshold value for each divided region are lines, and integrates the integrated values for each region, and the integrated value is the total number of pixels in the divided region. The value divided by is calculated as the linear density. Further, the method of calculating the linear density is not limited to the above-mentioned method, and a method of adding weights to the average value of the edge image and the number of pixels of the edge histogram and calculating the linear density may be used.

FIG. 4 is a diagram showing an example of a division region in which the linear density calculation unit 1031 shown in FIG. 1 divides the image data. The linear density calculation unit 1031 displays the coloring image created by the contour line image creation unit 1032 in step S202 as shown in FIG. 4 in units of 10 horizontal × 10 vertical = 100 unit areas d [0] [0] to d [. 9] Divide into [9]. Then, the linear density calculation unit 1031 calculates the linear densities lRate [0] [0] to lRate [9] [9] for each unit region. The linear density lRate is a value in the range of 0 to 100, and when it is 0, it means that there are no lines, and the larger the value (the higher the linear density), the more lines are present. Hereinafter, each divided unit area will be referred to as a divided area.

FIG. 5 is a diagram showing an example of a divided region in which the linear density calculation unit 1031 shown in FIG. 1 divides the image data shown in FIG. 2. When the linear density calculation unit 1031 divides the illustration image as shown in FIG. 2 (a) into the divided regions, it becomes as shown in FIG. 5 (a). In FIG. 5A, the linear density lRate [0] [0] of the divided region d [9] [0] in which the line does not exist has a very low value such as 0. Further, the linear density lRate [1] [3] of the divided region d [1] [3] in which the contour line of the object exists becomes a value larger than 0. When the linear density calculation unit 1031 divides the natural image as shown in FIG. 2 (b) into the divided regions, it becomes as shown in FIG. 5 (b). In FIG. 5B, the linear densities lRate [1] [9] of the divided regions d [1] [9] containing only lines unnecessary for coloring such as mountain leaves have very high values. In addition, the linear density lRate [0] [5] of the divided area d [0] [5] including the contour line of the mountain and the unnecessary line of the leaf, and the divided area d [5] [5] including many contour lines of the building. The linear density lRate [5] [8] of 8] has a medium value.

Subsequently, in step S204, the adjustment method determination unit 1033, which is the adjustment method determination unit, adjusts the user of the coloring image based on the linear density lRate for each division region calculated by the linear density calculation unit 1031 in step S203. Set the operation interface when performing. In step S204, when the image data is an illustration image as shown in FIG. 2A, the adjustment method determination unit 1033 provides the display unit 102 with an operation interface for uniformly adjusting the line on the image data (screen). Display it. When the image data is a natural image as shown in FIG. 2 (b), the adjustment method determination unit 1033 also displays an operation interface for individually adjusting a portion having many lines on the display unit 102, which is unnecessary for coloring. Make it possible to make individual adjustments for various parts.

Specifically, when the linear density lRate of all the division regions d is the threshold value th1 or less, it can be determined that there are no locations containing unnecessary lines because there are no locations with many lines. Therefore, the adjustment method determination unit 1033 determines that the image data is an illustration image as shown in FIG. 2A, and sets an operation interface for uniformly adjusting the lines on the screen.
FIG. 6 is a diagram showing an example of a display of the operation interface set by the adjustment method determination unit 1033 shown in FIG. FIG. 6A is a diagram showing an example of an operation interface for making uniform adjustments on the screen. In FIG. 6A, when the adjustment bar 601 is moved to the right, the line of the coloring image becomes darker, and when it is moved to the left, the line of the coloring image becomes lighter. The adjustment method determination unit 1033 causes the display unit 102 to display the operation interface. At this time, if the display unit 102 has a touch panel function, the adjustment bar 601 moves to the right or left based on the user's touch operation on the display unit 102. Further, for example, when another input means such as a mouse or a keyboard is connected to or provided in the image generation device 100, the adjustment bar 601 moves to the right or left based on the input received from the user by the input means. Moving. An element that accepts such an input operation from the outside is used as an input unit.

On the other hand, when the divided region d having a linear density lRate higher than the threshold value th1 exists in the coloring image being processed, it can be determined that the image includes a portion including an unnecessary line. Therefore, the adjustment method determination unit 1033 determines that the image data is a natural image as shown in FIG. 2B, and sets an operation interface for individually adjusting the lines.
FIG. 6B is a diagram showing an example of a display of an operation interface for individually adjusting lines. The adjustment bar 602 shown in FIG. 6B is for adjusting the line density of the coloring image uniformly on the screen in the same manner as the adjustment bar 601 shown in FIG. 6A. Further, by moving the adjustment bar 603 shown in FIG. 6B in the left-right direction, the line density is adjusted with respect to the portion of the line unnecessary for the coloring image. For example, after moving the adjustment bar 602 in the left-right direction to make uniform adjustments to the entire screen (image data), the adjustment bar 603 for performing individual adjustments is moved in the left-right direction to create a coloring image. Make adjustments for unnecessary parts. The movement of the adjustment bars 602 and 603 is performed in the same operation as the movement of the adjustment bar 601.

Further, in this step, a method of determining whether the image data that is the source of the coloring image is an illustration image as shown in FIG. 2A or a natural image as shown in FIG. 2B. Is not limited to the method using the linear density described above. For example, if the contour line in the coloring image created by the contour line image creation unit 1032 in step S202 has many simple lines such as straight lines and circles, a method of determining that the image data is an illustration image, etc. It may be.

Subsequently, in step S205, the adjustment method determination unit 1033 and the adjustment execution unit 1034 were created by the contour line image creation unit 1032 in step S202 based on the operation interface set by the adjustment method determination unit 1033 in step S204. Adjust the coloring image. In this embodiment, when the image data that is the source of the coloring image is an illustration image, the line is adjusted uniformly on the screen, so that the adjustment method determination unit 1033 reflects the user adjustment using the operation interface as it is. On the other hand, when the image data that is the basis of the coloring image is a natural image, the adjustment method determination unit 1033 performs user adjustment using the operation interface for each pixel because the adjustment is performed individually in the place where there are many lines. It is necessary to calculate whether to reflect the degree. Therefore, in step S205, the adjustment method determination unit 1033 calculates how much the user adjustment is reflected for each divided area and pixel in the image data when the line is adjusted individually, and according to the result. Create a user-adjusted image. Specifically, the adjustment method determination unit 1033 calculates the area adjustment reflection degree aRate, which is the degree to which the user adjustment is reflected for each division area d, based on the linear density lRate. Then, the adjustment method determination unit 1033 calculates the pixel adjustment reflection degree pRate, which is the degree of reflecting the user adjustment for each pixel, based on the area adjustment reflection degree aRate, which is the area reflection degree, and calculates each pixel of the coloring image. Create an image that reflects user adjustments.

FIG. 7 is a flowchart for explaining the details of the process of step S205 described with reference to the flowchart shown in FIG. In FIG. 7, depending on whether the operation interface set by the adjustment method determination unit 1033 in step S204 is an operation interface for uniformly adjusting the screen or an operation interface for individually adjusting unnecessary lines in the coloring image. , The process of creating a coloring image is different. In FIG. 7, when the adjustment method determination unit 1033 sets the operation interface for performing uniform screen adjustment in step S204, the adjustment method determination unit 1033 reflects the user adjustment using the operation interface as it is. On the other hand, when the adjustment method determination unit 1033 sets an operation interface for individually adjusting unnecessary lines in the coloring image in step S204, the adjustment method determination unit 1033 determines the pixel reflection degree for each pixel of the coloring image. The pixel adjustment reflection degree pRate is calculated. Then, the adjustment method determination unit 1033 reflects the user adjustment for each pixel of the coloring image according to the pixel adjustment reflection degree pRate.
The details will be described. First, in step S701, the adjustment method determination unit 1033 determines whether or not an operation interface for adjusting lines uniformly on the screen has been set. When the adjustment method determination unit 1033 sets the operation interface for adjusting the line uniformly on the screen, in step S702, the adjustment execution unit 1034 uses the operation interface for adjusting the line uniformly on the screen for coloring. User adjustments are made to the image to create the image. At this time, the image control unit 103 (for example, the adjustment execution unit 1034) causes the display unit 102 to display the preview screen and the operation interface.
FIG. 8 is a diagram showing an example of a preview screen displayed on the display unit 102 by the adjustment execution unit 1034 shown in FIG. As shown in FIG. 8, the display unit 102 has a preview screen in which user adjustments have been made to the coloring image, and an operation interface for uniformly adjusting lines as shown in FIG. 6A. And are displayed. Further, the display unit 102 switches and displays the preview screen on which the user adjustment has been performed and the operation interface at a predetermined timing such as a fixed cycle. Further, the display unit 102 may display a button for switching the display between the preview screen and the operation interface, and switch and display each time the button is selected (pressed, touched, etc.).

On the other hand, when the adjustment method determination unit 1033 does not set the operation interface for adjusting the lines uniformly on the screen, the adjustment method determination unit 1033 adjusts each contour line individually in step S703, so that the adjustment method determination unit 1033 is divided. Calculate the degree to which the user adjustment is reflected for each area. In addition, this case corresponds to the case where the adjustment method determination unit 1033 sets the operation interface for individually adjusting the contour line. The adjustment method determination unit 1033 has divided regions d [0] [0] to [9] [9] based on the linear density lRate [0] [0] to [9] [9] calculated by the linear density calculation unit 1031. ], The area adjustment reflection degree aRate [0] [0] to [9] [9], which is the degree to reflect the individual adjustment of the user, is calculated. In this embodiment, since unnecessary lines are individually adjusted by the user in the coloring image, it is necessary to calculate how much the user adjustment is reflected for each pixel in the coloring image. Therefore, in this step, the adjustment method determination unit 1033 calculates the degree of reflecting the user adjustment for each division area d based on the linear density lRate. The area adjustment reflection degree aRate is a value in the range of 0 to 100, and the adjustment method determination unit 1033 reflects the individual adjustment of the user according to the magnitude of the value. For example, when the area adjustment reflection degree aRate is 0, the adjustment method determination unit 1033 does not reflect the individual adjustment of the user and does not reflect the area even if the adjustment is made. Further, when the area adjustment reflection degree aRate is 100, the adjustment method determination unit 1033 reflects the individual adjustment of the user as it is. Further, when the area adjustment reflection degree aRate is 50, the adjustment method determination unit 1033 determines a setting method that reflects 50% of the individual adjustment of the user. In this embodiment, when the linear density lRate is high, the adjustment method determination unit 1033 determines that the coloring image contains many unnecessary lines, sets the area adjustment reflection degree aRate to a high value, and sets each individual image. Determine the setting method that reflects the adjustment. Therefore, when the area adjustment reflection degree aRate is a large value such as 100, when the user is adjusted so that the line density is the lightest, the adjustment execution unit 1034 is set to the preset lightest density. Adjust the line so that it becomes. Here, as a numerical value for setting the line density, if a smaller numerical value is defined as a lighter darkness and a larger numerical value is defined as a darker numerical value, the lightest darkness is set by setting the smallest numerical value. It can be achieved, and the darkest density can be achieved by setting the largest value.

When the linear density lRate is low, the adjustment method determination unit 1033 determines that the coloring image does not contain many unnecessary lines, and determines a setting method that does not reflect individual adjustments so much. Therefore, when the area adjustment reflection degree aRate is a small value such as 0, the adjustment method determination unit 1033 determines a setting that does not reflect the user's adjustment even if the user adjusts so that the line density becomes the thinnest. .. For the divided region where the value of the linear density lRate is medium, the adjustment method determining unit 1033 calculates the region adjustment reflection degree aRate using the linear density lRate of the peripheral (adjacent) divided region. There are two possible division regions in which the value of the linear density lRate is medium, that is, a case where many contour lines are included and a case where contour lines and unnecessary lines are mixed. When the divided area d includes many contour lines, it is a necessary line for the coloring image. Therefore, the adjustment method determination unit 1033 has a small value such as 0 for the area adjustment reflection degree aRate so as not to make individual adjustments. To set. On the other hand, when the contour line and the unnecessary line are mixed in the division area d, the necessary line and the unnecessary line are mixed. Therefore, when the adjustment execution unit 1034 makes individual adjustments, the necessary line is adjusted. If you do not make individual adjustments, unnecessary lines will remain in the coloring image. Therefore, in this embodiment, the adjustment execution unit 1034 reflects the user adjustment to a certain extent so that a problem does not occur in either case. Therefore, when the area adjustment reflection degree aRate becomes a value such as 50, the adjustment method determination unit 1033 may determine the setting that reflects the user adjustment by 50%. At this time, if the user adjusts the line so that the line density is the lightest, the adjustment execution unit 1034 sets the line so that the line density is 50% of the preset thinnest line density. Adjust the darkness.
In this step, when the linear density lRate of the division region d to be determined is medium, it is assumed that a division region d having a high linear density lRate exists around the division region d to be determined. In this case, the adjustment method determination unit 1033 determines that the contour line and the unnecessary line are mixed in the division area d to be determined. This is because it is considered that an object containing unnecessary lines in the coloring image exists over a plurality of division areas d, and if there is a division area d having a high linear density lRate around the division area d to be determined, it is unnecessary. This is because it can be determined that the division area d belongs to the object including the line.

Further, when the linear density lRate of the division region d of the determination target is medium and the division region d having a high linear density lRate does not exist around the division region d of the determination target, the adjustment method determination unit 1033 determines the determination target. It is determined that only a large number of contour lines are included in the divided region d of. This is because there is no division area d having a high linear density lRate around the division area d to be determined, so that the division area d to be determined does not include an object containing unnecessary lines in the coloring image. This is because it can be determined. The details of this step of calculating the area adjustment reflection degree aRate will be described later.

Subsequently, in step S704, the adjustment method determination unit 1033 reflects the pixel for each pixel based on the area adjustment reflection degree aRate [0] [0] to [9] [9] for each division area. The adjustment reflection degree pRate is calculated. The area adjustment reflection degree aRate is a value calculated for each unit area d. Therefore, if there is a large difference in the value of the area adjustment reflection degree aRate even in the divided areas adjacent to each other, the degree of reflecting the user adjustment suddenly changes at the boundary of the divided areas, and a brightness step may occur. For example, when an object containing unnecessary lines in a coloring book such as a mountain leaf exists over a plurality of division areas d, the division area reflects 100% of user adjustment in a certain division area and is adjacent to the division area. Now, let's assume that the user adjustment is reflected by 50%. In this case, if the line density is adjusted, the degree of reflection of the user adjustment differs depending on the position even within the same object, so that the line density differs at the boundary of the divided area, resulting in a luminance step. Therefore, in this embodiment, the area adjustment reflection degree aRate of the division area d is interpolated on a pixel-by-pixel basis so that the area is smoothly changed so as not to cause a luminance step.

FIG. 9 is a diagram for explaining a process of calculating the pixel adjustment reflection degree pRate in the pixel P belonging to the divided region A. The pixel P is a pixel existing in the lower right region in the divided region A. Therefore, the pixel adjustment reflection degree pRate is set in the division area A to which the pixel P belongs, the division area B adjacent to the right side of the division area A, the division area C adjacent to the lower side of the division area A, and the lower right side of the division area A. It is calculated based on each area reflection degree aRate of the adjacent division area D. In addition, (Equation 1) is used for this calculation.
pRate = y × (x × aRateA + (1-x) × aRateB)
+ (1-y) x (x x aRateC + (1-x) x aRateD) (Equation 1)
In (Equation 1), aRateA, aRateB, aRateC and aRateD indicate the region adjustment reflection degree of the divided regions A, B, C and D, x indicates the composition ratio in the horizontal direction, and y indicates the composition ratio in the vertical direction. The composition ratios x and y are numerical values in the range of 0.5 to 1, and are determined according to the distance from the center of the division region to which the target pixel belongs. For example, when the pixel P exists in the center of the division area A, by setting x = 1 and y = 1, pRate = aRateA from (Equation 1), and the area adjustment reflection degree aRateA of the division area A is applied as it is. NS. Further, it is assumed that the synthesis rates x and y can be obtained from a table or a mathematical formula. In this embodiment, since the user adjustment is performed based on the pixel adjustment reflection degree pRate calculated by interpolating according to the pixel position using (Equation 1), the adjustment can be performed without generating a luminance step.

Subsequently, in step S705, the adjustment execution unit 1034 makes user adjustments to the coloring image using the adjustment method determined by the adjustment method determination unit 1033. This adjustment method includes processing using the above-mentioned linear density lRate, region adjustment reflection degree aRate, and pixel adjustment reflection degree pRate. The adjustment execution unit 1034 creates an image in which the user has adjusted using the operation interface for individually adjusting the unnecessary lines in the coloring image. At this time, the image control unit 103 causes the display unit 102 to display the preview screen and the operation interface for individually adjusting the lines.

FIG. 10 is a diagram showing an example of a preview screen displayed by the display unit and an operation interface. As shown in FIG. 10, the preview screen in which the user adjustment is performed on the coloring image and the operation interface in which the line is individually adjusted as shown in FIG. 6B are displayed on the display unit 102. NS. Further, in the method of adjusting the line density of the coloring image using the operation interface shown in FIG. 6B, the line density is uniformly adjusted on the screen by using the adjustment bar 602 as described above. The method is not limited to the method of individually adjusting unnecessary parts in the coloring image by using the adjustment bar 603. For example, at the time of adjustment using the adjustment bar 602, instead of performing uniform adjustment on the screen, a method of adjusting using the adjustment bar 602 may be used except for the parts to be individually adjusted using the adjustment bar 603. When the line density is adjusted uniformly on the screen using the adjustment bar 602, the adjustment is performed in common with the adjustment bar 601 shown in FIG. 6A of the operation interface when the adjustment is performed uniformly on the entire screen. The operations can be made common. In addition, even if the coloring image is a natural image and there are places in the coloring image that include unnecessary lines, it is not necessary for the user to make individual adjustments, and it is judged that there is no problem with only uniform screen adjustment. , It can be dealt with only by the adjustment using the adjustment bar 602. On the other hand, when the adjustment bar 602 is used to make adjustments other than the individual contour line adjustments, the lines required for the coloring image and the unnecessary lines can be adjusted independently of each other, so that user adjustment can be easily performed. Furthermore, the above-mentioned two adjustment methods may be switched. For example, the configuration may be such that the user can select either of the two adjustment methods from the outside, or the switching may be performed according to the area of the portion including the unnecessary line in the coloring image. .. In this way, user adjustment according to the coloring image can be realized.

FIG. 11 is a flowchart for explaining the details of the process of step S703 described with reference to the flowchart shown in FIG. The process described with reference to FIG. 11 is a process of calculating the area adjustment reflection degree aRate based on the linear density lRate of each unit area d of the image that is the source of the coloring image. In this embodiment, when the user adjusts the unnecessary lines individually in the coloring image, the adjustment method determining unit 1033 determines the degree to which the user adjustment is reflected for each pixel of the coloring image. Therefore, the adjustment method determination unit 1033 calculates the area adjustment reflection degree aRate, which is the degree to which the user adjustment is reflected for each unit area d according to the linear density lRate.

In step S1101, the adjustment method determination unit 1033 determines whether or not the area adjustment reflection degree aRate has been calculated for all the divided areas d of the image data. When the calculation of the area adjustment reflection degree aRate is completed for all the divided areas d, the process ends. On the other hand, when the calculation of the area adjustment reflection degree aRate is not completed for all the division areas d, the linear density lRate of the arbitrary division area d for which the calculation of the area adjustment reflection degree aRate is not completed in step S1102. Is compared with the preset threshold value th2. When the line density lRate is equal to or higher than the threshold value th2, the adjustment method determining unit 1033 determines that the division area d is a division area d in which only unnecessary lines exist in the coloring image because the line density lRate is high. Then, in step S1103, the adjustment method determination unit 1033 calculates and sets the area adjustment reflection degree aRate as 100 so as to reflect the individual adjustment. The adjustment method determination unit 1033 performs the process of step S1101 after the process of step S1103. Here, since it is determined that the divided region d under determination contains only unnecessary lines in the coloring image, individual adjustments are reflected. For example, since the divided regions d [1] [9] shown in FIG. 5 (b) include many unnecessary contour lines of mountain leaves in the coloring image, the linear density lRate [1] [9] is set to a high value. Become. Therefore, the adjustment method determination unit 1033 calculates the area adjustment reflection degree aRate [1] [9] as 100, and sets the individual user adjustment to be reflected 100%.

On the other hand, when the linear density lRate is less than the threshold value th2, the adjustment method determination unit 1033 compares the linear density lRate of the divided region d under determination with the preset threshold value th3. The threshold value th3 is a value smaller than the threshold value th2. When the linear density lRate is equal to or less than the threshold value th3, the adjustment method determining unit 1033 determines that the divided region d is a divided region d in which unnecessary lines do not exist in the coloring image and only contour lines exist. Then, in step S1105, the adjustment method determination unit 1033 calculates and sets the area adjustment reflection degree aRate as 0 so as not to reflect the individual adjustment. The adjustment method determination unit 1033 performs the process of step S1105 and then the process of step S1101. Here, since it is determined that the unit area d under determination includes only the lines necessary for the coloring image, individual adjustments are not reflected. For example, since the divided regions d [6] [7] shown in FIG. 5 (b) include only the outline of the building, which is a line required for the coloring image, the linear density lRate [6] [7] is a low value. become. Therefore, the adjustment method determination unit 1033 calculates the area adjustment reflection degree aRate [6] [7] as 0, and sets it so as not to reflect individual user adjustments.

On the other hand, when the linear density lRate is a value exceeding the threshold value th3, the adjustment method determination unit 1033 presets the linear density lRates of all the division regions d adjacent to the division region d under determination in step S1106. It is determined whether or not the threshold value is th4 or less. This is because when the linear density lRate of the divided region d under determination is medium, many contour lines are included based on the linear density lRate of the peripheral divided region d, or the contour lines and unnecessary lines are combined. It is for determining whether or not the case includes. When the linear density lRate of all the divided regions d adjacent to the divided region d is equal to or less than the threshold value th4, in step S1107, the adjustment method determining unit 1033 includes only a large number of contour lines in the divided region d being determined. Is determined. Therefore, the adjustment method determination unit 1033 calculates and sets the area adjustment reflection degree aRate of the divided area d under determination as 0 so that the individual adjustments are not reflected. For example, the divided regions d [5] [8] shown in FIG. 5 (b) include many contour lines of the windows of the building, which are necessary lines for the coloring image, and therefore have a linear density of lRate [5] [8]. Is a medium value. Further, since there is no division area d having a high linear density lRate around the division areas d [5] [8], the area adjustment reflection degree aRate [5] [8] is set to 0 so that individual user adjustments are not reflected. Set to. The adjustment method determination unit 1033 performs the process of step S1107 and then the process of step S1101.

On the other hand, if there is a division area d adjacent to the unit area d under determination and whose linear density lRate exceeds the threshold value th4, in step S1108, the adjustment method determination unit 1033 determines the division under determination. The area adjustment reflection degree aRate of the area d is calculated and set as 50. This is because it is determined that the divided region d under determination includes a contour line and an unnecessary line, so that no problem occurs with either line. For example, the divided regions d [0] [5] shown in FIG. 5B include a mountain contour line that is a line necessary for the coloring image and a mountain leaf contour line that is not necessary for the coloring image. Therefore, the linear density lRate [0] [5] has a medium value. Further, since the divided regions d [1] [6] having a high linear density lRate exist around the divided regions d [0] [5], the adjustment method determination unit 1033 determines the region adjustment reflection degree aRate [0] [0] [ 5] is set to 50 so as to reflect individual user adjustments to a medium degree. Further, in the process of step S1108, the region adjustment reflection degree aRate is set to a fixed value of 50, but a value corresponding to the average value of the linear density lRate of the adjacent divided regions may be used. Further, in this embodiment, the image data is divided into 10 horizontal × 10 vertical, and there may be many divided regions d including both contour lines and unnecessary lines. However, by increasing the number of divisions, the division area d including the contour line and the unnecessary line can be reduced, and the determination can be made with higher accuracy. The adjustment method determination unit 1033 performs the process of step S1108 and then the process of step S1101.

As described above, in step S205, the user adjustment of the coloring picture image created in step S202 is performed based on the operation interface for user adjustment according to the image that is the source of the coloring picture image. To create.

According to the above embodiment, when the user adjustment is performed on the coloring image, the user adjustment is individually performed for the portion including the unnecessary line from the linear density of the divided area and the linear density of the divided area around the divided area. You can set the operation interface to be performed. Therefore, in the past, it was difficult to perform optimal user adjustment when a contour line and an unnecessary line were included in the coloring image, but in this embodiment, the user adjustment is performed for each of the contour line and the unnecessary line. Therefore, the optimum user adjustment for the coloring image becomes possible. In this embodiment, an example of adjusting the line density for the coloring image is shown, but the content to be adjusted is not limited to the line density, but the number of lines, the thickness of the line, and the line. The color of the image may be adjusted, or a plurality of items may be adjusted at the same time.

(Example 2)
In the first embodiment, an example is shown in which an operation interface for individually adjusting the user for unnecessary lines is provided in the coloring image. In this embodiment, an example is shown in which an operation interface for performing user adjustment is provided for each object (object) including an unnecessary line in the coloring image. In this embodiment, by providing an operation interface capable of making individual user adjustments for each object including unnecessary lines in the coloring image, it is possible to perform user adjustments more finely than in the first embodiment. .. In particular, when there are different types of objects containing unnecessary lines in the coloring image, optimum user adjustment for each object becomes possible.

The overall configuration of this embodiment is the same as that of the first embodiment shown in FIG. 1, and the processing content of the image control unit 103 is different. Hereinafter, in the components that perform the same processing as in the first embodiment, the description of the processing will be omitted.
The image control unit 103 is executed when creating a coloring image as in the first embodiment. FIG. 12 is a flowchart for explaining the processing of the image control unit 103 in this embodiment. Similar to the first embodiment, the image control unit 103 acquires the original image of the coloring image from the image data acquisition unit 101, calculates the linear density for each divided region of the acquired image, and responds to the acquired image. Set the operation interface for user adjustment and perform user adjustment. Here, in the present embodiment, the process of setting the operation interface for performing the user adjustment according to the acquired image and performing the user adjustment is different from that of the first embodiment. In the first embodiment, in order to set an operation interface for adjusting unnecessary lines in the coloring image, if the image shown in FIG. 2B is the original image for creating the coloring image, individual adjustment is performed. Will reflect the same user adjustments for the left and right peaks included in this image. Even if they are different objects as shown in FIG. 2B, if they are similar objects to each other, there is no particular problem even if the same individual adjustment is performed. However, when there are a plurality of objects including unnecessary lines in the coloring image and they are different types of objects, it is convenient if individual adjustments can be made for each object. Therefore, the image control unit 103 sets an operation interface that can be individually adjusted for each object including unnecessary lines, and makes user adjustments for each object.

The processing of steps S1201 to S1203 is the same as the processing of steps S201 to S203 in the first embodiment.
In step S1204, the adjustment method determination unit 1033 sets an operation interface for performing user adjustment of the coloring image according to the linear density lRate for each divided region calculated in step S1203. Here, when the image read in step S1201 is an illustration image as shown in FIG. 2A, the adjustment method determination unit 1033 adjusts the lines uniformly on the screen as in the first embodiment. Set the face. On the other hand, a case where the image read in step S1201 is an image as shown in FIG. 2B will be described. The adjustment method determination unit 1033 sets an operation interface for uniformly adjusting the lines on the screen and an operation interface for individually adjusting each object including unnecessary lines in the coloring image, as in the first embodiment. Then, the adjustment method determination unit 1033 makes user adjustments for each object including unnecessary lines by the adjustment method determination unit 1033 and the adjustment execution unit 1034. Specifically, when the division regions d having a high linear density lRate exist adjacent to each other, the adjustment method determination unit 1033 has an object including an unnecessary line in the coloring image over the plurality of division regions d. Determine that it exists.

FIG. 13 is a diagram for explaining a process when an object is specified for the coloring image. FIG. 13A is a diagram in which the divided region d including the mountain on the left side included in the image when the image shown in FIG. 2B is the original image of the coloring image is surrounded by a thick line. Since the 16 divided regions d surrounded by the thick line shown in FIG. 13A include mountain leaves, which are unnecessary lines in the coloring image, the value of the linear density lRate becomes large. In this embodiment, the group composed of 16 divided regions d surrounded by the thick line shown in FIG. 13 (a) is referred to as group 1. Similarly, FIG. 13B is a diagram in which the divided region d including the mountain on the right side included in the image when the image shown in FIG. 2B is the original image of the coloring image is surrounded by a thick line. .. Since the nine divided regions d surrounded by the thick line shown in FIG. 13B include mountain leaves, which are unnecessary lines in the coloring image, the value of the linear density lRate becomes large. In this embodiment, the group composed of the nine divided regions d surrounded by the thick line shown in FIG. 13B is referred to as group 2.

In the process of step S1204, the adjustment method determination unit 1033 calculates the number of groups in which a plurality of divided regions d having a high linear density lRate exist adjacent to each other with respect to the original image of the coloring image. Then, the adjustment method determination unit 1033 sets an operation interface that can be individually adjusted for the number of calculated groups.

FIG. 14 is a diagram showing an example of an operation interface displayed on the display unit 102 in step S1204. The adjustment bar 1401 shown in FIG. 14 is an adjustment bar for adjusting the line density of the coloring image uniformly on the screen, similarly to the adjustment bar 601 shown in FIG. 6A. The adjustment bar 1402 shown in FIG. 14 is an adjustment bar for adjusting the line density with respect to the portion including the mountain on the left side included in the image shown in FIG. 2 (b). The adjustment bar 1403 shown in FIG. 14 is an adjustment bar for adjusting the line density with respect to the portion including the mountain on the right side included in the image shown in FIG. 2 (b). Here, if the display unit 102 has a touch panel function, the adjustment bars 1401, 1402, 1403 move to the right or left based on the touch operation of the user. Further, for example, when another input means such as a mouse or a keyboard is connected to or provided in the image generation device 100, the adjustment bars 1401, 1402, 1403 move to the right based on the input received from the user by the input means. Or move to the left.

FIG. 15 is a diagram showing another example of the operation interface displayed on the display unit 102 in step S1204. As shown in FIG. 15, as another example of the operation interface, a switching button 1501 is provided, and each time the switching button 1501 is selected (pressed, touched, etc.), the adjustment bar 1502 switches the target to be adjusted. But it's okay. In the operation interface shown in FIG. 15, in the initial state, the adjustment bar 1502 is an adjustment bar for adjusting lines uniformly on the screen. When the switching button 1501 is selected once (pressed, touched, etc.), the adjustment bar 1502 adjusts the line of the mountain portion on the left side included in the image shown in FIG. 2 (b). Then, when the switching button 1501 is selected twice (pressed, touched, etc.), the adjustment bar 1502 becomes an adjustment bar for adjusting the line of the mountain portion on the right side included in the image shown in FIG. 2 (b). Become. The order in which the adjustment bars for individual adjustments are displayed may be the order in which the adjustment bars are displayed by calculating the priority, for example, the order according to the size of the area of the portion where the individual adjustments are performed.

In step S1205, the adjustment method determination unit 1033 and the adjustment execution unit 1034 adjust the coloring image created in step S1202 by using the operation interface set in step S1204. In this embodiment, in order to adjust the lines for each object including unnecessary lines in the coloring image, the process of step S105 of the first embodiment is performed for each group classified in step S1204. A case where the image shown in FIG. 2B is the original image of the coloring image will be described. The adjustment method determination unit 1033 calculates the area reflection degree aRate and the pixel adjustment reflection degree pRate in the 16 divided areas d surrounded by the thick line shown in FIG. 13 (a) classified into the group 1 in step S1204. do. Then, the adjustment method determination unit 1033 adjusts the coloring image in step S1205. Further, the adjustment method determination unit 1033 sets the area reflection degree aRate and the pixel adjustment reflection degree pRate in the nine division areas d surrounded by the thick line shown in FIG. 13B, which are classified into the group 2 in step S1204. The calculation is performed, and the coloring image is adjusted in step S1205. Then, in step S1206, the image printing unit 104 prints the coloring picture image created by performing user adjustment.

As described above, according to the present embodiment, when the user adjustment is performed on the coloring image, when there are a plurality of types of objects including unnecessary lines in the coloring image, individual adjustments are made for each object. It becomes possible and finer user adjustment can be performed.

(Example 3)
In Examples 1 and 2, an example in which the preview screen of the coloring picture image being adjusted and the operation interface are displayed on one display unit is shown. In this embodiment, an example is shown in which the preview screen of the coloring picture image being adjusted and the operation interface are displayed on separate display units.

When the preview screen and the operation interface of the coloring picture image being adjusted are displayed on one display unit as in Examples 1 and 2, the display of the preview screen and the operation interface becomes small, and the contents are difficult to see and the user. Adjustment can be difficult. In this embodiment, by displaying the preview screen of the coloring picture image being adjusted and the operation interface on separate display units, each screen can be displayed on a wide display unit, and user adjustment from the outside can be performed. Will be easier to implement.

The overall configuration of this embodiment is the same as that of the first embodiment shown in FIG. 1, and the processing content of the image control unit 103 is different. The display unit 102 includes two display displays. Hereinafter, in the components that perform the same processing as in the first embodiment, the description of the processing will be omitted.
The image control unit 103 is executed when creating a coloring image as in the first embodiment. Similar to the first embodiment, the image control unit 103 acquires the original image of the coloring image from the image data acquisition unit 101, calculates the linear density for each divided region of the acquired image, and responds to the acquired image. Set the operation interface for user adjustment and perform user adjustment. In the first and second embodiments, the preview screen of the coloring image being adjusted and the operation interface are displayed on the display unit 102 composed of one display. In this embodiment, the display unit 102 is composed of a plurality of displays, and the preview screen of the coloring picture image being adjusted and the operation interface are displayed on different display displays. The display unit 102 displays the preview screen of the coloring image being adjusted by the image control unit 103 and the operation interface on separate display displays. Further, one of the display displays of the display unit 102 may be mounted on a device different from the image generation device 100.

As described above, according to the present embodiment, when the user adjusts the coloring image, the preview screen of the coloring image being adjusted and the operation interface can be displayed on different displays. Become. Therefore, each screen can be displayed on a wide display unit, user adjustment from the outside can be easily performed, and visibility at the time of adjusting the coloring image can be improved.

100 Image generator 101 Image data acquisition unit 102 Display unit 104 Image printing unit 1031 Linear density calculation unit 1032 Contour line image creation unit 1033 Adjustment method determination unit 1034 Adjustment execution unit

Claims (14)

The image data acquisition unit that acquires image data and
A contour line creation unit that creates a contour line image by extracting the contour lines of the image data acquired by the image data acquisition unit, and a contour line creation unit.
A line density calculation unit that divides the contour line image created by the contour line creation unit into predetermined division regions and calculates the linear density for each division region.
An adjustment method determination unit that determines an adjustment method for the contour line image based on the linear density for each divided region calculated by the linear density calculation unit.
An image generation device including an adjustment execution unit that adjusts the contour line image by using the adjustment method determined by the adjustment method determination unit. In the image generator according to claim 1,
The adjustment method determining unit is an image generation device that determines an adjustment method that can individually adjust the contour line with respect to the contour line image of the divided region whose linear density is equal to or higher than a predetermined threshold value. In the image generator according to claim 2,
The adjustment method determining unit determines the region reflection degree for adjusting the contour line image of the divided region based on the linear density of the divided region and the linear density of the divided region adjacent to the divided region. Generator. In the image generator according to claim 3,
The adjustment method determining unit determines the pixel reflection degree for adjusting the contour line image included in the divided region for each pixel according to the region reflection degree and the distance from the center of the divided region. Generator. In the image generator according to any one of claims 2 to 4.
The adjustment method determining unit is an adjustment method capable of individually adjusting each of the objects included in the divided regions with respect to the contour line images of a plurality of divided regions adjacent to each other having the linear density equal to or higher than a predetermined threshold value. An image generator that determines. In the image generator according to any one of claims 1 to 5,
When the image data does not have a divided region whose line density is equal to or higher than a predetermined threshold value, the adjustment method determining unit determines an image generation method that can uniformly adjust the image data with respect to the contour line image. Device. In the image generator according to any one of claims 1 to 6,
It has an input unit that accepts operations from the outside.
The adjustment method determining unit is an image generation device that determines an adjusting method of the contour line image based on the input received by the input unit. In the image generator according to claim 7,
The adjustment method determining unit is an image generation device that determines the density of the contour line image based on the input received by the input unit. In the image generator according to any one of claims 1 to 8.
An image generation device having an image printing unit that prints the contour line image adjusted by the adjustment executing unit. In the image generator according to any one of claims 1 to 9.
An image generation device having a display unit that displays the contour line image adjusted by the adjustment execution unit. The process of acquiring image data to the device and
The process of creating a contour line image by extracting the contour line of the acquired image data, and
The process of dividing the created contour line image into a predetermined division area, and
The process of calculating the linear density for each divided region and
A process of determining an adjustment method for the contour line image based on the calculated linear density for each divided region, and a process of determining the adjustment method for the contour line image.
An image generation method that performs a process of adjusting the contour line image using the determined adjustment method. In the image generation method according to claim 11,
An image generation method for determining an adjustment method that can individually adjust the contour line for a contour line image of a divided region in which the line density is equal to or higher than a predetermined threshold value. In the image generation method according to claim 12,
An image generation method for determining a region reflection degree for adjusting the contour line image of the divided region based on the linear density of the divided region and the linear density of the divided region adjacent to the divided region. In the image generation method according to claim 13,
An image generation method for determining the pixel reflection degree for adjusting the contour line image included in the divided region for each pixel according to the region reflection degree and the distance from the center of the divided region.

Images