JP6882043B2 - Image processing equipment, programs and image processing methods - Google Patents

Description

The present invention relates to an image processing apparatus having an image processing means for executing image processing on image data.

Conventionally, various image processings have been performed in order to clarify the characters of the image data. For example, when the outline character is expanded, the edge of the character is detected to determine whether or not the outline character is expanded.

For example, it is determined whether or not the character edge detection unit that detects the character edge from the tag data indicating the attribute of the input image data and the character edge detected by the character edge detection unit are the outer edges of the white characters. Outside the white character for each of the white character judgment unit, the first pixel of the character determined to be the outer edge of the white character by the white character judgment unit, and at least the second pixel adjacent to the pixel. An invention including an expansion processing unit that performs expansion processing according to a difference between a white level of an edge and a white level of an outer edge of a white character and a white level of a white character is disclosed (for example, a patent). See Document 1).

Japanese Unexamined Patent Publication No. 2011-254271

If the edge of the object included in the image data can be appropriately determined, for example, it is possible to expand the white characters or perform appropriate processing to execute the image enhancement processing.

However, with the conventional technique, it has been difficult to appropriately determine the edge of an object included in the image data.

For example, in the above-mentioned Patent Document 1, when expanding outline characters, character edges are detected first from the attributes of the image, and then expansion of outline characters is performed with reference to bitmap data. Due to its complexity, there is a problem that it is not suitable for simultaneously performing various processes such as shrinkage of characters and expansion of outline characters.

In view of the above-mentioned problems, an object of the present invention is to provide an image processing apparatus or the like capable of performing appropriate image processing with simpler processing as compared with the conventional one.

In view of the above-mentioned problems, the image processing apparatus of the present invention is
In an image processing apparatus having an image processing means for executing image processing on image data,
A storage means for storing an attribute condition table that stores the attribute of the second pixel as an attribute condition in association with the attribute of the first pixel.
An attribute bitmap generating means for generating an attribute bitmap indicating the type of the object included in the image data for each pixel, and
A first determination means for determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second determination means for determining
When the attribute of the adjacent pixel is included in the attribute condition as the second pixel, the replacement means for replacing the attribute and the pixel value of the pixel of interest with the attribute and the pixel value of the adjacent pixel.
It is characterized by having.

The image processing apparatus of the present invention
In an image processing apparatus having an image processing means for executing image processing on image data,
A storage means for storing an attribute condition table that stores the attribute of the second pixel as an attribute condition in association with the attribute of the first pixel.
An attribute bitmap generating means for generating an attribute bitmap indicating the type of the object included in the image data for each pixel, and
A first determination means for determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second determination means for determining
When the attribute of the adjacent pixel is included in the attribute condition as the second pixel, the replacement means for replacing the attribute of the pixel of interest with the attribute of the edge,
It is characterized by having.

The program of the present invention
For computers that realize image processing functions that perform image processing on image data
A storage function that stores an attribute condition table that stores the attributes of the second pixel as attribute conditions in association with the attributes of the first pixel,
An attribute bitmap generation function that generates an attribute bitmap that indicates the type of object included in the image data for each pixel, and
A first determination function for determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second judgment function to judge
A replacement function that replaces the attribute and pixel value of the pixel of interest with the attribute and pixel value of the adjacent pixel when the attribute of the adjacent pixel is included in the attribute condition as the second pixel.
To realize.

The program of the present invention
For computers that realize image processing functions that perform image processing on image data
A storage function that stores an attribute condition table that stores the attributes of the second pixel as attribute conditions in association with the attributes of the first pixel,
An attribute bitmap generation function that generates an attribute bitmap that indicates the type of object included in the image data for each pixel, and
A first determination function for determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second judgment function to judge
A replacement function that replaces the attribute of the pixel of interest with the attribute of the edge when the attribute of the adjacent pixel is included in the attribute condition as the second pixel.
To realize.

According to the image processing apparatus of the present invention, the attribute of the second pixel is stored as an attribute condition in association with the attribute of the first pixel, and the attribute indicating the type of the object included in the image data is stored for each pixel. Generate the attribute bitmap shown in. Then, when the attribute of the pixel of interest is included in the attribute condition as the first pixel, it is determined whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. However, when it is included in the attribute condition, the attribute and pixel value of the pixel of interest are replaced with the attribute and pixel value of the adjacent pixel. As a result, it is possible to perform appropriate image processing by appropriately replacing the pixel of interest with an adjacent pixel according to the attribute condition.

It is external perspective view of the image forming apparatus in 1st Embodiment. It is a figure for demonstrating the functional structure of the image forming apparatus in 1st Embodiment. It is a figure for demonstrating the PDL interpreter part, the image control part, and the print control part in 1st Embodiment. It is a figure for demonstrating the attribute in 1st Embodiment. It is a figure for demonstrating the user setting part in 1st Embodiment. It is a figure which showed an example of the attribute condition in 1st Embodiment. It is a figure which showed an example of the attribute condition in 1st Embodiment. It is an operation flow for demonstrating the flow of processing in 1st Embodiment. It is a figure for demonstrating the mask pattern in 1st Embodiment. It is a figure for demonstrating the operation in 1st Embodiment. It is a figure for demonstrating the operation in 1st Embodiment. It is an operation flow for demonstrating the flow of processing in 2nd Embodiment. It is a figure for demonstrating the PDL interpreter part, the image control part, and the print control part in 3rd Embodiment. It is a figure for demonstrating the attribute in 3rd Embodiment. It is a figure for demonstrating the user setting part in 3rd Embodiment. It is a figure which showed an example of the attribute condition in 3rd Embodiment. It is a figure which showed an example of the attribute condition in 3rd Embodiment. It is an operation flow for demonstrating the flow of processing in 3rd Embodiment. It is a figure for demonstrating the mask pattern in 3rd Embodiment. It is a figure for demonstrating the operation in 3rd Embodiment. It is a figure for demonstrating the operation in 3rd Embodiment. It is a figure for demonstrating the user setting part in 4th Embodiment. It is an operation flow for demonstrating the flow of processing in 4th Embodiment.

Hereinafter, an embodiment for carrying out the present invention will be described with reference to the drawings. In this embodiment, the case where the image processing device is applied to a digital multifunction device will be described as an example, but it goes without saying that any device that performs image processing can be applied to devices such as printers and fax machines. ..

[1. First Embodiment]
[1.1 Configuration]
First, the configuration of the image forming apparatus 1 having the image processing apparatus will be described with reference to FIGS. 1, 2, and 3.

FIG. 1 is a diagram schematically showing an external perspective view of the image forming apparatus 1. Further, FIG. 2 is a block diagram (functional configuration diagram) for explaining the functional configuration of the image forming apparatus 1, and FIG. 3 is a block for explaining the PDL interpreter unit 1100, the image control unit 1200, and the print control unit 1300. It is a figure.

As shown in FIG. 2, the image forming apparatus 1 includes a control unit 1000, a PDL interpreter unit 1100, an image control unit 1200, a print control unit 1300, an image input unit 1400, an image forming unit 1500, and a storage unit. It is configured to include a 1600, an operation display unit 1700, and a communication unit 1800.

The control unit 1000 is a functional unit for controlling the entire image forming apparatus 1. The control unit 1000 realizes various functions by reading and executing various programs stored in the storage unit 1600, and is configured by, for example, a CPU (Central Processing Unit).

The image input unit 1400 reads an image of a document and generates image data, and is composed of a scanner device or the like equipped with a device for converting optical information such as a CCD (Charge Coupled Device) into an electric signal. .. The image input unit 1400 may capture an image captured by a digital camera or the like from the outside in addition to a scanner device or the like, or may use a USB memory, a storage medium such as a compact flash (registered trademark), or communication. Manuscript data may be input (received) from another terminal via unit 1800.

The image forming unit 1500 is a functional unit for forming image data on a recording medium (for example, recording paper). For example, the recording paper is fed from the paper feed tray 1350 of FIG. 1, and after an image is formed on the surface of the recording paper in the image forming unit 1500, the paper is discharged from the paper ejection tray 1550. The image forming unit 1500 is composed of, for example, a laser printer or the like using an electrophotographic method.

The manuscript data is received from another device such as an information processing device connected via the communication unit 1800. Here, as data received from another device, for example, PDL data indicated by PDL (Page Description Language) is received. The received PDL data is output to the PDL interpreter unit 1100 and processing is executed.

The PDL data received by the PDL interpreter unit 1100 is processed by the PDL interpreter unit 1100, the image control unit 1200, and the print control unit 1300, and output from the image forming unit 1500.

Specifically, the recording paper is conveyed from the paper feed tray 1350, and the image subjected to the above processing is output to the recording paper by the image forming unit 1500. Then, the recording paper on which the image is formed is output from the output tray 1550.

In the present embodiment, the processed image will be described as an example of being output to a recording paper, but may be stored in a USB memory or stored in a cloud server, for example.

Here, the functional configurations and operations of the PDL interpreter unit 1100, the image control unit 1200, and the print control unit 1300 will be described with reference to FIG.

The PDL interpreter unit 1100 includes an input interface unit 110, a reception buffer unit 120, a command analysis unit 130, an intermediate data generation unit 140, a bitmap generation unit 150, and an attribute bitmap generation unit 160.

The input interface unit 110 temporarily stores a file including the PDL data 80 sent from another information processing device in the reception buffer unit 120. The file containing the PDL data 80 stored in the reception buffer unit 120 is passed to the command analysis unit 130. Although the reception buffer unit 120 is described for convenience, a buffer area may be provided in the storage unit 1600 described later.

The command analysis unit 130 sequentially extracts and analyzes PDL commands included in the PDL data 80.

The intermediate data generation unit 140 generates intermediate data including information on the type of each drawing object on the output target page based on the input drawing command (PDL command) included in the PDL data 80.

For example, the intermediate data generation unit receives the analyzed PDL command and generates well-known intermediate data for printing classified by band data units to be generated based on the PDL command.

In this intermediate data, data for forming an object (drawing object) representing an object to be drawn and attributes of the object (type of drawing object, coordinates, etc.) are described.

The bitmap generation unit 150 generates bitmap data (bitmap image) of the output target page based on the intermediate data obtained by the intermediate data generation unit 140. The bitmap data generated by the bitmap generation unit 150 is preferably data that is generally used, and is therefore preferably RGB format or CMYK format data.

For example, the bitmap generation unit 150 generates 8-bit bitmap data for each color of RGB or CMYK from the intermediate data. In addition, a color space such as sRGB, HSV, or HLS may be used.

The attribute bitmap generation unit 160 corresponds to each pixel (pixel) constituting the bitmap data based on the intermediate data obtained by the intermediate data generation unit 140, and has an attribute indicating the above type for each pixel. Generate attribute bitmap data (attribute bitmap image) consisting of (attribute data).

This attribute bitmap data is, for example, 3-bit data for each pixel described using the attribute shown in FIG. 4 (attribute data indicating the attribute). The attribute defines a 3-bit value for each type of drawing object.

The attribute bitmap data is the value indicated by the attribute described in the intermediate data for each pixel of the intermediate data (for example, "000" for no object, "001" for white characters, "010" for characters, and white vector graphics. Is "011", the vector graphic is "100", the raster is "101", and the edge is "110").

Subsequently, the image control unit 1200 includes an image replacement determination unit 210, an image replacement processing unit 220, a bitmap data compression unit 230, and an image storage processing unit 240.

The image replacement determination unit 210 determines, from the attribute bitmap data obtained by the attribute bitmap generation unit 160, a pixel to be a replacement pixel in the image data so as to meet the conditions set by the user setting unit. Here, the user setting unit is a function of setting processing for an image and outputting it to the user setting information 1610 of the storage unit 1600.

The image replacement processing unit 220 is a functional unit that replaces pixel information determined to be replacement pixels among the pixels of the image data. Specifically, the pixel information of the adjacent pixel is copied to the pixel of interest detected by the image replacement determination unit 210. Here, the pixel information refers to information related to pixels, and for example, in the present embodiment, it refers to pixel values and attributes.

The bitmap data compression unit 230 individually compresses the bitmap data and the attribute bitmap data by a compression method suitable for each bitmap, and the image storage processing unit 240 stores and stores them in the storage unit 1600.

The print control unit 1300 includes an image reading unit 310, a bitmap decompression unit 320, a color conversion / γ / filter / screen processing unit 330, and a print processing unit 340.

When the image storage processing unit 240 stores one page of data, the image reading unit 310 stores the bitmap data of the page to be printed, the attribute bitmap data, and various information necessary for printing in the storage unit 1600. Read from. At this time, various information is set for the video controller included in the print processing unit 340.

When the operation mode set in the video controller is the color mode, the image forming unit 1500 is set to operate in the color mode by transmitting a command for operating the image forming unit 1500 in the color mode.

The bitmap decompression unit 320 individually decompresses the read compressed bitmap data and attribute bitmap data by a color determination / compression / decompression circuit, and the color conversion / γ / filter / screen processing unit 330 uses CMYK. Converts each color to 4 bits and transfers it to the video controller.

When the image data transfer request is transmitted from the image forming unit, the video controller transmits the image data of each CMYK color to the print processing unit 340 in accordance with a predetermined synchronization signal.

The print processing unit 340 executes the print process. As the printing process, for example, the image forming unit 1500 outputs the output 90 in which the image is formed on the recording paper.

The storage unit 1600 is a functional unit that stores various programs and various data necessary for the operation of the image forming apparatus 1. The storage unit 1600 is composed of, for example, a semiconductor memory such as an SSD (Solid State Drive), an HDD (Hard Disk Drive), or the like. Further, the storage area may be provided not in the storage device of the image forming device 1 but in, for example, a cloud server connected via a network.

Further, the storage unit 1600 stores the user setting information 1610 and the attribute condition setting table 1620 in which the attribute conditions are set.

The user setting information 1610 stores the settings made by the user in processing the image. The value set by the user setting unit is stored in the user setting information 1610. As the user setting unit, for example, as shown in FIG. 5, the user setting unit may be displayed and set by the operation display unit 1700, or may be set on the print driver setting screen in the information processing device connected to the image forming device 1. May be done.

The attribute condition setting table 1620 stores the attributes of the pixel of interest to be processed and the attributes of the adjacent pixels adjacent to the pixel of interest in executing the expansion / contraction processing as the image processing. As for this attribute condition, one attribute condition may be stored or may be stored for each user setting. Further, although it is stored in advance, it may be possible for the user to set it.

The attribute conditions of the attention pixel A0 and the adjacent pixel Ai may be stored for each user setting. For example, the attribute condition of FIG. 6 is an attribute condition when "character: contraction" and "outline character: expansion" are selected as user settings. When the attribute of the pixel of interest A0 is "character", the attributes of the adjacent pixel Ai are stored as "no object", "white vector graphic", "vector graphic", and "raster".

When the attribute of the attention pixel A0 is "vector graphic", the attribute of the adjacent pixel Ai is "white character", and when the attribute of the attention pixel A0 is "raster", the attribute of the adjacent pixel Ai is "". It is remembered as "white letters".

Similarly, FIG. 7 is also a diagram showing attribute conditions. FIG. 7 shows the attribute conditions when "character + graphic + image: expansion" is selected as the user setting. As shown in FIG. 7, for example, when the attribute of the pixel of interest A0 is "no object", the attributes of the adjacent pixel Ai are stored as attribute conditions in association with "character", "vector graphic", and "raster". There is.

As described above, one attribute condition may be stored or a plurality of attribute conditions may be stored. When a plurality of items are stored, they are stored in association with the user settings, and appropriate attribute conditions are read out according to the user settings.

Further, each attribute condition is stored for each user setting, and may be read in combination. For example, "expansion" and "contraction" are stored for the target "character", and "expansion" and "contraction" are stored for the "outline character", and by reading these in combination, one attribute condition may be obtained.

The operation display unit 1700 is an input device / display device for the user to input operations and display various information to the user. The input device is composed of any known device such as a hardware key, and the display layer is composed of any known device such as a liquid crystal display. Further, an operation display device in which an input device such as a touch panel display and a display device are integrated may be used.

The communication unit 1800 is a functional unit for connecting to a network, and can be connected by wire / wireless. For example, it is possible to communicate with other information processing devices and image forming devices, and to communicate with a server.

[1.2 Processing flow]
Subsequently, the flow of processing in this embodiment will be described with reference to FIG.

First, the attribute condition is set with respect to the user setting set by the user (step S102). For example, as shown in FIG. 5, when the user sets "character: contraction" and "outline character: expansion" in the user setting unit, the attribute condition of FIG. 6 is set. Further, when the user sets "character + graphic + image: expansion", the attribute condition of FIG. 7 is set. That is, attribute conditions are prepared in advance for each setting that can be selected by the user.

The attribute condition is appropriately read from the attribute condition setting table 1620. Here, in the present embodiment, it is read from the attribute condition setting table 1620, but for example, the user may set it. Further, the attribute condition may be read from the cloud.

Subsequently, the image replacement determination unit 210 determines whether or not the attention pixel A0 should perform the image replacement process by scanning the entire surface of the image with the mask pattern of FIG.

Here, the mask pattern of FIG. 9 is composed of the pixel of interest A0 and the adjacent pixels A1 and A2. What is determined as adjacent pixels are pixels in the scanning direction of the image. Specifically, as shown in FIG. 10, when the pixels are scanned from P10 to the right, P12, which is the right side of the pixel of interest A0, is the adjacent pixel A1.

When the scan is completed to the right, the line moves down one line. That is, scanning is performed to the right from P14. In this case, P14, which is the lower side of the pixel of interest A0, becomes the adjacent pixel A2.

Next, it is determined whether or not the attribute of the pixel of interest A0 matches the attribute condition (step S104).

More specifically, with reference to FIG. 6, first, it is determined whether the attribute of the attention pixel A0 is the attribute condition of the attention pixel of FIG. 6, “character”, “vector graphic”, and “raster”. Here, if the pixel of interest A0 has other attributes, it is determined that the attribute conditions are not met (step S104; No).

If the attribute of the pixel of interest A0 matches the attribute condition (step S104; Yes), the initial value 1 is set in i (step S106). Since i is still 1, it is determined whether the attribute of the adjacent pixel Ai (A1) matches the attribute condition (step S108; Yes → step S110). Specifically, when the attribute of the pixel of interest A0 is "character", it is determined whether or not the attribute of the adjacent pixel A1 is "no object", "white vector graphic", "vector graphic", or "raster". do.

Here, if the attributes of the adjacent pixels Ai do not match the attribute conditions (step S110; No), i is incremented (step S114), and the determination is repeated until i becomes 3 (that is, A2).

Here, when the attribute of the adjacent pixel Ai matches the attribute condition, the attribute and the pixel value are copied to the attention pixel A0 as the pixel information of the adjacent pixel Ai (step S110; Yes → step S112). That is, the pixel information of the pixel of interest A0 is replaced with the pixel information of the adjacent pixel Ai.

When the attributes of the pixel of interest A0 and the adjacent pixel Ai do not match the attribute conditions (step S104; No / step S108; No), or after the pixel information of the adjacent pixel Ai is copied to the pixel of interest A0 (step S112), If it is not the last data (the last pixel to be the target in the image data), the same processing is executed for the next pixel (step S126; No → step S128 → step S104). In the case of the last data (last pixel), this process ends (step S126; Yes).

Here, it is preferable that adjacent pixels are excluded as to whether or not it is the last pixel. For example, as shown in FIG. 10, the pixels in the gray portions at the right end and the lower end are not the target of the attention pixel A0.

[1.3 Operation example]
Subsequently, the operation in the present embodiment will be described with reference to FIG. FIG. 11 describes a process when the character is expanded.

Here, in FIG. 11, the pixels (mass) on the white background are pixels with "no object" as an attribute. Further, the pixel of "T" on the white background is the pixel of "character" as an attribute. Further, the pixel of "T" in the colored background is a pixel that was originally "no object" but changed to "character" by the expansion process.

Taking pixel P20 as an example, the attribute of pixel P20 (pixel of interest A0) is initially "no object". Further, since the pixel to the right of the pixel P20 (adjacent pixel A1) also has the attribute of "no object" at first, the attribute conditions do not match between the attention pixel A0 and the adjacent pixel A1.

However, the pixel P22 below the pixel P20 is a pixel with the attribute "character". In this case, the attribute conditions are the same for the pixel of interest A0 and the adjacent pixel A2. Therefore, the pixel information (attribute and pixel value) of A2 is copied to A0 and replaced. As a result, the pixel P20 becomes the attribute "character" and becomes the pixel value of the pixel P22, and as a result, the character expands.

Similarly, pixel P24 will be described. When the pixel of interest A0 is the pixel P24, the pixel P26 on the right side is the adjacent pixel A1. This pixel P26 is a pixel of the attribute "character". In this case, the attribute conditions are the same for the pixel of interest A0 and the adjacent pixel A1. Therefore, the pixel information (attribute and pixel value) of A1 is copied to A0. This causes the characters to expand.

In this way, as each case (a case that can be selected in the user setting unit (driver / operation panel)), the condition for copying the attribute and pixel value of the adjacent pixel to the pixel of interest is internally retained for the user setting in advance. From the attribute bitmap data obtained by the attribute bitmap generator including color information, it is determined whether or not the attributes of the pixel of interest and the adjacent pixel match the conditions set by the user setting unit, and the conditions are met. In that case, the pixel values and attribute information of the adjacent pixels can be copied to the pixel of interest to perform expansion / contraction.

Here, as a condition for copying an attribute and a pixel value as pixel information of a pixel adjacent to the pixel of interest, the attributes of the pixel of interest and the adjacent pixel are different, and the priority for copying is determined for each attribute, and as a processing condition. It may be uniquely decided.

That is, the expansion of characters is the most important as the expansion process. When expanding a character, in other words, the vector is contracted. Therefore, the priority may be set as the type (object) to expand.

For example, priority is given to the pixel of interest A0 in the order of "character", "vector", and "raster". Thereby, it may be decided which pixel is executed first.

[2. Second Embodiment]
Next, the second embodiment will be described. The second embodiment is an embodiment in which, in addition to the first embodiment, processing of raster data is separately executed when the raster area is entered in the image.

The functional configuration is the same as that of the first embodiment. The second embodiment replaces the processing flow of FIG. 8 of the first embodiment with FIG. 12. The same processing will be designated by the same reference numerals and description thereof will be omitted.

As shown in FIG. 12, steps S104 to S112 are expansion / contraction processing described in the first embodiment. In the present embodiment, processing in the case of a raster is added to steps S116 to S124. In the case of raster data, it is not always possible to detect edges that expand and contract depending on the type of object. Therefore, it is effective to combine different processes as in the present embodiment.

The processing of the raster area can be selected by the user, and for example, it can be selected without executing the processing separately.

In the raster area, in step S116, it is determined how the settings related to the image are set. Here, when the image is set to "expand" (step S116; image = expansion), and when the attributes of A0, A1, and A2 are rasters (step S118; Yes), the raster expansion process is performed. It is executed (step S120).

If the image is set to "shrink" (step S116; image = shrink), and if the attributes of A0, A1, and A2 are rasters (step S122; Yes), the raster shrinkage process is executed. (Step S124).

If there is no setting related to the image (step S116; image = no setting), or if there is an image setting but the attributes of A0, A1, and A2 are not rasters (step S118; No / step S122; No), the process is performed. Is not executed.

Here, the raster expansion process and the raster contraction process are performed by the following methods as an example.
In case of RGB format <Raster expansion processing method>
if (pixel value of noteworthy pixel A0> MIN (pixel value of adjacent pixel A1, pixel value of adjacent pixel A2))
Pixel value of pixel A0 of interest = MIN (pixel value of adjacent pixel A1, pixel value of adjacent pixel A2)
<Raster shrinkage processing method>
if (pixel value of noteworthy pixel A0 <MAX (pixel value of adjacent pixel A1, pixel value of adjacent pixel A2))
Pixel value of pixel A0 of interest = MAX (pixel value of adjacent pixel A1, pixel value of adjacent pixel A2)

That is, as the raster expansion processing, by replacing the pixel value with a smaller one (minimum value), the number of pixels with a high density increases and the pixel is expanded. Further, as the raster shrinkage processing, by replacing it with a pixel having a large pixel value (maximum value), the number of pixels having a low density increases and the pixel is shrunk.

The above-mentioned method is in the case of RGB format, and appropriate processing is performed in other methods. For example, in the case of the CMYK method, the relationship between the maximum and the minimum is reversed, and the expansion process is replaced with a large one and the contraction process is replaced with a small one.

In this way, when the attributes of the pixel of interest and the adjacent pixel are rasters, in the expansion processing in the RGB format, when the minimum value of the adjacent pixel is smaller than the pixel of interest, the minimum pixel value of the adjacent pixel is copied to the pixel of interest. Will be done. Further, in the shrinkage process, when the maximum value of the adjacent pixel value is larger than that of the pixel of interest, the maximum pixel value of the adjacent pixel is copied to the pixel of interest.

In the present embodiment, it has been described that the processes of steps S116 to S124 are executed after the processes of steps S104 to S112 of the first embodiment are executed. However, it goes without saying that the object of the invention can be achieved even if the treatment is performed in reverse.

[3. Third Embodiment]
Next, the third embodiment will be described. The third embodiment is an embodiment for efficiently executing edge detection when executing image enhancement processing.

Although the overall functional configuration is the same as that of the first embodiment, the configuration of the image control unit is different, and FIG. 3 of the first embodiment is replaced with FIG. In this embodiment, the points different from those in the first embodiment will be mainly described. That is, the image control unit 1200 of the first embodiment is replaced with the image control unit 1210.

The image control unit 1210 includes an image edge determination unit 212, an attribute conversion processing unit 214, a bitmap data compression unit 230, and an image storage processing unit 240.

The image edge determination unit 212 determines the edge portion of the image from the attribute bitmap data obtained by the attribute bitmap generation unit 160 so as to meet the conditions set by the user setting unit.

Here, since color information is important in the image enhancement process, the attribute bitmap generation unit 160 generates attribute bitmap data (attribute bitmap image) containing more color information than in the first embodiment.

For example, as shown in FIG. 14, in addition to the types of drawing objects, white, gray, and color information are used as attributes at the time of edge determination, and 4-bit data is provided for each pixel. Here, the white condition is R = G = B = 255, the gray condition is R = G = B equal amount and other than white, and the color condition is data other than white and gray.

Further, the attribute conversion processing unit 214 converts the attribute of the pixel of interest determined by the image edge determination unit 212 into the attribute of the “edge”.

Then, the pixel determined to be an edge by the image control unit 1210 and converted into an edge attribute is subjected to a color conversion process, a γ process, a filter process, and a screen process suitable for the edge.

The user sets the image enhancement processing condition as an example of the user setting in the user setting unit of FIG. When "character + outline character" is set for the entire color / monochrome area as the image enhancement processing condition, the attribute condition of FIG. 16 is set. The attribute conditions in FIG. 16 are clear from the description in the figure. For example, when the attribute (object type) of the pixel of interest A0 is "gray character", the attribute of the adjacent pixel Ai is "no object" and "white vector". These are "graphics", "gray vector graphics", "color vector graphics", and "rasters".

Further, when "character + outline character" is set for the monochrome area as the image enhancement processing condition, the attribute condition of FIG. 17 is set.

The attribute conditions of FIG. 17 are clear from the description in the figure, but the attributes of the pixel of interest A0 are only "gray characters" and "gray vector graphics". This is because jaggies are easily noticeable for black images, and user demands are strict. Therefore, by limiting it to only the gray part, it is possible to execute fine image processing, and it is expected that an effect that a sharper image can be output can be expected.

The attribute conditions are stored in advance for each user setting that can be selected by the user. Further, the edge determination range may be switched between "color / monochrome full area" and "monochrome area" at the time of shipment from the factory by a serviceman or a user.

When the "monochrome area" is selected, only the equal amount data of R = G = B is determined as an edge, and only the gray area is determined as an edge. Therefore, the print control unit 1300 performs image processing peculiar to the edge only in the gray area. To.

Subsequently, the flow of processing in this embodiment will be described with reference to FIG. It should be noted that this process is a description of the case where "the entire color / monochrome area" is selected and the data is in the RGB format.

The image edge determination determines whether or not the attribute of the pixel of interest A0 should be changed to "edge" by scanning the entire surface of the image with the mask pattern of FIG.

The mask pattern is composed of adjacent pixels of the right side A1, the lower side A2, the left side A3, and the upper side A4 of the pixel of interest A0. As shown in FIG. 20, this mask pattern is scanned pixel by pixel from the upper left to the lower right. It should be noted that one peripheral pixel is not the target of the pixel of interest.

Attribute conditions are set according to the user settings (step S202). Subsequently, it is determined whether the attribute of the pixel of interest A0 matches the attribute condition (step S204).

Here, when the attribute of the pixel of interest A0 matches the attribute condition (step S204; Yes), 1 is set in i (step S206), and the attribute of the adjacent pixel Ai matches the attribute condition. Whether or not it is determined (step S208; Yes → step S210).

Here, if the attributes of the adjacent pixels Ai do not match the attribute conditions, the process is repeatedly executed while incrementing i until i becomes 5, (step S210; No → step S212 → step S208). That is, it is determined whether or not the attributes of the adjacent pixels A1 to A4 match the attribute conditions.

Then, when the attribute of the adjacent pixel Ai matches the attribute condition (step S210; Yes), it is determined whether or not the pixel value of the pixel of interest A0 is equal to or greater than the threshold value, and when it is equal to or greater than the threshold value, the pixel of interest A0 Is not changed to the attribute of "edge", but if it is less than the threshold value, the attribute of the pixel of interest A0 is changed to the attribute of "edge" (step S214; Yes → step S216).

Here, the pixel value determination of the pixel of interest A0 in step S214 is performed by the following method. For RGB format
(Pixel value R of attention pixel A0 ≧ threshold value R)
& (Pixel value G of attention pixel A0 ≧ threshold value G)
& (Pixel value B of attention pixel A0 ≧ threshold value B)
If the condition of is satisfied, it is not determined as an edge (step S214; No). This is because when the pixel is thin, the image quality is improved when the pixel is not used as an edge. In the case of the CMYK format, if the pixel values C, M, Y, and K of the pixel of interest A0 are equal to or less than the threshold values C, M, Y, and K, the edge is not determined.

Hereinafter, specifically, it is determined whether the attribute of the attention pixel A0 is the condition "gray character", "color character", "gray vector graphic", and "color vector graphic" of FIG. 16, and the attribute of A0 is "gray character". In the case of "", it is determined whether or not the attributes of the adjacent pixel A1 are "no object", "white vector graphic", "gray vector graphic", "color vector graphic", and "raster".

When the attribute of the adjacent pixel A1 matches the attribute condition of FIG. 16, the attribute of the pixel of interest A0 is determined to be "edge". When the attribute of the adjacent pixel A1 does not match the attribute condition of FIG. 16, it is determined whether or not the attribute of the adjacent pixel A2 matches the attribute condition of FIG. Determine the attribute as "edge".

When the attributes of the adjacent pixels A2 do not match the attribute conditions of FIG. 16, the determination is performed in the same manner as the adjacent pixels A3 and A4.

When the attribute of the attention pixel A0 is determined to be "edge", in step S214, the pixel values of R, G, and B of the attention pixel A0 are compared with the threshold values R, G, and B. Then, when the pixel value of the pixel of interest A0 is equal to or greater than the threshold value, the determination of "edge" is cancelled.

Further, when the pixel values of R, G, and B of the pixel of interest A0 are less than the threshold values R, G, and B, it is determined as "edge". At this time, if the attribute of the pixel of interest is "gray character" or "gray vector graphic", it is converted to "gray edge", and if it is "color character" or "color vector graphic", it is converted to "color edge". The above process is repeated until the image is finished.

In the print control unit 1300, the image control unit 1210 determines that the pixel is an edge, and the pixel replaced with the attribute of "edge" performs a color conversion process, a γ process, a filter process, and a screen process suitable for the edge.

The "edge" attribute is processed so as to be more sharp than the normal attribute in the color conversion process, the γ process, and the filter process, and the screen process is processed with a higher resolution than the normal attribute.

Further, the image processing may be designed so that the "gray edge" has more black generation than the "color edge" in the attributes "color edge" and "gray edge".

In addition, the image processing of the edge attribute has several levels, and even if the color correction, γ, filter, and screen processing level are adjusted from the image processing more suitable for the edge to the image processing that is not so different from the normal processing. Good.

FIG. 21 is a diagram for explaining an operation example of the present embodiment. Pixels with a white background have an attribute of "no object", and pixels with a T displayed on a white background are pixels with an attribute of "character". Further, the pixel whose attribute is "edge" is a pixel in which T is displayed on the color background.

As the mask pattern, since there are adjacent pixels Ai on the top, bottom, left, and right of the pixel A0 of interest, edges are detected for edges in all directions of the character, and the attributes are changed as edges.

In this way, for each case (case that can be selected in the user setting unit (driver / operation panel)), the condition for changing the attribute of the pixel of interest to the edge attribute is internally based on the relationship between the attributes of the pixel of interest and the adjacent pixel. It is determined from the attribute bitmap data obtained by the attribute bitmap generation unit including the color information whether or not the attributes of the pixel of interest and the adjacent pixel match the conditions set by the user setting unit. If the conditions are met, the attribute of the pixel of interest can be changed to the edge attribute.

In addition, as a condition for replacing (changing) the attribute of the pixel of interest with the attribute of the edge from the attributes of the pixel of interest and the adjacent pixel, both pixels having different attributes even if the attributes of the pixel of interest and the adjacent pixel are different. Both may not be continuously generated as edge attributes.

Specifically, when it is determined that the edge attribute is due to the change of the attribute, the edge attribute is not continuous by not replacing the continuous pixel with the edge attribute. By doing so, it is possible to prevent the edge attributes from being continuous.

Further, in this case, the priority of the type of the object to be changed to the edge attribute may be determined. For example, in the case of the boundary between the character and the vector, the pixel of the character may be changed to the edge attribute, and the pixel of the vector may be left as it is.

Further, as a condition for changing the attribute of the pixel of interest to the attribute of the edge rather than the attribute of the pixel of interest and the adjacent pixel, the raster may not be the edge attribute. That is, only characters and vectors are set for the pixel of interest of the attribute condition, and the raster is not set. As a result, the raster is not an edge, only the characters and the vector are edges.

In addition, the change to the edge attribute has a mechanism for switching whether to change the entire color / monochrome area or only the monochrome area.

In addition, the edge attribute can be subjected to image processing (screen, γ, filter processing) suitable for the edge.

In addition, the image processing of edge attributes has several levels, and it is possible to adjust the color correction, γ, filter, and screen processing levels from image processing that is more suitable for edges to image processing that is not much different from normal processing. it can.

[4. Fourth Embodiment]
Next, the fourth embodiment will be described. The fourth embodiment is an embodiment in which the first (2) embodiment and the third embodiment are combined and processed.

In this case, as shown in FIG. 22, the user setting unit can make both settings.

Further, the operation process is as shown in FIG. 23. In this case, after executing the image replacement determination unit 210 and the image replacement processing unit 220 of the first embodiment, the image edge determination unit 212 and the attribute conversion processing unit 214 are executed.

That is, it is necessary to execute the image enhancement process after executing the expansion / contraction process. This is because the processing result of the image edge determination unit 212 changes due to the replacement of the attributes of the pixel of interest A0 due to expansion and contraction.

In this way, when both the expansion / contraction processing and the processing for changing to the edge attribute are performed, after the expansion / contraction processing is performed once, the pixel of interest and the adjacent pixel are compared again, and if the conditions are met, The pixel of interest will be changed to the edge attribute.

[5. Modification example]
Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and the design and the like within a range not deviating from the gist of the present invention are also within the scope of claims. include.

Further, in the above-described embodiment, the case where the image processing apparatus of the present invention is applied to an image forming apparatus such as a digital multifunction device has been described, but it goes without saying that other devices can also be applied. For example, it is needless to say that it may be applied not only to an image forming device such as a printer or a fax machine but also to a display method in a device such as a display display or a projector or a mobile terminal device such as a smartphone.

Further, in the above-described embodiment, the image processing is changed by the expansion / contraction / edge determination set by the user, but at the time of shipment from the factory, some modes and some attributes may be changed in advance. The process may be executed. For example, outline characters may be expanded from the default mode.

Further, the program that operates in each device in the embodiment is a program that controls a CPU or the like (a program that causes a computer to function) so as to realize the functions of the above-described embodiment. Then, the information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) at the time of processing, then stored in various ROM, HDD, and SSD storage devices, and read by the CPU as needed. , Correction / writing is performed.

Further, in the case of distribution to the market, the program can be stored and distributed in a portable recording medium, or transferred to a server computer connected via a network such as the Internet. In this case, it goes without saying that the storage device of the server computer is also included in the present invention.

1 Image forming device 1000 Control unit 1100 PDL interpreter unit 110 Input interface unit 120 Receive buffer unit 130 Command analysis unit 140 Intermediate data generation unit 150 Bitmap generation unit 160 Attribute bitmap generation unit 1200 Image control unit 210 Image replacement judgment unit 220 Image Replacement processing unit 230 Bitmap data compression unit 240 Image storage processing unit 1300 Print control unit 310 Image reading unit 320 Bitmap expansion unit 330 Color conversion / γ / filter / screen processing unit 340 Print processing unit 1400 Image input unit 1500 Image forming unit 1600 Storage unit 1610 User setting information 1620 Attribute condition setting table 1700 Operation display unit 1800 Communication unit

Claims (14)

In an image processing apparatus having an image processing means for executing image processing on image data,
A storage means for storing an attribute condition table that stores the attribute of the second pixel as an attribute condition in association with the attribute of the first pixel.
An attribute bitmap generating means for generating an attribute bitmap indicating the type of the object included in the image data for each pixel, and
A first determination means for determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second determination means for determining
When the attribute of the adjacent pixel is included in the attribute condition as the second pixel, the replacement means for replacing the attribute and the pixel value of the pixel of interest with the attribute and the pixel value of the adjacent pixel.
A third determination means for determining whether or not the attributes of the pixel of interest and the adjacent pixel are rasters,
Equipped with a,
When the third determination means determines that the attributes of the attention pixel and the adjacent pixel are rasters, the replacement means of the attention pixel is based on the pixel values of the attention pixel and the adjacent pixel. An image processing device characterized in that a pixel value is replaced with a pixel value of the adjacent pixel. The storage means stores the attribute condition table for each user setting.
Setting means for setting image processing by the user,
An attribute condition reading means for reading the attribute condition according to the set image processing, and an attribute condition reading means.
The image processing apparatus according to claim 1, further comprising. The image processing apparatus according to claim 1 or 2, wherein the image processing is a process of expanding or contracting an object included in the image data. The image processing apparatus according to any one of claims 1 to 3, wherein the adjacent pixel is a pixel adjacent to the pixel of interest in the scanning direction. The priority is set in advance for the attribute,
The replacement means is characterized in that when the attribute of the adjacent pixel has a higher priority than the attribute of the pixel of interest, the attribute and the pixel value of the pixel of interest are replaced with the attribute and the pixel value of the adjacent pixel. The image processing apparatus according to any one of claims 1 to 4. The replacement means
When the image data is in RGB format,
In the case of expansion processing, when the minimum value of the pixel value of the adjacent pixel is smaller than the pixel value of the pixel of interest, the minimum pixel value of the adjacent pixel is replaced with the pixel value of the pixel of interest.
In the case of shrinkage processing, when the maximum value of the pixel value of the adjacent pixel is larger than the pixel value of the pixel of interest, the maximum pixel value of the adjacent pixel is replaced with the pixel value of the pixel of interest.
In addition, when the image data is in CMYK format,
In the case of expansion processing, when the maximum value of the pixel value of the adjacent pixel is larger than the pixel value of the pixel of interest, the maximum pixel value of the adjacent pixel is replaced with the pixel value of the pixel of interest.
In the case of shrinkage processing, when the minimum value of the pixel value of the adjacent pixel is smaller than the pixel value of the pixel of interest, the minimum pixel value of the adjacent pixel is replaced with the pixel value of the pixel of interest.
The image processing apparatus according to claim 1. In an image processing apparatus having an image processing means for executing image processing on image data,
A storage means for storing an attribute condition table that stores the attribute of the second pixel as an attribute condition in association with the attribute of the first pixel.
An attribute bitmap generating means for generating an attribute bitmap indicating the type of the object included in the image data for each pixel, and
A first determination means for determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second determination means for determining
When the attribute of the adjacent pixel is included in the attribute condition as the second pixel, the replacement means for replacing the attribute of the pixel of interest with the attribute of the edge,
With
In the replacement means, when the image data is in RGB format,
When the pixel value of the pixel of interest is equal to or greater than a predetermined threshold value, the replacement of the attribute of the pixel of interest with the attribute of the edge is stopped.
When the image data is in CMYK format,
When the pixel value of the pixel of interest is equal to or less than a predetermined threshold value, the replacement of the attribute of the pixel of interest with the attribute of the edge is stopped.
An image processing device characterized by this. The image processing apparatus according to claim 7 , wherein the attribute bitmap includes color information in addition to the attributes. The image processing apparatus according to claim 7 , wherein the attribute of the first pixel is an attribute other than the raster. The image processing according to any one of claims 7 to 9 , wherein the attribute condition further includes an attribute condition switching means capable of switching between the entire color / monochrome area and only the monochrome area. apparatus. For computers that realize image processing functions that perform image processing on image data
A storage function that stores an attribute condition table that stores the attributes of the second pixel as attribute conditions in association with the attributes of the first pixel,
An attribute bitmap generation function that generates an attribute bitmap that indicates the type of object included in the image data for each pixel, and
A first determination function for determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second judgment function to judge
A replacement function that replaces the attribute and pixel value of the pixel of interest with the attribute and pixel value of the adjacent pixel when the attribute of the adjacent pixel is included in the attribute condition as the second pixel.
A third determination function for determining whether or not the attributes of the pixel of interest and the adjacent pixel are rasters, and
When the third determination function determines that the attributes of the attention pixel and the adjacent pixel are rasters, the replacement function of the attention pixel is based on the pixel values of the attention pixel and the adjacent pixel. A program characterized by replacing a pixel value with a pixel value of the adjacent pixel. For computers that realize image processing functions that perform image processing on image data
A storage function that stores an attribute condition table that stores the attributes of the second pixel as attribute conditions in association with the attributes of the first pixel,
An attribute bitmap generation function that generates an attribute bitmap that indicates the type of object included in the image data for each pixel, and
A first determination function for determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second judgment function to judge
A replacement function that replaces the attribute of the pixel of interest with the attribute of the edge when the attribute of the adjacent pixel is included in the attribute condition as the second pixel.
A program for realizing a
The replacement function is used when the image data is in RGB format.
When the pixel value of the pixel of interest is equal to or greater than a predetermined threshold value, the replacement of the attribute of the pixel of interest with the attribute of the edge is stopped.
When the image data is in CMYK format,
When the pixel value of the pixel of interest is equal to or less than a predetermined threshold value, the replacement of the attribute of the pixel of interest with the attribute of the edge is stopped.
A program characterized by that. In an image processing method that includes an image processing step that executes image processing on image data,
A storage step for storing an attribute condition table that stores the attribute of the second pixel as an attribute condition in association with the attribute of the first pixel, and a storage step.
An attribute bitmap generation step that generates an attribute bitmap that indicates the attribute indicating the type of the object included in the image data for each pixel, and
The first determination step of determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second judgment step to judge
When the attribute of the adjacent pixel is included in the attribute condition as the second pixel, the first replacement step of replacing the attribute and the pixel value of the pixel of interest with the attribute and the pixel value of the adjacent pixel,
A third determination step for determining whether or not the attributes of the pixel of interest and the adjacent pixel are rasters, and
When it is determined by the third determination step that the attributes of the pixel of interest and the adjacent pixel are rasters, the pixel value of the pixel of interest is determined based on the pixel values of the pixel of interest and the adjacent pixel. The second replacement step of replacing with the pixel value of the adjacent pixel,
An image processing method comprising. In an image processing method that includes an image processing step that executes image processing on image data,
A storage step for storing an attribute condition table that stores the attribute of the second pixel as an attribute condition in association with the attribute of the first pixel, and a storage step.
An attribute bitmap generation step that generates an attribute bitmap that indicates the attribute indicating the type of the object included in the image data for each pixel, and
The first determination step of determining whether or not the attribute of the pixel of interest is included in the attribute condition as the first pixel, and
When the attribute of the pixel of interest is included in the attribute condition as the first pixel, whether or not the attribute of the adjacent pixel adjacent to the pixel of interest is included in the attribute condition as the second pixel. The second judgment step to judge
A replacement step of replacing the attribute of the pixel of interest with the attribute of the edge when the attribute of the adjacent pixel is included in the attribute condition as the second pixel.
Including
In the replacement step, when the image data is in RGB format,
When the pixel value of the pixel of interest is equal to or greater than a predetermined threshold value, the replacement of the attribute of the pixel of interest with the attribute of the edge is stopped.
When the image data is in CMYK format,
When the pixel value of the pixel of interest is equal to or less than a predetermined threshold value, the replacement of the attribute of the pixel of interest with the attribute of the edge is stopped.
An image processing method characterized by that.

Images