JP5591631B2 - Image processing apparatus, image processing system, image forming apparatus, image processing method, image processing program, and recording medium thereof - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing system, and an image processing method for performing image composition processing for compositing image data for composition on part of document image data.

  2. Description of the Related Art Conventionally, image processing apparatuses that perform various types of image processing on image data obtained by reading an original with an image reading apparatus such as a scanner are known. An example of an application target of such an image processing apparatus is a digital multifunction peripheral. The digital multi-function peripheral, for example, realizes a copy function by forming (printing) image data of a document as an image on a recording sheet, or transferring the image data to another device (such as a computer). It is possible to implement the PUSH copy function using the above apparatus.

  By the way, a document read by the image reading apparatus may include various types (image types) of areas such as characters, photographs, and graphics. For this reason, in the area separation process performed by the image processing apparatus, for example, a photograph or graphic area formed with fine dots (halftone dots) at the time of printing an original is determined as a halftone dot area.

  Note that the halftone dot region has a characteristic that it tends to cause moire due to factors such as the halftone dot interval of the original, the recognition state of the image reading apparatus, the characteristics of the image data, or the characteristics of the image forming apparatus that performs image output processing. Have. For this reason, with respect to the halftone dot region, the occurrence of moire is generally suppressed by performing smoothing processing on the image data. For example, when “photo mode” or the like is selected in an image processing apparatus (such as a digital multi-function peripheral), generation of moire can be suppressed by performing smoothing processing on the image data.

  In addition, since it is desired to print and display a character image sharply in a region where characters are formed, sharpening processing is performed on the image data. For example, when “character mode” or the like is selected in the image processing apparatus, sharpening processing is performed on the image data to improve character reproducibility.

  As described above, the image processing apparatus generally performs image processing according to the image type of each region based on the result of the region separation processing.

  Also, in the conventional image reading apparatus, generally, image data obtained by reading a document is temporarily stored in a memory such as a hard disk, and the image data is read out from the memory as necessary to output image data such as print processing and transmission processing. Processing is to be performed. Further, in order to increase the storage amount of image data in the memory (number of stored original image data), the image data is often stored in the memory after being subjected to irreversible compression processing. For this reason, the image data read from the memory is often a part of the information included in the image data acquired by the image reading process.

  For this reason, in the conventional image reading apparatus, in general, in order to prevent a reduction in accuracy of the region separation processing, the image data acquired by the image reading processing is subjected to the region separation processing and then the compression processing, and the image after the compression processing is performed. Data and region separation processing results are associated with each other and stored in a memory. Also, when image data acquired by the image reading process is transmitted to another apparatus without being stored in the memory, a region separation process is applied to the image data acquired by the image reading process in order to reduce the amount of data to be transmitted. Then, the compression process is performed, and the image data after the compression process and the region separation process result are transmitted in association with each other.

  However, in these methods, a part of the image data subjected to the compression process is a part of other image data (for example, a CG image created by a personal computer or the like, a photograph taken by another image reading device (digital camera or the like)). When image processing based on the result of region separation processing on image data before compression processing and image composition processing is performed when various image processing is performed on composite image data obtained by combining image data such as Inappropriate image processing may be performed on the portion of the image.

  In order to avoid such a problem, it is conceivable that the region separation process is performed again on the composite image data, and the image process is performed on the composite image data based on the result. However, the number of lines (resolution) and density of image data read by the image reading apparatus and the number of lines and density of image data combined with the image data are often different. Further, the region separation process in the image reading apparatus is adjusted and optimized according to the characteristics of the reading process of the image reading apparatus. For this reason, if the region separation process is performed on the image data after the synthesis process, the region separation process of the synthesized part cannot be performed with high accuracy, and an inappropriate image process may be performed.

  In Patent Document 1, the captured video and the CG video are separated from the composite video obtained by combining the captured video and the CG video, and the normal cutoff frequency set for the captured video is set for the captured video. By performing low-pass filter processing and performing low-pass filter processing with a cut-off frequency higher than that of the captured image on the CG image, it is possible to suppress the occurrence of moire in the captured image and display the CG image clearly. Have been described.

JP 2008-78989 A (published April 3, 2008)

  However, the technique disclosed in Patent Document 1 assumes only a configuration in which a captured video composed of a moving image captured by an image sensor and a composite video such as a CG video generated by a method other than imaging are combined. For this reason, as in an image processing apparatus that performs image processing on image data obtained by reading a document, region separation processing is performed on image data obtained by reading a document, and each region separated Thus, no consideration is given to performing image processing according to the image type of each area. Therefore, the technique of Patent Document 1 cannot perform image processing corresponding to the image type of each area of the image data.

  More specifically, although the technique of Patent Document 1 describes that low-pass filter processing with different cutoff frequencies is performed on a captured video and a CG video, a common cutoff is applied to the entire captured video. Since the low-pass filter processing of the frequency is performed, for example, when characters and photographs are mixed in the captured image, the reproducibility of characters is impaired even if the moire of the photograph portion can be suppressed. That is, since the high-frequency component is cut in the low-pass filter processing, edges such as thin characters and lines having a high frequency are blurred. For this reason, in the case of an image including characters, if a low-pass filter process is simply performed to suppress halftone moiré, the entire image becomes blurred and the reproducibility of the characters is reduced.

  In addition, when characters and photos are mixed in the captured image, if sharpening is applied overall to emphasize the edges of characters and lines, the reproducibility of characters increases, but moiré occurs in the photo portion. Will occur.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to generate composite image data by combining composite image data with a part of document image data, and to generate the composite image data. In the image processing apparatus that performs image processing, image processing suitable for each image region is performed on each image region of the composite image data.

  An image processing apparatus according to the present invention includes a region separation processing unit that performs region separation processing for separating document image data into a plurality of image regions according to image types, and generates region identification signals indicating the image types of the image regions. An image processing apparatus comprising: an image processing unit that performs image processing on each image area according to an image type of each image area, wherein the image data for synthesis is combined with a part of the original image data An image composition unit that generates composite image data, an area type designation unit that specifies an image type of the composition image data, and the region corresponding to the region in which the composition image data in the document image data is composed By replacing the identification signal with an area identification signal corresponding to the image type of the image data for synthesis specified by the area type designation unit, the area identification signal of the synthesized image data is generated. A region identification signal replacement unit that performs the image processing unit for each image region of the image data for synthesis that is indicated by the region identification signal of the composite image data generated by the region identification signal replacement unit. The image processing according to the image type of each image area is performed.

  The image processing system of the present invention performs region separation processing for separating document image data into a plurality of image regions according to image types, and generates region identification signals indicating the image types of the image regions. And an image processing device that performs image processing on each of the image areas according to the image type of each of the image areas, and synthesizes the image data for synthesis with part of the original image data An image processing system that is communicably connected to a terminal device that includes an image composition unit that generates composite image data, the region type designation unit that identifies the image type of the image data for composition, and the original Replacing the area identification signal corresponding to the area where the image data for synthesis is combined in the image data with an area identification signal corresponding to the image type specified by the area type designation unit. Therefore, the image processing unit includes a region identification signal replacement unit that generates a region identification signal of the composite image data, and the image processing unit generates the region identification signal replacement unit for each image region of the composite image data. The image processing according to the image type of each image area indicated by the area identification signal of the composite image data is performed.

  Further, the image processing method of the present invention separates the manuscript image data into a plurality of image regions according to the image type, generates a region identification signal indicating the image type of each image region, An image processing method for performing image processing on an image area according to an image type of each image area, and combining image data for synthesis with a part of the original image data by an image composition application An image composition step for generating composite image data, and an area identification signal corresponding to an area of the original image data corresponding to the area where the image data for composition is combined, and an area identification corresponding to an image type of the image data for composition A region identification signal replacement step of generating a region identification signal of the composite image data by replacing it with a signal. In the image processing step, It is characterized by performing image processing corresponding to the image type of each image region indicated by the region identification signal of the composite image data generated by the area identification signal substitution step for each image area of the data.

  According to the image processing apparatus, the image processing system, and the image processing method described above, the area identification signal corresponding to the area where the image data for synthesis is synthesized in the original image data is converted into the area corresponding to the image type of the image data for synthesis. A region identification signal of the composite image data is generated by replacing the identification signal. Further, image processing corresponding to the image type of each image area indicated by the above-described area identification signal of the composite image data is performed on each image area of the image data for synthesis. Thereby, image processing suitable for each image region can be performed on each image region of the composite image data.

  In the image processing apparatus of the present invention, the image processing unit includes a filter processing unit that performs filter processing on the image data, and the filter processing unit responds to an image type indicated by the region identification signal. The filter used for the filter process may be changed.

  According to said structure, the filter process suitable for each said image area can be performed with respect to each image area of synthetic | combination image data.

  The image processing unit includes a black generation and under color removal unit that converts image data composed of a combination of a plurality of chromatic colors into image data composed of a combination of black and a plurality of chromatic colors. The color removal unit may be configured to set the black generation amount in accordance with the image type indicated by the region identification signal.

  According to the above configuration, it is possible to perform black generation and under color removal processing suitable for each image region for each image region of the composite image data.

Further, the image processing unit includes a gradation reproduction processing unit that generates a dot pattern for reproducing an image corresponding to the image data by performing dither processing on the image data,
The gradation reproduction processing unit may be configured to change a dither matrix used for dither processing according to the image type indicated by the region identification signal.

  According to said structure, the gradation reproduction process suitable for each said image area can be performed with respect to each image area of synthetic | combination image data.

  The area separation processing unit classifies each image area of the document image data into one of a plurality of image types including a dot area, a character / edge area, and a photographic paper photo / solid area. Also good.

  According to the above configuration, it is possible to perform image processing suitable for each image region on the halftone dot region, the character / edge region, and the photographic paper photo / solid region in the composite image data.

  Further, an instruction input unit that receives an instruction input from a user may be provided, and the region type designation unit may be configured to specify an image type of the image data for synthesis in accordance with an instruction input from the user.

  According to the above configuration, the image processing desired by the user can be performed on the image area corresponding to the image data for synthesis.

  In the image processing system of the present invention, the image processing apparatus includes an instruction input unit that receives an instruction input from a user, and the terminal device according to an instruction from the user that is input via the instruction input unit. It is good also as a structure provided with the control part which controls operation | movement of the said image synthetic | combination part. In addition, the terminal device includes a storage unit that stores a plurality of image data, and the image composition unit includes the image processing device that includes the image data stored in the storage unit. The composite image data may be generated using the image data designated by the user via the instruction input unit as the composite image data.

  According to said structure, the user can control the operation | movement regarding the image synthesis process in a terminal device via the instruction | indication input part of an image processing apparatus.

  The image forming apparatus of the present invention includes any one of the above-described image processing apparatuses and an image output unit that forms an image corresponding to image data output from the image processing apparatus on a recording material.

  According to the above configuration, the image forming process can be performed based on the result of the image process suitable for each image area being applied to each image area of the composite image data.

  The image processing apparatus may be realized by a computer. In this case, an image processing program for causing the image processing apparatus to be realized by the computer by causing the computer to operate as the respective units, and the program are recorded. Computer-readable recording media are also included in the scope of the present invention.

  As described above, the image processing apparatus of the present invention specifies an image composition unit that generates composition image data by compositing composition image data with a part of the document image data, and specifies an image type of the composition image data. Corresponding to the image type of the image data for synthesis specified by the area type specification unit, and the region identification signal corresponding to the region where the image data for synthesis in the original image data is combined. A region identification signal replacement unit that generates a region identification signal of the composite image data by replacing the region identification signal with the region identification signal, and the image processing unit identifies the region identification for each image region of the composition image data. Image processing corresponding to the image type of each image region indicated by the region identification signal of the composite image data generated by the signal replacement unit is performed.

  The image processing system according to the present invention also includes an area type designation unit that specifies an image type of the image data for synthesis, and the area identification signal corresponding to the area where the image data for synthesis is synthesized in the document image data. A region identification signal replacement unit that generates a region identification signal of the composite image data by replacing with a region identification signal corresponding to the image type specified by the region type designation unit, and the image processing unit includes: Image processing corresponding to the image type of each image region indicated by the region identification signal of the composite image data generated by the region identification signal replacement unit is performed on each image region of the composite image data.

  Further, the image processing method of the present invention includes an image composition step of generating composite image data by combining composite image data with a part of the original image data by an image composition application, and the composite image in the original image data. A region identification signal replacement step of generating a region identification signal of the composite image data by replacing the region identification signal corresponding to the region where the data is combined with a region identification signal corresponding to the image type of the image data for synthesis. In the image processing step, the image type of each image region indicated by the region identification signal of the composite image data generated in the region identification signal replacement step for each image region of the image data for synthesis is Appropriate image processing is performed.

  Therefore, according to the image processing apparatus, the image processing system, and the image processing method of the present invention, it is possible to perform image processing suitable for each image area on each image area of the composite image data.

It is a flowchart which shows the flow of a process in the image processing system concerning one Embodiment of this invention. It is a block diagram which shows the structure of the image processing system of FIG. It is a schematic diagram which shows the structure of the image processing apparatus with which the image processing system of FIG. 1 is equipped. FIG. 2 is an explanatory diagram illustrating a relationship between an image type of an image region and the content of spatial filter processing in the image processing system of FIG. 1. (A) is explanatory drawing which shows an example of original image data. (B) is explanatory drawing which shows an example of the image data for a synthesis | combination. (C) is an explanatory view showing an example of composite position information indicating a composite position of composite image data with respect to document image data. (D) is an explanatory view showing an example of composite image data obtained by combining the image data for synthesis (b) at the position indicated by the composite position information of (c) in the original image data of (a).

  An embodiment of the present invention will be described.

(1-1. Overall Configuration of Image Processing System 1000)
FIG. 2 is a block diagram showing a configuration of the image processing system 1000 according to the present embodiment. As shown in this figure, an image processing system 1000 includes a digital multifunction peripheral (image processing apparatus, image forming apparatus) 10 and an external apparatus (terminal apparatus) 800, both of which are connected via a communication network or the like. It is connected so that it can communicate.

  FIG. 3 is a schematic diagram showing a schematic configuration of a digital multifunction peripheral (image processing apparatus, image forming apparatus) 10 provided in the image processing system 1000. As shown in FIG. 2 and FIG. Unit 100, image processing unit 200, image output unit 300, control unit 400, operation panel 500, communication unit 600, and image storage unit 700.

  The control unit 400 includes a calculation unit 401 and a storage unit 402, and each unit of the digital multifunction peripheral 10, that is, the image input unit 100, the image processing unit 200, the image output unit 300, the operation panel 500, the communication unit 600, and The operation of the image storage unit 700 is controlled.

  The storage unit 402 controls various commands and setting values input from the user via the operation panel 500, detection results of various sensors arranged in the digital multifunction peripheral 10, and operations of each unit of the digital multifunction peripheral 10. The program stores various setting values and data tables, programs for executing various controls, and the like. As the storage unit 402, various storage means commonly used in this field, for example, a read only memory (ROM), a random access memory (RAM), a hard disk drive (HDD), or the like can be used.

  The arithmetic unit 401 reads various information stored in the storage unit 402 and a program for performing various controls, performs arithmetic processing and determination processing, and controls each unit of the digital multifunction peripheral 10 based on the processing results. Signals are sent to control the operation of each part. Note that the arithmetic unit 401 is a processing circuit realized by, for example, a microcomputer or a microprocessor that includes a central processing unit (CPU).

  As shown in FIG. 3, the image input unit 100 is provided on the upper surface of the casing in which the image output unit 300 is accommodated, and acquires original image data that is image data of the original by reading the original. It is. The document image data read by the image input unit 100 is sent to the image processing unit 200 and subjected to predetermined image processing.

  The image processing unit 200 performs image processing for making image data suitable for print processing in the image output unit 300 on the document image data acquired by the image input unit 100 reading the document. 2, the image processing unit 200 includes an A / D conversion unit 201, a shading correction unit 202, an input tone correction unit 203, a region separation processing unit 204, a region identification signal replacement unit 205, and color correction. A unit 206, a black generation and under color removal unit 207, a spatial filter processing unit 208, an output tone correction unit 209, and a tone reproduction processing unit (halftone generation unit) 210. Note that an image processing unit (print processing unit) is configured by a color correction unit 206, a black generation and under color removal unit 207, a spatial filter processing unit 208, an output tone correction unit 209, and a tone reproduction processing unit (halftone generation unit) 210. 220 is configured.

  The A / D conversion unit 201 converts the RGB analog signal input from the image input unit 100 into a digital signal and outputs the digital signal to the shading correction unit 202.

  The shading correction unit 202 performs processing for removing various distortions generated in the illumination system, the imaging system, and the imaging system of the image input unit 100 on the document image data sent from the A / D conversion unit 201, and performs input. Output to the gradation correction unit 203.

  The input tone correction unit 203 adjusts the color balance of the image data input from the shading correction unit 202, and at the same time converts it into a signal that can be handled easily by the image processing system employed in the image processing unit 200, such as a density signal. Apply the process. Also, image quality adjustment processing such as background density removal and contrast is performed. Further, the input tone correction unit 203 outputs the document image data subjected to each of the above processes to the region separation processing unit 204.

  The region separation processing unit 204 separates the image region in the document image data input from the input tone correction unit 203 into a character edge region, a halftone dot region, a photographic paper photograph / solid region, other regions, and an indefinite region (region separation). ) Further, the region separation processing unit 204 generates a region identification signal (region separation signal) indicating which region each pixel belongs to based on the separation result. For example, as shown in FIG. 4 to be described later, the region separation processing unit 204 represents a character edge region as 0, a halftone dot region as 1, a photographic paper photo / solid region as 2, an other region as 3, and an indefinite region as 4. A region identification signal is generated. The region separation processing method in the region separation processing unit 204 is not particularly limited, and various conventionally known methods can be used.

  In the present embodiment, the user can arbitrarily select an image composition mode in which image data of another image (composition image) is combined with part of the document image data read by the image input unit 100. Yes. When the image composition mode is selected, the region separation processing unit 204 temporarily stores the document image data in association with the region identification signal generated based on the document image data in the image storage unit 700. As a result, the communication unit 600 appropriately reads out the document image data stored in the image storage unit 700 and transmits it to the external apparatus 800, and the region identification signal replacement unit 205 appropriately reads out the region identification signal stored in the image storage unit 700. It is like that. When the image composition mode is not selected, the region separation processing unit 204 is based on the document image data input from the input tone correction unit 203 and the document image data, as indicated by a broken line in FIG. The generated area identification signal is output to the area identification signal replacement unit 205 as it is. Alternatively, even when the image composition mode is not selected, the region separation processing unit 204 temporarily stores the document image data and the region identification signal generated based on the document image data in the image storage unit 700, and the region identification signal The replacement unit 205 may read the document image data and the area identification signal stored in the image storage unit 700 from the image storage unit 700.

  When the image composition mode is selected, the area identification signal replacement unit 205 receives the composition position information indicating the composition position of the composition image data and the composition image data from the external device 800 via the communication unit 600 and the composition image data. Area type information indicating an image type (any one of a character edge area, a halftone dot area, a photographic paper photo / solid area, another area, and an indefinite area) is acquired. Further, an area identification signal corresponding to the document image data is read from the image storage unit 700, and among the read area identification signals, the area identification signal of the area corresponding to the combined position information is converted into an area identification signal corresponding to the area type information. Replace. Then, the replacement area identification signal is output to the black generation and under color removal unit 207, the spatial filter processing unit 208, and the gradation reproduction processing unit 210.

  When the image composition mode is not selected, the region identification signal replacement unit 205 directly uses the original image data input from the region separation processing unit 204 (or the original image data read from the image storage unit 700) as a color correction unit. The region identification signal corresponding to the document image data input to the region separation processing unit 204 (or the region identification signal corresponding to the document image data read from the image storage unit 700) is output to The data is output to the removal unit 207, the spatial filter processing unit 208, and the gradation reproduction processing unit 210.

  When the image composition mode is not selected, the region separation processing unit 204 outputs the region identification signal without passing through the region identification signal replacement unit 205, the black generation and under color removal unit 207, the spatial filter processing unit 208, and You may make it output directly to the gradation reproduction process part 210. FIG. Alternatively, the black generation and under color removal unit 207, the spatial filter processing unit 208, and the gradation reproduction processing unit 210 may read the region identification signal from the image storage unit 700.

  When the image composition mode is not selected, the region separation processing unit 204 may directly output the document image data to the color correction unit 206 without going through the region identification signal replacement unit 205. Further, the color correction unit 206 may read the document image data from the image storage unit 700.

  When the image composition mode is selected, the color correction unit 206 receives composite image data obtained by compositing the image for composition with the document image in the external apparatus 800 via the communication unit 600, and the image composition mode is set. If not selected, document image data is input from the area identification signal replacement unit 205.

  The color correction unit 206 converts the input document image data or composite image data composed of RGB signals into image data composed of CMY (C: cyan, M: magenta, Y: yellow) signals, and performs color reproduction. In order to realize faithfulness, a process of removing color turbidity based on the spectral characteristics of the CMY color material including an unnecessary absorption component is performed. The color correction unit 206 outputs the color-corrected image data to the black generation and under color removal unit 207.

  The black generation and under color removal unit 207 generates a black (K) signal from the CMY signal (image data including a combination of a plurality of chromatic colors) input from the color correction unit 206, and the original CMY signal. A process of subtracting a value corresponding to the black signal obtained by the black generation process and outputting a new CMY signal is executed to generate a CMYK signal (image data composed of a combination of black and a plurality of chromatic colors). Then, the black generation and under color removal unit 207 outputs the generated CMYK signal to the spatial filter processing unit 208.

Specifically, the black generation and under color removal unit 207 performs black generation and under color removal processing using skeleton black, which is a general method of black generation and under color removal processing. In this method, the input / output characteristics of the skeleton curve are y = f (x), the UCR (Under Color Removal) rate is α (0 <α <1), and the black correction and under color removal unit from the color correction unit 206. If the data input to 207 is C, M, Y, and the data generated by the black generation and under color removal unit 207 is C ′, M ′, Y ′, K ′,
K ′ = f {min (C, M, Y)}
C ′ = C−αK ′
M ′ = M−αK ′
Y ′ = M−αK ′
C ′, M ′, Y ′, and K ′ are calculated by calculating.

  Note that the black generation and under color removal unit 207 sets the value of the UCR rate α in accordance with the region identification signal. Specifically, for the character edge area, the value of UCR rate α is increased to increase the amount of K (density) compared to the halftone dot area, photographic paper photo / solid area, and other areas, and the amount of CMY is increased. cut back. For the halftone dot area, the photographic paper photograph / solid area, and other areas, the UCR rate α is made smaller than the character edge area to reduce the amount of K and the amount of CMY. Note that the black generation and under color removal unit 207 does not perform black generation and under color removal processing for the indefinite region. That is, the black generation and under color removal processing is passed through for the indefinite region.

  The spatial filter processing unit 208 corrects the spatial frequency characteristics for each image area in the CMYK image data input from the black generation and under color removal unit 207 to prevent blurring of the output image and deterioration of graininess. Based on the region identification signal, filter processing (spatial filter processing using a digital filter) corresponding to the image type of each image region is performed. Further, the spatial filter processing unit 208 outputs the image data after the filter processing to the output tone correction unit 209. FIG. 4 shows the relationship between the image type of the image area and the content of the filter processing in the spatial filter processing unit 208.

  As shown in this figure, the spatial filter processing unit 208 performs sharp enhancement processing (filter processing for sharp enhancement) on the character edge region in order to improve the reproducibility of black characters or color characters. Increase the amount of frequency enhancement.

  Further, the spatial filter processing unit 208 performs a smoothing process (filtering process for smoothing) for removing the input halftone dot component on the halftone dot region.

  In addition, the spatial filter processing unit 208 performs adaptive mixed filter processing on the photographic paper photograph / solid region and other regions, that is, performs some smoothing on the high-frequency component, while performing low-frequency component. A filter process (adaptive mixing process) that performs sharpening to some extent is performed. As a result, appropriate processing is performed even on regions that are difficult to determine as halftone regions or character edge regions (for example, photographic regions and document background regions). Also, the spatial filter processing unit 208 does not apply the filter process to indefinite areas (for example, areas where characters and halftone dots are mixed).

  The output tone correction unit 209 executes an output tone correction process (output γ correction process) for converting to a halftone dot area ratio according to the output characteristics of the image output unit 300, and outputs the image data after the output tone correction process. Output to the gradation reproduction processing unit 210.

  The gradation reproduction processing unit 210 separates the CMYK image data input from the output gradation correction unit 209 into pixels, and uses a screen that is optimal for each pixel according to the region identification signal of the pixel. A tone reproduction process (halftone process) for reproducing a tone is performed. That is, a dot pattern for forming an image corresponding to the image data on the recording material is generated. Specifically, the character edge region is subjected to dither processing using a dither matrix (for example, a 1 × 1 size dither matrix) smaller in size than the image region other than the character edge region to increase the character resolution. . In addition, the image area other than the character edge area is subjected to dither processing using a dither matrix having a size larger than that of the character edge area (for example, a 3 × 3 size dither matrix) to maintain gradation.

  The image data that has been subjected to the above-described processes in the image processing unit 200 is output to the image output unit 300. The image data subjected to the above-described processes in the image processing unit 200 is temporarily stored in the image storage unit 700 or another memory (not shown), read out at a predetermined timing, and output to the image output unit 300. You may make it do.

  In the above description, the A / D conversion unit 201, the shading correction unit 202, the input tone correction unit 203, the region separation processing unit 204, the region identification signal replacement unit 205, the color correction unit 206, and the black generation lower color removal unit. 207, the spatial filter processing unit 208, the output tone correction unit 209, and the tone reproduction processing unit (halftone generation unit) 210 sequentially output image data to the processing unit of the next stage. However, the present invention is not limited to this, and if necessary, the image data is temporarily stored in the image storage unit 700 or other memory (not shown), read at a predetermined timing, and input to the processing unit in the next stage. Also good. Similarly, the region identification signal may be temporarily stored in the image storage unit 700 or another memory, read out at a predetermined timing, and output to a predetermined processing unit. For example, a random access memory (RAM) or a hard disk drive (HDD) can be used as the memory.

  The image output unit 300 forms (prints) an image corresponding to the image data input from the image processing unit 200 on a recording material.

  The configuration of the image output unit 300 is not particularly limited, but in the present embodiment, an electrophotographic system is adopted. Specifically, as shown in FIG. 3, the image output unit 300 includes a paper feed tray 81, a manual paper feed tray 82, pickup rollers 11a and 11b, transport rollers 12a, 12b, 12c, and 12d, and an image forming unit 20c. 20m, 20y, 20k, an intermediate transfer device 6, a secondary transfer roller 14, and a fixing device 7.

  The recording material conveyance processing unit 301 controls the operations of the pickup rollers 11a and 11b, the conveyance rollers 12a, 12b, 12c, and 12d and the like, and the recording material placed on the paper feed tray 81 or the manual paper feed tray 82 or the fixing. After the fixing process by the apparatus 7 is performed, the recording material with the front and back reversed is conveyed to a facing portion between the secondary transfer roller 14 and the intermediate transfer device 6, and the recording material onto which the toner image has been transferred is transferred to this facing portion. The recording material is conveyed to the fixing device 7 and discharged onto the paper discharge tray 83 after the fixing process.

  The image forming processing unit 302 controls the operations of the image forming units 20c, 20m, 20y, and 20k, the intermediate transfer device 6, and the secondary transfer roller 14, and forms a toner image according to the image data and transfers it to the recording material. Let

  The image forming units 20c, 20m, 20y, and 20k generate cyan, magenta, yellow, and black toner images, respectively, according to the image data. These image forming units are different in the color of the toner that is used. Have substantially the same configuration. That is, each image forming unit includes a photosensitive drum 3, a charger 5 that uniformly charges the surface of the photosensitive drum 3, and an image of a color corresponding to the image forming unit on the surface of the charged photosensitive drum 3. The optical scanning unit 1 that irradiates light according to data to form an electrostatic latent image on the surface of the photosensitive drum 3 and the electrostatic latent image formed on the surface of the photosensitive drum 3 correspond to the image forming unit. And a cleaning device 4 that removes toner remaining on the surface of the photosensitive drum 3 without being transferred from the photosensitive drum 3 to an intermediate transfer belt 91 described later. Yes.

  The intermediate transfer device 6 is disposed so as to face support rollers 92 and 93, an intermediate transfer belt 91 that is suspended and driven by rotation of these support rollers, and the photosensitive drums 3 via the intermediate transfer belt 91. The transfer roller 94 is provided. A voltage having a polarity opposite to the charging polarity of the toner image formed on the surface of the photoconductive drum 3 is applied to each transfer roller 94, whereby each color toner image formed on the surface of the photoconductive drum 3 is intermediate. The image is transferred onto the transfer belt 91 in a superimposed manner. Further, the toner image transferred onto the intermediate transfer belt 91 is conveyed to a portion facing the secondary transfer roller 14 by the rotation of the intermediate transfer belt 91.

  Between the secondary transfer roller 14 and the intermediate transfer belt 91, the toner image on the intermediate transfer belt 91 is conveyed to a portion facing the secondary transfer roller 14 in synchronization with the transfer target of the toner image. A recording material is conveyed. That is, between the secondary transfer roller 14 and the intermediate transfer belt 91, (1) a recording material extracted from the paper feed tray 81 by the pickup roller 11a and conveyed via the conveying roller 12a, the registration roller 13, and the like, (2) Recording material extracted from the manual paper feed tray 82 by the pickup roller 11b and conveyed through the conveyance roller 12a, the registration roller 13, or the like, or (3) after the fixing process by the fixing device 7 described later is performed. Then, the front and back are reversed by the switchback by the transport roller 12d, and the recording material transported again through the transport rollers 12c and 12d, the registration roller 13 and the like is transported. Further, a high voltage having a polarity opposite to the charging polarity of the toner is applied to the secondary transfer roller 14, whereby the toner image on the intermediate transfer belt 91 is secondarily transferred to the recording material.

  The fixing processing unit 303 controls the operation of the fixing device 7 to fix the toner image transferred onto the recording material to the recording material. That is, the recording material onto which the toner image has been transferred at the opposing portion between the secondary transfer roller 14 and the intermediate transfer belt 91 is conveyed to the fixing device 7 and the fixing device 7 fixes the toner image on the recording material. .

  Note that the configuration of the image output unit 300 is not limited to the electrophotographic image forming apparatus, and for example, an inkjet image forming apparatus may be used.

  The operation panel 500 includes an input unit 502 that receives an instruction input from a user and transmits the instruction input to the control unit 400, and a display unit 501 for displaying various information presented to the user. The display unit 501 is configured by, for example, a liquid crystal display, and the input unit 502 is configured by, for example, various setting buttons. Note that the operation panel 500 may include a touch panel in which the function of the display unit 501 and the function of the input unit 502 are integrated.

  The communication unit 600 is configured by a modem or a network card, for example. The communication unit 600 connects the digital multifunction peripheral 10 to a network via a network card, a LAN cable, and the like, and an external device (for example, a personal computer, a server device, another digital multifunction peripheral, Data communication with a facsimile machine or the like). The communication unit 600 has a function of communicating with an external device such as a digital camera or a memory card via a USB interface or the like.

  The external device 800 includes a communication unit 801, an image composition application 802, and a storage unit 806. The image composition application 802 includes an image composition unit 803, a composition position determination unit 804, and an area type designation unit 805.

  In the present embodiment, the user issues an operation instruction to the external device 800 using the operation panel 500 of the digital multifunction device 10, and the control unit 400 of the digital multifunction device 10 is externally connected via the communication unit 600. A control command is transmitted to the apparatus 800, and the control unit 400 of the digital multi-function peripheral 10 directly controls the operation of the external apparatus 800 (so-called open system mode). However, the present invention is not limited to this, and a control unit (not shown) of the external device 800 may control the operation of each unit of the external device 800 in accordance with an image composition instruction from the digital multifunction peripheral 10. The external device 800 may be provided with a display device such as a liquid crystal display and an instruction input device (none of which is shown) such as a keyboard and a mouse, and the user may input an instruction via the instruction input device. .

  The communication unit 801 is constituted by a modem or a network card, for example. The communication unit 801 connects the external device 800 to a network via a network card, a LAN cable, etc., and the digital multi-function peripheral 10 or other devices (personal computer, server device, etc.) connected to the network so as to communicate with the data. Communicate. The communication unit 801 has a function of communicating with other devices such as a digital camera and a memory card via a USB interface or the like.

  The storage unit 806 stores image data of a composition image (composition image data) used for image composition processing. The image data for synthesis may be, for example, image data captured by a scanner, a digital camera, or the like, or may be image data generated by various application software provided in the external device 800. May be image data acquired from another device via the communication unit 801. Further, the resolution of the composition image data may be different from the resolution of the document image data.

  The image composition application 802 includes an image composition unit 803, a composition position determination unit 804, and an area type designation unit 805.

  The image composition unit 803 generates composite image data by performing image composition processing for compositing image data for composition on a part of the document image data received from the digital multifunction peripheral 10 via the communication unit 801, and the generated composite image Data is transmitted to the digital multi-function peripheral 10 via the communication unit 801. Note that the image data for synthesis used for this image synthesis processing is selected from the image data stored in the storage unit 806 of the external apparatus 800 by the user operating the operation panel 500 of the digital multifunction peripheral 10. However, the present invention is not limited to this. For example, not only document image data but also image data for synthesis may be transmitted from the digital multifunction peripheral 10 to the external device 800. Further, the image data for synthesis is transmitted from another device communicably connected to the external device 800 to the external device 800, and the image composition processing is performed using the image data for synthesis received by the external device 800. It may be.

  The composite position determination unit 804 generates composite position information indicating the composite position of the composite image with respect to the document image, and transmits the composite position information to the digital multifunction peripheral 10 via the communication unit 801. For example, the user operates the input unit 502 with respect to the layout of the original image displayed on the display unit 501 of the digital multi-function peripheral 10 and specifies the position of a figure (for example, a rectangle indicating the synthesis range) indicating the synthesis position of the synthesized image. Then, information indicating the designated position and range is transmitted to the external device 800. Based on these pieces of information, the composition position determination unit 804 specifies a range and a position for compositing the image data for composition in the document image data, and generates composition position information indicating the range and position.

  The area type designation unit 805 generates area identification information indicating the image type (character edge area, halftone dot area, photographic paper photo / solid area, other area, or indefinite area) of the composition image. Then, the data is transmitted to the digital multifunction peripheral 10 via the communication unit 801.

  For example, when the user designates a composition image, the image type of the composition image may be designated. In addition, when the image data is recorded in the storage unit 806, the image type of the image data is stored in association with the image type, and the image type of the image selected as the composition image by the region type designation unit 705 is stored from the storage unit 806. The region identification information may be generated by reading. Alternatively, region separation processing may be performed on the composition image data, and region identification information may be generated based on the result. In this case, the region separation processing may be performed by the external device 800, or the image data for synthesis may be transmitted to the digital multifunction device 10 and performed by the region separation processing unit 204 of the digital multifunction device 10.

(1-2. Operation of Image Processing System 1000)
First, the image input unit 100 of the digital multifunction peripheral 10 performs document image reading processing in accordance with an instruction from the user, acquires document image data (S1), and outputs the document image data to the image processing unit 200.

  In the image processing unit 200, the A / D conversion unit 201 performs A / D conversion processing on the input document image data (S2), and the shading correction unit 202 performs shading correction processing (S3). The tone correction unit 203 performs input tone correction processing (S4), and the region separation processing unit 204 performs region separation processing (S5). Thereafter, the region separation processing unit 204 determines whether or not to perform image composition processing (S6). This determination is made based on, for example, whether or not there has been an instruction to perform image composition processing from the user.

  If it is determined in S6 that the image composition processing is to be performed, the region separation processing unit 204 receives the document image data input from the input tone correction unit 203 and a region identification signal indicating the result of the region separation processing in the image storage unit 700. Remember once. Then, the communication unit 600 reads the document image data stored in the image storage unit 700 and transmits it to the external device 800 (S7).

  In the external apparatus 800, when the communication unit 801 receives the original image data transmitted from the digital multifunction peripheral 10 (S21), the combining position determination unit 804 combines the combining image with the original image data in response to an instruction input from the user. The position is determined and composite position information is generated. For example, the composition position determination unit 804 sets the value corresponding to the composition position information in each pixel belonging to the region to be composed of the composition image data in the document image data to 1 and the value corresponding to the composition position information in the other regions to 0. The indicated composite position information is generated. However, the configuration of the composite position information is not limited to this, and the composite position may be indicated by, for example, a coordinate value indicating the position of the outline or corner of the composite position or a value specifying a pixel.

  Further, the image composition unit 803 specifies the image data for composition in response to the selection instruction of the image data for composition from the user (S23). Further, the image composition unit 803 performs image composition processing of the image data for composition on the document image data to generate composite image data (S24).

  Further, the area type designation unit 805 generates area type information for designating the image type of the image data for synthesis in response to an instruction input from the user. Thereafter, the communication unit 801 returns the composite image data, the composite position information, and the area type information to the digital multi-function peripheral 10, and the external device 800 ends the process.

  FIG. 5A is an explanatory diagram showing an example of document image data in which a character / edge area, a halftone dot area, and a photographic paper photograph / solid area are mixed, and FIG. 5B is an example of composition image data. It is explanatory drawing which shows an example. It is assumed that the image type of the composition image data is designated by the user as a photographic paper photograph / solid image (printed paper photograph / solid area).

  FIG. 5C is an explanatory diagram showing an example of the synthesis position information indicating the synthesis position of the synthesis image data with respect to the document image data. FIG. 5D shows composite image data obtained by combining the image data for synthesis shown in FIG. 5B at the position indicated by the composite position information shown in FIG. 5C in the original image data shown in FIG. It is explanatory drawing which shows an example. As described above, since the image type of the image data for composition is designated by the user as a photographic paper photo / solid image (photographic paper photo / solid region), as shown in FIG. In the area identification signal after the replacement processing is performed by the identification signal replacement unit 205, the image type of the area where the image for synthesis is combined in the combined image data is photographic paper photograph / solid image (photographic paper photograph / solid area). .

  When the communication unit 600 of the digital multifunction peripheral 10 receives the composite image data, composite position information, and region type information returned from the external device 800 (S8), the region identification signal replacement unit 205 generates the region separation processing unit 204. The area corresponding to the synthesis image in the area identification signal thus replaced is replaced (corrected) with a signal corresponding to the area type information received from the external device 800 (S9). Then, the area identification signal replacement unit 205 outputs the composite image data received from the external device 800 to the color correction unit 206, and outputs the area identification signal after the replacement process to the black generation and under color removal unit 207 and the spatial filter processing unit 208. , And the gradation reproduction processing unit 210.

  On the other hand, if it is determined in S6 that the image composition processing is not performed, the region separation processing unit 204 outputs the document image data input from the input tone correction unit 203 to the color correction unit 206 as it is, and performs region separation processing. A region identification signal indicating the result is output to the black generation and under color removal unit 207, the spatial filter processing unit 208, and the gradation reproduction processing unit 210.

  Thereafter, the color correction unit 206 performs color correction processing on the image data (original image data or composite image data) input from the region identification signal replacement unit 205 (S10), and the image data after the color correction processing is converted to black. The data is output to the generated under color removal unit 207.

  Next, the black generation and under color removal unit 207 performs black generation and under color removal processing on the image data input from the color correction unit 206 based on the region identification signal input from the region identification signal replacement unit 205 (S11). ) And output to the spatial filter processing unit 208.

  Next, the spatial filter processing unit 208 performs spatial filter processing on the image data input from the black generation and under color removal unit 207 based on the region identification signal input from the region identification signal replacement unit 205 (S12), The data is output to the output tone correction unit 209.

  Next, the output tone correction unit 209 performs output tone correction processing on the image data input from the spatial filter processing unit 208 (S13), and outputs it to the tone reproduction processing unit 210.

  The gradation reproduction processing unit 210 performs gradation reproduction processing on the image data input from the output gradation correction unit 209 based on the region identification signal input from the region identification signal replacement unit 205 (S14). The image data after the gradation reproduction process is output to the image output unit 300.

  Thereafter, the image output unit 300 performs an image forming process for forming an image on the recording material according to the image data input from the gradation reproduction processing unit 210 of the image processing unit 200 (S15). Exit.

  As described above, the image processing system 1000 according to the present embodiment includes the area separation processing unit 204 that performs area separation processing on document image data to generate an area identification signal indicating the image type of each image area, and each image area. An image processing unit 220 that performs image processing according to the image type of each image region, an image combining unit 803 that combines the image data for combining with a part of the document image data, and generates combined image data; Region identification for generating a region identification signal of composite image data by replacing a region identification signal corresponding to a region where the image data for composition in the document image data is composed with a region identification signal corresponding to the image type of the image data for composition A signal replacement unit 205, and the image processing unit 220 displays each image indicated by the replacement region identification signal for each image region of the composite image data. It performs image processing in accordance with the image type of the region.

  Thereby, image processing suitable for each image region can be performed on each image region of the composite image data.

  For example, when image processing is performed on the composite image data in FIG. 5D obtained by combining the image data for synthesis in FIG. 5B with the original image data in FIG. When image processing is performed using a region identification signal obtained by region separation processing on image data, image processing corresponding to a character / edge region is performed on the image region combined with the image data for combining. That is, the image processing corresponding to the character / edge area is performed even though the image type of the image data for composition is photographic paper photograph / solid area.

  On the other hand, according to the present embodiment, among the area identification signals generated based on the document image data, the area identification signal of the image area in which the composition image data is synthesized is used as the image type of the composition image data. It replaces with the area identification signal according to. As a result, image processing corresponding to the image type indicated by the area identification signal generated based on the document image data is performed on the non-composite area in the composite image data, and the image of the image data for synthesis is applied to the composite area. Image processing according to the type can be performed. Therefore, appropriate image processing can be performed on each image area of the composite image data.

  In this embodiment, an image composition application 802 including an image composition unit 803, a composition position determination unit 804, and an area type designation unit 805, and a storage unit 806 that stores image data for composition are combined with the digital multi-function peripheral 10. Although the configuration of the external device 800 that performs communication between the devices has been described, the present invention is not limited to this. For example, one or both of the image composition application 802 and the storage unit 806 may be provided in the digital multifunction peripheral 10.

  In addition, the application target of the present invention is not limited to a digital multi-function peripheral. For example, the present invention may be provided in an image reading apparatus such as a scanner that reads a document and acquires document image data, and receives the document image data from the outside. Then, it may be provided in an image output apparatus such as a printer that performs image formation. The present invention can also be applied to an image forming system in which an image reading device and an image output device are connected via a network.

  In the present embodiment, each unit (each block) provided in the digital multi-function peripheral 10 may be realized by software using a processor such as a CPU. That is, the digital multi-function peripheral 10 includes a CPU (central processing unit) that executes instructions of a control program for realizing each function, a ROM (read only memory) that stores the program, and a RAM (random access memory) that expands the program. A configuration may be adopted in which a storage device (recording medium) such as a memory for storing the program and various data is provided. In this case, an object of the present invention is a recording medium in which a program code (execution format program, intermediate code program, source program) of a control program of the digital multi-function peripheral 10 which is software for realizing the above-described functions is recorded so as to be readable by a computer. Is supplied to the digital multi-function peripheral 10, and the computer (or CPU or MPU) reads and executes the program code recorded on the recording medium.

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Further, the digital multi-function peripheral 10 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  In addition, each block of the digital multi-function peripheral 10 is not limited to being realized using software, and may be configured by hardware logic. Hardware that performs a part of the processing and hardware of the hardware It may be a combination of arithmetic means for executing software for performing control and remaining processing.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  The present invention can be applied to an image processing apparatus and an image processing system for generating composite image data by combining composite image data with a part of document image data.

10 Digital multifunction peripherals (image processing devices, image forming devices)
DESCRIPTION OF SYMBOLS 100 Image input part 200 Image processing part 201 A / D conversion part 202 Shading correction | amendment part 203 Input tone correction | amendment part 204 Area | region separation process part 205 Area | region identification signal replacement part 206 Color correction part 207 Black generation under color removal part 208 Spatial filter process Unit 209 output tone correction unit 210 tone reproduction processing unit 220 image processing unit 300 image output unit 301 recording material conveyance processing unit 302 image formation processing unit 303 fixing processing unit 400 control unit 401 calculation unit 402 storage unit 500 operation panel 501 display Unit 502 Input unit (instruction input unit)
600 Communication unit 700 Image storage unit 705 Area type designation unit 800 External device (terminal device)
801 Communication unit 802 Image composition application 803 Image composition unit 804 Composition position determination unit 805 Area type designation unit 806 Storage unit 1000 Image processing system

Claims (13)

An area separation process for separating the document image data into a plurality of image areas according to the image type, and generating an area identification signal indicating the image type of each image area; An image processing apparatus including an image processing unit that performs image processing according to an image type of each image area,
An image synthesizing unit that synthesizes the image data for synthesis with a part of the original image data to generate synthesized image data;
An area type designation unit for specifying the image type of the image data for synthesis,
Of the region identification signal corresponding to the original image data, the region identification signal corresponding to the part of the region where the image data for synthesis is combined is identified by the region type designation unit. An area identification signal replacement unit that generates an area identification signal of the composite image data by replacing with an area identification signal corresponding to the image type of
The image processing section, each such that the synthetic image data in the composite image data is shown for each image region which is synthesized, by the region identification signal of the composite image data generated by the region identification signal replacement portion An image processing apparatus that performs image processing according to an image type of an image area. The image processing unit includes a filter processing unit that performs filter processing on image data,
The image processing apparatus according to claim 1, wherein the filter processing unit changes a filter used for the filter processing according to an image type indicated by the region identification signal. The image processing unit includes a black generation and under color removal unit that converts image data composed of a combination of a plurality of chromatic colors into image data composed of a combination of black and a plurality of chromatic colors,
The image processing apparatus according to claim 1, wherein the black generation and under color removal unit sets a black generation amount according to an image type indicated by the region identification signal. The image processing unit includes a gradation reproduction processing unit that generates a dot pattern for reproducing an image corresponding to the image data by performing dither processing on the image data,
The image processing apparatus according to claim 1, wherein the gradation reproduction processing unit changes a dither matrix used for dither processing according to an image type indicated by the region identification signal. .   The area separation processing unit classifies each image area of the document image data into one of a plurality of image types including a dot area, a character / edge area, and a photographic paper photograph / solid area. The image processing apparatus according to any one of claims 1 to 4. An instruction input unit for receiving an instruction input from a user;
The image processing apparatus according to claim 1, wherein the region type designation unit specifies an image type of the image data for synthesis in accordance with an instruction input from a user. An area separation process for separating the document image data into a plurality of image areas according to the image type, and generating an area identification signal indicating the image type of each image area; An image processing apparatus including an image processing unit that performs image processing according to the image type of each image area, and combining image data by combining the image data for synthesis with a part of the original image data. An image processing system that is communicably connected to a terminal device that includes an image composition unit to be generated,
An area type designation unit for specifying the image type of the image data for synthesis,
Of the region identification signal corresponding to the document image data, the region identification signal corresponding to the partial region combined with the composition image data corresponds to the image type specified by the region type specifying unit. An area identification signal replacement unit that generates an area identification signal of the composite image data by replacing with an area identification signal;
The image processing section, each such that the synthetic image data in the composite image data is shown for each image region which is synthesized, by the region identification signal of the composite image data generated by the region identification signal replacement portion An image processing system that performs image processing according to an image type of an image area. The image processing apparatus includes:
An instruction input unit for receiving an instruction input from a user;
The control unit according to claim 7, further comprising: a control unit that controls an operation of the image synthesizing unit provided in the terminal device in response to an instruction from a user input through the instruction input unit. The image processing system described. The terminal device includes a storage unit that stores a plurality of image data,
The image composition unit uses, as image data for synthesis, image data designated by a user via the instruction input unit provided in the image processing apparatus among the image data stored in the storage unit. The image processing system according to claim 8, wherein the composite image data is generated. The image processing device according to any one of claims 1 to 6, or the image processing device provided in the image processing system according to any one of claims 7 to 9,
An image forming apparatus comprising: an image output unit configured to form an image on a recording material according to image data output from the image processing apparatus. The original image data is separated into a plurality of image areas according to the image type, and an area separation processing step for generating an area identification signal indicating the image type of each image area, and for each image area, An image processing method for performing an image processing step of performing image processing according to an image type,
An image compositing step of compositing image data for compositing with a part of the original image data by an image compositing application to generate composite image data;
Of the region identification signal corresponding to the document image data, the region identification signal corresponding to the part of the region where the composition image data is synthesized is used as the region identification signal corresponding to the image type of the composition image data. A region identification signal replacement step of generating a region identification signal of the composite image data by replacing with
In the above image processing step, the composite image for each image area where the image data for the above synthesis is synthesized in the data, the respective images represented by the region identification signal of the composite image data generated by the area identification signal replacement step An image processing method, which performs image processing according to an image type of a region.   A program for operating the image processing apparatus according to any one of claims 1 to 6, wherein the program causes a computer to function as each unit. A recording medium storing the program according to claim 12 in a computer-readable manner.

Images