JP4267063B1 - Image processing apparatus, image processing method, program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To apply the same composition to an area (for example, a photo / graphic area) to be combined with a document image facing up and an area to be combined with a predetermined image (for example, a character area or an area having no attributes) The method will be applied.
A predetermined image to be synthesized is synthesized with each region of the document image by a method suitable for the characteristics of each region in the document image.
[Selection] Figure 17

Description

  The present invention relates to an image processing apparatus that generates a composite image by combining a document image and a predetermined image, a control method for the image processing apparatus, a program, and a storage medium.

  There is a special paper called anti-counterfeit paper. In this forgery prevention paper, a character string such as “COPY” is embedded so that it cannot be seen at first glance. The embedded character string rises on a copy obtained by copying the forgery prevention paper. Therefore, a document created using such anti-counterfeit paper can be easily distinguished from the copy. In addition, the user can be hesitant to use a copy of the document.

  Anti-counterfeit paper has such effects and has been used to create resident cards and forms. However, there is a problem that anti-counterfeit paper is expensive compared to plain paper. In addition, there is a problem that only a character string embedded at the time of paper production is lifted on a copy.

  Under such circumstances, in recent years, a new technology that can obtain the same effect as that of the forgery prevention paper has been attracting attention (see Patent Document 1). This is a technique in which original data and copy-forgery-inhibited pattern (sometimes called copy-checked copy-forgery-inhibited pattern) created using a computer are combined inside the printer, and image data with a copy-forgery-inhibited pattern obtained by this combination is output to plain paper. It is. A character string or the like is embedded in the copy-forgery-inhibited pattern image. For this reason, on the copy obtained by copying the image with the copy-forgery-inhibited pattern, the embedded character string appears as in the case of using the anti-counterfeit paper. Since this technology uses plain paper, there is an advantage that the original can be created at a lower cost than when using anti-counterfeit paper. Also, with this technique, new copy-forgery-inhibited pattern image data can be generated each time an original is created. Therefore, this technique has an advantage that the color of the copy-forgery-inhibited pattern image and the embedded character string can be freely set.

  By the way, the copy-forgery-inhibited pattern image is composed of a “remaining” region and a “disappearing” region (or “thinner than the remaining region”) on the copy. Note that the reflection densities in these two regions are substantially the same on the original. For this reason, it is not known that a character string such as “COPY” is embedded in the human eye. Here, “remaining” means that the image in the original is accurately reproduced on the copy. “Disappear” means that the original image is not reproduced on the copy. The reflection density is measured with a reflection densitometer.

  Hereinafter, the “remaining” area on the copy is referred to as a “latent image portion”, and the “disappearing” area (or “becomes thinner than the remaining area”) on the copy is referred to as a “background portion”.

  FIG. 24 is a diagram illustrating a state of dots in the tint block image. In the figure, the area where the dots are concentrated is the latent image part, and the area where the dots are dispersed is the background part. The dots in these two regions are generated by different halftone dot processing and different dither processing. For example, the dots in the latent image portion are generated by halftone dot processing with a low number of lines, and the dots in the background portion are generated by halftone dot processing with a high number of lines. Alternatively, the dots in the latent image portion are generated using a dot concentration type dither matrix, and the dots in the background portion are generated using a dot dispersion type dither matrix.

  Incidentally, the reproduction capability of a copying machine depends on the input resolution and output resolution of the copying machine. Therefore, there is a limit to the reproduction capability of the copying machine. As a result, when the dots in the latent image portion of the tint block image are formed larger than the dots that can be reproduced by the copying machine and the dots in the background portion are formed smaller than the dots that can be reproduced, the Then, the dots in the latent image portion are reproduced, but the dots in the background portion are difficult to reproduce. As a result, the latent image portion is reproduced darker than the background portion on the copy. Hereinafter, when the latent image portion is reproduced darker than the background portion on the copy, the embedded character string and the like appear to be raised, which is called visualization.

  FIGS. 25A and 25B are diagrams showing this visualization. The figure conceptually shows that concentrated dots (large dots) are reproduced on the copy and dispersed dots (small dots) are not accurately reproduced on the copy.

  The copy-forgery-inhibited pattern image is not limited to the above-described configuration, and may be configured such that a character string such as “COPY”, a symbol, a pattern, or the like appears (visualizes) on the copy so that a human can recognize it. That's fine. Even if a character string such as “COPY” is shown in white on the copy, it can be said that the copy-forgery-inhibited pattern image has achieved the purpose. In this case, it goes without saying that the area of “COPY” is called the background portion.

Patent Document 1 discloses a technique for determining a method for combining a document image and a tint block image. In this document 1, when the filled area does not exist in the document image, the document image is overwritten and combined with the copy-forgery-inhibited pattern image. Thereby, the image quality of the original image is not deteriorated by the copy-forgery-inhibited pattern image. On the other hand, when the filled area exists in the document image, the copy-forgery-inhibited pattern image is overwritten and combined with the document image. As a result, the copy-forgery-inhibited pattern image is not erased by the painted area of the document image. ,
Further, this patent document 1 describes a technique for determining which one should be overwritten based on not only whether or not a filled area exists in a document image but also at what ratio. .
JP-A-2005-136953

  However, when the technique disclosed in Patent Document 1 is used, the same composition method is applied to the entire original image.

  An object of the present invention is to synthesize a predetermined image to be combined with each region of the document image by a method suitable for the attribute of each pixel in the document image. The predetermined image includes, for example, a tint block image.

In order to solve the above-described problems, the present invention has a configuration shown in each claim.

An object of the present invention is to synthesize an image to be synthesized with each region of the original image by a method suitable for the attribute of each pixel in the original image.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

  In the following embodiments, a latent image character string and a latent image symbol are set in a latent image portion of a copy-forgery-inhibited pattern image, and are combined with an arbitrary content image to output an original (original printed matter). Further, the description will be made assuming that the latent image character string and the latent image symbol appear to rise as the background portion becomes thinner than the latent image portion in the copy.

  However, the background pattern image in the present invention is not limited to this. For example, as described above, a latent image character string or a latent image symbol is set as a background portion, and an area around the background portion is set as a latent image portion. The symbol may be expressed in white.

  The present invention is not defined by the type of tint block image, its generation process, color, shape, size, or the like.

  Further, by arranging different dot patterns on the latent image portion and the background portion of the original, it is possible to cause different moiré in the latent image portion and the background portion on the copy, thereby causing a difference in reflection density.

  Further, various methods that can be considered such as forming a tint block image using a line instead of a dot can be substituted.

<Printing system (Fig. 1)>
Next, Example 1 will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a printing system according to an embodiment of the present invention. In this system, the host computer 40 and the three image forming apparatuses (10, 20, 30) are connected to the LAN 50. However, in the printing system according to the present invention, the number of connections is not limited. In this embodiment, LAN is applied as a connection method, but the present invention is not limited to this. For example, an arbitrary network such as a WAN (public line), a serial transmission method such as USB, and a parallel transmission method such as Centronics and SCSI can be applied.

  A host computer (hereinafter referred to as a PC) 40 has a function of a personal computer. The PC 40 can send and receive files and send and receive e-mails using the FTP and SMB protocols via the LAN 50 and WAN. Further, it is possible to issue a print command from the PC 40 to the image forming apparatuses 10, 20, and 30 via a printer driver.

  The image forming apparatuses 10 and 20 are apparatuses having the same configuration. The image forming apparatus 30 is an image forming apparatus having only a print function, and does not have the scanner unit included in the image forming apparatuses 10 and 20. In the following, for the sake of simplicity of explanation, the configuration will be described in detail focusing on the image forming apparatus 10 of the image forming apparatuses 10 and 20.

  The image forming apparatus 10 includes a scanner unit 13 that is an image input device, a printer unit 14 that is an image output device, a controller (controller unit) 11 that controls operation of the entire image forming apparatus 10, and an operation unit that is a user interface (UI). 12 is comprised.

<Image Forming Apparatus 10 (FIG. 2)>
An appearance of the image forming apparatus 10 is shown in FIG. The scanner unit 13 converts image information into an electrical signal by inputting reflected light obtained by exposing and scanning an image on a document to the CCD. The scanner unit further converts the electrical signal into a luminance signal composed of R, G, and B colors, and outputs the luminance signal to the controller 11 as image data.

  The document is set on the tray 202 of the document feeder 201. When the user instructs to start reading from the operation unit 12, a document reading instruction is given from the controller 11 to the scanner unit 13. Upon receiving this instruction, the scanner unit 13 feeds the documents one by one from the tray 202 of the document feeder 201 and performs a document reading operation. Note that the document reading method is not an automatic feeding method by the document feeder 201, but a method of scanning the document by placing the document on a glass surface (not shown) and moving the exposure unit.

  The printer unit 14 is an image forming device that forms image data received from the controller 11 on a sheet. In this embodiment, the image forming method is an electrophotographic method using a photosensitive drum or a photosensitive belt, but the present invention is not limited to this. For example, the present invention can also be applied to an ink jet system that prints on paper by ejecting ink from a micro nozzle array. The printer unit 14 is provided with a plurality of paper cassettes 203, 204, and 205 that allow selection of different paper sizes or different paper orientations. The paper after printing is discharged to the paper discharge tray 206.

<Detailed Description of Controller 11 (FIG. 3)>
FIG. 3 is a block diagram for explaining the configuration of the controller 11 of the image forming apparatus 10 in more detail.

  The controller 11 is electrically connected to the scanner unit 13 and the printer unit 14. On the other hand, the controller 11 is connected to the PC 40 or an external device via the LAN 50 or the WAN 331. As a result, image data and device information can be input and output.

  The CPU 301 comprehensively controls access to various connected devices based on a control program stored in the ROM 303, and also performs overall control of various processes performed in the controller. A RAM 302 is a system work memory for the operation of the CPU 301 and also a memory for temporarily storing image data. The RAM 302 includes an SRAM that retains stored content even after the power is turned off, and a DRAM that erases the stored content after the power is turned off. The ROM 303 stores a boot program for the apparatus. An HDD 304 is a hard disk drive and can store system software and image data.

  The operation unit I / F 305 is an interface unit for connecting the system bus 310 and the operation unit 12. The operation unit I / F 305 receives image data to be displayed on the operation unit 12 from the system bus 310 and outputs the image data to the operation unit 12 and outputs information input from the operation unit 12 to the system bus 310.

  A network I / F 306 is connected to the LAN 50 and the system bus 310 to input / output information. The Modem 307 is connected to the WAN 331 and the system bus 310, and inputs and outputs information. A binary image rotation unit 308 converts the direction of image data before transmission. The binary image compression / decompression unit 309 converts the resolution of the image data before transmission into a resolution that matches a predetermined resolution or the partner's ability. For compression and expansion, methods such as JBIG, MMR, MR, and MH are used. The image bus 330 is a transmission path for exchanging image data, and is configured by a PCI bus or IEEE1394.

  The scanner image processing unit 312 corrects, processes, and edits image data received from the scanner unit 13 via the scanner I / F 311. The scanner image processing unit 312 determines whether the received image data is a color document or a monochrome document, a character document, or a photographic document. Then, the determination result is attached to the image data. Such accompanying information is referred to as attribute data. Details of processing performed by the scanner image processing unit 312 will be described later.

  The compression unit 313 receives the image data, and divides the image data into blocks of 32 pixels × 32 pixels. The 32 × 32 pixel image data is referred to as tile data. FIG. 4 conceptually shows this tile data. In a document (paper medium before reading), an area corresponding to the tile data is referred to as a tile image. The tile data is added with the average luminance information in the 32 × 32 pixel block and the coordinate position of the tile image on the document as header information. Further, the compression unit 313 compresses image data including a plurality of tile data. The decompression unit 316 decompresses image data composed of a plurality of tile data, raster-expands it, and sends it to the printer image processing unit 315.

  The printer image processing unit 315 receives the image data sent from the decompression unit 316 and performs image processing on the image data while referring to the attribute data attached to the image data. The image data after the image processing is output to the printer unit 14 via the printer I / F 314. Details of processing performed by the printer image processing unit 315 will be described later.

  The image conversion unit 317 performs a predetermined conversion process on the image data. This processing unit is composed of the following processing units.

  A decompression unit 318 decompresses the received image data. The compression unit 319 compresses the received image data. The rotation unit 320 rotates the received image data. The scaling unit 321 performs resolution conversion processing (for example, 600 dpi to 200 dpi) on the received image data. The color space conversion unit 322 converts the color space of the received image data. The color space conversion unit 322 performs a known background removal process using a matrix or a table, performs a known LOG conversion process (RGB → CMY), or performs a known output color correction process (CMY → CMYK). Can be. The binary multi-value conversion unit 323 converts the received two-gradation image data into 256-gradation image data. Conversely, the multi-level binary conversion unit 324 converts the received 256-gradation image data into 2-gradation image data using a technique such as error diffusion processing.

  The synthesizer 327 synthesizes the received two image data to generate one piece of image data. When combining two pieces of image data, a method of using an average value of luminance values of pixels to be combined as a combined luminance value, or a luminance value of a pixel having a brighter luminance level, A method for obtaining a luminance value is applied. In addition, it is possible to use a method in which the darker pixel is used as a synthesized pixel. Furthermore, a method of determining a luminance value after synthesis by a logical sum operation, a logical product operation, an exclusive logical sum operation, or the like between pixels to be synthesized is also applicable. These synthesis methods are all well-known methods. The thinning unit 326 performs resolution conversion by thinning out the pixels of the received image data, and generates image data such as 1/2, 1/4, and 1/8. The moving unit 325 adds a margin part to the received image data or deletes the margin part.

  The RIP 328 receives intermediate data generated based on PDL code data transmitted from the PC 40 or the like, and generates bitmap data (multi-value).

<Detailed Description of Scanner Image Processing Unit 312 (FIG. 5)>
FIG. 5 shows an internal configuration of the scanner image processing unit 312.

  The scanner image processing unit 312 receives image data composed of RGB 8-bit luminance signals. This luminance signal is converted by the masking processing unit 501 into a standard luminance signal that does not depend on the filter color of the CCD.

  The filter processing unit 502 arbitrarily corrects the spatial frequency of the received image data. This processing unit performs arithmetic processing using, for example, a 7 × 7 matrix on the received image data. By the way, in a copying machine or a multifunction machine, a character mode, a photo mode, or a character / photo mode can be selected as a copy mode by depressing the 704 tab in FIG. When the character mode is selected by the user, the filter processing unit 502 applies a character filter to the entire image data. When the photo mode is selected, a photo filter is applied to the entire image data. When the character / photo mode is selected, the filter is adaptively switched for each pixel in accordance with a character photo determination signal (part of attribute data) described later. In other words, it is determined for each pixel whether to apply a photo filter or a character filter. Note that coefficients for smoothing only high-frequency components are set in the photographic filter. This is because the roughness of the image is not noticeable. In addition, a coefficient for performing strong edge enhancement is set in the character filter. This is to increase the sharpness of the characters.

  The histogram generation unit 503 samples the luminance data of each pixel constituting the received image data. More specifically, luminance data in a rectangular area surrounded by a start point and an end point specified in the main scanning direction and the sub scanning direction are sampled at a constant pitch in the main scanning direction and the sub scanning direction. Then, histogram data is generated based on the sampling result. The generated histogram data is used to estimate the background level when performing background removal processing. The input-side gamma correction unit 504 converts luminance data having nonlinear characteristics using a table or the like.

  A color / monochrome determination unit 505 determines whether each pixel constituting the received image data is a chromatic color or an achromatic color, and the determination result is converted into image data as a color / monochrome determination signal (part of attribute data). Accompany it.

  The character photograph determination unit 506 determines whether each pixel constituting the image data is a pixel constituting a character, a pixel constituting a halftone dot, a pixel constituting a character in a halftone dot, or a pixel constituting a solid image Is determined based on the pixel value of each pixel and the pixel values of peripheral pixels of each pixel. Note that pixels that do not correspond to any of these are pixels that form a white region. Then, the determination result is attached to the image data as a character / photo determination signal (part of attribute data).

  In the present invention, pixels constituting halftone dots, pixels constituting halftone dots, and pixels constituting solid images are referred to as pixels having photo / graphic attributes. Alternatively, it is referred to as a pixel whose attribute type is a photograph / figure.

<Detailed Description of Printer Image Processing Unit 315 (FIG. 6)>
FIG. 6 shows the flow of processing performed in the printer image processing 315.

  The background removal processing unit 601 uses the histogram generated by the scanner image processing unit 312 to remove (remove) the background color of the image data. The monochrome generation unit 602 converts color data into monochrome data. The Log conversion unit 603 performs luminance density conversion. For example, the Log conversion unit 603 converts RGB input image data into CMY image data. The output color correction unit 604 performs output color correction. For example, image data input as CMY is converted into CMYK image data using a table or matrix. The output-side gamma correction unit 605 performs correction so that the signal value input to the output-side gamma correction unit 605 is proportional to the reflection density value after copying output. The halftone correction unit 606 performs arbitrary halftone processing in accordance with the number of gradations of the printer unit to be output. For example, the halftone correction unit 606 performs binarization or binarization on the received high gradation image data.

  Each processing unit in the scanner image processing unit 312 and the printer image processing unit 315 can output the received image data without performing each processing. Such passing of data without performing processing in a certain processing unit will be expressed as “through the processing unit” below. The description of the controller 11 has been described above.

<Description of Copy Operation and PDL Print Operation>
Next, a copy operation and a PDL print operation will be described with reference to FIGS. 2, 5, and 6. FIG.

  First, the copy operation will be described. The document read by the scanner unit 13 is sent as image data to the scanner image processing unit 312 via the scanner I / F 311. The scanner image processing unit 312 performs the processing shown in FIG. 5 on this image data, and generates attribute data together with new image data. Further, this attribute data is attached to the image data. Subsequently, the compression unit 313 generates tile data by dividing the image data into blocks of 32 pixels × 32 pixels. Further, the compression unit 313 compresses the image data including the plurality of tile data. The image data compressed by the compression unit 313 is sent to the RAM 302 and stored. The image data is sent to the image conversion unit 317 as necessary, subjected to image processing, and then sent again to the RAM 302 for storage. Thereafter, the image data stored in the RAM 302 is sent to the decompression unit 316. The decompression unit 316 decompresses this image data. Further, the decompression unit 316 raster-expands image data composed of a plurality of tile data after decompression. The rasterized image data is sent to the printer image processing unit 315. The printer image processing unit 315 performs image data editing according to attribute data attached to the image data. This process is the process shown in FIG. The image data that has been edited by the printer image processing unit 315 is sent to the printer unit 14 via the printer I / F 314. Finally, the printer unit 14 forms an image on the output paper.

  Note that the editing method in each processing unit in the scanner image processing unit 312 or the printer image processing unit 315, that is, each processing unit shown in FIGS. 5 and 6 is switched by register switching. This register switching is performed according to attribute data, setting information (by the user) from the operation unit 12, or the like. Although omitted in the above description, it goes without saying that processing stored in the ROM 303 or HDD 304 and image data extraction processing stored in the ROM 303 or HDD 304 may be performed as necessary.

  Subsequently, the PDL operation will be described. PDL data sent from the PC 40 via the LAN 50 is sent to the RAM 302 via the Network I / F 306 and stored. Intermediate data generated by interpreting the PDL data stored in the RAM 302 is sent to the RIP 328. The RIP 328 renders the intermediate data to generate raster format image data.

  When PDL data before interpretation is created by a specific application, object data exists in the PDL data. Object data is a general term for character code data, bitmap data, graphic data, paint data, and the like that constitute a document image. PDL data including such object data is rendered after being converted to intermediate data as described above. At that time, pixel values for each pixel in the document image are generated, but in practice, attribute information for each pixel in the document image is generated. This attribute information is determined by determining the type of object data in each pixel area. That is, when the object data corresponding to a certain pixel is a character code, the attribute information of the pixel is “character”. When the object data corresponding to a certain pixel is bitmap data, the attribute information of the pixel is “image”. When the object data corresponding to a certain pixel is graphic data and has a certain width or more in both length and width, the attribute information of the pixel is “graphic”. Further, when the object data corresponding to a certain pixel is graphic data, and the width in either the vertical or horizontal direction is equal to or less than a certain value, the attribute information of the pixel is “line”.

  The raster-format image data generated as described above is sent to the compression unit 329 together with the attribute information. The compression unit 329 compresses the image data after dividing it into blocks. The compressed image data is sent to the RAM 302. Needless to say, this image data is accompanied by attribute information. When PDL printing is instructed, this image data is sent to the printer unit 14 and an image is formed on the output paper. Since this operation is the same as the copy operation, description thereof is omitted.

  Next, a method for setting a background pattern will be described.

<Explanation of operation screen>
FIGS. 7, 8, 9, and 10 show operation screens displayed when the initial screen and the background pattern are set.

  FIG. 7 shows an initial screen in the image forming apparatus 10. An area 701 indicates whether or not the image forming apparatus 10 is ready for copying, and indicates the set number of copies. A document selection tab 704 is a tab for selecting a document type. When this tab is depressed, three types of selection menus of text, photo, and text / photo mode are displayed in a pop-up. A finishing tab 706 is a tab for performing settings related to various finishings. A duplex setting tab 707 is a tab for performing settings relating to duplex reading and duplex printing. A reading mode tab 702 is a tab for selecting an original reading mode. When this tab is depressed, three types of selection menus of color / black / automatic (ACS) are popped up. Note that color copy is performed when color is selected, and monochrome copy is performed when black is selected. When ACS is selected, the copy mode is determined by the monochrome color determination signal described above.

  FIG. 8 is a screen displayed when the application mode tab 705 in FIG. 7 is pressed down. The user can make settings relating to the reduced layout, color balance, background pattern, and the like on this screen.

  FIG. 9 is a screen displayed when the copy-forgery-inhibited pattern tab 801 in FIG. 8 is pressed down. On this screen, the user can set character string information (confidential, copy prohibition, invalid, CONFIDENTIAL, confidential, copy), symbol information (★), and the like as latent images. For example, when symbol information (★) is set as a latent image, the symbol information tab 901 may be pushed down and then the Next tab 902 may be pushed down.

  FIG. 10 is a screen displayed when the Next tab 902 in FIG. 9 is pressed down. The user can set the font size and color of the latent image on this screen. Font size candidates include large, medium, and small (1001), and color candidates include black, magenta, and cyan (1002). When the OK tab 1003 is pressed after the font and color settings are completed, the background pattern setting is completed.

<Image formation processing of image data with tint block>
In the following, the process from when the document image data obtained by reading the document is combined with the copy-forgery-inhibited pattern image data to generate a combined image and to form an image on output paper will be described with reference to FIG. In executing each process, the CPU 301 performs overall control. The RAM 302 functions as a main memory or work area for the CPU 1.

  When an instruction to add a background pattern to a document is given through the operation screen (FIGS. 8 to 10 and the like), the scanner unit 13 starts a document reading process (S1601). The document image data generated by this reading process is sent to the scanner image processing unit 312 and subjected to predetermined image processing (S1602). In addition, as described above, the attribute information is generated for each pixel when the predetermined image processing is performed (see the character photograph determination unit 506 in FIG. 5). The document image data that has undergone predetermined image processing is sent to the compression unit 313 and compressed (S1603). The compressed document image data is sent to and stored in the RAM 302 together with attribute data attached to the document image data (S1604). The document image data stored in the RAM 302 is composed of a plurality of tile data. The above processing is the same as the processing described in <Copy operation>.

  Thereafter, the document image data stored in the RAM 302 is sent to the decompression unit 318. The decompressing unit 318 decompresses the document image data (S1605). The expanded document image data is sent to the color space conversion unit 322. The color space conversion unit 322 performs background removal processing, monochrome generation processing, log conversion processing, and output color correction processing on the document image data (S1606). These processes correspond to the processes performed in the background removal processing unit 601, the monochrome generation unit 602, the log conversion unit 603, and the output color correction unit 604 in FIG. The document image data subjected to the above processing is sent to the compression unit 319. The compression unit 319 compresses the document image data that has been subjected to the image processing by the color space conversion unit 322 (S1607). The compressed document image data is sent to and stored in the RAM 302 (S1608). On the other hand, the copy-forgery-inhibited pattern image data generated by the processing to be described later is stored in the RAM 302 as uncompressed image data (S1609). Note that the copy-forgery-inhibited pattern image data stored in the RAM 302 is composed of a plurality of tile data like the original image data.

  Subsequently, a method for combining the document image data and the copy-forgery-inhibited pattern image data is determined (S1610).

  Subsequently, the document image data stored in the RAM 302 is sent to the decompression unit 318. The decompressing unit 318 decompresses the document image data (S1611). The expanded document image data is sent to the synthesis unit 327. Similarly, the copy-forgery-inhibited pattern image data is sent to the synthesis unit 327 via the decompression unit 318. The decompressing unit 318 does not decompress the tint block image data. This is because the tint block image data is not originally compressed.

  As described above, the document image data and the copy-forgery-inhibited pattern image data are sent to the synthesis unit 327. At the same time, the synthesis method determined in S1610 is also sent. The synthesizing unit 327 synthesizes these two image data by the synthesizing method determined in S1610 (S1612). Since the two image data are both composed of a plurality of tile data, the combined image data is also composed of a plurality of tile data. Details of the composition processing in S1612 will be described later. The composite image data is sent to the compression unit 319. The compression unit 319 compresses the composite image data (S1613). The compressed composite image data is sent to and stored in the RAM 302 (S1614). Further, the composite image data stored in the RAM 302 is sent to the decompression unit 316. The decompression unit 316 decompresses the composite image data. Furthermore, the expanded composite image data is rasterized (S1615). The rasterized composite image data is output to the printer image processing unit 315.

  Subsequently, the printer image processing unit 315 performs output side gamma correction processing and halftone correction processing on the composite image data (S1616). These processes correspond to the processes performed by the output-side gamma correction unit 605 and the halftone correction unit 606 in FIG. On the other hand, background removal processing, monochrome generation processing, log conversion processing, and output color correction processing are not performed. These processes correspond to the processes performed by the background removal processing unit 601, the monochrome generation unit 602, the log conversion unit 603, and the output color correction unit 604 in FIG. The reason why the background removal process, the log conversion process, and the output color correction process are not performed on the composite image data is to prevent the copy-forgery-inhibited pattern image from being destroyed by performing these processes. Note that, as described above, these processes are performed on the document image data by the color space conversion unit 322 in advance.

  The composite image data subjected to the above processing in the printer image processing unit 315 is output to the printer unit 14 via the printer I / F 314. The printer unit 14 outputs the composite image data on the output paper (S1617). That is, the composite image data is formed on the output paper. The above is the procedure of the image forming process for the image with a tint block (composite image).

  Although omitted in the above description, it goes without saying that the processing stored in the ROM 303 and the HDD 304 and the image data stored in the ROM 303 and the HDD 304 may be taken out as necessary.

<Flow of generation of tint block image data (FIG. 11)>
Next, the flow of processing when the copy-forgery-inhibited pattern image data is generated will be described with reference to FIG.

  First, bitmap data is generated based on latent image information (confidential, copy prohibition, symbol information, etc.) designated by the user. The symbol pattern 1101 is a conceptual diagram of bitmap data generated based on symbol information.

  Subsequently, a latent image pattern 1102 and a background pattern 1103 (both bitmap data) are generated by dither processing.

  Although the dither processing is a known technique, the case where both the dot concentration type dither matrix and the dot dispersion type matrix are 4 × 4 (FIGS. 12 and 13) is used as an example and is easily described with reference to FIGS. Give a simple explanation. FIG. 14 shows dot patterns generated by applying density signal values 3, 6, and 9 to the dot concentration type dither matrix shown in FIG. Here, when FIG. 12 is compared with FIG. 14, a dot is placed (on) at a pixel position where the numerical value in the dot concentration type dither matrix (FIG. 12) is equal to or less than the density signal value. You can see that Similarly, FIG. 15 shows dot patterns generated by applying density signal values 2, 4, and 5 to the dot dispersion type dither matrix shown in FIG. 14 and 15 are compared, it can be seen that the dot pattern in FIG. 14 is a concentrated dot pattern, whereas the dot pattern in FIG. 15 is a distributed dot pattern.

  This is the end of the description of the dither processing, and the description returns to the generation processing of the latent image pattern 1102 and the background pattern 1103.

  The HDD 304 stores a latent image portion generation dither matrix (hereinafter referred to as a latent image matrix) and a latent image portion generation density signal value to be applied to the dither matrix. In addition, a background portion generation dither matrix (hereinafter referred to as a background matrix) and background portion generation density signal values to be applied to the dither matrix are stored.

  In generating the latent image pattern 1102, the latent image matrix and the latent image portion generation density signal value are read from the HDD 304. The read latent image portion generation density signal value is applied to the latent image matrix. Then, a latent image pattern 1102 is generated. Similarly, a background pattern 1103 is generated.

  Subsequently, a pattern in which the latent image pattern 1102 and the background pattern 1103 are repeated a predetermined number of times (referred to as a latent image repeating pattern 1104 and a background repeating pattern 1105) is generated. Thereafter, latent image data 1106 is generated from the latent image repetition pattern 1104 and the symbol pattern 1101. Similarly, background image data 1107 is generated. Then, the generated latent image data 1106 and background image data 1107 are combined to generate copy-forgery-inhibited pattern image data 1108. The copy-forgery-inhibited pattern image data 1108 generated as described above is binary bitmap data. This bitmap data is accompanied by any color information of CMK. The color information may be determined by user settings or may be determined based on the color information of the document image data.

  As described above, in this embodiment, the copy-forgery-inhibited pattern image data is generated using the dither processing, but the present invention is not limited to this. For example, an error diffusion method or an average density method may be used to create a background pattern.

<Details of Synthesis Method Determination Process 1 (S1610)>
Next, step S1610 for determining a method for combining document image data and copy-forgery-inhibited pattern image data will be described with reference to FIG. In executing each process, the CPU 301 performs overall control. The RAM 302 functions as a main memory or work area for the CPU 301.

  In S1701, it is determined whether or not a tint block image should be combined with the target pixel that is the current target. Here, the pixel to which the copy-forgery-inhibited pattern image is to be synthesized is a pixel having no photo / graphic attribute. In addition, the pixels that should not be combined with the tint block image are pixels having photo / graphic attributes. Therefore, if the attribute of the target pixel is a photograph / graphic, the process proceeds to S1703. If the attribute is not a photograph / graphic, the process proceeds to S1702. In this way, the copy-forgery-inhibited pattern image is not combined with the area having the photo / graphic attribute to prevent deterioration of the image quality of the area having the photo / graphic attribute, and the copy-prohibition effect is achieved by combining the copy-forgery-inhibited pattern image with the other area. The original document image is output.

  In step S <b> 1703, information indicating that the target pixel is a pixel that does not synthesize a tint block image is stored in the RAM 302.

  In S <b> 1702, information indicating that the target pixel is a pixel to synthesize a tint block image is stored in the RAM 302.

  In S1704, it is determined whether or not the processing in S1702 and S1703 has been performed on all the pixels. That is, it is determined whether or not all the pixels in the document image are the target pixels. If it is determined that the processing for all the pixels has been completed, the processing in FIG. 17 is terminated. If it is determined that the processing for all the pixels has not been completed, the process returns to S1701, and the above-described processing is performed using the new pixel as the target pixel.

<Details of Composition Process 1 (S1612)>
In S1610 described above, when a region to be combined with a region to be combined and a region not to be combined are determined, a copy-forgery-inhibited pattern image reflecting the determination is generated in S1612.

  First, it is read out which pixel is determined to be a copy-forgery-inhibited pattern image to be synthesized in S1610.

  For the pixels determined to be combined, the pixel value of the target pixel in the document image and the pixel value of the target pixel in the copy-forgery-inhibited pattern image are combined with the smaller value (the lesser value). It is determined as the pixel value of the image (determined as logical sum synthesis). However, the composition method in the present invention is not limited to the logical sum composition, and may be an overwriting composition of a tint block image.

  In addition, in the case of overwriting synthesis of the copy-forgery-inhibited pattern image (with respect to the document image), when the target pixel is white in the copy-forgery-inhibited pattern image, the pixel value of the target pixel in the composite image is set equal to the pixel value of the target pixel in the document image To do. Further, when the target pixel is other than white in the copy-forgery-inhibited pattern image, the pixel value of the target pixel in the composite image is set equal to the pixel value of the target pixel in the copy-forgery-inhibited pattern image.

  Based on the above, when overwriting composition is compared with logical sum composition, the pixel value of the copy-forgery-inhibited pattern image is reflected in the synthesized image in overwriting composition. For this reason, it can be said that the overwriting composition has an advantage that a copy-forgery-inhibited pattern image with no deterioration is synthesized with the original image. However, since the copy-forgery-inhibited pattern image without deterioration is synthesized, there is a drawback that the image quality of the document image is deteriorated.

  Further, the pixel value in the original image is not changed for the pixel determined not to be combined. In this way, processing is performed on both the pixel that should be combined and the pixel that should not be combined. The above processing is performed for each pixel. If it is performed for all pixels, the processing in S1612 ends. That is, a composite image is generated.

  The effect when the copy-forgery-inhibited pattern image is combined with the original image by the combining method determined in the combining determination process will be described with reference to FIGS. 21, 22, and 23. FIG. FIG. 21 shows a document image. FIG. 22 shows an image when a copy-forgery-inhibited pattern image is simply combined with a document image. FIG. 23 is a composite image obtained when a copy-forgery-inhibited pattern image is combined with a document image by the combination method determined in the combination determination process. Comparing FIG. 22 and FIG. 23, in FIG. 22, the copy-forgery-inhibited pattern image is synthesized in all regions, whereas in FIG. 23, the copy-forgery-inhibited pattern image is not synthesized only in the region having the graphic attribute and the region having the image attribute. . For this reason, the synthesized image shown in FIG. 23 does not deteriorate the image quality in the area having the graphic attribute and the area having the image attribute.

<Details of Synthesis Method Determination Process 2 (S1610)>
FIG. 18 is a flowchart showing another example of the synthesis method determination process (S1610) in the present invention. In this example, after determining similarly to which area of the original image the copy-forgery-inhibited pattern image is to be synthesized, <details of composition processing 1>, the judgment result is displayed as a preview. In other words, the copy-forgery-inhibited pattern image is displayed on the display screen so that it can be seen in which area of the original image the copy-forgery-inhibited pattern image is combined and in which area the copy-forgery-inhibited pattern image is not combined. At the same time, on this display screen, it is possible to change the region where the tint block image is synthesized (or the region where the tint block image is not synthesized) according to a user instruction. By making this change possible, it is possible to create an output that takes into account the two balances of improving the copy suppression effect and preventing image quality deterioration of the original image.

  Since the processing in S1801 to S1804 is the same as the processing in S1701 to S1704, description thereof is omitted.

  In step S1805, the operation screen of the operation unit 12 displays a first image that allows the user to know which region of the original image is a region where the copy-forgery-inhibited pattern image is to be synthesized and which region is a region where the copy-forgery-inhibited pattern image is not to be synthesized. Control to display above. At the same time, an instruction to change the tint block synthesis area is received on the display screen. An example of this display screen is shown in FIG. 19 (details of FIG. 19 will be described later). Note that the first image in the present embodiment is an image created by giving a predetermined color only to an area where a copy-forgery-inhibited pattern image is to be synthesized and adding no color to other areas. However, the first image in the present invention is not limited to this. For example, an image created by adding a frame only to a region where a copy-forgery-inhibited pattern image is to be combined may be used as the first image. Further, a synthesized image obtained by synthesizing two images by the synthesis method determined in S1802 or S1803 may be used as the first image.

  In S1806, it is determined whether or not there has been a region selection instruction from the user (this instruction will be described later). If there is an area selection instruction, the process advances to step S1807. If there is no area selection instruction, the processing in FIG. 18 is terminated.

  In step S1807, information indicating which area is the selected area is stored in the RAM 302 together with information on whether the selected area is an area where the background pattern should be synthesized or an area where the background pattern should not be synthesized.

  Next, an example of processing in S1805 and S1806 will be specifically described. In FIG. 19, reference numeral 1901 denotes a background pattern addition setting area for allowing the user to select “add a background pattern to a specific area” or “not add a background pattern to a specific area”. Reference numeral 1902 denotes a tab used when the user specifies to display in the area 1907 the first image of the page immediately before the currently previewed page. Reference numeral 1903 denotes a tab used when the user designates to display in the area 1907 the first image of the page immediately after the currently previewed page. Reference numeral 1904 denotes a tab for designating a page to be displayed as the first image in the preview area 1907. Reference numeral 1905 denotes an area for displaying a currently targeted page. Reference numeral 1906 denotes a tab for displaying the first image of all pages (or the first image of the limit number that can be displayed in the operation screen). Reference numeral 1907 denotes an area for displaying the first image of the designated page. The preview area 1907 is configured to accept a position input by the user from the operation unit 12. For example, when the user designates the first position and the second position in the preview area 1907, a rectangular area having a diagonal line connecting the first position and the second position is selected.

  It should be noted that if “add a background pattern to a specific area” is selected in the background pattern addition setting area 1901 and then an area is selected on the preview area 1907, the selected area becomes an area to be combined with the background pattern image. Will be set. Then, this area designation is reflected in the first image (also referred to as the second composite image) displayed on the preview area 1907. Specifically, for example, an area selected on the preview area 1907 is colored (framed or synthesized with a tint block image). Of course, there is no change in the display of the area whose position is not designated on the preview area 1907.

  On the other hand, if “do not add a background pattern to a specific area” is selected in 1901 and then an area is selected on the preview area 1907, the selected area is set as an area that should not be synthesized with the background pattern image. Will be. Then, this area selection is reflected in the first image displayed on the preview area 1907. Specifically, for example, the frame of the region surrounded by the frame among the regions selected on 1907 is erased, the color of the colored portion is erased, or the portion where the tint block image is synthesized Remove the tint block image. As a result, the area selection is reflected in the first image. Of course, there is no change in the display of the area not selected on the preview area 1907.

  Reference numeral 1908 denotes an OK tab for determining that the copy-forgery-inhibited pattern image is an area to be synthesized and an area not to be synthesized. When this OK tab 1908 is pressed, the processing in S1806 is started. That is, before the OK tab is pressed, it is determined whether or not the setting of the area where the copy-forgery-inhibited pattern image should be combined (or should not be combined) has been performed based on the user's instruction.

  In S1805 described above, the description has been made assuming that the screen shown in FIG. 19 is displayed. However, the screen to be displayed in S1805 of the present invention is not limited to this. Any screen may be used as long as it can distinguish between the area to be synthesized and the area not to be synthesized in the copy-forgery-inhibited pattern image and can change the area displayed so as to be distinguishable. As an example, there is a screen as shown in FIG.

  20 are different from FIG. 19 in a background pattern addition setting area 2001, a display setting area 2008, and a reflection setting area 2009.

  2001, “Add a background pattern to a specific area”, “Do not add a background pattern to a specific area”, “Add a background pattern to an area having a specific attribute”, or “Do not add a background pattern to an area having a specific attribute”. This is a copy-forgery-inhibited pattern addition setting region for allowing the user to select the item.

  Reference numeral 2008 denotes a display setting area, which displays “composite image display” by default. However, when the display setting area 2008 is pressed, the display changes to “display for each attribute”. When the “composite image display” is selected, the first image is displayed in the preview area. On the other hand, when “display by attribute” is selected, the second image is displayed in the preview area. This second image is an image in which each area of the original image is colored according to the attribute. For example, a pixel that forms a character, a pixel that forms a halftone dot, a pixel that forms a character in a halftone dot, a pixel that forms a solid image, and other pixels are added with different colors, respectively. Generate an image of However, the second image in the present invention is not limited to this. For example, each area of the document image may be surrounded by a color frame corresponding to the attribute.

  Reference numeral 2009 denotes a reflection setting area, which displays “Reflect every page” by default. However, when the reflection setting area 2009 is pressed, the display changes to “all page reflection”. When “Reflect for each page” is selected, the instruction specified in the background pattern addition setting area 2001 is reflected only on the current page. In addition, when “all pages are reflected”, the instruction specified in the background pattern addition setting area 2001 is reflected on all pages.

  For example, it is assumed that the pixel constituting the solid image on the preview area 1907 is specified by a pointing device (not shown) after “Add background pattern to an area having a specific attribute” is selected in the background pattern addition setting area 2001. . Then, the background pattern is set to be added to all the pixels constituting the solid image. As a result of this setting being reflected in the first image, the pixel portions constituting the solid image are colored or surrounded by a frame.

  At this time, if “reflection for each page” is set in the reflection setting area 2009, the background pattern is set to be added to the pixels constituting the solid image in the current page. On the other hand, when “all page reflection” is set in the reflection setting area 2009, the background pattern is set to be added to the pixels constituting the solid image of all pages.

  As described above, the user selects a specific type of attribute by selecting “Add background pattern to an area having a specific attribute” on the background pattern addition setting area 2001 and specifying a pixel position on the preview area 1907. can do. As a result, it is possible to instruct to add a copy-forgery-inhibited pattern image to all pixels having this specific type of attribute. When “Do not add background pattern to region having specific attribute” is selected, the opposite is instructed.

  When the UI shown in FIG. 20 is used, unlike the case of using the UI shown in FIG. 19, it is possible to select whether to add a tint block for each finer attribute. In other words, more detailed attributes (photograph / figure) such as pixels constituting characters, pixels constituting halftone dots, pixels constituting characters in halftone dots, pixels constituting solid images, and other pixels. The tint block addition setting for each attribute) can be performed. Since the preview can be displayed with different display for each fine attribute in this way, the user can make the background pattern addition setting while confirming which attribute is the finer attribute. it can. Furthermore, since the reflection of all pages can be selected, the number of times of performing the tint block addition setting operation can be reduced.

<Details of Composition Process 2 (S1612)>
In S1610 described above, when the area to be combined with the area to be combined with the background pattern image is determined, and the user's selection is confirmed, a background pattern image reflecting these determinations is generated in S1612. FIG. 26 is a flowchart illustrating the processing flow in S1612.

  First, in S2601, it is determined whether or not the target pixel is a pixel for which the background pattern addition is designated by the user. If the pixel has been designated to be added with the background pattern, the process advances to step S2605. On the other hand, if the pixel has not been designated to add a tint block, the process proceeds to S2602.

  Next, in step S2602, it is determined whether the target pixel is a pixel for which the user has designated non-addition of tint block. If it is a pixel for which no tint block is specified, the process proceeds to S2604. On the other hand, if the pixel has not been designated to add a background pattern, the process proceeds to S2603.

  In step S2603, it is determined whether the target pixel is a pixel having a photograph / graphic attribute. If the pixel has a photo / graphic attribute, the process advances to step S2605. If the pixel does not have a photo / graphic attribute, the process advances to step S2604.

  In step S2604, the pixel value of the target pixel in the document image is used as the pixel value of the target pixel in the composite image.

  In step S 2605, the larger value of the pixel value of the target pixel in the copy-forgery-inhibited pattern image and the pixel value of the target pixel in the document image is set as the pixel value of the target pixel in the composite image (logical sum synthesis). ).

  This is the end of the description of the processing in FIG. In S2605, the description has been made assuming that the logical sum is synthesized. However, the method of determining the pixel value of the target pixel in the synthesized image in S2605 in the present invention is not limited to this method. For example, the overwriting composition as described above may be used.

  As described above, in the synthesis method determination process 2 and the synthesis process 2, the pixel value of the target pixel in the synthesized image is determined by the processing flow shown in FIGS. However, the present invention is not limited to this processing flow.

  For example, in step S1806, it is determined whether the user has instructed to add a background pattern or not to add a background pattern. If it is determined in S1807 that the user has instructed to add a background pattern, the attribute information of the area is set to predetermined attribute information, while if it is determined that the user has instructed not to add a background pattern, The attribute information of the area may be set to information other than the predetermined attribute information. In this way, it is not necessary to perform the determination processing in S2601 and S2602.

  In the above-described embodiments, the present invention has been described on the assumption that a copy-forgery-inhibited pattern image is combined with a scanned document. However, the present invention is not limited to this. For example, the present invention can be applied to a system that combines a copy-forgery-inhibited pattern image with a document image in the PDL data format transmitted from the host computer 40 or the like. At this time, it is determined whether to synthesize a tint block image according to the attribute information for each pixel obtained when rendering a document image in the PDL data format.

  By the way, as described above, the attribute information for each pixel obtained when rendering a document image in the PDL data format includes the types of “image”, “graphic”, “line”, “character, etc.”. For this reason, it is determined that pixels having attribute information of “image” / “graphic” have a photo / graphic attribute so as not to synthesize a tint block image (S1703, S1803). On the other hand, it is determined that pixels whose attribute information is “line” / “character” do not have a photo / graphic attribute, and a copy-forgery-inhibited pattern image is synthesized (S1702, S1802). It should be noted that a copy-forgery-inhibited pattern image is determined to be combined with a pixel whose attribute information is “others”, in other words, a pixel in a region where the object itself did not originally exist (S1702, S1802).

  Note that attribute information for each pixel obtained when rendering a document image in the PDL data format is determined by the type of object data to which the pixel belongs before rendering.

(Other examples)
In the first embodiment, the pixel values of the copy-forgery-inhibited pattern image and the document image are used when generating the composite image. However, the present invention is not limited to the use of pixel values, and may be information representing the density and brightness of an image. Such information representing the density and brightness of an image is collectively referred to as a pixel value. This pixel value includes, for example, a pixel value, a density value, a luminance value, and the like.

  In the first embodiment, a composite image is generated from the copy-forgery-inhibited pattern image and the document image. However, in the present invention, the image to be combined with the document image is not limited to the copy-forgery-inhibited pattern image, and may be any image. For example, it may be a digital watermark image or a form image.

  Further, the present invention can be applied to a system constituted by a plurality of devices (for example, a computer, an interface device, a reader, a printer, etc.), and can also be applied to an apparatus (multifunction device, printer, facsimile machine, etc.) comprising a single device. It is also possible.

  Another object of the present invention is that a computer (or CPU or MPU) of a system or apparatus reads and executes the program code from a storage medium that stores the program code for realizing the procedure of the flowchart shown in the above-described embodiment. Is also achieved. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment. Therefore, the program code and a storage medium storing the program code also constitute one of the present invention.

  As a storage medium for supplying the program code, for example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, or the like is used. be able to.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on the instruction of the program code is actually used. A case where part or all of the processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion board is based on the instruction of the program code. The CPU of the function expansion unit or the like performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

Diagram showing the overall configuration of the image forming system External view of input / output device of image forming apparatus The figure which shows the whole structure of an image forming apparatus Diagram showing tile data conceptually Block diagram of the scanner image processing unit Block diagram of the printer image processing unit Explanatory drawing of the copy screen of the operation unit Illustration 1 of the setting screen for the copy-forgery-inhibited pattern on the operation unit Illustration 2 of the setting screen for the copy-forgery-inhibited pattern on the operation unit Illustration 3 of the setting screen for the screen pattern on the operation unit The figure which shows the generation method of copy-forgery-inhibited pattern image data Diagram showing dot concentration type dither matrix Diagram showing dot-dispersed dither matrix Diagram showing centralized dither pattern Diagram showing distributed dither pattern A flowchart showing a process from the original image data obtained by reading the original to the copy-forgery-inhibited pattern image data, generating a composite image and forming an image on the output paper. Flowchart 1 describing the flow of processing in S1610 Flowchart 2 describing the flow of processing in S1610 Explanatory drawing of the setting screen of the operation unit 1 Explanatory drawing of the setting screen of the operation unit 2 Example of original image Example of a composite image when a copy-forgery-inhibited pattern image is composited over the entire area of the original image Example of a composite image when a copy-forgery-inhibited pattern image is combined with a partial area of the original image Example of tint block image (A) is an example of a tint block image before visualization, and (b) is an example of a tint block image after visualization. Flowchart 3 describing the flow of processing in S1610

Claims (10)

An image processing apparatus for generating a composite image by combining a document image and a first image,
Attribute determination means for determining which type of attribute information of each pixel in the original image corresponds to a predetermined type among a plurality of types;
Selection means for selecting at least one of the plurality of predetermined types based on a user instruction;
For the pixel whose type of attribute information determined by the attribute determination unit is the type selected by the selection unit, the first image is overwritten with the original image and is determined by the attribute determination unit. For a pixel whose attribute information is not the type selected by the selection unit, the composite image is generated by taking the pixel value of the pixel in the document image as the pixel value of the pixel in the composite image. And an image processing apparatus. The selection means includes
Position specifying means for specifying a position in the document image based on a user instruction;
The image processing apparatus according to claim 1, further comprising: an attribute information type selecting unit that selects a type of attribute information of a pixel corresponding to the position specified by the position specifying unit. The position specifying means includes
A pixel whose type of attribute information determined by the attribute determining unit is a first type and a pixel whose attribute information determined by the attribute determining unit is a second type different from the first type. Control means for controlling to display the document image on a display screen in an identifiable state;
3. The apparatus according to claim 2, further comprising second position designating means for designating a position in the document image displayed on the display screen by being controlled by the control means based on a user instruction. Image processing device. For a pixel whose type of attribute information determined by the attribute determination unit is the type selected by the selection unit, the first image is overwritten with the original image.
When the first image is colored in the pixel, the pixel value of the pixel in the first image is taken as the pixel value of the pixel in the composite image, and the first 4. When the color of the pixel is not colored, it means that the pixel value of the pixel in the document image is taken as the pixel value of the pixel in the composite image. The image processing apparatus according to any one of the above. A control method of an image processing apparatus for generating a composite image by combining a document image and a first image,
An attribute determination step for determining which type of attribute information of each pixel in the document image corresponds to a predetermined type;
A selection step of selecting at least one of the plurality of predetermined types based on a user instruction;
For the pixel whose type of attribute information determined in the attribute determination step is the type selected in the selection step, the first image is overwritten with the original image and is determined by the attribute determination unit. For a pixel whose attribute information is not the type selected by the selection unit, the composite image is generated by taking the pixel value of the pixel in the document image as the pixel value of the pixel in the composite image. And a generating step for controlling the image processing apparatus. The selection step includes
A position specifying step for specifying a position in the document image based on a user instruction;
6. The method of controlling an image processing apparatus according to claim 5 , further comprising an attribute information type selection step of selecting a type of attribute information of a pixel corresponding to the position specified in the position specifying step. The position specifying step includes
A pixel whose type of attribute information determined in the attribute determination step is a first type and a pixel whose attribute information determined in the attribute determination step is a second type different from the first type. A control step for controlling the original image to be displayed on the display screen in an identifiable state;
7. The method according to claim 6 , further comprising: a second position specifying step of specifying a position in the document image displayed on the display screen by being controlled by the control unit based on a user instruction. A method for controlling an image processing apparatus. For the pixel whose attribute information type determined in the attribute determination step is the type selected in the selection step, the first image is overwritten and combined with the original image.
When the first image is colored in the pixel, the pixel value of the pixel in the first image is taken as the pixel value of the pixel in the composite image, and the first 8 to 7, which means that the pixel value of the pixel in the document image is taken as the pixel value of the pixel in the composite image when the pixel is not colored. A control method for an image processing apparatus according to any one of the above. Program for executing the steps of the method according to the computer in any one of claims 5 to 8. A computer-readable storage medium storing the program according to claim 9 .

Images