JP2008148273A - Image forming apparatus, image processing method, and image forming system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image forming apparatus, an image processing method and an image forming system which can cope with the case that it is estimated that encoded image data or an encoded image may be damaged when image edition processing or post-processing is applied. <P>SOLUTION: The image forming apparatus can set image edition processing or post-processing via an operating unit 12. Furthermore, the image forming apparatus 10 compares region information in image data to which the set image edition processing or the post-processing is applied with region information to combine encoded image data with image data and when both the information overlaps, a user is notified of a warning, thereby selecting following processing. In such an image forming apparatus 10, the image edition processing or the post-processing is not performed until the user designates following processing according to the warning notification. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image forming apparatus, an image processing method, and an image forming system that can handle encoded image data.

  Conventionally, as represented by a bar code or the like, a technique has been used in which product information is encoded and printed on output paper, and the information is read and used for product management. Also, in this technical field, a method of encoding information such as an image as well as a product number and printing it on output paper is also used.

  For example, as will be described with reference to FIGS. 14 and 15, in the prior art, an arbitrary file such as a document file or an image file is printed on the output paper as encoded image data, which is read by a scanner, decoded, and the original. A technique for extracting files is used.

  In FIG. 14, the control unit (Controller Unit) 11 reads input data 1401 such as a document file or an image file, encodes it with 1402, and generates encoded image data 1403. The printer unit 14 combines the encoded image data 1403, and an output sheet 1404 in which the encoded image is embedded is output from the printing unit.

  On the other hand, in FIG. 15, the scanner unit 13 scans the output paper 1404 in which the encoded image output in FIG. 14 is embedded, the control unit 11 decodes the read data, and the original input data 1401 is obtained. Extract.

  As another example, an invention has been proposed in which an original file is encoded together with a thumbnail and printed on output paper, and then the output paper is read into an image forming apparatus so that the original file can be printed ( Patent Document 1).

  On the other hand, a conventional image forming apparatus has a function of performing various image editing processes on a document image and printing.

  For example, in the prior art, a binding margin process in which an original image is moved up, down, left, or right at the time of output and printed on output paper, and a frame erasing process that designates a frame for the original image to make the area outside the frame white. And an image editing process such as a bookbinding process for binding and outputting a document image.

  Also, a stapling process for stapling the output paper bundle at a predetermined position, a punching process for forming a punch hole at a predetermined position for the output paper bundle, and a cutting process for cutting the output paper bundle at a predetermined position. An image forming apparatus having a function of performing post-processing is also known.

  A technique for confirming an image when printing such image editing processing or post-processing on a preview screen has been proposed (see Patent Document 2).

JP 2001-344588 A JP 2001-067347 A

  However, in the conventional image forming apparatus, when the encoded image data is printed on the output paper, the above-described various image editing processes and post-processing are not taken into consideration, and are set after the print job has run once. The change could not be made.

  Therefore, when image editing processing is performed on a document image synthesized with encoded image data before printing on output paper, the encoded image data may be damaged, and the encoded image data remains damaged. There was a problem of printing on output paper. Further, when post-processing is performed on the original image, the encoded image may be damaged.

  That is, in the image editing process and post-processing, the encoded image data and the encoded image are damaged depending on the processing contents (see FIG. 16). In FIG. 16, (1), (5), and (6) are cases in which damage has occurred on the encoded image data (image editing process). (2) to (4) are cases where the encoded image is damaged by post-processing after the image is formed based on the encoded image data. As described above, conventionally, the encoded image data that has been damaged is printed on the output paper, the encoded image is damaged, or the image cannot be restored as intended by the user.

  The present invention has been made in view of such a problem, and an object of the present invention is to cope with a case where encoded image data or an encoded image is expected to be damaged when image editing processing or post-processing is performed. An object is to provide an image forming apparatus, an image processing method, and an image forming system. That is, an object of the present invention is to provide an image forming apparatus, an image processing method, and an image forming system capable of notifying the user of the prediction of the damage and allowing the user to input processing corresponding to the notification.

  In order to solve the above-described problems, an image forming apparatus according to the present invention includes post-processing means for performing post-processing at a preset position for a sheet after outputting original image data on the sheet. An overlapping determination unit that determines whether an area in which encoded image data is included in document image data overlaps a set position where post-processing is performed by the post-processing unit, and encoding by the overlap determination unit When it is determined that the area including the image data overlaps with the set position, the information processing unit includes notification means for notifying the user that the area is determined to overlap.

  The image forming apparatus of the present invention is an image forming apparatus having post-processing means for performing post-processing on a preset position for a sheet after outputting document image data on the sheet. In the original image data, an overlap determination unit that determines whether an area including the encoded image data overlaps a setting position where post-processing is performed by the post-processing unit, and the overlap determination unit includes the encoded image data. Inquiry means for inquiring to the user whether or not to output the original image data on the sheet when it is determined that the existing area and the set position overlap.

  The image forming apparatus of the present invention is an image forming apparatus capable of performing an image editing process. The image forming apparatus determines whether or not the image editing process is set, and the first image data in the image data to be subjected to the image editing process. First determination means for determining a region and acquiring first region information regarding the first region, and detecting whether or not the encoded image data exists in the image data, and the encoded image data exists Comparing the first region information and the second region information with a second determination unit that determines a second region in the image data to be acquired, and acquires second region information related to the second region; If it is determined by the third determination means and the third determination means that determines whether or not the first area information and the second area information overlap in the image data, they overlap. Notification means for notifying the user of From the selection menu of the subsequent processing shown, characterized in that it does not take place any further processing until one of the menu is selected.

  The image forming apparatus of the present invention is an image forming apparatus capable of performing post-processing, and determines whether or not post-processing is set, and determines a first region in image data to be subjected to post-processing. Then, the first determination means for acquiring the first area information relating to the first area, and detecting whether or not the encoded image data exists in the image data, the image data in which the encoded image data exists A second determination means for determining a second area in the image and acquiring second area information relating to the second area, and comparing the first area information and the second area information, If it is determined by the third determination means and the third determination means that the first area information and the second area information overlap with each other, and the third determination means determines that they overlap, A subsequent process displayed by the notification means. From the selection menu, characterized in that it does not take place any further processing until one of the menu is selected.

  The image forming apparatus of the present invention is an image forming apparatus capable of performing image editing processing and post-processing, and determines whether or not image editing processing and post-processing are set. A first determination means for determining a first area in the image data to be subjected to and acquiring first area information relating to the first area; and whether the encoded image data is present in the image data Second determination means for detecting whether or not, determining a second region in the image data in which the encoded image data exists, and acquiring second region information relating to the second region; and a first region A third determination unit that compares the information with the second region information and determines whether the first region information and the second region information overlap in the image data; Notification that notifies the user that it is duplicated if it is determined that it is duplicated And a stage, characterized in that the selection menu of the subsequent process displayed by the notification unit does not perform any further processing until one of the menu is selected.

  Furthermore, an image processing method of the present invention is an image processing method in an image forming apparatus capable of performing image editing processing, and determines whether or not image editing processing is set, and includes in image data subjected to image editing processing. The first region is determined, first region information about the first region is acquired, whether or not the encoded image data is present in the image data is detected, and the image in which the encoded image data is present A first determination step of determining a second region in the data and obtaining second region information regarding the second region is compared with the first region information and the second region information, and image data If it is determined by the second determination step that the first region information and the second region information overlap in the second determination step and the second determination step, it is determined that the user overlaps. Notification step to notify , Characterized in that the selection menu of the subsequent process displayed by the notification step, does not perform any further processing until one of the menu is selected.

  The image processing method of the present invention is an image processing method in an image forming apparatus capable of performing post-processing, and determines whether or not post-processing is set, and first image data in the image data to be post-processed is determined. The first region information relating to the first region is obtained, whether or not the encoded image data is present in the image data is detected, and in the image data in which the encoded image data is present The first determination step of determining the second region and acquiring the second region information regarding the second region is compared with the first region information and the second region information, and the first region information is compared with the second region information in the image data. If it is determined by the second determination step and the second determination step that the first region information and the second region information are overlapped, and the second determination step determines that they overlap, A notification step for notification, and the notification step From the selection menu of the subsequent process displayed Te, characterized in that it does not take place any further processing until one of the menu is selected.

  The image processing method of the present invention is an image processing method in an image forming apparatus capable of performing image editing processing and post-processing, and determines whether or not image editing processing and post-processing are set, and image editing Whether or not encoded image data exists in the image data by determining a first region in the image data to be processed and post-processed to obtain first region information relating to the first region A first determination step of determining a second region in the image data in which the encoded image data exists, and acquiring second region information related to the second region; The second determination step compares the second region information and determines whether or not the first region information and the second region information overlap in the image data. If determined, the user is notified that there is a duplicate. And a notification step of notifying that, characterized in that the selection menu of the subsequent process displayed by the notification step, does not perform any further processing until one of the menu is selected.

  Furthermore, an image forming system of the present invention is an image forming system including an image forming apparatus capable of image editing processing and capable of printing an image, and an information processing apparatus capable of supplying the image to the image forming apparatus. First determination means for determining presence / absence of setting of editing processing, determining a first region in image data to be subjected to image editing processing, and acquiring first region information relating to the first region; Detects whether encoded image data is present in the image data, determines a second region in the image data in which the encoded image data is present, and obtains second region information regarding the second region Comparing the first area information and the second area information, and determining whether or not the first area information and the second area information overlap in the image data. It overlaps by 3 determination means and 3rd determination means And a notification means for notifying the user that there is an overlap, if any of the subsequent processes is selected until a menu is selected from the selection menu of the subsequent processes displayed by the notification means. It is characterized by not performing.

  The image forming system of the present invention is an image forming system including an image forming apparatus capable of post-processing and capable of printing an image, and an information processing apparatus capable of supplying an image to the image forming apparatus. A first determination means for determining whether or not to set a first area in image data to be post-processed, and acquiring first area information relating to the first area; A second unit that detects whether or not the data exists in the image data, determines a second region in the image data in which the encoded image data exists, and acquires second region information related to the second region; The third determination unit compares the first region information and the second region information, and determines whether or not the first region information and the second region information overlap in the image data. If it is determined by the third determining means and the third determining means to overlap, A notification means for notifying the user that the user is doing, and from the selection menu of the subsequent process displayed by the notification means, none of the subsequent processes is performed until any menu is selected. To do.

  The image forming system of the present invention is an image forming system that can perform image editing processing and post-processing, and includes an image forming apparatus capable of printing an image and an information processing apparatus capable of supplying the image to the image forming apparatus. Therefore, it is determined whether or not the image editing process and the post-processing are set, a first area in the image data to be subjected to the image editing process and the post-process is determined, and the first area relating to the first area is determined. First determination means for acquiring region information, detecting whether the encoded image data is present in the image data, determining a second region in the image data in which the encoded image data is present, The second determination means for acquiring the second region information relating to the second region, the first region information and the second region information are compared, and the first region information and the second region are included in the image data. Third determination means for determining whether or not the information overlaps; And a notification means for notifying the user of the overlap, and any one of the menus is selected from a selection menu for subsequent processing displayed by the notification means. No subsequent processing is performed.

  Further, the information processing apparatus according to the present invention determines whether or not a drawing command is subdivided into a plurality of drawing commands, and the determining unit determines that the drawing command is subdivided into a plurality of drawing commands. In this case, a plurality of drawing commands are rendered, and a first determination unit that determines whether encoded image data exists in an image obtained by the rendering, and the drawing command is converted into a plurality of drawing commands by the determination unit. A second determination unit configured to determine whether a drawing command indicating an image among a plurality of drawing commands is a drawing command for drawing encoded image data when it is determined that the image is not subdivided; It is characterized by that.

  According to the present invention, it is possible to avoid the overlap between the encoded image data area on the original image and the area on the original image on which another image editing process or post-processing is performed. Image damage can be prevented.

  Hereinafter, the best embodiment of the present invention will be described in detail with reference to the accompanying drawings.

  In this specification, “image editing processing” is processing performed on image data, and includes data such as binding margin processing, frame erasing processing, bookbinding processing, negative / positive processing, mirror image processing, and code image printing processing. It refers to the processing that performs the above processing.

  Further, in this specification, “post-processing” is processing for performing physical processing on a recording medium on which an image is formed, and includes sorting processing, group processing, stapling processing, punch hole processing, and cutting processing. And so on.

<Printing system (Fig. 1)>
FIG. 1 is a block diagram showing a configuration of a printing system according to an embodiment of the present invention.

  In this printing system, the host computer 40 as an information processing apparatus and three image forming apparatuses (10, 20, 30) are connected to the LAN 50. In the printing system according to the embodiment of the present invention, these are The number of connections is not limited. In the present embodiment, the connection method is described using a LAN, but the present invention is not limited to this. For example, an arbitrary network such as a WAN (public line), a serial transmission method such as USB, and a parallel transmission method such as Centronics and SCSI can be applied.

  A host computer (hereinafter referred to as a PC) 40 has the functions of a personal computer and includes a CPU, a ROM for storing programs, and a memory such as a RAM. Therefore, the PC 40 can send and receive files and send and receive e-mails using the FTP and SMB protocols via the LAN 50 and WAN. A print command can also be supplied from the PC 40 to the image forming apparatuses 10, 20, and 30 via a printer driver. This can be done by using the above-described CPU and program functions.

  As shown in FIG. 1, the image forming apparatuses 10 and 20 are apparatuses having the same configuration. The image forming apparatus 30 is an image forming apparatus having only a print function, and does not have the scanner units (the scanner unit 13 and the scanner unit 23, respectively) included in the image forming apparatuses 10 and 20. Hereinafter, for convenience of explanation, the configuration of the image forming apparatuses 10 and 20 will be described in detail by paying attention to the image forming apparatus 10.

  The image forming apparatus 10 includes a controller unit 11 that controls the entire apparatus, an operation unit 12 that is a user interface such as print settings, a scanner unit 13 that is an image input device, and a printer unit 14 that is an image output device. It has. The control unit 11 controls the operation unit 12, the scanner unit 13, and the printer unit 14 in an integrated manner. The detailed configuration of the control unit 11 will be described in detail in the description of FIG.

<Image Forming Apparatus 10 (FIG. 2)>
FIG. 2 shows an appearance of the image forming apparatus 10 according to the embodiment of the present invention shown in FIG. The image forming apparatus 10 includes a control unit 11 (not shown), an operation unit 12, a scanner unit 13, and a printer unit 14.

  The scanner unit 13 includes a document feeder 201 and a tray 202.

  The scanner unit 13 has a plurality of CCDs that share the area to be scanned, and the reflected light obtained by exposing and scanning the image on the document is input to the CCD, thereby converting the image information into an electrical signal. It also has a function to

  Further, the scanner unit 13 converts the converted electric signal into a luminance signal composed of R, G, and B colors, and outputs the luminance signal to the control unit 11 as image data.

  The document is set on the tray 202 of the document feeder 201. When the user gives an instruction to start reading from the operation unit 12, a document reading instruction is given from the control unit 11 to the scanner unit 13. Upon receiving this instruction, the scanner unit 13 feeds the documents one by one from the tray 202 of the document feeder 201 and performs a document reading operation. Note that the document reading method is not an automatic feeding method by the document feeder 201, but a method of scanning the document by placing the document on a glass surface (not shown) and moving the exposure unit.

  Further, the printer unit 14 includes a plurality of paper cassettes 203, 204, and 205 that enable selection of different paper sizes or different paper orientations, a paper discharge tray 206 that discharges paper that is not subjected to post-processing, and post-processing. A unit 207 is provided.

  The printer unit 14 is an image forming device that forms image data received from the control unit 11 on a sheet. In this embodiment, the image forming method is an electrophotographic method using a photosensitive drum or a photosensitive belt, but the present invention is not limited to this. For example, the present invention can also be applied to an ink jet system that prints on paper by ejecting ink from a micro nozzle array.

  The post-processing unit 207 discharges the printed paper after the post-processing. Examples of post-processing include stapling (stapling), punching holes, cutting, and the like for discharged paper.

<Detailed Description of Control Unit 11 (FIG. 3)>
FIG. 3 is a block diagram for explaining the configuration of the control unit 11 of the image forming apparatus 10 according to the embodiment of the present invention in more detail. The control unit 11 is electrically connected to the operation unit 12, the scanner unit 13, and the printer unit 14. On the other hand, the control unit 11 is connected to an external device such as the PC 40 via the LAN 50 or the WAN 331. With this configuration, image data and device information can be input / output.

  The control unit 11 includes a CPU 301, a RAM 302, a ROM 303, an HDD 304, an operation unit I / F 305, a network I / F 306, a Modem 307, a binary image rotation unit 308, and a binary multi-value image compression / decompression unit 309. Each of these components is connected to the system bus 310.

The control unit 11 includes a scanner I / F 311, a scanner image processing unit 312, a compression unit 313, a printer I / F 314, a printer image processing unit 315, an expansion unit 316, an image conversion unit 317, a RIP 328, and a compression unit 329. Each of these components is connected to the image bus 330.
The image conversion unit 317 includes an expansion unit 318, a compression unit 319, a rotation unit 320, a scaling unit 321, a color space conversion unit 322, a binary multi-value conversion unit 323, and a multi-value binary conversion unit 324. , A moving unit 325, a thinning unit 326, and a combining unit 327.

  The system bus 310 and the image bus 330 are connected to each other, and the above-described components are thereby connected to each other so that data can be transmitted / received to / from each other. The RIP 328 is also connected to the system bus 310.

  Hereinafter, each part of the control part 11 is demonstrated.

  The CPU 301 comprehensively controls access to various connected devices (for example, the scanner unit 13 and the like) based on a control program stored in the ROM 303 and also controls various processes performed in the control unit 11. Control.

  A RAM 302 is a system work memory for the CPU 301 to operate, and is also a memory for temporarily storing image data. The RAM 302 includes an SRAM that retains the stored content even after the power is turned off, and a DRAM that erases the stored content after the power is turned off.

  The ROM 303 stores a control program, a boot program, and the like for the device as described above.

  The HDD 304 is a hard disk drive and can store system software and image data.

  The operation unit I / F 305 is an interface unit for connecting the system bus 310 and the operation unit 12. The operation unit I / F 305 receives information to be displayed on the operation unit 12 from each unit via the system bus 310 and transmits the information to the operation unit 12. On the other hand, the operation unit I / F 305 receives information received from the operation unit 12. It transmits to each part via.

  A network I / F 306 is connected to the LAN 50 and the system bus 310 and transmits / receives information to / from both.

  The Modem 307 is connected to the WAN 331 and the system bus 310 and transmits / receives information to / from them.

  Note that the Network I / F 306 and the Modem 307 are connected to an external computer such as the PC 40 via the LAN 50 and the WAN 331, respectively, and can receive print settings from the PC 40 or the like.

  A binary image rotation unit 308 converts the direction of image data before transmission.

  A binary multilevel image compression / decompression unit 309 converts the resolution of image data before transmission into a predetermined resolution or a resolution according to the capability of the transmission destination. For compression and decompression, methods such as JBIG, MMR, MR, and MH are used.

  The image bus 330 is a transmission path for exchanging image data, and is configured by a PCI bus or IEEE1394.

  The scanner image processing unit 312 corrects, processes, and edits image data received from the scanner unit 13 via the scanner I / F 311. The scanner image processing unit 312 can also determine whether the received image data is a color document or a black and white document, or whether it is a text document or a photo document. Further, the scanner image processing unit 312 performs processing for attaching the determination result to the image data. Here, the accompanying information is referred to as “attribute data”. Details of processing performed by the scanner image processing unit 312 will be described in detail with reference to FIG.

  The compression unit 313 receives the image data from the scanner image processing unit 312 and divides the image data into blocks of 32 pixels × 32 pixels. The image data of 32 pixels × 32 pixels is called tile image data. FIG. 4 is a diagram conceptually showing the tile image data. In a document (that is, a paper medium before being read from the scanner unit 13), an area corresponding to the tile image data is referred to as a tile image.

  Note that the tile image data is added with the average luminance information in the block of 32 pixels × 32 pixels and the coordinate position of the tile image on the document as header information. Further, the compression unit 313 compresses image data including a plurality of tile image data.

  The decompression unit 316 decompresses image data composed of a plurality of tile image data, raster-expands the image data, and transmits the raster image to the printer image processing unit 315.

  The printer image processing unit 315 receives image data from the decompression unit 316, refers to attribute data attached to the image data, and performs image processing on the image data. The image data after the image processing is output to the printer unit 14 via the printer I / F 314. Details of processing performed by the printer image processing unit 315 will be described in detail with reference to FIG.

  The image conversion unit 317 performs predetermined conversion processing on the image data. The image conversion unit 317 includes a processing unit as described below.

  The decompression unit 318 decompresses the received image data, the compression unit 319 compresses the received image data, and the rotation unit 320 rotates the received image data.

  The scaling unit 321 performs resolution conversion processing (for example, conversion processing from 600 dpi to 200 dpi) on the received image data.

  The color space conversion unit 322 converts the color space of the received image data, and uses a matrix or a table to remove background removal processing, LOG conversion processing (RGB → CMY), and output color correction processing (CMY), which are known techniques. → CMYK).

  The binary multi-value conversion unit 323 converts the received two-gradation image data into 256-gradation image data. On the other hand, the multi-level binary conversion unit 324 converts the received 256-gradation image data into 2-gradation image data using a technique such as error diffusion processing.

  The moving unit 325 performs processing for adding a margin part to the received image data and deleting the margin part.

  The thinning unit 326 performs resolution conversion by thinning out the pixels of the received image data, and generates, for example, image data whose resolution is 1/2, 1/4, 1/8, or the like of the original image data.

  The synthesizer 327 synthesizes the two received image data to generate one piece of image data. A known method can be used when combining two pieces of image data. That is, a method of setting an average value of luminance values of pixels to be combined as a combined luminance value, a method of setting a luminance value of a brighter pixel at a luminance level as a luminance value of a combined pixel, or a combination of the darker one after combining It is possible to apply the method of using the pixel. Furthermore, a method of determining a luminance value after synthesis by a logical sum operation, a logical product operation, an exclusive logical sum operation, or the like between pixels to be synthesized is also applicable.

  The RIP 328 receives intermediate data generated based on PDL (page description language) code data transmitted from the PC 40 or the like, and generates bitmap data (multi-value).

<Detailed Description of Scanner Image Processing Unit 312 (FIG. 5)>
FIG. 5 shows details of the internal configuration of the scanner image processing unit 312 in FIG.

  The scanner image processing unit 312 includes a masking processing unit 501, a filter processing unit 502, a histogram generation unit 503, an input side gamma correction unit 504, a color / monochrome determination unit 505, a character / photo determination unit 506, and a decoding unit 507.

  The scanner image processing unit 312 is a processing unit having a function of receiving image data composed of RGB 8-bit luminance signals.

  The masking processing unit 501 converts the luminance signal into a standard luminance signal that does not depend on the CCD filter color.

  The filter processing unit 502 arbitrarily corrects the spatial frequency of the image data received from the masking processing unit 501. The filter processing unit 502 performs arithmetic processing using, for example, a 7 × 7 matrix on the image data.

  On the other hand, in the copying machine or the multifunction machine, the character mode, the photo mode, or the character / photo mode can be selected as the copy mode by pressing the document selection tab 704 in FIG. When the character mode is selected, the filter processing unit 502 applies a character filter to the entire image data. When the photo mode is selected, the filter processing unit 502 applies a photo filter to the entire image data. Further, when the character / photo mode is selected, the filter processing unit 502 switches an applicable filter for each pixel in accordance with a character photo determination signal (part of attribute data) described later. That is, the filter processing unit 502 determines whether to apply a photo filter or a character filter for each pixel.

  Note that a coefficient for smoothing only the high-frequency component is set in the filter for photography, and the roughness of the image can be made inconspicuous. On the other hand, a coefficient for performing strong edge enhancement is set in the filter for characters, and the sharpness of the characters can be obtained.

  The histogram generation unit 503 samples the luminance data of each pixel constituting the image data received from the filter processing unit 502. More specifically, the histogram generation unit 503 outputs luminance data in a rectangular area surrounded by a start point and an end point specified in the main scanning direction and the sub scanning direction, respectively, in the main scanning direction and the sub scanning direction. Sample at a constant pitch. Then, the histogram generation unit 503 generates histogram data based on the sampling result. The generated histogram data is used for estimating the background level when the background removal processing unit 601 described later performs background removal processing.

  The input-side gamma correction unit 504 converts the luminance data received from the histogram generation unit 503 into luminance data having nonlinear characteristics using a table or the like.

  The color / monochrome determination unit 505 determines whether each pixel constituting the image data received from the masking processing unit 501 is a chromatic color or an achromatic color, and the determination result is a color / monochrome determination signal (part of attribute data). ) As image data.

  The character photograph determination unit 506 determines whether each pixel constituting the image data received from the masking processing unit 501 is a pixel constituting a character, a pixel constituting a halftone dot, or a pixel constituting a character in a halftone dot. Then, it is determined whether the pixel constitutes a solid image. When this determination is made, the character / photo determination unit 506 makes a determination based on the pixel value of each pixel and the pixel values of surrounding pixels of each pixel. Note that pixels that do not correspond to any of the above are pixels that form a white region. After the determination process, the character photograph determination unit 506 attaches the determination result to the image data as a character photograph determination signal (part of attribute data).

  The decoding unit 507 detects the presence of encoded image data in the image data output from the masking processing unit 501. Then, when detecting the encoded image data, the decoding unit 507 decodes the detected encoded image data and extracts information.

<Detailed Description of Printer Image Processing Unit 315 (FIG. 6)>
Next, the flow of processing in the printer image processing unit 315 in FIG. 3 will be described with reference to FIG. As described above, since the processing of the printer image processing unit 315 is controlled by the CPU 301, the following processing is also controlled by the CPU 301.

  The background removal processing unit 601 performs a process of removing (removing) the background color of image data using the histogram generated by the histogram generation unit 503 of the scanner image processing unit 312.

  The monochrome generation unit 602 converts color data into monochrome data.

  The Log conversion unit 603 performs luminance and density conversion processing. For example, the Log conversion unit 603 converts RGB input image data into CMY image data.

  The output color correction unit 604 performs output color correction. For example, image data input as CMY is converted into CMYK image data using a table or a matrix.

  The output-side gamma correction unit 605 performs correction so that the signal value input to the output-side gamma correction unit 605 is proportional to the reflection density value after copying output.

  A halftone correction unit 606 performs halftone processing according to the number of gradations of the printer unit 14 to be output. For example, processing such as binarization or binarization is performed on the received high gradation image data.

  The code image synthesis unit 607 is located between the output-side gamma correction unit 605 and the halftone correction unit 606, and synthesizes the encoded image data generated by the <encoding process> described later and the document image data. To do.

  Each processing unit in the scanner image processing unit 312 or the printer image processing unit 315 can output the received image data without performing each processing. In this way, passing data without processing in a certain processing unit is referred to as “through the processing unit”.

<Encoding process>
The CPU 301 performs encoding processing of predetermined information (the predetermined information includes, for example, a device number, printing time information, user ID information, and the like), and controls processing for generating encoded image data. Can do.

  In this specification, “encoded image data” indicates an image such as a two-dimensional code image or a barcode image, or a digital watermark image generated by a digital watermark technique. As described with reference to FIG. 14, encoded image data can be generated from a document file, an image file, a moving image file, an audio file, an execution file, and the like.

  Further, the CPU 301 can transmit the generated encoded image data to the encoded image composition unit 607 in the printer image processing unit 315 using a data bus (not shown).

  The above control (encoded image data generation control, transmission control) is performed by the CPU 301 executing a program stored in the RAM 302.

<Explanation of operation screen>
Next, the operation unit 12 of the image forming apparatus 10 will be described in more detail.

  FIG. 7 is an initial screen 700 of the operation unit 12. The initial screen 700 includes an area 701, a reading mode tab 702, a document selection tab 704, an application mode tab 705, a post-processing setting tab 706, and a duplex setting tab 707.

  An area 701 displays whether or not the image forming apparatus 10 is ready to copy, and displays the set number of copies.

  A reading mode tab 702 is a tab for selecting an original reading mode. When this tab is pressed, three types of selection menus (not shown) of color / black / automatic (ACS) are popped up. Note that color copy is performed when color is selected, and monochrome copy is performed when black is selected. When automatic (ACS) is selected, either color or monochrome copy mode is determined based on the color / monochrome determination signal generated by the color / monochrome determination unit 505 described above.

  The document selection 704 tab is a tab for selecting the type of document, and when this tab is pressed, three types of selection menus (not shown) of text, photo, and text / photo mode are popped up.

  An application mode tab 705 is a tab for setting various image editing processes.

  A post-processing setting tab 706 is a tab for performing settings related to various finishings.

  A duplex setting tab 707 is a tab for performing settings relating to duplex reading and duplex printing.

  FIG. 8 is a diagram illustrating an example of an application mode setting screen 800 displayed when the application mode tab 705 is pressed. In this embodiment, the application mode setting screen 800 includes a binding margin setting tab 801, a frame erase setting tab 802, a bookbinding setting tab 803, a negative / positive setting tab 804, a mirror image setting tab 805, and an encoded image printing tab 806.

  A binding margin setting tab 801 is used to set a binding margin for printing on an output sheet by moving an original image up, down, left, or right during output.

  A frame erasure setting tab 802 is used when a frame is specified for an original image and a frame erasure is set so that pixels outside the frame are white pixels.

  A bookbinding setting tab 803 is used for bookbinding setting for booklet output of a document image.

  A negative / positive setting tab 804 is used when negative / positive setting is performed on a document image. When the negative / positive setting tab 804 is pressed, a negative / positive ON / OFF screen (not shown) is displayed, and it is possible to select whether or not to perform negative / positive output. The initial value is set not to output negative / positive.

  A mirror image setting tab 805 is used to set a mirror image for printing a mirror image by reversing the original image vertically or horizontally. When the mirror image setting tab 805 is pressed, a mirror image ON / OFF screen (not shown) is displayed, and it is possible to select whether or not to output a mirror image. The initial value is set not to output a mirror image.

  The encoded image print tab 806 is used when setting related to a mode for newly combining encoded image data with a document image. Information to be newly converted into encoded image data is not particularly limited, such as a document file stored in the PC 40 or the HDD 304 in the image forming apparatus 10 or a character string input from a virtual keyboard (not shown).

  FIG. 9 is a diagram showing an example of a post-processing setting screen 900 displayed when the post-processing setting tab 706 is pressed. In the present embodiment, the post-processing setting screen 900 includes a sort setting tab 901, a group setting tab 902, a staple setting tab 903, a punch setting tab 904, and a cutting setting tab 905.

  The sort setting tab 901 can be set to output a plurality of copies with the page order aligned. When this setting is performed, for example, the page order can be output as “1, 2, 3, 1, 2, 3.” for each unit.

  A group setting tab 902 can be set to output a plurality of copies of the same page continuously. When this setting is performed, it is possible to output a plurality of copies for each page, for example, the page order is “1, 1, 2, 2, 3, 3.”.

  A stapling setting tab 903 can be set to staple a bundle of output sheets at a specified position. If this setting is performed, for example, when outputting a single document with 5 pages, it is possible to perform stapling processing in units of outputting the 5 pages.

  The punch setting tab 904 can be set to punch holes at specified positions for a bundle of output sheets.

  A cutting setting tab 905 can perform setting for cutting a bundle of output sheets at a specified position.

<Processing when manuscript image is input>
FIG. 10 is a flowchart relating to a series of processes for reading a document and storing it as image data. The process to be described later is performed for each page when there are a plurality of pages to be read.

  In step S <b> 1001, the CPU 301 transmits the document read by the scanner unit 13 to the scanner image processing unit 312 via the scanner I / F 311 as image data.

  In step S1002, the scanner image processing unit 312 performs the processing described with reference to FIG. 5 on the image data transmitted in step S1001, and generates attribute data together with new image data. The scanner image processing unit 312 also performs processing for attaching this attribute data to the new image data.

  In step S1003, the decoding unit 507 in the scanner image processing unit 312 detects whether or not encoded image data exists in the new image data generated in step S1002, as described above. If the decoding unit 507 detects encoded image data, the process proceeds to step S1004. If not detected, the process proceeds to step S1008.

  In step S1004, the decoding unit 507 determines in which area in the document image the detected encoded image data exists, and transmits the area information to the RAM 302 for storage.

  Here, as shown in the example of FIG. 17, the region information is a code when the upper left corner of the original image 1701 is the origin (0, 0), the main scanning direction is the X axis, and the sub scanning direction is the Y axis. This is information on the position coordinates of the area occupied by the converted image data 1702. In the example of FIG. 17, the area of the encoded image data 1702 is indicated by a rectangular area surrounded by the position coordinates of (X0, Y0), (X1, Y0), (X0, Y1), and (X1, Y1). .

  In step S1005, the composite unit 507 decodes the encoded image data and acquires information. At this stage, since image editing processing and post-processing have not yet been performed, the encoded image data is not damaged, and the original data can be extracted from the encoded image data as shown in FIG. .

  In step S1006, the CPU 301 transmits the decrypted information acquired in step S1005 to the RAM 302 using a data bus (not shown) and stores it.

  In step S <b> 1007, the CPU 301 re-encodes the decoded information to generate encoded image data, and transmits the re-encoded image data to the encoded image synthesis unit 607 in the printer image processing unit 315. The combining process in the code image combining unit 607 will be described later in step S1206. Here, the re-encoding process is performed by the CPU 301 executing a program stored in the RAM 302 to generate encoded image data.

  In step S1008, the compression unit 313 divides the new image data generated by the scanner image processing unit 312 into blocks of 32 pixels × 32 pixels, and generates tile image data. Further, the compression unit 313 compresses the image data composed of the plurality of tile image data.

  In step S1009, the CPU 301 transmits the image data compressed by the compression unit 313 to the RAM 302 and stores it.

  The image data is transmitted by the CPU 301 to the image conversion unit 317 as necessary, subjected to image processing, and then transmitted to the RAM 302 again and stored.

<Process of adding new encoded image data to the document>
FIG. 11 is a diagram for explaining a flow when the encoded image print tab 806 shown in FIG. 8 is pressed. The encoded image print tab 806 is used for newly adding encoded image data to the read and stored document image data described with reference to the flowchart of FIG. Since the encoded image print tab 806 is displayed on the operation unit 12 of the image forming apparatus 10 as described above, when the encoded image print tab 806 is pressed, it is pressed by the control unit 11 via the operation unit I / F 305. The processing flow described later is controlled by the CPU 301.

  Similarly to FIG. 10, the processing described later is performed for each page when there are a plurality of pages to be read.

  In step S <b> 1101, the CPU 301 stores, in the RAM 302, information to be newly converted into encoded image data specified by the user with encoded information specifying means (not shown). Information newly converted into encoded image data is not particularly limited, such as a document file stored in the PC 40 or the HDD 304 in the image forming apparatus, and a character string input from a virtual keyboard (not shown).

  In step S1102, the CPU 301 executes a program stored in the RAM 302, and generates encoded image data from the information stored in step S1101.

  In step S <b> 1103, the CPU 301 designates a synthesis area for the original document based on the position coordinates in the original document specified by the user by the encoding information specifying means (not shown) and the size of the generated encoded image data. The composite area is described with reference to FIG. 17 as an example. The upper left corner of the original image 1701 stored in the RAM 302 is the origin (0, 0), the main scanning direction is the X axis, and the sub scanning direction is the Y axis. In this case, the area occupied by the encoded image data 1702 is indicated. In the example of FIG. 17, the area of the encoded image data 1702, that is, the synthesis area, is a rectangular area represented by (X0, Y0), (X1, Y0), (X0, Y1), and (X1, Y1). Indicated.

  In step S1104, the CPU 301 uses the encoded image data generated in step S1102 and the position coordinate information described in step S1103 to use the data bus (not shown) and the code image synthesis unit in the printer image processing unit 315. To 607. The synthesizing process in the code image synthesizing unit 607 will be described later in step S1211.

<Processing when forming an image on output paper>
FIG. 12 is a flowchart showing a process when outputting the image data obtained by combining the encoded image data generated by the process described with reference to the flowcharts of FIGS. 10 and 11 onto the output sheet (on the sheet). That is, an output process described later is a process that is output to the printer unit 14 via the printer I / F 314 and is therefore controlled by the CPU 301.

  Similarly to FIG. 10 and FIG. 11, the processing described later is performed for each page when there are a plurality of pages of image data to be output.

  In step S1201, the CPU 301 determines whether any image editing process is designated from the application mode setting screen 800 shown in FIG. If it is determined that any one of the image editing processes has been designated, the process proceeds to step S1202. On the other hand, if any image editing process has not been designated, the process proceeds to step S1203.

  In step S <b> 1202, the CPU 301 determines an area in which the image editing process designated from the application mode setting screen 800 is performed on the document image. The area determination process of the image editing process will be described in detail in <Image editing area determination process> described later.

  In step S1203, the CPU 301 determines whether any post-processing is designated from the post-processing setting screen 900 shown in FIG. If it is determined that any post-processing is specified, the process proceeds to step S1204. On the other hand, if any post-processing is determined not to be specified, the process proceeds to step S1205.

  In step S1204, the CPU 301 determines an area where the designated post-processing is performed on the document image. This post-processing area determination process will be described in detail later in <Post-Processing Area Determination Process>.

  In step S1205, the CPU 301 applies the composition area for combining the encoded image data described in FIGS. 10 and 11 to the document, the image editing process area for the document determined in step S1202, and the document determined in step S1204. Compare with post-processing area. The CPU 301 determines whether or not the areas overlap with each other as a result of the comparison process. If the areas overlap, the process proceeds to step S1206. If the areas do not overlap, the process proceeds to step S1209.

  In step S <b> 1206, the CPU 301 displays a user warning screen 1300 illustrated in FIG. 13 on the operation unit 12. The user warning screen 1300 includes a print setting change 1301, a continuation 1302, and a cancel 1303. Reference numerals 1301 to 1303 are also called reset processing, notification display ignoring processing, and print cancellation processing, respectively. Subsequent processing is performed by the user pressing one of these. That is, until any one of the print setting change 1301, continuation 1302, and cancel 1303 displayed on the user warning screen 1300 is pressed, the CPU 301 does not perform subsequent processing and enters a waiting state.

  In step S1207, the CPU 301 determines whether the print setting change 1301 has been pressed.

  When the print setting change 1301 is pressed, the CPU 301 displays the application mode setting screen 800 in FIG. 8 or the post-processing setting screen 900 in FIG. When the setting content is changed from the application mode setting screen 800 or the post-processing setting screen 900 and a job restart button (not shown) is pressed, the CPU 301 restarts the job, returns to step S1201 again, and performs the above-described processing. I do.

  If the print setting change 1301 has not been pressed, the process proceeds to step S1208.

  In step S1208, the CPU 301 determines whether the continuation 1302 has been pressed or the cancel 1303 has been pressed.

  If cancel 1303 is pressed, the process proceeds to step S1215, and the CPU 301 cancels the job and ends the image forming process.

  On the other hand, if the continuation 1302 is pressed, the process proceeds to step S1209.

  In step S1209, the CPU 301 transmits the image data stored in the RAM 302 to the decompression unit 316. The decompression unit 316 performs processing for decompressing the image data. Further, the decompression unit 316 raster develops image data composed of a plurality of tile image data after decompression processing, and transmits the rasterized image data to the printer image processing unit 315.

  In step S1210, the CPU 301 causes the printer image processing unit 315 to perform designated image editing processing on the document image data.

  In step S1211, the printer image processing unit 315 performs image data editing in accordance with attribute data attached to the image data. This processing content is the same as the processing content described in FIG. In this step, the encoded image data generated in step S1007 or step S1102 and the document image data subjected to the image editing process in step S1210 are combined. In other words, the code image synthesis unit 607 in the printer image processing unit 315 synthesizes the transmitted encoded image data and the original image data based on the information on the position map. The synthesized image data is stored in the RAM 302 by the CPU 301.

  More specifically, the code image combining unit 607 combines the document image data output from the output-side gamma correction unit 605 and the encoded image data generated in step S1007 or step S1102. Then, the halftone correction unit 606 performs halftone processing on the composite image data obtained by the synthesis in accordance with the number of gradations of the printer unit 14 to output. The composite image data after halftone processing is transmitted to the printer unit 14 via the printer I / F 314.

  In step S1212, the printer unit 14 forms an image of the composite image data on output paper.

  In step S1213, the CPU 301 determines whether post-processing is necessary. If it is determined that post-processing is necessary, the process proceeds to step S1214. If it is determined that post-processing is not necessary, the process ends.

  In step S1214, the post-processing unit 207 executes post-processing designated for the discharged paper. For example, when the stapling setting tab 903 is designated, stapling processing is performed on the discharged paper according to predetermined setting contents (for example, stapling processing for each part).

  In this embodiment, if the composite area overlaps at least one of the image editing process area and the post-process area in step S1205, the user interface such as a user warning screen is notified in step S1206. However, it is not limited to this. What is important in the present embodiment is to notify the user when there is an overlap. If this notification can be made, for example, the image forming apparatus may be provided with a sound output unit such as a speaker, and the sound may be output from the sound output unit. Further, the notification may be performed by providing the image forming apparatus with a light emitting unit such as an LED and emitting light from the light emitting unit. The notification may be displayed on a display unit of an external device such as a host computer to notify the user.

  The user who is notified of the duplication by the notification may input the functions according to reference numerals 1301 to 1303 via the host computer 40 or the operation unit 12 of the image forming apparatus.

  In this embodiment, if there is duplication when printing as it is, the user can be notified of this, and the user can recognize the notification and perform processing as intended by the user. Therefore, if it is desired to output even if the overlap is accepted, it can be printed as it is. In addition, when the above overlap cannot be accepted, printing can be stopped or the setting can be changed, so that an image in which the encoded image data and the encoded image are not damaged can be formed.

  Thus, in the present embodiment, if there is an overlap during the printing process, the user can know that fact, and the user can input a process suitable for the printing to the image forming apparatus. The printing process can be performed by a process intended by the user.

<Image editing area determination processing>
As illustrated in FIG. 8, the image editing process includes types such as binding margin, frame erasing, and bookbinding. For this reason, the determination method of the image editing area applied to the document image differs depending on the contents of the image editing process.

  For example, FIG. 18A shows an example of an image editing area in the binding margin process when the binding margin setting tab 801 is pressed, while FIG. 18B shows a case where the frame erase setting tab 802 is pressed. An example of an image editing area in the frame erasing process is shown.

  18A and 18B, the upper left corner of the original image 1801 and original image 1802 stored in the RAM 302 is the origin (0, 0), the main scanning direction is the X axis, and the sub scanning direction is the Y axis. It is said. Hereinafter, the determination method of the image editing area will be described in detail for each of the cases (A) and (B).

  In the binding margin process (A), for example, when the binding margin setting tab 801 is pressed, the document image is shifted to a setting position of 2 cm in the main scanning direction on the detailed setting screen (not shown), and the binding margin is set. Suppose you are set to make.

  In this case, the area surrounded by (0, 0) and (X2, Y2) corresponding to the binding margin amount for 2 cm is an image editing area by the binding margin process, and the CPU 301 stores the document image data in the image editing area. Perform the deletion process.

  On the other hand, in the frame erasing process of (B), for example, when the frame erasing setting tab 802 is pressed, the frame erasing amount is set at a setting position of 5 mm from the document edge and 10 mm of the document center width on the detailed setting screen (not shown). Suppose that is set.

  In this case, a region corresponding to 5 mm from the document edge and a document center width of 10 mm can be expressed by the same coordinate system as in the case of (A). That is, referring to FIG. 18B, it can be seen that the following areas exist. A region surrounded by (0,0), (X7,0), (0, Y2), and (X7, Y2). A region surrounded by (0, Y2), (X3, Y2), (0, Y3), and (X3, Y3). A region surrounded by (X4, Y2), (X5, Y2), (X4, Y3), and (X5, Y3). A region surrounded by (X6, Y2), (X7, Y2), (X6, Y3), and (X7, Y3). A region surrounded by (0, Y3), (X7, Y3), (0, Y4), and (X7, Y4). An area obtained by combining all these areas becomes an image editing area by the frame erasing process, and the CPU 301 performs a process of deleting the document image data in the image editing area.

  Here, only the binding margin process and the frame erasing process have been described as an example of the image editing process. However, image editing areas in other image editing processes can also be expressed using the above-described coordinate system.

  With the determination method as described above, the CPU 301 determines an area where the image editing process designated on the application mode setting screen 800 is applied to the document image, and information obtained as a result of the determination is obtained in step S1205 described above. As described above, it is a material for determining whether or not there is an overlap.

<Post-processing area determination process>
As illustrated in FIG. 9, post-processing includes types such as stapling, punching, and cutting. For this reason, the method for determining the post-processing area that affects the document image differs depending on the content of the post-processing.

  For example, FIG. 19A shows an example of a post-processing area in the stapling process when the staple setting tab 903 is pressed, while FIG. 19B shows the cutting process when the cutting setting tab 905 is pressed. An example of a post-processing area is shown.

  19A and 19B, the upper left corner of the original images 1901 and 1903 stored in the RAM 302 is the origin (0, 0), the main scanning direction is the X axis, and the sub scanning direction is the Y axis. . Hereinafter, in each of the cases (A) and (B), the post-processing area determination method will be described in detail. In the example of FIG. 19, it is assumed that the size of the original image is the same as the size of the output paper, and the coordinate origin of the original image is the same as the coordinate origin of the output paper. When the size of the original image and the output paper are different, or when the coordinate system is different, it is necessary to consider coordinate conversion and the offset amount of the original position of the original image with respect to the origin of the output paper.

  In the stapling process (A), for example, when the stapling setting tab 903 is pressed, it is assumed that stapling is set to the upper right setting position with respect to the output sheet on the detailed setting screen (not shown). The position where the post-processing unit 207 can staple the output sheet is determined in advance as the physical machine specifications of the image forming apparatus 10. Accordingly, when stapling the output sheet to the upper right, the staple needle width area 1902 connecting (X8, Y5) and (X9, Y6) becomes the post-processing area.

  On the other hand, in the cutting process of (B), for example, when the cutting setting tab 905 is pressed, a case is set in which a setting position of 30 mm on the right side of the output sheet is cut on the detailed setting screen (not shown). .

  In this case, an area surrounded by (X10, 0), (X10, Y7), (X11, 0), and (X11, Y7) corresponding to a cutting width of 30 mm is a post-processing area.

  Here, as an example of the post-processing, only the stapling process and the cutting process have been described. However, post-processing areas in other post-processing can also be expressed using the above-described coordinate system.

  With the determination method as described above, the CPU 301 determines an area where the post-processing designated on the post-processing setting screen 900 is applied to the document image, and information obtained as a result of the determination is described in step S1205 described above. As described above, it is a material for determining whether or not there is an overlap.

  FIG. 20 is a diagram showing a software configuration of the document processing system according to the second embodiment of the present invention. The document processing system is realized by a digital computer 2000 which is a preferred embodiment of the document processing apparatus (information processing apparatus) of the present invention. The general application 2001 is an application program and has a printing function for the OS. The general application 2001 provides functions such as word processing, spreadsheet, photo retouch, draw or paint, presentation, and text editing as application programs.

  These applications use a predetermined interface (generally called GDI) provided by an operating system (OS) when printing application data such as created document data and image data. That is, the general application 2001 transmits an output command (referred to as a GDI function) in a predetermined OS-dependent format to the OS output module that provides the interface in order to print the created data. .

  The output module that has received the output command converts the output command into a format that can be processed by an output device such as a printer, and outputs the converted command (called a DDI function). When using Windows (registered trademark) of Microsoft (registered trademark) as the OS, a module called GDI (Graphic Device Interface) corresponds to the output module described above.

  An electronic document writer 2002 is an improvement of the driver of the output device described above, and is a software module provided for realizing the document processing system. However, the electronic document writer 2002 is not intended for a specific output device, and converts an output command into a format that can be processed by a bookbinding application 2004 and a printer driver 2006 described later. The format after conversion by the electronic document writer 2002 (hereinafter referred to as “electronic document format”) is not particularly limited as long as a document in units of pages can be expressed in a detailed format. Among substantial standard formats, for example, the PDF format by Adobe Systems, the SVG format, etc. can be adopted as the electronic document format.

  When the general application 2001 uses the electronic document writer 2002, the electronic application writer 2002 is designated as a device driver used for output in the general application 2001, and printing is executed. The bookbinding application 2004 completes the new incomplete electronic document file generated by the electronic document writer 2002 as an electronic document file 2003 having a format to be described later.

  When it is necessary to clearly identify this point in the description of the present specification, the names are divided as follows. That is, a file created by the electronic document writer 2002 is called an electronic document file 2003, and an electronic document file given a structure by the bookbinding application 2004 is called a book file 2003. If there is no need to distinguish between them, a document file, an electronic manuscript file, and a book file generated by an application are all referred to as a document file (or document data) 2003.

  The bookbinding application 2004 reads the electronic document file 2003 or the book file 2003 and provides a function for editing the file 2003 to the user of the document processing system. However, the bookbinding application 2004 does not provide a function for editing the contents of each page, but provides a function for editing a structure of a chapter or book, which will be described later, configured with a page as a minimum unit.

  When the book file 2003 edited by the bookbinding application 2004 is printed, the bookbinding application 2004 activates the electronic document despooler 2005. An electronic document despooler 2005 is a program module installed in the computer together with the bookbinding application 2004.

  An electronic document despooler 2005 is a module used to output drawing data to the printer driver 2006 when printing a document file (book file 2003) used by the bookbinding application 2004. The electronic document despooler 2005 first reads a designated book file 2003 from the hard disk. After that, the electronic document despooler 2005 generates an output command suitable for the above-described OS output module in order to print each page in the format described in the book file 2003, and outputs it to an output module (not shown). At that time, the electronic document despooler 2005 designates the printer driver 2006 of the printer 2007 used as an output device as a device driver. The output module converts the output command received using the printer driver 2006 of the designated printer 2007 into a device command that can be interpreted and executed by the printer 2007. The converted device command is transmitted to the printer 2007, and an image corresponding to the command is printed by the printer 2007.

  FIG. 21 is a diagram schematically showing an example of the format of the book file 2003. As shown in FIG. The book, chapter, and page in the book file 2003 in this example are indicated by nodes corresponding to the respective. One book file 2003 includes one book. Since the book and chapter are concepts for defining the structure of the book, they include defined attribute values and links to lower layers as entities. The page has data for each page output by the application program as an entity. Therefore, the page includes an original page entity (original page data) and a link to each original page data in addition to the attribute value. Note that a print page when outputting to a paper medium or the like may include a plurality of document pages. This structure is not displayed by a link, but is displayed as an attribute in each hierarchy of a book, chapter, and page. In FIG. 21, since the book file 2003 does not have to be one complete book, “book” is generalized and described as “document”.

  First, document information 2101 is held at the top. The document information 2101 can be roughly divided into three parts, 2102 to 2104. The document control information 2102 holds information such as a path name in the file system of the document file. The document setting information 2103 holds layout information such as page layout and function setting information of the printing apparatus such as stapling, and corresponds to a book attribute. The chapter information list 2104 holds a set of chapters constituting a document in a list format. The list holds chapter information 2105.

  Similarly, the chapter information 2105 can be roughly divided into three parts 2106 to 2108. The chapter control information 2106 holds information such as a chapter name. The chapter setting information 2107 holds function setting information of the printing apparatus such as a page layout and stapling unique to the chapter, and corresponds to a chapter attribute. In chapter setting information 2107, having the setting information for each chapter makes the first chapter a 2UP layout (printing two pages on one output sheet), and the other chapters a complicated 4UP layout. It is possible to create a document with a simple layout. The page information list 2108 holds a set of document pages constituting each chapter in a list format. The page information list 2108 indicates page information data 2109.

  Similarly, the page information data 2109 can be roughly divided into three parts, reference numerals 2101 to 2112. The page control information 2110 holds information such as page numbers to be displayed on the tree. The page setting information 2111 holds information such as a page rotation angle and page layout position information, and corresponds to an original page attribute. Page link information (page data link) 2112 is document data corresponding to a page. In the example of FIG. 21, the page information 2109 does not directly have document data, but has only page link information 2112, and actual document data is held in a page data list 2113.

  FIG. 22 is a list showing an example of book attributes (document setting information 2103). Usually, for items that can be defined overlapping with lower layers such as chapters and pages, the attribute values of the lower layers are preferentially adopted. Therefore, for items included only in the book attribute, the value defined in the book attribute becomes a valid value throughout the book. An item overlapping with a lower layer has a meaning as a default value when the item is not defined in the lower layer. However, in this embodiment, as will be described later, it is possible to select whether or not to give priority to the attribute value of the lower layer. Each item illustrated does not specifically correspond to one item, but may include a plurality of related items.

  Items unique to the book attributes are the printing method (FIG. 22-No1), bookbinding details (FIG. 22-No10), front / back cover (FIG. 22-No11), index paper (FIG. 22-No12), slip sheet (FIG. 22-No13) and chapter break (FIG. 22-No14). These six items are items defined throughout the book. The item No. 1 in FIG. 22 is expressed as “FIG. 22 -No. 1”, and the same applies to FIG. 23 and FIG.

  As an attribute of the printing method (No. 1 in FIG. 22), three values of single-sided printing, double-sided printing, and bookbinding printing can be designated. Here, “bookbinding printing” is a method of printing in a format that allows bookbinding by bundling a separately designated number of sheets into two and folding the bundle. As an attribute of bookbinding details (FIG. 22-No. 10), when bookbinding printing is designated as an attribute of a printing method (FIG. 22-No. 1), a spread direction, the number of sheets to be bundled, and the like can be designated.

  As attributes of the front cover / back cover (FIG. 22-No. 11), when printing the electronic manuscript file 2003 put together as a book, designation to add front and back cover sheets, and printing on the added sheets Content specifications can be included. The attributes of the index sheet (FIG. 22-No. 12) include, as chapter breaks, designation of insertion of index sheets with ears prepared separately in the printing apparatus and designation of print contents in the index (ear) portions. it can. These attributes can be used when a printer that uses an inserter with an insert function to insert paper prepared separately from the printing paper into a desired position is used, or when multiple paper cassettes are used. Effective when possible. The same applies to the attribute of the slip sheet (No. 13 in FIG. 22).

  As attributes of the slip sheet (No. 13 in FIG. 22), designation of insertion of a sheet supplied from an inserter or a sheet cassette as a chapter break, and designation of a sheet feed source when inserting a slip sheet Etc. can be included. The chapter break (No. 14 in FIG. 22) attribute can include designation of whether to use a new sheet, use a new print page, or do nothing at the chapter break.

  FIG. 23 is a list showing an example of chapter attributes (chapter setting information 2107), and FIG. 24 is a list showing page attributes (page setting information 2111). The relationship between chapter attributes and page attributes is the same as the relationship between book attributes and lower layer attributes.

  As for the chapter attributes (chapter setting information 2107), there are no items unique to the chapters, and all items overlap with the book attributes. Therefore, normally, if the definition in the chapter attribute is different from the definition in the book attribute, the value defined in the chapter attribute has priority. However, in this embodiment, as will be described later, it is possible to select whether or not to give priority to the attribute value of the lower layer.

  22 to 24, there are five items that are common only to the book attribute (document setting information 2103) and the chapter attribute (chapter setting information 2107). That is, paper size (FIG. 23-No1), paper orientation (FIG. 23-No2), N-up printing designation (FIG. 23-No3), enlargement / reduction (FIG. 23-No4), paper discharge method (FIG. 23-No7) 5 items. Among these, the attribute of N-up print designation (No. 23 in FIG. 23) is an item for designating the number of document pages included in one print page. Examples of arrangements that can be specified include 1 × 1, 1 × 2, 2 × 2, 3 × 3, and 4 × 4. The attribute of the paper discharge method (No. 7 in FIG. 23) is an item for designating whether or not stapling is performed on the discharged paper. The validity of this attribute indicates whether the printing apparatus to be used has a stapling function. Depends on.

  Referring to FIG. 24, items unique to the page attribute (page setting information 2111) include page rotation designation (FIG. 24-No1), zoom (FIG. 24-No4), arrangement position designation (FIG. 24-No5), annotation (FIG. 24-NO6) and page division (FIG. 24-No. 8). The attribute of page rotation designation (No. 1 in FIG. 24) is an item for designating a rotation angle when an original page is arranged on a print page. The zoom (No. 4 in FIG. 24) attribute is an item for designating the scaling factor of the original page. The scaling factor is specified with the size of the virtual logical page area as 100%. The virtual logical page area is an area occupied by one manuscript page when the manuscript page is arranged in accordance with designation of N-up or the like. For example, if the designation of N-up is 1 × 1, the virtual logical page area is an area corresponding to one print page, and if it is 1 × 2, each side of one print page is reduced to about 70%. It becomes.

  Referring to FIGS. 22 to 24, attributes common to all of the book, chapter, and page include a watermark (No. 24-No. 2) attribute and a header / footer (FIG. 24-No. 3) attribute. A watermark is a separately designated image or character string that is printed over data created by an application. The header / footer is a watermark printed on the upper margin and the lower margin of each page. However, items that can be specified by variables, such as page number and date, are prepared in the header and footer. The contents that can be specified in the attributes of the watermark (FIG. 24-No. 2) and the header / footer (FIG. 24-No. 3) are common to the chapter and the page, but are different from those of the book. The contents of the watermark and header / footer can be set in the book attribute (document setting information 2103), and how the watermark and header / footer are printed throughout the book can be specified. On the other hand, for a chapter or page, it is possible to specify whether or not to apply the watermark or header / footer set in the book to the chapter or page.

  FIG. 25 shows a user interface screen 2500 displayed when the book file 2003 is opened by the bookbinding application 2004. The tree portion 2501 displays a tree indicating the structure of the open book. The preview unit 2502 has three display methods according to the user's designation.

  The first display method is a mode called a document view that displays a document page as it is. In the document view mode, the content of the document page belonging to the book focused (with the cursor placed) on the tree portion 2501 is reduced and displayed. Note that a layout such as Nup is not reflected in the display of the preview section 2502. The second display method is a print view mode. In the print view mode, the document page is displayed on the preview unit 2502 in a form reflecting the layout of the document page. The third display method is the simple print view mode. In the simple print view mode, the contents of each original page are not reflected in the display of the preview section 2502, but only the layout is reflected.

<Data reading process of bookbinding application 2004>
FIG. 26 is a flowchart relating to processing when the bookbinding application 2004 reads the electronic document file 2003.

  In step S2601, the bookbinding application 2004 reads the electronic document file 2003 newly or additionally. In addition to simply reading, pre-processing for the encoded image data detection processing in step S2603 is also performed. Details of this preprocessing will be described with reference to FIG.

  Next, the process proceeds to step S2602, and the bookbinding application 2004 determines whether there is data to be subjected to the encoded image data detection process. In this determination process, the presence or absence of image data in the electronic document file 2003 is usually determined. Furthermore, when considering the process of replacing the binarized image data with graphic pixels, it is necessary to determine whether or not graphic data exists. If it is determined that there is target data, the process proceeds to step S2603. If there is no target data, the process of this flowchart ends.

  In step S2603, the bookbinding application 2004 performs processing for detecting encoded image data for the data of the read electronic document file 2003. Next, in step S2604, the bookbinding application 2004 determines whether or not the encoded image data has been detected in step S2603. If the encoded image data exists, the process proceeds to step S2605. Terminate the process. When a plurality of detection target data is found in step S2602, the processing of steps S2603 to S2604 is performed on all target data, but in this flow, the description of the loop is omitted for simplification.

  In step S2605, the bookbinding application 2004 changes the current setting for the electronic document file 2003 so that the encoded image does not deteriorate. Details of this setting change processing will be described later with reference to FIG. Further, the process proceeds to step S2606, and the bookbinding application 2004 restricts the GUI so that a setting that induces deterioration of the encoded image cannot be performed. Details of this processing will also be described later with reference to FIG.

  FIG. 27 is a flowchart illustrating an example of detailed processing in step S2601 of FIG. This flowchart will be described using a flow of creating and reading a new electronic document file 2003, but the process of reading an existing electronic document file 2003 is also included in the process of this flowchart.

  First, in step S 2701, the general application 2001 executes print processing for the electronic document writer 2002. At this time, the general application 2001 running on Windows (registered trademark) does not directly call the interface of the electronic document writer 2002 but calls the Windows GDI interface.

  In step S2702, the GDI interface called by the general application 2001 is converted into an interface with a driver called DDI (Device Driver Interface). During this format conversion, the GDI may subdivide one GDI interface call into a plurality of DDI interface calls. For example, even if the application 2001 calls a GDI interface for drawing one image, the DDI interface received by the electronic document writer 2002 may be subdivided into an interface for drawing a plurality of small image pieces. In this case, an encoded image cannot be correctly detected unless a plurality of small image pieces are restored to the original image size. Details of this data restoration processing will be described with reference to FIG.

  In step S 2703, the electronic document writer 2002 once spools the received DDI interface. In step S <b> 2704, the electronic document writer 2002 reads the format designation at the time of creating the electronic document file 2003. This format specification includes a resolution specification and a margin specification. In step S2705, the electronic document writer 2002 converts the data spooled in step S2703 according to the format designation read in step S2704.

  In step S 2706, the electronic document writer 2002 writes the data converted in step S 2705 to the electronic document file 2003. In step S2707, the bookbinding application 2004 reads the electronic document file 2003 created in step S2706. In step S2708, the bookbinding application 2004 restores the small image piece data divided by GDI as necessary.

  FIG. 28 is a flowchart for explaining an outline of the processing for restoring the divided data by the bookbinding application 2004 in step S2708 of FIG. First, in step S2801, the bookbinding application 2004 determines whether the encoded image data is subdivided. Details of the determination process in this step will be described with reference to FIG. Next, the process proceeds to step S2802, and if the CPU 301 determines that the image data is subdivided in step S2801, the process proceeds to step S2803, and if not, this process ends. In step S2803, a process of restoring the divided encoded image data to the original form is executed. Details of this processing will be described with reference to FIG.

  FIG. 29 is a flowchart illustrating details of the process in step S2801 of FIG. In step S2901, the bookbinding application 2004 extracts a document page drawing command from the electronic document file 2003 read in step S2707, particularly in order from the top of the page data list 2113. The document page data is composed of drawing commands obtained by converting the DDI spooled by the electronic document writer 2002 in step S2703 in FIG. 27 in step S2705. The bookbinding application 2004 reads the drawing command sequence one by one from the top. In step S2902, the bookbinding application 2004 determines whether there is a drawing command that has not been read. If all drawing commands have been processed, the process proceeds to step S2906; otherwise, the process proceeds to step S2903.

  In step S2903, the bookbinding application 2004 determines whether or not the drawing command currently being processed and the drawing command determined in step S2902 immediately before are the same type of drawing command. This can be determined by storing the immediately preceding processing target command and determining whether or not the same type of drawing command is continuous. If the drawing command currently being processed is the top drawing command of the page, it is determined that the same type is not lined up. The determination of whether or not they are the same type depends on the drawing system of the electronic document writer 2002. For example, a JPEG image drawing command is continuous, a BMP image drawing is continuous, and an image brush is used. It is determined that the drawn rectangular graphic drawing is continuous. In this case, even if the drawing command for the BMP image is arranged next to the drawing command for the JPEG image, it is not determined that the same type of drawing command is arranged.

  If drawing commands of the same type are continuous, the encoded image data may have been subdivided, so the process further proceeds to step S2904. Otherwise, the process proceeds to the next drawing command. The process returns to step S2901.

  In step S2904, the bookbinding application 2004 determines whether the same type of drawing commands determined in step S2903 are adjacent to each other. This can be determined from the positional relationship between the coordinates of two consecutive drawing commands. For example, the upper left coordinates and the lower right coordinates of two consecutive drawing commands are (X1, Y1), (X2, Y2), (x1, y1), (x2, y2) (where the upper left origin, X1 <x1, Y1 Let us consider the case of <y1). In such a case, if Y1 = y1, Y2 = y2, and X2 + 1 = x1, it is determined that they are continuous in the X direction. If X1 = x1, X2 = x2, and Y2 + 1 = y1, it is determined that they are continuous in the Y direction. be able to.

  If it is determined in step S2904 that they are adjacent, the process proceeds to step S2905. If not, the process returns to step S2901. In step S <b> 2905, the bookbinding application 2004 determines that the divided encoded image data exists in the electronic document file 2003 being read. This can be realized by preparing a flag area in the bookbinding application 2004 and performing a process of setting a flag in the area.

  In step S2906, the bookbinding application 2004 determines that there is no divided encoded image data in the electronic document file 2003 being read. This process can be realized by leaving the flag as it is without setting it.

  Normally, when one GDI interface call is divided into a plurality of DDI interface calls, the corresponding plurality of DDI interfaces are divided into consecutive calls. This example will be described when two GDI interfaces GDI-A and GDI-B are called. In such a case, GDI-A goes to multiple DDI interfaces DDI-A1, DDI-A2, and DDI-A3, and GDI-B goes to multiple DDI interfaces DDI-B1, DDI-B2, DDI-B3, and DDI-B4. And divided respectively. In this case, assuming that GDI-A and GDI-B are called in this order, DDI is called in the order of DDI-A1, DDI-A2, DDI-A3, DDI-B1, DDI-B2, DDI-B3, and DDI-B4. .

  The flowchart of FIG. 29 uses this property to determine whether or not there is a division process. If there is a possibility that the divided DDI commands may be called out of order without maintaining the order, in step S2901, first, drawing command sequences belonging to the same manuscript page are sorted by command type, and the drawing coordinates are further changed. Perform pre-processing of sorting by upper left coordinates.

  FIG. 30 is a flowchart illustrating in detail an example of processing from the data restoration processing in step S2803 in FIG. 28 to the subsequent encoded image data detection processing. In step S3001, the bookbinding application 2004 renders the read original page data at the original resolution, and creates image data. In this process, a process for creating an image to be displayed in the preview may be simply performed at a high resolution. In step S3002, the bookbinding application 2004 performs block selection processing on the image data created in step S3001. In this block selection process, the bookbinding application 2004 can extract an area corresponding to the drawing data type, such as an image portion or a text portion.

  Further, the process proceeds to step S3003, and the bookbinding application 2004 sequentially selects the blocks extracted in step S3002 one by one. Next, in step S3004, the bookbinding application 2004 determines whether or not the processing from step S3005 has been performed on all the blocks extracted in step S3002. If the processes after step S3005 have been performed on all the blocks, the process proceeds to step S3009. If there are still blocks to be processed, the process proceeds to step S3005.

  In step S3005, the bookbinding application 2004 determines whether the currently selected block is an image block. If it is not an image area, the process returns to step S3003 to select an unprocessed block and continue the process of this flowchart. If it is an image area, the process proceeds to step S3006. In step S3006, the bookbinding application 2004 performs processing for detecting encoded image data from the image of the currently selected block.

  In step S3007, the bookbinding application 2004 determines whether it has been detected that the encoded image data is included in step S3006. If the encoded image data is detected, the process proceeds to step S3008. Otherwise, the process returns to step S3003 again. In step S3008, the bookbinding application 2004 sets a flag indicating that encoded image data exists in the currently processed page. In this example, since it is only necessary to know whether or not there is even one piece of encoded image data in the page document, the processing is ended even if an unprocessed block still remains.

  In step S3009, the bookbinding application 2004 cannot detect the encoded image data as a result of examining all the blocks, and therefore sets a flag indicating that there is no encoded image data on the corresponding page and ends the processing.

  Since FIG. 30 shows an example of processing for one page, in the case of a document consisting of a plurality of pages, it is necessary to perform the processing shown in FIG. 30 on the plurality of pages. In the case of this example, it is only necessary to detect that even one encoded image data exists in the document. Therefore, after the flag is set in step S3008, the process may be interrupted even if there are remaining pages.

  Depending on the embodiment, it is necessary to determine whether or not there is encoded image data in units of pages. In this case, it is necessary to apply the processing of FIG. 30 to all pages. In this case, the bookbinding application 2004 has a flag for each page, and in step S3008, a process for setting a flag corresponding to the processing target page may be performed.

  FIG. 31 is an example of processing executed when encoded image data is detected, and is a flowchart for explaining the details of the setting change processing in step S2605 in FIG. In step S <b> 3101, the bookbinding application 2004 checks the current imposition processing setting for the electronic document file 2003. Here, it is checked whether imposition setting is not equal-magnification processing, but Nup setting processing for reducing and allocating data for a plurality of pages per page is designated. If it is determined that Nup is specified, the process proceeds to step S3102. If not, the process proceeds to step S3103. In step S <b> 3102, the bookbinding application 2004 changes the settings for the electronic document file 2003 so that the imposition setting is equal (1 up).

  In step S3103, the bookbinding application 2004 checks the current margin setting for the electronic document file 2003. If the margin is set, the process proceeds to step S3104, and if not, the process proceeds to step S3105. In step S <b> 3104, the bookbinding application 2004 changes the margin of the electronic document file 2003 to 0 in order to prevent the periphery of the data from being clipped or reduced to fit the area inside the margin.

  In step S3105, the bookbinding application 2004 checks the current position movement setting for the electronic document file 2003. If the position movement is set, the process proceeds to step S3106, and if not, the process proceeds to step S3107. In step S3106, the bookbinding application 2004 performs a setting change for correcting the movement amount to 0 so that the data does not protrude outside the sheet due to the position movement.

  In step S <b> 3107, the bookbinding application 2004 determines whether enlargement / reduction is set for the electronic document file 2003. If the enlargement / reduction setting is not equal to that of the original, the process proceeds to step S3108. If not, the process proceeds to step S3109. In step S3108, the bookbinding application 2004 changes the enlargement / reduction ratio of the electronic document file 2003 to 100% so that it is printed at the same size as the document size.

  In step S <b> 3109, the bookbinding application 2004 determines whether a stamp is set for the electronic document file 2003. This determination process is performed because there is a possibility that the encoded image cannot be detected because the original and the stamp overlap when the stamp is set. If the stamp has been set, the process proceeds to step S3110. If not, the process proceeds to step S3111. In step S <b> 3110, the bookbinding application 2004 performs processing for clearing the stamp setting for the electronic document file 2003 so that the stamp is not applied.

  In step S <b> 3111, it is determined whether an annotation is set to be output for the electronic document file 2003. If the annotation is set to be output and the annotation is actually set, there is a possibility that the encoded image cannot be detected because the document and the annotation overlap as in the stamp. If it is determined that an annotation is output, the process proceeds to step S3112. If not, the process of this flowchart ends. In step S3112, the annotation display setting for the electronic document file 2003 is changed to Off so that no annotation is output.

  In this flowchart, the description is limited to only six types of settings, but the present invention is not limited to these six types of settings, and it goes without saying that all the settings that affect the detection of the encoded image can be covered. Yes.

  In addition to the setting of the book file 2003 described above, the setting of the image quality of the printer driver 2006 also affects the detection of the encoded image, so it may not be sufficient to change the setting of the book file 2003. For example, if the printer driver 2006 sets a coarse resolution, a print result that can provide sufficient information to the human eye can be obtained, but an encoded image may not be detected. In general, the electronic document despooler 2005 cannot sufficiently change the setting of the printer driver 2006 only by a printer driver interface defined by the OS. When the printer driver 2006 discloses a special interface for changing settings, the electronic document despooler 2005 can control the settings of the printer driver 2006 in more detail.

  FIG. 32 is a flowchart of a processing example in which the electronic document despooler 2005 changes the image setting of the printer driver 2006 that affects the detection of the encoded image when there is a setting change interface between the electronic document despooler 2005 and the printer driver 2006. It is.

  In step S3201, the bookbinding application 2004 determines whether the resolution set by the printer driver 2006 matches the resolution of the document. If the resolutions match, the process proceeds to step S3204. If it is determined that the resolutions do not match, but the printer driver 2006 has a resolution setting that matches the resolution of the document, the process proceeds to step S3202. In this case, the process proceeds to step S3203. In step S3202, the bookbinding application 2004 changes the resolution setting in the printer driver 2006 so that the resolution of the document matches the output resolution. In step S3203, the bookbinding application 2004 changes the resolution setting of the printer driver 2006 so that the output is performed at the highest possible resolution.

  In step S3204, the bookbinding application 2004 checks the image quality setting in the printer driver 2006. If the image quality setting is not the highest quality, the process proceeds to step S3205. If not, the process proceeds to step S3206. In step S3205, the bookbinding application 2004 changes the setting of the image quality in the printer driver 2006 so as to obtain the highest image quality.

  In step S3206, the bookbinding application 2004 checks the color setting in the printer driver 2006. If the color setting is monochrome fixed or color fixed, the process proceeds to step S3207, and if not, the process proceeds to step S3208. In step S3207, the bookbinding application 2004 changes to auto color setting for switching between color output and monochrome output depending on whether the document is a color document or a monochrome document.

  In step S3208, the bookbinding application 2004 checks whether the color tone correction processing in the printer driver 2006 is set. If the color tone correction has been set, the process proceeds to step S3209. If not, the process ends. In step S3209, the bookbinding application 2004 cancels the color tone correction processing in the printer driver 2006 in order to eliminate the possibility that the encoded image cannot be detected due to the color tone being changed.

  Although only four types of image processing settings are described in FIG. 32, the present invention is not limited to these four types of image processing settings. Needless to say, in practice, all settings affecting the encoded image are examined, and the settings should be changed so that the influence is eliminated or the influence on the detection process is sufficiently reduced. In step S3203, the output is switched to the highest resolution, but variations such as stopping the processing are also conceivable.

  FIG. 33 is an example of a GUI for performing imposition settings. There are five tabs, and it is possible to set processing classified into five types. The first tab screen is composed of three groups (areas 3301 to 3033) separated by a horizontal line. In area 3301, controls for setting the output paper are arranged, and the paper size, orientation, and the like can be set. The area 3302 includes controls for setting the page layout, and it is possible to set the Nup setting, the arrangement order of the N divided areas in the case of Nup, the dividing line between the areas, and the like. . An area 3303 is configured with controls for setting the placement of the document, and includes a placement standard such as placing the document based on the upper left reference of the paper, and a setting for reducing the placement of the document into an area narrowed by a margin. can do.

  FIG. 34 shows an example of the GUI after applying the GUI control processing in step S2606 in FIG. 26 to the GUI in FIG. As a result of controlling the GUI so that the setting that affects the image quality of the encoded image cannot be performed, the appearance is the same as that in FIG. 33, but all the settings are disabled. In FIG. 33, all settings are disabled, but in the example of FIG. 33, all settings in areas 3301 to 3033 are settings that affect the image quality of the encoded image. If the setting does not affect the detection of the encoded image, it remains usable. Needless to say, the scope of the present invention includes not only disabling the control as a whole but also restricting options.

FIG. 35 is a flowchart illustrating an example of a detailed flow of the GUI control process in step S2606. In step S <b> 3501, the bookbinding application 2004 reads a list of GUI controls for performing settings that affect detection of the encoded image from the electronic document file 2003. In step S3502, the bookbinding application 2004 sequentially extracts controls from the list read in step S3501. Next, in step S3503, the bookbinding application 2004 determines whether or not processing has been performed for all controls to be controlled. If all target controls have been processed, the process ends. On the other hand, if there are any remaining controls, the process advances to step S3504 to perform the process for that control. In step S3504, the bookbinding application 2004 disables the processing target control selected in step S3502.
(Other embodiments)
Furthermore, the present invention can be applied to a system including a plurality of devices (for example, a computer, an interface device, a reader, a printer, etc.) or to an apparatus (an image forming apparatus, a printer, a facsimile device, etc.) including a single device. It is also possible.

  In addition, an object of the present invention is to read and execute a program of a system or apparatus (or CPU or MPU) from a storage medium storing a program that realizes the procedure of the flowchart shown in the above-described embodiment. Can also be achieved. In this case, the program itself read from the storage medium realizes the functions of the above-described embodiment. Therefore, this program and a storage medium storing the program also constitute one aspect of the present invention.

  As a storage medium for supplying the program, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like is used. Can do.

  The functions of the above-described embodiment are realized by executing the program read by the computer. In addition, an OS (operating system) running on the computer based on the instruction of the program performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing. It is.

  Furthermore, the program read from the storage medium may be written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

1 is a diagram illustrating an overall configuration of an image forming system according to an embodiment of the present invention. 1 is an external view of an input / output device of an image forming apparatus according to an embodiment of the present invention. 2 is a block diagram for explaining in more detail the configuration of a control unit of the image forming apparatus according to the embodiment of the present disclosure. FIG. It is a figure which shows notionally tile image data concerning one Embodiment of this invention. It is a block diagram of the scanner image processing part concerning one embodiment of the present invention. It is a block diagram of a printer image processing unit according to an embodiment of the present invention. It is a figure explaining an example of the operation part concerning one Embodiment of this invention. It is a figure explaining an example of the operation part concerning one Embodiment of this invention. It is a figure explaining an example of the operation part concerning one Embodiment of this invention. 6 is a flowchart of document input processing according to an embodiment of the present invention. It is a flowchart of the new addition process of the encoded image concerning one Embodiment of this invention. It is a flowchart of the process which outputs the encoding image concerning one Embodiment of this invention to an output paper. It is a figure explaining an example of the operation part concerning one Embodiment of this invention. It is a figure explaining the prior art which encodes input data. It is explanatory drawing of the prior art which decodes encoding data and extracts the data before encoding. It is a figure explaining the subject which concerns on this invention. It is a figure explaining the encoding image area | region concerning one Embodiment of this invention. It is a figure explaining the image edit area | region concerning one Embodiment of this invention. It is a figure explaining the post-processing area | region concerning one Embodiment of this invention. It is a figure which shows the structure of the document processing system which concerns on 2nd embodiment of this invention. It is a figure which shows typically an example of the format of the book file which concerns on 2nd embodiment of this invention. It is a list | wrist which shows an example of the book attribute which concerns on 2nd embodiment of this invention. It is a list | wrist which shows an example of the chapter attribute which concerns on 2nd embodiment of this invention. It is a list | wrist which shows an example of the page attribute which concerns on 2nd embodiment of this invention. It is a figure which shows the user interface screen which concerns on 2nd embodiment of this invention. 10 is a flowchart for explaining processing when a bookbinding application according to a second embodiment of the present invention reads an electronic document file. It is a flowchart which shows the detail of the process which reads the electronic original file which concerns on 2nd embodiment of this invention. It is a flowchart explaining the outline of the division | segmentation data restoration process which concerns on 2nd embodiment of this invention. It is a flowchart which shows the detail of the process which determines whether the encoding image data which concern on 2nd embodiment of this invention are subdivided. It is a flowchart explaining in detail an example of the data restoration process which concerns on 2nd embodiment of this invention, and the process until detection of encoding image data. 10 is a flowchart showing details of an electronic document file setting change process according to the second embodiment of the present invention. 10 is a flowchart illustrating an example of processing for changing image settings of a printer driver according to a second embodiment of the present invention. It is a figure which shows an example of GUI for performing the imposition setting which concerns on 2nd embodiment of this invention. It is a figure which shows GUI after applying the GUI control processing which concerns on 2nd embodiment of this invention to GUI shown in FIG. It is a flowchart which shows the detailed process of the GUI control process which concerns on 2nd embodiment of this invention.

Explanation of symbols

10, 20, 30 Image forming apparatus 11, 21, 31 Controller (Controller Unit)
12, 22, 32 Operation unit 14, 24, 33 Printer unit 40 Host computer (PC)
50 LAN
301 CPU (Central Processing Unit)
305 Operation unit I / F (interface)
312 Scanner image processing unit 315 Printer image processing unit 507 Decoding unit 607 Code image composition unit 800 Application mode setting screen 801 Binding margin setting tab 802 Frame erase setting tab 803 Bookbinding setting tab 804 Negative / positive setting tab 805 Mirror image setting tab 806 Encoded image printing Tab 900 Post-processing setting screen 901 Sort setting tab 902 Group setting tab 903 Staple setting tab 904 Punch setting tab 905 Cutting setting tab 1300 User warning screen 1301 Print setting change 1302 Continue 1303 Cancel 2000 Digital computer 2001 General application 2002 Electronic document writer 2003 Electronic Original file (book file)
2004 bookbinding application 2005 electronic document despooler 2006 printer driver 2007 printer 2101 document information 2102 document control information 2103 document setting information 2104 chapter information list 2105 chapter information 2106 chapter control information 2107 chapter setting information 2108 page information list 2109 page information 2110 page control information 2111 Page setting information 2112 Page link information (page data link)
2113 Page data list 2500 User interface screen 2501 Tree portion 2502 Preview portion

Claims (30)

An image forming apparatus having post-processing means for performing post-processing on a preset position for a sheet after outputting original image data on the sheet,
An overlap determination unit that determines whether an area in which the encoded image data is included in the document image data overlaps a setting position where post-processing is performed by the post-processing unit;
Notification means for notifying the user that the overlap is determined when the overlap determination means determines that the area containing the encoded image data and the set position overlap. An image forming apparatus. An image forming apparatus having post-processing means for performing post-processing on a preset position for a sheet after outputting original image data on the sheet,
An overlap determination unit that determines whether an area in which the encoded image data is included in the document image data overlaps a setting position where post-processing is performed by the post-processing unit;
An inquiry for inquiring of a user whether or not to output the document image data on a sheet when the overlap determination unit determines that the area including the encoded image data and the set position overlap. And an image forming apparatus. An image forming apparatus capable of performing image editing processing,
First determination for determining presence / absence of setting of the image editing process, determining a first area in the image data on which the image editing process is performed, and acquiring first area information regarding the first area Means,
Detecting whether or not encoded image data exists in the image data, determining a second region in the image data in which the encoded image data exists, and a second region relating to the second region A second determination means for acquiring information;
A third determination that compares the first region information with the second region information and determines whether or not the first region information and the second region information overlap in the image data. Means,
A notification means for notifying the user that there is a duplicate if it is determined by the third determination means to be duplicated,
An image forming apparatus according to claim 1, wherein none of the subsequent processes is performed until any menu is selected from a selection menu of a subsequent process displayed by the notification unit. The subsequent processing selection menu is a menu that allows selection of any one of a resetting process, a notification display ignoring process, and a print canceling process,
As the subsequent processing,
When the resetting process is selected, a resetting unit for resetting the setting of the image editing process is displayed. After the setting of the image editing process is reset, the third determining unit again Comparing the first region information and the second region information to determine whether the first region information and the second region information overlap;
When the notification display ignoring process is selected, the image editing process is performed according to the first area information,
The image forming apparatus according to claim 3, wherein the image forming process is stopped when the print canceling process is selected.   5. The image according to claim 3, wherein the image editing process is any one of a binding margin process, a frame erasing process, a bookbinding process, a negative / positive process, a mirror image process, and a code image printing process. Forming equipment. An image forming apparatus capable of performing post-processing,
First determination means for determining presence / absence of setting of the post-processing, determining a first region in the image data to be subjected to the post-processing, and acquiring first region information regarding the first region; ,
Detecting whether or not encoded image data exists in the image data, determining a second region in the image data in which the encoded image data exists, and a second region relating to the second region A second determination means for acquiring information;
A third determination that compares the first region information with the second region information and determines whether or not the first region information and the second region information overlap in the image data. Means,
A notification means for notifying the user that there is a duplicate if it is determined by the third determination means to be duplicated,
An image forming apparatus according to claim 1, wherein none of the subsequent processes is performed until any menu is selected from a selection menu of a subsequent process displayed by the notification unit. The subsequent processing selection menu is a menu that allows selection of any one of a resetting process, a notification display ignoring process, and a print canceling process,
As the subsequent processing,
When the resetting process is selected, a resetting unit for resetting the setting of the post-processing is displayed. After the setting of the post-processing is reset, the third determining unit again performs the first setting. 1 area information and the 2nd area information are compared, it is judged whether the 1st area information and the 2nd area information overlap,
When the notification display ignoring process is selected, the post-processing is performed according to the first area information,
The image forming apparatus according to claim 6, wherein the image forming process is stopped when the print canceling process is selected.   The image forming apparatus according to claim 6, wherein the post-processing is any one of sorting processing, group processing, stapling processing, punching processing, and cutting processing. An image forming apparatus capable of performing image editing processing and post-processing,
It is determined whether or not the image editing process and the post-processing are set, a first area in the image data to be subjected to the image editing process and the post-processing is determined, and a first area related to the first area is determined. First determination means for acquiring the area information;
Detecting whether or not encoded image data exists in the image data, determining a second region in the image data in which the encoded image data exists, and a second region relating to the second region A second determination means for acquiring information;
A third determination that compares the first region information with the second region information and determines whether or not the first region information and the second region information overlap in the image data. Means,
A notification means for notifying the user that there is a duplicate if it is determined by the third determination means to be duplicated,
An image forming apparatus according to claim 1, wherein none of the subsequent processes is performed until any menu is selected from a selection menu of a subsequent process displayed by the notification unit. The subsequent processing selection menu is a menu that allows selection of any one of a resetting process, a notification display ignoring process, and a print canceling process,
As the subsequent processing,
When the resetting process is selected, a resetting unit for resetting the setting of the image editing process and the setting of the post-processing is displayed, and the setting of the image editing process and the post-processing is reset. After that, again, the third determination unit compares the first region information with the second region information, and whether or not the first region information and the second region information overlap each other. And
When the notification display ignoring process is selected, the image editing process and the post process are performed according to the first area information,
The image forming apparatus according to claim 9, wherein the image forming process is stopped when the print canceling process is selected. The image editing process is any one of a binding margin process, a frame erasing process, a bookbinding process, a negative / positive process, a mirror image process, or a code image printing process,
The image forming apparatus according to claim 9, wherein the post-processing is any one of a sorting process, a group process, a stapling process, a punching process, and a cutting process. An image processing method in an image forming apparatus capable of performing image editing processing,
Determining whether or not the image editing process is set, determining a first area in the image data to be subjected to the image editing process, obtaining first area information relating to the first area; Detects whether data is present in the image data, determines a second region in the image data in which the encoded image data is present, and obtains second region information regarding the second region A first determination step,
A second determination that compares the first region information with the second region information and determines whether the first region information and the second region information overlap in the image data. Steps,
A notification step of notifying the user that there is an overlap when it is determined that the second determination step determines that there is an overlap,
An image processing method characterized in that none of the subsequent processes is performed until one of the menus is selected from the selection menu of the subsequent processes displayed in the notification step. The subsequent processing selection menu is a menu that allows selection of any one of a resetting process, a notification display ignoring process, and a print canceling process,
As the subsequent processing,
When the resetting process is selected, a resetting unit for resetting the setting of the image editing process is displayed. After the setting of the image editing process is reset, the second determination step is performed again. Done
When the notification display ignoring process is selected, the image editing process is performed according to the first area information,
The image processing method according to claim 12, wherein when the print cancellation process is selected, the image forming process is stopped.   14. The image according to claim 12, wherein the image editing process is any one of a binding margin process, a frame erasing process, a bookbinding process, a negative / positive process, a mirror image process, and a code image printing process. Processing method. An image processing method in an image forming apparatus capable of performing post-processing,
The presence / absence of post-processing setting is determined, the first region in the image data to be subjected to the post-processing is determined, the first region information regarding the first region is obtained, and the encoded image data is Detecting whether or not the image data is present, determining a second region in the image data in which the encoded image data is present, and obtaining second region information relating to the second region; 1 determination step;
A second determination that compares the first region information with the second region information and determines whether the first region information and the second region information overlap in the image data. Steps,
A notification step of notifying the user that there is an overlap when it is determined that the second determination step determines that there is an overlap,
An image processing method characterized in that none of the subsequent processes is performed until one of the menus is selected from the selection menu of the subsequent processes displayed in the notification step. The subsequent processing selection menu is a menu that allows selection of any one of a resetting process, a notification display ignoring process, and a print canceling process,
As the subsequent processing,
When the resetting process is selected, a resetting unit that resets the setting of the post-processing is displayed. After the setting of the post-processing is reset, the second determination step is performed again.
When the notification display ignoring process is selected, the post-processing is performed according to the first area information,
The image processing method according to claim 15, wherein the image forming process is stopped when the print canceling process is selected.   The image processing method according to claim 15, wherein the post-processing is any one of a sorting process, a group process, a stapling process, a punch hole process, and a cutting process. An image processing method in an image forming apparatus capable of performing image editing processing and post-processing,
It is determined whether or not the image editing process and the post-processing are set, and a first area in the image data to be subjected to the image editing process and the post-processing is determined to determine a first area related to the first area. Region information is obtained, whether or not encoded image data is present in the image data is detected, and a second region in the image data in which the encoded image data is present is determined to determine the second region. A first determination step of acquiring second region information regarding the region of
A second determination that compares the first region information with the second region information and determines whether the first region information and the second region information overlap in the image data. Steps,
A notification step of notifying the user that there is an overlap when it is determined that the second determination step determines that there is an overlap,
An image processing method characterized in that none of the subsequent processes is performed until one of the menus is selected from the selection menu of the subsequent processes displayed in the notification step. The subsequent processing selection menu is a menu that allows selection of any one of a resetting process, a notification display ignoring process, and a print canceling process,
As the subsequent processing,
When the resetting process is selected, a resetting unit for resetting the image editing process and the setting of the post-processing is displayed, and after the setting of the image editing process and the post-processing is reset Then, the third determination step is performed again,
When the notification display ignoring process is selected, the image editing process and the post process are performed according to the first area information,
The image processing method according to claim 18, wherein the image forming process is stopped when the print canceling process is selected. The image editing process is any one of a binding margin process, a frame erasing process, a bookbinding process, a negative / positive process, a mirror image process, or a code image printing process,
20. The image processing method according to claim 18, wherein the post-processing is any one of sorting processing, group processing, stapling processing, punching processing, and cutting processing. An image forming system including an image forming apparatus capable of image editing processing and capable of printing an image, and an information processing apparatus capable of supplying the image to the image forming apparatus,
First determination for determining presence / absence of setting of the image editing process, determining a first area in the image data on which the image editing process is performed, and acquiring first area information regarding the first area Means,
Detecting whether or not encoded image data exists in the image data, determining a second region in the image data in which the encoded image data exists, and a second region relating to the second region A second determination means for acquiring information;
A third determination that compares the first region information with the second region information and determines whether or not the first region information and the second region information overlap in the image data. Means,
A notification means for notifying the user that there is a duplicate if it is determined by the third determination means to be duplicated,
An image forming system in which none of the subsequent processes is performed until any menu is selected from a selection menu of a subsequent process displayed by the notification unit. The subsequent processing selection menu is a menu that allows selection of any one of a resetting process, a notification display ignoring process, and a print canceling process,
As the subsequent processing,
When the resetting process is selected, a resetting unit for resetting the setting of the image editing process is displayed. After the setting of the image editing process is reset, the third determining unit again Comparing the first region information and the second region information to determine whether the first region information and the second region information overlap;
When the notification display ignoring process is selected, the image editing process is performed according to the first area information,
The image forming system according to claim 21, wherein when the print canceling process is selected, the image forming process is stopped.   23. The image according to claim 21, wherein the image editing process is any one of a binding margin process, a frame erasing process, a bookbinding process, a negative / positive process, a mirror image process, and a code image printing process. Forming system. An image forming system including an image forming apparatus capable of post-processing and printing an image, and an information processing apparatus capable of supplying the image to the image forming apparatus,
First determination means for determining presence / absence of setting of the post-processing, determining a first region in the image data to be subjected to the post-processing, and acquiring first region information regarding the first region; ,
Detecting whether or not encoded image data exists in the image data, determining a second region in the image data in which the encoded image data exists, and a second region relating to the second region A second determination means for acquiring information;
A third determination that compares the first region information with the second region information and determines whether or not the first region information and the second region information overlap in the image data. Means,
A notification means for notifying the user that there is a duplicate if it is determined by the third determination means to be duplicated,
An image forming system in which none of the subsequent processes is performed until any menu is selected from a selection menu of a subsequent process displayed by the notification unit. The subsequent processing selection menu is a menu that allows selection of any one of a resetting process, a notification display ignoring process, and a print canceling process,
As the subsequent processing,
When the resetting process is selected, a resetting unit for resetting the setting of the post-processing is displayed. After the setting of the post-processing is reset, the third determining unit again performs the first setting. 1 area information and the 2nd area information are compared, it is judged whether the 1st area information and the 2nd area information overlap,
When the notification display ignoring process is selected, the post-processing is performed according to the first area information,
The image forming system according to claim 24, wherein the image forming process is stopped when the print canceling process is selected.   26. The image forming system according to claim 24, wherein the post-processing is any one of sorting processing, group processing, stapling processing, punching processing, and cutting processing. An image forming system including an image forming apparatus capable of image editing processing and post-processing, capable of printing an image, and an information processing apparatus capable of supplying the image to the image forming apparatus,
It is determined whether or not the image editing process and the post-processing are set, a first area in the image data to be subjected to the image editing process and the post-processing is determined, and a first area related to the first area is determined. First determination means for acquiring the area information;
Detecting whether or not encoded image data exists in the image data, determining a second region in the image data in which the encoded image data exists, and a second region relating to the second region A second determination means for acquiring information;
A third determination that compares the first region information with the second region information and determines whether or not the first region information and the second region information overlap in the image data. Means,
A notification means for notifying the user that there is a duplicate if it is determined by the third determination means to be duplicated,
An image forming system in which none of the subsequent processes is performed until any menu is selected from a selection menu of a subsequent process displayed by the notification unit. The subsequent processing selection menu is a menu that allows selection of any one of a resetting process, a notification display ignoring process, and a print canceling process,
As the subsequent processing,
When the resetting process is selected, a resetting unit for resetting the setting of the image editing process and the setting of the post-processing is displayed, and the setting of the image editing process and the post-processing is reset. After that, again, the third determination unit compares the first region information with the second region information, and whether or not the first region information and the second region information overlap each other. And
When the notification display ignoring process is selected, the image editing process and the post process are performed according to the first area information,
28. The image forming system according to claim 27, wherein the image forming process is stopped when the print canceling process is selected. The image editing process is any one of a binding margin process, a frame erasing process, a bookbinding process, a negative / positive process, a mirror image process, or a code image printing process,
29. The image forming system according to claim 27, wherein the post-processing is any one of a sorting process, a group process, a stapling process, a punch hole process, and a cutting process. Determining means for determining whether or not the drawing command is subdivided into a plurality of drawing commands;
When the determination unit determines that the drawing command has been subdivided into a plurality of drawing commands, the plurality of drawing commands are rendered, and it is determined whether encoded image data is present in the image obtained by the rendering First judging means to
When the determination means determines that the drawing command is not subdivided into a plurality of drawing commands, a drawing command indicating an image among the plurality of drawing commands is a drawing command for drawing encoded image data. An information processing apparatus comprising: a second determination unit that determines whether or not there is.

Images