JP2010088048A - Image processing apparatus, image forming apparatus, computer program, recording medium, and image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus, an image forming apparatus, a computer program, a recording medium, and an image processing method, for output of a manuscript having a plurality of pages assigned to a manuscript image by a predetermined state. <P>SOLUTION: An assigned manuscript determining unit 204 determines whether a manuscript image is an assigned manuscript image to which a manuscript having a plurality of pages are assigned. A manuscript dividing unit 205 divides an image into assignment units when the manuscript image is the assigned manuscript image. A manuscript direction detection unit 206 determines a vertical direction relating to each of divided images. A manuscript correcting unit 207 corrects the divided images by performing processing such as magnification processing, rotation processing, etc. relating to each of the divided images in response to a vertical direction, the number of assignment, and an assigned state. A display-print command generation unit 208 performs generation processing of a display command for displaying in every divided image in a correct vertical direction, and the generation processing of a print command for printing by the assigned state (a state before assignment). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus that processes a document image, and more particularly to an image processing apparatus that can determine a document assignment state with respect to a document image and output a document assigned based on the determination result in a required state The present invention relates to an image forming apparatus including the image processing apparatus, a computer program for realizing the image processing apparatus, a recording medium storing the computer program, and an image processing method.

  In an image forming apparatus such as a copying machine or a multifunction peripheral, the vertical direction or inclination of the original is detected, and based on the determination result, image processing such as correction is performed and the image processing result is displayed. In such a case, a method for re-executing image processing according to the determination result has been proposed.

For example, with respect to the input document image, the top and bottom of the document and the tilt of the document are determined, the preset image processing is executed and the image after image processing is displayed, and the determination result of the top and bottom of the document and tilt correction If there is an error, for example, the left and right angles of the document are adjusted. An image reading apparatus is disclosed that can re-execute image processing according to the adjustment result without re-scanning, and display and output an image that has been re-executed (see Patent Document 1). ).
JP 2007-324648 A

  However, in the apparatus of Patent Document 1, when a plurality of pages of documents with different orientations are assigned to one document image, it is not possible to specify which orientation is the correct orientation. In addition, when the orientation of one of the assigned documents is corrected to a specific direction (for example, the top-to-bottom direction), the orientation of the other document may be horizontal or reversed. There was a problem that some of them were difficult to see.

  The present invention has been made in view of such circumstances, and an image processing apparatus capable of outputting a plurality of pages of a document assigned to a document image in a required state, an image forming apparatus including the image processing apparatus, It is an object of the present invention to provide a computer program for realizing the image processing apparatus, a recording medium storing the computer program, and an image processing method.

  An image processing apparatus according to the present invention, in an image processing apparatus that processes and outputs a document image, includes an allocated document determination unit that determines whether or not the document image is an allocated document image to which a plurality of pages of documents are allocated. When the allocated document determination unit determines that the document is an allocated document image, the document dividing unit divides the document image into divided images for each document on each page, and the divided image divided by the document dividing unit has a required size. And / or document correction means for correcting the orientation of the divided image, and information generation means for generating information for outputting the divided image in accordance with the correction contents of the divided image corrected by the document correction means. It is characterized by that.

  In the image processing apparatus according to the present invention, the document correction unit includes a scaling unit that scales the divided image so that the size of the divided image divided by the document dividing unit becomes the size of the document before the allocation. The information generating means is configured to generate information for outputting the divided image in accordance with a scaling ratio changed by the scaling means.

  An image processing apparatus according to the present invention includes a top and bottom determination unit that determines a top and bottom direction of each of the divided images divided by the document dividing unit, and the document correction unit has a top and bottom direction of the divided image determined by the top and bottom determination unit. A rotation unit configured to rotate the divided image so that the vertical direction of the divided image and the vertical direction of the original image coincide with each other when the vertical direction of the original image is different from the vertical direction of the original image; Information for outputting the divided image is generated in accordance with the rotated angle.

  The image processing apparatus according to the present invention includes display image data generation means for generating display image data for displaying a document image, and the information generation means displays the divided image divided by the document division means. The display image data generation means is configured to generate at least one display information of the size, the top direction, and the position of each of the divided images according to the correction content corrected by the document correction means. The display image data including the display information is generated.

  The image processing apparatus according to the present invention includes a print image data generation unit that generates print image data for printing a document image, and the information generation unit prints the divided image divided by the document division unit. In order to assign each of the divided images to the original document image, at least one piece of print information of the size, the vertical direction, and the position of each of the divided images is generated according to the correction content corrected by the document correction unit. The print image data generation means is configured to generate print image data using the print information.

  An image forming apparatus according to the present invention includes an image forming unit that forms an output image, and an image processing apparatus according to any one of the above-described inventions.

  A computer program according to the present invention is a computer program for causing a computer to function as means for processing an original image. The computer determines whether the original image is an assigned original image in which a plurality of pages of originals are assigned. When it is determined that the original document is an allocated original image, the original dividing means for dividing the original image into divided images for each original on each page, and / or the divided divided image to a required size. A document correction unit that corrects the orientation of the divided image and an information generation unit that generates information for outputting the divided image according to the correction content of the corrected divided image are used.

  A recording medium readable by a computer according to the present invention records the computer program according to the above-described invention.

  The image processing method according to the present invention is an image processing method by an image processing apparatus that processes and outputs a document image, and determines whether or not the document image is an allocated document image in which a plurality of pages of documents are allocated, If it is determined that the image is an image, the original image is divided into divided images for each original on each page, the divided divided image is corrected to a required size and / or the direction of the divided image, and the corrected divided image is corrected. Information for outputting the divided image is generated in accordance with the correction content of the image.

  In the present invention, it is determined whether or not the document image is an allocated document image in which a plurality of pages of documents are allocated. If it is determined that the document image is an allocated document image, the document image is divided into images for each document on each page. Divide into For example, when two pages of originals are assigned to one original image (the number of assignments is 2), the original image is divided into two divided images corresponding to the originals of each page. Then, information for correcting the divided image to a required size and / or correcting the direction of the divided image, and outputting (for example, displaying or printing) the divided image according to the correction content of the corrected divided image. (For example, a display command or a print command) is generated. Thereby, each divided image can be corrected to a required size and orientation, and each document assigned to the document image can be displayed or printed in a required state.

  In the present invention, there is provided scaling means for scaling the divided image so that the size of the divided divided image becomes the size of the original document before layout, and the divided image is output according to the scaled magnification. To generate information. For example, when a four-page document is assigned to one document image (the number of assignments is 4), the magnification processing of the divided images corresponding to each document is performed at 200%, and the original document before the assignment is performed. Correct to the size of. As a result, even when a plurality of pages of a document is allocated to the document image, the allocated document can be output in the original size, and the document can be easily viewed.

  In the present invention, there is provided a top / bottom determination means for determining the top / bottom direction of each of the divided divided images, and when the determined top / bottom direction of the divided image is different from the top / bottom direction of the document image, The divided image is rotated so that the vertical direction coincides with the vertical direction. Then, information for outputting a divided image is generated according to the rotated angle. For example, when two pages of originals are assigned to one original image (the number of assignments is 2), the vertical direction of the divided image corresponding to one original is the same as the vertical direction of the original image. No rotation processing is performed. When the vertical direction of the divided image corresponding to the other document is different from the vertical direction of the original image, the divided image is rotated so that the vertical direction of the divided image becomes the vertical direction of the original image. As a result, even when a plurality of pages of documents having different orientations are allocated, all the documents can be corrected to the correct orientation (for example, the same orientation as the document image) for easy viewing.

  In the present invention, the display image data generating means for generating the display image data for displaying the document image is provided, and when displaying the divided image, each of the divided images is displayed according to the correction content for the divided image. At least one display information of the size, top and bottom direction and position is generated, and display image data including the generated display information is generated. For example, when a two-page document is allocated to one document image and is divided into two divided images, the top and bottom direction of the first divided image matches the top and bottom direction of the second divided image. Is rotated 90 degrees counterclockwise with respect to the document image, the first divided image is scaled to the size of the original document before assignment. Further, correction is performed to change the size of the second divided image to the size of the original document before assignment, and correction is performed to rotate 90 degrees clockwise so that the vertical direction coincides with the vertical direction of the original image. The processing contents of the scaling process and the rotation process as the correction contents are generated as display information, and display image data including the generated display information is generated. As a result, it is possible to divide and display the allocated originals assigned with a plurality of pages of originals, and to correct all the originals in the correct orientation (for example, the same orientation as the original image) for easy viewing. . In addition, by generating display image data including display information, the display device that processes the display image data can perform processing for displaying each document of the assigned document, and the image processing device side This process can be simplified.

  In the present invention, a print image data generation unit that generates print image data for printing a document image is provided. When printing a divided image, the divided image is assigned to the original document image. In accordance with the correction contents for the divided image, at least one piece of print information of the size, the vertical direction, and the position of each divided image is generated, and print image data is generated using the generated print information. For example, when a two-page document is allocated to one document image and is divided into two divided images, the top and bottom direction of the first divided image matches the top and bottom direction of the second divided image. Is rotated 90 degrees counterclockwise with respect to the original image, correction is performed to change the size of the first divided image to the size of the original original document before allocation. Further, the second divided image is scaled to the size of the original document before allocation, and correction is performed to rotate 90 degrees clockwise so that the vertical direction coincides with the vertical direction of the original image. Then, in order to assign each of the divided images to the original document image, processing contents opposite to those of the scaling process and the rotation process as the correction contents are generated as print information, and the generated print information is used for printing. Image data is generated. As a result, the original image can be printed in the assigned state before being divided, and the original in the same state as the original original can be obtained.

  According to the present invention, each of the divided images can be corrected to a required size and orientation, and each document assigned to the document image can be displayed or printed in a required state.

  Hereinafter, the present invention will be described with reference to the drawings illustrating embodiments. FIG. 1 is a block diagram illustrating a configuration of an image forming apparatus 100 including an image processing apparatus 2 according to the present invention. The image forming apparatus 100 (for example, a digital color copying machine or a multi-function machine having a copier function, a printer function, a filing function, a facsimile transmission function, a Scan to E-mail function, or the like) includes an image input device 1 and an image processing device 2. , An image output device 3 as an image forming means, a control unit 4 configured to control the entire device, a data processed by the image processing device 2 or data after processing, etc. The transmission / reception unit 5 including the storage unit 51, an operation panel (not shown) having a liquid crystal display, operation buttons, and the like are provided.

  The image input device 1 includes, for example, a CCD (Charged Coupled Device) line sensor, and an electric signal obtained by color-separating light reflected from a document into R, G, and B (R: red, G: green, B: blue). Convert to A color image signal (RGB analog signal) input by the CCD line sensor is converted into a digital signal by an A / D (analog / digital) converter 201, and an illumination system of the image input device 1 is converted by a shading correction unit 202. Various distortions generated in the imaging system and imaging system are removed. Thereafter, the input processing unit 203 performs processing for correcting γ for each of the RGB signals.

  The input processing unit 203 outputs the image data to the transmission / reception unit 5.

  The transmission / reception unit 5 temporarily stores the input image data in a storage unit 51 such as a hard disk or a semiconductor memory. Then, each process including the subsequent color correction process is performed on the image data once stored. The image data once stored is converted into a required format (for example, PDF file format), and then, for example, an external connection device or a communication line via a network network or a communication line such as an Ethernet network (registered trademark) or a facsimile. Sent to.

  An allocated document determination unit 204 as an allocated document determination unit performs document allocation state determination processing on the image data read from the storage unit 51 or the image data output from the input processing unit 203. That is, it is determined whether or not the document image is an image (allocated document image) indicating an allocated document in which a plurality of pages of documents are allocated.

  For example, the following method can be used to determine the allocated document (Nin1 document). That is, (1) a method of selecting an image mode (for example, a divided image output mode) from the operation panel and determining a document to be assigned by the control unit 4, and (2) a connection to an information processing apparatus such as a personal computer. In the case of a scanner, there is a method in which a document type is selected on a scanner reading condition setting screen (for example, a scanner driver setting screen), and the control unit 4 determines an assigned document.

  As another determination method for the document to be assigned, the number of inversions (or the number of edges) at which the pixel value changes (inverts) from 0 to 1, or from 1 to 0, for each line in the main scanning direction and the sub-scanning direction of the document. ) Distribution. In this case, an average value or a variance value of pixel values for each line can be used. When the following condition is satisfied, it can be determined that the document is an allocated document (for example, a 2-in-1 document). That is, (1) regarding the number of inversions in the main scanning direction, there are two continuous distributions, and there is a blank area between the distributions. (2) Regarding the number of inversions in the sub-scanning direction, since there is a line spacing, the distribution is such that the number of inversions appears at every predetermined interval. (3) Although the blank area depends on the layout of the document, the line whose number of inversions is a predetermined value (for example, 20) or less is about 20 mm during the distribution of the feature amount (about 170 lines when the resolution is 300 dpi). ) Exists. In this case, the determination is made by removing the margins at the peripheral portion of the document (except when the first line or the last line is included in the lines whose number of inversions is equal to or less than a predetermined value). When the allocation number is 4, blank areas appear in both the main scanning direction and the sub-scanning direction.

  Furthermore, as another method for determining an assigned document, the assigned state can be determined using a top / bottom discrimination process described later. 2 and 3 are explanatory views showing a method for determining an assigned document using the top / bottom determination process. 2 and 3 show a case where a two-page document is allocated to a document image (2-in-1 document) (allocation number is 2), but the same applies to other allocation numbers.

  First, the top / bottom discrimination processing of the document will be described. In the document top / bottom discrimination process, for example, character recognition is performed using an OCR technique, each character in the document is cut out, and the cut out character is patterned.

  Next, the feature of the character pattern is compared with the character pattern information stored in the database. As a matching method, the character pattern that has been cut out is superimposed on the character pattern that has been databased, the black and white for each pixel is compared, and the databased character pattern when all match is the character of the input pattern Determine. If there is no character pattern that matches all, it is determined that the character pattern has the largest number of matching pixels. If the predetermined matching ratio is not reached, it is determined that discrimination is impossible.

  Then, the cut character pattern is rotated by 90 °, 180 °, and 270 °, and the above processing is repeated. The number of distinguishable characters for each rotation angle of the extracted character pattern is compared, and the rotation angle with the largest number of distinguishable characters is set as the character direction, that is, the top / bottom direction of the document.

  FIG. 2B shows the result of performing the above-described top / bottom discrimination processing on a document image to which a two-page document having different directions (the top and bottom directions are different) as shown in FIG. 2A is assigned. In this way, when a plurality of pages of documents with different top and bottom directions are allocated in one document, the top and bottom direction of the allocated documents cannot be specified. That is, since the rotation angles are 0 ° and 90 ° and the respective frequencies are equal to or greater than the threshold value, it is not possible to specify which rotation angle indicates the vertical direction.

  Therefore, as shown in FIG. 3A, for example, the original image is divided into two by dividing the long side direction of the original image into two, and the top and bottom discrimination processing is performed on each of the divided divided images. . For the divided image indicated by “Iroha”, as shown in FIG. 3B, the rotation angle is 0 ° and a frequency equal to or greater than the threshold value is obtained, and the vertical direction is a direction corresponding to the rotation angle of 0 °. I understand. For the divided image indicated by “ABC”, as shown in FIG. 3C, a rotation angle is 90 ° and a frequency equal to or higher than the threshold value is obtained, and the vertical direction is a direction corresponding to the rotation angle 90 °. I understand that there is. As described above, since the vertical direction can be specified for each of the divided images, it is possible to determine that this original is an assigned original in which the vertical directions are mixed. 2 and 3 exemplify a 2-in-1 document. However, if the top-and-bottom direction cannot be specified even if the document is divided into two, the Nin1 allocation is also determined by increasing the allocation number. be able to.

  An original dividing unit 205 as an original dividing unit divides an image into allocation units when it is determined that the original image is an allocated original image. For example, when a four-page document is allocated to one document image, an image corresponding to each allocated document is set as a divided image, and the document image is divided into four divided images. The document dividing unit 205 outputs the divided image to the transmission / reception unit 5 or the storage unit 51. Then, each of the divided images stored in the storage unit 51 is subjected to document direction detection processing by a document direction detection unit 206, which will be described later, and document correction processing by a document correction unit 207.

  FIG. 4 is an explanatory diagram showing an example of document division. In the figure, the numbered images are divided images. FIG. 4A shows that the number 1 is assigned and the number of assignments is 1, that is, an unassigned document. As shown in FIG. 4A, if the document is not an allocated document, the document dividing process is not performed.

  On the other hand, in FIG. 4B, numbers 1 and 2 are assigned, and the number of assignments is 2. That is, a two-page document (numbers 1 and 2) is assigned to the document image. Similarly, in FIG. 4C, numbers 1, 2, 3, and 4 are assigned, and the number of assignments is four. That is, a four-page document (numbers 1, 2, 3, 4) is assigned to the document image. The same applies to FIGS. 4D to 4F. The layout state is represented by the number of layouts and is a number of 2, 4, 6, 8, 9,..., And equally divides the document size (length) in the main scanning direction and the sub-scanning direction. Thus, the document image is divided into divided images corresponding to the number of assignments.

  As a method for detecting the document size (length), for example, (1) the main scanning direction placed on the document table by a photoelectric conversion element such as a phototransistor disposed in the image input apparatus 1, There are a method for detecting the document size in the sub-scanning direction, a method (2) a method for detecting the size of the document selected by the user from the operation panel, and one of these methods may be used.

  A document direction detection unit 206 serving as a top / bottom determination unit determines the top / bottom direction for each of the divided images read from the storage unit 51. More specifically, the document direction detection unit 206 determines whether the vertical direction of each divided image coincides with the vertical direction of the document image (a document image composed of a plurality of pages of divided images and assigned with a plurality of pages of documents). Determine whether or not. The top / bottom direction can be determined using the top / bottom determination process described above. The document direction detection unit 206 outputs the determination result (for example, the top-to-bottom direction, the assigned state, etc.) to the document correction unit 207 and the display / print command generation unit 208.

  A document correction unit 207 serving as a document correction unit, a scaling unit, and a rotation unit performs scaling for each of the divided images in accordance with the document direction detection result (vertical direction) and the layout detection result (number of layouts and layout state). The divided image is corrected by performing processing such as processing and rotation processing.

  First, rotation processing as correction processing will be described. In the case of rotating 90 degrees, 180 degrees, and 270 degrees counterclockwise around the origin, the relationship between the coordinates before and after the rotation can be expressed by the following expression. And the correction | amendment of the vertical direction of a divided image is performed using the following formula | equation. That is, if the coordinates before rotation are (X, Y) and the coordinates after rotation are (X ′, Y ′), (1) X ′ = the length of the original image in the Y direction−1 when rotated 90 °. -Y, Y '= X. Further, (2) when rotated 180 °, X ′ = length of the original image in the X direction-1-X, and Y ′ = length of the original image in the Y direction-1-Y. In addition, (3) at the time of 270 ° rotation, X ′ = Y and Y ′ = the length of the original image in the X direction—1-X.

  Next, the scaling process as the correction process will be described. Scaling processing is performed by interpolating each pixel of the divided image, etc., so that the divided image has the same size as the original document before division, and scaling is performed using a scaling factor according to the number of assignments. Do. Interpolation processing can be used for scaling.

  FIG. 5 is an explanatory diagram showing the relationship between the number of assignments and the scaling factor. As shown in FIG. 5, for example, in the case of a 4 in 1 document (number of assignments 4), a scaling process is performed on the divided images using a scaling factor of 200%. The same applies to other allocation numbers.

  As a method of interpolating pixels, for example, (1) interpolation processing by nearest neighbor (nearest neighbor interpolation), that is, a pixel closest to the pixel to be interpolated or a predetermined positional relationship with respect to the pixel to be interpolated (2) Bilinear (linear interpolation) interpolation processing, that is, weighting in a form proportional to the distance between the four existing pixels surrounding the pixel to be interpolated. A method of calculating an average of values and using the value as an interpolation pixel. (3) Interpolation processing by bicubic (non-linear interpolation), that is, adding four points surrounding pixels to be interpolated and adding 12 points surrounding them. There is a method of performing an interpolation calculation using the pixel values of a total of 16 points, and either method can be used.

  The display / print command generation unit 208 as information generation means generates a display command as display information for displaying each divided image divided in allocation units in the correct top-and-bottom direction, an allocation state (state before division) A print command generation process as print information for printing is performed.

  More specifically, for example, the display / print command generation unit 208 displays the display position and display for each divided image so that the divided images (divided originals) are displayed in the order of the originals (page order). Display command (display information) related to the size of the image and the display direction (top and bottom direction).

  Hereinafter, an example of display command generation will be described. FIG. 6 is an explanatory diagram showing an example of a plurality of document images, FIG. 7 is an explanatory diagram showing an example of a corrected document image, and FIG. 8 is an explanatory diagram showing an example of an output file for display. . As shown in FIG. 6, the first document image is the document P1 itself, not the allocated document image. Similarly, it is assumed that the third document image is also the document P4 itself and not the allocated document image. Assume that the second document image is an allocated document image to which documents P2 and P3 are allocated.

  In the case of an assigned document image, the image is divided into divided images P2 and P3 according to the number of assignments, and the divided images P2 and P3 are subjected to scaling processing so as to be the size of the original document. If it is different from the vertical direction, the rotation process is performed so that the vertical direction matches the vertical direction of the document image. FIG. 7 shows a document image (divided image) that has been corrected by correction processing such as scaling processing and rotation processing.

  That is, the divided image P2 is rotated 90 ° clockwise so that the vertical direction coincides with the vertical direction of the original image, and is scaled (enlarged) to the original original size. ) Processing is performed. Further, only the scaling (enlargement) processing is performed on the divided image P3 so as to be the size of the original document.

  Then, an output file is generated as shown in FIG. 8 so that the document images P1 to P4 of FIG. 7 can be displayed in this order. As shown in FIG. 8, a display command as display information is embedded in the image data of the original image P1 of the first page. The display command can be analyzed and executed by the image display device, and includes designation of an image to be displayed, display start position (coordinates) of the image to be displayed, display size, and the like. Similarly, a display command as display information is embedded in the image data of the original image P2 of the second page, the original image P3 of the third page, and the original image P4 of the fourth page. As shown in FIG. 8, an image to be displayed for each page is designated, and the original document size (100% size) is displayed with the upper left as a reference.

  As a result, it is possible to divide and display the allocated originals assigned with a plurality of pages of originals, and to correct all the originals in the correct orientation (for example, the same orientation as the original image) for easy viewing. . In addition, by generating display image data including display information, the display device that processes the display image data can perform processing for displaying each document of the assigned document, and on the image display device side. This process can be simplified.

  Further, the display / print command generation unit 208, for example, print information regarding the print position, print size, and print direction for each original page so that the divided original is printed in the original state (before division). Generate a print command.

  An example of print command generation will be described below. FIG. 9 is an explanatory diagram showing an example of an output file for printing. An example of a plurality of document images is the same as in FIG. 6, and an example of a corrected document image is the same as in FIG. That is, as shown in FIG. 6, the first document image is the document P1 itself, not the allocated document image. Similarly, it is assumed that the third document image is also the document P4 itself and not the allocated document image. Assume that the second document image is an allocated document image to which documents P2 and P3 are allocated.

  In the case of an assigned document image, the image is divided into divided images P2 and P3 according to the number of assignments, and the divided images P2 and P3 are subjected to scaling processing so as to be the size of the original document. If it is different from the vertical direction, the rotation process is performed so that the vertical direction matches the vertical direction of the document image. FIG. 7 shows a document image (divided image) that has been corrected by correction processing such as scaling processing and rotation processing.

  That is, the divided image P2 is rotated 90 ° clockwise so that the vertical direction coincides with the vertical direction of the original image, and is scaled (enlarged) to the original original size. ) Processing is performed. Further, only the scaling (enlargement) processing is performed on the divided image P3 so as to be the size of the original document.

  In order to print the original images P2 and P3 shown in FIG. 7 in a state before correction, that is, in the state shown in FIG. 6B, information on what correction content has been corrected by the original correction unit 207 is acquired. . Then, a print correction command (rotation information, scaling information) is generated so as to perform a process reverse to the correction process performed by the document correction unit 207 so as to obtain the divided images P2 and P3 before being corrected. For example, when the original correction unit 207 performs 140% enlargement scaling processing and 90 ° rotation processing, 1/14 (about 70%) reduction scaling processing is the reverse of these corrections. And a printing correction command for performing a rotation process of −90 °. As a result, it is possible to obtain an image in the same size and top / bottom direction as the assigned document (original document).

  Then, a print position designation command for designating a print position is generated for an image whose size and top / bottom direction have been restored. In the example of FIG. 9, first, the image P3 is designated to be printed from the upper left, and the image P2 is a print position designation command that designates printing from the substantially center following the image P3. As shown in FIG. 9, in conjunction with the above-described printing correction command, the original image can be printed in an assigned state before being divided, and an original equivalent to the original (before division) image can be obtained as a printed matter. Can do. That is, in this case, the print command for the divided images P2 and P3 includes correction processing (division, scaling, rotation, etc.).

  In the example of FIG. 6, the second original image is an assigned original image, and originals P2 and P3 are assigned. The vertical direction of the divided image corresponding to the original P2 is the vertical direction of the original image. On the other hand, on the other hand, the vertical direction of the divided image corresponding to the original P3 shows a case where the vertical direction of the original image coincides with the vertical direction of the original image, but the example of the assigned original image is not limited to this. For example, the vertical direction of the divided image corresponding to the original P3 may be different from the vertical direction of the original image, similarly to the divided image corresponding to the original P2. In this case, the vertical direction of the divided image corresponding to the original P3 and the vertical direction of the divided image corresponding to the original P2 may be different from each other. Further, similarly to the divided image corresponding to the original P3, the vertical direction corresponding to the original P2 may be the same as the vertical direction of the original image.

  The generation of the display command is not limited to the above example. Hereinafter, another example of display command generation will be described. FIG. 10 is an explanatory diagram showing another example of the output file for display, and FIG. 11 is an explanatory diagram showing another example of the output file for display when data is shared.

  Similar to the example of FIG. 6 described above, in the case of a layout document, a display command for split display (partial display) on the split images P2 and P3 is generated according to the number of layouts. Further, a display command for performing a scaling process on the divided images P2 and P3 so as to be the size of the original document is further generated. Further, if the top and bottom direction of the document image is different, a display command is generated for performing rotation processing so that the top and bottom direction matches the top and bottom direction of the document image. The display image after correction is as shown in FIG. 7 by the display commands such as the divided display command, the scaling display command, and the rotation display command.

  That is, with respect to the partial image P2, the P2 portion is divided, rotated 90 degrees clockwise to match the vertical direction with the vertical direction of the document image, and becomes the size of the original document. Thus, the image is displayed after being subjected to scaling (enlargement) processing. In addition, the partial image P3 is displayed after being subjected only to scaling (enlargement) processing so as to be the size of the original document.

  Then, in order to obtain display images P1 to P4 as shown in FIG. 7, an output file is generated as shown in FIG. As shown in FIG. 10, a display command as display information is embedded in the image data of the original image P1 of the first page. The display command can be analyzed and executed by the image display device, and includes designation of an image to be displayed, display start position (coordinates) of the image to be displayed, display size, and the like. For the second page, a display command as display information indicating partial cutout, scaling, and rotation processing is embedded in the P2 portion of the original image data including P2. For the third page, a display command is embedded as display information indicating partial cutout and scaling processing in the P3 portion of the original image data including P3. The fourth page is the same as the first page.

  The example shown in FIG. 11 is a case where the document image data for display on the second page and the document image data for display on the third page are the same data, and thus are shared. The data is shared and a display command for the P2 portion is embedded, and a display command for the P3 portion is embedded.

  As described above, by generating a display command for performing display by performing correction processing from the document image data, the display device that processes the display image data performs processing for displaying each document of the allocated document. Therefore, the processing on the image processing apparatus side can be simplified. In this case, the image processing device side does not perform division, scaling, and rotation processing on the image, and puts it in the file data as a display command. On the image display device side, according to the display command at the time of display, necessary division, Performs scaling and rotation.

    Next, as described in the examples of FIGS. 10 and 11, the image processing apparatus does not perform division, scaling, or rotation correction processing, and is necessary according to the display command when displaying on the image display apparatus. An example of generating a print command when performing division, scaling, and rotation processing will be described.

  FIG. 12 is an explanatory diagram showing another example of an output file for printing. As described above, when the division, scaling, and rotation correction processing is not performed on the image processing apparatus side, the output file for printing is as shown in FIG. That is, since image data exists in the file as it is in the original document, a print command is generated for each page so that printing is performed in a page state of the original document. At this time, division, scaling, and rotation correction processes are not necessary. That is, in this case, the print command for the divided images P2 and P3 does not include correction processing (division, scaling, rotation, etc.).

  The color correction unit 209 generates a CMY (C: cyan, M: magenta, Y: yellow) signal that is a complementary color of the RGB signal, and performs a process for improving color reproducibility. Specifically, the color correction unit 209 performs a process of removing color turbidity based on the spectral characteristics of the CMY color material including unnecessary absorption components in order to make the color reproduction faithful.

  The black generation and under color removal unit 210 generates a K (black) signal based on the CMY signal input from the color correction unit 209 and generates a new CMY signal by subtracting the K signal from the input CMY signal. Then, the generated CMYK signal is output to the spatial filter unit 211. As a result, the CMY three-color signal is converted into a CMYK four-color signal.

  The spatial filter unit 211 performs a spatial filter process with a digital filter based on the region separation data on the CMYK signal input from the black generation and under color removal unit 210. Thereby, the spatial frequency characteristics of the image data are corrected, and blurring of the output image in the image output device 3 or deterioration of graininess is prevented. For example, the spatial filter unit 211 enhances high-frequency components by performing a sharp enhancement process on a region separated into character regions by a region separation unit 214 (to be described later), in particular, in order to improve the reproducibility of black characters or color characters. In addition, the spatial filter unit 211 performs a low-pass filter process for removing the input halftone component on the region separated by the halftone dot region in the region separation unit 214. The spatial filter unit 211 outputs the processed CMYK signal to the halftone generation unit 212.

  The halftone generation unit 212 performs gradation reproduction processing. For example, the halftone generation unit 212 performs binarization processing or multi-value processing so as to be suitable for reproduction of high-frequency components in the image output device 3 in order to improve the reproducibility of black characters or color characters, particularly for the regions separated into character regions. Process. In addition, the gradation separation process (halftone generation) is performed so that the area separated into the halftone dot area is finally separated into pixels and each gradation can be reproduced. Further, the binarization process or the multi-value process is performed so that the area separated into the photographic areas is suitable for the gradation reproducibility in the image output apparatus 3.

  When performing printing, the output data generation unit 213 as the print image data generation unit corrects the image data based on the print correction command and the print position designation command, and generates print data to be printed by the image output device 3. To do. Details of the correction command for printing and the print position designation command will be described later.

  Further, when displaying the document image, the output data generation unit 213 as the display image data generation unit generates an output file in which a display command is embedded in the image data of the document image to be displayed for each page to be displayed. Further, the image data of the document image to be displayed is processed such as thinning out pixels so that the entire image is displayed on a display unit (for example, a liquid crystal display) of the image display device. And gradation correction (gamma correction) based on the display characteristics of the image display device is performed.

  The region separation unit 214 determines to which pixel each pixel of the input image data belongs, such as a black character, a color character, a halftone dot, a photographic paper photograph (continuous gradation region), or the like. The region separation unit 214 outputs the region separation data as a determination result to the black generation and under color removal unit 210, the spatial filter unit 211, and the halftone generation unit 212. Thereby, appropriate processing according to various areas is performed.

  The image output device 3 is an image forming unit using an electrophotographic system or an inkjet system that outputs image data of an original image onto a recording sheet.

  FIG. 13 is a block diagram showing a configuration of the image processing apparatus 2 according to the present invention when the image display apparatus 6 is used. As shown in FIG. 13, when the original image is displayed on the image display device 6, the color correction unit 209 uses RGB image data suitable for the image reading characteristics of the scanner to match the display characteristics of the image display device 6. Processing for conversion to image data of 'G'B' is performed, and enhancement or smoothing processing is performed in the spatial filter unit 211 based on the region separation signal as necessary. Then, the output data generation unit 213 generates an output file by embedding a display command in the image data of the document image to be displayed for each display page. Further, processing such as thinning out pixels is performed so that the entire image is displayed on the display unit of the image display device 6, and gradation correction (gamma correction) based on the display characteristics of the image display device 6 is performed to obtain image data. The image is output to the image display device 6. When the image data is displayed, the processes in the black generation and under color removal unit 210 and the halftone generation unit 212 are not performed.

  As described above, the allocated document determination unit 204 determines whether or not the document image is an allocated document image in which a plurality of pages of documents are allocated. If it is determined that the document image is an allocated document image, the document dividing unit 205 converts the document image into a document image. The image is divided into divided images for each document on each page. Then, the divided image divided by the document correcting unit 207 is corrected to a required size and / or the direction of the divided image, and the divided image is displayed by the display / print command generating unit 208 according to the correction content for the corrected divided image. Information (for example, a display command or a print command) is generated. Thereby, each divided image can be corrected to a required size and orientation, and each document assigned to the document image can be displayed or printed in a required state.

  In particular, the document correction unit 207 has a scaling process function for scaling the divided image so that the size of the divided divided image becomes the size of the document before layout. The display / print command generation unit 208 includes: Information for outputting a divided image is generated according to the scaled magnification. As a result, even when a plurality of pages of a document is allocated to the document image, the allocated document can be output in the original size, and the document can be easily viewed.

  In addition, the original direction detection unit 206 determines the vertical direction of each of the divided divided images. If the vertical direction of the determined divided image is different from the vertical direction of the original image, the original correction unit 207 determines the vertical direction of the divided image. A rotation process is performed to rotate the divided images so that the top and bottom direction of the document image matches. Then, the display / print command generation unit 208 generates information for outputting the divided image according to the rotated angle. For example, when two pages of originals are assigned to one original image (the number of assignments is 2), the vertical direction of the divided image corresponding to one original is the same as the vertical direction of the original image. No rotation processing is performed. When the vertical direction of the divided image corresponding to the other document is different from the vertical direction of the original image, the divided image is rotated so that the vertical direction of the divided image becomes the vertical direction of the original image. As a result, even when a plurality of pages of documents having different orientations are allocated, all the documents can be corrected to the correct orientation (for example, the same orientation as the document image) for easy viewing.

  Next, the operation of the image processing apparatus 2 according to the present invention will be described. 14 is a flowchart showing the processing procedure of the image processing apparatus 2, FIG. 15 is a flowchart showing the processing procedure of file generation, FIG. 16 is a flowchart showing the processing procedure of display command generation, and FIG. It is a flowchart which shows the process sequence of command generation. Note that each unit such as the allocated document determination unit 204, the document dividing unit 205, the document direction detection unit 206, the document correction unit 207, the display / print command generation unit 208, and the output data generation unit 213 is realized by a dedicated hardware circuit. Alternatively, the function of each unit can be realized by configuring the CPU or RAM and causing the CPU to execute a program code indicating a predetermined processing procedure. Thereby, the image processing apparatus 2 according to the present invention can be realized by the program code. First, FIG. 14 will be described.

  The image processing device 2 (hereinafter referred to as “device 2”) detects the document size based on the document image (S11), and determines whether the document image is an allocated document (S12). If the original image is an assigned original (YES in S12), the apparatus 2 performs original division to divide the original image into divided images of a plurality of pages according to the number of assignments (S13). If the document image is not an assigned document (NO in S12), the apparatus 2 performs the process of step S14 described later without performing the process of step S13.

  The apparatus 2 detects the document direction (vertical direction) for each page for each of the divided divided images (S14). The apparatus 2 determines whether or not the top and bottom direction of the divided image matches the top and bottom direction of the document image (S15). If they do not match (NO in S15), the top and bottom direction of the divided images that do not match is the top and bottom direction of the document image. Rotate the divided image so as to match the original direction to correct the document direction (S16). If they match (YES in S15), the apparatus 2 performs the process of step S17 described later without performing the process of step S16.

  The apparatus 2 determines whether or not correction of all document pages has been completed (S17). If correction has not been completed (NO in S17), the processing from step S14 is performed. When the correction is completed (YES in S17), the device 2 performs a file generation process (S18) and ends the process.

  Next, the file generation process will be described with reference to FIG. The apparatus 2 performs a display command generation process (S100), performs a print command generation process (S200), and ends the process.

  Next, display command generation processing will be described with reference to FIG. The apparatus 2 acquires image data of a document image (corrected image data for a document that has been corrected) (S101), and generates a display command (S102). The apparatus 2 determines whether or not generation of display commands for all document images has been completed (S103). If not completed (NO in S103), the processing after step S101 is continued and completed (S103). YES), the process is terminated.

  Next, the print command generation process will be described with reference to FIG. The apparatus 2 acquires image data of a document image (or corrected image data for a document that has been corrected) (S201), and determines whether the document is a direction-corrected document (S202). ). When the direction is corrected (YES in S202), the apparatus 2 generates a command for returning the direction of the divided image (S203). If the direction is not corrected (NO in S202), the apparatus 2 performs the process of step S204 described later without performing the process of step S203.

  The apparatus 2 determines whether or not the command generation processing for returning the directions of all the divided images to the state before correction is completed (S204). If not completed (NO in S204), the processing after step S201 is performed. Continue. If completed (YES in S204), the apparatus 2 acquires image data of the original image (or corrected image data for the corrected original) (S205), and uses the divided original image. It is determined whether or not there is (S206).

  If the original document image has been divided (YES in S206), the apparatus 2 acquires all image data of the original document image to be divided (S207), and generates a command for reconfiguring the divided original document to a state before division (S207). S208). If it is not a divided document image (NO in S206), the apparatus 2 performs the process of step S209 described later without performing the processes of steps S207 and S208.

  The apparatus 2 generates a print command (S209), determines whether or not generation of print commands for all document images has been completed (S210), and if not completed (NO in S210), the process from step S205 is performed. If the process is continued and completed (YES in S210), the process ends.

  FIG. 18 is a block diagram illustrating a configuration of the image reading apparatus 200. As shown in FIG. 18, the image processing apparatus 2 according to the present invention can be used for an image reading apparatus (scanner) 200. The image reading apparatus 200 includes an image input apparatus 1, an image processing apparatus 2, a control unit 4, a storage unit 51, and the like. Further, the image processing apparatus 2 includes an A / D conversion unit 201, a shading correction unit 202, an input processing unit 203, an allocated document determination unit 204, a document dividing unit 205, a document direction detection unit 206, a document correction unit 207, display / printing. A command generation unit 208, an output data generation unit 213, and the like are provided. The same parts as those in the example of FIG.

  The additional information including the RGB signal (image signal in which the display command is embedded), the print correction command, and the print position designation command after the above-described processes are performed in the image processing apparatus 2 includes an information processing apparatus such as a personal computer, Output to MFP.

  As described above, according to the present invention, each document allocated to a document image can be displayed or printed in a required state. In particular, even when a plurality of pages with different orientations are assigned to one document image, the plurality of pages assigned to the document image can be output (displayed or printed) in a required state. it can. That is, in the Nin1 document, when the top and bottom direction of the assigned document is different, the top and bottom direction can be determined for each assigned document and preview or filing can be performed. In addition, information indicating that the document is a Nin1 document is added to the image data of the divided image, and when printing, the information as the original Nin1 document can be obtained by referring to this information.

  In the above-described embodiment, the document correction unit is configured to perform the scaling process and the rotation process. However, the document correction unit may include only one of the scaling process and the rotation process. Further, the display / print command generation unit may be separated into a display command generation unit and a print command generation unit. In this case, the image processing device may be configured to include either or both of the display command generation unit and the print command generation unit depending on the form in which either the image display device or the image output device or both are connected. .

  In the present invention, the above-described image processing (for example, FIGS. 14 to 17) is recorded on a computer-readable recording medium in which program code (execution format program, intermediate code program, source program) to be executed by a computer is recorded. You can also As a result, it is possible to provide a portable recording medium on which a program for performing the above-described image processing is recorded.

  In the present embodiment, the recording medium may be a memory (not shown) for processing performed by a microcomputer, for example, a program medium such as a ROM, or an external storage device (not shown). It may be a program medium provided with a program reading device and readable by inserting a recording medium therein.

  In any case, the stored program code may be configured to be accessed and executed by the microprocessor, or the program code is read, and the read program code is a program (not shown) of the microcomputer. The program code may be downloaded to the storage area and executed. In this case, it is assumed that the computer program for download is stored in the main device in advance.

  Here, the program medium is a recording medium configured to be separable from the main body, such as a tape system such as a magnetic tape or a cassette tape, a magnetic disk such as a flexible disk or a hard disk, and a CD-ROM / MO / MD / DVD. Semiconductors such as optical discs, IC cards (including memory cards) / optical cards, etc., or mask ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash ROM, etc. It may be a medium that carries a fixed program code including a memory.

  In the present embodiment, since the system configuration is such that a communication network including the Internet can be connected, the medium may be a medium that dynamically carries a program so as to download a program code from the communication network. When the program code is downloaded from the communication network in this way, the computer program for downloading may be stored in the main device in advance or may be installed from another recording medium. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The recording medium is read by a program reading device provided in a digital color image forming apparatus or a computer system, whereby the above-described image processing method is executed.

  The computer system includes an image input device such as a flatbed scanner, a film scanner, and a digital camera, a computer that performs various processes such as the image processing method by loading a predetermined program, and a CRT display that displays the processing results of the computer. Or it comprises an image display device such as a liquid crystal display and a printer that outputs the processing results of the computer to paper or the like. Furthermore, a network card, a modem, etc. are provided as communication means for connecting to a server or the like via a network.

1 is a block diagram illustrating a configuration of an image forming apparatus including an image processing apparatus according to the present invention. It is explanatory drawing which shows the determination method of the layout document using the top-and-bottom determination process. It is explanatory drawing which shows the determination method of the layout document using the top-and-bottom determination process. It is explanatory drawing which shows the example of a document division | segmentation. It is explanatory drawing which shows the relationship between the allocation number and a scaling factor. FIG. 6 is an explanatory diagram illustrating an example of a plurality of document images. It is explanatory drawing which shows the example of the original document image after correction | amendment. It is explanatory drawing which shows the example of the output file for a display. It is explanatory drawing which shows the example of the output file for printing. It is explanatory drawing which shows the other example of the output file for a display. It is explanatory drawing which shows the other example of the output file for a display at the time of sharing data. It is explanatory drawing which shows the other example of the output file for printing. It is a block diagram which shows the structure of the image processing apparatus which concerns on this invention in the case of using an image display apparatus. It is a flowchart which shows the process sequence of an image processing apparatus. It is a flowchart which shows the process sequence of file generation. It is a flowchart which shows the process sequence of command generation for a display. It is a flowchart which shows the process sequence of command generation for printing. It is a block diagram which shows the structure of an image reading apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image input device 2 Image processing device 3 Image output device 4 Control part 5 Transmission / reception part 6 Image display apparatus 51 Memory | storage part 204 Document arrangement | positioning determination part 205 Document division part 206 Document direction detection part 207 Document correction part 208 Display / print command generation part 213 Output data generator

Claims (9)

In an image processing apparatus that processes and outputs a document image,
An allocated document determination means for determining whether the document image is an allocated document image in which a plurality of pages of documents are allocated;
A document dividing unit that divides the document image into divided images for each document on each page when the allocated document determination unit determines that the document is an allocated document image;
A document correcting means for correcting the divided image divided by the document dividing means to a required size and / or the orientation of the divided image;
An image processing apparatus comprising: an information generation unit configured to generate information for outputting the divided image according to the correction content of the divided image corrected by the document correction unit. The document correction means includes
A scaling unit that scales the divided image so that the size of the divided image divided by the document dividing unit becomes the size of the original before the assignment;
The information generating means
The image processing apparatus according to claim 1, wherein the image processing apparatus is configured to generate information for outputting the divided image according to a scaling ratio that has been changed by the scaling unit. A top / bottom determination unit that determines the top / bottom direction of each of the divided images divided by the document dividing unit;
The document correction means includes
When the top and bottom direction of the divided image determined by the top and bottom determination unit is different from the top and bottom direction of the document image, the rotating unit rotates the split image so that the top and bottom direction of the divided image matches the top and bottom direction of the document image. With
The information generating means
The image processing apparatus according to claim 1, wherein information for outputting the divided image is generated according to an angle rotated by the rotating unit. Display image data generating means for generating display image data for displaying a document image;
The information generating means
When displaying the divided image divided by the original dividing unit, at least one display information of the size, the vertical direction, and the position of each of the divided images is generated according to the correction content corrected by the original correcting unit. Configured,
The display image data generation means includes
4. The image processing apparatus according to claim 1, wherein the image processing apparatus is configured to generate display image data including the display information. 5. Printing image data generation means for generating image data for printing for printing a document image;
The information generating means
When printing the divided images divided by the document dividing unit, the size and the vertical direction of each of the divided images according to the correction contents corrected by the document correcting unit in order to assign each of the divided images to the original document image. And at least one print information of the position is generated,
The print image data generation means includes
5. The image processing apparatus according to claim 1, wherein image data for printing is generated using the print information. 6.   An image forming apparatus comprising: an image forming unit that forms an output image; and the image processing apparatus according to claim 1. In a computer program for causing a computer to function as means for processing a document image,
Computer
An allocated document determination means for determining whether the document image is an allocated document image in which a plurality of pages of documents are allocated;
A document dividing unit that divides the document image into divided images for each document on each page when it is determined that the document image is a layout document image;
Document correcting means for correcting the divided image to a required size and / or the orientation of the divided image;
A computer program that functions as information generation means for generating information for outputting a divided image in accordance with the correction content of the corrected divided image.   A computer-readable recording medium on which the computer program according to claim 7 is recorded. In an image processing method by an image processing apparatus that processes and outputs a document image,
Determining whether the original image is an assigned original image in which a multi-page original is assigned;
If it is determined that the document image is an allocated document image, the document image is divided into divided images for each document on each page;
Correct the divided image to the required size and / or the orientation of the divided image,
An image processing method, comprising: generating information for outputting a divided image according to the correction content of the corrected divided image.

Images