JP2007172029A - Print inspection device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a print inspection device capable of eliminating an influence caused by an individual difference and secular deterioration of a printer to conduct precisely print inspection, and having a learning function. <P>SOLUTION: This print inspection device 1 is constituted to prepare preliminarily a dictionary for defining a correspondence relation between character information of all the characters input preliminarily from a print server 60 and printed in a continuous form by the printer 70, and feature amounts of all the characters printed in the continuous form by the printer 70, read by a main body unit 10, and computed by a processing unit 30, is constituted to ask an operator about judgement when the feature amount of the character serving as an inspection object, read from the continuous form and computed by the processing unit 30 is determined to be less than a determination reference value with respect to the feature amount of the character correlated by the dictionary, using correct answer information as to a character string printed in the continuous form by the printer 70 input preliminarily from the print server 60, as an index, and is constituted to add to the dictionary the feature amount of the character determined to be less than a determination reference value, according to a judged result. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a print inspection apparatus, and more particularly to a print inspection apparatus that inspects characters printed on a form by a printer.

  For example, for a usage statement or invoice issued monthly by a financial institution or the like, letters, numbers and symbols (hereinafter simply referred to as “characters”) are printed on a predetermined form such as fanfold paper by a printing apparatus (printer). Then, the form is cut by the post-processing device, and the cut form is further folded as necessary, and is automatically enclosed in an envelope by the inserter device and sent to each customer. In particular, when the number of issued usage statements is large, a system printer capable of high-precision and high-speed printing is used.

  However, even if a high-precision printer such as a system printer is used, the characters of the printer printed on the form are not uniform, density differences (thinning or blurring, thickening or collapsed characters), missing characters, or skewed characters. Printing defects due to defects, paper quality, printing environment, etc. occur.

  For this reason, an inspection device (for example, refer to Patent Document 1) for inspecting whether dots of a print pattern printed by a printer meet a predetermined standard, template matching or bit matching between input image data and image data of printed matter Printer device for map matching (see, for example, Patent Documents 2 and 3), printer device for comparing and comparing a bitmap font generated by a character generator from a character code and a bitmap of a printed material (for example, see Patent Document 4), input A technique such as a print inspection apparatus (see, for example, Patent Document 5) that divides and compares a reference image of the entire printed material and an image of the entire printed material that have been read is disclosed. Further, as a technique for recognizing handwritten characters, a pattern recognition device that creates a recognition dictionary using a secondary identification function derived from a Bayesian decision rule considering a rival category is also disclosed (see, for example, Patent Document 6).

  These conventional technologies can be broadly divided into image collation technology for collating image data used for printing (printing) with image data read from the printed one, and reading the printed one for OCR processing and character recognition. Can be classified into two types of recognition and collation techniques for collating the results converted into character data.

Japanese Patent Publication No. 7-92542 Japanese Patent No. 2994257 JP 2001-96872 A JP 2003-305927 A JP 2000-172844 A JP 2002-150221 A

  However, in the above prior art, the accuracy when performing image collation and recognition collation is reduced because the shape of the same font is slightly different for each printer. In addition, when there are a plurality of character code systems used in the printing application software, it is necessary to consider the logic at the time of character collation for each code system, font, and font size. Further, even if a character image printed on a form by a printer is read by a printing inspection apparatus to create a dictionary, there is a problem that the collation is rejected due to a problem of deterioration of the printer over time.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a print inspection apparatus that can accurately perform a print inspection while eliminating the influence of individual differences between printers and aging deterioration, and has a learning function.

  In order to solve the above problems, the present invention provides a printing inspection apparatus for inspecting characters printed on a form by a printer, a conveying means for conveying the form in one direction, and an image of the form conveyed by the conveying means. An image reading means for reading out, an image of a character printed on the form from the image read by the image reading means, and a feature amount calculating means for calculating the feature amount of the cut out character, and the printer inputted in advance The character information including codes, fonts, and font sizes of all characters that can be printed on the form, and the printer prints the form in a predetermined format corresponding to the character information, and is read by the image reading unit. A dictionary that defines the correspondence between the feature amounts of all the characters calculated by the feature amount calculation means and the character images cut out by the feature amount calculation means. And a dictionary creation means for creating the information, and the correct answer information relating to the character string that has been input in advance and printed on the form by the printer as an index, becomes an inspection object, is read from the form by the image reading means, and is computed by the feature amount computing means It is determined whether or not the character feature amount is greater than or equal to a predetermined determination reference value with respect to the character feature amount associated with the dictionary creation means. A print determination unit that determines that the character is correctly printed on the form by the printer, and a character feature amount calculated by the feature amount calculation unit by the print determination unit is a character associated with the dictionary creation unit. A display unit that displays an image of a character to be inspected by the feature amount calculation means when it is determined that the feature amount is less than the determination reference value. And an input means for inputting an operator's judgment result as to whether or not the character to be inspected displayed on the display means has been correctly printed on the form by the printer, and the character to be inspected from the input means A dictionary created by the dictionary creation means with the feature quantity computed by the feature quantity computation means using the character information of the character to be inspected as an index when information indicating that the character is correctly printed is input Registration means for registering as additional feature amounts in the feature amount.

  In the present invention, the printer prints all the characters constituting the character information in the form in a predetermined format corresponding to the character information including the code, font, and font size of all characters that can be printed on the form by the printer. . The form on which all characters are printed is conveyed in one direction by the conveying means, the image of the form conveyed by the conveying means is read by the image reading means, and the form is read from the image read by the image reading means by the feature amount calculating means. The image of the character printed on is cut out, and the feature amount of the cut out character is calculated. The character information described above is input in advance to the dictionary creation means, and the feature values of all the characters calculated by the feature value calculation means, the character information, and the characters cut out by the feature value calculation means by the dictionary creation means. A dictionary that defines the correspondence with the image is created. A substantially plain form may be used as the form used for creating the dictionary. Next, a character string of characters to be inspected is printed on the form by the printer. Correct information relating to a character string printed on a form by a printer is input in advance to the print determination means. The correct answer information includes character information of each character constituting the character string printed on the form. Note that the character information and the correct answer information may be input via a recording medium that can be read by the dictionary creation means or the print determination means, or may be input online from a printer or a computer that controls the printer. The form on which the character string is printed is conveyed in one direction by the conveying means, the image of the form conveyed by the conveying means is read by the image reading means, and the form read from the image read by the image reading means by the feature amount calculating means. The image of the printed character is cut out, and the feature amount of the cut out character is calculated. Next, the print decision means uses the correct answer information inputted in advance as an index, and the character feature quantity calculated by the feature quantity computation means to be inspected is associated with the character (created by the dictionary creation means). (Characters for which correspondence is defined by a dictionary) is determined to be greater than or equal to a predetermined determination reference value, and when it is determined to be greater than or equal to the determination reference value, the character to be inspected is a form in the printer Is judged to have been printed correctly. Then, when it is determined that the character feature amount calculated by the feature determination unit by the print determination unit is less than the determination reference value with respect to the character feature amount associated by the dictionary creation unit, the feature amount calculation unit The image of the character to be inspected is displayed on the display means, and the operator's judgment result as to whether the character to be inspected and displayed on the display means is correctly printed on the form by the printer is input from the input means, and the registration means Thus, when the information indicating that the character to be inspected is correctly printed is input from the input unit, the feature amount calculated by the feature amount calculating unit is indexed using the character information of the character to be inspected as a dictionary. It is registered as an additional feature amount in the feature amount of the dictionary created by the creation means.

  In the present invention, in order to assist the operator's judgment, the display unit uses the dictionary creation unit to create a correspondence between the character image cut out by the feature amount calculation unit and the character information of the character to be inspected as an index. May be displayed simultaneously with the image of the character to be inspected. The dictionary created by the dictionary creating means preferably has a data structure that can have a plurality of additional feature quantities that can be registered by the registering means. Further, the print determination means uses the correct answer information as an index to determine whether or not the feature quantity of the character to be inspected and calculated by the feature quantity calculation means has a correspondence relationship established in the dictionary for the character associated by the dictionary creation means or in advance. It may be determined whether any one of the feature amounts registered in the above is a determination reference value or more. In this case, when it is determined that the value is less than the determination reference value, the print determination unit further determines the determination criterion with respect to any other feature amount of which the correspondence relationship is defined in the dictionary or is registered in advance. It is preferable to determine whether the value is greater than or equal to the value.

  The image reading means reads the image of the form conveyed by the conveying means for each page, and the feature amount calculating means reads the character image printed on the form from the image read for each page by the image reading means one character at a time. It may be cut out. Further, in order to increase the processing speed, an inspection area setting means for setting an inspection area in each page of the form is further provided, and the feature amount calculating means is an inspection area setting means in the image read by the image reading means. A character image printed on a form may be cut out character by character from the set inspection region image. At this time, it is preferable that the feature amount calculating unit includes a plurality of computers capable of calculating in parallel the feature amounts of characters cut out from the image read for each page by the image reading unit. Further, the feature amount calculating means may divide the cut-out character image into small regions and use the image forming direction for each small region as an element of the feature amount.

  According to the present invention, a dictionary that defines the correspondence between the feature amounts of all characters actually printed on a form by the printer and the character information is created by the dictionary creating means, and the correct answer information is indexed by the print judging means. It is determined whether or not the character feature value actually printed on the form by the printer and calculated by the feature value calculation means and the character feature value associated by the dictionary creation means are equal to or greater than a predetermined determination reference value. Therefore, since the print determination means collates the feature amounts of characters printed by the same printer, it is possible to eliminate the influence due to individual differences between printers, and to determine the determination reference value as the threshold, It is possible to flexibly determine whether the character has been correctly printed by setting the aptitude, and even if it is determined by the print determination means that it is less than the determination reference value, the display means and the input means Since the operator's judgment result can be input via the printer, it is possible to cope with the deterioration of the printer over time. Further, the character feature quantity determined by the registration means as less than the judgment reference value by the print judgment means is added as a dictionary as an additional feature quantity. Therefore, it is possible to obtain an effect that a learning function can be given to the dictionary.

  Hereinafter, an embodiment of a print inspection apparatus according to the present invention will be described with reference to the drawings. In the present embodiment, an example will be described in which a continuous form printed by a printer is inspected offline (not linked to printing by a printer).

(Constitution)
As shown in FIG. 1, a printing inspection apparatus 1 according to the present embodiment includes a main unit (reading unit) 10 that reads an image printed on a continuous form F such as fanfold paper (folded printing paper with feed holes) by a printer. And a processing unit 30 for determining whether characters, numbers and symbols (hereinafter referred to as characters) have been correctly printed on the continuous form F by a printer.

  As shown in FIG. 2, the main unit 10 has a plurality of protrusions that are engaged with feed holes formed on both sides of the continuous form F in a casing having a substantially horizontal transfer surface 10 </ b> A. It has two tractor belts 17 that convey in one direction (the direction of arrow A in FIG. 2). The tractor belt 17 is stretched between the tractor rollers 15 and 16. The main unit 10 has a tractor width adjustment motor TM for adjusting the tractor width between the two tractor belts 17 so as to conform to the width size of the continuous form F.

  On the other hand, the continuous form F is transported in one direction (in the direction of arrow A in FIG. 2) in cooperation with the tractor belt 17 in the vicinity of the housing outlet (not shown), and the continuous form F is placed outside the main unit 10. Conveying and discharging rollers 18 and 19 for discharging are arranged. The tractor roller 16 and the conveyance discharge roller 18 are drive rollers, and a rotational driving force is transmitted from a conveyance motor FM including a stepping motor via a driving force transmission mechanism that is configured by a plurality of gears and not shown. In addition, between the conveyance discharge rollers 18 and 19, a structure is adopted in which the conveyance discharge roller 19 can be moved between two positions of contact and separation with respect to the conveyance discharge roller 18 so that the continuous form F can be set. Yes.

  The upper surface of the tractor belt 17 stretched between the tractor rollers 15 and 16 and the contact point between the transport discharge rollers 18 and 19 are set at substantially the same height position. For this reason, the continuous form F is guided into the housing of the main unit 10 substantially horizontally with its back surface in sliding contact with the transport surface 10A, and pulled with a constant force between the transport discharge rollers 18 and 19 and the tractor belt 17. Thus, the sheet is conveyed in a substantially horizontal state, and is discharged out of the housing by the conveyance discharge rollers 18 and 19. In the present embodiment, the maximum conveyance speed of the continuous form F is set to about 1.5 m / s.

  A surface line scan camera 11 that reads an image printed on the surface of the continuous form F is disposed above and downstream of the tractor belt 17 (left side in FIG. 2). A back surface line scan camera 13 that reads an image printed on the back surface of the continuous form F is disposed slightly downstream of the image forming apparatus 11. The line scan cameras 11 and 13 have a dichroic filter, a lens, and a CCD line sensor in a casing.

  White light LED arrays 12A, 12B and 14A, 14B for irradiating the reading positions are arranged on both sides of the reading positions of the line scan cameras 11, 13, respectively. A rod lens (not shown) for condensing white light in a line shape with respect to the reading position is disposed in the vicinity of the LED arrays 12A, 12B, 14A, and 14B.

  The main unit 10 includes a document set detection sensor 21 that detects whether the continuous form F is set on the main unit 10 above and upstream of the tractor belt 17, a tractor belt 17, and transport discharge rollers 18 and 19. In the meantime, a residual paper detection sensor 22 that detects whether or not the continuous form F remains, a rotary encoder 23 that is attached to the rotating shaft of the tractor roller 15 and detects the transport amount of the tractor belt 17 with respect to the continuous form F, two tractors A tractor width home position detection sensor 24 for detecting the home position of the tractor width, which is attached in the vicinity of a gear (not shown) for adjusting the tractor width between the belts 17, and a continuous form F attached to the rotation shaft of the transport discharge roller 19. A jam detection sensor 25 for detecting the jam is provided.

  Further, the main unit 10 has a power supply unit (not shown) for converting the commercial AC power source into a DC power source that can drive / activate the drive unit and the like, and a microcomputer (not shown) that controls the operation of the main unit 10 as a whole. ing. The microcomputer has a sensor control unit that controls the above-described sensor, an actuator control unit that controls the motor drive, and a CPU that has a CPU and cuts out an image for one page read by a line scan camera to correct skew. And an interface for communicating with an image processing unit that reads a barcode, which will be described later, and the processing unit 30 are connected.

  The casing of the main unit 10 is provided with a continuous form F and a plurality of open doors for inspection and repair. On the downstream side of the main unit 10, a folding device 50 that folds the continuous form F, and a loop base 40 that serves as a buffer for adjusting the folding speed of the folding device 50 and the conveyance speed of the continuous form F of the main unit 10. The loop base 40 and the folding device 50 are arranged in this order.

  As shown in FIGS. 1 and 3, the processing unit 30 is composed of an inspection server 31 arranged in a housing and an inspection terminal 32 (32A, 32B, 32C, 32D, 32E) including a plurality of computers having the same specifications. It is configured. In other words, as shown in FIG. 1, the processing unit 30 is a rack that mechanically houses the inspection server 31 and the inspection terminal 32, and as shown in FIG. A computer group that determines whether characters are correctly printed on F. Note that FIG. 3 is an equivalent block diagram of FIG.

  As shown in FIG. 1, a display 31A of the inspection server 31 is arranged at the top of the processing unit 30, and a plurality of operation buttons 31B (corresponding to the keyboard of the inspection server 31 of FIG. 3) are provided on both sides of the display 31A. Is arranged. An inspection terminal 32 is disposed below the inspection server 31. As shown in FIG. 3, the inspection server 31, each inspection terminal 32, and the main unit 10 are connected to each other via a communication line.

  As shown in FIG. 4, the interface of the main unit 10 has a capture board 10B having a control circuit, a serializer, and a deserializer. On the other hand, each inspection terminal 32 is provided with an interface board having a control circuit, a serializer, a deserializer, and a page memory. The capture board 10B of the main unit 10 and the interface board of each inspection terminal 32 are connected in a daisy chain via a communication line. For this reason, the main unit 10 can transmit image data and the like to the inspection terminal 32 waiting for processing.

(Continuous form)
Next, the continuous form F to be inspected by the print inspection apparatus 1 according to the present embodiment will be described. In the following, for the sake of simplicity, the continuous form F will be described as being printed by a system printer 70 controlled by the print server 60 as shown in FIG.

  As shown in FIG. 5, on each page of the continuous form F, the main unit 10 represents the start of each page so that the image of the continuous form F can be read on a page-by-page basis. Start left mark LM arranged on the side), the start right mark RM representing the start of each page, the start right mark RM arranged on the right side of the same height position as the start left mark LM (the front end side and the back side in FIG. 1), and the system Print processing information (information for specifying a job and a page) for the continuous form F by the printer 70 is coded and a bar code BC arranged below the start left mark LM, indicating the end of each page (left side in FIG. 1). An end mark EM disposed on the rear end side and the front side in the transport direction is printed.

  In the present embodiment, these marks and barcodes are printed on the continuous form F by the system printer 70. Even when the image processing unit of the main unit 10 recognizes a part of a plurality of marks and the like, it is different from other marks and the like. The start left mark LM and the start right mark RM are printed in the same shape at symmetrical positions with respect to the transport direction of the main unit 10, and the start left mark LM is from the end mark EM. The end mark EM is printed within the main scanning position of the start left mark LM with respect to the reading direction of the line scan cameras 11 and 13 with a sufficiently large width and a sufficiently short length. Further, the barcode BC is printed in the sub-scanning direction with respect to the reading direction of the line scan cameras 11 and 13, is within the main scanning position of the start left mark LM, and the width of the barcode BC is the start left. Printing is sufficiently smaller than the width of the mark LM.

  The continuous form F shown in FIG. 5 schematically shows an example of use as a usage statement. In addition to the marks and bar codes described above, the continuous form F contains the contents of the usage statement by the system printer 70. Is printed. In the present embodiment, the characters in the inspection area EF indicated by the one-dot chain line in FIG. 5 are the inspection target characters to be inspected by the print inspection apparatus 1. In the present embodiment, similar marks and barcodes are also printed on the back side of the continuous form F, but the inspection area EF can be set to a different area from the front side.

(Operation)
Next, the operation of the print inspection apparatus 1 according to the present embodiment will be described in the order of dictionary creation processing, form registration processing, and print inspection processing. The dictionary creation process and the form registration process are executed before the print inspection apparatus 1 performs the print inspection (processing) of the continuous form F.

<Dictionary creation process>
In short, the dictionary creation processing calculates each feature quantity of characters that can be printed on the continuous form F by the system printer 70, and creates a dictionary that defines the correspondence between the computed feature quantity and the characters (information). The details are as follows.

  First, the print server 60 causes a character string to be printed on a dictionary creation continuous form in a predetermined format corresponding to character information including codes, fonts, and font sizes of all characters that can be printed on the continuous form F by the system printer 70. At the same time, the above-described mark and barcode are printed on each page. In the present embodiment, a continuous form having the same paper quality as the continuous form F, which is different from the continuous form F shown in FIG. As a predetermined format, an identification mark indicating that a dictionary creation character is printed on each line, a reference character that indicates the size of the character, a plurality of font size characters for each font, and a single font size For this, a format in which two or more characters are printed is used. This “predetermined format” means a protocol that allows the processing unit 30 to grasp how all the characters constituting the character information are printed on the dictionary creation continuous form by the system printer 70. .

  Next, character information including codes, fonts, and font sizes of all characters that can be printed on the dictionary creation continuous form by the system printer 70 is written by the print server 60 on the recording medium so as to conform to the predetermined format described above. Character information is input to the inspection server 31 via the recording medium. Thus, the preparation for the dictionary creation process is completed. In general, since the font and font size of characters printed on the continuous form F serving as a usage statement or invoice are limited, the amount of information recorded on the recording medium by the print server 60 does not become so large. Therefore, the above-mentioned “all characters that can be printed” does not mean all characters that can be printed by the system printer 70, and means that fonts and font size characters that are not printed on the continuous form F are excluded. If there is a margin in the recording medium, all characters that can be printed by the system printer 70 may be recorded.

  When the operator creates a dictionary creation continuous form printed by the system printer 70 in the main unit 10 and presses a predetermined button of the operation buttons 31B, the print inspection apparatus 1 starts a dictionary creation process.

  The microcomputer of the main unit 10 that has received the print inspection process start command from the processing unit 30 (inspection server 31) turns on the LED arrays 12A, 12B and 14A, 14B, and controls the transport motor FM via the actuator controller. Drive. Thus, the dictionary creation continuous form is conveyed at a constant speed in the direction of arrow A in FIG. 2, and the line scan cameras 11 and 13 start reading images of the dictionary creation continuous form. Further, the microcomputer refers to a signal from the sensor control unit and starts monitoring jamming of the continuous form for creating a dictionary. It should be noted that the operator sets the dictionary creation continuous form (the front end thereof) in the folding device 50 when the dictionary creation continuous form is discharged from the main unit 10 to the loop base 40 to some extent.

  The image processing unit of the main body unit 10 cuts out an image for one page divided by the start left mark LM or the start right mark RM and the end mark EM. That is, the image from the image at the time when the start left mark LM or the start right mark RM arrives earlier to the reading position to the end mark EM is cut out as an image for one page. In parallel with the image cutout, the image processing unit reads and decodes the barcode BC printed after the start left mark LM, and acquires the above-described print processing information. Next, the image processing unit sequentially transmits the cut image data for one page, the print processing information read from the barcode, and the character information of the page to the inspection terminal 32 waiting for processing. Thereby, each inspection terminal 32 can recognize what page image of the image data for one page received from the print processing information corresponds to the image of the dictionary creation continuous form.

  Each inspection terminal 32 cuts out a character image character by character from the image data image for the received page, and stores the image data and print processing information of the cut out character image in the RAM and the hard disk. After reading the dictionary creation continuous form, the extracted character image and print processing information are read from the RAM and the hard disk, and divided into, for example, 5 × 5 small areas, and 8 directions (45 °) are used as reference vectors. At this time, a feature vector for the inclination of the image forming direction of each small region is calculated, and a feature amount obtained by multiplying each feature vector by a weighting coefficient is calculated. In addition, when dividing into 5 × 5 small areas and using eight-direction reference vectors, 200 feature spaces are formed for one character, and the weighting factor constitutes, for example, the outer portion of the character. It can be set so that the feature vector of a small region becomes larger. In the present embodiment, since two or more characters are printed on the dictionary creation continuous form for the same character (characters having the same code, font, and font size), an average feature amount is calculated for the same character. . When each inspection terminal 32 calculates the feature amount of the received character for the page, the character information is used as an index, the character information, the feature amount, and the character image data stored in the RAM are associated one by one, and the print processing information At the same time, the data is transmitted to the inspection server 31.

  The inspection server 31 receives a dictionary created by one or more inspection terminals 32 and reconstructs a plurality of dictionaries created by the inspection terminal into one dictionary. This dictionary has a data structure that can have a plurality of additional feature amounts (described later) added as feature amounts. Next, with reference to the print processing information received from the inspection terminal 32, the correspondence relationship between the character information, the feature amount, and the image data has been determined for all characters constituting the character information input via the recording medium. (No dictionaries have been created for all characters). If no, the process waiting for processing (features etc. sent to the inspection server 31) to create the rest of the dictionary. Further, image data for one page, print processing information, and character information of the page are transmitted to the terminal 32. When an affirmative determination is made, each inspection terminal 32 is made to verify the created dictionary.

  That is, the inspection server 31 transmits character information, feature amounts, image data, and resolution information having a resolution lower than the image of the image data to each inspection terminal 32 in the created dictionary. Each inspection terminal 32 generates an image with reduced resolution according to the resolution information from the received image data, and divides the generated image into the above-described predetermined small regions and uses the eight directions as reference vectors. A feature vector obtained by multiplying each feature vector by a weighting coefficient is calculated by calculating a feature vector regarding the inclination in the forming direction. Next, it is determined whether or not the calculated feature value is equal to or greater than a verification reference value set in advance with respect to the received feature value. If the determination is affirmative, information indicating that the feature amount of the character to be verified is appropriate is added to the character information. If the determination is negative, the information indicating that the feature amount of the character to be verified is inappropriate. Is added to the character information, and the character information is transmitted to the inspection server 31 when the processing for several tens of characters is completed.

  The inspection server 31 determines whether or not character information has been received for all the characters in the created dictionary. If the determination is negative, the inspection server 32 that is waiting for processing further receives character information and characteristics for several tens of characters. The amount, the image data, and the resolution information are transmitted, and in the case of an affirmative determination, it is determined whether or not there is a character whose feature amount is determined to be inappropriate by referring to the information added to each character information. If it is determined that there is no character for which the feature amount is determined to be inappropriate, the dictionary name is given to the created dictionary, and the created dictionary contents (corresponding relationships between character information, feature amounts, and image data are defined) Are stored in the hard disk, and the dictionary information and the dictionary name excluding information on the correspondence between the character information and the image data among the created dictionaries are transmitted to each inspection terminal 32, and the dictionary creation process is terminated. If it is determined that there is a character whose amount is determined to be inappropriate, the verification reference value is changed (lowered) by the inspection terminal 32 for that character, and the feature values of all the characters in the created dictionary are appropriate. The verification reference value (changed) is set as a determination reference value described later (by changing the default value of the determination reference value set in advance as dictionary attached information) and created. Assign dictionary name to dictionary The contents of the created dictionary are saved on the hard disk, and the dictionary information and the dictionary name excluding the correspondence information between the character information and the image data in the created dictionary are transmitted to each inspection terminal 32 to create the dictionary. End the process. Each inspection terminal 32 stores the received dictionary information and dictionary name in the hard disk.

<Form registration process>
Next, the form registration process will be described. In short, the form registration process is to set the inspection area EF of the above-described continuous form F. The details are as follows.

  The inspection server 31 acquires image data for one page of the continuous form F read by the main unit 10 via the inspection terminal 32. Next, on the basis of the start left mark LM (or start right mark RM) and end mark EM of the acquired image data, the image is cut out so as to include the inspectable region RF (see FIG. 5), and magnification correction is performed. The cut-out image is displayed on the display 31A and waits until the operator designates the inspection area EF. The operator sequentially designates the inspection area EF using the operation button 31B (or an external computer logged into the inspection server 31), and the inspection server 31 acquires the position information of the inspection area EF.

  The inspection server 31 determines whether or not an operation button for ending the specification of the inspection area EF has been pressed (or whether a command for ending the specification from the external computer has been received). Since there is a possibility that the inspection area EF may be continuously specified, the process waits. If the determination is affirmative, the registered form name is assigned to the continuous form F in which the inspection area EF is specified, and the image data of the cut out continuous form F and The position information of the inspection area EF is associated with the registered form name and stored (or updated) on the hard disk, and the registered form name and the position information of the inspection area EF of the continuous form F associated with the registered form name are inspected. It transmits to the terminal 32 and a form registration process is complete | finished. Each inspection terminal 32 that has received the dictionary from the inspection server 31 stores (or updates) the registered form name and the positional information of the inspection area EF of the continuous form F in association with each other on the hard disk.

  The above-described dictionary name and registered form name can be added with names that can be easily identified by the operator. For example, the operator operates the operation button 31B (or logs in to the inspection server 31 from an external computer). The same applies hereinafter.) By specifying the name added to the registered form name, the registered form and the inspection area EF can be displayed on the display 31A. FIG. 5 shows an example in which nine inspection areas EF are designated.

<Print inspection process>
Next, the print inspection process will be described. Prior to this print inspection process, the print server 60 outputs print data to the system printer 70 to print a character string desired by the operator on the continuous form F, and based on the print data output to the system printer 70, Inspection job data (correct answer information) is created and output to a recording medium. FIG. 6 shows an example of the data structure of the inspection job data. In the inspection job data, in addition to information for specifying the dictionary name and registered form name (code for identifying the printer, code for identifying the form), the job for the continuous form F by the system printer 70 and each Print processing information for specifying a page and the above-described character information (job identification ID, field data) are included.

  The operator operates the operation button 31B to cause the inspection server 31 to read the inspection job data created by the print server 60 and recorded on the recording medium. When the inspection server 31 reads the inspection job data, the inspection server 31 transmits the read inspection job data to each inspection terminal 32. Thereby, the preparation for the print inspection process of each inspection terminal 32 is completed.

  When the operator sets the continuous form F printed by the system printer 70 on the main unit 10 and presses a predetermined start button of the operation buttons 31B, the print inspection apparatus 1 starts the print inspection process.

  Similarly to the dictionary creation process, the microcomputer of the main unit 10 that has received the print inspection start command from the processing unit 30 turns on the LED arrays 12A, 12B and 14A, 14B, and conveys the motor FM via the actuator controller. Drive. Thereby, the continuous form F is conveyed at a constant speed in the direction of arrow A in FIG. 2, and the line scan cameras 11 and 13 start reading the image of the continuous form F. Further, the microcomputer starts monitoring the jam of the continuous form F with reference to the signal from the sensor control unit.

  The image processing unit of the main unit 10 cuts out an image from the image at the time when the start left mark LM or the start right mark RM arrives at the reading position to the end mark EM as an image for one page. In parallel with the image cutout, the image processing unit (the CPU) reads the barcode BC printed after the start left mark LM (decodes it to obtain print processing information).

  Next, the image processing unit performs skew correction on the cut out image for one page. That is, the number of pixels Tx [pel] between the start left mark LM and the start right mark RM is counted, and the deviation amount in the transport direction between the start right mark RM and the start left mark LM is counted as the skew amount ΔTy [line]. When the image data at coordinates (x, y) is V (x, y), skew correction is performed by the following equation: V (x, y) = q (x) · V (x, y + s (x) ) + R (x) · V (x, y + s (x) +1). Note that s (x) = int (x · ΔTy / Tx), r (x) = x · ΔTy / Tx−s (x), and q (x) = 1−r (x).

  In addition, the image processing unit counts the number of main scanning lines (lines) Ty [line] between the start left mark LM and the end mark EM so that the coordinates when the image of the inspection area EF is cut out by the inspection terminal can be corrected. Further, Δx is counted when the deviation amount between the start left mark LM and the end mark EM is Δx + Offset [pel]. When the skew correction is completed, the image processing unit of the main unit 10 reads the skew-corrected image data for one page, the read barcode data (decoded print job, page, etc. print processing information), and the start left mark LM. When the number of pixels Tx between the start right mark RM and the number of main scanning lines (lines) Ty between the start left mark LM and end mark EM and the deviation between the start left mark LM and end mark EM are Δx + Offset [pel]. Are sequentially transmitted to the inspection terminal 32 waiting for the inspection.

  Each inspection terminal 32 recognizes its processing part from the received barcode data (print processing information), and extracts character matching job data (correct information) for the corresponding page from already received inspection job data. Each inspection terminal 32 recognizes the registered form name from the inspection job data, acquires the position information of the inspection area EF from the registered form name, and cuts out the image of the inspection area EF from the received image data for one page. The inspection job data (correct information) in the inspection area EF is specified.

  Each inspection terminal 32 associates the distance x [mm] in the inspection job data with the received pixel count Tx [pel] between the start left mark LM and the start right mark RM, and is based on the optical resolution p [DPI]. The magnification correction coefficient Ax in the scanning direction is obtained by, for example, Ax = 25.4 · Tx / (p · x), and the coordinates in the main scanning direction of the inspection region EF are corrected. For this correction, for example, (corrected coordinates in the main scanning direction) = Ax · (coordinates in the main scanning direction of the inspection area EF indicated by the inspection job data) can be used.

  Each inspection terminal 32 associates the received main scanning line number Ty [line] between the start left mark LM and end mark EM with the distance y [mm] in the inspection job data, and the optical resolution p. The sub-scanning direction magnification correction coefficient Ay is obtained from [DPI] by, for example, Ay = 25.4 · Ty / (p · y), and the coordinates in the sub-scanning direction of the inspection region EF are corrected. For this correction, for example, (corrected coordinates in the sub-scanning direction) = Ay · (coordinates in the sub-scanning direction of the inspection area EF indicated by the inspection job data) can be used.

  Each inspection terminal 32 corrects the main scanning direction of the cut-out position of the inspection region EF based on the deviation amount Δx when the deviation amount between the received start left mark LM and end mark EM is Δx + Offset [pel]. Here, Offset represents a positional shift amount in the main scanning direction due to a difference in shape between the start left mark LM and the end mark EM. The main scanning line number Ty [line] between the start left mark LM and the end mark EM is made to correspond to the distance y [mm] in the inspection job data, and the main scanning direction skew correction coefficient Ax ′ from the optical resolution p [DPI]. Is obtained by, for example, Ax ′ = Δx / Ty, the coordinates of the inspection area EF are corrected by the following expression, and the skew correction is performed by correcting the coordinates of the inspection area EF with respect to the skew in the main scanning direction. : (Coordinates in the main scanning direction after correction) = (Coordinates in the main scanning direction of the inspection area EF indicated by the inspection job data information) + Ax ′. (Coordinates in the sub scanning direction of the inspection area EF specified by the inspection job data) Coordinate).

  Next, each inspection terminal 32 cuts out a character image character by character from the image in the inspection area EF, divides it into the predetermined small areas, calculates the feature vector of the inclination in the image forming direction of each small area, and A feature amount obtained by multiplying the feature vector by a weighting coefficient is calculated. Next, it is determined whether or not the calculated feature value is equal to or greater than a determination reference value with respect to the feature value corresponding to the extracted character in the dictionary, using the collation job data (correct answer information) of the extracted character as an index. If the determination is affirmative, it is determined that the characters cut out from the image in the inspection area EF (characters to be inspected) are correctly printed on the continuous form F by the system printer 70.

  Each inspection terminal 32 collects the determination results in units of pages and transmits them to the inspection server 31 as inspection results. At this time, with respect to a character that has been negatively determined (determined that printing has not been performed properly), the attribute information (character information of the character in the print processing information and collation job data) regarding the character and the character from the inspection area EF. The image data of the clipped image is transmitted to the inspection server 31.

  The inspection server 31 that has received the inspection result determines whether there is a negatively determined character. If the determination is affirmative, the characters of the attribute information that are determined not to be printed properly are sequentially displayed. Both the image of the character extracted by referring to the dictionary with the character information as an index and the image of the character extracted from the inspection area EF and transmitted from the inspection terminal 32 are displayed on the display 31A at the same time. Is waited until a predetermined button is pressed among the operation buttons 31B. When the operation button is pressed, the inspection server 31 takes in the input information, and when the information indicates OK, the character information is used as an index, and the character is cut out (character that is visually determined OK by the operator). Is added to the dictionary as an additional feature amount, and information defining the correspondence with the image data is added to the dictionary. Further, the inspection result and the visual judgment result (OK) of the operator are displayed on the page. If the information is created as an inspection log and represents NG, the inspection result and the operator's visual judgment result (NG) are created as the inspection log for the page.

  On the other hand, when the inspection server 31 determines that there is no negatively determined character in the inspection result received from the inspection terminal 32, the inspection server 31 waits until the inspection result is received for all pages and performs the same processing as described above. The inspection log of all pages is saved, the character information of the additional feature amount registered and the additional feature amount are transmitted to each inspection terminal 32, the dictionary information is updated, and the inspection job data is deleted. This completes the print inspection. As a result, the next time the processing unit 30 examines the characters printed on the continuous form F by the system printer 70, it determines whether or not there are a plurality of feature amounts associated with the dictionary. It is determined whether the feature amount of the extracted character is equal to or greater than the determination reference value with respect to any one of the feature amounts associated with the dictionary. Thus, it is determined whether or not it exceeds the criterion value. The page determined to be NG is printed again by the system printer 70 with reference to the inspection log, or is corrected by handwriting or the like.

(Action etc.)
Next, the operation and the like of the print inspection apparatus 1 according to the present embodiment will be described.

  In the print inspection apparatus 1 according to the present embodiment, characters printed on the dictionary creation continuous form in a predetermined format corresponding to the character information by the system printer 70 are read by the main unit 10 and all characters are read by the processing unit 30. The feature amount is calculated, and a dictionary that defines the correspondence relationship between the calculated feature amount of all characters and the character information of all characters that can be input in advance and printed on the continuous form F by the system printer 70 is created. For this reason, the processing unit 30 can determine whether the characters are correctly printed on the continuous form F by the system printer 70 even if the character to be inspected is an external character.

  In the print inspection apparatus 1 of the present embodiment, in the dictionary creation process, a dictionary that defines the correspondence between all the characters that can be printed on the continuous form F by the system printer 70 and their feature amounts is created in advance. In the processing, the character image printed on the continuous form F is cut out to calculate the character feature amount, and the feature amounts are collated using the collation job data (correct information) as an index. Since the processing unit 30 (inspection terminal 32) collates the feature quantities, complicated character recognition processing using a recognition function or the like is not performed. For this reason, complicated processing for character recognition is not required, errors in character recognition can be eliminated, and feature quantities are collated with each other, so that it is not necessary to create logic for collation for each character information.

  Furthermore, in the print inspection apparatus 1 according to the present embodiment, since the feature amounts of characters printed by the same printer are collated, the influence of individual differences among printers is eliminated without being affected by a slightly different font shape between printers. can do. Further, in the print inspection apparatus 1 according to the present embodiment, since the processing unit 30 determines whether or not the feature amounts are equal to or larger than the determination reference value, the print inspection is performed flexibly and accurately by setting the determination reference value appropriately. be able to.

  Furthermore, in the print inspection apparatus 1 according to the present embodiment, even if the processing unit 30 once determines that the value is less than the determination reference value, the operator's determination result can be input via the display 31A and the operation button 31B. Furthermore, according to the operator's decision result, the character feature amount once determined to be less than the determination reference value is registered as an additional feature amount in the dictionary, and the dictionary stores the additional feature amount. Since having a plurality has a data structure, print inspection can be sequentially performed on the plurality of feature amounts, and a learning function can be given to the print inspection apparatus 1. In this case, first, if it is determined whether the feature amount of the character to be inspected is equal to or greater than the determination reference value with respect to the newly added additional feature amount in the dictionary, it is possible to prevent the system printer 70 from aging. Correspondence can be improved.

  Furthermore, in the print inspection apparatus 1 of the present embodiment, the image processing unit of the main unit 10 decodes the barcode printed on the continuous form F, and notifies each inspection terminal 32 of the decoded print processing information. Even if there are a large number of print inspection jobs for continuous forms printed by a plurality of printers, each inspection terminal 32 refers to the print processing information from the correct answer information that has been input in advance. Since the correct answer information regarding the character string can be specified, it is possible to easily manage the correspondence between the continuous form and the correct answer information.

  Furthermore, in the print inspection apparatus 1 according to the present embodiment, since a plurality of marks printed on the continuous form F have individuality, when the image processing unit of the processing unit 30 recognizes a part of the marks, the other marks are displayed. Misidentification with the mark can be prevented. Further, since the plurality of marks and the barcode BC printed on the continuous form F by the system printer 70 are printed at a specific printing position and direction, the main body unit does not interfere with the barcode BC and the plurality of marks. The ten image processing units can accurately cut out the image of each page from the continuous form F.

  In the print inspection apparatus 1 of this embodiment, since the image processing unit of the main unit 10 performs skew correction, the positional accuracy when each inspection terminal 32 cuts out the inspection area EF is improved, and the character to be inspected is detected. Since it is possible to accurately cut out characters one by one without causing image loss, the inspection accuracy of the print inspection apparatus 1 can be increased.

  Furthermore, in the print inspection apparatus 1 of the present embodiment, the inspection terminal 32 is configured by a plurality of computers, and the inspection server 31 transmits an image read for each page to the inspection terminal 32 waiting for processing to calculate a feature amount or the like. Since the inspection terminal 32 determines whether only the characters in the inspection area EF set in the form registration process have been correctly printed on the continuous form F, the print inspection can be quickly performed. .

  In addition, the print inspection apparatus 1 according to the present embodiment performs offline print inspection and can perform dictionary creation processing, form registration processing, and print inspection processing for each of a plurality of printers (not limited to a specific printer). Therefore, high versatility can be secured.

  In this embodiment, the example of inspecting the characters of the continuous form F printed by the system printer 70 offline has been described. However, from the printing on the continuous form F to the sealing of the envelope as described in the background section. When performing a series of processes continuously, an online configuration may be adopted. In this case, the continuous form F discharged from the system printer 70 may be set in the main unit 10 with a buffer provided by a loop base, and the print server 60 and the processing unit 30 are connected by a communication line. Also good.

  In this embodiment, an example in which an image of a continuous form is read by a high-speed line sensor has been described. However, an area sensor may be used to increase the reading speed. Furthermore, in this embodiment, although the example which reads both surfaces of the continuous form F was shown, it does not wait that it may be made to read only one side.

  Furthermore, in the present embodiment, as shown in FIG. 6, the example in which the inspection job data has a code for identifying the printer and a code for identifying the form is shown. The operator may input from the operation button 31B.

  Further, in the present embodiment, an example in which the skew processing is performed by the main body unit 10 has been described, but the skew processing may be performed by the inspection terminal 32 for each page. Furthermore, in this embodiment, for the sake of simplicity, an example in which skew correction is not performed in the dictionary creation processing has been described. However, skew correction may be performed as in the print inspection processing.

  In the present embodiment, an example is shown in which the character is printed on the dictionary creation continuous form with the character information in a predetermined format in the dictionary creation processing. However, the correct answer information may be used as in the print inspection processing. Good. Moreover, in this embodiment, although the example which inspects the character printed on the continuous form was shown, this invention is not restrict | limited to this, For example, the character printed on the single form is test | inspected continuously or intermittently. There is no doubt that it can be applied to a printing inspection apparatus.

  As described above, the present invention provides a print inspection apparatus having a learning function as well as capable of performing a print inspection with high accuracy by eliminating the influence of individual differences and aging of printers. Since it contributes to the manufacture and sale of equipment, it has industrial applicability.

1 is an external perspective view of a printing inspection apparatus according to an embodiment to which the present invention is applicable. It is a schematic sectional drawing of the main-body unit of a printing inspection apparatus. It is a block diagram which shows typically the function of the processing unit of a printing inspection apparatus. It is a block diagram which shows the daisy chain structure between a main body unit and a processing unit. It is explanatory drawing which shows the example of printing printed on the continuous form with the system printer. It is explanatory drawing which shows the data structure of inspection job data.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Print inspection apparatus 11 Surface line scan camera (image reading means)
13 Backside line scan camera (image reading means)
17 Tractor belt (part of transport means)
18, 19 Transport discharge roller (part of transport means)
30 processing unit (dictionary creation means, feature value calculation means, print determination means, registration means, inspection area setting means)
31A Display (display means)
31B Operation buttons (input means)
70 System Printer (Printer)
F Continuous form (form)
FM transport motor (part of transport means)
EF inspection area

Claims (9)

In a print inspection device that inspects characters printed on a form by a printer,
Conveying means for conveying the form in one direction;
Image reading means for reading an image of a form conveyed by the conveying means;
A feature amount calculating unit that cuts out an image of a character printed on the form from an image read by the image reading unit, and calculates a feature amount of the cut out character;
Character information including codes, fonts and font sizes of all characters that can be input in advance and printed on the form by the printer, and printed on the form in a predetermined format corresponding to the character information by the printer. Means for creating a dictionary that defines a correspondence relationship between the feature amounts of all the characters read by the means and calculated by the feature amount calculation means, and the character images cut out by the feature amount calculation means;
The correct amount of information about the character string that is input in advance and printed on the form by the printer is used as an index, and the feature amount of the character that is to be inspected and read from the form by the image reading unit and calculated by the feature amount calculating unit is It is determined whether or not the character feature amount associated with the dictionary creation means is greater than or equal to a predetermined criterion value, and the character to be inspected is determined to be greater than or equal to the criterion value by the printer. A print determination means for determining that the print has been correctly performed;
The feature amount when the character feature amount calculated by the feature amount calculation unit by the print determination unit is determined to be less than the determination reference value with respect to the character feature amount associated by the dictionary creation unit. Display means for displaying an image of the character to be inspected by the calculation means;
An input means for causing the operator to input a result of whether or not the character to be inspected displayed on the display means is correctly printed on the form by the printer;
When the information indicating that the character to be inspected is correctly printed is input from the input unit, the feature amount calculated by the feature amount calculating unit with the character information of the character to be inspected as an index Registration means for registering as an additional feature quantity in the feature quantity of the dictionary created by the dictionary creation means;
Printing inspection device with   The display means includes an image of the character that is cut out by the feature amount calculation means and the character to be inspected, and the inspection object for which the correspondence is determined by the dictionary creation means using the character information of the character to be inspected as an index. The print inspection apparatus according to claim 1, wherein a character image is simultaneously displayed.   The print inspection apparatus according to claim 1, wherein the dictionary created by the dictionary creation unit has a data structure that can have a plurality of additional feature amounts that can be registered by the registration unit.   The print determination means uses the correct answer information as an index, and a correspondence relationship is defined in the dictionary for the character feature quantity that is to be inspected and that is calculated by the feature quantity calculation means by the dictionary creation means. The print inspection apparatus according to claim 3, wherein it is determined whether or not any one of the feature amounts registered in advance is equal to or greater than the determination reference value.   When the print determination unit determines that any one of the feature values is less than the determination reference value, the print determination unit further determines whether the correspondence is defined in the dictionary or any of the feature values registered in advance. The printing apparatus according to claim 4, wherein it is determined whether or not the feature amount is greater than or equal to the determination reference value.   The image reading unit reads the image of the form conveyed by the conveying unit for each page, and the feature amount calculating unit is an image of characters printed on the form from the image read for each page by the image reading unit. The print inspection apparatus according to claim 1, wherein each character is cut out character by character.   The image processing apparatus further comprises inspection area setting means for setting an inspection area in each page of the form, and the feature amount calculating means is an inspection area set by the inspection area setting means among images read by the image reading means. The print inspection apparatus according to claim 6, wherein the character image printed on the form is cut out character by character from the image.   The said feature-value calculating means has several computers which can calculate the feature-value of the said character cut out from the image read for every page with the said image reading means in parallel. The printing inspection apparatus according to 7.   The print inspection apparatus according to claim 1, wherein the feature amount calculation unit divides the extracted character image into small regions and uses an image forming direction for each small region as an element of the feature amount.

Images