JP2006014189A - Printed matter issuing apparatus, printed matter verifying apparatus, and printed matter processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a printed matter issuing apparatus, printed matter verifying apparatus and printed matter processing system in which tampering can be verified without deteriorating a document image. <P>SOLUTION: A printed matter issuing apparatus 100 comprises a feature image forming section 103 for creating a transparent feature image capable of restoring feature data and a printing section 104 for printing a printed matter with the feature image by overlapping the feature image on at least a print area of the printed matter, and a printed matter verifying apparatus 200 comprises a tampering verifying section 206 for comparing feature data restored by a feature data restoring section 203 with feature data extracted by a feature data extracting section 202 and detecting tampering upon the printed matter. The feature image is printed while superposing an original print document so as not to deteriorate the original print document. Thus, tampering can be verified without deteriorating the document image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a printed matter issuing device, a printed matter verifying device, and a printed matter processing system for processing a printed matter, and in particular, a printed matter issuing device for embedding information related to an original document, a printed matter verifying device for detecting falsification of a printed document, and these Is related to a printed material processing system.

  In today's society, transactions through “documents” such as various applications and certificates are widely conducted. While these documents may be handled in the form of digitized electronic documents, printed documents have advantages and ease of handling that electronic documents do not have. Compared to the compulsory use of personal computers for browsing electronic documents, it seems to be widely accepted because of its low cost, good listability of documents, ease of carrying and distribution, etc. Tampering is a security threat to this printed document. As a falsification verification technique for a printed document that addresses this problem, a technique described in Japanese Patent Laid-Open No. 2001-309157 “Document authentication method, system, document creation apparatus, document authentication apparatus, and storage medium” NTT Data (Patent Document 1) is available. there were.

In Patent Document 1, falsification verification is performed as follows.
First, on the document issuing side, feature data is extracted from a document image obtained by scanning a printed document. This feature data is converted into a feature image (for example, a barcode), and a document image pasted on the margin portion of the document image is created and printed as shown in FIG. Referred to as “printed document with feature image”). On the falsification verification side, the feature data is extracted from the document image obtained by scanning the print document with the feature image, and the pasted feature image is cut out and compared with the original feature data.

JP 2001-309157 A JP 2003-209676 A Japanese Patent Laid-Open No. 2003-264685 JP 2001-157002 A JP 2002-64700 A

By the way, as in the embodiment of Patent Document 1, there is the following problem when taking a method of printing a feature image by pasting it on a document image.
(1) On the document issuing side, the document image deteriorates if the resolution of the scanner that reads the printed document is not sufficient. Since the feature image is pasted and output to the deteriorated document image, the feature data extracted from the deteriorated document image is compared at the time of verification, and this causes a difference from the original feature data, resulting in falsification. The tampering detection accuracy deteriorates, for example, misjudging a portion that has not been tampered with.
(2) When the original document image is printed on the document issuing side, the document image deteriorates depending on the state of the printer. In this case also, the problem (1) occurs.

  The present invention has been made in view of the above-described problems of the background art, and an object of the present invention is to provide a new and improved printed material that can be falsified and verified without deterioration of a document image. An issue device, a printed material verification device, and a printed material processing system are provided.

  In order to solve the above problems, according to a first aspect of the present invention, there is provided a printed matter issuing apparatus (100) for printing a printed matter with a feature image in which a feature image including feature data extracted from the printed matter is embedded in the printed matter. . The printed matter issuing apparatus of the present invention is capable of restoring feature data, a printed matter reading unit (101) that reads a printed matter and generates a content image, a feature data extraction unit (102) that extracts feature data from the content image, and A feature image forming unit (103) that forms a feature image having transparency, and a printing unit (104) that prints a print with a feature image in which the feature image is superimposed on at least a print region (a portion that is not a margin region) of the print. (Claim 1).

  According to this configuration, the feature image is printed over the original print document so that the original print document does not deteriorate. Here, the characteristic image is formed as a transparent image so that the information on the printed matter is not lost even if it is superimposed on the print region (the portion that is not the margin region). Such a transparent image can be formed by, for example, a digital watermark technique. In this way, falsification verification can be performed in a state where there is no deterioration of the document image. Even in a printed matter having almost no margin, information can be embedded in the entire printed matter, so that feature information can be embedded regardless of the format of the printed matter. On the contrary, since the space for embedding the feature information is not required, the entire surface of the printed material can be effectively used as an original function of the printed material. The printed material of the present invention is not limited to a document, and can be applied to printed materials such as figures and images.

  The printed matter issuing apparatus of the present invention can be applied as follows.

  Prior to feature extraction by the feature data extraction unit (102), a reference mark printing unit (112) for printing a reference mark indicating a reference position on the printed matter may be further provided (claim 2).

The reference position can be set as follows, for example (claim 3).
-Set based on the image characteristics existing in the printed matter.
・ Set based on ruled lines in printed material.
• Set based on specific marks in the printed material.
-Set based on image features existing in the feature image.

  The inclination may be normalized before the reference position is set (Claim 4). In this case, the inclination normalization may be performed based on the image feature existing in the feature image.

  Also, processing using electronic document data may be performed. For example, an electronic document printing unit (112) for printing a printed material from document data may be further provided. In this case, the electronic document data can include a reference mark indicating a reference position. Alternatively, assuming electronic document data that does not include a reference mark, a reference mark adding unit (140) that adds a reference mark indicating a reference position to the electronic document data, and a printed matter from the electronic document data to which the reference mark is added. It is also possible to further include an electronic document printing unit (112) for printing.

Even when processing using electronic document data is performed, the reference position can be set as follows, for example (claim 9).
-Set based on image characteristics existing in electronic document data.
・ Set based on ruled lines in electronic document data.
-Set based on a specific mark in the electronic document data.

  Alternatively, the image feature existing in the feature image may be a reference mark indicating the reference position of the electronic document data.

  Normalization of the inclination may be performed before setting the reference position (claim 11). In this case, the inclination normalization may be performed based on the image feature existing in the feature image.

  Further, the reference mark indicating the reference position may be printed on the printed matter in advance before being read by the printed matter reading unit (101).

  In order to solve the above-described problem, according to the second aspect of the present invention, a printed matter in which tampering after printing is detected on a printed matter with a feature image obtained by superimposing a feature image on at least a print region (a portion that is not a blank region) of the printed matter. A verification device (200) is provided. The printed matter verification apparatus of the present invention includes a printed matter reading unit (201) that reads a printed matter with a feature image to generate a content image with a feature image, and a feature image extraction unit (202) that extracts a feature image from the content image with a feature image. , A feature data restoration unit (203) for restoring feature data from a feature image, a content image extraction unit (204) for extracting a content image from a content image with a feature image, and a feature data extraction unit for extracting feature data from the content image (205) and a tampering verification unit (206) for comparing the feature data restored by the feature data restoration unit and the feature data extracted by the feature data extraction unit to detect tampering with the printed matter. The printed matter with an image includes a reference mark indicating a reference position (claim 14).

  In order to solve the above-described problem, according to a third aspect of the present invention, a printed matter issuing device (600) that extracts feature data from a printed matter and a feature data storage that stores feature data from the printed matter issuing device via a network. There is provided a printed matter processing system including an apparatus (700) and a printed matter verification device (200) that receives feature data from a feature data storage device via a network and detects tampering after printing the printed matter. In the printed material processing apparatus of the present invention, the printed material verification apparatus includes a printed material reading unit (201) that reads a printed material to generate a content image, a feature data extraction unit (205) that extracts feature data from the content image, and a feature data extraction device. A tampering verification unit (206) that detects tampering with the printed matter by comparing the feature data extracted by the unit with the feature data received from the feature data storage device.

  According to such a system, feature data is stored in a feature data storage device via a network, and the configuration of the printed matter issuing device and the printed matter verification device is simplified by referring to the feature data during verification. Can do. Then, it is possible to obtain the same effect as that obtained by the printed matter issuing apparatus or printed matter verification apparatus of the present invention.

  In the printed matter processing system of the present invention, the following applications are possible.

  The printed matter issuing apparatus may further include a reference mark printing unit (112) for printing a reference mark indicating a reference position on the printed matter before the feature extraction by the feature data extraction unit (102). 15).

The reference position can be set as follows, for example (claim 16).
-Set based on the image characteristics existing in the printed matter.
・ Set based on ruled lines in printed material.
• Set based on specific marks in the printed material.
-Set based on image features existing in the feature image.

  The inclination may be normalized before the reference position is set (claim 17). In this case, the inclination normalization may be performed based on the image feature existing in the feature image.

  The printed matter issuing apparatus may perform processing using electronic document data. For example, the printed matter issuing apparatus can further include an electronic document printing unit (112) for printing a printed matter from electronic document data including a reference mark indicating a reference position. Alternatively, assuming the case of electronic document data that does not include a reference mark, the printed matter issuing apparatus includes a reference mark adding unit (140) that adds a reference mark indicating a reference position to the electronic document data, and an electronic document to which the reference mark is added. It is also possible to further comprise an electronic document printing unit (112) that prints a printed matter from the document data.

Even when processing using electronic document data is performed, the reference position can be set as follows, for example (claim 21).
-Set based on image characteristics existing in electronic document data.
・ Set based on ruled lines in electronic document data.
-Set based on a specific mark in the electronic document data.
-Set based on image features existing in the feature image.

  Normalization of the inclination may be performed before setting the reference position (claim 22). In this case, the inclination normalization may be performed based on the image feature existing in the feature image.

  Further, the reference mark indicating the reference position may be printed in advance on the printed matter before the feature data is extracted (claim 24).

  The printed matter may include reference information for referring to the feature data stored in the feature data storage device (claim 25).

  Furthermore, an issuer client terminal (1200) that supplies a printed matter to the print issuer and requests a predetermined process from the issuer, and an issuer service supply device (1300) that charges the issuer client terminal. ) And the like (claim 26). In this case, the printed matter may include information for performing transaction management between the issuing client terminal and the issuing service supply device (claim 27).

  Furthermore, a verification side client terminal (1400) that supplies a printed matter to the printed matter verification apparatus and requests a predetermined process from the printed matter verification apparatus, and a verification side service supply apparatus (1300) that charges the verification side client terminal ) And the like (claim 28). In this case, the printed matter may include information for performing transaction management between the verification-side client terminal and the verification-side service supply device (claim 29).

  According to another aspect of the present invention, there are provided a program for causing a computer to function as the printed matter issuing device or the printed matter verifying device, and a computer-readable recording medium on which the program is recorded. Here, the program may be described in any programming language. In addition, as a recording medium, for example, a recording medium that is currently used as a recording medium capable of recording a program, such as a CD-ROM, a DVD-ROM, or a flexible disk, or any recording medium that is used in the future should be adopted. Can do.

  In the above description, the reference numerals in parentheses attached to the constituent elements are merely shown as examples of corresponding constituent elements in the embodiments and drawings described below for easy understanding. It is not limited to.

  As described above, according to the present invention, in order to prevent the original print document from being deteriorated, the feature image is printed over the original print document. As a result, tampering verification can be performed in a state where there is no deterioration of the document image. Since information can be embedded even in a printed matter having almost no margin, feature information can be embedded regardless of the format of the printed matter. On the contrary, since the space for embedding the feature information is not required, the entire surface of the printed material can be effectively used as an original function of the printed material.

  Exemplary embodiments of a printed matter issuing apparatus, a printed matter verifying apparatus, and a printed matter processing system according to the present invention will be described below in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

(First embodiment)
FIG. 1 is a configuration diagram of the first embodiment.
As shown in FIG. 1, the printed material processing system according to the present embodiment is mainly configured by a printed material issuing device 100 and a printed material verification device 200. The printed matter issuing apparatus 100 is an apparatus that prints out and outputs a feature image obtained by imaging feature data necessary for falsification verification on an original printed matter. Hereinafter, the printed output is referred to as “printed product with characteristic image”. The printed matter verification apparatus 200 is a device for reading a printed matter with a feature image with a scanner device and detecting falsification.
Hereinafter, details of the printed matter issuing apparatus 100 and the printed matter verifying apparatus 200 will be described in order.

(Printed matter issuing device 100)
As shown in FIG. 1, the printed matter issuing apparatus 100 is a device that prints out a printed matter 2 with a feature image by superimposing a feature image obtained by imaging feature data necessary for tampering verification on the original printed matter 1. A printed product scanning unit 101, a feature data extracting unit 102, a feature image forming unit 103, and a printing unit 104 are provided.

  The printed material 1 is a document, figure, image, or the like printed on paper. A printed material scanning unit 101 (an example of a printed material reading unit of the present invention) is a functional unit that performs processing of reading the contents of paper such as documents, drawings, and images in the printed material 1 and converting them into images. Hereinafter, this image is referred to as a content image.

  The feature data extraction unit 102 extracts features and places such as documents, diagrams, and images from the content image. As a specific example of this feature extraction, for example, a general image feature extraction method such as vector information and frequency components can be used in addition to the method described in Patent Document 1.

The feature image forming unit 103 converts the feature data into a feature image that can be read by the scanner device on the verification side. As this feature image, for example, the following technique for embedding confidential information in a printed material can be used.
-JP 2003-209676 A "Method for Embedding and Detecting Confidential Information in Printed Document" (Oki Electric Industry Co., Ltd., Patent Document 2)
・ Japanese Patent Laid-Open No. 2003-264685 “Method for preventing falsification of printed matter” (Oki Electric Industry Co., Ltd., Patent Document 3)
・ Japanese Patent Laid-Open No. 2001-157022 (Toppan Printing Co., Ltd., Patent Document 4)
・ Japanese Patent Laid-Open No. 2002-64700 (Toppan Printing Co., Ltd., Patent Document 5)

  As an example, the technique disclosed in Patent Document 2 will be described. The watermark image forming unit disclosed in Patent Document 2 digitizes information to be embedded in a printed matter and converts it into a numerical value (N is a natural number of 2 or more. ), And assigns each symbol of the code word to a watermark signal prepared in advance. The watermark signal represents a wave having an arbitrary wavelength and direction by an arrangement of dots (black pixels), and a predetermined symbol can be identified by a predetermined filter. The function of the feature image forming unit 103 of the present embodiment can be realized by the watermark image forming unit disclosed in Patent Document 2. It should be noted that the watermark image forming unit disclosed in Patent Document 2 is merely an example for realizing the function of the feature image forming unit 103, and it goes without saying that other techniques may be employed.

  The printing unit 104 prints the characteristic image on the printed material 1 and outputs the printed material 2 with the characteristic image. An example of the print 2 with the feature image is shown in FIG. FIG. 2A shows an example in which an image having no transparency such as a two-dimensional barcode is embedded in the margin as a feature image, and FIG. 2B shows a transmission made up of dots as in Patent Document 2. This is an example of embedding a characteristic image as a feature image in the entire text. In the present embodiment, a case where the transparent image shown in FIG. 2B is embedded as a feature image will be described.

The configuration of the printed matter issuing apparatus 100 has been described above.
Next, the configuration of the printed matter verification apparatus 200 will be described.

(Printed matter verification apparatus 200)
As shown in FIG. 1, the printed matter verification apparatus 200 is a device that reads a featured image-attached printed matter with a scanner device, detects falsification, and outputs a falsification detection result 3. A unit 202, a feature data restoration unit 203, a content image extraction unit 204, a feature data extraction unit 205, and a falsification verification unit 206 are provided.

  A printed material scanning unit (an example of a printed material reading unit of the present invention) 201 is a functional unit that performs processing for reading a paper surface of the printed material 2 with a characteristic image and forming an image.

  The feature image extraction unit 202 is a functional unit that performs a process of extracting a feature image portion from a content image with a feature image.

  The feature data restoration unit 203 is a functional unit that performs a process of restoring feature data from a feature image. When the function of the feature image forming unit 103 is realized by the watermark image forming unit disclosed in Patent Document 2 on the printed matter issuing apparatus 100 side, the function of the feature data restoring unit 203 is also disclosed in Patent Document 2. It can be realized by a watermark detection unit. That is, the feature image formed by the feature image forming unit 103 is formed by a watermark signal expressing a wave having an arbitrary wavelength and direction by an arrangement of dots (black pixels). The watermark signal can identify a predetermined symbol by a predetermined filter. In this way, the feature data restoration unit 203 can perform a process of restoring the feature data from the feature image. It should be noted that the watermark detection unit disclosed in Patent Document 2 is merely an example for realizing the function of the feature data restoration unit 203, and it goes without saying that other techniques may be employed.

  The content image extraction unit 204 is a functional unit that performs processing for extracting only a part of a content image from a content image with a feature image.

  The feature data extraction unit 205 is a functional unit that performs a process of extracting feature data from the content image in the same manner as the feature data extraction unit 102 of the printed matter issuing apparatus 100.

  The falsification verification unit 206 is a functional unit that performs processing for comparing the original feature data restored from the feature image with the feature data of the printed material that has just been read, and detecting the presence / absence of falsification, the falsification location, and the like. The falsification verification result is output as falsification verification result 3.

  The printed matter processing system according to the present embodiment is configured as described above. Next, the operation of this embodiment will be described. FIG. 3 is an operation flow of the printed matter issuing apparatus 100. Hereinafter, an operation flow of the printed matter issuing apparatus 100 in FIG. 3 will be described.

<Printed matter scan (step S102)>
When the process is started, the printed material 1 is scanned and imaged in step S102 to output a content image.

<Feature Data Extraction (Step S103)>
In step S103, feature data is extracted from the content image. This feature data is a feature or location of a document, figure, image or the like. As features of a document, a figure, and an image, for example, known image feature extraction techniques such as vector information and frequency components (DCT, wavelet, etc.) are used. For the position, a reference position is defined on the content image, and the position is expressed by a relative position from the reference position.

  As an example of how to obtain the reference position, as shown in FIG. 4, a method of setting (x0, y0) where the accumulation of the edge components in the vertical direction and the horizontal direction first exceeds the threshold value as the reference position is used. There is. There may be a plurality of reference positions. For example, the position (x1, y1) where the accumulation of the edge components in the vertical direction and the horizontal direction in FIG. 4 finally exceeds the threshold may be used as the reference position.

  Further, when the reference position is determined by the method shown in FIG. 4, since the image may be inclined at the time of scanning, it is preferable to first perform the rotation correction on the content image and normalize the inclination. As a specific example of the rotation correction, the rotation angle at which the accumulation of the edge components in the vertical direction and the horizontal direction or the accumulation of the margin part is maximized may be obtained.

  Note that the feature data may be further encoded so that error detection and correction can be performed. For example, a parity check code, a Hamming code, or a BCH code is used as the coding method here. Also, a checksum that has no correction capability but can detect errors may be used.

  Further, in order to verify data consistency, a hash value (MD5, SHA-1, etc.), an electronic signature (SHA1 wlth RSA EncryptPtion, etc.), HMAC, etc. may be added.

<Feature Image Generation (Step S104)>
In step S104, a feature image is created from the feature data. For this feature image, a technique for printing a bar code or the secret information mentioned above can be used.

<Output of Printed Material (Step S105)>
Next, in step S105, the feature image is overlaid on the printed matter 1, and then the feature-added printed matter 2 is output and the process ends.

  The operation of the printed matter issuing apparatus 100 has been described above. Next, the operation of the printed matter verification apparatus 200 will be described. FIG. 5 is an operation flow of the printed matter verification apparatus 200. Hereinafter, an operation flow of the printed matter verification apparatus 200 of FIG. 5 will be described.

<Scan of Printed Material (Step S202)>
When the process is started, the feature image-attached printed material 2 is scanned and a feature image-attached content image is output in step S202. Here, it is possible to normalize the inclination by performing rotation correction on the content image. The inclination normalization method is the same as the processing in step S102 in the printed matter issuing apparatus 100.

<Feature Image Extraction (Step S203)>
In step S203, a feature image is extracted from the content image with the feature image.

<Characteristic data restoration (step S204)>
In step S204, feature data is restored from the feature image.
If the error cannot be corrected by detecting the error of the feature data and decoding the correction code, or if the data is not consistent with the hash value, electronic signature, HMAC, etc., the feature data cannot be restored in step S205. As a result, the process proceeds to step S210, and a message indicating falsification verification failure is output and the process ends. On the other hand, if the feature data is successfully restored in step S205, the process proceeds to step S206.

<Extraction of Content Image (Step S206)>
In step S206, a content image obtained by removing the feature image from the content image with the feature image is extracted.

<Feature Data Extraction (Step S207)>
In step S207, content images and feature data are extracted. In this feature data extraction process, as in step S102 in the printed matter issuing apparatus 100, the position of each feature is represented by a relative position from a reference position on the content image.

<Falsification verification (step S208)>
In step S208, tampering verification is performed by comparing the feature data restored from the feature image with the feature data extracted from the content image. If there is a difference, the location or the like is obtained, and a message indicating that the falsification has occurred is output. If there is no difference, a message indicating no falsification is output (step S209), and the process is terminated.

  Note that the paper may be placed upside down or rotated 90 degrees during the reading process in step S202. Therefore, in step S207, the feature data when the content image with feature image is rotated 90 degrees or 180 degrees may be obtained and the comparison in step S208 may be performed. Similarly, in step S204, feature data restored from an image when the feature image is rotated 90 degrees or 180 degrees may be used.

The operation of this embodiment has been described above.
In the present embodiment, the case where there are ruled lines in the document has been described as an example. In addition, as shown in FIG. 6, it is known in advance that there are specific marks ((a) when there are specific marks at the four corners or (b) when there is a logo mark for the issue period) on the printed matter. In this case, a position where the mark is detected by pattern matching or feature extraction such as edge or frequency may be set as the reference position.

  In addition, when the printed material scanning unit 101 can always scan the same position with high accuracy and the printing unit 104 can always print with high accuracy at the same position during overprinting, the feature image itself may be used as the reference position. In that case, the printed product verification apparatus 200 side extracts the edge portion of the feature image itself ((c) barcode or (d) watermark image), for example, as shown in FIG. The positional relationship may be obtained. Further, an internal portion of the feature image may be used (a specific example is described in Patent Document 3). Such a method is effective when the printed material does not have a feature serving as a reference position.

(Effects of the first embodiment)
As described above, according to the present embodiment, there are the following effects.
(1-1) In the falsification detection in which feature data is added to the printed matter, the original image is not deteriorated, so that the falsification detection accuracy is high.
(1-2) In overprinting, another image is overlaid on the original printed matter, but when the feature image cannot always be overlaid and printed with high accuracy, the positional relationship between the images cannot be grasped by the verification side. There is. In this embodiment, since the reference position is determined from the ruled lines or marks originally in the printed material, the verification side can grasp the correct positional relationship of the images by detecting the reference position by the same method.
(1-3) When the reading position of the scanner is always the same, and when printing can be performed at the same position with high accuracy at the time of overlap printing, the feature image itself is set as the reference position, and the printed matter does not have the feature serving as the reference position. Is effective.
(1-4) Since it can be applied to documents that are not left as electronic data, it can also be applied to services such as falsification detection of old important documents.

(Second Embodiment)
In the second embodiment, a method effective when there is no ruled line or mark that can set the reference position in the original printed matter will be described. A feature is that a mark (reference mark) for which a reference position can be set is first printed on the original printed matter.

  FIG. 7 is a configuration diagram of the second embodiment. Since the printed matter verification apparatus is substantially the same as that of the first embodiment, a duplicate description is omitted.

  In the printed matter issuing apparatus 300, the difference from the first embodiment is that the reference mark is first printed on the printed matter 1 (the reference mark creating unit 111 and the printing unit 112), and the printed matter 4 with the reference mark is overprinted. It is that the processing to do is added. As shown in FIG. 8, this printed matter 4 with reference marks is printed with (a) four corners and (b) specific marks (reference marks) superimposed on the outer periphery of the document.

  Hereinafter, only the difference of the first embodiment from the configuration of the second embodiment will be described.

  The reference mark creation unit 111 performs a process of creating a reference mark as shown in FIG. Then, the printing unit 112 prints the reference mark on the original printed matter 1 in FIG. 9B, and outputs the printed matter 4 with the reference mark in FIG. 9C. Thereafter, the same processing as in the first embodiment is performed on the printed matter 4 with reference marks.

The present embodiment is configured as described above.
FIG. 10 is an operation flow of the printed matter issuing apparatus 300 according to the second embodiment.
The difference from the first embodiment is that a process (step S110) in which a fiducial mark is overprinted first is added. This step S110 is as described above with reference to FIGS.

As described above, according to the present embodiment, there are the following effects in addition to the first embodiment.
(2-1) Even when there is no ruled line or mark for determining the reference position in advance on the printed matter, it is possible to obtain falsification detection accuracy equivalent to that of the first embodiment.

(Third embodiment)
In the first embodiment, the printed matter issuing apparatus 100 receives the printed matter 1 as an input. In the third embodiment, the printed matter issuing apparatus creates equivalent printed matter-added printed matter from electronic document data before printing.

  FIG. 11 is a configuration diagram of the third embodiment. Since the printed matter verification apparatus is substantially the same as that of the first embodiment, a duplicate description is omitted. However, it is assumed that the electronic document data that can be handled by the printed matter verification apparatus includes ruled lines, marks, and the like that are reference positions from the beginning.

  In the printed matter issuing apparatus 400 according to the present embodiment, the electronic document data 5 is an electronic file such as a word processor or a spreadsheet, an image file, or the like. Then, the printed matter 112 performs processing for printing the contents of the electronic document data 5 on blank paper on which nothing is printed, and outputs the printed matter 1. Other points are substantially the same as those in the first embodiment.

The present embodiment is configured as described above.
FIG. 10 is an operation flow of the printed matter issuing apparatus 400 according to the third embodiment.
The difference from the first embodiment is that the electronic document data 5 is first printed in step S120.

  In the present embodiment, the description has been made on the assumption that the electronic document data 5 includes a ruled line or a mark as a reference position from the beginning. Even if the electronic document data 5 does not include such ruled lines and marks as reference positions, the same configuration and operation as in the third embodiment can be used as long as the first blank sheet 6 includes ruled lines and marks. The same effect can be obtained.

  Similarly to the first embodiment, when the printed product scanning unit 101 can always scan the same position with high accuracy and the printing unit 104 can always print with high accuracy at the same time during overprinting, the feature image itself is displayed. It may be a reference position.

(Effect of the third embodiment)
As for the feature data extraction for the electronic document, the feature data can be extracted more accurately by extracting the feature data from the actually printed matter. This is because there are uncertain factors such as ink blot of the printer, ink fading, and printing distortion. By performing falsification detection on an electronic document as in this embodiment, falsification detection with higher accuracy can be performed. In addition, the shape of the print font of the printer may differ depending on the printer. Therefore, it is possible to detect falsification with higher accuracy by extracting the feature data from the actual printed matter than extracting the feature data from the electronic document. be able to.

This embodiment is effective when the document originally includes a ruled line or a mark serving as a reference position. Even when there is no ruled line or mark, the same effect can be obtained by performing the following.
-When the first blank sheet 6 includes ruled lines and marks from the beginning.
In addition, when the printed product scanning unit 101 can always scan the same position with high accuracy and the printing unit 104 can always print with high accuracy at the same position during overprinting, the feature image itself can be used as the reference position.

(Fourth embodiment)
In the third embodiment, it was assumed that the document originally includes a ruled line or a mark serving as a reference position. The fourth embodiment is an embodiment that copes with the same method as the first reference mark in the second embodiment. Thus, this embodiment is an embodiment in which the second embodiment is combined with the third embodiment as a base.

  FIG. 13 is a configuration diagram of the fourth embodiment. Since the printed matter verification apparatus is substantially the same as that of the first embodiment, a duplicate description is omitted.

  The difference from the third embodiment is that a reference mark adding unit 140 for adding a reference mark to the input electronic document data 5 is added. The reference mark adding unit 140 adds a reference mark similar to that in FIG. 8 to the electronic document data 5. The subsequent steps are the same as in the first embodiment.

The present embodiment is configured as described above.
FIG. 14 is an operation flow of the printed matter issuing apparatus 500 according to the fourth embodiment.
The difference from the third embodiment is that a process for adding a reference mark to electronic document data (step S130) is added.

(Effect of the fourth embodiment)
As described above, according to the present embodiment, there are the following effects in addition to the third embodiment.
(4-1) Even when there is no ruled line or mark for determining the reference position in advance in the electronic document data, the same falsification detection accuracy as in the third embodiment can be obtained.

(Fifth embodiment)
In the first embodiment, feature data is stored in a feature image and printed on a printed matter. In the fifth embodiment, feature data is stored in a server or the like, and this feature data is referred to at the time of verification. The performance of falsification detection is the same as that of the first embodiment. In addition, the configuration of each device is simple compared to the first embodiment.

FIG. 15 is a configuration diagram of the fifth embodiment.
As shown in FIG. 15, the present embodiment is mainly configured by a printed matter issuing device 600, a feature data storage device 700, and a printed matter verifying device 800. Hereinafter, details of the printed matter issuing device 600, the feature data storage device 700, and the printed matter verification device 800 will be described in order.

(Printed matter issuing device 600)
As shown in FIG. 15, the printed matter issuing apparatus 600 according to the present embodiment has a configuration in which the functional parts of the feature image forming unit 103 and the printing unit 104 are removed from the printed matter issuing apparatus 100 in the first embodiment. It has become. The feature data (including the reference position) extracted by the feature data extraction unit 102 is stored in the feature data storage device 700.

(Feature data storage device 700)
The feature data storage device 700 is a device that stores the feature data of the printed matter 1. It can be accessed from the printed material issuing device 600 and the printed material verification device 800 through a network or the like.

(Printed matter verification apparatus 800)
The printed matter verification apparatus 800 according to the present embodiment has the feature image extraction unit 202, the feature data restoration unit 203, and the processing unit of the content image extraction unit 204 removed from the printed matter verification apparatus 200 in the first embodiment. It has a configuration. The verification unit 206 performs verification using the feature data stored in the feature data storage device 700.

  The present embodiment is configured as described above. Next, the operation of this embodiment will be described. First, the operation of the printed matter issuing apparatus 600 will be described. FIG. 16 is an operation flow of the printed matter issuing apparatus 600.

  In FIG. 16, the process up to the feature data extraction in step S103 is the same as in the first embodiment. When the process of step S103 is finished, the feature data is transmitted to the feature data storage device 700 in step S600, and the process is finished. In order to associate the printed matter 1 with the feature data stored in the feature data storage device 700, for example, the file name of the feature data may be printed in the margin of the printed matter 1 using characters, barcodes, or the like.

  Next, the operation of the printed matter verification apparatus 800 will be described. FIG. 17 is an operation flow of the printed matter verification apparatus 800.

  In FIG. 17, when the printed material scanning process in step S202 is completed, the feature data extraction process in step S207 is performed. Steps S202 and S207 are the same as those in the first embodiment.

  Finally, in step S800, tampering verification is performed by comparing the feature data stored in the feature data storage device 700 with the feature data extracted from the content image. In the process of acquiring the feature data stored in the feature data storage device 700, when the file name is printed with a barcode, the printed matter verification device 800 automatically reads the feature data and reads the corresponding feature data. Obtain from 700. Alternatively, when the user knows the file name, the user may input the file name to the printed matter verification apparatus 800. If there is a difference, a message indicating that the location has been altered is output, and if there is no difference, a message indicating no alteration is output (step S209), and the processing is terminated.

(Effect of 5th Embodiment)
As described above, according to the present embodiment, there is an effect equivalent to that of the first embodiment in tampering detection. Furthermore, compared to the first embodiment, the system configuration is simplified by the absence of the following processing.
-The issuer does not need to generate and print feature images.
-The verification side does not need to extract feature images and restore them to feature data.

(Sixth embodiment)
The fifth embodiment is effective when the printed matter 1 has a ruled line or a mark serving as a reference position. Similar to the second embodiment, the sixth embodiment is characterized in that the reference mark is first printed on the printed matter. Thus, the present embodiment is an embodiment in which the second embodiment is combined with the fifth embodiment as a base.

  FIG. 18 is a configuration diagram of the sixth embodiment. Since the printed matter verification apparatus is substantially the same as that of the fifth embodiment, redundant description is omitted.

  In the printed matter issuing apparatus 900, the part different from the fifth embodiment is that the reference mark is first printed on the printed matter 1 (the reference mark creating unit 111 and the printing unit 112), and the printed matter 4 with the reference mark is overprinted. It is that the processing to do is added. This is the same as the difference between the first embodiment and the second embodiment.

The present embodiment is configured as described above.
FIG. 19 is an operation flow of the printed matter issuing apparatus 900 according to the sixth embodiment.
The difference from the fifth embodiment is that a process (step S110) in which a fiducial mark is overprinted first is added. This step S110 is as described above with reference to FIGS.

(Effect of 6th Embodiment)
As described above, according to the present embodiment, the same effect as that of the fifth embodiment can be obtained when there is no ruled line or mark serving as a reference position on the printed matter.

(Seventh embodiment)
In the fifth embodiment, the printed matter issuing apparatus uses a printed matter as an input. The seventh embodiment is characterized in that electronic document data is input. As described above, the present embodiment is an embodiment in which the third embodiment is combined with the fifth embodiment as a base.

  FIG. 20 is a configuration diagram of the seventh embodiment. Since the printed matter verification apparatus is substantially the same as that of the fifth embodiment, redundant description is omitted. It is assumed that the electronic document data that can be handled by the printed matter verification apparatus includes ruled lines, marks, and the like that are reference positions from the beginning.

  The electronic document data 5 is an electronic file such as a word processor or a spreadsheet, an image file, or the like. The printed matter 112 performs processing for printing the contents of the electronic document data 5 on the blank paper 6 on which nothing is printed, and outputs the printed matter 1. Others are the same as the fifth embodiment.

The present embodiment is configured as described above.
FIG. 21 is an operation flow of the printed matter issuing apparatus 400 according to the seventh embodiment.
The difference from the seventh embodiment is that the electronic document data 5 is first printed in step S120.

(Effect of 7th Embodiment)
As described above, according to the present embodiment, with respect to problems (such as ink bleeding or distortion during printing with a printer) when printing from the electronic document described in the third embodiment, the fifth embodiment. The same effect can be obtained.

(Eighth embodiment)
In the seventh embodiment, it is assumed that the document originally includes a ruled line or a mark serving as a reference position. The eighth embodiment is an embodiment that copes with the same method as the first reference mark attached in the second embodiment. Thus, the present embodiment is an embodiment in which the fourth embodiment is combined with the fifth embodiment as a base.

  FIG. 22 is a configuration diagram of the fourth embodiment. Since the printed matter verification apparatus is substantially the same as that of the fifth embodiment, redundant description is omitted.

  The difference from the seventh embodiment is that a reference mark adding unit 140 for adding a reference mark to the input electronic document data 5 is added. This is the same as the difference between the third embodiment and the fourth embodiment.

The present embodiment is configured as described above.
FIG. 23 is an operation flow of the printed matter issuing apparatus 1100 according to the eighth embodiment.
The difference from the seventh embodiment is that a process of adding a reference mark to electronic document data (step S130) is first added.

(Effect of 8th Embodiment)
As described above, according to the present embodiment, there are the following effects in addition to the seventh embodiment.
(8-1) Even when there is no ruled line or mark for determining the reference position in advance in the electronic document data, the same falsification detection accuracy as in the seventh embodiment can be obtained.

(Ninth embodiment)
The ninth embodiment is based on the fourth embodiment in the form of a service provided by an ASP (Application Service Provider). By processing important processing such as feature data extraction and feature image creation on the service provider side, there are the following merits.
(1) System maintenance management can be unified.
(2) Technology elements can be prevented from leaking (it is not preferable that technology necessary for falsification verification is leaked)
(3) It is possible to develop a bill collection business using the flat rate system or pay-as-you-go system.

  FIG. 24 is a connection configuration diagram of a system according to the ninth embodiment.

(Issuing client terminal 1200)
The issuer client terminal 1200 (only two issuer client terminals 1200-1 and 1200-2 are shown in FIG. 24) is a terminal that prints the printed matter 2 with the characteristic image for the electronic document data 5. The difference from the printed matter issuing apparatus 500 of the fourth embodiment is that no reference mark creation, feature data extraction / feature image is performed.

(Issuing side service supply device 1300)
The issuer service supply device 1300 performs processing such as creation of reference marks, feature data extraction, and feature image creation for the electronic document data 5 requested from the issuer client terminal 1200. It is a device that collects (bills) from.

  The issuer client terminal 1200 and the issuer service supply device 1300 are connected by a communication network such as the Internet.

(Verification-side client terminal 1400)
The verification-side client terminal 1400 (only two verification-side client terminals 1200-1 and 1200-2 are shown in FIG. 24) is a terminal for verifying the printed matter 2 with feature images. The difference from the printed matter verification apparatus 200 of the first to fourth embodiments is that the feature data is not restored or extracted from the feature image.

(Verification side service supply device 1500)
The verification-side service supply device 1500 is a device that verifies the verification of the print 2 with the feature image requested from the verification-side client terminal 1400, and collects (charges) a fee from the user when these processes are completed.

  The verification-side client terminal 1400 and the verification-side service supply device 1500 are connected by a communication network such as the Internet.

  The present embodiment is configured as described above. Next, the operation of this embodiment will be described. First, the operation of the issuing side (issuing side client terminal 1200 and issuing side service supply apparatus 1300) will be described. FIG. 25 is an operation flow on the issue side in the ninth embodiment.

  First, in step S1201 and step S1301, authentication of a user who uses the issuing client terminal 1200 is performed. As this user authentication, it is possible to use a known technique such as authentication using a user ID and a password.

  Next, in step S1202 and step S1302, encryption communication is established between the issuing client terminal 1200 and the issuing service providing apparatus 1300. As this encryption communication, SSL (Secure Sockets Layer), IPSec, or the like, which is a known technique, can be used. Note that this encrypted communication may not be established in the case of a network in which information leakage is not considered in communication.

  In step S1203, the issuing client terminal 1200 transmits the electronic document data 5. In step S1303, the issuing service supply apparatus 1300 receives the electronic document data 5.

  In step S1304, the issuing service supply apparatus 1300 creates a reference mark and an identification image. The reference mark is a mark for setting a reference position on the printed matter as described in the second and fourth embodiments. The identification image is used to identify an image when a printed image is exchanged between the client side and the service supply side. For example, it may be created with a two-dimensional barcode. Information for managing a printed matter such as a serial number is embedded in the identification image. If management of printed matter is not required, the identification image may be omitted.

  In step S1305, the issuing service supply apparatus 1300 inserts the reference mark and the identification image into the electronic document data received from the issuing client terminal 1200. It is desirable to embed the reference mark and the identification image in the margin of the electronic document data.

  In step S <b> 1306, the issuing service supply apparatus 1300 transmits electronic document data with a reference mark and an identification image to the issuing client terminal 1200. In step S1204, the issuing client terminal 1200 receives the electronic document data with the reference mark.

  In step S1205, the issuing client terminal 1200 prints the received electronic document data with the reference mark and the identification image and outputs the printed material 1 with the reference mark.

  Next, in step S1206, the issuing client terminal 1200 reads the printed matter 1 with the reference mark that has been printed by the scanner device or the like.

  In step S <b> 1207, the issuing client terminal 1200 transmits the read image of the reference mark printed matter 1 to the issuing service providing apparatus 1300. In step S1307, the issuer service supply apparatus 1300 receives the printed material read image with the reference mark.

  In step S1308, the issuing service supply apparatus 1300 authenticates that the identification image issued by itself is attached from the identification image in the received printed image with the reference mark.

  In step S1309, the issuing service supply apparatus 1300 extracts the feature data (and the reference position) of the received printed image with the reference mark.

  In step S1310, the issuing service supply apparatus 1300 creates a feature image from the feature data. This processing is as described in the first embodiment.

  In step S <b> 1311, the issue side service supply apparatus 1300 transmits the created feature image to the issue side client terminal 1200. In step S1208, the issuing client terminal 1200 receives this feature image.

  In step S1209, the issuing client terminal 1200 prints the feature image on the reference mark-attached printed matter 1 and outputs the feature image-attached printed matter 2.

  In step S1312, the issuing side service supply apparatus 1300 charges a fee for the service so far. Billing is collected from the account or credit specified by the user (no need for flat rate or no billing).

  Finally, the encryption communication is canceled in steps S1210 and S1313, and the process is terminated.

  The operation of the issuing side (issuing side client terminal 1200 and issuing side service supply apparatus 1300) has been described above. Next, operations of the verification side (verification side client terminal 1400 and verification side service supply apparatus 1500) will be described. FIG. 26 is an operation flow on the verification side in the ninth embodiment.

  First, in step S1401 and step S1501, the user who uses the verification-side client terminal 1400 is authenticated. As this user authentication, it is possible to use a known technique such as authentication using a user ID and a password.

  Next, in steps S1402 and S1502, encryption communication is established between the verification-side client terminal 1400 and the verification-side service supply device 1500. As this encryption communication, SSL (Secure Sockets Layer), IPSec, or the like, which is a known technique, can be used. Note that this encrypted communication may not be established in the case of a network in which information leakage is not considered in communication.

  Next, in step S1403, the verification-side client terminal 1400 reads the featured print 2 with the scanner device.

  In step S <b> 1404, the verification-side client terminal 1400 transmits the read featured image-added printed material image (feature image-added printed material read image) to the verification-side service supply device 1500. In step S1503, the verification-side service supply apparatus 1500 receives the print image with the feature image read image.

  In step S1504, the verification-side service supply apparatus 1500 reads the management number attached to the printed material from the authentication image in the printed image with the feature image. The read management number is used to determine the fee for charging. This is used to identify the service expiration date. If the authentication image information is not used, step S1504 may not be performed.

  In step S1505, the verification-side service supply apparatus 1500 performs falsification verification on the print image with the feature image. The processing related to the tampering verification may be performed as shown in the first embodiment.

  In step S1506, the verification-side service supply apparatus 1500 transmits a falsification verification result. In step S1405, the verification client terminal 1400 receives the falsification verification result.

  In step S1507, the verification-side service supply apparatus 1300 charges a fee for the service so far.

  Finally, the encryption communication is canceled in steps S1406 and S1508, and the process is terminated.

  In this embodiment, an example of a falsification verification service for electronic document data has been described. In addition, the falsification verification for the printed matter described in the first and second embodiments can be similarly serviced. Further, as shown in the fourth to eighth embodiments, the service can be performed in the same manner when the feature data of the printed matter and the electronic document data is stored in another device. As these realization methods, as in the ninth embodiment, the client side may leave processing related to printing and reading of printed matter, and the service supply side may perform feature data extraction and falsification verification processing.

(Effect of 9th Embodiment)
As described above, according to the present embodiment, providing the service through a network for a part of the processing with respect to the first to eighth embodiments has the following effects.
(9-1) System maintenance management can be unified.
(9-2) Although it is not preferable that the technology required for falsification verification leaks, this embodiment can prevent the leakage of technical elements.
(9-3) It is possible to develop a bill collection business based on a flat rate system or a pay-as-you-go system.
(9-4) Transaction management can be performed by attaching an identification image to the exchange of print data between the client and the server.

  The preferred embodiments of the printed matter issuing apparatus, the printed matter verifying apparatus, and the printed matter processing system according to the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to such examples. It will be obvious to those skilled in the art that various changes or modifications can be conceived within the scope of the technical idea described in the claims, and these are naturally within the technical scope of the present invention. It is understood that it belongs.

For example, the following usage forms are possible.
1. The present invention can be applied to printed materials other than paper (for example, organic compounds such as metal, cloth, and plastic).
2. In the present invention, the printed material may be read as long as the printed content can be read by a camera or the like in addition to the scanner device.
3. The present invention can be applied to services that can be performed by storing feature data of print contents in a printed matter in addition to tamper detection. For example, the present invention can be applied to a technique for automatically arranging the answers to questionnaire sheets based on the feature data using arrangement information and entry rules of check box fields and free description fields of questionnaire sheets.
4). In the first to eighth embodiments, the range for extracting the feature data may be an arbitrary portion in addition to the entire paper surface. One or a plurality of arbitrary portions may be provided.
5. In the first to fourth embodiments, the feature images are printed on the same paper surface, but the feature images may be printed on the back side of the paper surface or another paper surface.
6). In the fifth to eighth embodiments, the device for storing the feature data is set to the outside by the feature, but a storage device provided inside the device may be used.
7). Although all the feature data is stored in the feature image in the first to fourth embodiments, a part may be stored outside as in the fifth to eighth embodiments.

  INDUSTRIAL APPLICABILITY The present invention can be used for a printed matter issuing device, a printed matter verifying device, and a printed matter processing system for processing a printed matter, and in particular, a printed matter issuing device for embedding information related to an original document, and a printed matter verifying device for detecting falsification of a printed document. , And a printed material processing system including these as system components.

It is explanatory drawing which shows the structure of 1st Embodiment. It is explanatory drawing which shows the example of printed matter with a feature image. It is a flowchart which shows operation | movement of the printed matter issuing apparatus 100 in 1st Embodiment. It is explanatory drawing regarding the setting method of the reference | standard position of a content image. It is a flowchart which shows operation | movement of the printed matter verification apparatus 200 in 1st Embodiment. It is explanatory drawing which shows the example of other reference positions. It is explanatory drawing which shows the structure of 2nd Embodiment. It is explanatory drawing which shows the example of printed matter with a reference mark. It is explanatory drawing which shows the additional overlay printing of a reference mark. It is a flowchart which shows operation | movement of the printed matter issuing apparatus 300 in 2nd Embodiment. It is explanatory drawing which shows the structure of 3rd Embodiment. It is a flowchart which shows operation | movement of the printed matter issuing apparatus 400 in 3rd Embodiment. It is explanatory drawing which shows the structure of 4th Embodiment. It is a flowchart which shows operation | movement of the printed matter issuing apparatus 500 in 4th Embodiment. It is explanatory drawing which shows the structure of 5th Embodiment. It is a flowchart which shows operation | movement of the printed matter issuing apparatus 600 in 5th Embodiment. It is a flowchart which shows operation | movement of the printed matter verification apparatus 800 in 5th Embodiment. It is explanatory drawing which shows the structure of 6th Embodiment. It is a flowchart which shows operation | movement of the printed matter issuing apparatus 900 in 6th Embodiment. It is explanatory drawing which shows the structure of 7th Embodiment. It is a flowchart which shows operation | movement of the printed matter verification apparatus 1000 in 7th Embodiment. It is explanatory drawing which shows the structure of 8th Embodiment. It is a flowchart which shows operation | movement of the printed matter verification apparatus 1100 in 8th Embodiment. It is explanatory drawing which shows the connection form in 9th Embodiment. It is a flowchart which shows the issue side operation | movement of 9th Embodiment. It is a flowchart which shows the verification side operation | movement of 9th Embodiment. It is explanatory drawing which shows the conventional document issuing apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Printed matter 2 Printed matter with characteristic image 3 Tampering verification result 4 Printed matter with reference mark 5 Electronic document data 6 Blank paper 100 Printed matter issuing apparatus 101 Printed matter scanning part 102 Feature data extracting part 103 Feature image forming part 104 Printing part 111 Reference mark creating part 112 Printing Unit 200 printed material verification apparatus 201 printed material scanning unit 202 feature image extraction unit 203 feature data restoration unit 204 content image extraction unit 205 feature data extraction unit 206 falsification verification unit

Claims (29)

A printed matter issuing device for printing a printed matter with a feature image in which a feature image including feature data extracted from a printed matter is embedded in the printed matter,
A printed material reading unit that reads the printed material and generates a content image;
A feature data extraction unit for extracting feature data from the content image;
A feature image forming unit capable of restoring the feature data and forming a transparent feature image;
A printing unit that prints a printed matter with a feature image obtained by superimposing the feature image on at least a print region of the printed matter;
A printed matter issuing device characterized by comprising:   The printed matter issuing apparatus according to claim 1, further comprising a reference mark printing unit that prints a reference mark indicating a reference position on the printed matter before the feature extraction by the feature data extraction unit. The reference position is
The image data is set based on any of image characteristics existing in the printed material, ruled lines in the printed material, specific marks in the printed material, or image characteristics existing in the characteristic image. The printed matter issuing apparatus according to 2.   The printed matter issuing apparatus according to claim 2, wherein inclination normalization is performed before setting the reference position.   The printed matter issuing apparatus according to claim 4, wherein the normalization of the inclination is performed based on an image feature existing in the feature image.   The printed matter issuing apparatus according to claim 1, further comprising an electronic document printing unit that prints the printed matter from electronic document data.   The printed matter issuing apparatus according to claim 6, wherein the electronic document data includes a reference mark indicating a reference position. A reference mark adding unit for adding a reference mark indicating a reference position to the electronic document data;
An electronic document printing unit for printing the printed matter from the electronic document data to which the reference mark is added;
The printed matter issuing apparatus according to claim 1, further comprising: The reference position is
9. The method according to claim 7, wherein the electronic document data is set based on any of image characteristics existing in the electronic document data, ruled lines in the electronic document data, or specific marks in the electronic document data. The printed matter issuing device described.   The printed matter issuing apparatus according to claim 6, wherein the image feature existing in the feature image is a reference mark indicating a reference position of the electronic document data.   The printed matter issuing apparatus according to claim 7, wherein inclination normalization is performed before the reference position is set.   The printed matter issuing apparatus according to claim 11, wherein the normalization of the inclination is performed based on an image feature existing in the feature image.   The printed matter issuing apparatus according to claim 1, wherein a reference mark indicating the reference position is printed in advance on the printed matter before being read by the printed matter reading unit. A printed matter verification apparatus for detecting tampering after printing on a printed matter with a feature image obtained by superimposing a feature image on at least a print area of the printed matter,
A printed matter reading unit that reads a printed matter with a feature image and generates a content image with a feature image;
A feature image extraction unit for extracting a feature image from the content image with the feature image;
A feature data restoration unit for restoring feature data from the feature image;
A content image extraction unit for extracting a content image from the content image with the feature image;
A feature data extraction unit for extracting feature data from the content image;
Comparing the feature data restored by the feature data restoration unit with the feature data extracted by the feature data extraction unit, and detecting a falsification to the printed matter;
Including
The printed matter verification apparatus, wherein the printed matter with the feature image includes a reference mark indicating a reference position. A printed matter issuing device for extracting feature data from a printed matter, a feature data storage device for storing the feature data from the printed matter issuing device via a network, and receiving the feature data from the feature data storage device via a network A printed matter processing system including a printed matter verification device for detecting tampering after printing on the printed matter,
The printed matter verification apparatus includes:
A printed material reading unit that reads the printed material to generate a content image;
A feature data extraction unit for extracting feature data from the content image;
Comparing the feature data extracted by the feature data extraction unit with the feature data received from the feature data storage device, and detecting a falsification to the printed matter;
Including
The printed matter issuing device
The printed matter processing system further comprising a reference mark printing unit that prints a reference mark indicating a reference position on the printed matter before the feature extraction by the feature data extracting unit. The reference position is
The image data is set based on any of image characteristics existing in the printed material, ruled lines in the printed material, specific marks in the printed material, or image characteristics existing in the characteristic image. The printed matter processing system according to 15.   The print processing system according to claim 15 or 16, wherein normalization of inclination is performed before setting of the reference position.   18. The printed matter processing system according to claim 17, wherein the inclination is normalized based on an image feature existing in the feature image. A printed matter issuing device for extracting feature data from a printed matter, a feature data storage device for storing the feature data from the printed matter issuing device via a network, and receiving the feature data from the feature data storage device via a network A printed matter processing system including a printed matter verification device for detecting tampering after printing on the printed matter,
The printed matter verification apparatus includes:
A printed material reading unit that reads the printed material to generate a content image;
A feature data extraction unit for extracting feature data from the content image;
Comparing the feature data extracted by the feature data extraction unit with the feature data received from the feature data storage device, and detecting a falsification to the printed matter;
Including
The printed matter issuing device
A printed matter processing system, further comprising an electronic document printing unit that prints the printed matter from electronic document data including a reference mark indicating a reference position. A printed matter issuing device for extracting feature data from a printed matter, a feature data storage device for storing the feature data from the printed matter issuing device via a network, and receiving the feature data from the feature data storage device via a network A printed matter processing system including a printed matter verification device for detecting tampering after printing on the printed matter,
The printed matter verification apparatus includes:
A printed material reading unit that reads the printed material to generate a content image;
A feature data extraction unit for extracting feature data from the content image;
Comparing the feature data extracted by the feature data extraction unit with the feature data received from the feature data storage device, and detecting a falsification to the printed matter;
Including
The printed matter issuing device
A reference mark adding unit for adding a reference mark indicating a reference position to the electronic document data;
An electronic document printing unit for printing the printed matter from the electronic document data to which the reference mark is added;
A printed matter processing system, further comprising: The reference position is
It is set based on any one of image characteristics existing in the electronic document data, ruled lines in the electronic document data, specific marks in the electronic document data, or image characteristics existing in the feature image. 21. The printed material processing system according to claim 19, wherein the printed material processing system is characterized in that:   The printed matter processing system according to claim 19, wherein inclination normalization is performed before the reference position is set.   23. The printed matter processing system according to claim 22, wherein the inclination is normalized based on an image feature existing in the feature image. A printed matter issuing device for extracting feature data from a printed matter, a feature data storage device for storing the feature data from the printed matter issuing device via a network, and receiving the feature data from the feature data storage device via a network A printed matter processing system including a printed matter verification device for detecting tampering after printing on the printed matter,
The printed matter verification apparatus includes:
A printed material reading unit that reads the printed material to generate a content image;
A feature data extraction unit for extracting feature data from the content image;
Comparing the feature data extracted by the feature data extraction unit with the feature data received from the feature data storage device, and detecting a falsification to the printed matter;
Including
The printed matter processing system, wherein a reference mark indicating a reference position is printed in advance on the printed matter before extracting the feature data.   The printed matter processing system according to any one of claims 15 to 24, wherein the printed matter includes reference information for referring to feature data stored in the feature data storage device. An issuer client terminal that supplies the printed matter to the printed matter issuing device and requests the printed matter issuing device to perform a predetermined process;
An issuer service supply device for charging the issuer client terminal;
The printed material processing system according to claim 15, further comprising:   27. The printed matter processing system according to claim 26, wherein the printed matter includes information for performing transaction management between the issuing client terminal and the issuing service supply device. A verification-side client terminal that supplies the printed matter to the printed matter verification apparatus and requests the printed matter verification apparatus to perform a predetermined process;
A verification-side service supply device that charges the verification-side client terminal;
The printed matter processing system according to claim 15, further comprising:   29. The printed material processing system according to claim 28, wherein the printed material includes information for performing transaction management between the verification-side client terminal and the verification-side service supply device.

Images