JP2020028102A - Reading apparatus, image forming apparatus, authenticity determination system, and reading method - Google Patents

Abstract

To allow a user to determine the validity of a determination result of authenticity determination to improve the accuracy in authenticity determination.SOLUTION: A reading apparatus receives, with an image pick-up device, light from a subject irradiated by a light source with light and reads the light from the subject, and comprises: control means that controls a second reading operation to read the subject through an invisible image; correction means that performs correction on the invisible image; and notification means that notifies the outside of at least the invisible image after the correction.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a reading device, an image forming device, an authentication system, and a reading method.

  Conventionally, security awareness of documents such as security of originality of documents and judgment of authenticity has increased, and invisible invisible information is embedded in documents, and invisible information is read with invisible light such as infrared light to secure originality. 2. Description of the Related Art An invisible reading technique for determining authenticity and preventing forgery is known.

  Patent Literature 1 discloses a technique of performing invisible reading with a scanner (reading device) such as a copying machine and displaying / printing the result.

  However, although the conventional reading device can read an invisible image (NIR (near infrared) image), it is configured to disclose only the processed result to the user. And there is no means to judge the validity of the judgment result.

  The present invention has been made in view of the above, and it is an object of the present invention to enable a user to determine the validity of a result of an authentication determination, and to improve the accuracy of the authentication.

  In order to solve the above-described problems and achieve the object, the present invention provides a reading device that receives light from a subject irradiated with light by a light source with an image sensor to read the subject in an invisible image. Control means for controlling a reading operation, correction means for correcting the invisible image, and notification means for notifying at least the corrected invisible image to the outside are provided.

  According to the present invention, not the final determination result but the invisible image itself (raw data) as the intermediate information is notified to the operator side, so that the user can determine the validity of the determination result of the authenticity determination. Thus, there is an effect that the accuracy of authenticity determination can be improved.

FIG. 1 is a diagram illustrating a configuration of an example of the image forming apparatus according to the first embodiment. FIG. 2 is a cross-sectional view exemplarily showing the structure of the image reading unit. FIG. 3 is a block diagram showing the electrical connection of each unit constituting the image reading unit. FIG. 4 is a flowchart schematically showing the flow of the image reading process. FIG. 5 is a diagram illustrating the operation and effect of the image reading process in the image reading unit. FIG. 6 is a block diagram illustrating a configuration of an image notification unit of the image reading unit according to the second embodiment. FIG. 7 is a flowchart schematically showing the flow of the image notification process. FIG. 8 is a block diagram illustrating a configuration of an image correction unit of the image reading unit according to the third embodiment. FIG. 9 is a flowchart schematically showing the flow of the image reading process when there is an area extraction process and a scaling process. FIG. 10 is a diagram illustrating the operation and effect of the image reading process in the image reading unit. FIG. 11 is a block diagram illustrating an electrical connection of each unit included in the image forming apparatus according to the fourth embodiment. FIG. 12 is a flowchart schematically showing the flow of an image reading process when performing authenticity judgment on a printed image. FIG. 13 is a block diagram illustrating a configuration of an image correction unit of the image reading unit according to the fifth embodiment. FIG. 14 is a diagram schematically illustrating a configuration of an image reading unit and an ADF according to the sixth embodiment. FIG. 15 is a flowchart schematically showing the flow of the image reading process in the configuration using the ADF. FIG. 16 is a diagram illustrating a configuration in which the image reading unit according to the seventh embodiment integrally notifies a visible image and an invisible (NIR) image. FIG. 17 is a flowchart schematically showing a flow of an image reading process when notifying a visible image and an invisible (NIR) image integrally. FIG. 18 is a block diagram illustrating an electrical connection of each unit included in the image forming apparatus according to the eighth embodiment. FIG. 19 is a flowchart schematically showing a flow of an image reading process when simultaneously reading a visible image and an invisible (NIR) image. FIG. 20 is a diagram schematically illustrating a configuration of an image reading unit and an ADF according to the ninth embodiment. FIG. 21 is a block diagram illustrating the electrical connection of each unit constituting the image forming apparatus. FIG. 22 is a flowchart schematically showing a flow of an image reading process when simultaneously reading the front and back visible images or the invisible (NIR) image of the front surface and the visible image of the back surface. FIG. 23 is a block diagram illustrating a configuration of an image correction unit of the image reading unit according to the tenth embodiment. FIG. 24 is a flowchart schematically showing the flow of an image reading process when a visible image and an NIR image are combined into one image. FIG. 25 is a diagram illustrating the operation and effect of the image reading process in the image reading unit. FIG. 26 is a block diagram illustrating a configuration of an image correction unit of the image reading unit according to the eleventh embodiment. FIG. 27 is a diagram for explaining the operation and effect of the contrast adjustment processing for an invisible image in the contrast adjustment unit. FIG. 28 is a diagram for explaining the operation and effect of the contrast adjustment processing for a visible image in the contrast adjustment unit. FIG. 29 is a block diagram illustrating a configuration of an image correction unit of an image reading unit according to the twelfth embodiment. FIG. 30 is a diagram for explaining the function and effect of the line drawing process on an invisible image. FIG. 31 is a flowchart schematically showing a flow of an image reading process including a contrast adjustment process or a line drawing process. FIG. 32 is a block diagram showing the electrical connections of the components constituting the authenticity determination system according to the thirteenth embodiment. FIG. 33 is a diagram illustrating a configuration of an image notification unit of the image reading unit according to the fourteenth embodiment. FIG. 34 is a diagram for explaining the operation and effect when the invisible / visible image and the result of the authenticity determination are notified integrally. FIG. 35 is a block diagram showing the electrical connections of the components constituting the authenticity determination system according to the fifteenth embodiment. FIG. 36 is a diagram for explaining the operation and effect when image information is stored in an external storage (cloud). FIG. 37 is a diagram for explaining the operation and effect when both the visible image and the invisible image are stored in an external storage (cloud). FIG. 38 is a diagram for explaining the operation and effect when the access key to the image information is encrypted in the authentication system according to the sixteenth embodiment.

  Hereinafter, embodiments of a reading device, an image forming apparatus, an authentication system, and a reading method will be described in detail with reference to the accompanying drawings.

(First Embodiment)
FIG. 1 is a diagram illustrating a configuration of an example of the image forming apparatus 100 according to the first embodiment. In FIG. 1, an image forming apparatus 100 is generally called a multifunction peripheral having at least two functions of a copy function, a printer function, a scanner function, and a facsimile function.

  The image forming apparatus 100 includes an image reading unit 101 as an image reading unit and an ADF (Automatic Document Feeder) 102, and an image forming unit 103 below the image reading unit 101. Regarding the image forming unit 103, the internal configuration is shown with an external cover removed to explain the internal configuration.

  The ADF 102 is a document support unit that positions a document for reading an image at a reading position. The ADF 102 automatically conveys the document placed on the placing table to the reading position. The image reading unit 101 reads a document conveyed by the ADF 102 at a predetermined reading position. The image reading unit 101 has a contact glass serving as a document supporting unit on which a document is placed, and reads a document on the contact glass serving as a reading position. Specifically, the image reading unit 101 is a scanner having a light source, an optical system, and an image sensor such as a CCD (Charge Coupled Device) inside, and reads reflected light of a document illuminated by the light source with the image sensor through the optical system. .

  The image forming unit 103 prints the document image read by the image reading unit 101. The image forming unit 103 includes a manual feed roller 104 for manually feeding recording paper, and a recording paper supply unit 107 for supplying recording paper. The recording paper supply unit 107 has a mechanism for feeding out recording paper from a multi-stage recording paper feed cassette 107a. The supplied recording paper is sent to the secondary transfer belt 112 via the registration roller 108.

  On the recording paper conveyed on the secondary transfer belt 112, the toner image on the intermediate transfer belt 113 is transferred in the transfer unit 114.

  Further, the image forming unit 103 includes an optical writing device 109, a tandem type image forming unit (Y, M, C, K) 105, an intermediate transfer belt 113, the secondary transfer belt 112, and the like. The image written by the optical writing device 109 is formed as a toner image on the intermediate transfer belt 113 by an image forming process by the image forming unit 105.

  Specifically, the image forming unit (Y, M, C, K) 105 has four photoconductor drums (Y, M, C, K) rotatably, and a charging roller is provided around each photoconductor drum. , A developing unit, a primary transfer roller, a cleaner unit, and an image forming element 106 including a static eliminator. The image forming element 106 functions in each photosensitive drum, and an image on the photosensitive drum is transferred onto the intermediate transfer belt 113 by each primary transfer roller.

  The intermediate transfer belt 113 is disposed so as to be stretched by a driving roller and a driven roller in a nip between each photosensitive drum and each primary transfer roller. The toner image primary-transferred to the intermediate transfer belt 113 is secondary-transferred onto the recording paper on the secondary transfer belt 112 by the secondary transfer device as the intermediate transfer belt 113 travels. The recording paper is conveyed to the fixing device 110 by traveling of the secondary transfer belt 112, and the toner image is fixed on the recording paper as a color image. Thereafter, the recording paper is discharged to a discharge tray outside the apparatus. In the case of double-sided printing, the recording paper is reversed by the reversing mechanism 111, and the reversed recording paper is sent onto the secondary transfer belt 112.

  Note that the image forming unit 103 is not limited to one that forms an image by the electrophotographic method as described above, and may be one that forms an image by an inkjet method.

  Next, the image reading unit 101 will be described.

  FIG. 2 is a cross-sectional view exemplarily illustrating the structure of the image reading unit 101. As shown in FIG. 2, the image reading unit 101 includes, in a main body 11, a sensor substrate 10 having an image sensor 9 as an image sensor, a lens unit 8, a first carriage 6, and a second carriage 7. The image sensor 9 is, for example, a CCD or CMOS image sensor. The first carriage 6 has the light source 2 which is an LED (Light Emitting Diode) and the mirror 3. The second carriage 7 has mirrors 4 and 5. Further, the image reading unit 101 has the contact glass 1 and the reference white plate 13 on the upper surface.

  In the reading operation, the image reading unit 101 emits light upward from the light source 2 while moving the first carriage 6 and the second carriage 7 from the standby position (home position) in the sub-scanning direction (A direction). Then, the first carriage 6 and the second carriage 7 form reflected light from the document 12 on the image sensor 9 via the lens unit 8.

  When the power is turned on, the image reading unit 101 sets the reference by reading the reflected light from the reference white plate 13. That is, the image reading unit 101 moves the first carriage 6 directly below the reference white plate 13, turns on the light source 2, and forms the reflected light from the reference white plate 13 on the image sensor 9 to adjust the gain. Do.

  FIG. 3 is a block diagram showing the electrical connection of each unit constituting the image reading unit 101. As shown in FIG. 3, in addition to the image sensor 9 and the light source 2 described above, the image reading unit 101 includes a signal processing unit 21, an image correction unit 22 functioning as a correction unit, a control unit 23 functioning as a control unit, and a light source driving unit. A notification unit 25 serving as a notification unit; and an image notification control unit 26 serving as a notification control unit.

  The light source 2 is configured for visible / near infrared (NIR). The light source driving unit 24 drives the light source 2.

  The image sensor 9 reads reflected light from a subject, and outputs an RGB signal when reading a visible image and outputs an NIR signal when reading an invisible image. Since a color filter of a general image sensor has a characteristic of transmitting NIR light, an NIR signal appears at each RGB output when reading an invisible image. In the present embodiment, for the sake of explanation, an N output signal of R output is used.

  The signal processing unit 21 has a gain control unit (amplifier), an offset control unit, and an A / D conversion unit (AD converter). The signal processing unit 21 performs gain control, offset control, and A / D conversion on the image signal (RGB) output from the image sensor 9 to convert the image signal (RGB) into digital data, and outputs the digital data to the image correction unit 22 in the subsequent stage. I do.

  The image correction unit 22 performs various corrections including the shading correction, and outputs the corrected data to the image notification unit 25.

  The image notification unit 25 outputs the image to a display or the like so that the operator can easily check the image.

  The image notification control unit 26 controls an image notification condition for the image notification unit 25 according to a notification condition specified from the outside.

  The control unit 23 selectively controls the visible image mode or the invisible (NIR) image mode, and controls the light source driving unit 24, the image sensor 9, the signal processing unit 21, the image correction unit 22, and the image notification control unit 26. Control settings. The control unit 23 selectively controls the visible image mode (first reading operation) or the invisible (NIR) image mode (second reading operation), and controls the setting of each unit according to the mode.

  Next, the flow of the image reading process under the control of the control unit 23 will be described. The image reading operation under the control of the control unit 23 controls to switch various settings depending on whether the mode is the visible image mode or the NIR image mode. The control to be switched is an image sensor mode (for visible / NIR), a signal processing mode (for visible / NIR), a light source mode (visible / NIR light), and an image correction (for visible / NIR).

  FIG. 4 is a flowchart schematically showing the flow of the image reading process. As shown in FIG. 4, the control unit 23 first determines whether the visible image mode is designated (Step S1).

  When the visible image mode is designated (Yes in Step S1), the control unit 23 proceeds to Step S2. In step S2, the control unit 23 executes the mode switching of the image sensor 9 to set the mode to the “visible mode”.

  Next, the control unit 23 switches the mode of the signal processing unit 21 to the “visible mode” (step S3), switches the mode of the light source 2 to the “visible mode” (step S4), and sets the image correction unit. Then, the mode is switched to the "visible mode" (step S5).

  Thereafter, in step S6, the control unit 23 executes image reading.

  In the following step S7, the control unit 23 displays the read image on the display by the image notification unit 25.

  On the other hand, when the NIR image mode is designated (No in step S1), the control unit 23 proceeds to step S8. In step S8, the control unit 23 executes the mode switching of the image sensor 9 to set the mode to the “NIR mode”.

  Next, the control unit 23 executes mode switching of the signal processing unit 21 to set the mode to the “NIR mode” (step S9), executes mode switching of the light source 2 to set the mode to the “NIR mode” (step S10), and sets the image correcting unit. The mode is switched to the "NIR mode" (step S11).

  Thereafter, in Step S6, the control unit 23 executes reading of an image.

  In the following step S7, the control unit 23 displays the read image on the display by the image notification unit 25.

  That is, in the image reading process according to the present embodiment, reading of a target document is started after setting each mode, and images read in both the visible image mode and the NIR image mode are displayed on the display.

  For example, in the case of the visible image mode, it is used when confirming the description contents (information) of the document. On the other hand, in the case of the NIR image mode, it is used when authenticating a document.

  As described above, by switching the light emission of the light source between the visible reading and the NIR reading, the visible image and the invisible image can be selectively read, and the authenticity can be determined by reading the invisible image.

  Next, the operation and effect of the image reading process in the image reading unit 101 will be described.

  In recent years, invisible information embedding (latent image) technology has been used to embed invisible information in various documents such as seal registration documents, resident certificates, and tax payment certificates in addition to identification cards. This enhances document security. In embedding the invisible information, for example, when a document is copied by a copying machine, the embedded information is made to disappear.

  Here, FIG. 5 is a diagram for explaining the operation and effect of the image reading process in the image reading unit 101. FIG. 5A shows an example of a certificate (original) as a document in which invisible (NIR) information is embedded. The net information of the certificate (certificate content, identification number, date of issue, issuer, etc.) is printed as visible information. On the other hand, a "positive" character surrounded by a circle with invisible information is embedded in the lower right part of the certificate so that it cannot be visually recognized. This invisible information functions as an authenticity determination mark, and the authenticity is determined based on the presence or absence of the mark.

  FIG. 5B shows an image obtained by reading the certificate of FIG. 5A in the visible image mode. In the visible image mode, the visible information of the certificate is read, and the operator can confirm the net information described in the certificate. However, since the character “positive”, which is invisible information, is printed as invisible information, the information is lost without being read on the image.

  On the other hand, FIG. 5C shows an image obtained by reading the certificate of FIG. 5A in the NIR image mode. In the NIR image mode, contrary to the visible image mode, the visible information, which is the net information of the certificate, is not read, and only the "positive" characters, which are the invisible information, are read, and the operator is described in the certificate. The authentication mark can be confirmed. At this time, if the certificate is genuine or original, the authenticity judgment mark is read and it is judged to be true (genuine), but if the certificate is fake (forged) or duplicated (copied), the authenticity judgment mark is read. It is determined to be fake (fake) because it cannot be obtained.

  As described above, according to the present embodiment, the NIR image itself (raw data), which is intermediate information, is notified to the operator instead of the final determination result. Can be determined by the user.

  The invisible embedding technology may be one using a visible color material (CMYK) or one using invisible ink (transparent in the visible region, absorbing in the NIR region), and cannot be visually recognized and can be read by NIR. Any method may be used as long as it is provided.

  Further, in the present embodiment, an example of image reading in the NIR (near infrared) region has been described as an example of invisible reading. However, in general, a pigment-based color filter has high transmittance in the NIR (800 to 1000 nm) region. It is known that the Si image sensor 9 itself also has quantum sensitivity. Therefore, by using this wavelength range, it can be used in a state of high sensitivity, and invisible reading can be performed efficiently.

  In the conventional reading apparatus, it is difficult to improve the accuracy of the authenticity determination because only the final result of analyzing the read NIR image is notified to the operator. According to the present embodiment, the user can determine the validity of the result of the authenticity determination by notifying the operator of the NIR image itself (raw data) as the intermediate information instead of the final result. Can be.

  Further, according to the present embodiment, since the second reading operation is a reading operation in the infrared region, invisible reading can be performed efficiently.

(Second embodiment)
Next, a second embodiment will be described.

  The image reading unit 101 according to the second embodiment differs from the first embodiment in that the accuracy of the authenticity determination is increased by storing images. Hereinafter, in the description of the second embodiment, the description of the same parts as those of the first embodiment will be omitted, and the points different from the first embodiment will be described.

  In the first embodiment, the user is able to judge the validity of the result of the authenticity judgment by human judgment (eye). However, it is necessary to perform the image reading at the time of reading, that is, to perform the authenticity judgment in real time. Yes, not suitable for checking by multiple people.

  Therefore, in the second embodiment, the NIR image used for authenticity determination is stored once and then notified to improve the accuracy of the authenticity determination.

  FIG. 6 is a block diagram illustrating a configuration of the image notification unit 25 of the image reading unit 101 according to the second embodiment. As shown in FIG. 6A, the image notifying unit 25 displays the input image in real time, and the operator A performs the authenticity determination, which is the same as the first embodiment. In addition, the image notification unit 25 illustrated in FIG. 6A includes an image storage unit 25a that functions as a storage unit that temporarily stores the read invisible image.

  With such a configuration, when the operator B performs the authenticity determination, the operator B issues a notification instruction to the image notification control unit 26, calls the image stored in the image storage unit 25a at the timing of the notification instruction, and Notify.

  The image notification unit 25 illustrated in FIG. 6B includes an image storage unit 25b that functions as a storage unit that stores the read invisible image.

  With such a configuration, when the operators A and B perform the authenticity determination, both the operators A and B issue a notification instruction to the image notification control unit 26 and are stored in the image storage unit 25b at the timing of the notification instruction. The called images are called and notified to the operators A and B.

  As described above, if the read NIR image is temporarily stored and then notified, authentication can be performed at an arbitrary timing, and multiple checks such as authentication performed by a plurality of persons can be performed. Therefore, the accuracy of authenticity determination can be improved.

  FIG. 7 is a flowchart schematically showing the flow of the image notification process. As shown in FIG. 7, when retrieving an image from the image storage unit, the image notification control unit 26 first checks whether an image notification instruction has been issued by the operator (step S21).

  When the image notification control unit 26 determines that there is an image notification instruction (Yes in step S21), the image notification control unit 26 calls the NIR image from the image storage units 25a and 25b (step S22), and notifies (displays) the image on the display (step S23). . Thereafter, the operator performs authenticity judgment on the NIR image.

  As described above, according to the present embodiment, the accuracy of authenticity determination can be improved by multiple checks by multiple persons or multiple times.

(Third embodiment)
Next, a third embodiment will be described.

  The image reading unit 101 according to the third embodiment differs from the first and second embodiments in that the authenticity determination is facilitated regardless of the embedded position of the invisible information. Hereinafter, in the description of the third embodiment, the description of the same portions as those in the first embodiment or the second embodiment will be omitted, and the description will be different from the first embodiment or the second embodiment. The parts will be described.

  As described in the first embodiment, when reading invisible embedded information in various media including general documents, it is sometimes known where the invisible embedded information is located. There are cases where it is not known whether there is.

  Therefore, in the present embodiment, the image notification method is changed depending on whether the position of the invisible information is known or unknown, so that the authentication is easily determined regardless of whether the position of the invisible information is known or unknown.

  FIG. 8 is a block diagram illustrating a configuration of the image correction unit 22 of the image reading unit 101 according to the third embodiment. As shown in FIG. 8, the image correction unit 22 includes an area extraction unit 31 and a scaling unit 32.

  The area extracting unit 31 extracts an image area specified in the mode determined by the external instruction. The scaling unit 32 scales the image area extracted by the area extracting unit 31. Magnification, magnification, reduction, and magnification (without magnification) can be selected. However, enlargement and magnification are substantially used for authenticity determination. The zoom condition is also specified in the mode determined by the external instruction.

  Next, the flow of the image reading process under the control of the control unit 23 will be described.

  FIG. 9 is a flowchart schematically showing the flow of the image reading process when there is an area extraction process and a scaling process. Note that the processing in steps S1 to S11 is not different from the processing described in FIG. 4, and thus the description thereof is omitted. The difference from the flowchart described with reference to FIG. 4 is that an area extraction process and a scaling process are included between the reading process (step S6) and the image notification process (step S7).

  When executing the reading of the image (step S6), the control unit 23 determines whether the image is partially displayed (step S21).

  When the control unit 23 determines that the display is a partial display (Yes in step S21), the control unit 23 controls the image correction unit 22 to perform area extraction (designated area) and scaling (enlargement) (step S22). For example, when the position of the invisible information is known, a necessary portion is a part, and therefore, the corresponding region of the image is extracted and enlarged and displayed.

  On the other hand, if the control unit 23 determines that the image is not partially displayed (No in step S21), the control unit 23 controls the image correction unit 22 to perform area extraction (entire) and magnification (actual magnification) (step S23). For example, if the position of the invisible information is unknown, it is necessary to find the invisible information from the entire image, so that the entire image is displayed as an extraction target at the same magnification.

  FIG. 10 is a diagram illustrating the operation and effect of the image reading process in the image reading unit 101. FIG. 10A shows an example of a document (original) in which invisible (NIR) information is embedded. The net information of the certificate (certificate content, identification number, date of issue, issuer, etc.) is printed as visible information. On the other hand, a "positive" character surrounded by a circle with invisible information is embedded in the lower right part of the certificate so that it cannot be visually recognized. This invisible information functions as an authenticity determination mark, and the authenticity is determined based on the presence or absence of the mark.

  FIG. 10B shows an example where the position of the invisible information is unknown. In this case, since the operator does not know the position of the invisible information, it is necessary to find where the authenticity determination mark is on the image. Therefore, by displaying the entire image at the same magnification as an extraction target, it is easy to find invisible information from the entire image, and it is easy to determine the authenticity.

  On the other hand, FIG. 10C shows an example where the position of the invisible information is known. In this case, since the operator knows where the position of the invisible information comes, there is no need to search for where the authentication judgment mark is in the image. However, when the pattern of the authentication mark is complicated, it is necessary to closely examine the pattern (FIG. 10C shows an example in which the circle is not a continuous line but a chain line). Therefore, by extracting only the corresponding region of the image and displaying the portion in an enlarged manner, it is possible to identify a complicated pattern and to easily determine the authenticity.

  As described above, according to the present embodiment, even if the printing location of the invisible embedding information is unknown, it is possible to easily determine the authenticity.

  Further, even when a fine pattern of the invisible embedded information is determined, it is possible to easily determine the authenticity.

(Fourth embodiment)
Next, a fourth embodiment will be described.

  The image forming apparatus 100 according to the fourth embodiment is different from the first to third embodiments in that the image forming apparatus 100 is configured to determine the authenticity of a printed image. Hereinafter, in the description of the fourth embodiment, the description of the same parts as those in the first to third embodiments will be omitted, and the description will be different from the first to third embodiments. The parts will be described.

  Until now, it has been described that the read NIR image is displayed on a display or the like to determine the authenticity. However, when notifying the image immediately to another operator or a customer or performing a multiple check, a plurality of displays are required. There is a problem that image handling for authenticity determination is not practical, for example, a table must be prepared.

  Therefore, in the present embodiment, the authentication is performed using the print image obtained by printing the read NIR image, thereby improving the handling of the image and further facilitating the authenticity determination.

  FIG. 11 is a block diagram illustrating an electrical connection of each unit included in the image forming apparatus 100 according to the fourth embodiment. FIG. 11A shows an electrical connection of each unit constituting the image forming apparatus 100. The difference from FIG. 3 described in the first embodiment is that the image notification unit 25 notifies not by a display image but by a print image (paper medium) via the image forming unit 103.

  FIG. 11B is a block diagram illustrating an example of a configuration of the image notification unit 25. As shown in FIG. 11B, the image notification unit 25 includes an image printing unit 25c. The image printing unit 25c causes the image forming unit 103 to print the input image under the control of the image notification control unit 26.

  According to the present embodiment, when authenticating a print image, multiple checks can be performed by handing over the print image even when checking by multiple persons. Further, since the print image itself becomes the evidence (ground for determination), even in a case where the evidence is requested and passed to the customer, it is only necessary to pass the print image as it is.

  FIG. 11C is a block diagram illustrating another example of the configuration of the image notification unit 25. As shown in FIG. 11C, the image notification unit 25 includes an image printing unit 25d and an image storage unit 25a. The image printing unit 25d causes the image forming unit 103 to print the invisible image input under the control of the image notification control unit 26. The point that the operator determines the authenticity of the printed image is the same as in FIG. 11B, and as described above, this makes it easier to perform multiple checks.

  Further, the image storage unit 25a stores the input invisible image simultaneously with printing. Thus, the invisible image stored in the image storage unit 25a is displayed on the display at an arbitrary timing, so that another operator can determine the authenticity. In this case, it is conceivable that the operator performs authenticity judgment on both the print image and the display, and passes the print image as evidence to the customer.

  FIG. 12 is a flowchart schematically showing the flow of an image reading process when performing authenticity judgment on a printed image. Note that the processing of steps S1 to S6, steps S8 to S11, and steps S21 to S23 is not different from the processing described in FIG. 9, and thus description thereof is omitted. The difference from the flowchart described in FIG. 9 is that image notification (display on the display) (step S7) is changed to image notification (printing) (step S31).

  As described above, according to the present embodiment, multiple checks for authenticity determination can be easily performed.

(Fifth embodiment)
Next, a fifth embodiment will be described.

  The image reading unit 101 according to the fifth embodiment differs from the first to fourth embodiments in that an invisible (NIR) image is converted to monochrome. Hereinafter, in the description of the fifth embodiment, description of the same portions as those in the first to fourth embodiments will be omitted, and the description will be different from the first to fourth embodiments. The parts will be described.

  Until now, an invisible image has been described using a configuration using RGB. However, since an NIR image has no concept of color, it is more natural to treat it as monochrome data. In addition, there is also a problem that the file size is increased by treating the NIR image as a color image, and a problem that display on the image notification unit 25 is slow.

  Therefore, in the present embodiment, an invisible image is converted into monochrome image data to minimize the image file size and to speed up image notification.

  FIG. 13 is a block diagram illustrating a configuration of the image correction unit 22 of the image reading unit 101 according to the fifth embodiment. As shown in FIG. 13A, the image correction unit 22 includes a monochrome conversion unit 41 and a selector (SEL) 42 in addition to an area extraction unit 31 and a scaling unit 32.

  The monochrome converter 41 converts the RGB data into monochrome data.

  The selector 42 selects the RGB data and the converted monochrome data. More specifically, the selector 42 is controlled by the control unit 23 to select either RGB data or monochrome data according to an external instruction.

  FIG. 13B shows an image path in the NIR image mode. As shown in FIG. 13B, in the case of the NIR image mode, the monochrome conversion unit 41 is enabled, and the subsequent selector 42 selects monochrome data (NIR image). After the selector 42, the data is sent as monochrome data (single channel data), and the file size of the image can be reduced to about 1/3 of that of the RGB image. In addition, since the file size is reduced, the time required for the image notification unit 25 to notify the image to the outside is also shortened, and the notification can be speeded up.

  As described above, according to the present embodiment, by making the invisible image monochrome, the image notification to the outside can be performed at high speed or at low cost.

(Sixth embodiment)
Next, a sixth embodiment will be described.

  The image forming apparatus 100 according to the sixth embodiment is different from the first to fifth embodiments in that the image forming apparatus 100 is configured to increase the productivity of authenticity determination. Hereinafter, in the description of the sixth embodiment, description of the same portions as those in the first to fifth embodiments will be omitted, and will be different from the first to fifth embodiments. The parts will be described.

  The image forming apparatus 100 of the present embodiment has an ADF 102 that continuously transports a plurality of documents to a reading position. By combining the image reading unit 101 and the ADF 102, the productivity of authenticity determination can be increased.

  FIG. 14 is a diagram schematically illustrating a configuration of the image reading unit 101 and the ADF 102 according to the sixth embodiment. The configuration of the image reading unit 101 is the same as that of FIG.

  The ADF 102 sends the plurality of originals 12 placed on the original tray 51 to the transport path 53 one by one by a pickup roller 52. The image of the document 12 sent to the transport path 53 is read by the image reading unit 101 at the scanner reading position (light source irradiation position) 54. Here, the reading position 54 is a position where light from the light source 2 is irradiated. The document 12 after the image reading is output to the discharge tray 55. The above operation is continuously performed until all the originals 12 are discharged. As described above, even when there are a plurality of documents, it is possible to increase the reading productivity, that is, the productivity of the authenticity determination by using the ADF 102.

  Next, the flow of the image reading process under the control of the control unit 23 will be described.

  FIG. 15 is a flowchart schematically showing a flow of an image reading process in a configuration using the ADF 102. Note that the processing of steps S1 to S6, steps S8 to S11, steps S21 to S23, and step S31 is not different from the processing described in FIG. The difference from the flowchart described with reference to FIG. 12 is that a branch (step S41) for determining whether all documents (documents) have been read after the image notification is added.

  When the control unit 23 determines that reading of all the documents (documents) is completed (Yes in step S41), the control unit 23 ends the reading operation and proceeds to step S21. On the other hand, when it is determined that the reading of all the documents (documents) has not been completed (No in step S41), the control unit 23 returns to step S6 and performs reading again, and the reading of all the documents (documents) is completed. The reading operation is performed until. The reading in step S6 includes the operation of transporting the original (document) by the ADF 102.

  Further, in FIG. 15, the image notification is performed after the reading is completed. However, the present invention is not limited to this, and the image notification may be performed for each reading.

  As described above, according to the present embodiment, the productivity of authenticity determination can be increased.

(Seventh embodiment)
Next, a seventh embodiment will be described.

  The image reading unit 101 according to the seventh embodiment is different from the first to sixth embodiments in that a visible image and an invisible (NIR) image are notified integrally. Hereinafter, in the description of the seventh embodiment, description of the same portions as those in the first to sixth embodiments will be omitted, and the description will be different from the first to sixth embodiments. The parts will be described.

  Until now, only invisible images have been used for authenticity determination. However, invisible images are used only for authenticity determination, and individual identification of a document cannot always be performed. For example, in a case where an image output from the image notification unit 25 is stored as evidence (evidence) for later confirmation or the like (this is assumed in both paper and electronic data), it is determined that individual identification of evidence cannot be performed. In addition, there arises a problem that the operator cannot determine which document is authenticated.

  Thus, in the present embodiment, the visible image and the NIR image are notified integrally so that the operator can determine which document the authenticity of has been determined.

  FIG. 16 is a diagram illustrating a configuration in which the image reading unit 101 according to the seventh embodiment integrally notifies a visible image and an invisible (NIR) image.

  FIG. 16 is a block diagram illustrating a configuration of the image notification unit 25. The image notification unit 25 illustrated in FIG. 16 connects the image storage unit 25b illustrated in FIG. 6B and the image printing unit 25e serially. The image storage unit 25b stores the visible image (RGB) and the NIR image input at an arbitrary timing, and outputs the visible image and the NIR image to the image printing unit 25e when the two images are completed.

  The image printing unit 25e prints the visible image and the NIR image in the image forming unit 103 and notifies the outside. In addition, the image output from the image storage unit 25b is output for a display and notified to the outside as a display image, as described with reference to FIG.

  FIG. 16B shows an example of an image output from the image notification unit 25. The output from the image notification unit 25 is composed of a visible image for individual identification and an invisible image for authenticity determination, and these are integrally printed or displayed on a display. As described above, by integrally notifying the invisible image for authenticity determination and the individual identification information, the function can be enhanced as evidence and information management can be facilitated. Further, when outputting as a print image from the image notification unit 25, as shown in FIG. 16C, the front side is printed as a visible image, and the back side is printed as an invisible image, so that it is physically managed as one piece of evidence. Therefore, information management can be further facilitated.

  It is not always necessary to read the visible image and the invisible image at the same time. For example, the visible image and the invisible image may be read at different timings such as invisible reading (or vice versa) after reading the visible image. However, considering the practical operation of adding individual identification information to the evidence, it is desirable that the time difference between visible reading and invisible reading be small.

  Next, the flow of the image reading process under the control of the control unit 23 will be described.

  FIG. 17 is a flowchart schematically showing a flow of an image reading process when notifying a visible image and an invisible (NIR) image integrally. Note that the processing of steps S2 to S5, steps S8 to S11, steps S21 to S23, step S31, and step S41 is not different from the processing described in FIG. The difference from the flowchart described with reference to FIG. 15 is that the visible image reading and the invisible image reading are sequentially performed, and the visible / invisible image integrated mode is set.

  As shown in FIG. 17, the control unit 23 first determines whether or not the visible / invisible image integrated mode is designated (step S51).

  When the visible / invisible image integrated mode is specified (Yes in step S51), the control unit 23 executes reading of the visible image after executing the processing in steps S2 to S5 (step S52). Next, after executing the processing of steps S8 to S11, the control unit 23 executes reading of the invisible image (step S53).

  When the visible / invisible image integrated mode is not designated (No in step S51), the control unit 23 selects the visible / invisible image mode, and shifts to the image reading flow shown in FIG.

  Although FIG. 17 shows an example in which the invisible image is read after the visible image is read, the order may be reversed. In FIG. 17, the image notification is performed after reading the visible / invisible image. However, the present invention is not limited to this, and the image notification may be performed for each reading.

  As described above, according to the present embodiment, the image notification unit 25 inputs the corrected visible image and the invisible image, and notifies the visible image and the invisible image integrally. Management can be facilitated.

  Further, according to the present embodiment, the image notifying unit 25 prints the visible image and the invisible image on the first surface and the second surface of the print image and notifies them, thereby performing information management for authenticity determination. It can be even easier.

(Eighth embodiment)
Next, an eighth embodiment will be described.

  The image forming apparatus 100 according to the eighth embodiment is different from the first to seventh embodiments in that a visible image and an invisible (NIR) image are simultaneously read. Hereinafter, in the description of the eighth embodiment, the description of the same parts as those in the first to seventh embodiments will be omitted, and the description will be different from the first to seventh embodiments. The parts will be described.

  In the seventh embodiment, an example has been described in which a visible image and an invisible (NIR) image are sequentially read, and the result is notified integrally. However, considering the operability of the operator, the visible image and the invisible image are divided into two. The operation (instruction) to read twice is complicated.

  Therefore, in the present embodiment, the operability of the operator is improved by adopting a configuration in which the visible image and the NIR image are simultaneously read.

  FIG. 18 is a block diagram illustrating an electrical connection of each unit included in the image forming apparatus 100 according to the eighth embodiment. FIG. 18A shows a configuration in which a visible image and an NIR image are read simultaneously. In the configuration shown in FIG. 3, the image sensor 9 outputs any one of RGB or NIR image signals. On the other hand, in the image forming apparatus 100 shown in FIG. 18A, the image sensor 9 reads reflected light from a subject, and outputs an RGB image signal and an NIR image signal at a time.

  The RGB image signal and the NIR image signal output from the image sensor 9 are output to the image notification unit 25 via the signal processing unit 21 and the image correction unit 22.

  FIG. 18B is a diagram illustrating a configuration of the image sensor 9. As shown in FIG. 18 (b), the image sensor 9 can read RGB and NIR images at a time by forming NIR pixel columns in addition to RGB pixel columns.

  FIG. 18C is a diagram illustrating a configuration of the image notification unit 25. As shown in FIG. 18C, the RGB image signal and the NIR image signal are input to the image storage 25b at a time.

  As described above, the operability of the operator can be improved by simultaneously reading the visible image and the NIR image.

  Next, the flow of the image reading process under the control of the control unit 23 will be described.

  FIG. 19 is a flowchart schematically showing a flow of an image reading process when simultaneously reading a visible image and an invisible (NIR) image. Note that the processing in steps S21 to S23, step S31, step S41, and step S51 is not different from the processing described with reference to FIG. 17, and a description thereof will be omitted. The difference from the flowchart described with reference to FIG. 17 is that when the visible / invisible image integrated mode is selected, the settings of the image sensor 9, the signal processing unit 21, the light source 2, and the image correction unit 22 are set to the visible (RGB) image and the invisible (NIR) is that the setting is such that images are read simultaneously.

  As shown in FIG. 19, when the visible / invisible image integrated mode is designated (Yes in step S51), the control unit 23 proceeds to step S61. In step S61, the control unit 23 executes mode switching of the image sensor 9 to set the mode to the “visible & NIR mode”.

  Next, the control unit 23 switches the mode of the signal processing unit 21 to the "visible & NIR mode" (step S62), switches the mode of the light source 2 to the "visible & NIR mode" (step S63), The mode of the correction unit 22 is switched to the "visible & NIR mode" (step S64).

  After that, in step S65, the control unit 23 simultaneously reads a visible (RGB) image and an invisible (NIR) image.

  As described above, according to the present embodiment, it is possible to increase the productivity of authenticity judgment while facilitating information management.

(Ninth embodiment)
Next, a ninth embodiment will be described.

  The image forming apparatus 100 according to the ninth embodiment is different from the first to eighth embodiments in that a visible image and an invisible (NIR) image on both sides are simultaneously read. Hereinafter, in the description of the ninth embodiment, the description of the same parts as in the first to eighth embodiments will be omitted, and the description will be different from the first to eighth embodiments. The parts will be described.

  In the eighth embodiment, the configuration has been described in which a visible image and an invisible (NIR) image are simultaneously read by using the image sensor 9 to which an NIR pixel row is added. However, this case can be dealt with only when the visible image and the NIR image are on the same surface. When the visible image and the NIR image are not on the same surface, such as when the visible image is the front surface and the NIR image is the back surface, Cannot read.

  Therefore, in the present embodiment, the NIR image is read on the front surface and the visible image is read on the back surface, so that even if the visible image and the NIR image are not on the same surface, they can be read at the same time.

  FIG. 20 is a diagram schematically illustrating a configuration of the image reading unit 101 and the ADF 102 according to the ninth embodiment. The ADF 102 is a one-pass transport path 53, and differs from the ADF 102 shown in FIG. 14 in that a contact image sensor (CIS; Contact-Image-Sensor) 61 is provided in the transport path 53. Here, it is assumed that the image reading unit 101 has the visible image mode and the NIR image mode, and the CIS 61 of the ADF 102 has only the visible image mode.

  The ADF 102 sends the plurality of originals 12 placed on the original tray 51 to the transport path 53 one by one by a pickup roller 52. The NIR image of the front surface of the document 12 sent to the transport path 53 is read by the image reading unit 101 at a scanner reading position (light source irradiation position) 54. Thereafter, the document 12 is conveyed toward the discharge tray 55. The RGB image on the back surface of the document 12 conveyed toward the paper discharge tray 55 is read by the CIS 61 in the middle of the conveyance path 53.

  As described above, by adopting a configuration in which the NIR image is read on the front surface and the visible image is read on the back surface, even when the visible image and the NIR image are not on the same surface, they can be read simultaneously.

  Although the image reading unit 101 reads the NIR image and the CIS 61 reads the RGB image in FIG. 20, the relationship may be reversed. Further, the CIS 61 may read by a reduction optical system, and conversely, the reduction optical system on the image reading unit 101 side may be a CIS.

  FIG. 21 is a block diagram showing the electrical connection of each unit constituting the image forming apparatus 100. FIG. 21A shows a configuration in which a visible image on the front and back sides or an invisible (NIR) image on the front side and a visible image on the back side are simultaneously read. The difference from the configuration shown in FIG. 18 is that, in addition to the configuration for reading the front side of the document (light source 2 and image sensor 9), a CIS 61 (the light source is visible light) for reading the back side of the document is added.

  The CIS 61 is controlled by the control unit 23 and the light source driving unit 24. That is, the operation of the CIS 61 is controlled according to the image mode.

  The output of the CIS 61 is only a visible image and is an RGB output. The RGB (NIR) image on the image reading unit 101 side and the RGB image on the CIS 61 side are output to the image notification unit 25 via the signal processing unit 21 and the image correction unit 22, respectively.

  FIG. 21B is a diagram illustrating a configuration of the image notification unit 25. As shown in FIG. 21B, an RGB (NIR) image signal for the front surface and an RGB image signal for the back surface are input to the image storage unit 25b at a time. In this case, the RGB image on the back surface and the NIR image on the front surface are output from the image storage unit 25b and printed or displayed on a display.

  Next, the flow of the image reading process under the control of the control unit 23 will be described.

  FIG. 22 is a flowchart schematically showing a flow of an image reading process when simultaneously reading the front and back visible images or the invisible (NIR) image of the front surface and the visible image of the back surface. Note that the processing of steps S8 to S11, steps S21 to S23, step S31, step S41, step S51, and step S53 is not different from the processing described with reference to FIG. The difference from the flowchart described with reference to FIG. 17 is that the visible image reading and the invisible image reading are performed in parallel, and the visible / invisible image integrated mode is set.

  As shown in FIG. 22, when the visible / invisible image integrated mode is designated (Yes in step S51), the control unit 23 performs reading of the invisible image on the front surface of the document after executing the processes in steps S8 to S11. Execute (Step S53).

  In addition, when the visible / invisible image integrated mode is designated (Yes in step S51), the control unit 23 sets the CIS 61 to the visible (RGB) setting for the back side of the document (step S71), and Is executed (step S72).

  Note that there is no particular limitation on the timing relationship between the front side reading (NIR) and the back side reading (RGB).

  As described above, according to the present embodiment, even when visible information and invisible information are on different sides, it is possible to increase the productivity of authenticity determination while facilitating information management.

(Tenth embodiment)
Next, a tenth embodiment will be described.

  The image reading unit 101 of the tenth embodiment is different from the first to ninth embodiments in that the visible image and the NIR image are combined into one image. Hereinafter, in the description of the tenth embodiment, the description of the same portions as those in the first to ninth embodiments will be omitted, and the description will be different from the first to ninth embodiments. The parts will be described.

  In the eighth embodiment and the ninth embodiment, the configuration in which the visible image and the NIR image are notified integrally has been described. However, since it is necessary to notify a plurality of images (surfaces), the notification is completed. There is a problem that it takes time to be done.

  Therefore, in the present embodiment, the time for image notification is reduced by synthesizing the visible image and the NIR image into one (frame) image.

  FIG. 23 is a block diagram illustrating a configuration of the image correction unit 22 of the image reading unit 101 according to the tenth embodiment. As shown in FIG. 23A, the image correction unit 22 includes an area extraction unit 31, a scaling unit 32, a monochrome conversion unit 41, and a selector (SEL) 42, as well as an image synthesis function that functions as a synthesis unit. A portion 71 is provided.

  For example, when an external instruction is received to notify the visible image on the front and back and the NIR image integrally, the control unit 23 enables the image combining in the image combining unit 71. The image combining unit 71 combines the visible image and the NIR image into one (frame) image under the control of the control unit 23.

  FIG. 23B shows an effective image path when the visible image and the NIR image are combined into one (frame) image. As shown in FIG. 23B, when combining the visible image and the NIR image into one (frame) image, the image combining unit 71 converts the NIR image included in the front-side read image via the monochrome conversion unit 41. get. On the other hand, the image synthesizing unit 71 directly obtains the RGB image which is the back side read image.

  The image combining unit 71 combines the input NIR image and the RGB image to generate a new RGB image. The image synthesizing unit 71 outputs the generated RGB images to the subsequent image notification unit 25 via the area extracting unit 31 and the scaling unit 32. At this time, when viewed from the image notification unit 25 at the subsequent stage, only the RGB image is notified (not shown). In this case, only the RGB image need be notified, and the operation of the image notification unit 25 is basically the same. Note that the image path invalidated by RGB output from the image synthesizing unit 71 is a path for outputting front and back images of visible images.

  As described above, by synthesizing the visible image and the NIR image into one (frame) image, the time for image notification can be reduced and the speed can be increased.

  In the present embodiment, the case where the area is extracted and scaled after image synthesis is described, but image synthesis may be performed after area extraction and scaled.

  Next, the flow of the image reading process under the control of the control unit 23 will be described.

  FIG. 24 is a flowchart schematically showing the flow of an image reading process when a visible image and an NIR image are combined into one image. The processing of steps S8 to S11, steps S21 to S23, step S31, step S41, step S51, step S53, and steps S71 to S72 is not different from the processing described in FIG. I do. The difference from the flowchart described with reference to FIG. 22 is that, after reading is completed, whether or not the visible image and the invisible image are combined is added.

  As shown in FIG. 24, when it is determined that reading of all the documents (documents) is completed (Yes in step S41), the control unit 23 determines whether to enable the image combining in the image combining unit 71 (step S81). ). When receiving an external instruction to integrally notify the visible image and the NIR image on the front and back, the control unit 23 determines that image combining in the image combining unit 71 is enabled (Yes in step S81), and the image combining unit 71 Is enabled (step S82).

  On the other hand, if no external instruction has been received to notify the visible image on the front and back and the NIR image integrally, the control unit 23 determines that image combining in the image combining unit 71 is not enabled (No in step S81). The image composition in the image composition section 71 is invalidated (step S83).

  Here, FIG. 25 is a diagram for explaining the operation and effect of the image reading process in the image reading unit 101. FIG. 25A is an example of a visible image (RGB) and an invisible image (NIR) input to the image combining unit 71.

  FIG. 25B is an example of a composite image. The example shown in FIG. 25B is an example in which the authenticity mark of the NIR image is overlaid on the RGB image by enlarging it, and the NIR image portion is treated as a black and white pattern. By combining the RGB image and the NIR image into a single image on the same plane in this manner, the data volume handled by the image notification unit 25 can be reduced, and the speed of image notification can be increased.

  FIG. 25C shows another example of the composite image. The example shown in FIG. 25C is an example in which the authenticity mark of the NIR image is combined with the blank area of the RGB image, and the NIR image portion is treated as a monochrome image as in FIG. By laying out and synthesizing the NIR image in an area different from the area where the context of the RGB image exists as described above, it is possible to speed up the image notification while maintaining the visibility of the visible information.

  In this embodiment, the NIR image portion is treated as a black-and-white image. However, by combining images in a color different from the visible image, the visibility of invisible information can be improved.

  As described above, according to the present embodiment, image notification to the outside can be performed at high speed while facilitating information management.

  Further, according to the present embodiment, the visibility of the visible information can be maintained by laying out the visible image and the invisible image in different areas on the same surface.

  Further, according to the present embodiment, the visibility of the invisible information can be improved by making the color of the invisible image different from that of the visible image.

(Eleventh embodiment)
Next, an eleventh embodiment will be described.

  The image reading unit 101 according to the eleventh embodiment differs from the first to tenth embodiments in that the contrast of an invisible image is adjusted to further increase the accuracy of authenticity determination. Hereinafter, in the description of the eleventh embodiment, the description of the same parts as those in the first to tenth embodiments will be omitted, and the description will be different from the first to tenth embodiments. The parts will be described.

  Although the invisible embedding technique shown in FIG. 5 of the first embodiment, that is, the so-called latent image technique, can embed information that cannot be visually recognized, it is possible to reduce the density of the embedded image from that of the normal image. The device is designed to be inconspicuous visually. Therefore, the contrast may not be sufficient even when the read invisible image is viewed, and it may be difficult to determine the authenticity. Further, there is a case where the image density read by the reading device is low, and in that case, there is a problem that it is similarly difficult to determine the authenticity.

  Therefore, in the present embodiment, by correcting the contrast of the image, it is possible to maintain the authentication accuracy even when the contrast of the invisible image is insufficient.

  FIG. 26 is a block diagram illustrating a configuration of the image correction unit 22 of the image reading unit 101 according to the eleventh embodiment. As shown in FIG. 26, the image correction unit 22 includes a region adjustment unit 31, a scaling unit 32, a monochrome conversion unit 41, a selector (SEL) 42, an image synthesis unit 71, and a contrast adjustment unit 72. It has.

  The contrast adjusting unit 72 adjusts the contrast of the visible image and the invisible (NIR) image. Specifically, the contrast adjustment unit 72 performs a contrast enhancement process or a binarization process on the NIR image, or a contrast suppression process (integration process) on the visible image.

  Here, FIG. 27 is a diagram for explaining the operation and effect of the contrast adjustment processing of the invisible image in the contrast adjustment unit 72. FIG. 27A shows an invisible read image before adjustment. FIG. 27B shows an invisible image after the contrast adjustment, and it can be seen that the authenticity determination mark can be more clearly identified from the image of FIG. 27A by performing the contrast enhancement processing. FIG. 27 (c) shows an invisible image when the contrast is adjusted by binarization, and it can be seen that the authenticity determination mark can be clearly identified from the image of FIG. 27 (a). Note that an appropriate value is set in advance for the binarization threshold. By performing the contrast enhancement processing by the binarization processing, the accuracy of the authenticity determination can be easily maintained.

  In FIG. 27, the contrast of the invisible image is adjusted. However, considering that the contrast is relative to the visible image, a similar effect can be obtained by changing the contrast of the visible image.

  Here, FIG. 28 is a diagram for explaining the operation and effect of the contrast adjustment processing of the visible image in the contrast adjustment unit 72. FIG. 28A shows an image in which the visible image and the invisible read image before adjustment are combined in one frame. FIG. 28B shows an image in which the contrast has been adjusted so as to suppress the contrast of the visible image. By performing the contrast suppression processing, the authenticity determination mark is more likely to be applied to the image of FIG. It turns out that it can be clearly identified. The contrast suppression processing can be easily realized by using an integration filter. By performing the contrast suppression processing by the integration filter processing, the authentication accuracy can be easily maintained.

  As described above, according to the present embodiment, by performing the contrast enhancement process on the invisible image, the accuracy of the authenticity determination can be maintained even when the invisible image has a low density.

  Further, according to the present embodiment, by performing the contrast suppression processing for suppressing the contrast of the visible image, it is possible to maintain the authenticity determination accuracy even when the invisible image is composed of dots (knitting points).

(Twelfth embodiment)
Next, a twelfth embodiment will be described.

  The image reading unit 101 of the twelfth embodiment is different from the first to eleventh embodiments in that a line drawing process is performed on an invisible image. Hereinafter, in the description of the twelfth embodiment, the description of the same portions as the first embodiment to the eleventh embodiment will be omitted, and the description will be different from the first embodiment to the eleventh embodiment. The parts will be described.

  In the eleventh embodiment, the contrast of an invisible image has been described as an example. However, in the invisible embedding (latent image) technique, the invisible image may be made inconspicuous by forming dots (halftone dots) ( The density appears equivalently to the human eye), and in that case, there is also a problem that it is difficult to determine the authenticity.

  Thus, in the present embodiment, by performing correction for converting the dots of an image into linear drawings, the accuracy of authenticity determination can be maintained even when the invisible image is a dot (halftone dot).

  FIG. 29 is a block diagram illustrating a configuration of the image correction unit 22 of the image reading unit 101 according to the twelfth embodiment. As shown in FIG. 26, the image correction unit 22 includes an area extraction unit 31, a scaling unit 32, a monochrome conversion unit 41, a selector (SEL) 42, an image synthesis unit 71, and a contrast adjustment unit 72. In addition, a line drawing unit 73 is provided.

  The line drawing unit 73 performs a line drawing process of recognizing dots and connecting them. In the present embodiment, the line drawing unit 73 is arranged on the side to which an NIR image is input in order to perform processing on an invisible image, but may be arranged on the visible image side.

  FIG. 30 is a diagram for explaining the function and effect of the line drawing process on an invisible image. FIG. 30A shows an invisible read image before processing. Since the authenticity judgment mark “positive in a circle” is composed of dots (dots), it is difficult to identify the mark by itself. FIG. 30B shows an image on which the line drawing processing has been performed. Since the dots are connected to form a continuous smooth image, the authenticity determination mark is clearly identified with respect to FIG. You can see what you can do.

  In the present embodiment, in a sense, the pattern of the authentication mark is changed, but it is assumed that there is no problem in authenticating even if the pattern is changed in advance.

  Next, the flow of the image reading process under the control of the control unit 23 will be described.

  FIG. 31 is a flowchart schematically showing a flow of an image reading process including a contrast adjustment process or a line drawing process. Note that the processing of steps S8 to S11, steps S21 to S23, step S31, step S41, step S51, step S53, steps S71 to S72, and steps S81 to S83 is not different from the processing described in FIG. , The description of which is omitted. The difference from the flowchart described in FIG. 24 is that it is added whether or not to execute the contrast adjustment processing or the line drawing processing after the reading is completed.

  As shown in FIG. 31, when the control unit 23 determines that all the documents (documents) have been read (Yes in step S41), the control unit 23 executes the contrast adjustment processing in the contrast adjustment unit 72 or the line drawing processing in the line drawing unit 73. It is determined whether to make it valid (step S91). When determining that the contrast adjustment process or the line drawing process is to be enabled (Yes in step S91), the control unit 23 enables the contrast adjustment process or the line drawing process (step S92).

  On the other hand, the control unit 23 determines that the contrast adjustment processing or the line drawing processing is not enabled (No in step S91), and disables the contrast adjustment processing or the line drawing processing (step S93).

  In FIG. 31, it is described that any one of the contrast adjustment (invisible image), the contrast adjustment (visible image), and the line drawing process is selected, but these processes may be used in combination.

  As described above, according to the present embodiment, even when the invisible image is composed of dots (knitting points), the authentication accuracy can be maintained.

(Thirteenth embodiment)
Next, a thirteenth embodiment will be described.

  The thirteenth embodiment is different from the first to twelfth embodiments in that the primary judgment of the authenticity judgment is performed in the device. Hereinafter, in the description of the thirteenth embodiment, description of the same portions as those in the first to twelfth embodiments will be omitted, and will be different from the first to twelfth embodiments. The parts will be described.

  Until now, a configuration has been described in which the validity of the authenticity determination can be confirmed by visual confirmation. However, when confirming the validity of the authenticity judgment, there is a problem that it takes time to perform the judgment work because the authenticity judgment itself is also performed.

  Therefore, in the present embodiment, a configuration is adopted in which the primary determination of the authenticity is performed in the device to reduce the time required for the determination operation.

  FIG. 32 is a block diagram showing the electrical connections of the components constituting the authentication determination system 200 according to the thirteenth embodiment. The authentication system 200 shown in FIG. 32A includes an authentication unit 91 functioning as an authentication unit that performs authentication between the image correction unit 22 and the image notification unit 25.

  The authenticity judgment unit 91 judges the authenticity of the NIR image output from the image correction unit 22 by detecting the presence or absence of an authentication mark (positive circle). The authentication section 91 outputs the authentication result to the image notification section 25.

  The image notification unit 25 also notifies the result of the authenticity determination in accordance with the image information described above.

  The control unit 23 controls whether or not the authentication is performed by the authentication unit 91, the determination method, and the determination conditions according to the image mode.

  The components other than the authentication unit 91 are the same as those of the image reading unit 101 or the image forming apparatus 100 described above. Calling.

  FIG. 32B shows an authenticity determination system 200 using the image sensor 9 that can simultaneously acquire an RGB image and an NIR image. The difference from the authenticity determination system 200 shown in FIG. 32A is that the RGB image and the NIR image are simultaneously acquired by using the CIS 61 in FIG. This is a point that the image sensor 9 that can be acquired has been replaced.

  In addition, the authentication result obtained by the authentication system 200 (notified externally) is treated as a primary determination result. This is because the result is not always appropriate in consideration of forgery or falsification. Therefore, the final determination result is determined from the primary determination result obtained by the authenticity determination system 200 and the validity determination based on the NIR image notified from the image notification unit 25.

  As described above, the time required for the determination operation can be reduced by performing the primary determination of the authenticity determination in the device and performing the authentication determination together with the notified NIR image.

  As described above, according to the present embodiment, the authenticity determination operation can be shortened.

(14th embodiment)
Next, a fourteenth embodiment will be described.

  The authenticity determination system 200 of the fourteenth embodiment is different from the first to thirteenth embodiments in that the invisible / visible image and the result of the authentication are notified integrally. Hereinafter, in the description of the fourteenth embodiment, the description of the same parts as in the first to thirteenth embodiments will be omitted, and the description will be different from the first to thirteenth embodiments. The parts will be described.

  Although the authentication system 200 is described in the thirteenth embodiment, storing the authentication result as evidence separately from the NIR image from the viewpoint of information management makes it difficult to manage information later.

  Therefore, in the present embodiment, information management as evidence is facilitated by integrally notifying the NIR image and the result of the authentication determination.

  FIG. 33 is a diagram illustrating a configuration of the image notification unit 25 of the image reading unit 101 according to the fourteenth embodiment. The image notification unit 25 of the image reading unit 101 illustrated in FIG. 33 includes a notification image generation unit 25f that functions as an information combining unit between the image storage unit 25b and the image printing unit 25e.

  As shown in FIG. 33, an authentication result is input to the image notification unit 25 in addition to the visible image and the NIR image. The input image is stored in the image storage unit 25b, and output to the subsequent notification image generation unit 25f as an RGB image and an NIR image. In addition, the result of the authenticity determination is also stored in the image storage unit 25b, and is output to the subsequent notification image generation unit 25f.

  The notification image generation unit 25f performs image synthesis for adding an authentication result to the input NIR image. The notification image generation unit 25f outputs the synthesized NIR image (notification image (NIR)) to the image printing unit 25e. The image printing unit 25e prints the NIR image (notification image (NIR)) after synthesis in a visible manner or displays it on a display.

  As described above, the information management can be facilitated by integrally notifying the NIR image and the authentication result as an image.

  In FIG. 33, the authentication result is combined with the NIR image. However, the authentication result may be combined with the visible image.

  FIG. 34 is a diagram for explaining the operation and effect when the invisible / visible image and the result of the authenticity determination are notified integrally. FIG. 34A is an example of a visible image (RGB) and an invisible image (NIR) input to the image notification unit 25, and an authenticity determination result.

  FIG. 34 (b) is an example of a synthesized image, in which the authenticity mark of the NIR image is synthesized with the RGB image, and further the image is synthesized by overwriting the authentication result with the image. The parts are treated as black and white patterns.

  In this way, by combining the image and the result of the authenticity determination to form a single image on the same surface, subsequent information management becomes easy. If the original is fake, there is no authenticity mark, and the result of the authenticity determination is notified by combining a fake character.

  FIG. 34C shows another example of the synthesized image, in which the authentication result is synthesized in the blank area of the authentication mark of the RGB image or the NIR image, and the NIR image portion and the authentication judgment are performed. The result is treated as a monochrome image as described above. In this way, by laying out and authenticating the authentication result in an area different from the area where the image context exists, the visibility of the image information can be maintained. In particular, the effect can be reduced by synthesizing with the NIR image. Can be played).

  In the above example, the authenticity determination result portion is treated as a black-and-white image. However, by combining images in a color different from the visible / invisible image, the visibility of the authenticity determination result can be improved.

  As described above, according to the present embodiment, information management can be facilitated while shortening the authenticity determination work.

(Fifteenth embodiment)
Next, a fifteenth embodiment will be described.

  The authenticity determination system 200 of the fifteenth embodiment differs from the first to fourteenth embodiments in that image information is stored in an external storage (cloud). Hereinafter, in the description of the fifteenth embodiment, the description of the same portions as those in the first to fourteenth embodiments will be omitted, and the description will be different from the first to fourteenth embodiments. The parts will be described.

  Until now, it has been assumed that image information notified to the outside is stored as evidence in local storage capacity or printed paper.However, in reality, a huge storage capacity or space for storing a large amount of printed paper is required. There's a problem.

  Therefore, in the present embodiment, evidence storage is particularly facilitated by storing image information having a particularly large capacity in an external storage and notifying only the access key to the external storage.

  FIG. 35 is a block diagram showing the electrical connections of the components constituting the authenticity determination system 200 according to the fifteenth embodiment. FIG. 35A shows a configuration when image information is stored in an external storage (cloud). In the authentication system 200 shown in FIG. 35A, an external storage (cloud) 92 is connected from the image notification unit 25.

  The external storage (cloud) 92 functions as a storage means and is a storage on a network such as a cloud. The authentication system 200 includes an external storage (cloud) 92.

  FIG. 35B is a diagram illustrating a configuration of the image notification unit 25. As shown in FIG. 35B, the image notification unit 25 receives an authentication result in addition to the visible image and the NIR image. The input image is stored in the image storage unit 25b, and output to the subsequent notification image generation unit 25f as an RGB image and an NIR image. In addition, the result of the authenticity determination is also stored in the image storage unit 25b, and is output to the subsequent notification image generation unit 25f.

  The notification image generation unit 25f performs image synthesis for adding an authentication result to the input NIR image. The notification image generation unit 25f outputs the synthesized NIR image (notification image (NIR)) to the image printing unit 25e. The image printing unit 25e prints the NIR image (notification image (NIR)) after synthesis in a visible manner or displays it on a display.

  In addition, the notification image generation unit 25f outputs storage images (RGB, NIR) for the external storage (cloud) 92. The storage images (RGB, NIR) output from the notification image generator 25f are different from the notification images (RGB, NIR) output from the notification image generator 25f. More specifically, the notification image is an image obtained by synthesizing the authentication result and the like, whereas the storage image is image information before being synthesized.

  As a result, the operator side is immediately notified of the result of the authenticity determination by the notification image immediately. If the validity determination is necessary, the storage image for the external storage (cloud) 92 is called to confirm the validity of the authenticity determination. Such operations are also possible. The access information (access key) to the external storage (cloud) 92 is generated by the notification image generation unit 25f, and is notified to the notification image along with the result of the authentication.

  FIG. 36 is a diagram for explaining the operation and effect when image information is stored in the external storage (cloud) 92. 36, the upper part shows the notification image, and the lower part shows the image stored in the external storage (cloud) 92.

  FIG. 36A shows an example in which a visible (RGB) image and an authentication result are combined with the notification image, and the storage image is an invisible (NIR) image. The difference between the notification image shown in FIG. 36A and the image described in FIG. 34C described in the fourteenth embodiment is that the access information (access key) to the image is located below the authentication result. The point is that they are combined.

  The operator looks at the notified visible information and the result of the authentication, recognizes the result as the primary result of the authentication of a specific individual (document), and then uses the access key added together as necessary to use the access key. The workflow is such that the external storage (cloud) 92 is accessed, the stored invisible image is checked, and the validity is checked. In this case, since the visible image (individual identification information) is first notified together with the authentication result and the access key, information management becomes easy.

  FIG. 36B shows an example in which an invisible image (NIR) and an authentication result are combined with the notification image, and the storage image is a visible image (RGB). The NIR image here is obtained by extracting and enlarging the authenticity determination mark.

  In this case, the operator sees the notified invisible information and the result of the authenticity determination, recognizes the primary result of the authenticity determination, and performs validity determination. Then, the user accesses the external storage (cloud) 92 using the access key added together as necessary, confirms the stored visible image, and identifies an individual as to which document the result is. It becomes a workflow of doing. In this case, since the NIR information is first notified together with the authentication result and the access key, the validity of the authentication can be confirmed in real time.

  FIG. 36C shows an example in which the notification image is only the authentication result and the storage images are a visible (RGB) image and an invisible (NIR) image.

  In this case, the operator looks at the notified authentication result, recognizes the primary result of the authentication, and then accesses the external storage (cloud) 92 using the access key added together as necessary. Then, the workflow is such that the stored visible image and the NIR image are checked, and the validity check and the individual identification of which document is the result are performed. In this case, since only the authentication result and the access key are notified, the primary judgment of the authentication can be performed at an early stage.

  As described above, by storing the image information in the external storage (cloud) 92 and notifying only the access key to the outside, it is possible to easily store the evidence while maintaining the accuracy and validity of the authenticity determination. it can.

  FIG. 37 is a diagram for explaining the operation and effect when both the visible image and the invisible image are stored in the external storage (cloud) 92. In FIG. 37, the upper part shows the notification image, and the lower part shows the image stored in the external storage (cloud) 92.

  FIG. 36 shows an example in which one or both of the visible image and the invisible image that are not included in the notification image are stored in the external storage (cloud) 92. However, from the viewpoint of the storage reliability of the evidence, the notification image Regardless, it is desirable to store both the visible image and the invisible image.

  FIG. 37A shows an example in which the notification key is combined with the individual identification information extracted from the visible (RGB) image, the authentication result, and the access key. Storage images are both visible (RGB) and invisible (NIR) images.

  The workflow of the operator is the same as that described with reference to FIG. 36A, but since both the RGB image and the NIR image are stored in the external storage (cloud) 92, the storage reliability can be improved.

  The notification image in FIG. 37A is an example in which individual identification information extracted from the RGB image is described. However, unlike FIG. 36A, the visible image used for the notification image is stored (backed up). Therefore, it is possible to process the RGB image.

  FIG. 37B is an example in which the notification image is combined with the individual identification information extracted from the visible (RGB) image, the result of the authentication, the access key, and the authentication mark extracted and enlarged from the NIR image. Storage images are both visible (RGB) and invisible (NIR) images.

  The workflow of the operator is basically the same as that of FIG. 37 (a), but the validity check is also performed together with the notification of the authenticity judgment mark. Since both the RGB image and the NIR image are stored in the external storage (cloud) 92, the storage reliability can be improved.

  Note that the notification image in FIG. 37B also illustrates an example in which the individual identification information extracted from the RGB image is described. Since this is also a configuration in which the visible image used for the notification image is stored (backed up), the RGB image Processing is possible.

  As described above, by always storing both the visible image and the invisible image in the external storage (cloud) 92, the storage reliability of the evidence can be improved.

  As described above, according to the present embodiment, storage of evidence for authenticity determination can be facilitated.

(Sixteenth embodiment)
Next, a sixteenth embodiment will be described.

  The authenticity determination system 200 of the sixteenth embodiment differs from the first to fifteenth embodiments in that an access key to image information is encrypted. Hereinafter, in the description of the sixteenth embodiment, the description of the same portions as those in the first to fifteenth embodiments will be omitted, and the description will be different from the first to fifteenth embodiments. The parts will be described.

  The example in which the access key is used to access the external storage (cloud) 92 to acquire the image information has been described above. However, since a person who can see the notification image can easily access the image, there is a problem that security is not preferable. is there.

  Therefore, in the present embodiment, evidence storage can be performed securely by encrypting the access key and notifying it to the outside.

  FIG. 38 is a diagram for explaining an operation and an effect when the access key to the image information is encrypted in the authentication system 200 according to the sixteenth embodiment.

  FIG. 38 shows an example in which an access key is encrypted. FIG. 38 (a) shows a one-dimensional encryption code (example: bar code), and FIG. 38 (b) shows a two-dimensional encryption code (example: QR code (registered trademark)). )). Code symbols such as barcodes and QR codes are already widely used encryption methods, and can be easily encrypted by using them.

  As described above, by encrypting and notifying the access key, secure evidence storage becomes possible.

  As described above, according to the present embodiment, the access information is encrypted, so that the evidence storage can be performed securely.

  In each of the above embodiments, an example in which the image forming apparatus of the present invention is applied to a multifunction peripheral having at least two functions of a copy function, a printer function, a scanner function, and a facsimile function will be described. The present invention can be applied to any image forming apparatus such as a printer, a printer, a scanner, a facsimile, and the like.

  Further, in each of the above-described embodiments, the example in which the reading apparatus of the present invention is applied to a multifunction peripheral has been described. However, the present invention is not limited to this, and may be applied to various applications such as inspection in the FA field. Is possible.

  Further, the reader of the present invention can be applied to a bill reader for the purpose of discriminating bills and preventing forgery. Further, the reading device of the present invention is applicable to a device that reads a visible image and an invisible image and performs some processing in the next step.

Reference Signs List 22 correction means 23 control means 25 notifying means 25a, 25b storage means 25f information synthesizing means 26 notification control means 71 synthesizing means 91 authenticity judging means 92 storage means 100 image forming apparatus 101 reading device 102 document support unit 103 image forming unit 200 authenticity judging system

Japanese Patent No. 4821372

Claims (37)

In a reading device that receives and reads light from a subject irradiated with light by a light source with an image sensor,
Control means for controlling a second reading operation for reading the subject as an invisible image;
Correction means for correcting the invisible image,
Notifying means for notifying at least the invisible image after correction to the outside,
A reading device comprising: In a reading device that receives and reads light from a subject irradiated with light by a light source with an image sensor,
Control means for controlling a first reading operation for reading the subject with a visible image and a second reading operation for reading the subject with an invisible image;
Correction means for correcting the visible image or the invisible image,
Notifying means for notifying at least the invisible image after correction to the outside,
A reading device comprising: Notification control means for controlling a notification condition of the notification means,
The reading device according to claim 1, further comprising: The notification unit has a storage unit that stores at least the invisible image,
The notification control unit controls to notify an image stored in the storage unit to the outside at an arbitrary timing,
The reader according to claim 3, wherein: The correcting unit outputs an image of the entire surface of the subject to the notifying unit,
The reading device according to any one of claims 1 to 4, wherein: The correcting unit outputs an image obtained by enlarging a part of the entire surface of the subject to the notifying unit,
The reading device according to claim 1, wherein: The notifying unit notifies the outside of the invisible image by a print image,
The reading device according to claim 1, wherein: The second reading operation is a reading operation in an infrared region.
The reading device according to any one of claims 1 to 7, wherein: The correcting unit converts the invisible image into a monochrome image.
The reading device according to any one of claims 1 to 8, wherein: The second reading operation is capable of continuously reading the invisible image of the subject.
The reading device according to any one of claims 1 to 9, wherein: The notification unit inputs the corrected visible image and the invisible image, and notifies the visible image and the invisible image integrally.
The reading device according to any one of claims 1 to 10, wherein: The notifying unit notifies the visible image and the invisible image by printing them on a first surface and a second surface of a print image, respectively.
The reading device according to claim 11, wherein: The control means performs the first reading operation and the second reading operation simultaneously;
The reader according to claim 2, wherein: The first reading operation is an operation of reading a first surface of the subject,
The second reading operation is an operation of reading a second surface of the subject.
14. The reading device according to claim 13, wherein: The notifying unit includes a synthesizing unit that synthesizes the visible image read in the first reading operation and the invisible image read in the second reading operation on the same plane.
The reading device according to claim 13, wherein: The combining means lays out the visible image and the invisible image in different areas on the same surface,
The reading device according to claim 15, wherein: The combining means changes the color of the invisible image with respect to the visible image,
17. The reading device according to claim 15, wherein: The correction unit performs a contrast enhancement process on the invisible image,
The reading device according to any one of claims 1 to 17, wherein: The contrast enhancement process is a binarization process.
19. The reader according to claim 18, wherein: The correction means performs a contrast suppression process of suppressing the contrast of the visible image,
The reading device according to any one of claims 1 to 19, wherein: The contrast suppression process is an integration filter process.
21. The reading device according to claim 20, wherein: The correction unit performs a line drawing process of connecting dots of the invisible image,
The reading device according to any one of claims 1 to 21, characterized in that: A reading device according to any one of claims 1 to 22,
A document supporting portion for positioning a document to be read by the reading device at a reading position of the reading device;
An image forming unit;
An image forming apparatus comprising: A reading device according to any one of claims 1 to 22,
Authenticity determining means for determining whether the subject is true using the invisible image,
With
The authentication result determined by the authentication unit is notified to the outside by the notification unit,
An authenticity determination system characterized by the following. The notifying unit includes an information synthesizing unit that performs image synthesis to lay out the invisible image or the visible image and the authentication result on the same surface,
The notifying unit notifies the invisible image and the authenticity determination result,
The authenticity determination system according to claim 24, wherein: The information synthesizing unit synthesizes the invisible image and the authentication result with an image, and lays out the invisible image and the authentication result in another area on the same surface.
The authenticity determination system according to claim 25, wherein: The information synthesizing unit changes the color of the authentication result with respect to the invisible image,
The authenticity determination system according to claim 25 or 26, wherein: The information combining means makes the color of the authentication result different from the visible image,
The authenticity determination system according to claim 27, wherein: Having storage means for storing the visible image or the invisible image on a network,
The authentication unit generates access information to the storage unit,
The notifying unit notifies the visible image or the invisible image to the outside by notifying the access information,
The authenticity determination system according to any one of claims 24 to 28, wherein: In the notification means, the authentication result, the access information and the individual identification information are notified integrally,
The authenticity determination system according to claim 29, wherein: In the notifying unit, the authentication result, the access information, and the invisible image or a part thereof are integrally notified,
The authenticity determination system according to claim 29, wherein: The notifying unit integrally notifies the authentication result and the access information;
The authenticity determination system according to claim 29, wherein: The notifying unit stores both the visible image and the invisible image in the storage unit,
33. The authenticity determination system according to claim 29, wherein: The access information is encrypted;
An authenticity determination system according to any one of claims 29 to 33, characterized in that: The access information is a code symbol.
35. The authentication system according to claim 34, wherein: A reading method in a reading device that receives light from a subject irradiated with light by a light source with an imaging element and reads the light,
A control step of controlling a second reading operation of reading the subject as an invisible image;
A correction step of performing correction on the invisible image,
Notifying step of notifying at least the invisible image after correction to the outside,
A reading method, comprising: A reading method in a reading device that receives light from a subject irradiated with light by a light source with an imaging element and reads the light,
A control step of controlling a first reading operation of reading the subject with a visible image and a second reading operation of reading the subject with an invisible image;
A correction step of performing correction on the visible image or the invisible image,
Notifying step of notifying at least the invisible image after correction to the outside,
A reading method, comprising:

Images