JP5241650B2 - Serial number recognition device and paper sheet processing device - Google Patents

Description

  The present invention relates to a serial number recognition device that processes paper sheets such as banknotes and securities on which unique serial numbers are described, and recognizes the serial numbers described on the paper sheets, and the serial number recognition The present invention relates to a paper sheet processing apparatus to which the apparatus is applied.

  Conventionally, there is a device that processes paper sheets such as banknotes and securities with unique serial numbers and recognizes the serial numbers described in the paper sheets (for example, see Patent Documents 1 and 2). . The serial number is a character string composed of a plurality of digits and symbols. The recognized serial number can be used for identifying counterfeit tickets, stolen tickets, and the like.

  In addition, with respect to a paper sheet whose serial number is described in two places, any character of the serial number described in one area (hereinafter referred to as a serial number area) is dirty or blurred. In some cases, the device recognizes the serial number of the paper sheet by recognizing the character corresponding to the serial number described in the other serial number area (see Patent Document 3).

Japanese Patent Laid-Open No. 10-154256 JP 2007-219817 A JP-A-62-280993

  However, even in the configuration of Patent Document 3, if the same digit character cannot be recognized due to dirt or fading in the serial number described in the two serial number areas, the serial number cannot be recognized. . That is, there is a problem in that the recognition rate, which is the ratio of the number of paper sheets whose serial numbers can be recognized, is not sufficiently improved with respect to the total number of processed paper sheets.

  An object of the present invention is to provide a serial number recognition device that sufficiently improves the recognition possibility ratio, which is the ratio of the number of paper sheets whose serial number can be recognized to the total number of processed paper sheets, and the serial number An object of the present invention is to provide a paper sheet processing apparatus to which a recognition device is applied.

  The serial number recognition device of the present invention is configured as follows in order to solve the above problems.

  An image acquisition unit acquires an image of a paper sheet on which serial numbers composed of unique character strings are written in at least two places. A serial number written on a banknote or a security is usually a character string combining uppercase alphabets or numbers. Capital letters and numbers are letters composed of a group of consecutive dots.

  In addition, as a character composed of a plurality of separated dot groups, for example, there are “i” and “j” which are lowercase alphabets.

  The serial number area cutout means cuts out images of two serial number areas in which unique serial numbers are written from the sheet image acquired by the image acquisition means. The character cutout means cuts out the character of each digit for the serial number described in the serial number area from the image of the two serial number areas cut out by the serial number area cutout means. The character composite image generation means generates a continuous group of dots as the character image of the digit, using the character image of the corresponding digit cut out from the image of the two serial number areas by the character cutout means.

  For example, the character composite image generation means generates a logical sum image obtained by taking the logical sum of the character images of the corresponding digits cut out from the images of the two serial number areas, and if there are a plurality of clusters of consecutive dot groups, A dot group having the longest perimeter is defined as a character composite image of that digit.

  Therefore, by recognizing the generated character composite image of this digit even in the case where the character of the same digit cannot be recognized due to dirt, blurring, etc. in the serial number described in the two serial number regions The serial number can be recognized. That is, it is possible to sufficiently improve the recognition availability ratio, which is the ratio of the number of paper sheets whose serial numbers can be recognized to the total number of processed paper sheets.

  In addition, as one of the two serial number areas, the serial number described is recognized, and at this time, the character of the digit that could not be recognized is authenticated by the character described in the other serial number area. Also good. In this case, when the same digit character cannot be authenticated in both serial number areas, the character synthesized image is generated and authenticated by the character synthesized image generating means, thereby shortening the processing time. Can be planned.

  According to the present invention, it is possible to improve the recognition possibility ratio, which is the ratio of the number of paper sheets whose serial number can be recognized to the total number of processed paper sheets.

It is a figure which shows the internal structure of a banknote processing apparatus. It is a block diagram which shows the structure of the principal part of a banknote processing apparatus. It is a block diagram which shows the structure of an identification unit. It is the schematic which shows the structure of the imaging part of an identification unit. It is a figure which shows the serial number described in the banknote. It is a figure which shows serial number area | region information. It is a flowchart which shows the identification process which determines whether it is a banknote which can be handled. It is a flowchart which shows a serial number recognition process. It is a figure explaining extraction of the character which constitutes a serial number. It is a figure explaining extraction of the character which constitutes a serial number. It is a flowchart which shows a synthetic | combination process. It is a figure explaining the synthetic | combination procedure of a character image. It is a flowchart which shows a synthetic | combination process. It is a figure explaining the synthetic | combination procedure of a character image.

  Hereinafter, the banknote processing apparatus which is embodiment of this invention is demonstrated.

  This banknote processing apparatus is applied to an automatic teller machine (ATM) or the like installed in a store of a financial institution. FIG. 1 is a diagram showing an internal configuration of the banknote handling apparatus. FIG. 2 is a block diagram showing the configuration of the main part of the banknote handling apparatus. The banknote handling apparatus 1 includes a main control unit 2, an identification unit 3, a transport unit 4, and an operation / display unit 5.

  The main control unit 2 controls the operation of each unit provided in the bill processing apparatus 1 main body. A serial number recognition unit 30 according to an embodiment of the present invention is applied to the identification unit 3. The serial number recognition unit 30 recognizes a unique serial number described on the bill to be processed. The identification unit 3 identifies the denomination, authenticity, etc. of the banknote for each banknote to be processed.

  The conveyance unit 4 conveys a banknote along the banknote conveyance path 40 formed inside the banknote processing apparatus 1 main body. The banknote transport path 40 connects the deposit / withdrawal banknote storage unit 41, the identification unit 3, the temporary storage unit 42, the money type cartridges 43 (43 </ b> A, 43 </ b> B, 43 </ b> C), the recovery cartridge 44, and the replenishment cartridge 45. In the banknote transport path 40, a plurality of sensors for detecting the banknote being transported are arranged.

  The deposit / withdrawal port is provided with a shutter 41a for restricting the insertion of the deposited banknote into the deposited / withdrawal banknote storage unit 41 and the withdrawal of the withdrawn banknote. The temporary holding unit 42 temporarily holds the deposited banknote. The denomination cartridge 43 stores banknotes of the corresponding denomination (1,000 yen, 5,000 yen, 10,000 yen). For example, the denomination cartridge 43A stores a thousand yen bill. The money type cartridge 43B stores 5,000 yen bills. The money type cartridge 43C stores 10,000 yen bills. The collection cartridge 44 stores banknotes that are not suitable for use as withdrawal banknotes. The replenishment cartridge 45 stores withdrawal banknotes to be replenished to the denomination cartridge 43. The replenishment cartridge 45 is provided with a replenishment banknote collection cartridge (not shown). The replenishing banknote collection cartridge stores banknotes that have been fed out from the replenishing cartridge 45 and are not suitable for use as withdrawal banknotes.

  The operation / display unit 5 receives a display of a guidance screen for an input operation on the main body and an input operation by an operator.

  FIG. 3 is a block diagram showing a schematic configuration of the identification unit. As described above, the serial number recognition unit 30 according to the embodiment of the present invention is applied to the identification unit 3. The identification unit 3 includes a control unit 31, an imaging unit 32, a magnetic pattern reading unit 33, and an image processing unit 34.

  The control unit 31 controls the operation of each unit included in the identification unit 3. The imaging unit 32 images the front and back surfaces of the banknotes that are being transported along the banknote transport path 40. As shown in FIG. 4, the imaging unit 32 has line sensors 321 </ b> A and 322 </ b> A and light sources 321 </ b> B and 322 </ b> B arranged on both upper and lower sides across the banknote conveyance path 40. There are four orientations of banknotes transported through the banknote transport path 40. Specifically, there are four ways depending on the difference between the direction of the surface of the banknote (which of the line sensor 321A or the line sensor 322A faces) and the direction of the banknote with respect to the banknote transport direction. In the imaging unit 32, one of the line sensor 321A or the line sensor 322A images the surface of the banknote, and the other images the back surface of the banknote.

  The magnetic pattern reading part 33 reads the magnetic pattern of the banknote currently conveyed by the banknote conveyance path 40. FIG. The image processing unit 34 processes the front and back images of the banknote imaged by the imaging unit 32, discriminates the denomination, and recognizes a unique serial number described on the banknote. The serial number is a character string composed of a plurality of digits and numbers. Symbols and numbers used for serial numbers are characters that do not have separated dot pieces. Specifically, it is an uppercase alphabet or a number from 0 to 9.

  Note that “i”, “j”, etc., which are lowercase alphabets, are characters having separated dot pieces.

  The image processing unit 34 processes the image of the banknote imaged by the imaging unit 32 and detects the reflected light pattern of the banknote. The banknote has serial numbers on the upper left and lower right of the surface (see FIG. 5). In the following description, the area where the serial number is written on the upper left of the surface is called a first serial number area, and the area where the serial number is written on the lower right of the surface is called a second serial number area.

  As described above, there are four directions of banknotes being conveyed through the banknote conveyance path 40. Moreover, since the imaging part 32 has arrange | positioned line sensor 321A, 322A on both sides on both sides of the banknote conveyance path 40, the surface of the said banknote is imaged irrespective of the direction of the banknote currently conveyed in the banknote conveyance path 40. An image and a captured image of the back surface can be obtained.

  In addition, the image processing unit 34 categorizes the first serial number region and the second description on the captured image of the surface of the banknote for the four orientations of the banknote transported through the banknote transport path 40. Serial number area information indicating the position of the number area is stored (see FIG. 6). This serial number area information is the first on the picked-up image with reference to the corner of the bill (for example, the upper right corner of the bill in the picked-up image) as reference coordinates (0, 0) in the picked-up image of the surface of the bill. The first start coordinates (first area start X coordinate and first area start Y coordinate) indicating the coordinate position of the upper right corner of the serial number area, X of the first serial number area on the captured image Length in the direction (first region size X), length in the Y direction of the first serial number region on the captured image (first region size Y), second serial number region on the captured image The second start coordinates (second area start X coordinate and second area start Y coordinate) indicating the coordinate position of the upper right corner of the image, and the length in the X direction of the second serial number area on the captured image (Second area size X) and the length in the Y direction (second area size Y) of the second serial number area on the captured image Is a registered information. In FIG. 6, only the serial number area information for the 10,000 yen banknote is shown, but this serial number area information is also stored for the 5000 yen banknote and the thousand yen banknote.

  Here, the conveyance route of the banknote in the banknote processing apparatus 1 is demonstrated easily. First, the deposited banknote is inserted into the deposited / withdrawal banknote storage unit 41 by the operator. The banknotes inserted into the deposit / withdrawal banknote storage unit 41 are fed one by one and conveyed to the identification unit 3. The identification unit 3 identifies the denomination, authenticity, etc., and determines whether or not the banknote is a banknote that can be deposited (handled banknote). The banknote determined by the identification unit 3 to be depositable is transported to the temporary storage unit 42. On the other hand, the banknote determined to be non-payable is returned to the deposit / withdrawal banknote storage unit 41. The banknote returned to the deposit / withdrawal banknote storage unit 41 is returned to the operator.

  Thereafter, the banknotes stored in the temporary storage unit 42 are fed out one by one, transported to the identification unit 3 again, and it is determined again whether they are depositable banknotes. The banknote determined by the identification unit 3 to be depositable is transported to the denomination cartridge 43 of the corresponding denomination, and the banknote determined to be unpaid is transported to the collection cartridge 44.

  Next, the withdrawal banknote will be described. Withdrawal banknotes, for each denomination, banknotes corresponding to the number of withdrawals are fed one by one from the corresponding denomination denomination type cartridge 43, conveyed to the identification unit 3, and withdrawable banknotes (handleable banknotes). It is determined whether or not. The banknote determined by the identification unit 3 to be able to be withdrawn is conveyed to the deposit / withdrawal banknote storage unit 41, and the banknote determined to be unable to be withdrawn is conveyed to the collection cartridge 44. Further, each time a banknote is conveyed to the collection cartridge 44, one banknote fed out from the corresponding denomination cartridge 43 is added.

  Finally, supplementary banknotes will be described. The replenishment banknotes are fed one by one from the replenishment cartridge 45, conveyed to the identification unit 3, and it is determined whether or not the banknotes can be withdrawn. The banknote determined by the identification unit 3 to be able to be withdrawn is conveyed to the denomination cartridge 43 of the corresponding denomination, and the banknote that has been determined to be incapable of withdrawal is conveyed to the replenishment collection cartridge.

  Next, details of the identification process for determining whether or not the bill is a handleable bill will be described. FIG. 7 is a flowchart showing this identification processing. In the identification unit 3, the imaging unit 32 images the front surface and the back surface for each banknote to be processed that has been transported along the transport path 40 (s1). Further, the magnetic pattern reading unit 33 reads the magnetic pattern of the bill to be processed (s2). The identification unit 3 collates the captured image of the banknote imaged by the imaging unit 32 with the registered image of the banknote of each denomination to determine the denomination (s3). Furthermore, the similarity between the reflected light pattern in the predetermined reflected light detection area of the banknote and the registered reflected light pattern of the banknote of the denomination, the magnetic pattern in the magnetic pattern detection area of the banknote, and the banknote of the denomination The first authenticity determination for determining the authenticity of the banknote is performed depending on whether the similarity to the registered magnetic pattern exceeds a predetermined value (s4). If the similarity of at least one of the reflected light pattern and the magnetic pattern does not exceed a predetermined value in s4, it is determined that the banknote cannot be handled (banknote that cannot be deposited or banknote that cannot be withdrawn) (s5).

  If the similarity of both the reflected light pattern and the magnetic pattern exceeds a predetermined value in s4, the identification unit 3 performs a serial number recognition process for recognizing the serial number of the banknote (s6). Details of the serial number recognition process in s6 will be described later. If the serial number cannot be recognized by the identification unit 3 (s7), it is determined that the bill cannot be handled in s5.

  When the serial number can be recognized by the identification unit 3 (s7), second authenticity determination is performed to determine whether the banknote with the serial number is a fake ticket or a stolen ticket (unhandled banknote) (s8). s8 is a process in which the serial number of the banknote to be processed recognized this time is collated with the serial number of a fake ticket or a stolen banknote registered in advance, and determined based on the collation result. The verification of the serial number may be performed by storing information in which the serial number of the fake ticket or the stolen banknote is registered in the identification unit 3 and performed by the identification unit 3, or notifying the host apparatus of the serial number recognized this time. However, it is also possible to use a configuration in which this higher-level device collates.

  If the identification unit 3 determines in the second authenticity determination relating to s8 that the bill to be processed is not a fake ticket or a stolen ticket, the identification unit 3 determines that the bill to be processed is a handleable bill (s9). On the other hand, if it is determined in the second authenticity determination relating to s8 that the banknote to be processed is a fake ticket or a stolen ticket, the banknote to be processed is determined to be an unhandled banknote in s5.

  The identification unit 3 notifies the main control unit 2 of the determination result in s5 or s9 (s10).

  Next, the serial number recognition process according to s6 will be described. FIG. 8 is a flowchart showing the serial number recognition process. The image processing unit 34 cuts out the first serial number region and the second serial number region from the captured image of the banknote captured by the imaging unit 32 (s11). At this time, the identification unit 3 detects the direction of the banknote in the banknote conveyance path 40 from the captured image. The positions of the first serial number area and the second serial number area are obtained from the serial number area information shown in FIG. In s11, if the cut image of the first serial number region and the second serial number region is a color image, binarization processing for converting the image into a binary image is also performed.

  The image processing unit 34 cuts out the characters constituting the serial number described in the first serial number area cut out in s11 one by one (s12). As shown in FIG. 9, the character cutout takes the distribution of black dots in the height direction of the character and detects the position in the width direction for each character. Next, as shown in FIG. 10, the distribution of black dots in the width direction is taken for each character whose position in the width direction is determined, and the position in the height direction is detected for each character. The image processing unit 34 recognizes each character cut out in s12 by known pattern matching (s13). When all the characters can be recognized, the image processing unit 34 sets the serial number of the banknote to be processed based on the recognition result (s14, s20).

  On the other hand, if not all characters can be recognized in s13, characters constituting the serial number described in the second serial number area cut out in s11 are cut out one by one (s15). The process according to s15 is the same as the process according to s12 described above. Then, the image processing unit 34 recognizes each character cut out in s15 by known pattern matching (s16). When all the characters can be recognized, the image processing unit 34 sets the serial number of the bill to be processed based on the recognition result (s17, s20).

  In addition, the process concerning s12-s14 and the process concerning s15-s17 may be configured to be performed first.

  When all characters cannot be recognized in s16, the image processing unit 34 uses both the serial number described in the first serial number area and the serial number described in the second serial number area. It is determined whether there is a digit whose character cannot be recognized (s18). When there is no digit that cannot be recognized in both the serial number described in the first serial number area and the serial number described in the second serial number area, the image processing unit 34 The character of the digit that could not be recognized by the serial number described in the serial number region is replaced with the character of the digit that can be recognized by the serial number described in the other serial number region (s19). The banknote serial number is set (s20).

  When there is a digit that could not be recognized in both the serial number described in the first serial number area and the serial number described in the second serial number area, the image processing unit 34 A synthesis process is performed (s21). Hereinafter, the synthesis process according to s21 will be described.

  FIG. 11 is a flowchart showing the composition processing according to s21. The image processing unit 34 sets a digit that could not be recognized as a processing target digit in both the serial number described in the first serial number area and the serial number described in the second serial number area. (S31). The image processing unit 34 reads the character image in the first serial number area and the character image in the second serial number area for the character of the digit to be processed set in s31 (s32), and outputs these logical sum images. Generate (s33).

  Here, the serial number “I” of the digit to be processed is present. In the first serial number area, there are dot pieces due to the dirt shown in FIG. 12, and in the second serial number area, the fragmentation due to blurring shown in FIG. As an example, a character cannot be recognized due to the occurrence of In s33, a logical sum image of these character images is created.

  If the number of dot pieces in the logical sum image created in s33 is plural (s34), the image processing unit 34 detects the perimeter of each dot piece (s35). Then, the dot piece having the maximum perimeter is extracted as the target character (s36).

  If the number of dot pieces in the logical sum image created in s33 is one, the dot piece is extracted as a target character without performing the processing in s35.

  The image processing unit 34 recognizes the character relating to the dot piece generated in s36, and sets the character recognized here as the character of the target digit (s37). If there is an unprocessed digit (s38), the image processing unit 34 returns to s31 and repeats the above-described processing.

  Each of the image processing units 34 that could not be recognized in both the serial number described in the first serial number area and the serial number described in the second serial number area in the composition processing according to s21 If all the digit characters are recognized, these characters are replaced with the characters recognized in the synthesis process (s22, s23), and this is set as the serial number of the bill to be processed (s20).

  Note that the characters of other digits are recognized by the serial number described in the first serial number area or the serial number described in the second serial number area.

  In addition, in the combination processing according to s21, the character of each digit that could not be recognized in both the serial number described in the first serial number area and the serial number described in the second serial number area. If any of the characters is not recognized, the serial number is not recognized correctly (s22, s24).

  Therefore, even in the case of serial numbers written in the two serial number areas, even if characters of the same digit cannot be recognized due to dirt, blurring, etc., the character of that digit can be recognized. Thereby, the recognition possibility ratio which is a ratio of the number of the banknotes whose serial numbers can be recognized with respect to the total number of banknotes processed can be improved.

  Further, the above-described synthesis process related to s21 may be replaced with the process described below. FIG. 13 is a flowchart showing the synthesis process. The image processing unit 34 sets a digit that could not be recognized as a processing target digit in both the serial number described in the first serial number area and the serial number described in the second serial number area. (S41). The image processing unit 34 reads out the character image in the first serial number region and the character image in the second serial number region for the character of the digit to be processed set in s41 (s42), and performs an exclusive OR of these characters. An image is generated and a logical product image is generated (s43, s44).

  Here, as in the example described above, the serial number “I” of the digit to be processed is present. In the first serial number area, there are dot pieces due to the stains shown in FIG. 14, and in the second serial number area. In the example shown in FIG. 14, the character cannot be recognized due to the fragmentation caused by the blur. In s43, an exclusive OR image of these character images is created. In s44, a logical product image of these character images is created.

  The image processing unit 34 determines whether each dot piece existing in the exclusive OR image generated in s43 is adjacent to any dot piece existing in the logical product image generated in s44 (s45). The image processing unit 34 generates a logical sum image of the dot piece determined to be adjacent to any dot piece existing in the logical product image in s45 and the logical product image generated in s44 ( s46).

  The image processing unit 34 recognizes the character related to the logical sum image generated in s46, and sets the character recognized here as the character of the target digit (s47). If there is an unprocessed digit (s48), the image processing unit 34 returns to s41 and repeats the above-described processing.

  As described above, even in the process shown in FIG. 13, even in the case where a serial number written in two serial number areas cannot recognize a character of the same digit due to dirt, blurring, etc., Can be recognized.

  The present invention can also be applied to an apparatus that processes paper sheets such as securities.

  In addition, the description of the above-described embodiment is an example in all respects, and should be considered not restrictive. The scope of the present invention is shown not by the above embodiments but by the claims. Furthermore, the scope of the present invention is intended to include all modifications within the meaning and scope equivalent to the scope of the claims.

DESCRIPTION OF SYMBOLS 1 ... Banknote processing apparatus 2 ... Main control unit 3 ... Identification unit 30 ... Serial number recognition unit 31 ... Control part 32 ... Imaging part 321A, 322A ... Line sensor 321B, 322B ... Light source 33 ... Magnetic pattern reading part 34 ... Image processing part 4 ... Transport unit 40 ... Banknote transport path 5 ... Display unit

Claims (6)

Image acquisition means for acquiring an image of a paper sheet in which serial numbers consisting of unique character strings are written in at least two places;
Serial number area cutting means for cutting out images of two serial number areas where unique serial numbers are written from the image of the paper sheet acquired by the image acquisition means;
Character cutting means for cutting out characters of each digit for the serial number described in the serial number area from the image of the two serial number areas cut out by the serial number area cutting means,
Using the character image of the corresponding digit cut out from the images of the two serial number regions by the character cutout unit,
Recognizing means for recognizing the character generated by the character composite image generating means,
The serial number recognition device, wherein the character composite image generation means is a means for generating a continuous group of dots as a character image of the digit.   The character composite image generation means generates a logical sum image obtained by logically summing the character images of the corresponding digits cut out from the images of the two serial number regions. The serial number recognition device according to claim 1, which is means for making one dot group a character composite image of that digit based on the specified conditions.   The character composite image generation means generates a logical sum image obtained by taking a logical sum of character images of corresponding digits cut out from images of two serial number regions. The serial number recognition device according to claim 1, which is means for setting a dot group having a longest length to a character composite image of that digit.   When the character extraction means cannot recognize both the character images of the corresponding digits extracted from the images of the two serial number areas, the character composite image generation means generates the character composite image of the digits. The serial number recognition device according to any one of claims 1 to 3, which is means for generating.   The character composite image generation means generates an exclusive logical sum image obtained by taking an exclusive logical sum and a logical product image obtained by performing a logical product for the character images of the corresponding digits cut out from the images of the two serial number areas. And a means for generating a group of continuous dots from the exclusive OR image and the logical product image generated here, and making this a character composite image of that digit. Serial number recognition device. The serial number recognition device according to claim 1,
Paper sheets provided with handling availability determination means for determining whether or not the paper sheet is a handleable paper sheet using the serial number described in the paper sheet recognized by the serial number recognition device Processing equipment.

Images