AU2020200185A1

AU2020200185A1 - Image acquisition device, sheet handling device, banknote handling device, and image acquisition method

Info

Publication number: AU2020200185A1
Application number: AU2020200185A
Authority: AU
Inventors: Akira BOGAKI
Original assignee: Glory Ltd
Current assignee: Glory Ltd
Priority date: 2019-01-11
Filing date: 2020-01-09
Publication date: 2020-07-30
Also published as: JP2020113270A; JP7391668B2; EP3680867B1; EP3680867A1

Abstract

The present invention provides an image acquisition device, a sheet handling device, a banknote handling 5 device, and an image acquisition method enabling acquisition of an image from which a feature of a sheet is detectable in an opaque portion and an image from which a feature of the sheet is detectable in a transparent portion. The image acquisition device includes a light 10 receiving unit and an image generating unit. The light receiving unit receives a first transmitted light generated by transmission of a first emitted light having a first quantity of light through a sheet to output a first image signal and receives a second transmitted light generated by 15 transmission of a second emitted light having a second quantity of light through the sheet to output a second image signal. The image generating unit generates a first transmission image from the first image signal and generates a second transmission image from the second image 20 signal. The second quantity of light is set to be smaller than the first quantity of light. 4/8 FIG.4 21 113 110 111 112 111 BN 311 1 120 124 121 122 123

Description

4/8 FIG.4 21 113

110 111 112 111

BN

311 1

120 124 121 122

IMAGE ACQUISITION DEVICE, SHEET HANDLING DEVICE, BANKNOTE HANDLING DEVICE, AND IMAGE ACQUISITION METHOD TECHNICAL FIELD

[00013 The present invention relates to image acquisition devices, sheet handling devices, banknote handling devices, and image acquisition methods. The present invention specifically relates to an image acquisition device, a sheet handling device, a banknote handling device, and an image acquisition method suitable for detecting a feature of a sheet having a transparent portion.

BACKGROUND ART

[0002] Sheets such as banknotes (printed money), gift vouchers, and checks have a variety of security features for anti-counterfeiting. For example, although paper usually used for sheets is made of vegetable fibers, paper made of synthetic fibers or a polymer sheet made of synthetic resin may be used in order to improve the properties such as durability, water resistance, and security. Banknotes made of polymer sheets are called polymer banknotes and are difficult to counterfeit.

[0003) In collection of features such as the external shape and the presence or absence of a sheet, an optical sensor such as an optical line sensor is usually used. A transparent portion transmits light emitted from the optical sensor, and a sheet having a transparent portion may therefore need to undergo different processes from a common sheet having no transparent portion.

[0004] For example, JP 2013-77163 A discloses an optical reading device and a sheet handling device that irradiate one surface of a sheet with light beams at different wavelengths from two different light sources and receive light beams emitted in such irradiation and passed through the sheet to achieve detection of a watermarked image on the sheet and detection of the shape and the presence or absence of a defect at the same stage.

SUMMARY OF INVENTION

[00051 In recognition of information such as the type and the authenticity of a sheet with the use of an image of the sheet, the image is usually taken by an image acquisition device including an optical line sensor. A transparent portion of the sheet transmits light, such as infrared light, emitted from a light source of the image acquisition device. Thus, also in this case, a sheet having a transparent portion needs to undergo different processes from a common sheet having no transparent portion.

[0006] Specifically, in processing of recognizing a sheet, the external shape (outline) of the sheet first needs to be detected (extracted) from image data based on an output of the optical line sensor. In other words, the image based on the output of the optical line sensor includes not only the sheet but also the background thereof (a region other than the sheet), and the region corresponding to the sheet in the overall image needs to be specified and the external shape of the region needs to be extracted. Still, in the case of a sheet having a transparent portion, the region corresponding to the sheet may not be correctly extracted from the overall image.

[0007) For example, when a transmission image of a banknote having a transparent portion is taken using infrared light in order to detect a feature of ink of the banknote in its opaque portion, the infrared light may pass through the transparent portion and a transmissive image 210 as illustrated in FIG. 8 may be obtained. In this image, a transparent region 212, which corresponds to the transparent portion, in a medium region 211, which corresponds to the banknote, may be assimilated into a background region 213, which corresponds to the region other than the banknote. This is because, in order to detect a feature of ink in an opaque region 214 corresponding to the opaque portion, the quantity of light applied to the banknote needs to be high so that the output of a light receiving unit of an optical line sensor is high. In this case, the output of the light receiving unit in the transparent portion is saturated. In the case as illustrated in FIG. 8, the banknote may be misrecognized as being torn into two pieces. Even when the transparent portion of the banknote has a shading pattern, this shading pattern cannot be detected from the transmission image 210 including the transparent region 212 because the transparent region 212 is a saturated region. Similarly, even when the transparent portion of the banknote has a defect, this defect in the transparent portion cannot be detected from the transmission image 210 including the transparent region 212.

[0008] Further, even when light of different wavelengths is applied to a sheet having a transparent portion as disclosed in JP 2013-77163 A, transmissive light alone of such light of different wavelengths fails to enable correct detection of the external shape and the presence or absence of a variety of sheets having a transparent portion and to enable correct detection of the shading pattern and the presence or absence of a defect in the transparent portion. For example, when a banknote is irradiated with visible light and infrared light each at a quantity of light that enables detection of a feature of ink in an opaque portion, the output of the light receiving unit is saturated for each light in the transparent portion which has a high transmittance, causing a failure in detecting the external shape.

[0009 As described above, conventional techniques need to be improved in order to utilize an image of a sheet to detect any features of the sheet, such as the external shape and the presence or absence of the sheet, a feature of ink, the shading pattern, and the presence or absence of a defect, in not only an opaque portion but also a transparent portion. (0010] In response to the above issues, an object of the present invention is to provide an image acquisition device, a sheet handling device, a banknote handling device, and an image acquisition method enabling acquisition of an image from which a feature of a sheet is detectable in an opaque portion and an image from which a feature of the sheet is detectable in a transparent portion.

[0011] In order to solve the above issues and to achieve the objects, one aspect of the present invention is an image acquisition device comprising: a light source configured to emit light to a sheet; a light receiving unit configured: to receive a first transmitted light generated by transmission of a first emitted light having a first quantity of light through the sheet to output a first image signal, the first emitted light being emitted from the light source; and to receive a second transmitted light generated by transmission of a second emitted light having a second quantity of light through the sheet to output a second image signal, the second emitted light being emitted from the light source; and an image generating unit configured: to generate a first transmission image from the first image signal; and to generate a second transmission image from the second image signal, wherein the second quantity of light is set to be smaller than the first quantity of light.

[0012] In the above aspect of the present invention, the first quantity of light is set to a quantity of light at which the first transmission image includes a saturated region, and the second quantity of light is set to a quantity of light at which a region in the second transmission image corresponding to the saturated region is unsaturated.

[0013] In the above aspect of the present invention, the saturated region is a region where an image signal has a maximum output, and the quantity of light at which a region is unsaturated is a quantity of light at which an image signal has an output lower than the maximum output.

[0014] In the above aspect of the present invention, the image acquisition device further comprises a control unit configured to control the light source and the image generating unit, wherein the control unit is configured: to control the light source to emit the first and second emitted lights in accordance with timings such that the first and second emitted lights are emitted one after the other in a cyclic manner, and to control the image generating unit to read out the first and second image signals from the light receiving unit synchronously with the timings of emitting of the first and second emitted lights.

[0015] In the above aspect of the present invention, the light receiving unit is configured to receive light emitted from the light source in the absence of the sheet to output a third image signal, the image generating unit is configured to generate a reference waveform from the third image signal, and the second quantity of light is set to allow the reference waveform to satisfy a predetermined condition.

[0016 In the above aspect of the present invention, the light receiving unit is configured to receive light generated by transmission of light emitted from the light source through a reference medium to output a fourth image signal, the image generating unit is configured to generate a reference medium waveform from the fourth image signal, and the first quantity of light is set based on a transmittance of the reference medium calculated from the reference medium waveform.

[0017] In the above aspect of the present invention, the first quantity of light is set such that the transmittance of the reference medium as a whole is uniform.

[0018] In the above aspect of the present invention, the sheet is a banknote, a gift voucher, or a check having a transparent portion, and the image generating unit is configured to generate a transmission image including an image of the transparent portion.

[0019] In the above aspect of the present invention, the transparent portion is a portion having a transmittance of not lower than 30% and not higher than 90% with respect to the first emitted light.

[0020] In the above aspect of the present invention, the light source is configured to emit infrared light to the sheet.

[0021] In the above aspect of the present invention, the ratio of the second quantity of light to the first quantity of light is not less than 1/16 and not more than 1/4.

[0022) In the above aspect of the present invention, the light source is configured to emit visible light to the sheet.

[0023] Another aspect of the present invention is a sheet handling device comprising the above image acquisition device.

[0024] Another aspect of the present invention is a banknote handling device comprising the above image acquisition device.

[0025] Another aspect of the present invention is an image acquisition method comprising: receiving a first transmitted light generated by transmission of a first emitted light having a first quantity of light through a sheet to output a first image signal, the first emitted light being emitted from a light source; receiving a second transmitted light generated by transmission of a second emitted light having a second quantity of light through the sheet to output a second image signal, the second emitted light being emitted from the light source; generating a first transmission image from the first image signal; and generating a second transmission image from the second image signal, wherein the second quantity of light is set to be smaller than the first quantity of light.

[0026] The image acquisition device, the sheet handling device, the banknote handling device, and the image acquisition method of the present invention enables acquisition of an image from which a feature of a sheet is detectable in an opaque portion and an image from which a feature of the sheet is detectable in a transparent portion.

BRIEF DESCRIPTION OF DRAWINGS

[0027] FIG. 1 includes schematic plan views of an exemplary banknote having a transparent portion; FIG. 1(a) illustrates a front surface and FIG. 1(b) illustrates a back surface. FIG. 2 includes schematic views illustrating the summary of Embodiment 1; FIG. 2(a) is a schematic view of an exemplary transmission image of a banknote obtained by applying light having a relatively large quantity of light and FIG. 2(b) is a schematic view of an exemplary transmission image of a banknote obtained by applying light having a relatively small quantity of light. FIG. 3 is a schematic perspective view of the external appearance of a banknote handling device of Embodiment 1. FIG. 4 is a schematic cross-sectional view of the structure of an imaging unit of a banknote recognition device (image acquisition device) of Embodiment 1. FIG. 5 is a block diagram of a structure of the banknote recognition device (image acquisition device) of Embodiment 1. FIG. 6 is a timing chart of exemplary control of light sources by a light source control unit and exemplary control of readout of signals from line sensors by a sensor control unit in Embodiment 1. FIG. 7 is a flowchart of a procedure of acquiring a transmission image using infrared light in the banknote recognition device (image acquisition device) and an image acquisition method of Embodiment 1. FIG. 8 is a schematic view of an exemplary transmission image of a banknote. FIG. 9 is a timing chart of exemplary control of light sources by a light source control unit and exemplary control of readout of signals from line sensors by a sensor control unit in a modified embodiment of the present invention.

DESCRIPTION OF EMBODIMENTS

[0028] Preferred embodiments of the image acquisition device, the sheet handling device, the banknote handling device, and the image acquisition method of the present invention are described below with reference to the drawings. Examples of the sheet to be detected in the present invention include banknotes, checks, gift vouchers, bills, ledgers, documents of value, and card-like media. In other words, the banknote handling device is an embodiment of the sheet handling device. In the following, the present invention is described with devices and methods for banknotes taken as examples. Described in the following as a preferred embodiment of the image acquisition device of the present invention is a banknote recognition device also having a function of an image acquisition device. The banknote recognition device may be a device constituting part of the banknote handling device, or may be a device separate from and not associated with the banknote handling device. Described in the following are examples of a banknote detection device (image acquisition device), a banknote handling device, and an image acquisition method.

[0029] In the description, the term "reflection image" means an image based on the intensity distribution of light generated from light applied to and reflected on a sheet. The term "transmission image" means an image based on the intensity distribution of light generated from light applied to and passed through a sheet.

[00301 (Banknote to be handled) A banknote to be handled in the present embodiment is described here. The banknote to be handled is preferably a polymer banknote having a transparent portion such as a clear window that transmits light such as infrared light and visible light applied. In the present embodiment, a banknote having no transparent portion, such as a paper banknote, may also be handled. Preferred among paper banknotes are a medium having a highly transmissive watermark and a medium having a high transmittance such as an oil-stained banknote. The transparent portion is preferably made from a synthetic resin (polymer). Thus, the banknote to be handled is preferably formed from a polymer sheet. The banknote to be handled may also be a sheet (hybrid banknote) whose transparent portion is formed from a polymer sheet and whose opaque portion is formed from paper made of vegetable fibers or synthetic fibers. As described here, the base material of the banknote to be handled is preferably a polymer or a composite of paper and a polymer. The transparent portion may partially include an optically variable device (OVD) such as rainbow hologram.

[00311 FIG. 1 illustrates a banknote BN1 that is an exemplary banknote to be handled. As illustrated in FIGs. 1(a) and 1(b), the banknote BN1 includes a band-shaped transparent portion BNla at a central portion in the longitudinal direction and opaque portions BN1b at both sides of the transparent portion BNla. The transparent portion BNla may be a region having an infrared (e.g., wavelength range: 760 to 1100 nm) transmittance of not lower than 30% and not higher than 90%, for example, and the front and back surfaces thereof have respective patterns printed thereon. The opaque portions BN1b each may be a region having an infrared transmittance of not higher than 10%, for example, and the front and back surfaces thereof have respective patterns, such as a portrait or the denomination thereof, printed thereon. Each of the patterns on the transparent portion BN1a and the opaque portions BN1b is at least partially printed with infrared absorption ink, so that the pattern is a shading pattern including regions having different infrared transmittances.

[0032] (Summary of the present embodiment) With reference to FIG. 2 and FIG. 8, the summary of the present embodiment is described. When a transmission image of a banknote BN1 having a transparent portion BNla is acquired in a conventional case, for example, the output of a transparent region 212 corresponding to the transparent portion BN1a may be saturated and the region may exhibit highlight clipping, as illustrated in FIG. 8. In this case, a feature of the transparent portion BN1a may not be obtained. This is because light having a relatively large quantity of light needs to be applied to the banknote BN1 so as to enable extraction of a feature of ink at the opaque portion BN1b.

[0033] Thus, in acquiring a transmission image of a banknote BN1 having a transparent portion BN1a in the present embodiment, light (for extracting a feature of ink) having a common quantity of light as in conventional cases and light having a small quantity of light (e.g., 200 digit relative to 255 digit at saturation) that does not cause saturation of the output at a transmittance of 100% (in a medium-absent state) are applied to the banknote BN1, so that two transmission images are acquired. Thereby, the former light having a common quantity of light leads to a transmission image 210, as illustrated in FIG. 2(a), in which the output of the transparent region 212 corresponding to the transparent portion BNla is saturated to cause highlight clipping as in a conventional case, while a feature of ink is imaged in the opaque regions 214 corresponding to the opaque portions BNlb. Thus, the transmission image 210 enables detection of a feature of ink in the opaque portions BN1b and the presence or absence of a defect in the opaque portions BNlb. The latter light having a small quantity of light leads to a transmission image 220, as illustrated in FIG. 2(b), in which the output of the transparent region 222 corresponding to the transparent portion BNla is unsaturated and a feature of the transparent portion BNla is imaged. This can prevent assimilation of the transparent region 222 to a background region 223 (a region other than a medium region 221) corresponding to a region other than the banknote BN1 (a region where the banknote BN1 is absent) and enables detection of connection of the two opaque regions 224 (opaque portions BNlb), which enables precise detection of the external shape of the medium region 221 corresponding to the banknote BN1. The transmission image 220 enables detection of the shading pattern of the transparent portion BNla and the presence or absence of a defect in the transparent portion BNla. For the latter transmission image 220, the light applied to the opaque portions BNlb has a small quantity of light. Thus, no feature of ink may be imaged and shadow clipping may occur in the opaque regions 224 corresponding to the opaque portions BNib. The transparent portion BNla is preferably a portion having a transmittance of not lower than 30% with respect to light emitted from the light source of the banknote recognition device (image acquisition device) of the present embodiment, and may be a portion having a transmittance of not lower than 30% and not higher than 90%. When light applied has a quantity of light that enables extraction of a feature of ink at the opaque portions BN1b and the transparent portion BNla has a transmittance of not lower than 30%, the output of the transparent region may be saturated. Still, as in the present embodiment, light having a smaller quantity of light can lead to a transmission image in which the output of the transparent region is unsaturated. In contrast, if the transparent portion BNla has a transmittance of higher than 90%, no threshold for determining the presence or absence of a medium may be obtained.

[0034] (Structure of banknote handling device) With reference to FIG. 3, the structure of a sheet handling device of the present embodiment is described. The banknote handling device of the present embodiment may have a structure illustrated in FIG. 3, for example. A banknote handling device 300 illustrated in FIG. 3 is a small banknote handling device to be used on a table, and includes a banknote recognition device (not illustrated in FIG. 3) that executes processing of recognizing banknotes, a hopper 301 that supports a stack of banknotes to be handled, two rejecters 302 to which banknotes dispensed from the hopper 301 into a housing 310 are discharged when they are rejected banknotes such as counterfeit notes or suspect notes, an operation unit 303 with which an operator input the instructions, four stackers 306a to 306d that accumulate sorted banknotes whose denomination, authenticity, and fitness are recognized in the housing 310, and a display 305 that displays the information such as the recognition count results of banknotes and the accumulation states of the stackers 306a to 306d. Based on the fitness determination results by the banknote recognition device, the stackers 306a to 306c store fit notes and the stacker 306d stores unfit notes among the four stackers 306a to 306d. A method of sorting banknotes into the stackers 306a to 306d may be selected as appropriate.

[00351 <Structure of imaging unit> With reference to FIG. 4, the structure of an imaging unit that is a main unit of a banknote recognition device of the present embodiment is described. As illustrated in FIG. 4, an imaging unit 21 includes optical line sensors 110 and 120 arranged to face each other. Between the optical line sensors 110 and 120 is formed a gap through which a banknote BN is transported. This gap is a portion of a transport path 311 of the banknote handling device of the present embodiment. The optical line sensors 110 and 120 are respectively placed on the upper and lower sides of the transport path 311.

[0036] The optical line sensor 110 includes two reflection light sources 111, a condenser 112, and a light receiving unit 113. The reflection light sources 111 each emit light at predetermined wavelengths (invisible light such as infrared light and visible light such as single-color light of red, green, blue, or the like, or white light) to the main surface (hereinafter, referred to as the surface A) on the light receiving unit 113 side of a banknote BN. The condenser 112 gathers light emitted from the reflection light sources 111 and reflected on the banknote BN. The light receiving unit 113 includes solid state image sensors (not illustrated) arranged in line along the direction (main scanning direction) perpendicular to the direction (sub-scanning direction) of transporting a banknote BN, and receives the light gathered by the condenser 112 and converts the light into an electric signal. The electric signal is then amplified and converted into digital data by analog-to-digital conversion. The resulting digital data is output as an image signal.

[00371 The optical line sensor 120 includes two reflection light sources 121, a condenser 122, a light receiving unit 123, and a transmission light source 124. The reflection light sources 121 each emit light at predetermined wavelengths (invisible light such as infrared light and visible light such as single-color light of red, green, blue, or the like, or white light) to the main surface (hereinafter, referred to as the surface B) on the light receiving unit 123 side of the banknote BN. The condenser 122 gathers light emitted from the reflection light sources 121 and reflected on the banknote BN. The light receiving unit 123 includes solid state image sensors (not illustrated) arranged in line along the direction perpendicular to the direction of transporting a banknote BN, and receives the light gathered by the condenser 122 and converts the light into an electric signal. The electric signal is then amplified and converted into digital data by analog-to-digital conversion. The resulting digital data is output as an image signal.

[0038] The transmission light source 124 emits light at predetermined wavelengths (invisible light such as infrared light and visible light such as single-color light of red, green, blue, or the like, or white light) to the surface B of the banknote BN. The transmission light source 124 is placed on the optical axis of the condenser 112 of the optical line sensor 110. Part of the light emitted from the transmission light source 124 passes through the banknote BN, gathered by the condenser 112 of the optical line sensor 110, and detected by the light receiving unit

113.

[0039] The light sources 111, 121, and 124 each include a linear light guide (not illustrated) extending in the direction (main scanning direction) perpendicular to the paper surface of FIG. 4 and a plurality of LED elements (not illustrated) arranged at each end (optionally one end) of the light guide.

[0040] The reflection light sources 111 and 121 each may include, as the LED elements, LED elements capable of emitting light within different wavelength ranges, and are each configured to emit light within the selected wavelength ranges. Specifically, for example, the reflection light sources 111 and 121 each include LED elements that emit infrared (IR) light and LED elements that emit visible light (single-color light of red, green, blue, or the like, or white light), and these reflection light sources 111 and 121 emit infrared light and visible light to a sheet.

[00411 The transmission light source 124 may include, as the LED elements, LED elements capable of emitting light within different wavelength ranges, and is configured to emit light within the selected wavelength ranges. Specifically, for example, the transmission light source 124 includes LED elements that emit infrared (IR) light and LED elements that emit visible light (single-color light of red, green, blue, or the like, or white light), and the transmission light source 124 emits infrared light and visible light to a sheet.

[0042] The optical line sensors 110 and 120 repetitively image a banknote BN under transport in the transport direction and output image signals. Thereby, the banknote recognition device of the present embodiment can acquire an image of the whole banknote BN. The banknote recognition device of the present embodiment acquires reflection images of the surface A of the banknote BN and transmission images of the banknote BN based on the output signals from the optical line sensor 110, and acquires reflection images of the surface B of the banknote BN based on the output signals from the optical line sensor 120.

[00431 <Structure of banknote recognition device (image acquisition device)> With reference to FIG. 5, the structure of a banknote recognition device (image acquisition device) of the present embodiment is described. As illustrated in FIG. 5, a banknote recognition device (image acquisition device) 1 of the present embodiment includes a control unit 10, a detection unit 20, and a memory unit 30.

[0044] The control unit 10 includes components such as programs for executing a variety of processing operations stored in the memory unit 30, a central processing unit (CPU) configured to execute the programs, a variety of hardware components to be controlled by the CPU, and a logical device, e.g., a field programmable gate array (FPGA). The control unit 10 controls the components of the banknote recognition device 1 in accordance with the programs stored in the memory unit 30 based on the signals output from the components of the banknote recognition device 1 and the control signals from the control unit 10. The control unit 10 also has functions of a light source control unit 11, a sensor control unit 12, an image generating unit 13, a shape detection unit 14, and a recognition unit 15 in accordance with the program stored in the memory unit 30.

[0045]

In addition to the above imaging unit 21, the detection unit 20 also includes a magnetism detection unit 22, a thickness detection unit 23, and a UV detection unit 24 along the transport path for banknotes. The imaging unit 21 images a banknote as described above and outputs an image signal (image data). The magnetism detection unit 22 includes a magnetism sensor (not illustrated) that determines the magnetism. The magnetism sensor detects the magnetism of magnetic ink printed on a banknote or of a security thread, for example. The magnetism sensor is a magnetism line sensor including magnetism detection devices arranged in line. The thickness detection unit 23 includes a thickness detection sensor (not illustrated) that measures the thickness of a banknote. The thickness detection sensor detects abnormal feeding such as double feeding and banknotes with material such as tape, for example. The thickness detection sensor includes rollers arranged to face each other with the transport path in between, and detects the displacements of the rollers in passing of a banknote by sensors provided for the respective rollers. The UV detection unit 24 includes a ultraviolet light emitting unit (not illustrated) and a light receiving unit (not illustrated), and the light receiving unit detects fluorescence generated when the ultraviolet light emitting unit emits ultraviolet light to a banknote and ultraviolet light passed through the banknote.

[00461 The memory unit 30 includes a non-volatile memory such as a semiconductor memory or a hard disk drive, and stores a variety of programs and a variety of data for controlling the banknote recognition device 1. The memory unit 30 stores imaging parameters such as the wavelength ranges of light emitted from the light sources 111, 121, and 124, the timings of turning on and off the light sources 111, 121, and 124, the values of forward currents applied to the LED elements of the light sources 111, 121, and 124, and the timings of reading out the signals from the optical line sensors 110 and 120, during one cycle of imaging by the imaging unit 21.

[0047] The one cycle of imaging means an imaging pattern in which the parameters, such as the wavelength ranges of the light emitted from the light sources 111, 121, and 124, the timings of turning on and off the light sources 111, 121, and 124, the values of forward currents applied to the LED elements, and the timings of reading out the signals, are set. One cycle of imaging is taken as one period and repetitive consecutive execution of this cycle enables acquisition of an image of the whole banknote.

[10048] The light source control unit 11 performs dynamic lighting control in which the light sources 111, 121, and 124 are sequentially turned on so as to acquire distinct images of a banknote by the light sources 111, 121, and 124. Specifically, the light source control unit 11 controls turning on and off of the light sources 111, 121, and 124 based on the timings set in the imaging parameters. This control is performed using a mechanical clock that changes in accordance with the rate of transporting a banknote and a system clock that is always output at a constant frequency regardless of the rate of transporting a banknote. The light source control unit 11 sets the levels of forward currents applied to the LED elements based on the imaging parameters.

[00491 The sensor control unit 12 controls the timings of reading out the image signals from the optical line sensors 110 and 120 and reads out the image signals from the line sensors synchronously with the timings of turning on and off the light sources 111, 121, and 124 based on the timings set in the imaging parameters. This control is performed using the mechanical clock and the system clock. The sensor control unit 12 then sequentially stores the read-out image signals in a ring buffer (line memory) of the memory unit 30.

[00501 The image generating unit 13 has a function of generating an image based on a variety of signals relating to a banknote acquired from the detection unit 20. Specifically, the image generating unit 13 first decomposes the data (image signals) stored in the ring buffer into data sets for the respective conditions of light application and light reception. More specifically, the data is decomposed into received light intensity data of light generated from visible light applied and reflected, received light intensity data of light generated from infrared light applied and reflected, received light intensity data of light generated from visible light applied and transmitted, and received light intensity data of light generated from infrared light applied and transmitted. The image generating unit 13 then performs correction processing such as cutting of dark outputs, gain adjustment, and correction of bright output levels in accordance with the properties of each decomposed data set, generates a variety of images (image data) of the banknote, and stores the images in the memory unit 30.

[0051] The shape detection unit 14 detects (extracts) the external shape (outline) of a banknote based on an infrared transmission image A of the banknote to be described later. The specification thereof will be described later. The shape detection unit 14 also outputs the outline. information (extracted partial image region) of the banknote to the recognition unit 15.

(00521 The recognition unit 15 utilizes a variety of signals relating to a banknote acquired from the detection unit 20 to execute recognition processing. The recognition unit 15 recognizes at least the denomination and authenticity of the banknote. The recognition unit 15 may have a function of determining the fitness of the banknote. In this case, the recognition unit 15 has a function of detecting the presence or absence of a defect such as soil, fold, or tear in the banknote and detecting the presence or absence of material such as tape attached to the banknote based on the thickness of the banknote, and thereby determining whether the banknote is handled as a fit note to be reused in the market or as an unfit note unsuitable to circulation in the market.

[0053] When the recognition unit 15 uses an image of a banknote taken by the imaging unit 21 for recognition of the information such as the denomination, the authenticity, and the fitness, it utilizes the outline information of the banknote acquired by the shape detection unit 14. For example, based on the outline information of a banknote acquired by the shape detection unit 14, the recognition unit 15 defines a medium region corresponding to the banknote as a recognition target area within the whole image including the banknote and the other region, divides the image data within the area into blocks, and executes recognition processing by, for example, pattern matching.

[00541 In order to recognize the information such as the denomination, the authenticity, and the fitness, the recognition unit 15 may further detect the shading pattern of the transparent portion of a banknote or may detect the presence or absence of a defect in the transparent portion of a banknote based on the infrared transmission image A to be described later.

[0055] <Method of controlling light sources and method of controlling readout of signals from line sensors> With reference to FIG. 6, the control of the light sources by the light source control unit 11 and the control of readout of the signals from the optical line sensors 110 and 120 by the sensor control unit 12 are described. FIG. 6 illustrates the contents and timings of turning on the light sources and of reading out the signals.

[0056] The light source control unit 11 is configured to control the light sources to emit infrared light having a quantity of light a and infrared light having a quantity of light b in accordance with timings such that the infrared light having a quantity of light a and the infrared light having a quantity of light b are emitted one after the other in a cyclic manner. Specifically, as illustrated in the upper row of FIG. 6, at the imaging position of the optical line sensor 110, a banknote under transport is irradiated with infrared light having a quantity of light a from the transmission light source 124, then with infrared light having a quantity of light b from the transmission light source 124, then with visible light from the transmission light source 124, then with infrared light from the reflection light source 111, and then with visible light from the reflection light source 111, during one cycle. The quantity of light a and the quantity of light b correspond respectively to the second quantity of light and the first quantity of light. The infrared light having a quantity of light a and the infrared light having a quantity of light b correspond respectively to the first emitted light and the second emitted light. During the banknote is irradiated with light, the imaging devices of the light receiving unit 113 are exposed to light and thereby store electric charges. The sensor control unit 12 is configured to read out the image signals from the light receiving unit 113 synchronously with the timings of emitting of the infrared light having a quantity of light a and the infrared light having a quantity of light b. In other words, each time the light applied to the banknote is switched, the image signal by the light before switching is read out from the optical line sensor 110. As a result, the optical line sensor 110 acquires data of one line constituting a transmission image by the infrared light having the quantity of light a (hereinafter, referred to as an infrared transmission image A), data of one line constituting a transmission image by the infrared light having the quantity of light b (hereinafter, referred to as an infrared transmission image B), data of one line constituting a transmission image by the visible light (hereinafter, referred to as a visible transmission image), data of one line constituting a reflection image of the surface A by the infrared light (hereinafter, referred to as an infrared reflection image of the surface A), and data of one line constituting a reflection image of the surface A by the visible light (hereinafter, referred to as a visible reflection image of the surface A) during one cycle.

[0057] Repetitive consecutive execution of this one cycle of imaging enables acquisition of the infrared transmission image A, the infrared transmission image B, the visible transmission image, the infrared reflection image of the surface A, and the visible reflection image of the surface A of the whole banknote. The infrared transmission image A and the infrared transmission image B correspond respectively to the second transmission image and the first transmission image.

[00581

As illustrated in the lower row of FIG. 6, at the imaging position of the optical line sensor 120, the reflection light source 121 is first turned off for a predetermined period of time (a period of time during which the sheet is irradiated with light from the transmission light source 124), thereafter the banknote under transport is irradiated with infrared light from the reflection light source 121, and then with visible light from the reflection light source 121, during one cycle. During the banknote is irradiated with light, the imaging devices of the light receiving unit 123 are exposed to light and thereby store electric charges. Also in this case, each time the light applied to the banknote is switched, the image signal by the light before switching is read out from the optical line sensor 120. As a result, the optical line sensor 120 acquires data of one line constituting a reflection image of the surface B by the infrared light (hereinafter, referred to as an infrared reflection image of the surface B) and data of one line constituting a reflection image of the surface B by the visible light (hereinafter, referred to as a visible reflection image of the surface B) during one cycle.

[0059] Repetitive consecutive execution of this one cycle of imaging enables acquisition of the infrared reflection image of the surface B and the visible reflection image of the surface B.

[0060] As illustrated in FIG. 6, the durations of applying the respective types of light are set to be equal to each other. In other words, the durations of storing electric charges by the imaging devices are set to be equal to each other regardless of the type of light.

[0061) The quantity of light a is set to be lower than the quantity of light b. The ratio of the quantity of light a to the quantity of light b is preferably not less than 1/16 and not more than 1/4, although it can be set as appropriate.

[00621 In the present embodiment, the quantity of light is expressed by (level of forward current applied to LED element) x (duration of irradiation). Here, the durations of irradiation are equal to each other as described above, and thus the value of forward current applied to each LED element of the transmission light source 124 is set to be lower in imaging of the infrared transmission image A than in imaging of the infrared transmission image B. The level of forward current applied to an LED element is proportional to the radiant intensity of the LED element, so that the quantity of light can be regarded as being proportional to the radiant intensity of the LED element.

[0063] The quantity of light b is preferably set to a quantity of light at which the infrared transmission image B (specifically, a medium region in the infrared transmission image B corresponding to the banknote, usually a transparent region corresponding to the transparent portion) includes a saturated region (a region exhibiting highlight clipping). This enables detection of a feature of the banknote, such as a feature of ink, in opaque regions corresponding to the opaque portions of the banknote from the infrared transmission image B. In the infrared transmission image B, the whole transparent region may be a saturated region. The saturated region (region exhibiting highlight clipping) is a region where an image signal has a maximum output. Specifically, this region is a region where an output of an image signal is to be a predetermined maximum value (e.g., 255 digit) after the outputs of the optical line sensors 110 and 120 are subjected to dark output correction in which the output with the light sources turned off is set to zero and bright output correction in which gain correction is performed on each pixel such that the output of a white reference medium with the light sources turned on is uniform, and then data constituting a transmission image in the absence of the white reference medium is acquired.

[00641 The quantity of light a is preferably set to a quantity of light at which a region in the infrared transmission image A corresponding to the saturated region of the infrared transmission image B is unsaturated (does not exhibit highlight clipping). This enables detection of a feature of the banknote, such as the external shape, the shading pattern, or the presence or absence of a defect in the transparent portion, in a transparent region corresponding to the transparent portion of the banknote from the infrared transmission image A. The quantity of light at which a region is unsaturated is a quantity of light at which an image signal has an output lower than the maximum value.

[0065] <Method for detecting external shape of banknote> Next, a method for detecting the external shape of a banknote by the shape detection unit 14 is described. The shape detection unit 14 detects (extracts) the external shape (outline) of a banknote based on the infrared transmission image A. In other words, the shape detection unit 14 specifies a medium region (partial image region) from the whole infrared transmission image A including the medium region corresponding to the banknote and a background region corresponding to the region other than the banknote, and then detects the external shape of the medium region.

[0066]

Specifically, the shape detection unit 14 first binarizes the infrared transmission image A based on a predetermined threshold. In other words, each pixel value of the infrared transmission image A is compared with the predetermined threshold; the pixel with a pixel value of lower than the threshold is determined as medium-present, and the pixel data thereof is replaced by 1 (white), while the pixel with a pixel value of not lower than the threshold is determined as medium-absent, and the pixel data thereof is replaced by 0 (black). The shape detection unit 14 then executes edge detection on the binarized infrared transmission image A, and thereby detects the four sides of the banknote from the results of the edge detection. The shape detection unit 14 subsequently executes Hough transform to compute the straight lines passing the four sides of the banknote, thereby determines the four apexes corresponding to the four corners of the banknote.

[00671 In the present embodiment, the quantity of light a in acquiring the infrared transmission image A is set to a quantity of light that is lower than the quantity of light b in acquiring the infrared transmission image B and at which a region in the infrared transmission image A corresponding to the saturated region in the infrared transmission image B is unsaturated. In other words, even when the infrared transmission image A is binarized, the shape detection unit 14 can determine the transparent region corresponding to the transparent portion of the banknote as medium-present. This can prevent highlight clipping of the transparent region in the infrared transmission image A and the resulting assimilation thereof to the background region. As a result, the external shape of the banknote can be detected not only in the opaque regions corresponding to the opaque portions of the banknote but also in the transparent region.

[0068] <Method for acquiring image> Next, the processing by the banknote recognition device 1, in particular the method for acquiring the infrared transmission images A and B of a banknote is described. First described is a method of setting the quantity of light a and the quantity of light b, in other words, a method of initial setting of the transmission light source 124.

[0069] The quantity of light a is preferably set as follows. Specifically, the transmission light source 124 is turned on with no medium such as a banknote placed at the imaging position of the optical line sensor 110. The light receiving unit 113 is made to receive the light (e.g., infrared light) emitted from the transmission light source 124 and to output an image signal (lD data) corresponding to the third image signal. The image generating unit 13 is made to generate a reference waveform from this image signal. The quantity of light a is set to allow this reference waveform to satisfy a predetermined condition.

[0070] The predetermined condition may be set as appropriate in accordance with the characteristics of a medium to be imaged. For example, the quantity of light a may be adjusted by controlling the level of forward current applied to each LED element and the duration of irradiation such that the maximum value of the reference waveform is 200 digit (255 digit indicates saturation, 200 digit indicates a transmittance of 100%), and then the reference waveform may be subjected to correction processing such as cutting of dark outputs, gain adjustment, and correction of bright output levels.

[0071]

Alternatively, the quantity of light a may be calculated from the waveform obtained with a reference medium, which has a lower transmittance than the transparent portion of a banknote to be imaged, placed at the imaging position of the optical line sensor 110.

[0072] The quantity of light b is preferably set as follows. Specifically, the transmission light source 124 is turned on with an entirely white reference medium placed at the imaging position of the optical line sensor 110. The light receiving unit 113 is made to receive the light (e.g., infrared light) emitted from the transmission light source 124 and to output an image signal (1D data) corresponding to the fourth image signal. The image generating unit 13 is made to generate a reference medium waveform from this image signal. The transmittance of the reference medium is calculated from this reference medium waveform, and the quantity of light b is set based on the calculated transmittance of the reference medium. Specifically, the quantity of light b may be set such that the transmittance of the reference medium as a whole is uniform. For example, when 255 digit indicates saturation, the level of forward current applied to each LED element and the duration of irradiation may be controlled such that the maximum value of the reference medium waveform is about 128 digit that is about a half of 255 digit. In order to avoid saturation of the output at the quantity of light b, the output of the image signal may be further controlled such that the maximum value of the reference medium waveform is 4/5 of the original value after each LED element is controlled.

[0073] With reference to FIG. 7, the processing of acquiring the infrared transmission images A and B of a banknote by the banknote recognition device 1 is described. As illustrated in FIG. 7, the light receiving unit 113 first receives light generated by transmission of light having a quantity of light a emitted from the transmission light source 124 through a banknote to output an image signal Si, and receives light generated by transmission of light having a quantity of light b emitted from the transmission light source 124 through the banknote to output an image signal S2 (S11). The quantity of light a is set to be lower than the quantity of light b. The light generated by transmission of light having a quantity of light a through a banknote and the light generated by transmission of light having a quantity of light b through a banknote correspond respectively to the second transmitted light and the first transmitted light. The image signal Si and the image signal S2 correspond respectively to the second image signal and the first image signal.

[00741 Then, the sensor control unit 12 reads out the image signals Si and S2 from the optical line sensor 110 and sequentially stores the read-out image signals S1 and S2 in the ring buffer of the memory unit 30 (S12).

[0075] Then, the image generating unit 13 generates an infrared transmission image A from the data based on the image signal S1 and generates an infrared transmission image B from the data based on the image signal S2 (S13).

[00761 As described above, the quantity of light b is set to a quantity of light at which the infrared transmission image B includes a saturated region, while the quantity of light a is set to a quantity of light at which a region in the infrared transmission image A corresponding to this saturated region is unsaturated.

[0077] As described hereinabove, in the present embodiment, the light receiving unit 113 is configured to receive light generated by transmission of light having a quantity of light a through a banknote to output an image signal Sl, the light having the quantity of light a being emitted from the transmission light source 124, and to receive light generated by transmission of light having a quantity of light b through the banknote to output an image signal S2, the light having the quantity of light b being emitted from the transmission light source 124; and the image generating unit 13 is configured to generate an infrared transmission image A from the image signal Sl and to generate an infrared transmission image B from the image signal S2. The quantity of light a is set to be smaller than the quantity of light b. Preferably, the quantity of light b is set to a quantity of light at which the infrared transmission image B includes a saturated region, and the quantity of light a is set to a quantity of light at which a region in the infrared transmission image A corresponding to this saturated region is unsaturated. This enables detection of a feature of the opaque portions of the banknote from the infrared transmission image B and detection of a feature of the transparent portion of the banknote from the infrared transmission image A.

[0078) Described in the above embodiment is a case where the values of forward currents applied to the LED elements of the transmission light source 124 are different from each other while the durations of applying the respective types of light (i.e., the durations of receiving the respective types of light and storing electric charges by the imaging devices) are set to be equal to each other such that the quantity of light a is lower than the quantity of light b. Still, these durations may be different from each other. Specifically, the duration of irradiating a banknote with light from the transmission light source 124 may be shorter in imaging of the infrared transmission image A than in imaging of the infrared transmission image B, while the value of forward current applied to each LED element of the transmission light source 124 may be equal in both imaging processes. Alternatively, the duration of irradiating a banknote with light from the transmission light source 124 may be shorter in imaging of the infrared transmission image A than in imaging of the infrared transmission image B and the value of forward current applied to each LED element of the transmission light source 124 may be smaller in the former imaging than in the latter imaging.

[0079] Described in the above embodiment is a case where the light having a quantity of light a and the light having a quantity of light b are infrared light. Still, the light having a quantity of light a and the light having a quantity of light b each may be visible light of red, green, blue, or the like, for example. In the case of applying green light, the ratio of the quantity of light a to the quantity of light b is preferably not less than 1/16 and not more than 1/4, although it can be set as appropriate. In other words, the ratio of the quantity of light a to the quantity of light b may vary in accordance with the wavelength range used. The level of the quantity of light a and the level of the quantity of light b may vary in accordance with the wavelength range used.

[0080] With reference to FIG. 9, the control of the light sources by the light source control unit 11 and the control of readout of the signals from the optical line sensors 110 and 120 by the sensor control unit 12 are described in the case where the light having a quantity of light a and the light having a quantity of light b are visible light. FIG. 9 illustrates the contents and timings of turning on the light sources and of reading out the signals. This case is the same as the case of FIG. 6, except for partial difference in the contents and the timings of turning on the light sources.

[0081] In the case of FIG. 9, as illustrated in the upper row of FIG. 9, at the imaging position of the optical line sensor 110, a banknote under transport is irradiated with visible light having a quantity of light a from the transmission light source 124, then with visible light having a quantity of light b from the transmission light source 124, then with infrared light from the transmission light source 124, then with infrared light from the reflection light source 111, and then with visible light from the reflection light source 111, during one cycle. As a result, the optical line sensor 110 acquires data of one line constituting a transmission image by the visible light having the quantity of light a (hereinafter, referred to as a visible transmission image A), data of one line constituting a transmission image by the visible light having the quantity of light b (hereinafter, referred to as a visible transmission image B), data of one line constituting a transmission image by the infrared light (hereinafter, referred to as an infrared transmission image), data of one line constituting an infrared reflection image of the surface A, and data of one line constituting a visible reflection image of the surface A, during one cycle.

[00821 Repetitive consecutive execution of this one cycle of imaging enables acquisition of the visible transmission image A, the visible transmission image B, the infrared transmission image, the infrared reflection image of the surface A, and the visible reflection image of the surface A of the whole banknote. The visible transmission image A and the visible transmission image B correspond respectively to the second transmission image and the first transmission image.

[00831 As illustrated in the lower row of FIG. 9, imaging by the optical line sensor 120 is the same as in the case illustrated in FIG. 6.

[0084] As illustrated in FIG. 9, the durations of applying the respective types of light are set to be equal to each other. In other words, the durations of storing electric charges by the imaging devices are set to be equal to each other regardless of the type of light.

[0085] The quantity of light a is set to be lower than the quantity of light b. The ratio of the quantity of light a to the quantity of light b can be set as appropriate. Still, as described above, the ratio of the quantity of light a to the quantity of light b is preferably not less than 1/16 and not more than 1/4 in the case of applying green light.

[0086] In the case illustrated in FIG. 9, as in the case illustrated in FIG. 6, the quantity of light b is preferably set to a quantity of light at which the visible transmission image B (specifically, a medium region in the visible transmission image B corresponding to the banknote, usually a transparent region corresponding to the transparent portion) includes a saturated region (a region exhibiting highlight clipping). This enables detection of a feature of the banknote, such as a feature of ink, in opaque regions corresponding to the opaque portions of the banknote from the visible transmission image B. In the visible transmission image B, the whole transparent region may be a saturated region.

[0087]

The quantity of light a is preferably set to a quantity of light at which a region in the visible transmission image A corresponding to the saturated region of the visible transmission image B is unsaturated (does not exhibit highlight clipping). This enables detection of a feature of the banknote, such as the external shape, the shading pattern, or the presence or absence of a defect in the transparent portion, in a transparent region corresponding to the transparent portion of the banknote from the visible transmission image A.

[0088] Described in the above embodiment is a case where light having a quantity of light a and light having a quantity of light b are within the same wavelength range. Still, the wavelength range of the light having a quantity of light a and the wavelength range of the light having a quantity of light b may be different from each other.

[0089] Described in the above embodiment is a case where the shape detection unit 14 detects the external shape of a banknote as a feature of the banknote and the recognition unit 15 detects the shading pattern of the transparent portion and the presence or absence of a defect in the transparent portion as features of the banknote based on the infrared transmission image A acquired with a small quantity of light a. Still, the banknote recognition device (image acquisition device) 1 may detect the presence or absence of a banknote based on the infrared transmission image A or the visible transmission image A. Thereby, even when a banknote has a transparent portion at an edge, the banknote recognition device 1 can detect this edge as described above, and thus can correctly detect passing of the banknote. Accordingly, the banknote recognition device (image acquisition device) 1 can also suitably be used as a tracking sensor for detecting the presence or absence of a banknote under transport. (0090] Hereinabove, some embodiments of the present invention are described with reference to the drawings. Still, the present invention is not intended to be limited by the above embodiments. The structures of the embodiments may be appropriately combined with each other or modified within the spirit of the present invention.

INDUSTRIAL APPLICABILITY

[0091] As described above, the present invention provides a technique useful for acquiring an image from which a feature of a sheet is detectable in an opaque portion and an image from which a feature of the sheet is detectable in a transparent portion.

Claims

1. An image acquisition device comprising: a light source configured to emit light to a sheet; a light receiving unit configured: to receive a first transmitted light generated by transmission of a first emitted light having a first quantity of light through the sheet to output a first image signal, the first emitted light being emitted from the light source; and to receive a second transmitted light generated by transmission of a second emitted light having a second quantity of light through the sheet to output a second image signal, the second emitted light being emitted from the light source; and an image generating unit configured: to generate a first transmission image from the first image signal; and to generate a second transmission image from the second image signal, wherein the second quantity of light is set to be smaller than the first quantity of light.

2. The image acquisition device according to claim 1, wherein the first quantity of light is set to a quantity of light at which the first transmission image includes a saturated region, and the second quantity of light is set to a quantity of light at which a region in the second transmission image corresponding to the saturated region is unsaturated.

3. The image acquisition device according to claim 2, wherein the saturated region is a region where an image signal has a maximum output, and the quantity of light at which a region is unsaturated is a quantity of light at which an image signal has an output lower than the maximum output.

4. The image acquisition device according to any one of claims 1 to 3, further comprising a control unit configured to control the light source and the image generating unit, wherein the control unit is configured: to control the light source to emit the first and second emitted lights in accordance with timings such that the first and second emitted lights are emitted one after the other in a cyclic manner, and to control the image generating unit to read out the first and second image signals from the light receiving unit synchronously with the timings of emitting of the first and second emitted lights.

5. The image acquisition device according to any one of claims 1 to 4, wherein the light receiving unit is configured to receive light emitted from the light source in the absence of the sheet to output a third image signal, the image generating unit is configured to generate a reference waveform from the third image signal, and the second quantity of light is set to allow the reference waveform to satisfy a predetermined condition.

6. The image acquisition device according to any one of claims 1 to 5, wherein the light receiving unit is configured to receive light generated by transmission of light emitted from the light source through a reference medium to output a fourth image signal, the image generating unit is configured to generate a reference medium waveform from the fourth image signal, and the first quantity of light is set based on a transmittance of the reference medium calculated from the reference medium waveform.

7. The image acquisition device according to claim 6, wherein the first quantity of light is set such that the transmittance of the reference medium as a whole is uniform.

8. The image acquisition device according to any one of claims 1 to 7, wherein the sheet is a banknote, a gift voucher, or a check having a transparent portion, and the image generating unit is configured to generate a transmission image including an image of the transparent portion.

9. The image acquisition device according to claim 8, wherein the transparent portion is a portion having a transmittance of not lower than 30% and not higher than 90% with respect to the first emitted light.

10. The image acquisition device according to any one of claims 1 to 9, wherein the light source is configured to emit infrared light to the sheet.

11. The image acquisition device according to any one of claims 1 to 10, wherein the ratio of the second quantity of light to the first quantity of light is not less than 1/16 and not more than 1/4.

12. The image acquisition device according to any one of claims 1 to 11, wherein the light source is configured to emit visible light to the sheet.

13. A sheet handling device comprising the image acquisition device according to any one of claims 1 to 12.

14. A banknote handling device comprising the image acquisition device according to any one of claims 1 to 12.

15. An image acquisition method comprising: receiving a first transmitted light generated by transmission of a first emitted light having a first quantity of light through a sheet to output a first image signal, the first emitted light being emitted from a light source; receiving a second transmitted light generated by transmission of a second emitted light having a second quantity of light through the sheet to output a second image signal, the second emitted light being emitted from the light source; generating a first transmission image from the first image signal; and generating a second transmission image from the second image signal, wherein the second quantity of light is set to be smaller than the first quantity of light.