EP2755163A2 - Biometric information image-capturing device, biometric authentication apparatus and manufacturing method of biometric information image-capturing device - Google Patents
Biometric information image-capturing device, biometric authentication apparatus and manufacturing method of biometric information image-capturing device Download PDFInfo
- Publication number
- EP2755163A2 EP2755163A2 EP13195457.0A EP13195457A EP2755163A2 EP 2755163 A2 EP2755163 A2 EP 2755163A2 EP 13195457 A EP13195457 A EP 13195457A EP 2755163 A2 EP2755163 A2 EP 2755163A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- biometric information
- light
- biometric
- capturing unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004519 manufacturing process Methods 0.000 title claims description 3
- 238000012545 processing Methods 0.000 claims description 36
- 230000003287 optical effect Effects 0.000 claims description 14
- 238000003860 storage Methods 0.000 claims description 14
- 238000009792 diffusion process Methods 0.000 claims description 9
- 238000013459 approach Methods 0.000 claims description 2
- 210000003462 vein Anatomy 0.000 description 31
- 238000005286 illumination Methods 0.000 description 12
- 238000000034 method Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 10
- 238000004891 communication Methods 0.000 description 9
- 230000010287 polarization Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000009826 distribution Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 239000004925 Acrylic resin Substances 0.000 description 1
- 229920000178 Acrylic resin Polymers 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 229920003023 plastic Polymers 0.000 description 1
- 229920003229 poly(methyl methacrylate) Polymers 0.000 description 1
- 239000004926 polymethyl methacrylate Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/24—Coupling light guides
- G02B6/42—Coupling light guides with opto-electronic elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/141—Control of illumination
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/147—Details of sensors, e.g. sensor lenses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
- G06V40/1324—Sensors therefor by using geometrical optics, e.g. using prisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10T—TECHNICAL SUBJECTS COVERED BY FORMER US CLASSIFICATION
- Y10T29/00—Metal working
- Y10T29/49—Method of mechanical manufacture
- Y10T29/49826—Assembling or joining
Definitions
- the present disclosure relates to a biometric information image-capturing device which photographs biometric information and a manufacturing method thereof, and a biometric authentication apparatus.
- a biometric authentication technology has been developed authenticating a user of an apparatus or a system based on biometric image in which biometric information such as vein pattern of hands or fingers, fingerprints, or palm prints is represented.
- the biometric information image-capturing device photographs a body part including the biometric information of the user who intends to use the biometric authentication apparatus to acquire a biometric image which represents the biometric information.
- the biometric authentication apparatus matches the input biometric information of the user represented in the biometric image with the registered biometric information represented in a biometric image of a registered user who is registered in advance.
- the biometric authentication apparatus When it is determined that the input biometric information coincides with the registered biometric information based on a matching result, the biometric authentication apparatus authenticates the user as the registered user who has been authorized. Also, the biometric authentication apparatus permits the authenticated user to use an apparatus equipped with the biometric authentication apparatus or another apparatus connected with the biometric authentication apparatus.
- biometric information image-capturing device which includes an image capturing unit which photographs the biometric information along with a light source which illuminates the body part including the biometric information in order to have sufficient contrast in the biometric information. Also, the illumination light from the light source is diffusively reflected from the body part including the biometric information and the diffusively reflected light reaches the image capturing unit, so that a luminance distribution according to the biometric information is reproduced on the biometric image.
- the biometric information used in the biometric authentication is the vein pattern of hands or fingers
- an infrared light emitting diode is used as an illumination light source.
- the infrared light emitted from the infrared light emitting diode is incident into and repeatedly scatters in hands or fingers to finally become a diffusively reflected light which emits from a skin surface.
- Some of light rays are absorbed by, for example, the vein in the course of a diffused reflection of light.
- some of the diffusively reflected light rays reach the image capturing unit.
- the diffusively reflected light described above diffuses toward various directions and thus, the luminance on the image capturing unit generally becomes lower.
- the illumination light rays emitted from the illumination light source are specularly reflected on the surface of the body part including the biometric information. Since the specularly reflected light is directed only toward a direction reflected at a reflection angle which is equal to an incidence angle with respect to the normal line of the surface of the body part, the specularly reflected light is brighter than the diffusively reflected light. Therefore, when both the specularly reflected light and the diffusively reflected light are incident on the image capturing unit, an unevenness of luminance occurs between an area on which the specularly reflected light is impinged and another area on which the specularly reflected light is not impinged.
- the specularly reflected light becomes too bright to exceed a dynamic range of the image capturing unit in the area on which the specularly reflected light is impinged and thus, there is a concern that the luminance distribution of the diffusively reflected light representing the biometric information may not be reproduced. Therefore, a technology for removing the specularly reflected light which reaches the image capturing unit has been suggested. See, for example, Japanese Laid-open Patent Publication No. 2002-200050 and Japanese National Publication of International Patent Application No. 2002-514098 .
- Japanese Laid-open Patent Publication No. 2002-200050 discloses a skin color measurement apparatus in which each of an incident light and a reflected light from a light source is transmitted through a polarization plate, and the reflected light is detected to exclude a surface-reflected light reflected from a surface of skin.
- the skin color measurement apparatus includes two types of the polarization plates having different polarization directions and switches the polarization plate which transmits light between a case of measuring the surface-reflected light and another case of measuring the diffusively reflected light.
- Japanese National Publication of International Patent Application No. 2002-514098 discloses a light emitting device including a plurality of light emitting elements that are able to selectively emit light and are positioned such that a regular reflection is excluded or minimized to avoid obtaining a blurred iris image.
- a mechanism for switching the polarization plate between the case of measuring the surface-reflected light and another case of measuring the diffusively reflected light is needed in the technology described in Japanese Laid-open Patent Publication No. 2002-200050 .
- the polarization plate is generally expensive and thus, the biometric information image-capturing device using the polarization plate becomes expensive as well.
- the iris is photographed while individually controlling the light emitting element to be ON and OFF to obtain an image for which a regular reflected light is removed and thus, there is a concern that it will take a time until the image for which the regular reflected light is removed is obtained. Further, a controller which controls the light emitting element is also needed in this technology.
- biometric information image-capturing device capable of reducing unevenness of luminance on the biometric image caused by the specularly reflected illumination light by the surface of the body part including the biometric information.
- biometric information image-capturing device capable of reducing unevenness of luminance on the biometric image caused by the specularly reflected illumination light by the surface of the body part including the biometric information.
- a biometric information image-capturing device includes an image capturing unit configured to photograph a body part including biometric information to generate a biometric image in which the biometric information is represented, at least one light source disposed in the periphery of the image capturing unit and configured to illuminate light toward a photographing range of the image capturing unit, and a light guide member disposed to be opposed to the at least one light source in the periphery of the image capturing unit and provided with a concaved portion located at a surface of the light guide member, the concaved portion being nearer to the image capturing unit side than the at least one light source.
- the biometric information image-capturing device disclosed in the present disclosure may reduce unevenness of luminance on the biometric image caused by the specularly reflected illumination light by the surface of the body part including the biometric information.
- FIG. 1 is a schematic plan view of a biometric information image-capturing device according to an embodiment.
- FIG. 2 is a schematic side cross sectional view of the biometric information image-capturing device when viewed from an arrow A-A' of FIG. 1 .
- FIG. 3 is a view illustrating an example of a positional relationship between a light source, a subject and an image capturing unit.
- FIG. 4 is a schematic side cross sectional view of the biometric information image-capturing device according to a modified example.
- FIG. 5 is a schematic side cross sectional view of the biometric information image-capturing device according to another modified example.
- FIG. 6 is a view schematically illustrating a configuration of a biometric authentication apparatus including the biometric information image-capturing device.
- the biometric information image-capturing device includes at least one illumination light source located in the periphery of the image capturing unit which photographs the body part including the biometric information and generates an image representing the biometric information, to illuminate a photographing range of the image capturing unit.
- a light guide member is provided to be opposed to the illumination light source and a concaved portion or a recess is formed at a surface opposing the illumination light source of the light guide member and thus, light from the illumination light source from the concaved portion is refracted toward the image capturing unit side to make an incidence angle with respect to a surface of the body part including the biometric information larger. Accordingly, the biometric information image-capturing device suppresses the specularly reflected light from the surface of the body part including the biometric information among light rays emitted from the illumination light source from being reached the image capturing unit.
- the biometric information image-capturing device photographs the vein pattern of a palm to generate an image in which the vein pattern of the palm is represented.
- the biometric information image-capturing device may photograph the biometric information other than the vein pattern of the palm, such as, for example, the vein pattern of hands or fingers, fingerprints, palm prints.
- FIG. 1 is a schematic plan view of a biometric information image-capturing device according to an embodiment.
- FIG. 2 is a schematic side cross sectional view of the biometric information image-capturing device when viewed from an arrow A-A' of FIG. 1 .
- the biometric information image-capturing device 1 includes an image capturing unit 2, a plurality of light sources 3, and a light guide member 4.
- the image capturing unit 2, each of the light sources 3 and the light guide member 4 are accommodated in a rectangular parallelepiped case 5 of which an upper end part is opened. Further, a side wall of the case 5 may be formed in a guide for placing hands.
- a guide for placing hands may be provided in the periphery of an opening of the case 5 separately from the case 5. Further, a plate shaped transparent glass or transparent plastic for protecting the image capturing unit 2, each light source 3 and the light guide member 4 may be disposed on the upper end of the case 5.
- the biometric information image-capturing device 1 illuminates hands placed in the periphery of the opening of the case 5 of an upper side of the biometric information image-capturing device 1 to be opposed to the image capturing unit 2 and each light source 3 with light from each light source 3. Also, the image capturing unit 2 photographs the illuminated hands to generate a biometric image in which the vein pattern of the palm is represented.
- the image capturing unit 2 is disposed at lower part of the case 5 such that a sensor surface is oriented upwardly.
- the image capturing unit 2 includes an area sensor (not illustrated) in which solid-state image-capturing elements having a sensitivity for infrared light are arranged two-dimensionally and an imaging optical system (not illustrated).
- the imaging optical system images an image within a photographing range on the area sensor such that the entirety of the opening of the upper end of the case 5 becomes the photographing range.
- a control signal instructing to photograph is received from a controller (not illustrated) while hands are placed on the periphery of the opening of the upper end of the case 5, the image capturing unit 2 generates the biometric image in which the vein pattern of the palm is represented and outputs the generated biometric image to the controller.
- the plurality of the light sources 3 are disposed to be opposed to the light guide member 4 in order to illuminate the photographing range of the image capturing unit 2.
- the biometric information image-capturing device 1 includes four light sources 3 and the respective light sources 3 are disposed at equal intervals on a circumference centered about an optical axis of the image capturing unit 2.
- each light source 3 may be formed with a light emitting element, for example, an infrared light emitting diode, which emits infrared light such that light from each light source 3 reaches into hands in the present embodiment.
- each light source 3 may be disposed in such a manner that the light emission surface of the light source is oriented toward a right above to allow the center of the light emission intensity distribution to follow along a perpendicular direction., otherwise, the light emission surface of the light source orients upward obliquely to allow the center of the light emission intensity distribution to be inclined nearer to the image capturing unit 2 side than the perpendicular direction.
- the number of the light sources 3 is not limited to four light sources, but may be, for example, three, six or eight light sources. Further, in a case where a light emitting element having sufficient light emission intensity may be used as the light source, the number of the light source 3 may be 1 (one). In the present embodiment, each of the light sources 3 is always lighted ON during photographing of the vein pattern of the palm.
- the light guide member 4 is made of materials, such as acrylic resin or glass, which is transparent to light emitted from the light source 3, and has a ring shape. Further, in the present embodiment, a lower surface and an upper surface of the light guide member 4 is orthogonal to an optical axis OA of the image capturing unit 2, respectively. Also, the light guide members 4 are disposed on the upper side of each light source 3 to be opposed to each light source 3 such that the center of the light guide member 4 is substantially coincided with the optical axis OA of the image capturing unit 2, and thus, the light guide member 4 is fixed on a protrusion provided on, for example, a sidewall of the case 5 by adhesion. Therefore, the light emitted from the light source 3 transmits the light guide member 4 and then, incidents on hands placed on the upper side of the biometric information image-capturing device 1.
- the concaved portion 4a which becomes a concaved shape with respect to the light source 3 is formed on the lower surface of the light guide member 4, that is, a side surface opposing the light source 3. Accordingly, the concaved portion 4a includes a concave surface as illustrated in FIG. 2 .
- the concaved portion 4a may be formed in a ring shape centered about the optical axis OA of the image capturing unit 2, or otherwise, a cross section along a radial direction from the optical axis OA of the image capturing unit 2 may be formed in an arc, parabola or other secondary or higher-order curve. Otherwise, the concaved portion 4a may be formed in a spherical surface shape or aspherical shape such as a paraboloidal surface only at locations opposing the light source 3.
- the concaved portion 4a is formed in such a manner that the center of the concaved portion 4a is formed nearer to the image capturing unit 2 side than the center of the light emission surface of the light source 3 along a line connecting the optical axis of the image capturing unit 2 and the light source 3. Accordingly, light emitted from the light source 3 becomes wider by the concaved portion 4a and also a portion of the emitted light is refracted by the concaved portion 4a such that an angle of the light with respect to the perpendicular direction becomes larger. Therefore, the refracted light is obliquely incident onto the surface of hands at a large incidence angle.
- an incidence angle is equal to a reflection angle and thus, the light specularly reflected from the surface of hands is also reflected at a larger reflection angle.
- the specularly reflected light does not reach the image capturing unit 2 and only the light diffusively reflected on the surface of hands or within the hands reaches the image capturing unit 2.
- the body part 10 including the biometric information covers the entirety of the opening formed at the upper end of the case 5 while being mounted on the upper side of the biometric information image-capturing device 1. Further, for simplicity, it is assumed that the optical axis OA of the image capturing unit 2 is parallel to a perpendicular direction, and also, the surface of the body part 10 including the biometric information is perpendicular to the optical axis OA of the image capturing unit 2.
- the incidence angle is equal to the reflection angle
- the light emitted from the light source 3 is reflected from a point P between the light source 3 and the image capturing unit 2 on a line intersecting a perpendicular surface connecting the light source 3 and the image capturing unit 2, and the surface of the body part10, in order for the light to specularly reflect from the surface of the body part 10 and to be incident on the image capturing unit 2.
- the incidence angle and the reflection angle for the case described above is ⁇ .
- the light emitted from the light source 3 is refracted on the upper surface 4b of the light guide member 4.
- the concaved portion 4a is formed as in the shape of the curved surface 300 indicated by a dotted line.
- an arrow 301 when the light emitted from the light source 3 is incident on the curved surface 300 parallel to the normal line of the curved surface 300 indicated by the dotted line and further, maintains an angle of ⁇ with respect to the perpendicular direction, the light emitted from the light source 3 travels straightforward without being refracted from the curved surface 300. Therefore, the light is specularly reflected from the body part 10 and incidents onto the image capturing unit 2.
- light ray indicated by the arrow 301 is referred to as the specularly reflected light.
- a position and a curvature of the concaved portion 4a is set such that a normal line 302 at an intersection point Q of the specularly reflected light and the surface of the concaved portion 4a is more separated from the image capturing unit 2 than the specularly reflected light at an outside of the concaved portion 4a. Accordingly, the light emitted from the light source 3 and incident onto the intersection point Q is refracted from the intersection point Q toward the image capturing unit 2 and thus, an incidence angle of the light to the body part 10 becomes larger than the angle of ⁇ and further, the light reaches the body part 10 at a position nearer to a perpendicular upper side of the image capturing unit 2 than the point P. Therefore, the specularly reflected light is not incident on the image capturing unit 2.
- the biometric information image-capturing device may refract the light emitted from the light source towards the image capturing unit side by the concaved portion provided on the light guide member positioned between the light source and the body part including the biometric information to suppress the specularly reflected light from being reached the image capturing unit. Therefore, the biometric information image-capturing device may reduce unevenness of luminance on the biometric image caused by the specularly reflected light. Further, the biometric information image-capturing device does not need a mechanically operating component in order to suppress the specularly reflected light from being reached the image capturing unit. Therefore, the biometric information image-capturing device may be miniaturized. Further, the biometric information image-capturing device does not need a lighting control of the light source and the light source may be always lighted on during photographing and thus, control of the biometric information image-capturing device may be simplified.
- the light guide member may include a diffusion layer which diffuses light refracted from the concaved portion.
- FIG. 4 is a schematic side cross sectional view of the biometric information image-capturing device according to a modified example.
- the respective components of a biometric information image-capturing device 11 according to the modified example are given the same reference numerals as those of the corresponding constitutional elements of the biometric information image-capturing device 1 illustrated in FIG. 1 and FIG. 2 .
- a diffusion layer 6 is provided substantially parallel to a bottom surface of the case 5 within the light guide member 4.
- the diffusion layer 6 forms, for example, the light guide member 4 with an upper side member and a lower side member and is formed by making a boundary surface between the upper side member and the lower side member a rough surface. Otherwise, a light diffusion film or a light diffusion sheet may be disposed between the upper side member and the lower side member of the light guide member 4 as the diffusion layer 6. Further, the diffusion layer 6 may be formed on the upper surface of the light guide member 4.
- the light from the light source 3 is widened by the concaved portion 4a and then, further scattered at the diffusion layer 6. Therefore, the body part including the biometric information placed on the uppers side of the biometric information image-capturing device 11 is illuminated with light rays incoming from various directions. Therefore, the biometric information image-capturing device 11 may further suppress unevenness of luminance of light illuminated to the body part including the biometric information and as a result, unevenness of luminance on the biometric image may be reduced.
- FIG. 5 is a schematic side cross sectional view of the biometric information image-capturing device according to another modified example.
- the respective components of a biometric information image-capturing device 12 according to the modified example are given to the same reference numerals as those of the corresponding constitutional elements of the biometric information image-capturing device 1 illustrated in FIG. 1 and FIG. 2 .
- the upper surface 4b' of the light guide member 4 is formed in a tapered shape such that the light guide member 4 becomes gradually thicker as the light guide member 4 approaches the center, that is, the image capturing unit 2. Therefore, an angle of the light from the light source 3 incident upon the upper surface 4b' becomes larger as compared to a case where the upper surface 4b is orthogonal to the optical axis of the image capturing unit 2. Accordingly, the light is refracted by the upper surface 4b' toward a direction inclined more to the image capturing unit 2 side and thus, an incidence angle of the light incident upon the body part including the biometric information and placed on the upper side of the biometric information image-capturing device 12 also becomes larger. Accordingly, the biometric information image-capturing device 12 may suppress the specularly reflected light on the surface of the body part from being reached the image capturing unit 2.
- a concaved portion may be formed on the upper surface of the light guide member opposing the body part including the biometric information along with another concaved portion formed on a lower surface of the light guide member opposing the light source or instead of the concaved portion formed on the lower surface.
- the concaved portion formed on the upper surface is desirable to be formed in the periphery of the image capturing unit than the light source along a line connecting the optical axis of the image capturing unit and the light source. Accordingly, the concaved portion formed on the upper surface may widen the light from the light source.
- FIG. 6 is a view schematically illustrating a configuration of a biometric authentication apparatus including the biometric information image-capturing device according to the embodiment described above or the modified example thereof.
- the biometric authentication apparatus 100 includes a display unit 101, an input unit 102, a biometric information image-capturing device 103, a communication unit 104, a storage unit 105, and a processing unit 106.
- the display unit 101, the input unit 102 and the biometric information image-capturing device 103 may be provided separately from a case in which the communication unit 104, the storage unit 105 and the processing unit 106 are accommodated.
- the display unit 101, the input unit 102, the biometric information image-capturing device 103, the communication unit 104, the storage unit 105 and the processing unit 106 may be in a single case, such as, so called a notebook type personal computer or a tablet type terminal.
- the biometric authentication apparatus 100 may further include a storage medium access apparatus (not illustrated) which accesses a storage medium such as a magnetic disk, a semiconductor memory card and an optical storage medium.
- the biometric authentication apparatus 100 may read a computer program for a biometric authentication process stored on the storage medium to be executed on the processing unit 106 through, for example, the storage medium access apparatus, and execute the biometric authentication process according to the computer program.
- the biometric authentication apparatus 100 executes the biometric authentication process using the biometric image indicating the vein pattern of the palm, which is generated by the biometric information image-capturing device 103, of a user Also, when it is authenticated that a user is one of registered users as a result of the biometric authentication process, the biometric authentication apparatus 100 permits the user to use a computer equipped with the biometric authentication apparatus 100. Otherwise, the biometric authentication apparatus 100 transmits a signal that the user is authenticated to another device not illustrated through the communication unit 104 to permit the user to use the other device.
- the display unit 101 includes a display device, for example, a liquid crystal display. Also, the display unit 101 displays, for example, a message indicating the body part (right hand or left hand) used for matching, or a guidance message for placing hands on a position at which an appropriate biometric image may be obtained, with respect to the user. Further, the display unit 101 displays various information related to an application executed by the processing unit 106.
- a display device for example, a liquid crystal display.
- the display unit 101 displays, for example, a message indicating the body part (right hand or left hand) used for matching, or a guidance message for placing hands on a position at which an appropriate biometric image may be obtained, with respect to the user. Further, the display unit 101 displays various information related to an application executed by the processing unit 106.
- the input unit 102 includes a pointing device, for example, a keyboard and a mouse. Also, a command, data, a user name or a user identification number input by the user through the input unit 102 is transferred to the processing unit 106.
- the biometric information image-capturing device 103 is a biometric information image-capturing device according to the embodiment described above or the modified example thereof and generates the biometric image indicating the vein pattern of the palm of the user.
- the biometric information image-capturing device 103 transmits the biometric image to the processing unit 106 each time when the biometric image is generated.
- the communication unit 104 includes a communication interface circuit used for connecting the biometric authentication apparatus 100 to a communication network (not illustrated). Also, the communication unit 104 transmits the permission for use or the authentication result with respect to the user received from the processing unit 106 to another device through the communication network.
- the storage unit 105 includes, for example, a non-volatile semiconductor memory and a volatile semiconductor memory. Also, the storage unit 105 stores, for example, an application program used in the biometric authentication apparatus 100, user names, user identification numbers and individual setting information of at least one of registered users. Further, the storage unit 105 stores a program for executing the biometric authentication process. Further, the storage unit 105 stores data for matching that indicates the feature of the vein pattern of the left or right palm which is the registered biometric information of the registered users. The data for matching include a position or a type of a feature point which indicates a characteristic structure such as an end point or a bifurcation point of the vein extracted from the biometric image generated at the time of registration of the registered user or update of the data for matching. Otherwise, the data for matching may be data itself generated at the time of registration of the registered user or at the time of update of the data for matching, or a portion of the biometric image.
- the processing unit 106 includes a single or plural processors and peripheral circuits thereof. Also, the processing unit 106 executes the biometric authentication process using the biometric image in which the biometric information of the user is represented obtained from the biometric information image-capturing device 103.
- the processing unit 106 generates the data for matching indicating features of the biometric information photographed in the biometric image from the biometric image. For example, when the biometric authentication apparatus 100 performs a matching process with a minutiae matching, the processing unit 106 extracts the feature points used in the minutiae matching from the biometric image. Also, the processing unit 106 uses locations of the feature points and the types of the feature points as the data for matching.
- the processing unit 106 distinguishes a vein area which is a set of pixels in which the vein is photographed from a non-vein area which is another set of pixels in which the vein is not photographed.
- the value of the pixel in which the vein is photographed is lower than that of the pixel in which the vein is not photographed in the present embodiment.
- the processing unit 106 binarizes the biometric image such that, for example, a set of pixels having a pixel value which is equal to or less than a binarization threshold value is set as a vein area and another set of pixels having another pixel value which is larger than the binarization threshold value is set as a non-vein area.
- the binarization threshold value is set to, for example, a preset fixed value (e.g., 150) or an average pixel value of the respective pixels within the biometric image.
- the processing unit 106 performs, for example, a thinning process with respect to the set of pixels having pixel values which correspond to the vein on the binarized biometric image to generate a thinned binary image in which the vein is thinned.
- the processing unit 106 scans the thinned binary image using a plurality of templates that correspond to the bifurcation points or the end points of the vein to detect locations of the bifurcation points or the end points on the thinned binary image when the thinned binary image matches with any one of templates.
- the processing unit 106 extracts a central pixel at the detected location or the detected locations as a feature point.
- the processing unit 106 may extract the feature point from the biometric image using another known method which obtains the endpoints and the bifurcation points as the feature points. Further, the processing unit 106 may obtain another feature amount indicating the feature of the vein pattern on the biometric image as the data for matching. For example, the processing unit 106 may divide a subject area into a plurality of blocks and obtain the number of veins for each block as the data for matching.
- the processing unit 106 may extract the biometric image itself or some area including the vein area on the biometric image from the biometric image to define the biometric image itself or some area as the data for matching.
- the processing unit 106 receives the user name or the user identification number from the input unit 102, and the processing unit 106 reads the data for matching of the registered user corresponding to the user name or the user identification number from the storage unit 105. Next, the processing unit 106 matches the data for matching of the user with that of the registered user and calculates a matching score indicating a similarity level between two data for matching to be matched as the result of the matching process.
- the processing unit 106 obtains the number of feature points that match with the feature points included in the data for matching of the registered user and the feature points included in the data for matching of the user with respect to the vein pattern. Next, the processing unit 106 divides the number of the matched feature points by the number of the feature points extracted with respect to the vein pattern of the user to calculate the matching score. Further, when the pattern matching is used, the processing unit 106 calculates a normalized cross-correlation value while changing a relative position of the biometric image and the biometric image in which the vein pattern of the registered user is photographed. Also, the processing unit 106 defines the maximum value of the normalized cross-correlation value as the matching score.
- the processing unit 106 determines that the biometric information of the user is matched with the biometric information of the registered user to be matched, and the processing unit 106 authenticates the user as the registered user.
- the processing unit 106 determines that the biometric information of the user is not matched with the biometric information of the registered user to be matched. In this case, the processing unit 106 does not authenticate the user and displays the authentication result information indicating an authentication result on the display unit.
- the threshold value for determining authentication may be set to a value with which the authentication by the processing unit 106 succeeds only when the registered user is the user himself. Also, the threshold value for determining authentication may be set to another value with which the authentication by the processing unit 106 fails when a person different from the registered user is a user. For example, the threshold value for determining authentication may be set to a value obtained by adding a value obtained by multiplying a difference between the maximum value and the minimum value of the matching score by 0.7 to the minimum of the score value.
- an area on which the specularly reflected light by the body part including the biometric information is impinged is absent on the biometric image and thus, unevenness of luminance on the biometric image is small. Accordingly the biometric information is clearly represented on the biometric image and the biometric authentication apparatus according to the present embodiment may use most of the feature points of the biometric information for matching. Therefore, the biometric authentication apparatus of the present embodiment may enhance the authentication accuracy.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Vascular Medicine (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Image Input (AREA)
Abstract
Description
- The present disclosure relates to a biometric information image-capturing device which photographs biometric information and a manufacturing method thereof, and a biometric authentication apparatus.
- A biometric authentication technology has been developed authenticating a user of an apparatus or a system based on biometric image in which biometric information such as vein pattern of hands or fingers, fingerprints, or palm prints is represented. In the biometric authentication apparatus using such a biometric authentication technology, for example, the biometric information image-capturing device photographs a body part including the biometric information of the user who intends to use the biometric authentication apparatus to acquire a biometric image which represents the biometric information. Also, the biometric authentication apparatus matches the input biometric information of the user represented in the biometric image with the registered biometric information represented in a biometric image of a registered user who is registered in advance. When it is determined that the input biometric information coincides with the registered biometric information based on a matching result, the biometric authentication apparatus authenticates the user as the registered user who has been authorized. Also, the biometric authentication apparatus permits the authenticated user to use an apparatus equipped with the biometric authentication apparatus or another apparatus connected with the biometric authentication apparatus.
- There is a biometric information image-capturing device which includes an image capturing unit which photographs the biometric information along with a light source which illuminates the body part including the biometric information in order to have sufficient contrast in the biometric information. Also, the illumination light from the light source is diffusively reflected from the body part including the biometric information and the diffusively reflected light reaches the image capturing unit, so that a luminance distribution according to the biometric information is reproduced on the biometric image. For example, when the biometric information used in the biometric authentication is the vein pattern of hands or fingers, an infrared light emitting diode is used as an illumination light source. The infrared light emitted from the infrared light emitting diode is incident into and repeatedly scatters in hands or fingers to finally become a diffusively reflected light which emits from a skin surface. Some of light rays are absorbed by, for example, the vein in the course of a diffused reflection of light. Also, some of the diffusively reflected light rays reach the image capturing unit. The diffusively reflected light described above diffuses toward various directions and thus, the luminance on the image capturing unit generally becomes lower.
- In the meantime, some of the illumination light rays emitted from the illumination light source are specularly reflected on the surface of the body part including the biometric information. Since the specularly reflected light is directed only toward a direction reflected at a reflection angle which is equal to an incidence angle with respect to the normal line of the surface of the body part, the specularly reflected light is brighter than the diffusively reflected light. Therefore, when both the specularly reflected light and the diffusively reflected light are incident on the image capturing unit, an unevenness of luminance occurs between an area on which the specularly reflected light is impinged and another area on which the specularly reflected light is not impinged. Further, in some cases, the specularly reflected light becomes too bright to exceed a dynamic range of the image capturing unit in the area on which the specularly reflected light is impinged and thus, there is a concern that the luminance distribution of the diffusively reflected light representing the biometric information may not be reproduced. Therefore, a technology for removing the specularly reflected light which reaches the image capturing unit has been suggested. See, for example, Japanese Laid-open Patent Publication No.
2002-200050 2002-514098 - Japanese Laid-open Patent Publication No.
2002-200050 2002-514098 - A mechanism for switching the polarization plate between the case of measuring the surface-reflected light and another case of measuring the diffusively reflected light is needed in the technology described in Japanese Laid-open Patent Publication No.
2002-200050 2002-514098 - Accordingly, it is preferable to provide a biometric information image-capturing device capable of reducing unevenness of luminance on the biometric image caused by the specularly reflected illumination light by the surface of the body part including the biometric information.
- Accordingly, it is an object in one aspect of the invention to provide a biometric information image-capturing device capable of reducing unevenness of luminance on the biometric image caused by the specularly reflected illumination light by the surface of the body part including the biometric information.
- According to an aspect of the invention, a biometric information image-capturing device includes an image capturing unit configured to photograph a body part including biometric information to generate a biometric image in which the biometric information is represented, at least one light source disposed in the periphery of the image capturing unit and configured to illuminate light toward a photographing range of the image capturing unit, and a light guide member disposed to be opposed to the at least one light source in the periphery of the image capturing unit and provided with a concaved portion located at a surface of the light guide member, the concaved portion being nearer to the image capturing unit side than the at least one light source.
- An object and advantage of the present disclosure is implemented and achieved by elements particularly indicated in claims and a combination thereof. It is to be understood that both the descriptions described above and the descriptions to be described below are illustrative and explanatory, but not intended to limit the present disclosure as in the claims.
- The biometric information image-capturing device disclosed in the present disclosure may reduce unevenness of luminance on the biometric image caused by the specularly reflected illumination light by the surface of the body part including the biometric information.
-
FIG. 1 is a schematic plan view of a biometric information image-capturing device according to an embodiment. -
FIG. 2 is a schematic side cross sectional view of the biometric information image-capturing device when viewed from an arrow A-A' ofFIG. 1 . -
FIG. 3 is a view illustrating an example of a positional relationship between a light source, a subject and an image capturing unit. -
FIG. 4 is a schematic side cross sectional view of the biometric information image-capturing device according to a modified example. -
FIG. 5 is a schematic side cross sectional view of the biometric information image-capturing device according to another modified example. -
FIG. 6 is a view schematically illustrating a configuration of a biometric authentication apparatus including the biometric information image-capturing device. - Hereinbelow, a biometric information image-capturing device according to an embodiment will be described with reference to accompanying drawings. The biometric information image-capturing device includes at least one illumination light source located in the periphery of the image capturing unit which photographs the body part including the biometric information and generates an image representing the biometric information, to illuminate a photographing range of the image capturing unit. Also, in the biometric information image-capturing device, a light guide member is provided to be opposed to the illumination light source and a concaved portion or a recess is formed at a surface opposing the illumination light source of the light guide member and thus, light from the illumination light source from the concaved portion is refracted toward the image capturing unit side to make an incidence angle with respect to a surface of the body part including the biometric information larger. Accordingly, the biometric information image-capturing device suppresses the specularly reflected light from the surface of the body part including the biometric information among light rays emitted from the illumination light source from being reached the image capturing unit.
- In the present embodiment, it is assumed that the biometric information image-capturing device photographs the vein pattern of a palm to generate an image in which the vein pattern of the palm is represented. However, the biometric information image-capturing device may photograph the biometric information other than the vein pattern of the palm, such as, for example, the vein pattern of hands or fingers, fingerprints, palm prints.
-
FIG. 1 is a schematic plan view of a biometric information image-capturing device according to an embodiment.FIG. 2 is a schematic side cross sectional view of the biometric information image-capturing device when viewed from an arrow A-A' ofFIG. 1 . As illustrated inFIG. 1 andFIG. 2 , the biometric information image-capturingdevice 1 includes animage capturing unit 2, a plurality oflight sources 3, and alight guide member 4. Theimage capturing unit 2, each of thelight sources 3 and thelight guide member 4 are accommodated in a rectangularparallelepiped case 5 of which an upper end part is opened. Further, a side wall of thecase 5 may be formed in a guide for placing hands. Otherwise, a guide for placing hands may be provided in the periphery of an opening of thecase 5 separately from thecase 5. Further, a plate shaped transparent glass or transparent plastic for protecting theimage capturing unit 2, eachlight source 3 and thelight guide member 4 may be disposed on the upper end of thecase 5. - The biometric information image-capturing
device 1 illuminates hands placed in the periphery of the opening of thecase 5 of an upper side of the biometric information image-capturingdevice 1 to be opposed to theimage capturing unit 2 and eachlight source 3 with light from eachlight source 3. Also, theimage capturing unit 2 photographs the illuminated hands to generate a biometric image in which the vein pattern of the palm is represented. - The
image capturing unit 2 is disposed at lower part of thecase 5 such that a sensor surface is oriented upwardly. Theimage capturing unit 2 includes an area sensor (not illustrated) in which solid-state image-capturing elements having a sensitivity for infrared light are arranged two-dimensionally and an imaging optical system (not illustrated). The imaging optical system images an image within a photographing range on the area sensor such that the entirety of the opening of the upper end of thecase 5 becomes the photographing range. When a control signal instructing to photograph is received from a controller (not illustrated) while hands are placed on the periphery of the opening of the upper end of thecase 5, theimage capturing unit 2 generates the biometric image in which the vein pattern of the palm is represented and outputs the generated biometric image to the controller. - The plurality of the
light sources 3 are disposed to be opposed to thelight guide member 4 in order to illuminate the photographing range of theimage capturing unit 2. In the present embodiment, the biometric information image-capturingdevice 1 includes fourlight sources 3 and therespective light sources 3 are disposed at equal intervals on a circumference centered about an optical axis of theimage capturing unit 2. Further, eachlight source 3 may be formed with a light emitting element, for example, an infrared light emitting diode, which emits infrared light such that light from eachlight source 3 reaches into hands in the present embodiment. Further, eachlight source 3 may be disposed in such a manner that the light emission surface of the light source is oriented toward a right above to allow the center of the light emission intensity distribution to follow along a perpendicular direction., otherwise, the light emission surface of the light source orients upward obliquely to allow the center of the light emission intensity distribution to be inclined nearer to theimage capturing unit 2 side than the perpendicular direction. Further, the number of thelight sources 3 is not limited to four light sources, but may be, for example, three, six or eight light sources. Further, in a case where a light emitting element having sufficient light emission intensity may be used as the light source, the number of thelight source 3 may be 1 (one). In the present embodiment, each of thelight sources 3 is always lighted ON during photographing of the vein pattern of the palm. - The
light guide member 4 is made of materials, such as acrylic resin or glass, which is transparent to light emitted from thelight source 3, and has a ring shape. Further, in the present embodiment, a lower surface and an upper surface of thelight guide member 4 is orthogonal to an optical axis OA of theimage capturing unit 2, respectively. Also, thelight guide members 4 are disposed on the upper side of eachlight source 3 to be opposed to eachlight source 3 such that the center of thelight guide member 4 is substantially coincided with the optical axis OA of theimage capturing unit 2, and thus, thelight guide member 4 is fixed on a protrusion provided on, for example, a sidewall of thecase 5 by adhesion. Therefore, the light emitted from thelight source 3 transmits thelight guide member 4 and then, incidents on hands placed on the upper side of the biometric information image-capturingdevice 1. - In the present embodiment, the
concaved portion 4a which becomes a concaved shape with respect to thelight source 3 is formed on the lower surface of thelight guide member 4, that is, a side surface opposing thelight source 3. Accordingly, theconcaved portion 4a includes a concave surface as illustrated inFIG. 2 . Theconcaved portion 4a may be formed in a ring shape centered about the optical axis OA of theimage capturing unit 2, or otherwise, a cross section along a radial direction from the optical axis OA of theimage capturing unit 2 may be formed in an arc, parabola or other secondary or higher-order curve. Otherwise, theconcaved portion 4a may be formed in a spherical surface shape or aspherical shape such as a paraboloidal surface only at locations opposing thelight source 3. - The
concaved portion 4a is formed in such a manner that the center of theconcaved portion 4a is formed nearer to theimage capturing unit 2 side than the center of the light emission surface of thelight source 3 along a line connecting the optical axis of theimage capturing unit 2 and thelight source 3. Accordingly, light emitted from thelight source 3 becomes wider by theconcaved portion 4a and also a portion of the emitted light is refracted by theconcaved portion 4a such that an angle of the light with respect to the perpendicular direction becomes larger. Therefore, the refracted light is obliquely incident onto the surface of hands at a large incidence angle. In the specular reflection, an incidence angle is equal to a reflection angle and thus, the light specularly reflected from the surface of hands is also reflected at a larger reflection angle. As a result, the specularly reflected light does not reach theimage capturing unit 2 and only the light diffusively reflected on the surface of hands or within the hands reaches theimage capturing unit 2. - This situation will be described in more detail with reference to
FIG. 3 . In the present embodiment, it is assumed that thebody part 10 including the biometric information covers the entirety of the opening formed at the upper end of thecase 5 while being mounted on the upper side of the biometric information image-capturingdevice 1. Further, for simplicity, it is assumed that the optical axis OA of theimage capturing unit 2 is parallel to a perpendicular direction, and also, the surface of thebody part 10 including the biometric information is perpendicular to the optical axis OA of theimage capturing unit 2. - In the specular reflection, since the incidence angle is equal to the reflection angle, the light emitted from the
light source 3 is reflected from a point P between thelight source 3 and theimage capturing unit 2 on a line intersecting a perpendicular surface connecting thelight source 3 and theimage capturing unit 2, and the surface of the body part10, in order for the light to specularly reflect from the surface of thebody part 10 and to be incident on theimage capturing unit 2. It is assumed that the incidence angle and the reflection angle for the case described above is θ. Further, the light emitted from thelight source 3 is refracted on theupper surface 4b of thelight guide member 4. Therefore, the light is emitted from thelight guide member 4 at an angle of θ in order to be incident on the surface of thebody part 10 at the incidence angle θ. Accordingly, according to the Snell's law, the light emitted from thelight source 3 is incident on theupper surface 4b of thelight guide member 4 at an angle of Φ (=arcsin (sinθ/n)) with respect to the normal line, where "n" is refractive index of thelight guide member 4. - Here, it is assumed that the
concaved portion 4a is formed as in the shape of thecurved surface 300 indicated by a dotted line. As illustrated by anarrow 301, when the light emitted from thelight source 3 is incident on thecurved surface 300 parallel to the normal line of thecurved surface 300 indicated by the dotted line and further, maintains an angle of Φ with respect to the perpendicular direction, the light emitted from thelight source 3 travels straightforward without being refracted from thecurved surface 300. Therefore, the light is specularly reflected from thebody part 10 and incidents onto theimage capturing unit 2. For convenience, light ray indicated by thearrow 301 is referred to as the specularly reflected light. - Accordingly, in the present embodiment, a position and a curvature of the
concaved portion 4a is set such that anormal line 302 at an intersection point Q of the specularly reflected light and the surface of theconcaved portion 4a is more separated from theimage capturing unit 2 than the specularly reflected light at an outside of theconcaved portion 4a. Accordingly, the light emitted from thelight source 3 and incident onto the intersection point Q is refracted from the intersection point Q toward theimage capturing unit 2 and thus, an incidence angle of the light to thebody part 10 becomes larger than the angle of θ and further, the light reaches thebody part 10 at a position nearer to a perpendicular upper side of theimage capturing unit 2 than the point P. Therefore, the specularly reflected light is not incident on theimage capturing unit 2. - As described above, the biometric information image-capturing device may refract the light emitted from the light source towards the image capturing unit side by the concaved portion provided on the light guide member positioned between the light source and the body part including the biometric information to suppress the specularly reflected light from being reached the image capturing unit. Therefore, the biometric information image-capturing device may reduce unevenness of luminance on the biometric image caused by the specularly reflected light. Further, the biometric information image-capturing device does not need a mechanically operating component in order to suppress the specularly reflected light from being reached the image capturing unit. Therefore, the biometric information image-capturing device may be miniaturized. Further, the biometric information image-capturing device does not need a lighting control of the light source and the light source may be always lighted on during photographing and thus, control of the biometric information image-capturing device may be simplified.
- Further, according to a modified example, the light guide member may include a diffusion layer which diffuses light refracted from the concaved portion.
-
FIG. 4 is a schematic side cross sectional view of the biometric information image-capturing device according to a modified example. InFIG. 4 , the respective components of a biometric information image-capturingdevice 11 according to the modified example are given the same reference numerals as those of the corresponding constitutional elements of the biometric information image-capturingdevice 1 illustrated inFIG. 1 andFIG. 2 . In the biometric information image-capturingdevice 11 according to the modified example, adiffusion layer 6 is provided substantially parallel to a bottom surface of thecase 5 within thelight guide member 4. Thediffusion layer 6 forms, for example, thelight guide member 4 with an upper side member and a lower side member and is formed by making a boundary surface between the upper side member and the lower side member a rough surface. Otherwise, a light diffusion film or a light diffusion sheet may be disposed between the upper side member and the lower side member of thelight guide member 4 as thediffusion layer 6.
Further, thediffusion layer 6 may be formed on the upper surface of thelight guide member 4. - Accordingly, the light from the
light source 3 is widened by theconcaved portion 4a and then, further scattered at thediffusion layer 6. Therefore, the body part including the biometric information placed on the uppers side of the biometric information image-capturingdevice 11 is illuminated with light rays incoming from various directions. Therefore, the biometric information image-capturingdevice 11 may further suppress unevenness of luminance of light illuminated to the body part including the biometric information and as a result, unevenness of luminance on the biometric image may be reduced. -
FIG. 5 is a schematic side cross sectional view of the biometric information image-capturing device according to another modified example. InFIG. 5 , the respective components of a biometric information image-capturingdevice 12 according to the modified example are given to the same reference numerals as those of the corresponding constitutional elements of the biometric information image-capturingdevice 1 illustrated inFIG. 1 andFIG. 2 . - In the modified example, the
upper surface 4b' of thelight guide member 4 is formed in a tapered shape such that thelight guide member 4 becomes gradually thicker as thelight guide member 4 approaches the center, that is, theimage capturing unit 2. Therefore, an angle of the light from thelight source 3 incident upon theupper surface 4b' becomes larger as compared to a case where theupper surface 4b is orthogonal to the optical axis of theimage capturing unit 2. Accordingly, the light is refracted by theupper surface 4b' toward a direction inclined more to theimage capturing unit 2 side and thus, an incidence angle of the light incident upon the body part including the biometric information and placed on the upper side of the biometric information image-capturingdevice 12 also becomes larger. Accordingly, the biometric information image-capturingdevice 12 may suppress the specularly reflected light on the surface of the body part from being reached theimage capturing unit 2. - According to another modified example, a concaved portion may be formed on the upper surface of the light guide member opposing the body part including the biometric information along with another concaved portion formed on a lower surface of the light guide member opposing the light source or instead of the concaved portion formed on the lower surface. In this case, the concaved portion formed on the upper surface is desirable to be formed in the periphery of the image capturing unit than the light source along a line connecting the optical axis of the image capturing unit and the light source. Accordingly, the concaved portion formed on the upper surface may widen the light from the light source.
-
FIG. 6 is a view schematically illustrating a configuration of a biometric authentication apparatus including the biometric information image-capturing device according to the embodiment described above or the modified example thereof. As illustrated inFIG. 6 , thebiometric authentication apparatus 100 includes adisplay unit 101, aninput unit 102, a biometric information image-capturingdevice 103, acommunication unit 104, astorage unit 105, and aprocessing unit 106. Thedisplay unit 101, theinput unit 102 and the biometric information image-capturingdevice 103 may be provided separately from a case in which thecommunication unit 104, thestorage unit 105 and theprocessing unit 106 are accommodated. Otherwise, thedisplay unit 101, theinput unit 102, the biometric information image-capturingdevice 103, thecommunication unit 104, thestorage unit 105 and theprocessing unit 106 may be in a single case, such as, so called a notebook type personal computer or a tablet type terminal. Further, thebiometric authentication apparatus 100 may further include a storage medium access apparatus (not illustrated) which accesses a storage medium such as a magnetic disk, a semiconductor memory card and an optical storage medium. Also, thebiometric authentication apparatus 100 may read a computer program for a biometric authentication process stored on the storage medium to be executed on theprocessing unit 106 through, for example, the storage medium access apparatus, and execute the biometric authentication process according to the computer program. - The
biometric authentication apparatus 100 executes the biometric authentication process using the biometric image indicating the vein pattern of the palm, which is generated by the biometric information image-capturingdevice 103, of a user Also, when it is authenticated that a user is one of registered users as a result of the biometric authentication process, thebiometric authentication apparatus 100 permits the user to use a computer equipped with thebiometric authentication apparatus 100. Otherwise, thebiometric authentication apparatus 100 transmits a signal that the user is authenticated to another device not illustrated through thecommunication unit 104 to permit the user to use the other device. - The
display unit 101 includes a display device, for example, a liquid crystal display. Also, thedisplay unit 101 displays, for example, a message indicating the body part (right hand or left hand) used for matching, or a guidance message for placing hands on a position at which an appropriate biometric image may be obtained, with respect to the user. Further, thedisplay unit 101 displays various information related to an application executed by theprocessing unit 106. - The
input unit 102 includes a pointing device, for example, a keyboard and a mouse. Also, a command, data, a user name or a user identification number input by the user through theinput unit 102 is transferred to theprocessing unit 106. - The biometric information image-capturing
device 103 is a biometric information image-capturing device according to the embodiment described above or the modified example thereof and generates the biometric image indicating the vein pattern of the palm of the user. The biometric information image-capturingdevice 103 transmits the biometric image to theprocessing unit 106 each time when the biometric image is generated. - The
communication unit 104 includes a communication interface circuit used for connecting thebiometric authentication apparatus 100 to a communication network (not illustrated). Also, thecommunication unit 104 transmits the permission for use or the authentication result with respect to the user received from theprocessing unit 106 to another device through the communication network. - The
storage unit 105 includes, for example, a non-volatile semiconductor memory and a volatile semiconductor memory. Also, thestorage unit 105 stores, for example, an application program used in thebiometric authentication apparatus 100, user names, user identification numbers and individual setting information of at least one of registered users. Further, thestorage unit 105 stores a program for executing the biometric authentication process. Further, thestorage unit 105 stores data for matching that indicates the feature of the vein pattern of the left or right palm which is the registered biometric information of the registered users. The data for matching include a position or a type of a feature point which indicates a characteristic structure such as an end point or a bifurcation point of the vein extracted from the biometric image generated at the time of registration of the registered user or update of the data for matching. Otherwise, the data for matching may be data itself generated at the time of registration of the registered user or at the time of update of the data for matching, or a portion of the biometric image. - The
processing unit 106 includes a single or plural processors and peripheral circuits thereof. Also, theprocessing unit 106 executes the biometric authentication process using the biometric image in which the biometric information of the user is represented obtained from the biometric information image-capturingdevice 103. - The
processing unit 106 generates the data for matching indicating features of the biometric information photographed in the biometric image from the biometric image. For example, when thebiometric authentication apparatus 100 performs a matching process with a minutiae matching, theprocessing unit 106 extracts the feature points used in the minutiae matching from the biometric image. Also, theprocessing unit 106 uses locations of the feature points and the types of the feature points as the data for matching. - Therefore, the
processing unit 106 distinguishes a vein area which is a set of pixels in which the vein is photographed from a non-vein area which is another set of pixels in which the vein is not photographed. The value of the pixel in which the vein is photographed is lower than that of the pixel in which the vein is not photographed in the present embodiment. Accordingly, theprocessing unit 106 binarizes the biometric image such that, for example, a set of pixels having a pixel value which is equal to or less than a binarization threshold value is set as a vein area and another set of pixels having another pixel value which is larger than the binarization threshold value is set as a non-vein area. The binarization threshold value is set to, for example, a preset fixed value (e.g., 150) or an average pixel value of the respective pixels within the biometric image. - Next, the
processing unit 106 performs, for example, a thinning process with respect to the set of pixels having pixel values which correspond to the vein on the binarized biometric image to generate a thinned binary image in which the vein is thinned. Theprocessing unit 106 scans the thinned binary image using a plurality of templates that correspond to the bifurcation points or the end points of the vein to detect locations of the bifurcation points or the end points on the thinned binary image when the thinned binary image matches with any one of templates. Theprocessing unit 106 extracts a central pixel at the detected location or the detected locations as a feature point. - Further, the
processing unit 106 may extract the feature point from the biometric image using another known method which obtains the endpoints and the bifurcation points as the feature points. Further, theprocessing unit 106 may obtain another feature amount indicating the feature of the vein pattern on the biometric image as the data for matching. For example, theprocessing unit 106 may divide a subject area into a plurality of blocks and obtain the number of veins for each block as the data for matching. - Further, when the
biometric authentication apparatus 100 performs the matching process with a pattern matching, theprocessing unit 106 may extract the biometric image itself or some area including the vein area on the biometric image from the biometric image to define the biometric image itself or some area as the data for matching. - In the meantime, the
processing unit 106 receives the user name or the user identification number from theinput unit 102, and theprocessing unit 106 reads the data for matching of the registered user corresponding to the user name or the user identification number from thestorage unit 105. Next, theprocessing unit 106 matches the data for matching of the user with that of the registered user and calculates a matching score indicating a similarity level between two data for matching to be matched as the result of the matching process. - When the minutiae matching is used, the
processing unit 106 obtains the number of feature points that match with the feature points included in the data for matching of the registered user and the feature points included in the data for matching of the user with respect to the vein pattern. Next, theprocessing unit 106 divides the number of the matched feature points by the number of the feature points extracted with respect to the vein pattern of the user to calculate the matching score. Further, when the pattern matching is used, theprocessing unit 106 calculates a normalized cross-correlation value while changing a relative position of the biometric image and the biometric image in which the vein pattern of the registered user is photographed. Also, theprocessing unit 106 defines the maximum value of the normalized cross-correlation value as the matching score. - When the matching score is equal to or larger than a threshold value for determining authentication, the
processing unit 106 determines that the biometric information of the user is matched with the biometric information of the registered user to be matched, and theprocessing unit 106 authenticates the user as the registered user. - When the matching score is less than the threshold value for determining authentication, the
processing unit 106 determines that the biometric information of the user is not matched with the biometric information of the registered user to be matched. In this case, theprocessing unit 106 does not authenticate the user and displays the authentication result information indicating an authentication result on the display unit. - The threshold value for determining authentication may be set to a value with which the authentication by the
processing unit 106 succeeds only when the registered user is the user himself. Also, the threshold value for determining authentication may be set to another value with which the authentication by theprocessing unit 106 fails when a person different from the registered user is a user. For example, the threshold value for determining authentication may be set to a value obtained by adding a value obtained by multiplying a difference between the maximum value and the minimum value of the matching score by 0.7 to the minimum of the score value. - In the present embodiment, an area on which the specularly reflected light by the body part including the biometric information is impinged is absent on the biometric image and thus, unevenness of luminance on the biometric image is small. Accordingly the biometric information is clearly represented on the biometric image and the biometric authentication apparatus according to the present embodiment may use most of the feature points of the biometric information for matching. Therefore, the biometric authentication apparatus of the present embodiment may enhance the authentication accuracy.
- All examples and conditional language recited herein are intended for pedagogical purposes to aid the reader in understanding the disclosure and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions, nor does the organization of such examples in the specification relate to a showing of the superiority and inferiority of the disclosure. Although the embodiments of the present disclosure have been described in detail, it should be understood that the various changes, substitutions, and alterations could be made hereto without departing from the spirit and scope of the disclosure.
Claims (8)
- A biometric information image-capturing device comprising:an image capturing unit configured to photograph a body part including biometric information to generate a biometric image in which the biometric information is represented;at least one light source disposed in the periphery of the image capturing unit and configured to illuminate light toward a photographing range of the image capturing unit; anda light guide member disposed to be opposed to the at least one light source in the periphery of the image capturing unit and provided with a concaved portion located at a surface of the light guide member, the concaved portion being nearer to the image capturing unit side than the at least one light source.
- The biometric information image-capturing device according to claim 1, wherein the concaved portion is formed on a surface of the light guide member side opposing the at least one light source.
- The biometric information image-capturing device according to claim 1, wherein the concaved portion is formed on one of surfaces of the light guide member side opposing the at least one light source and the other of surfaces of the light guide member is disposed so as to oppose the body part.
- The biometric information image-capturing device according to claim 2, wherein the concaved portion is formed in such a manner that a normal line of the surface of the concaved portion at an intersection point of the light ray and the concaved portion is inclined to be further separated from the image capturing unit than a direction of a predetermined light ray among light rays emitted from the at least one light source incident onto the concaved portion, in order for the predetermined light ray to be specularly reflected from a surface of the body part placed on a predetermined location to be incident upon the image capturing unit.
- The biometric information image-capturing device according to claim 2, wherein the light guide member includes a diffusion layer that diffuses light refracted by the concaved portion.
- The biometric information image-capturing device according to claim 2, wherein the light guide member is formed such that a thickness of the light guide member along the optical axis direction of the image capturing unit becomes thicker as the light guide member approaches the image capturing unit.
- A biometric authentication apparatus comprising:a storage unit configured to store data for registration-matching indicating features of biometric information of a registered user;a biometric information image-capturing device according to claim 1 configured to generate a biometric image in which the biometric information of a user is represented; anda processing unit configured to generate the data for matching indicating the feature of the biometric information of the user from the biometric image and match the data for matching with the data for registration-matching to determine whether the user is to be authenticated as the registered user.
- A manufacturing method of a biometric information image-capturing device comprising:disposing an image capturing unit configured to photograph a body part including biometric information to generate a biometric image in which the biometric information is represented;disposing at least one light source illuminating light toward a photographing range of the image capturing unit in the periphery of the image capturing unit; anddisposing a light guide member including a concaved portion on the surface thereof in the periphery of the image capturing unit such that the light guide member is opposed to the at least one light source, and the concaved portion is located at a surface nearer to the image capturing unit side than the at least one light source.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013004830A JP6075069B2 (en) | 2013-01-15 | 2013-01-15 | Biological information imaging apparatus, biometric authentication apparatus, and manufacturing method of biometric information imaging apparatus |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2755163A2 true EP2755163A2 (en) | 2014-07-16 |
EP2755163A3 EP2755163A3 (en) | 2016-06-29 |
EP2755163B1 EP2755163B1 (en) | 2018-05-30 |
Family
ID=50002403
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13195457.0A Active EP2755163B1 (en) | 2013-01-15 | 2013-12-03 | Biometric information image-capturing device, biometric authentication apparatus and manufacturing method of biometric information image-capturing device |
Country Status (5)
Country | Link |
---|---|
US (1) | US9336427B2 (en) |
EP (1) | EP2755163B1 (en) |
JP (1) | JP6075069B2 (en) |
KR (1) | KR101496586B1 (en) |
CN (1) | CN103929566B (en) |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103002192B (en) * | 2012-12-10 | 2015-05-20 | 威海华菱光电股份有限公司 | Image recognition device and image reading device |
JP6360752B2 (en) * | 2014-08-29 | 2018-07-18 | アルプス電気株式会社 | Illumination imaging device |
CN104318204A (en) * | 2014-09-29 | 2015-01-28 | 上海箩箕技术有限公司 | Fingerprint imaging system and method, fingerprint identification system, electronic apparatus |
WO2016067359A1 (en) * | 2014-10-28 | 2016-05-06 | パイオニア株式会社 | Laser doppler sensor |
US10268874B2 (en) * | 2014-10-29 | 2019-04-23 | Nec Corporation | Biometric authentication apparatus and biometric authentication method |
CN106156694B (en) * | 2015-03-27 | 2021-09-17 | 深圳印象认知技术有限公司 | Image collector bracket component and image collector |
JP6482440B2 (en) * | 2015-09-28 | 2019-03-13 | 京セラ株式会社 | Measuring apparatus and measuring system |
KR101698529B1 (en) * | 2016-04-14 | 2017-02-01 | 에스투원 주식회사 | Mobile scientific investigation apparatus and control method thereof |
CN108241828A (en) * | 2016-12-23 | 2018-07-03 | 创智能科技股份有限公司 | Biological identification device |
FR3065306B1 (en) * | 2017-04-12 | 2019-04-05 | Safran Identity and Security | METHOD OF DETECTING FRAUD |
JP7165909B2 (en) * | 2018-02-28 | 2022-11-07 | パナソニックIpマネジメント株式会社 | Image synthesizing device, iris authentication system, image synthesizing method, and iris authentication method |
CN108615004B (en) * | 2018-04-20 | 2021-09-14 | Oppo广东移动通信有限公司 | Fingerprint identification assembly, display device and electronic device |
JP2018158125A (en) * | 2018-05-29 | 2018-10-11 | パイオニア株式会社 | Laser Doppler Sensor |
JP6899798B2 (en) * | 2018-06-15 | 2021-07-07 | 株式会社東海理化電機製作所 | Biometric information authentication device |
CN113261270A (en) * | 2018-12-26 | 2021-08-13 | 伟摩有限责任公司 | Low beam lighting module |
CH716053A1 (en) * | 2019-04-10 | 2020-10-15 | Smart Secure Id Ag | Biometric formation device and biometric formation method for acquiring image data of a body part of a person with user guidance. |
WO2021010017A1 (en) * | 2019-07-12 | 2021-01-21 | ソニー株式会社 | Electronic device |
JP2020058826A (en) * | 2019-12-18 | 2020-04-16 | パイオニア株式会社 | Laser doppler sensor |
FR3113429A1 (en) | 2020-08-17 | 2022-02-18 | Isorg | Image acquisition device |
FR3113431B1 (en) * | 2020-08-17 | 2023-09-15 | Isorg | Image acquisition system |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002514098A (en) | 1996-08-25 | 2002-05-14 | センサー インコーポレイテッド | Device for iris acquisition image |
JP2002200050A (en) | 2000-12-28 | 2002-07-16 | Kao Corp | Skin color meter, skin color diagnostic machine, and face image processor |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09231304A (en) * | 1996-02-27 | 1997-09-05 | Olympus Optical Co Ltd | Code reader |
US6185319B1 (en) * | 1996-12-06 | 2001-02-06 | Yamatake Honeywell Co., Ltd. | Fingerprint input apparatus |
JP2000194829A (en) * | 1998-12-24 | 2000-07-14 | Mitsubishi Electric Corp | Irregular pattern reader |
JP2002112970A (en) | 2000-10-10 | 2002-04-16 | Daito Seiki Co Ltd | Device and method for observing surface of skin |
JP2004005327A (en) | 2002-05-30 | 2004-01-08 | Aisin Engineering Kk | Code reading device |
JP3770241B2 (en) | 2003-03-04 | 2006-04-26 | 株式会社日立製作所 | Personal authentication device and personal authentication method |
JP4804962B2 (en) * | 2006-03-03 | 2011-11-02 | 富士通株式会社 | Imaging device |
JP4745084B2 (en) | 2006-03-03 | 2011-08-10 | 富士通株式会社 | Imaging device |
JP4566930B2 (en) * | 2006-03-03 | 2010-10-20 | 富士通株式会社 | Imaging device |
JP4708220B2 (en) * | 2006-03-03 | 2011-06-22 | 富士通株式会社 | Illumination device and imaging device using the same |
JP2008264185A (en) | 2007-04-19 | 2008-11-06 | Hitachi Maxell Ltd | Imaging module for biometric authentication and biometric authentication apparatus |
US8027519B2 (en) | 2006-12-13 | 2011-09-27 | Hitachi Maxwell, Ltd. | Imaging module for biometrics authentication, biometrics authentication apparatus and prism |
DE102009003765A1 (en) * | 2009-04-08 | 2010-10-14 | Eurodelta Gmbh | Device for detecting biometric features |
JP5056867B2 (en) * | 2009-07-01 | 2012-10-24 | カシオ計算機株式会社 | Biological information detection apparatus and biological information detection method |
EP2495682B1 (en) * | 2009-10-30 | 2018-07-25 | Fujitsu Frontech Limited | Illumination optical system of image capturing device |
JP2011215665A (en) | 2010-03-31 | 2011-10-27 | Hitachi Media Electoronics Co Ltd | Finger vein authentication device |
-
2013
- 2013-01-15 JP JP2013004830A patent/JP6075069B2/en active Active
- 2013-12-03 EP EP13195457.0A patent/EP2755163B1/en active Active
- 2013-12-04 US US14/096,495 patent/US9336427B2/en not_active Expired - Fee Related
- 2013-12-18 CN CN201310697844.1A patent/CN103929566B/en active Active
- 2013-12-18 KR KR20130158403A patent/KR101496586B1/en active IP Right Grant
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002514098A (en) | 1996-08-25 | 2002-05-14 | センサー インコーポレイテッド | Device for iris acquisition image |
JP2002200050A (en) | 2000-12-28 | 2002-07-16 | Kao Corp | Skin color meter, skin color diagnostic machine, and face image processor |
Also Published As
Publication number | Publication date |
---|---|
CN103929566B (en) | 2017-09-26 |
EP2755163A3 (en) | 2016-06-29 |
JP6075069B2 (en) | 2017-02-08 |
JP2014137641A (en) | 2014-07-28 |
KR20140092220A (en) | 2014-07-23 |
US9336427B2 (en) | 2016-05-10 |
EP2755163B1 (en) | 2018-05-30 |
KR101496586B1 (en) | 2015-02-26 |
CN103929566A (en) | 2014-07-16 |
US20140198957A1 (en) | 2014-07-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9336427B2 (en) | Biometric information image-capturing device, biometric authentication apparatus and manufacturing method of biometric information image-capturing device | |
EP2551790B1 (en) | Biometric authentication device and adjustment method for position of hand of user in biometric authentication device | |
US7747046B2 (en) | Apparatus and method for obtaining images using a prism | |
KR101222308B1 (en) | Biometric information processing device and recording medium | |
US10043087B2 (en) | Living body identification device, living body identification method and living body authentication system | |
US8300903B2 (en) | Imaging apparatus and method for authentication of user | |
KR101701559B1 (en) | Image correction apparatus, image correction method, and biometric authentication apparatus | |
EP2172911A2 (en) | Authentication apparatus | |
JP5982311B2 (en) | Blood vessel imaging device | |
US7081951B2 (en) | Palm print scanner and methods | |
WO2022148382A1 (en) | Biometric acquisition and recognition system and method, and terminal device | |
JP7259866B2 (en) | Imaging device and imaging method | |
KR102089618B1 (en) | Method and system for collecting means of publictransportation fares using bi0-information | |
WO2001065466A2 (en) | Method and apparatus for detecting a color change of a live finger | |
KR20040042727A (en) | fingerprint input apparatus using a optics | |
JP2018005723A (en) | Biometric authentication device | |
CN216817443U (en) | Compact optical fingerprint sensor | |
EP3627380B1 (en) | A method of verifying the acquisition of an individual's biometric data | |
US11200401B2 (en) | Method and device for biometric vascular recognition and/or identification | |
TWI666591B (en) | Optical detection method for multiple fingerprint information authentication and information processing device using the same | |
KR20220037473A (en) | Shooting device and authentication device | |
CN115497128A (en) | Biological characteristic capture device | |
JP2013033555A (en) | Biometric authentication device | |
JP2009070100A (en) | Personal identification device, program, and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20131203 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06K 9/20 20060101ALI20160525BHEP Ipc: G06K 9/00 20060101AFI20160525BHEP Ipc: G02B 6/00 20060101ALN20160525BHEP Ipc: G06F 21/32 20130101ALN20160525BHEP |
|
R17P | Request for examination filed (corrected) |
Effective date: 20160712 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
17Q | First examination report despatched |
Effective date: 20170228 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06K 9/00 20060101AFI20180131BHEP Ipc: G06F 21/32 20130101ALN20180131BHEP Ipc: G06K 9/20 20060101ALI20180131BHEP Ipc: G02B 6/00 20060101ALN20180131BHEP |
|
INTG | Intention to grant announced |
Effective date: 20180216 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1004366 Country of ref document: AT Kind code of ref document: T Effective date: 20180615 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013038076 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180530 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180830 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180830 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180831 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1004366 Country of ref document: AT Kind code of ref document: T Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013038076 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20190301 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181203 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20181231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181203 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181231 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181203 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20131203 Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180930 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602013038076 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G06K0009000000 Ipc: G06V0010000000 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20221027 Year of fee payment: 10 Ref country code: FR Payment date: 20221110 Year of fee payment: 10 Ref country code: DE Payment date: 20221102 Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602013038076 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20231203 |