US20220343671A1 - Device for displaying information and for capturing autopodial impressions - Google Patents
Device for displaying information and for capturing autopodial impressions Download PDFInfo
- Publication number
- US20220343671A1 US20220343671A1 US17/764,919 US202017764919A US2022343671A1 US 20220343671 A1 US20220343671 A1 US 20220343671A1 US 202017764919 A US202017764919 A US 202017764919A US 2022343671 A1 US2022343671 A1 US 2022343671A1
- Authority
- US
- United States
- Prior art keywords
- light
- layer
- illumination
- illumination source
- placement surface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005286 illumination Methods 0.000 claims abstract description 158
- 230000003287 optical effect Effects 0.000 claims abstract description 48
- 239000004973 liquid crystal related substance Substances 0.000 claims description 70
- 238000010168 coupling process Methods 0.000 claims description 66
- 238000005859 coupling reaction Methods 0.000 claims description 66
- 238000000034 method Methods 0.000 claims description 21
- 230000005540 biological transmission Effects 0.000 claims description 14
- 230000008878 coupling Effects 0.000 claims description 11
- 230000002745 absorbent Effects 0.000 claims description 9
- 239000002250 absorbent Substances 0.000 claims description 9
- 238000010521 absorption reaction Methods 0.000 claims description 6
- 230000009471 action Effects 0.000 claims description 4
- 230000008859 change Effects 0.000 claims description 4
- 230000023077 detection of light stimulus Effects 0.000 claims description 3
- 230000003213 activating effect Effects 0.000 claims description 2
- 230000001953 sensory effect Effects 0.000 claims 1
- 239000010410 layer Substances 0.000 description 228
- 230000010287 polarization Effects 0.000 description 14
- 238000010276 construction Methods 0.000 description 12
- 239000011521 glass Substances 0.000 description 11
- 239000000463 material Substances 0.000 description 6
- 239000000758 substrate Substances 0.000 description 6
- 239000000853 adhesive Substances 0.000 description 4
- 230000001070 adhesive effect Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 239000004417 polycarbonate Substances 0.000 description 4
- 239000011241 protective layer Substances 0.000 description 4
- 230000007423 decrease Effects 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000000576 coating method Methods 0.000 description 2
- 239000010408 film Substances 0.000 description 2
- 238000000265 homogenisation Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000007373 indentation Methods 0.000 description 2
- 239000004033 plastic Substances 0.000 description 2
- 229920003023 plastic Polymers 0.000 description 2
- 229920003229 poly(methyl methacrylate) Polymers 0.000 description 2
- 229920000515 polycarbonate Polymers 0.000 description 2
- 239000004926 polymethyl methacrylate Substances 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- NIXOWILDQLNWCW-UHFFFAOYSA-M Acrylate Chemical compound [O-]C(=O)C=C NIXOWILDQLNWCW-UHFFFAOYSA-M 0.000 description 1
- 239000012790 adhesive layer Substances 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000000149 argon plasma sintering Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 239000006059 cover glass Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 150000002118 epoxides Chemical class 0.000 description 1
- -1 for example Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 230000005923 long-lasting effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229920001296 polysiloxane Polymers 0.000 description 1
- 239000011148 porous material Substances 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
- 239000012780 transparent material Substances 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
- G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0013—Means for improving the coupling-in of light from the light source into the light guide
- G02B6/0015—Means for improving the coupling-in of light from the light source into the light guide provided on the surface of the light guide or in the bulk of it
- G02B6/002—Means for improving the coupling-in of light from the light source into the light guide provided on the surface of the light guide or in the bulk of it by shaping at least a portion of the light guide, e.g. with collimating, focussing or diverging surfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/143—Sensing or illuminating at different wavelengths
Definitions
- the invention is directed to a device and a method for displaying information and for the simultaneous contact-based capture of prints of a plurality of blood-perfused skin areas of human autopodia, generally those of the finger.
- the reflection at a placement surface for the autopodia is utilized to generate the recordings of the prints; for example, the principle of frustrated total internal reflection can be used.
- biometric authentication by means of personal features of the user are becoming increasingly prevalent.
- Known methods are based, for example, on face recognition.
- biometric authentication by means of fingerprints offers appreciably more information and, therefore, greater security, since appreciably more information is encoded in the papillary structure of the human finger than can be checked, for example, with biometric authentication by face recognition.
- Authentication by means of an individual fingerprint has long been known.
- Mobile phones suitable for this purpose generally have an individual location for placement of the finger which is set off from the rest of the screen.
- a plurality of prints of fingers can be stored in a database, but it is always the case that only one individual print can be recorded at a time. Greater security is afforded by multiple-finger authentication in which the prints of multiple fingers are recorded simultaneously. For reasons of space and ergonomics, recording of this kind is carried out via the screen of the mobile phone.
- Sensor-screen combinations in which an optical image sensor—CMOS sensor, TFT sensor, CCD sensor, etc. —is linked with a screen—OLED screen, QLED screen, LCD screen, etc. —already exist in mobile devices.
- a touch-sensitive layer is integrated in the screen in most cases.
- the optical image sensor captures skin prints which are compared with data stored in the system in order to determine and possibly verify the identity of the user or also in order to trigger particular functions of applications which can be associated with specific fingers.
- the touch-sensitive area of the screen simultaneously serves as a placement surface for the fingers whose prints are to be recorded. Accordingly, no special area apart from the screen surface is needed for the capture of biometric features.
- the effective area for displaying information can be increased in this way because a separate sensor area for placement of a finger is no longer needed.
- optical image sensors which, in contrast to capacitive or ultrasound-based fingerprint sensors, have the advantage that high-resolution recordings can be realized with them even over large distances between the optical sensor and the biometric object to be captured. This is especially important, for example, when additional cover films or cover glasses are applied to the screen surface by the user of the mobile device, for example, to protect against scratches.
- Liquid crystal (LC) screens are most commonly used as screens—also referred to hereinafter as “display”—because they are easy to produce and are long-lasting.
- the structures of the skin prints can generally not be resolved with sufficient precision in this way because the resolution decreases with increasing distance between the sensor and the applied object. Therefore, for irradiation of the applied skin areas with directed light, the arrangements have the above-mentioned additional illumination arranged laterally adjacent the back-light illumination, the light of the additional illumination being coupled into an own light guide arranged over the LC unit. This reduces the brilliance of the screen, and the displayed images and information appear less clear because, due to the additional illumination light, the light guide, the distance between the LC unit and the upper side of the cover layer is increased on the one hand and additional light-scattering structures and layers or further interfaces are arranged in the light path on the other hand.
- the additional illumination is disadvantageously designed such that the placement surface cannot be entirely irradiated by the directed light with the same light intensity so that only a portion of the screen surface is available for capturing high-resolution skin prints; therefore, a simultaneous capture of the prints of a plurality of fingers is scarcely possible.
- US 2018/0357460 A1 describes various devices which use LC units (LCDs, LC displays) to display information.
- LC units LCDs, LC displays
- FIGS. 16 c , 16 d of US 2018/0357460 A1 point light sources which are arranged in grid shape, for example, micro-LEDs which emit directed scanning light, are used for the illumination for capturing fingerprints in case of an LC display.
- the point light sources are arranged in front of the back-light illumination which emits diffuse light.
- the optical sensors are arranged above the illumination arrangements because the usual back-light illumination of an LC display is opaque on the side thereof remote of the pixels of the LC unit. In this case, the detectors are integrated in the backplane of the LC unit.
- the point light sources for generating the directed light are arranged at greater distances from one another than would be adequate, for example, for the pixel width and pixel height of the LC unit.
- light-blocking elements which block light coming from the back-light illumination are arranged in the areas between the point light sources so that, although the uniformity of the illumination—when point light sources are turned off—is increased, the brightness is disadvantageously reduced. Beyond this, it may be necessary when using point light illumination to capture the skin print portion by portion for reasons of precision and to assemble it subsequently to form a total print.
- the light sources for the point light illumination can also be arranged above the optical sensor elements. However, the latter are arranged above the back-light illumination of the LC unit in every case.
- U.S. Pat. No. 10,177,194 B2 describes a device for displaying information and for contact-based capture of individual fingerprints with an OLED.
- An additional illumination device for emitting directed light is arranged below the OLED pixels which are not transparent, and the light is emitted in the regions between the OLED pixels. Accordingly, the entire possible surface is basically not available for light emission, and the brightness is reduced.
- the sensor elements are also arranged below the OLED pixels but above the additional illumination. A back-light illumination is not necessary due to the fact that it is an OLED. In the arrangements described in U.S. Pat. No.
- a light guide structure is used to generate the directed illumination.
- light of the additional illumination in order to couple the directed light out of the light guide, light of the additional illumination is coupled into a transparent substrate layer and then into a light guide structure which is arranged below the transparent substrate layer and connected to the latter.
- the light-guiding structure in turn has a plurality of optical microstructures, for example, microprisms, which serve as out-coupling elements and guide the light in direction of a placement surface for a finger.
- the prior art devices with additional illumination layer arranged over the display unit used to display information have the drawback that, as a result, the brilliance and brightness of the displayed information are reduced, although the additional illumination is not active.
- the additional illumination is activated, insofar as it is in the visible range, it can also cause blooming of the displayed information.
- the additional illumination is arranged below the LC unit or OLED unit for generating directed light for recording fingerprints, high transmission losses occur which can impair the quality of the fingerprint recording. This can be compensated by stronger light sources, but this would ultimately lead to a higher energy consumption and is therefore disadvantageous particularly for mobile battery-operated devices.
- a further object consists in realizing a method for capturing prints of skin areas of a plurality of autopodia on a device of this kind in the most energy-efficient manner possible.
- the device Viewed from the direction of a contacting skin area, the device first of all comprises a placement surface for placing the autopodia.
- the placement surface is generally made of glass but can also be the interface of a protective film, for example, of plastic, applied to the glass.
- a touch-sensitive layer which registers whether or not skin areas are placed on the placement surface is arranged below the placement surface, again viewed from the direction of the contacting skin area.
- touch-sensitive layers are already known in the art and are connected to the control of the device in mobile devices, for example.
- the touch-sensitive layer in the present invention is also used for activating and deactivating the sensors for capturing skin prints.
- LC unit liquid crystal unit
- This LC unit comprises pixels arranged in grid shape which are generally made up of red, green and blue subpixels, the color definition being carried out by means of corresponding color filters.
- the pixels and subpixels are individually controllable by means of a control unit.
- the term “LC unit” refers herein exclusively to the pixel structures which are switchable to transmissive or opaque, but not to the back-light illumination thereof.
- the polarization structures above and below the pixels needed for changing the transmission characteristics belong to the LC unit as does the color filter which is arranged between the polarization structure above the pixels and the pixels.
- the partly transparent backplane via which the pixels are controlled is arranged between the polarization structure below the pixels and the pixels themselves.
- the backplane can be provided on its underside in the opaque region with an absorbent layer to prevent reflections of light which is emitted in direction of the placement surface by the illumination unit described in the following.
- An illumination unit with a transparent light guide layer body, first illumination source or means and second illumination source or means are arranged below the LC unit.
- the first illumination means is formed for illuminating the LC unit with diffuse light in a first wavelength range, i.e., light of the first wavelength range which is emitted into the light guide layer body and exits the latter diffusely upwardly in direction of the placement surface. Accordingly, the back-light illumination for the LC unit is realized by the first illumination means.
- the second illumination means is formed to emit directed light in a limited angular range of no more than 20° around a given central angle, i.e., ⁇ 10° around the central angle; it emits light in a second wavelength range.
- the two wavelength ranges may be congruent, partially overlap or be completely distinct from one another.
- each of the wavelength ranges can also comprise only one individual wavelength within tolerances given, for example, by filters.
- the central angle is predetermined such that light which is emitted in the limited angular range and guided through the LC unit and the touch-sensitive layer at an underside of the placement surface would be at least partially reflected at the placement surface, for example, would principally be totally internally reflected, in the event of a medium which adjoins the placement surface and has a refractive index that diverges from the refractive index of the material of the placement surface.
- the medium can be air, for example.
- the central angle need not form 0° with a surface normal of the placement surface, but rather preferably forms an angle between 0° and 80°, particularly preferably between 0° and 70°, with the surface normal.
- the limited angular range also includes only angles of no more than 10° around the central angle to allow the sharpest possible imaging of the papillary structures on an optical sensor which is to be described in the following and, in so doing, also to sharply image details.
- the central angle is preferably greater than the critical angle of total internal reflection, for example, 42° in the case of the usual glass-air interface. In this way, the reflections at the interface are particularly strong, the light is utilized efficiently, and the contrast is correspondingly high.
- the angles of the limited angular range all lie around the central angle such that they are greater than the critical angle of total internal reflection.
- the central angle is preferably 0° in order to keep the light path between reflection at the placement surface or interface and the detection at a sensor layer as short as possible and, therefore, keep the resolution as high as possible. In this case, the amount of light is appreciably smaller because, as a rule, no more than 4% of the light is reflected at the placement surface as boundary with air.
- the diffuse illumination is not suitable by itself to image skin prints, since the distance between a sensor layer, which is arranged below the light guide layer body and will be described more fully later, and the placement surface can amount to several hundreds of micrometers so that the papillary structures of the skin and details such as pores cannot be resolved by the sensor elements. This loss of detail which can be on the order of only 50 ⁇ m is caused by the wide angular spectrum of the diffuse illumination which leads to blurriness of the structures to be imaged with increasing distance insofar as no imaging or collimating optics are used.
- the diffuse illumination is necessary in order to illuminate the screen as uniformly as possible when it is used to display information.
- the pixels of the LC unit are switchable between a state which is transparent to the diffuse light and the directed light and a state which is opaque to the diffuse light, which takes place as a result of the change in the polarization direction of the light which is already linearly polarized when entering the LC unit.
- the pixels of the LC unit are illuminated by the diffuse light emitted by the first illumination means for displaying information which is processed with the help of the control unit for the display. Switching into a state which is also opaque to the directed light is not absolutely necessary but is a possible option.
- an optical sensor layer is arranged below the light guide layer body, this optical sensor layer having sensor elements which are arranged in grid shape and which are sensitive at least to light of the second wavelength range.
- the optical sensor layer is arranged below the illumination unit. Since the sensor elements are arranged below the light guide layer body, the latter must be transparent in contrast to the prior art where the back-light illumination for LC units is configured to be opaque because the back-light illumination has on its underside a highly reflective layer which maximizes the luminous efficacy.
- the surface of the sensor layer, or at least of the sensor elements, which is generally metallic can be configured to be partially reflective except for the apertures of the elements detecting the light of the second wavelength range.
- this sensor layer or sensor elements need not be transparent or semitransparent so that less expensive components can be used for this purpose, for example, CMOS-based sensors. Since all of the components which are necessary for registration of skin prints are arranged below the LC unit, the screen is not visually disturbed. Since neither the diffuse light nor the directed light need traverse areas with semitransparent sensors which generally transmit only 1% to a maximum of 30% of the emitted light, the energy efficiency can be improved; less energy is required for the same brightness as in conventional devices.
- the directed light is not changed with respect to the polarization direction by the LC layer at certain central angles so that it can always pass the LC unit unimpeded regardless of whether the LC unit is switched into the opaque state or transparent state.
- the central angle of the directed light should be between 30° and 80°, preferably between 40° and 70°, and particularly preferably between 50° and 70°.
- an LC unit with uncrossed linear polarizers, i.e., parallelly oriented polarization filters must be used because otherwise the directed light would be extinguished.
- losses of about 50% may nevertheless occur with the LC unit during illumination with directed light due to polarization at the lower polarization structure when the utilized light is not polarized. Such losses can be prevented in that, for example, a laser or other light source emitting polarized light is used as light source for the directed illumination.
- the second illumination means to display information when the central angle is in the range above the critical angle of the total internal refection at the placement surface.
- This can be achieved, for example, in that the angle of inclination of suitable, e.g., prism-shaped, out-coupling structures is selected to be correspondingly large in order to impress a large directional change on the light guided in the light guide when impinging on the inclined surface of the light out-coupling structure. Further, this depends on the difference in the refractive index between the light guide and adhesion layers which surround the latter and which have lower refractive indices than that of the light guide, since this defines which light angles are guided at all.
- the first illumination means can be switched off during the capture of skin prints of autopodia.
- the second illumination means need only be activated when one or more skin areas are to be detected; this can be integrated in the control of a corresponding application, for example.
- the switching on of the second illumination means can be locally limited to areas in which the touch-sensitive layer has detected the placement of one or more skin areas during an illumination from the side, for example, on a stripe-shaped region.
- the first wavelength range for the diffuse illumination and the second wavelength range for the directed illumination have no intersection, that is, the areas do not overlap.
- the superposition of the signals of the two illumination means can be minimized in this way.
- the first wavelength range then preferably comprises visible light
- the second wavelength range preferably contains nonvisible light, preferably in the NIR range between 780 nm and 3000 nm, and illumination in the UV-A range between 315 nm and 380 nm is also possible.
- the second illumination means can be formed to also emit monochromatic light, that is, the second illumination means emits light only in a very narrow band.
- a transmission filter is arranged between the optical sensor layer and the light guide body so that preferably only light of the second illumination means is allowed to pass.
- the light guide layer body and the illumination means are essential component parts of the arrangement.
- the light guide layer body can be realized in various ways.
- the light guide layer body comprises a lower transparent layer as part of the first illumination means and an upper transparent layer as part of the second illumination means.
- the two layers are preferably formed to be substantially plate-shaped, i.e., have two large surface areas—also referred to as main surfaces or large sides—which are arranged substantially parallel to one another and at a short distance from one another.
- the two large surface areas are connected at the edges by narrow sides which form the edges of the plate.
- the geometry of the plate is often rectangular, but this is not compulsory.
- the first illumination means comprises first light sources which emit light in the first wavelength range
- the second illumination means comprises second light sources which emit light in the second wavelength range.
- the light of the first light sources is coupled into the lower transparent layer
- the light of the second light sources is coupled into the upper transparent layer.
- the first light sources and second light sources are preferably arranged at a narrow side of the respective plate-shaped layer, and the light can then be coupled into the respective layer laterally via the narrow side or via a corner of the light guide layer which is preferably cut off or provided with a bevel for this purpose.
- the light source comprises a plurality of individual light sources, the emitting angle of each individual light source preferably being limited by collimating means, for example, absorbent cylindrical structures and/or optical lenses.
- collimating means for example, absorbent cylindrical structures and/or optical lenses.
- the maximum available brightness is increased in this way.
- This spatial collimation is a great advantage particularly for the generation of directed light because the angle of incidence at which the light impinges on the light guide can already be limited from the outset to a small angular range which depends on the specific collimating structure.
- the light of the first light sources and the light of the second light sources is guided in the respective layer of the light guide layer body by means of total internal reflection (TAR); an incident angle range with angles under which light of the first light sources and light of the second light sources impinge from the side on an interface of the respective layer must accordingly be selected such that the light is also guided at the critical angles of the incident angle range through total internal reflection.
- Optical layers which have a lower refractive index than the respective layer of the light guide body are applied to the large surface areas. These optically low-refracting layers can comprise air or a transparent adhesive, for example.
- the transparent layers of the light guide body have interfaces at their main surfaces, and first out-coupling structures are formed at the interfaces of the lower transparent layer to couple out diffuse light and second out-coupling structures are formed at the interfaces of the upper transparent layer for coupling out directed light. In each of these two cases, the light is coupled out in direction of the placement surface.
- first light sources and second light sources in such a way that the light is coupled into the lower transparent layer or upper transparent layer laterally, and the first light sources and second light sources are combined to form a common edge illumination.
- first light source and second light source are combined to form an individual light source, the light thereof being coupled into the light guide layer body via the edge. Since light of the same wavelengths is used both for the diffuse illumination and for the directed illumination, it is advisable to arrange an additional diaphragm layer between the optical sensor layer and the light guide layer body for solid angle selection so that the sensor elements of the optical sensor layer can receive substantially mainly, or only, light of the directed illumination.
- the out-coupling structures for the directed light and for the diffuse light are formed such that the illumination per unit area is carried out predominantly homogeneously with respect to intensity and, for the directed light, also with respect to angular distribution regardless of whether skin parts of autopodia lie on the placement surface at one location or at a plurality of locations. This is realized by means of a correspondingly selected distribution of the out-coupling structures on the large surface areas. For example, the number of out-coupling structures can be increased with increasing distance from the side from which the light is coupled in.
- the light guide layer body comprises an individual, transparent, substantially plate-shaped combination layer.
- the first illumination means comprises first light sources and the second illumination means comprises second light sources, and light of the first light sources is coupled into the combination layer preferably at a first narrow side, preferably laterally or laterally from a corner, and light of the second light sources is coupled into the combination layer preferably at a second narrow side opposite the first narrow side, preferably laterally or laterally from a corner, or from below by means of additional optical elements such as lenses or prisms which are arranged laterally of the sensor layer.
- first out-coupling structures and second out-coupling structures can also be arranged in this instance in order to increase or ensure homogeneity, for example, at an interface opposite that interface having the combination out-coupling structures. It is important in this respect in particular that the diffuse light be coupled out as homogeneously as possible.
- the means for homogenizing the directed light that is insignificant for the viewer of the screen because no information is to be displayed by it can also be integrated in the optical sensor layer in that, for example, the diaphragm size is adapted at that location or the sensitivity of the sensor elements is gradually increased with increasing distance from the side on which the light is coupled in, or a semitransparent layer is applied with gradually decreasing absorption proceeding from this side.
- the invention is further directed to a method for simultaneously capturing the skin prints of a plurality of autopodia placed on a placement surface, particularly with a device such as that described in the preceding.
- the device comprises a placement surface, a touch-sensitive layer, an LC unit with individually controllable pixels arranged in grid shape, an illumination unit with a transparent light guide layer body and first illumination means for illuminating the LC unit with diffuse light in a first wavelength range and with second illumination means for emitting directed light in a second wavelength range, and an optical sensor layer with sensor elements which are arranged in grid shape and are sensitive to the light of the second wavelength range.
- the LC unit of the device for example, of a mobile phone or PC tablet, is initially illuminated with diffuse light in a first wavelength range by the first illumination means during operation, the pixels of the LC unit being switchable between a state which is transparent to the diffuse light and a state which is opaque to the diffuse light.
- Information can be displayed in this way. This is the usual operating mode of a screen or PC tablet of this kind when there is no finger placed on it. Information is displayed in color, since usually every pixel is composed of a plurality of subpixels emitting light of the basic colors red, green and blue.
- the touch-sensitive layer detects whether or not skin areas are placed on the placement surface. When skin areas are placed on the latter, the sensor elements of the optical sensor layer are activated so that they can detect light. Further, the second illumination means which is switched off in normal operating mode in which only information is displayed are switched on. If a touch-sensitive layer is provided, the corresponding information about whether one or more fingers are applied, for example, is available automatically, and the touch-sensitive layer also registers the placement locations on the two-dimensional placement surface. User information can be displayed on the screen of the device simultaneously in conjunction with the capture of the prints.
- the second illumination means After the second illumination means has been switched on, it emits directed light in a limited angular range of no more than 20° around a given central angle, where the central angle is predetermined such that light which is emitted in the limited angular range and which is directed through the LC unit and the touch-sensitive layer on an underside of the placement surface is mainly totally internally reflected at the placement surface in the event of an adjoining medium with a refractive index of air.
- the light passes through the placement surface particularly when skin ridges of a finger or of another autopodium are applied. Light reflected from the placement surface is then detected by means of the optical sensor layer.
- the detected light can be captured and registered as an impression of one autopodium or impressions of a plurality of autopodia, i.e., the intensity values detected by the optical sensor elements are processed to form a print or plurality of prints, and image processing methods known from the prior art are used. If the registration or capture of the skin areas of autopodia was successfully concluded or was aborted, for example, because a finger was removed from the placement surface before the recording could be finished, the optical sensor layer is deactivated and the second illumination means is switched off.
- the method works in a very energy-efficient manner.
- the switching on of the second illumination means and of the optical sensor elements can also be tied to further conditions, for example, the switching on can be limited to applications which explicitly require the checking of fingerprints such as applications for online banking, for example.
- the captured print or captured prints are compared with prints stored in a database and, depending on the results of the comparison, an action or several actions are possibly carried out.
- a mobile device can be associated with a plurality of users in a company, and each of the users has his/her own user profile and own user surface. A profile specific to the respective user can then be loaded for a user surface based on the fingerprints.
- an individual recording is preferably initiated for each autopodium applied.
- the recordings can also be repeated in case a change in position of one or more autopodia is detected or if additional autopodia are applied.
- the detection of light of the second wavelength range can also be limited to regions in which the placement of an autopodium is detected by the touch-sensitive layer.
- Possible applications of the invention reside mainly in the integration of multi-fingerprint sensors in LC screens.
- they can be a component part of smartphones, tablets, television devices, laptops and other equipment with displays by which a user authentication is to be carried out.
- An example of an application is a touch-sensitive screen in a car having a virtual dashboard with a virtual start button which is enabled when the corresponding fingerprint of a registered user is detected and allows the car to start and/or a virtual switch by means of which a user-specific seating and mirror combination is adjusted.
- FIGS. 1 a,b two cross-sectional views of devices for displaying information and for simultaneous contact-based capture of skin prints of autopodia with applied finger;
- FIG. 2 a cross section through a light guide layer body with two transparent layers
- FIG. 3 a cross section through a light guide layer body in an alternative configuration
- FIGS. 4 a )- c various possibilities for coupling light into a transparent layer of a light guide layer body
- FIG. 5 a further possibility for illuminating a transparent layer of a light guide layer body
- FIG. 6 possible arrangements of out-coupling elements in a top view
- FIG. 7 a possible construction of an LC unit
- FIG. 8 the basic flow of a method for the simultaneous capture of the skin prints of a plurality of autopodia.
- FIG. 1 a shows a section through a device for displaying information and for the simultaneous contact-based capture of prints of a plurality of blood-perfused skin areas of human autopodia.
- a finger 1 serves as an example of an autopodium.
- the device comprises first of all a placement surface 2 for placement of the autopodia.
- this is part of an optional protective layer 3 which serves to protect elements located below it.
- this can be a glass layer or plastic layer.
- a touch-sensitive layer 4 is arranged below the optional protective layer 3 and registers whether or not skin areas are placed on the placement surface 2 .
- an LC unit 5 with pixels 6 which are arranged in grid shape and are individually controllable by means of a control unit, not shown.
- an illumination unit with a transparent light guide layer body 7 and first illumination source or means and second illumination source or means which will be described more fully below referring to FIG. 2 and FIG. 3 .
- an optical sensor layer 8 with sensor elements 9 arranged in grid shape is arranged below the light guide layer body 7 .
- the illumination unit comprises the transparent light guide layer body 7 and first illumination means and second illumination means.
- the first illumination means is formed to illuminate the LC unit with diffuse light in a first wavelength range.
- the second illumination means is formed to emit directed light in a limited angular range of no more than 20° around a given central angle and in a second wavelength range.
- the central angle is predetermined such that light which is emitted in the limited angular range and is directed through the LC unit 5 and the touch-sensitive layer 4 at an underside of the placement surface would be at least partially reflected at the placement surface in case of a medium adjoining the latter and having a refractive index diverging from the refractive index of a material of the placement surface 2 .
- the pixels 6 of the LC unit 5 can be switched between a state which is transparent to the diffuse light and the directed light and a state which is opaque at least to the diffuse light. To display the information, it is illuminated through the diffuse light.
- the sensor elements 9 of the optical sensor layer 8 are only sensitive to light of the second wavelength range of the directed light, although it is not ruled out that the first wavelength range and second wavelength range overlap or that the second wavelength range is contained within the first wavelength range.
- the surface of the sensor elements 9 which faces the light guide layer body 7 can be configured to be reflective for increasing the luminous efficacy for the diffuse light and with a diaphragm structure for improving the angular selectivity and/or the homogeneity of the directed illumination.
- the central angle forms an angle between 0° and 80°, preferably between 0° and 70°, with a surface normal of the placement surface 2 .
- the limited angular range preferably comprises angles of no more than 10° around the central angle, i.e., of ⁇ 5° around the latter.
- the second illumination means can be configured such that it emits preferably monochromatic light in a very narrow wavelength range of a few nanometers.
- a transmission filter is preferably arranged between the optical sensor layer 8 and the light guide body 7 to separate the light of the second illumination means from the light of the first illumination means.
- FIG. 2 shows a first configuration of a light guide layer body 7 with first illumination means and second illumination means.
- the light guide layer body 7 has a lower layer 10 and an upper layer 11 .
- Both the lower layer 10 and upper layer 11 are formed from transparent materials such as, for example, glass, PMMA or polycarbonate and are substantially plate-shaped.
- the lower layer 10 is associated with the first illumination means, whereas the upper layer 11 is associated with the second illumination means. Accordingly, the lower layer 10 serves to illuminate the LC unit 5 with diffuse light in the first wavelength range, while the upper layer 11 serves to emit directed light as was described above.
- the first illumination means comprises first light sources 12
- the second illumination means comprises the second light sources 13 . Both the first light sources 12 and the second light sources 13 are only shown symbolically in FIG. 2 and FIG. 3 . Possible embodiments are shown in FIG. 4 and FIG. 5 .
- Light of the first light sources 12 is coupled into the lower transparent layer 10 , for example, laterally, laterally from a corner, or from below.
- Light of the second light sources 13 is coupled into the upper transparent layer 11 laterally at a narrow side or laterally from a corner or from below.
- This auxiliary means is formed by first out-coupling structures 14 at interfaces of the lower transparent layer 10 and second out-coupling structures 15 at interfaces of the upper transparent layer 11 .
- “interfaces” means the large surface areas or main surfaces of the respective transparent layer 10 , 11 .
- the out-coupling structures 14 , 15 can be arranged at one or both interfaces of the respective layer.
- the first out-coupling structures 14 are formed as concave indentations in the lower transparent layer 10 at the lower interface.
- convex bulges can also be formed at the upper interface of the lower transparent layer 10 .
- a reflective layer 101 can be applied to a narrow side of the lower transparent layer 10 opposite the narrow side serving to couple in light in order to improve the luminous efficacy of the diffuse illumination.
- the second out-coupling structures 15 are formed in this instance at the upper interface of the upper layer with an exemplary rectangular base area and prismatic longitudinal section. Alternatively or additionally, the out-coupling structures 15 could also be arranged at the lower interface of the upper layer 11 and can likewise be parallelepiped-shaped.
- light is coupled out in this instance only within a narrow angular range which is predetermined by the geometry and, inter alia, by the angle of inclination of the prism surface or relief surface of the out-coupling structures, where the angle of inclination is preferably 5° to 25° relative to the large surface area of the transparent layer 11 , particularly preferably 10° to 20°.
- Both the directed light coupled out by the second out-coupling structures 15 and the diffuse light coupled out by the first out-coupling structures 14 are coupled out in direction of the placement surface 2 .
- Separating layers 16 are arranged at the interfaces so that the light is conducted in the lower transparent layer 10 and in the upper transparent layer 11 , respectively, by means of total internal reflection.
- These separating layers 16 can be air or an adhesive layer, for example.
- Other materials with a correspondingly lower refractive index than the transparent layers 10 , 11 which allow the total internal reflection within the transparent layers 10 , 11 can also be contemplated.
- the refractive index of separating layer 16 is 1% to 30%, preferably 5% to 30%, particularly preferably 10% to 25% lower than the refractive index of the transparent layers 10 , 11 .
- the separating layer 16 also fills up the concave indentations of the first out-coupling structures 14 , for example.
- optically transparent double-sided adhesive strips (OCA) or liquid adhesives (LOCA) which harden under heat or UV radiation are also suitable as materials for the separating layer.
- OCA optically transparent double-sided adhesive strips
- LOCA liquid adhesives
- silicones, acrylate or epoxides having refractive indices of between 1.2 and 1.5, preferably between 1.3 and 1.47 and particularly preferably between 1.35 and 1.43 can be used for this purpose.
- the material for the transparent layers 10 , 11 for example, glasses, PMMA or polycarbonate, etc., is selected with a refractive index between 1.4 and 1.8, preferably between 1.45 and 1.6 and particularly preferably between 1.47 and 1.55.
- FIG. 1 b shows a construction in which light is coupled into the light guide layer body 7 from below in at least one of the two transparent layers.
- light of the second light sources 13 is coupled into the upper transparent layer 11 and/or light of the first light sources 12 is coupled into the lower transparent layer 10 .
- a projection 71 of the lower transparent layer 10 is formed at the light guide layer body 7 .
- a projection of the upper transparent layer 11 can also be formed on the right-hand side in order to couple light of the light sources 13 into the upper transparent layer 11 from below.
- Prism-shaped in-coupling elements 72 or lenticular in-coupling elements 73 are then mounted on the underside of the projection 71 for coupling in light.
- An adhesive which is adapted with respect to refractive index and which accordingly has, as far as possible, the same refractive index as the transparent layers 11 , 12 and the in-coupling elements 72 , 73 is preferably used to connect these elements to the light guide layer body 7 or transparent layers 11 , 12 . In this way, the entire construction of the device can be designed more compactly, since light can also be coupled into very thin transparent layers 11 , 12 .
- a transmission filter layer 81 which can be configured, for example, as a bandpass filter and which is transparent substantially only to light of the second light source 13 is arranged between the sensor layer 8 and the light guide layer body 7 . This is advantageous when the first wavelength range and second wavelength range overlap.
- the first light sources 12 and the second light sources 13 are depicted separate. But, in case of lateral in-coupling, it is also possible to combine the first light sources 12 and the second light sources 13 to form a common edge illumination. Diaphragms for angle selection are then preferably integrated on the sensor elements 9 so that the sensor elements 9 preferably detect the directed light of the second light source after reflection at the placement surface. In this case, the first illumination means would always be switched on regardless of whether or not a fingerprint is registered.
- an adapted transmission filter for example, a bandpass filter, in the form of a transmission filter layer 81 between the optical sensor layer 8 and the lower transparent layer 10 , this transmission filter preferably being transparent only to light of the second light source 13 in a narrow range of, e.g., 5 nm or 10 nm to 200 nm, preferably 10 nm to 100 nm, particularly preferably from 10 nm to 50 nm bandwidth.
- the light to be detected by the optical sensor elements 9 is spectrally limited to a narrow range of a few nanometers.
- the reduction in light efficiency can be countered with a monochromatic light source, and a transmission filter layer 81 with an even narrower bandwidth of less than 5 nm can correspondingly be utilized.
- the light guide layer body 7 can be constructed thinner, which reduces the overall depth of the device.
- the light guide layer body 7 comprises a transparent, substantially plate-shaped combination layer 17 , also referred to as individual layer. Except for the separating layers 16 , the combination layer 17 is the only layer of the light guide layer body 7 .
- the first illumination means comprises first light sources 12 and the second illumination means comprises second light sources 13 . Light of the first light sources 12 is preferably coupled into the combination layer 17 laterally or laterally from a corner at a first narrow side 18 .
- Light of the second light sources 13 is preferably coupled into the combination layer 17 laterally or laterally from a corner at a second narrow side 19 opposite the first narrow side 18 .
- those sides or edges which connect the large surface areas or main surfaces to one another are referred to as narrow sides.
- the light is guided in the interior of the combination layer 17 by means of total internal reflection, and combination out-coupling structures 20 for coupling out diffuse light and directed light in direction of the placement surface 2 depending on an incident direction are formed at the interfaces of the transparent combination layer 17 .
- Light can also be coupled into the combination layer 17 from the bottom when a projection is formed at both sides similar to the construction in FIG. 1 a.
- the combination out-coupling structures 20 are constructed in this instance such that when illuminated from the left-hand side referring to FIG. 3 , i.e., proceeding from narrow side 18 , with light of the first light source 12 indicated by the solid arrows, light is coupled out in direction of the placement surface 2 in an undirected, i.e., diffuse, manner.
- the corresponding part of the combination out-coupling structure 20 is formed in this instance by way of example with a—uniform or variable—curvature for coupling out diffuse, undirected illumination.
- the combination out-coupling structure 20 has a plane surface which, however, has an inclination in the manner of a prism compared to the placement surface 2 , that is, forms an angle other than zero with the placement surface 2 . Depending on this inclination, directed light is coupled out at a defined central angle in direction of the placement surface.
- the intensity of the diffusely out-coupled light appears substantially homogeneous because this is the light that is predominantly perceived by the observer.
- light coupled in from the other side for the directed illumination is largely coupled out in the vicinity of the incident area, since many of the combination out-coupling structures 20 are located in that area.
- a homogenization can then advantageously be achieved at least for the detection of the directed light via additional apertures over the individual sensor elements 9 which have smaller apertures in the area where the light of the second light sources 13 is coupled in than on the opposite side where the light of the first light sources 12 is coupled in.
- the transmissivity can also be continuously varied with a transmission layer that becomes thicker or thinner as is described, for example, in DE 10 2017 119 983 B3, the disclosure of which is incorporated herein.
- the light is preferably coupled into the light guide on both sides already under a determined angle which satisfies the precondition for total internal reflection so that better use is made of the light.
- This can be realized, for example, by an inclined arrangement of light sources at the light guide or in-coupling optics arranged upstream.
- FIGS. 4 a )- c show three configurations of the illumination unit with a light guide layer body and illumination means for coupling light into corners.
- the diagram is a top view of a main surface of a transparent layer 10 , 11 or 17 of the light guide body.
- FIG. 4 a shows an embodiment form for the in-coupling of light in which the first light source and second light source are formed as LEDs—the way in which the light is coupled in functions equally well for directed light and diffuse light—and in which the in-coupling of light is implemented on at least one surface formed by cutting off a corner of the corresponding transparent layer of the light guide layer body.
- a corner 21 which is cut off in this way produces an additional narrow side which forms an angle of 135°, for example, with the usual narrow sides of a rectangular plate-shaped layer. In this case, it is not necessary for the light emitted by the light sources 12 , 13 to be pre-collimated in horizontal direction.
- absorbent coatings at the other narrow sides of the light guide layer at which no light is coupled in. These absorbent coatings absorb light impinging at these other narrow sides or couple out the light laterally so that this light no longer reaches the placement surface.
- FIGS. 4 b ) and c) show additional steps beyond FIG. 4 a ).
- the light distribution or light homogenization is improved by means of a diffuser 22 so that light is emitted uniformly in all directions
- the cut corner 21 is formed as a concave curve so that all of the rays exiting divergently from the first light source 12 or second light source 13 can enter the light guide layer continuously, and light exiting from only one individual LED can also propagate and be coupled out in the entire transparent layer 10 , 11 or 17 .
- FIG. 5 shows a further configuration for coupling in light at a narrow side which is particularly suited for generating directed light.
- the first light source 12 and second light source 13 comprise many individual LEDs 23 which are arrayed along the narrow side used for in-coupling.
- the LEDs 23 are embedded in cylindrical or frustoconical absorption structures 24 which are shown in cross section.
- the absorption structures 24 provide for the spatial collimation of the light emitted by the LEDs to an angular range of, e.g., 10° around an axis 25 .
- the available angular range depends particularly on the extent of the cylindrical or frustoconical absorption structure 24 in emitting direction.
- FIG. 6 shows two sections of an upper transparent layer 11 with second out-coupling structures 15 in a top view.
- the second out-coupling structures 15 are wedge-shaped and present rectangles rising in a lectern-shaped manner from the direction of illumination or trapezoidal surfaces as is shown in section in FIG. 2 .
- Shown here is the upper interface of the upper transparent layer 11 in which the second out-coupling structures 15 are formed. They are arranged in a plurality of rows, and the distance of the individual rows relative to one another decreases with increasing distance from the second light source 13 in order to improve the homogeneity of the intensity of the emitted light; this is also shown in FIG. 2 .
- FIG. 7 shows a possible construction of an LC unit 5 in detail.
- the core of the LC unit 5 is formed by a liquid crystal layer 27 with liquid crystal molecules 28 contained in cells, not shown here.
- the liquid crystal molecules 28 are rod-shaped in this instance in order, for one, to graphically show the polarization direction and the rotation of the polarization of the light.
- the cells with the liquid crystal molecules 28 are bounded by a vertical orientation layer 29 —in this instance below the liquid crystal layer 27 —and a horizontal orientation layer 30 , in this instance at the upper side of the liquid crystal layer 27 .
- the orientation layers are, for example, glass plates with a plurality of parallel, either horizontally or vertically oriented microgrooves by means of which the liquid crystal molecules 28 are helically oriented mechanically along the length of the cell.
- Layer-shaped transparent electrodes 31 are arranged at the outer sides of the glass plates and, when voltage is applied, the orientation of the liquid crystal molecules 28 can be changed by these electrodes 31 .
- a color filter 32 and a glass substrate 33 are arranged on the upper side of the transparent electrodes 31 above the horizontal orientation layer 30 , i.e., in emitting direction toward the placement surface 2 , and a horizontal polarization filter 34 is arranged on the glass substrate 33 .
- an active semiconductor matrix or backplane 35 is arranged on the underside of the electrodes 31 below the vertical orientation layer 29 .
- TFTs thin film transistors
- the LC unit is terminated at the bottom by a glass substrate 33 and a vertical polarization filter 37 .
- an absorbent layer 38 is arranged below the backplane 35 , which absorbent layer 38 is likewise matrix-shaped with respect to structure and corresponds to the matrix structure of the backplane 35 .
- This absorbent layer 38 reduces reflections at the backplane 35 and improves the quality of the recording.
- a transparent backplane comprising transparent conductive materials such as ITO, IZO or AZO and transparent semiconductors such as GaN or ZnO can also be used.
- FIG. 8 shows the basic flow of a method for the simultaneous capture of prints of a plurality of autopodia placed on a placement surface 2 , which method can be carried out with a device particularly such as that described in the foregoing.
- the device comprises—viewed from the direction of the applied autopodia—the placement surface 2 , a touch-sensitive layer 4 , an LC unit 5 with individually controllable pixels 6 arranged in grid shape, an illumination unit with a transparent light guide layer body 7 and first illumination means for illuminating the LC unit 5 with diffuse light in a first wavelength range and second illumination means for emitting directed light in a second wavelength range.
- Adjoining the light guide layer body 7 is an optical sensor layer 8 with sensor elements 9 which are arranged in grid shape and are sensitive to light of the second wavelength range.
- the method can be implemented with a commercially available mobile phone with touch-sensitive screen, with touch-sensitive screens of PCs, etc. Accordingly, as a rule, information is already displayed on the screen. A user can now place the finger 1 on the placement surface 2 in a particular location on the screen in order to start an application, and the method steps to be described in the following are then carried out.
- the LC unit 5 is illuminated with diffuse light in a first wavelength range by the first illumination means to display information, and the pixels 6 of the LC unit 5 are switchable between a state which is transparent to the diffuse light and a state which is opaque to the diffuse light.
- the touch-sensitive layer 4 detects whether or not fingers 1 are placed on the placement surface 2 , the second illumination means is switched on or activated to emit directed light on the one hand and, on the other hand, the sensor elements 9 of the optical sensor layer 8 are activated, i.e., are enabled to detect incident light of the second wavelength range.
- the detection of light of the second wavelength range can be restricted to areas in which the placement of an autopodium is detected by the touch-sensitive layer 4 .
- the second illumination means After the second illumination means is switched on, it emits directed light in a limited angular range of no more than 20°, preferably no more than 10°, around a predetermined central angle.
- the central angle is predetermined such that light which is emitted in the limited angular range and is guided through the LC unit 5 and the touch-sensitive layer 4 to an underside of the placement surface 2 is at least partially reflected at the placement surface 2 in case of an adjoining medium with a refractive index diverging from the refractive index of a material of the placement surface 2 . If a finger 1 is making contact, the directed light is reflected at the locations of a skin valley because there is still a layer of air between the placement surface 2 and the finger 1 at the location of the skin valley.
- the directed light passes through the placement surface 2 into the finger 1 and is scattered so that these areas appear darker in the image.
- Light reflected by the placement surface 2 is detected by means of the optical sensor layer 8 and, due to the differences in intensity, an image of the print of an autopodium or of the skin prints of a plurality of autopodia are recorded.
- the optical sensor layer 8 is deactivated and the second illumination means is switched off.
- the captured print or the captured prints are subsequently compared with prints stored in a database 26 . Depending on the results of the comparison, various actions may be carried out when the finger 1 is detected, for example, the approval of a transaction, etc.
- the method can be configured to be particularly energy-efficient such that the registration or capture of the fingerprint scarcely impacts the life of the battery.
- the method steps may be repeated when autopodia are lifted off and placed again on another location or when further autopodia are applied.
- an individual recording is carried out for each applied autopodium so that when four fingers are applied, for example, four images are ideally generated simultaneously.
- a multi-finger authentication can be integrated, for example, in mobile phones without impairing the quality of the display of information on the screen. Also, virtually the entire surface area of the device is available for displaying information, since the entire surface of the screen can be utilized for recognition of the fingerprint, and area need be provided exclusively for print detection. Moreover, the construction is very compact so that the overall depth of the corresponding device can be kept sufficiently flat.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- Image Input (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Planar Illumination Modules (AREA)
Abstract
Description
- The present application is a National Phase entry of PCT Application No. PCT/EP2020/073384, filed Aug. 20, 2020, which claims priority to German Patent Application No. 10 2019 126 408.1, filed Sep. 30, 2019, the disclosures of which are hereby incorporated by reference herein in their entirety.
- The invention is directed to a device and a method for displaying information and for the simultaneous contact-based capture of prints of a plurality of blood-perfused skin areas of human autopodia, generally those of the finger. The reflection at a placement surface for the autopodia is utilized to generate the recordings of the prints; for example, the principle of frustrated total internal reflection can be used.
- The development of mobile phones over the course of recent years into devices on which sensitive data are increasingly managed also requires increasingly higher standards for a secure authentication by the user. The users themselves also place a high value on the security of authentication. In addition to entering passwords or identification numbers, biometric authentication by means of personal features of the user are becoming increasingly prevalent. Known methods are based, for example, on face recognition. However, biometric authentication by means of fingerprints offers appreciably more information and, therefore, greater security, since appreciably more information is encoded in the papillary structure of the human finger than can be checked, for example, with biometric authentication by face recognition.
- Authentication by means of an individual fingerprint has long been known. Mobile phones suitable for this purpose generally have an individual location for placement of the finger which is set off from the rest of the screen. A plurality of prints of fingers can be stored in a database, but it is always the case that only one individual print can be recorded at a time. Greater security is afforded by multiple-finger authentication in which the prints of multiple fingers are recorded simultaneously. For reasons of space and ergonomics, recording of this kind is carried out via the screen of the mobile phone. Sensor-screen combinations in which an optical image sensor—CMOS sensor, TFT sensor, CCD sensor, etc. —is linked with a screen—OLED screen, QLED screen, LCD screen, etc. —already exist in mobile devices. In order to allow screen inputs via fingers, a touch-sensitive layer is integrated in the screen in most cases.
- The optical image sensor captures skin prints which are compared with data stored in the system in order to determine and possibly verify the identity of the user or also in order to trigger particular functions of applications which can be associated with specific fingers.
- In other devices known from the prior art, the touch-sensitive area of the screen simultaneously serves as a placement surface for the fingers whose prints are to be recorded. Accordingly, no special area apart from the screen surface is needed for the capture of biometric features. The effective area for displaying information can be increased in this way because a separate sensor area for placement of a finger is no longer needed.
- In this regard, it is preferable to use optical image sensors which, in contrast to capacitive or ultrasound-based fingerprint sensors, have the advantage that high-resolution recordings can be realized with them even over large distances between the optical sensor and the biometric object to be captured. This is especially important, for example, when additional cover films or cover glasses are applied to the screen surface by the user of the mobile device, for example, to protect against scratches. Liquid crystal (LC) screens are most commonly used as screens—also referred to hereinafter as “display”—because they are easy to produce and are long-lasting.
- Reference is made in this connection, for example, to WO 2019/041214 A1 and US 2018/0165497 A1. Aside from the usual screen illumination, additional illumination which is arranged laterally and irradiates a skin area placed on the screen with directed light is used in these cases. Subsequently, the light of the additional illumination which is reflected back from the skin area is detected by an optical image sensor which is located below the screen or integrated in the screen. LC units which are outfitted with two-dimensional back-light illumination are usually used for displaying information on the screen. The optical sensor must be located in front of the opaque back-light illumination as viewed by the user and must itself be transparent, although the brightness losses are on a scale of greater than 50%. The light emitted by this back-light illumination propagates diffusely. The structures of the skin prints can generally not be resolved with sufficient precision in this way because the resolution decreases with increasing distance between the sensor and the applied object. Therefore, for irradiation of the applied skin areas with directed light, the arrangements have the above-mentioned additional illumination arranged laterally adjacent the back-light illumination, the light of the additional illumination being coupled into an own light guide arranged over the LC unit. This reduces the brilliance of the screen, and the displayed images and information appear less clear because, due to the additional illumination light, the light guide, the distance between the LC unit and the upper side of the cover layer is increased on the one hand and additional light-scattering structures and layers or further interfaces are arranged in the light path on the other hand. Moreover, the additional illumination is disadvantageously designed such that the placement surface cannot be entirely irradiated by the directed light with the same light intensity so that only a portion of the screen surface is available for capturing high-resolution skin prints; therefore, a simultaneous capture of the prints of a plurality of fingers is scarcely possible.
- US 2018/0357460 A1 describes various devices which use LC units (LCDs, LC displays) to display information. According to
FIGS. 16c, 16d of US 2018/0357460 A1, point light sources which are arranged in grid shape, for example, micro-LEDs which emit directed scanning light, are used for the illumination for capturing fingerprints in case of an LC display. The point light sources are arranged in front of the back-light illumination which emits diffuse light. The optical sensors are arranged above the illumination arrangements because the usual back-light illumination of an LC display is opaque on the side thereof remote of the pixels of the LC unit. In this case, the detectors are integrated in the backplane of the LC unit. So as not to completely block the light of the back-light illumination, the point light sources for generating the directed light are arranged at greater distances from one another than would be adequate, for example, for the pixel width and pixel height of the LC unit. In order to achieve the most uniform possible illumination nevertheless, light-blocking elements which block light coming from the back-light illumination are arranged in the areas between the point light sources so that, although the uniformity of the illumination—when point light sources are turned off—is increased, the brightness is disadvantageously reduced. Beyond this, it may be necessary when using point light illumination to capture the skin print portion by portion for reasons of precision and to assemble it subsequently to form a total print. The light sources for the point light illumination can also be arranged above the optical sensor elements. However, the latter are arranged above the back-light illumination of the LC unit in every case. - U.S. Pat. No. 10,177,194 B2 describes a device for displaying information and for contact-based capture of individual fingerprints with an OLED. An additional illumination device for emitting directed light is arranged below the OLED pixels which are not transparent, and the light is emitted in the regions between the OLED pixels. Accordingly, the entire possible surface is basically not available for light emission, and the brightness is reduced. The sensor elements are also arranged below the OLED pixels but above the additional illumination. A back-light illumination is not necessary due to the fact that it is an OLED. In the arrangements described in U.S. Pat. No. 10,177,194 B2, only a maximum of approximately 10% of the directed light emitted by the additional illumination arrives at the sensor elements for reasons pertaining to design so that a loss of precision may come about in this case. A light guide structure is used to generate the directed illumination. In U.S. Pat. No. 10,177,194 B2, in order to couple the directed light out of the light guide, light of the additional illumination is coupled into a transparent substrate layer and then into a light guide structure which is arranged below the transparent substrate layer and connected to the latter. The light-guiding structure in turn has a plurality of optical microstructures, for example, microprisms, which serve as out-coupling elements and guide the light in direction of a placement surface for a finger.
- To summarize, the prior art devices with additional illumination layer arranged over the display unit used to display information have the drawback that, as a result, the brilliance and brightness of the displayed information are reduced, although the additional illumination is not active. When the additional illumination is activated, insofar as it is in the visible range, it can also cause blooming of the displayed information. While arrangements are also described in the prior art in which the additional illumination is arranged below the LC unit or OLED unit for generating directed light for recording fingerprints, high transmission losses occur which can impair the quality of the fingerprint recording. This can be compensated by stronger light sources, but this would ultimately lead to a higher energy consumption and is therefore disadvantageous particularly for mobile battery-operated devices.
- Therefore, it is the object of the invention to develop an arrangement by which prints of skin areas of a plurality of autopodia can be captured simultaneously with high quality on the entire surface of the screen of the mobile device without impairing the brilliance of the screen and, beyond this, the arrangement should operate in the most energy-efficient manner possible. A further object consists in realizing a method for capturing prints of skin areas of a plurality of autopodia on a device of this kind in the most energy-efficient manner possible.
- The above-stated object is met for a device for displaying information and for the simultaneous contact-based capture of prints of a plurality of blood-perfused skin areas of human autopodia by means of reflection, having the following features: Viewed from the direction of a contacting skin area, the device first of all comprises a placement surface for placing the autopodia. The placement surface is generally made of glass but can also be the interface of a protective film, for example, of plastic, applied to the glass. A touch-sensitive layer which registers whether or not skin areas are placed on the placement surface is arranged below the placement surface, again viewed from the direction of the contacting skin area. Such touch-sensitive layers are already known in the art and are connected to the control of the device in mobile devices, for example. In addition, the touch-sensitive layer in the present invention is also used for activating and deactivating the sensors for capturing skin prints.
- An LC unit (liquid crystal unit) is arranged below the touch-sensitive layer. This LC unit comprises pixels arranged in grid shape which are generally made up of red, green and blue subpixels, the color definition being carried out by means of corresponding color filters. The pixels and subpixels are individually controllable by means of a control unit. The term “LC unit” refers herein exclusively to the pixel structures which are switchable to transmissive or opaque, but not to the back-light illumination thereof. Generally, the polarization structures above and below the pixels needed for changing the transmission characteristics belong to the LC unit as does the color filter which is arranged between the polarization structure above the pixels and the pixels. It is important that beyond those layers mentioned above—placement surface, possibly protective layer, touch-sensitive layer—no additional layers are arranged above the LC unit such as structured light-guiding layers or semitransparent sensor layers which could reduce the brightness or brilliance of the screen. The partly transparent backplane via which the pixels are controlled is arranged between the polarization structure below the pixels and the pixels themselves. The backplane can be provided on its underside in the opaque region with an absorbent layer to prevent reflections of light which is emitted in direction of the placement surface by the illumination unit described in the following.
- An illumination unit with a transparent light guide layer body, first illumination source or means and second illumination source or means are arranged below the LC unit. The first illumination means is formed for illuminating the LC unit with diffuse light in a first wavelength range, i.e., light of the first wavelength range which is emitted into the light guide layer body and exits the latter diffusely upwardly in direction of the placement surface. Accordingly, the back-light illumination for the LC unit is realized by the first illumination means.
- The second illumination means is formed to emit directed light in a limited angular range of no more than 20° around a given central angle, i.e., ±10° around the central angle; it emits light in a second wavelength range. The two wavelength ranges may be congruent, partially overlap or be completely distinct from one another. In particular, each of the wavelength ranges can also comprise only one individual wavelength within tolerances given, for example, by filters. The central angle is predetermined such that light which is emitted in the limited angular range and guided through the LC unit and the touch-sensitive layer at an underside of the placement surface would be at least partially reflected at the placement surface, for example, would principally be totally internally reflected, in the event of a medium which adjoins the placement surface and has a refractive index that diverges from the refractive index of the material of the placement surface. The medium can be air, for example.
- The central angle need not form 0° with a surface normal of the placement surface, but rather preferably forms an angle between 0° and 80°, particularly preferably between 0° and 70°, with the surface normal. In a particularly preferable manner, the limited angular range also includes only angles of no more than 10° around the central angle to allow the sharpest possible imaging of the papillary structures on an optical sensor which is to be described in the following and, in so doing, also to sharply image details.
- In this connection, two variants are particularly preferred. In one case in which the principle of frustrated total internal reflection is utilized for the reflection, the central angle is preferably greater than the critical angle of total internal reflection, for example, 42° in the case of the usual glass-air interface. In this way, the reflections at the interface are particularly strong, the light is utilized efficiently, and the contrast is correspondingly high. In a particularly preferable manner, the angles of the limited angular range all lie around the central angle such that they are greater than the critical angle of total internal reflection. In the other case, when the usual reflection is used instead of total internal reflection, the central angle is preferably 0° in order to keep the light path between reflection at the placement surface or interface and the detection at a sensor layer as short as possible and, therefore, keep the resolution as high as possible. In this case, the amount of light is appreciably smaller because, as a rule, no more than 4% of the light is reflected at the placement surface as boundary with air.
- The diffuse illumination is not suitable by itself to image skin prints, since the distance between a sensor layer, which is arranged below the light guide layer body and will be described more fully later, and the placement surface can amount to several hundreds of micrometers so that the papillary structures of the skin and details such as pores cannot be resolved by the sensor elements. This loss of detail which can be on the order of only 50 μm is caused by the wide angular spectrum of the diffuse illumination which leads to blurriness of the structures to be imaged with increasing distance insofar as no imaging or collimating optics are used. On the other hand, the diffuse illumination is necessary in order to illuminate the screen as uniformly as possible when it is used to display information.
- The pixels of the LC unit are switchable between a state which is transparent to the diffuse light and the directed light and a state which is opaque to the diffuse light, which takes place as a result of the change in the polarization direction of the light which is already linearly polarized when entering the LC unit. As described, the pixels of the LC unit are illuminated by the diffuse light emitted by the first illumination means for displaying information which is processed with the help of the control unit for the display. Switching into a state which is also opaque to the directed light is not absolutely necessary but is a possible option.
- Finally, an optical sensor layer is arranged below the light guide layer body, this optical sensor layer having sensor elements which are arranged in grid shape and which are sensitive at least to light of the second wavelength range.
- Accordingly, in contrast to the prior art, the optical sensor layer is arranged below the illumination unit. Since the sensor elements are arranged below the light guide layer body, the latter must be transparent in contrast to the prior art where the back-light illumination for LC units is configured to be opaque because the back-light illumination has on its underside a highly reflective layer which maximizes the luminous efficacy. In order to increase the luminous efficacy for the diffuse illumination in the device according to the invention, the surface of the sensor layer, or at least of the sensor elements, which is generally metallic can be configured to be partially reflective except for the apertures of the elements detecting the light of the second wavelength range.
- Due to the fact that the sensor layer forms the lowest layer of the device, this sensor layer or sensor elements need not be transparent or semitransparent so that less expensive components can be used for this purpose, for example, CMOS-based sensors. Since all of the components which are necessary for registration of skin prints are arranged below the LC unit, the screen is not visually disturbed. Since neither the diffuse light nor the directed light need traverse areas with semitransparent sensors which generally transmit only 1% to a maximum of 30% of the emitted light, the energy efficiency can be improved; less energy is required for the same brightness as in conventional devices.
- In a further embodiment form, the directed light is not changed with respect to the polarization direction by the LC layer at certain central angles so that it can always pass the LC unit unimpeded regardless of whether the LC unit is switched into the opaque state or transparent state. The reason for this is that particular LC units may be highly dependent on angle and wavelength with respect to transmission characteristics, as a result of which the directed light can pass through the LC unit independent from the switching state. For this purpose, the central angle of the directed light should be between 30° and 80°, preferably between 40° and 70°, and particularly preferably between 50° and 70°. In this embodiment form, an LC unit with uncrossed linear polarizers, i.e., parallelly oriented polarization filters, must be used because otherwise the directed light would be extinguished.
- However, losses of about 50% may nevertheless occur with the LC unit during illumination with directed light due to polarization at the lower polarization structure when the utilized light is not polarized. Such losses can be prevented in that, for example, a laser or other light source emitting polarized light is used as light source for the directed illumination.
- Further, it is possible in some constructions to also utilize the second illumination means to display information when the central angle is in the range above the critical angle of the total internal refection at the placement surface. This can be achieved, for example, in that the angle of inclination of suitable, e.g., prism-shaped, out-coupling structures is selected to be correspondingly large in order to impress a large directional change on the light guided in the light guide when impinging on the inclined surface of the light out-coupling structure. Further, this depends on the difference in the refractive index between the light guide and adhesion layers which surround the latter and which have lower refractive indices than that of the light guide, since this defines which light angles are guided at all.
- In order to save energy, the first illumination means can be switched off during the capture of skin prints of autopodia. On the other hand, the second illumination means need only be activated when one or more skin areas are to be detected; this can be integrated in the control of a corresponding application, for example. The switching on of the second illumination means can be locally limited to areas in which the touch-sensitive layer has detected the placement of one or more skin areas during an illumination from the side, for example, on a stripe-shaped region.
- In a particularly preferred configuration, the first wavelength range for the diffuse illumination and the second wavelength range for the directed illumination have no intersection, that is, the areas do not overlap. The superposition of the signals of the two illumination means can be minimized in this way. The first wavelength range then preferably comprises visible light, and the second wavelength range preferably contains nonvisible light, preferably in the NIR range between 780 nm and 3000 nm, and illumination in the UV-A range between 315 nm and 380 nm is also possible.
- Alternatively, the second illumination means can be formed to also emit monochromatic light, that is, the second illumination means emits light only in a very narrow band. In this case, in order to separate the light of the second illumination means from the light of the first illumination means, a transmission filter is arranged between the optical sensor layer and the light guide body so that preferably only light of the second illumination means is allowed to pass.
- The light guide layer body and the illumination means are essential component parts of the arrangement. The light guide layer body can be realized in various ways. In a first configuration, the light guide layer body comprises a lower transparent layer as part of the first illumination means and an upper transparent layer as part of the second illumination means. The two layers are preferably formed to be substantially plate-shaped, i.e., have two large surface areas—also referred to as main surfaces or large sides—which are arranged substantially parallel to one another and at a short distance from one another. The two large surface areas are connected at the edges by narrow sides which form the edges of the plate. The geometry of the plate is often rectangular, but this is not compulsory. The first illumination means comprises first light sources which emit light in the first wavelength range, and the second illumination means comprises second light sources which emit light in the second wavelength range. The light of the first light sources is coupled into the lower transparent layer, and the light of the second light sources is coupled into the upper transparent layer. The first light sources and second light sources are preferably arranged at a narrow side of the respective plate-shaped layer, and the light can then be coupled into the respective layer laterally via the narrow side or via a corner of the light guide layer which is preferably cut off or provided with a bevel for this purpose. When light is coupled in from the side particularly in the second light sources for generating the directed light, but also in the first light sources, it can be advantageous when the light source comprises a plurality of individual light sources, the emitting angle of each individual light source preferably being limited by collimating means, for example, absorbent cylindrical structures and/or optical lenses. The maximum available brightness is increased in this way. This spatial collimation is a great advantage particularly for the generation of directed light because the angle of incidence at which the light impinges on the light guide can already be limited from the outset to a small angular range which depends on the specific collimating structure. It is also possible to couple in light from below for the diffuse illumination when the first light sources are integrated, for example, in the optical sensor layer and are arranged, for example, between the sensor elements.
- The light of the first light sources and the light of the second light sources is guided in the respective layer of the light guide layer body by means of total internal reflection (TAR); an incident angle range with angles under which light of the first light sources and light of the second light sources impinge from the side on an interface of the respective layer must accordingly be selected such that the light is also guided at the critical angles of the incident angle range through total internal reflection. Optical layers which have a lower refractive index than the respective layer of the light guide body are applied to the large surface areas. These optically low-refracting layers can comprise air or a transparent adhesive, for example. The transparent layers of the light guide body have interfaces at their main surfaces, and first out-coupling structures are formed at the interfaces of the lower transparent layer to couple out diffuse light and second out-coupling structures are formed at the interfaces of the upper transparent layer for coupling out directed light. In each of these two cases, the light is coupled out in direction of the placement surface.
- It is also possible in principle to exchange the transparent layers with respect to their stacking sequence and, correspondingly, the illumination means and light sources and to form out-coupling structures at the interfaces of the lower transparent layer for coupling out directed light and out-coupling structures at the interfaces of the upper transparent layer for coupling out diffuse light even when this results in a further widening of the emitting angle of the directed light, i.e., the limited angular range should be correspondingly selected much narrower than in the first case where the widening of the returning light is not carried out until shortly before impinging on the sensor.
- It is possible to form the first light sources and second light sources in such a way that the light is coupled into the lower transparent layer or upper transparent layer laterally, and the first light sources and second light sources are combined to form a common edge illumination. In the extreme case, the first light source and second light source are combined to form an individual light source, the light thereof being coupled into the light guide layer body via the edge. Since light of the same wavelengths is used both for the diffuse illumination and for the directed illumination, it is advisable to arrange an additional diaphragm layer between the optical sensor layer and the light guide layer body for solid angle selection so that the sensor elements of the optical sensor layer can receive substantially mainly, or only, light of the directed illumination.
- The out-coupling structures for the directed light and for the diffuse light are formed such that the illumination per unit area is carried out predominantly homogeneously with respect to intensity and, for the directed light, also with respect to angular distribution regardless of whether skin parts of autopodia lie on the placement surface at one location or at a plurality of locations. This is realized by means of a correspondingly selected distribution of the out-coupling structures on the large surface areas. For example, the number of out-coupling structures can be increased with increasing distance from the side from which the light is coupled in.
- In an alternative configuration of the device, instead of using a lower transparent layer and an upper transparent layer in the light guide layer body, the light guide layer body comprises an individual, transparent, substantially plate-shaped combination layer. The first illumination means comprises first light sources and the second illumination means comprises second light sources, and light of the first light sources is coupled into the combination layer preferably at a first narrow side, preferably laterally or laterally from a corner, and light of the second light sources is coupled into the combination layer preferably at a second narrow side opposite the first narrow side, preferably laterally or laterally from a corner, or from below by means of additional optical elements such as lenses or prisms which are arranged laterally of the sensor layer. In this case also, the light is guided by means of total internal reflection, and combination out-coupling structures are preferably formed at the interfaces of the transparent combination layer for coupling out diffuse light and directed light simultaneously in direction of the placement surface depending on an emitting direction, for example, proceeding from the first narrow side or second narrow side. Additionally or alternatively, first out-coupling structures and second out-coupling structures can also be arranged in this instance in order to increase or ensure homogeneity, for example, at an interface opposite that interface having the combination out-coupling structures. It is important in this respect in particular that the diffuse light be coupled out as homogeneously as possible. The means for homogenizing the directed light that is insignificant for the viewer of the screen because no information is to be displayed by it can also be integrated in the optical sensor layer in that, for example, the diaphragm size is adapted at that location or the sensitivity of the sensor elements is gradually increased with increasing distance from the side on which the light is coupled in, or a semitransparent layer is applied with gradually decreasing absorption proceeding from this side.
- The invention is further directed to a method for simultaneously capturing the skin prints of a plurality of autopodia placed on a placement surface, particularly with a device such as that described in the preceding. Viewed from the direction of the autopodia, the device comprises a placement surface, a touch-sensitive layer, an LC unit with individually controllable pixels arranged in grid shape, an illumination unit with a transparent light guide layer body and first illumination means for illuminating the LC unit with diffuse light in a first wavelength range and with second illumination means for emitting directed light in a second wavelength range, and an optical sensor layer with sensor elements which are arranged in grid shape and are sensitive to the light of the second wavelength range.
- In the method, the LC unit of the device, for example, of a mobile phone or PC tablet, is initially illuminated with diffuse light in a first wavelength range by the first illumination means during operation, the pixels of the LC unit being switchable between a state which is transparent to the diffuse light and a state which is opaque to the diffuse light. Information can be displayed in this way. This is the usual operating mode of a screen or PC tablet of this kind when there is no finger placed on it. Information is displayed in color, since usually every pixel is composed of a plurality of subpixels emitting light of the basic colors red, green and blue.
- The touch-sensitive layer detects whether or not skin areas are placed on the placement surface. When skin areas are placed on the latter, the sensor elements of the optical sensor layer are activated so that they can detect light. Further, the second illumination means which is switched off in normal operating mode in which only information is displayed are switched on. If a touch-sensitive layer is provided, the corresponding information about whether one or more fingers are applied, for example, is available automatically, and the touch-sensitive layer also registers the placement locations on the two-dimensional placement surface. User information can be displayed on the screen of the device simultaneously in conjunction with the capture of the prints.
- After the second illumination means has been switched on, it emits directed light in a limited angular range of no more than 20° around a given central angle, where the central angle is predetermined such that light which is emitted in the limited angular range and which is directed through the LC unit and the touch-sensitive layer on an underside of the placement surface is mainly totally internally reflected at the placement surface in the event of an adjoining medium with a refractive index of air. However, the light passes through the placement surface particularly when skin ridges of a finger or of another autopodium are applied. Light reflected from the placement surface is then detected by means of the optical sensor layer. Since the sensor elements are arranged in grid shape, the detected light can be captured and registered as an impression of one autopodium or impressions of a plurality of autopodia, i.e., the intensity values detected by the optical sensor elements are processed to form a print or plurality of prints, and image processing methods known from the prior art are used. If the registration or capture of the skin areas of autopodia was successfully concluded or was aborted, for example, because a finger was removed from the placement surface before the recording could be finished, the optical sensor layer is deactivated and the second illumination means is switched off.
- Since the second illumination means and the optical sensor elements only consume energy when fingers are applied, the method works in a very energy-efficient manner. Moreover, the switching on of the second illumination means and of the optical sensor elements can also be tied to further conditions, for example, the switching on can be limited to applications which explicitly require the checking of fingerprints such as applications for online banking, for example.
- In a final step, the captured print or captured prints are compared with prints stored in a database and, depending on the results of the comparison, an action or several actions are possibly carried out. For example, a mobile device can be associated with a plurality of users in a company, and each of the users has his/her own user profile and own user surface. A profile specific to the respective user can then be loaded for a user surface based on the fingerprints.
- In order to enhance security, an individual recording is preferably initiated for each autopodium applied. The recordings can also be repeated in case a change in position of one or more autopodia is detected or if additional autopodia are applied. In order to make the method even more energy-efficient, the detection of light of the second wavelength range can also be limited to regions in which the placement of an autopodium is detected by the touch-sensitive layer.
- Possible applications of the invention reside mainly in the integration of multi-fingerprint sensors in LC screens. For example, they can be a component part of smartphones, tablets, television devices, laptops and other equipment with displays by which a user authentication is to be carried out. An example of an application is a touch-sensitive screen in a car having a virtual dashboard with a virtual start button which is enabled when the corresponding fingerprint of a registered user is detected and allows the car to start and/or a virtual switch by means of which a user-specific seating and mirror combination is adjusted.
- It will be appreciated that the features mentioned above and those explained in greater detail below can be used not only in the indicated combination, but also in other combinations or by themselves without departing from the scope of the present invention.
- The invention will be described in the following referring to exemplary embodiments in the appended drawings which likewise disclose features essential to the invention. These exemplary embodiments are to be considered as merely illustrative and not restrictive. For example, it is not to be construed from a description of an embodiment example having a plurality of elements or components that all of these elements or components are necessary for its implementation. On the contrary, other embodiment examples may also contain alternative elements and components, fewer elements or components, or additional elements or components. Elements or components of various embodiment examples may be combined with one another unless otherwise indicated. Modifications and alterations which are described for one of the embodiment examples may also be applicable to other embodiment examples. To avoid repetition, like or similar elements are designated by like reference numerals in various figures and are not described multiple times. The drawings show:
-
FIGS. 1a,b two cross-sectional views of devices for displaying information and for simultaneous contact-based capture of skin prints of autopodia with applied finger; -
FIG. 2 a cross section through a light guide layer body with two transparent layers; -
FIG. 3 a cross section through a light guide layer body in an alternative configuration; -
FIGS. 4a )-c) various possibilities for coupling light into a transparent layer of a light guide layer body; -
FIG. 5 a further possibility for illuminating a transparent layer of a light guide layer body; -
FIG. 6 possible arrangements of out-coupling elements in a top view; -
FIG. 7 a possible construction of an LC unit; and -
FIG. 8 the basic flow of a method for the simultaneous capture of the skin prints of a plurality of autopodia. -
FIG. 1a shows a section through a device for displaying information and for the simultaneous contact-based capture of prints of a plurality of blood-perfused skin areas of human autopodia. In the present instance, afinger 1 serves as an example of an autopodium. Viewed from the direction of the contacting skin area, the device comprises first of all aplacement surface 2 for placement of the autopodia. In the present case, this is part of an optionalprotective layer 3 which serves to protect elements located below it. For example, this can be a glass layer or plastic layer. A touch-sensitive layer 4 is arranged below the optionalprotective layer 3 and registers whether or not skin areas are placed on theplacement surface 2. Below this touch-sensitive layer 4 is anLC unit 5 withpixels 6 which are arranged in grid shape and are individually controllable by means of a control unit, not shown. Below theLC unit 5 is an illumination unit with a transparent lightguide layer body 7 and first illumination source or means and second illumination source or means which will be described more fully below referring toFIG. 2 andFIG. 3 . Finally, anoptical sensor layer 8 withsensor elements 9 arranged in grid shape is arranged below the lightguide layer body 7. - The construction of the illumination unit will be described in more detail in the following referring to the alternative configurations according to
FIG. 2 andFIG. 3 . The illumination unit comprises the transparent lightguide layer body 7 and first illumination means and second illumination means. The first illumination means is formed to illuminate the LC unit with diffuse light in a first wavelength range. On the other hand, the second illumination means is formed to emit directed light in a limited angular range of no more than 20° around a given central angle and in a second wavelength range. The central angle is predetermined such that light which is emitted in the limited angular range and is directed through theLC unit 5 and the touch-sensitive layer 4 at an underside of the placement surface would be at least partially reflected at the placement surface in case of a medium adjoining the latter and having a refractive index diverging from the refractive index of a material of theplacement surface 2. - The
pixels 6 of theLC unit 5 can be switched between a state which is transparent to the diffuse light and the directed light and a state which is opaque at least to the diffuse light. To display the information, it is illuminated through the diffuse light. However, thesensor elements 9 of theoptical sensor layer 8 are only sensitive to light of the second wavelength range of the directed light, although it is not ruled out that the first wavelength range and second wavelength range overlap or that the second wavelength range is contained within the first wavelength range. The surface of thesensor elements 9 which faces the lightguide layer body 7 can be configured to be reflective for increasing the luminous efficacy for the diffuse light and with a diaphragm structure for improving the angular selectivity and/or the homogeneity of the directed illumination. The central angle forms an angle between 0° and 80°, preferably between 0° and 70°, with a surface normal of theplacement surface 2. The limited angular range preferably comprises angles of no more than 10° around the central angle, i.e., of ±5° around the latter. - However, when the first wavelength range and the second wavelength range overlap, the second illumination means can be configured such that it emits preferably monochromatic light in a very narrow wavelength range of a few nanometers. A transmission filter is preferably arranged between the
optical sensor layer 8 and thelight guide body 7 to separate the light of the second illumination means from the light of the first illumination means. -
FIG. 2 shows a first configuration of a lightguide layer body 7 with first illumination means and second illumination means. In this instance, the lightguide layer body 7 has alower layer 10 and anupper layer 11. Both thelower layer 10 andupper layer 11 are formed from transparent materials such as, for example, glass, PMMA or polycarbonate and are substantially plate-shaped. Thelower layer 10 is associated with the first illumination means, whereas theupper layer 11 is associated with the second illumination means. Accordingly, thelower layer 10 serves to illuminate theLC unit 5 with diffuse light in the first wavelength range, while theupper layer 11 serves to emit directed light as was described above. The first illumination means comprisesfirst light sources 12, and the second illumination means comprises the secondlight sources 13. Both thefirst light sources 12 and the secondlight sources 13 are only shown symbolically inFIG. 2 andFIG. 3 . Possible embodiments are shown inFIG. 4 andFIG. 5 . - Light of the
first light sources 12 is coupled into the lowertransparent layer 10, for example, laterally, laterally from a corner, or from below. Light of the secondlight sources 13 is coupled into the uppertransparent layer 11 laterally at a narrow side or laterally from a corner or from below. In the lowertransparent layer 10 and in the uppertransparent layer 11, the light is guided, respectively, through total internal reflection and, accordingly, cannot be coupled out of the light guides without auxiliary means. This auxiliary means is formed by first out-coupling structures 14 at interfaces of the lowertransparent layer 10 and second out-coupling structures 15 at interfaces of the uppertransparent layer 11. In this instance, “interfaces” means the large surface areas or main surfaces of the respectivetransparent layer coupling structures coupling structures 14 are formed as concave indentations in the lowertransparent layer 10 at the lower interface. Alternatively or additionally, convex bulges can also be formed at the upper interface of the lowertransparent layer 10. When light from thefirst light sources 12 which was irradiated into the lowertransparent layer 10 impinges on the first out-coupling structures 14, it is deflected substantially diffusely and coupled out as is indicated by the small arrows. - Optionally, a
reflective layer 101 can be applied to a narrow side of the lowertransparent layer 10 opposite the narrow side serving to couple in light in order to improve the luminous efficacy of the diffuse illumination. On the other hand, the second out-coupling structures 15 are formed in this instance at the upper interface of the upper layer with an exemplary rectangular base area and prismatic longitudinal section. Alternatively or additionally, the out-coupling structures 15 could also be arranged at the lower interface of theupper layer 11 and can likewise be parallelepiped-shaped. Therefore, light is coupled out in this instance only within a narrow angular range which is predetermined by the geometry and, inter alia, by the angle of inclination of the prism surface or relief surface of the out-coupling structures, where the angle of inclination is preferably 5° to 25° relative to the large surface area of thetransparent layer 11, particularly preferably 10° to 20°. - Both the directed light coupled out by the second out-
coupling structures 15 and the diffuse light coupled out by the first out-coupling structures 14 are coupled out in direction of theplacement surface 2. Separating layers 16 are arranged at the interfaces so that the light is conducted in the lowertransparent layer 10 and in the uppertransparent layer 11, respectively, by means of total internal reflection. These separating layers 16 can be air or an adhesive layer, for example. Other materials with a correspondingly lower refractive index than thetransparent layers transparent layers layer 16 is 1% to 30%, preferably 5% to 30%, particularly preferably 10% to 25% lower than the refractive index of thetransparent layers separating layer 16 also fills up the concave indentations of the first out-coupling structures 14, for example. In particular, optically transparent double-sided adhesive strips (OCA) or liquid adhesives (LOCA) which harden under heat or UV radiation are also suitable as materials for the separating layer. For example, silicones, acrylate or epoxides having refractive indices of between 1.2 and 1.5, preferably between 1.3 and 1.47 and particularly preferably between 1.35 and 1.43 can be used for this purpose. The material for thetransparent layers -
FIG. 1b shows a construction in which light is coupled into the lightguide layer body 7 from below in at least one of the two transparent layers. In the example shown inFIG. 1b , light of the secondlight sources 13 is coupled into the uppertransparent layer 11 and/or light of thefirst light sources 12 is coupled into the lowertransparent layer 10. To this end, aprojection 71 of the lowertransparent layer 10—directed in this case toward the left-hand side—is formed at the lightguide layer body 7. Similarly, a projection of the uppertransparent layer 11, not shown, can also be formed on the right-hand side in order to couple light of thelight sources 13 into the uppertransparent layer 11 from below. Prism-shaped in-coupling elements 72 or lenticular in-coupling elements 73, for example, are then mounted on the underside of theprojection 71 for coupling in light. An adhesive which is adapted with respect to refractive index and which accordingly has, as far as possible, the same refractive index as thetransparent layers coupling elements guide layer body 7 ortransparent layers transparent layers - Further, in the configuration shown in
FIG. 1b , atransmission filter layer 81 which can be configured, for example, as a bandpass filter and which is transparent substantially only to light of the secondlight source 13 is arranged between thesensor layer 8 and the lightguide layer body 7. This is advantageous when the first wavelength range and second wavelength range overlap. - In
FIG. 2 , thefirst light sources 12 and the secondlight sources 13 are depicted separate. But, in case of lateral in-coupling, it is also possible to combine thefirst light sources 12 and the secondlight sources 13 to form a common edge illumination. Diaphragms for angle selection are then preferably integrated on thesensor elements 9 so that thesensor elements 9 preferably detect the directed light of the second light source after reflection at the placement surface. In this case, the first illumination means would always be switched on regardless of whether or not a fingerprint is registered. - Additionally, in case of two separate
light sources transmission filter layer 81 between theoptical sensor layer 8 and the lowertransparent layer 10, this transmission filter preferably being transparent only to light of the secondlight source 13 in a narrow range of, e.g., 5 nm or 10 nm to 200 nm, preferably 10 nm to 100 nm, particularly preferably from 10 nm to 50 nm bandwidth. In this way, the light to be detected by theoptical sensor elements 9 is spectrally limited to a narrow range of a few nanometers. The narrower the spectral range, the less interference light from thefirst light source 12 is detected by theoptical sensor elements 9, but the amount of light that is detectable overall is also reduced so that the light efficiency decreases. In this case, an appropriate compromise must be found which is suited to the application, which is accomplished by means of thetransmission filter layer 81 if the filter is not too narrow. The reduction in light efficiency can be countered with a monochromatic light source, and atransmission filter layer 81 with an even narrower bandwidth of less than 5 nm can correspondingly be utilized. - A particularly preferred, alternative construction is shown in
FIG. 3 . In this instance, the lightguide layer body 7 can be constructed thinner, which reduces the overall depth of the device. In this case, the lightguide layer body 7 comprises a transparent, substantially plate-shapedcombination layer 17, also referred to as individual layer. Except for the separating layers 16, thecombination layer 17 is the only layer of the lightguide layer body 7. In this case again, the first illumination means comprisesfirst light sources 12 and the second illumination means comprises secondlight sources 13. Light of thefirst light sources 12 is preferably coupled into thecombination layer 17 laterally or laterally from a corner at a firstnarrow side 18. Light of the secondlight sources 13 is preferably coupled into thecombination layer 17 laterally or laterally from a corner at a secondnarrow side 19 opposite the firstnarrow side 18. In a plate-shaped light guide, those sides or edges which connect the large surface areas or main surfaces to one another are referred to as narrow sides. In this case also, the light is guided in the interior of thecombination layer 17 by means of total internal reflection, and combination out-coupling structures 20 for coupling out diffuse light and directed light in direction of theplacement surface 2 depending on an incident direction are formed at the interfaces of thetransparent combination layer 17. Light can also be coupled into thecombination layer 17 from the bottom when a projection is formed at both sides similar to the construction inFIG. 1 a. - The combination out-
coupling structures 20 are constructed in this instance such that when illuminated from the left-hand side referring toFIG. 3 , i.e., proceeding fromnarrow side 18, with light of thefirst light source 12 indicated by the solid arrows, light is coupled out in direction of theplacement surface 2 in an undirected, i.e., diffuse, manner. The corresponding part of the combination out-coupling structure 20 is formed in this instance by way of example with a—uniform or variable—curvature for coupling out diffuse, undirected illumination. Light originating from the secondlight sources 13 which enters from the opposite side and is represented in this instance by the dashed arrows is deflected in direction of theplacement surface 2 when impinging on the combination out-coupling structure 20 proceeding from the right-hand side referring toFIG. 3 . At this location, the combination out-coupling structure 20 has a plane surface which, however, has an inclination in the manner of a prism compared to theplacement surface 2, that is, forms an angle other than zero with theplacement surface 2. Depending on this inclination, directed light is coupled out at a defined central angle in direction of the placement surface. - Aside from the fact that the entire overall height of this construction appears smaller, fewer layers need also be connected to one another. The shorter distance from the placement surface also allows a higher image quality of the captured skin print. While a homogeneous intensity distribution can be achieved through the quantity and distribution of out-
coupling structures FIG. 2 , thefirst light sources 12 and secondlight sources 13, respectively, can also be arranged on both sides in principle, unlike the configuration according toFIG. 3 —this is true either only for the diffuse light or only for the directed light when using combination out-coupling structures 20, since the same spatial distribution of out-coupling structures is used for both diffuse light and directed light. - Generally, it is through the distribution of the combination out-
coupling structures 20 that it is ensured that the intensity of the diffusely out-coupled light appears substantially homogeneous because this is the light that is predominantly perceived by the observer. In this case, light coupled in from the other side for the directed illumination is largely coupled out in the vicinity of the incident area, since many of the combination out-coupling structures 20 are located in that area. A homogenization can then advantageously be achieved at least for the detection of the directed light via additional apertures over theindividual sensor elements 9 which have smaller apertures in the area where the light of the secondlight sources 13 is coupled in than on the opposite side where the light of thefirst light sources 12 is coupled in. The transmissivity can also be continuously varied with a transmission layer that becomes thicker or thinner as is described, for example, inDE 10 2017 119 983 B3, the disclosure of which is incorporated herein. - As is indicated by the arrows in
FIG. 3 , the light is preferably coupled into the light guide on both sides already under a determined angle which satisfies the precondition for total internal reflection so that better use is made of the light. This can be realized, for example, by an inclined arrangement of light sources at the light guide or in-coupling optics arranged upstream. - As regards the input of light, the simplest way is to couple the light in from the side as was shown by way of example in
FIG. 3 . However, in order to achieve the highest possible resolution of the biometric features of a finger placed on the placement surface, it is advantageous to couple the light into the corresponding layer via a corner. This is explained in more detail referring toFIG. 4 .FIGS. 4a )-c) show three configurations of the illumination unit with a light guide layer body and illumination means for coupling light into corners. The diagram is a top view of a main surface of atransparent layer FIG. 4a ) shows an embodiment form for the in-coupling of light in which the first light source and second light source are formed as LEDs—the way in which the light is coupled in functions equally well for directed light and diffuse light—and in which the in-coupling of light is implemented on at least one surface formed by cutting off a corner of the corresponding transparent layer of the light guide layer body. Acorner 21 which is cut off in this way produces an additional narrow side which forms an angle of 135°, for example, with the usual narrow sides of a rectangular plate-shaped layer. In this case, it is not necessary for the light emitted by thelight sources -
FIGS. 4b ) and c) show additional steps beyondFIG. 4a ). InFIG. 4b ), the light distribution or light homogenization is improved by means of adiffuser 22 so that light is emitted uniformly in all directions, whereas inFIG. 4c ) thecut corner 21 is formed as a concave curve so that all of the rays exiting divergently from thefirst light source 12 or secondlight source 13 can enter the light guide layer continuously, and light exiting from only one individual LED can also propagate and be coupled out in the entiretransparent layer -
FIG. 5 shows a further configuration for coupling in light at a narrow side which is particularly suited for generating directed light. Thefirst light source 12 and secondlight source 13 comprise manyindividual LEDs 23 which are arrayed along the narrow side used for in-coupling. TheLEDs 23 are embedded in cylindrical orfrustoconical absorption structures 24 which are shown in cross section. Theabsorption structures 24 provide for the spatial collimation of the light emitted by the LEDs to an angular range of, e.g., 10° around anaxis 25. The available angular range depends particularly on the extent of the cylindrical orfrustoconical absorption structure 24 in emitting direction. -
FIG. 6 shows two sections of an uppertransparent layer 11 with second out-coupling structures 15 in a top view. The second out-coupling structures 15 are wedge-shaped and present rectangles rising in a lectern-shaped manner from the direction of illumination or trapezoidal surfaces as is shown in section inFIG. 2 . Shown here is the upper interface of the uppertransparent layer 11 in which the second out-coupling structures 15 are formed. They are arranged in a plurality of rows, and the distance of the individual rows relative to one another decreases with increasing distance from the secondlight source 13 in order to improve the homogeneity of the intensity of the emitted light; this is also shown inFIG. 2 . -
FIG. 7 shows a possible construction of anLC unit 5 in detail. The core of theLC unit 5 is formed by aliquid crystal layer 27 withliquid crystal molecules 28 contained in cells, not shown here. Theliquid crystal molecules 28 are rod-shaped in this instance in order, for one, to graphically show the polarization direction and the rotation of the polarization of the light. The cells with theliquid crystal molecules 28 are bounded by avertical orientation layer 29—in this instance below theliquid crystal layer 27—and ahorizontal orientation layer 30, in this instance at the upper side of theliquid crystal layer 27. The orientation layers are, for example, glass plates with a plurality of parallel, either horizontally or vertically oriented microgrooves by means of which theliquid crystal molecules 28 are helically oriented mechanically along the length of the cell. Layer-shapedtransparent electrodes 31 are arranged at the outer sides of the glass plates and, when voltage is applied, the orientation of theliquid crystal molecules 28 can be changed by theseelectrodes 31. Further, acolor filter 32 and aglass substrate 33 are arranged on the upper side of thetransparent electrodes 31 above thehorizontal orientation layer 30, i.e., in emitting direction toward theplacement surface 2, and ahorizontal polarization filter 34 is arranged on theglass substrate 33. In this construction, an active semiconductor matrix orbackplane 35, as it is called, is arranged on the underside of theelectrodes 31 below thevertical orientation layer 29. This is a matrix oftransistors 36, usually thin film transistors (TFTs), atransistor 36 being associated with each cell and controlling the electrode of this cell situated above it. The LC unit is terminated at the bottom by aglass substrate 33 and avertical polarization filter 37. - In conventional screens, it is desirable to utilize as much light of the back-light illumination as possible to illuminate the screen. This is why reflections on metallic structures—for example, conductive traces—in the
backplane 35 are not disruptive, since the reflected light can possibly be guided in direction of the LC unit again through further reflections. In the present case, however, reflections of diffuse or directed light which has been coupled out of the light guides situated underneath are not desirable because this light goes directly to thesensor layer 8 without impinging on theplacement surface 2 beforehand. Accordingly, this reflected light negatively influences the detection of directed light with thesensor elements 9 because this light represents an offset without image information of prints. As a result of this offset, the light-sensitive elements of the sensor layer may already be saturated merely because of the back-reflection at the backplane structures, which makes it more difficult to detect finger lines. Therefore, in the construction described here, anabsorbent layer 38 is arranged below thebackplane 35, whichabsorbent layer 38 is likewise matrix-shaped with respect to structure and corresponds to the matrix structure of thebackplane 35. Thisabsorbent layer 38 reduces reflections at thebackplane 35 and improves the quality of the recording. It will be appreciated that, alternatively or additionally, a transparent backplane comprising transparent conductive materials such as ITO, IZO or AZO and transparent semiconductors such as GaN or ZnO can also be used. - Lastly,
FIG. 8 shows the basic flow of a method for the simultaneous capture of prints of a plurality of autopodia placed on aplacement surface 2, which method can be carried out with a device particularly such as that described in the foregoing. The device comprises—viewed from the direction of the applied autopodia—theplacement surface 2, a touch-sensitive layer 4, anLC unit 5 with individuallycontrollable pixels 6 arranged in grid shape, an illumination unit with a transparent lightguide layer body 7 and first illumination means for illuminating theLC unit 5 with diffuse light in a first wavelength range and second illumination means for emitting directed light in a second wavelength range. Adjoining the lightguide layer body 7 is anoptical sensor layer 8 withsensor elements 9 which are arranged in grid shape and are sensitive to light of the second wavelength range. The method can be implemented with a commercially available mobile phone with touch-sensitive screen, with touch-sensitive screens of PCs, etc. Accordingly, as a rule, information is already displayed on the screen. A user can now place thefinger 1 on theplacement surface 2 in a particular location on the screen in order to start an application, and the method steps to be described in the following are then carried out. - Another possibility for starting the method consists in that a security-relevant input is required in an already running application for which the user must identify himself/herself via fingerprints. Accordingly, in the normal state the
LC unit 5 is illuminated with diffuse light in a first wavelength range by the first illumination means to display information, and thepixels 6 of theLC unit 5 are switchable between a state which is transparent to the diffuse light and a state which is opaque to the diffuse light. If the touch-sensitive layer 4 then detects whether or notfingers 1 are placed on theplacement surface 2, the second illumination means is switched on or activated to emit directed light on the one hand and, on the other hand, thesensor elements 9 of theoptical sensor layer 8 are activated, i.e., are enabled to detect incident light of the second wavelength range. In order to save energy, the detection of light of the second wavelength range can be restricted to areas in which the placement of an autopodium is detected by the touch-sensitive layer 4. - After the second illumination means is switched on, it emits directed light in a limited angular range of no more than 20°, preferably no more than 10°, around a predetermined central angle. The central angle is predetermined such that light which is emitted in the limited angular range and is guided through the
LC unit 5 and the touch-sensitive layer 4 to an underside of theplacement surface 2 is at least partially reflected at theplacement surface 2 in case of an adjoining medium with a refractive index diverging from the refractive index of a material of theplacement surface 2. If afinger 1 is making contact, the directed light is reflected at the locations of a skin valley because there is still a layer of air between theplacement surface 2 and thefinger 1 at the location of the skin valley. Conversely, at the locations where skin ridges are placed on theplacement surface 2, the directed light passes through theplacement surface 2 into thefinger 1 and is scattered so that these areas appear darker in the image. Light reflected by theplacement surface 2 is detected by means of theoptical sensor layer 8 and, due to the differences in intensity, an image of the print of an autopodium or of the skin prints of a plurality of autopodia are recorded. When the recording of the skin prints of the autopodia is concluded or interrupted, theoptical sensor layer 8 is deactivated and the second illumination means is switched off. The captured print or the captured prints are subsequently compared with prints stored in adatabase 26. Depending on the results of the comparison, various actions may be carried out when thefinger 1 is detected, for example, the approval of a transaction, etc. - Due to the fact that the second illumination means and the
optical sensor layer 8 are activated only when a fingerprint must actually be registered, the method can be configured to be particularly energy-efficient such that the registration or capture of the fingerprint scarcely impacts the life of the battery. The method steps may be repeated when autopodia are lifted off and placed again on another location or when further autopodia are applied. Preferably, an individual recording is carried out for each applied autopodium so that when four fingers are applied, for example, four images are ideally generated simultaneously. - With the device described above and the method described above, a multi-finger authentication can be integrated, for example, in mobile phones without impairing the quality of the display of information on the screen. Also, virtually the entire surface area of the device is available for displaying information, since the entire surface of the screen can be utilized for recognition of the fingerprint, and area need be provided exclusively for print detection. Moreover, the construction is very compact so that the overall depth of the corresponding device can be kept sufficiently flat.
-
- 1 finger
- 2 placement surface
- 3 protective layer
- 4 touch-sensitive layer
- 5 LC unit
- 6 pixel
- 7 light guide layer body
- 8 sensor layer
- 9 sensor element
- 10 lower transparent layer
- 11 upper transparent layer
- 12 first light source
- 13 second light source
- 14 first out-coupling structure
- 15 second out-coupling structure
- 16 separating layer
- 17 combination layer
- 18 first narrow side
- 19 second narrow side
- 20 combination out-coupling structure
- 21 cut corner
- 22 diffuser
- 23 LED
- 24 absorption structure
- 25 axis
- 26 database
- 27 liquid crystal layer
- 28 liquid crystal molecule
- 29 vertical orientation layer
- 30 horizontal orientation layer
- 31 transparent electrode
- 32 color filter
- 33 glass substrate
- 34 horizontal polarization filter
- 35 backplane
- 36 transistor
- 37 vertical polarization filter
- 38 absorbent layer
- 71 projection
- 72 prism-shaped in-coupling element
- 73 lenticular in-coupling element
- 81 transmission filter layer
- 101 reflecting layer
Claims (20)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102019126408.1 | 2019-09-30 | ||
DE102019126408.1A DE102019126408B4 (en) | 2019-09-30 | 2019-09-30 | Device and method for the display of information and for the contact-based simultaneous recording of skin impressions of several perfused skin areas of human autopodia |
PCT/EP2020/073384 WO2021063597A1 (en) | 2019-09-30 | 2020-08-20 | Device for displaying information and for capturing autopodial impressions |
Publications (2)
Publication Number | Publication Date |
---|---|
US20220343671A1 true US20220343671A1 (en) | 2022-10-27 |
US11721125B2 US11721125B2 (en) | 2023-08-08 |
Family
ID=72234831
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/764,919 Active US11721125B2 (en) | 2019-09-30 | 2020-08-20 | Device for displaying information and for capturing autopodial impressions |
Country Status (4)
Country | Link |
---|---|
US (1) | US11721125B2 (en) |
CN (1) | CN114450728B (en) |
DE (1) | DE102019126408B4 (en) |
WO (1) | WO2021063597A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220109442A1 (en) * | 2019-01-31 | 2022-04-07 | Ams International Ag | Optical proximity sensor system |
US20220179253A1 (en) * | 2020-01-10 | 2022-06-09 | Boe Technology Group Co., Ltd. | Display device with fingerprint recognition function |
US20240135741A1 (en) * | 2021-03-30 | 2024-04-25 | Wuhan China Star Optoelectronics Technology Co., Ltd. | Display panel and display device |
US12126337B2 (en) * | 2020-01-30 | 2024-10-22 | Ams International Ag | Optical proximity sensor system |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200057340A1 (en) * | 2018-08-15 | 2020-02-20 | Shenzhen GOODIX Technology Co., Ltd. | Under-screen optical fingerprint recognition system, backlight module, display screen, and electronic device |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102015116026A1 (en) | 2015-09-22 | 2017-03-23 | JENETRIC GmbH | Device and method for direct optical image acquisition of documents and / or living skin areas without imaging optical elements |
US10177194B2 (en) | 2015-12-11 | 2019-01-08 | Gingy Technology Inc. | Fingerprint identification apparatus |
CN108182873B (en) | 2016-12-08 | 2020-08-07 | 乐金显示有限公司 | Flat panel display having optical image sensor embedded therein |
US10614283B2 (en) * | 2017-03-07 | 2020-04-07 | Shenzhen GOODIX Technology Co., Ltd. | Devices with peripheral task bar display zone and under-LCD screen optical sensor module for on-screen fingerprint sensing |
US10664676B2 (en) | 2017-06-12 | 2020-05-26 | Will Semiconductor (Shanghai) Co. Ltd. | Systems and methods for reducing unwanted reflections in display systems incorporating an under display biometric sensor |
US10331939B2 (en) | 2017-07-06 | 2019-06-25 | Shenzhen GOODIX Technology Co., Ltd. | Multi-layer optical designs of under-screen optical sensor module having spaced optical collimator array and optical sensor array for on-screen fingerprint sensing |
WO2019041214A1 (en) | 2017-08-31 | 2019-03-07 | 上海箩箕技术有限公司 | Display module |
DE102017119983B3 (en) | 2017-08-31 | 2018-09-27 | JENETRIC GmbH | Apparatus for contact-based simultaneous recording of autopod impressions |
DE102017008710B3 (en) | 2017-09-12 | 2019-02-28 | JENETRIC GmbH | Arrangement for the optical recording of living skin areas of human autopods and documents |
US20190129530A1 (en) | 2017-10-30 | 2019-05-02 | Synaptics Incorporated | Under display biometric sensor |
CN108983521A (en) * | 2018-08-14 | 2018-12-11 | Oppo广东移动通信有限公司 | Fingerprint collecting method, device, electrochromic window assemblies and electronic equipment |
-
2019
- 2019-09-30 DE DE102019126408.1A patent/DE102019126408B4/en active Active
-
2020
- 2020-08-20 WO PCT/EP2020/073384 patent/WO2021063597A1/en active Application Filing
- 2020-08-20 CN CN202080068452.7A patent/CN114450728B/en active Active
- 2020-08-20 US US17/764,919 patent/US11721125B2/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200057340A1 (en) * | 2018-08-15 | 2020-02-20 | Shenzhen GOODIX Technology Co., Ltd. | Under-screen optical fingerprint recognition system, backlight module, display screen, and electronic device |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220109442A1 (en) * | 2019-01-31 | 2022-04-07 | Ams International Ag | Optical proximity sensor system |
US20220179253A1 (en) * | 2020-01-10 | 2022-06-09 | Boe Technology Group Co., Ltd. | Display device with fingerprint recognition function |
US11867993B2 (en) * | 2020-01-10 | 2024-01-09 | Boe Technology Group Co., Ltd. | Display device with fingerprint recognition function |
US12126337B2 (en) * | 2020-01-30 | 2024-10-22 | Ams International Ag | Optical proximity sensor system |
US20240135741A1 (en) * | 2021-03-30 | 2024-04-25 | Wuhan China Star Optoelectronics Technology Co., Ltd. | Display panel and display device |
Also Published As
Publication number | Publication date |
---|---|
CN114450728A (en) | 2022-05-06 |
US11721125B2 (en) | 2023-08-08 |
CN114450728B (en) | 2023-05-12 |
DE102019126408A1 (en) | 2021-04-01 |
WO2021063597A1 (en) | 2021-04-08 |
DE102019126408B4 (en) | 2021-12-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10614283B2 (en) | Devices with peripheral task bar display zone and under-LCD screen optical sensor module for on-screen fingerprint sensing | |
US11048903B2 (en) | Under-LCD screen optical sensor module for on-screen fingerprint sensing | |
US10318791B2 (en) | Anti-spoofing sensing for rejecting fake fingerprint patterns in under-screen optical sensor module for on-screen fingerprint sensing | |
CN109791599B (en) | Under-screen optical sensor module for on-screen fingerprint sensing | |
US10331939B2 (en) | Multi-layer optical designs of under-screen optical sensor module having spaced optical collimator array and optical sensor array for on-screen fingerprint sensing | |
CN109791325B (en) | Device with peripheral taskbar display and LCD underscreen optical sensor module for on-screen fingerprint sensing | |
CN109196525B (en) | Anti-spoof sensing to reject false fingerprint patterns in an off-screen optical sensor module for on-screen fingerprint sensing | |
CN109154869B (en) | Optical collimator of optical sensor module under screen for on-screen fingerprint sensing | |
CN108121483B (en) | Flat panel display with embedded optical imaging sensor | |
WO2019161632A1 (en) | On-lcd screen optical fingerprint sensing based on optical imaging with lens-pinhole module and other optical designs | |
WO2020035021A1 (en) | Lcd fingerprint recognition system, under-screen optical fingerprint recognition device, and electronic device | |
US20150346856A1 (en) | Touch-sensing lcd panel | |
WO2021051752A1 (en) | Backlight module applied to display panel | |
US11328531B2 (en) | Apparatus for optically directly recording skin prints for mobile applications | |
US11721125B2 (en) | Device for displaying information and for capturing autopodial impressions | |
CN111902822B (en) | Under-screen illumination with external light source | |
US11733572B2 (en) | Image capturing apparatus | |
WO2021012702A1 (en) | Asymmetric brightness enhancement films for liquid crystal display assemblies | |
CN112154443B (en) | Optical fingerprint sensor with folded optical path | |
CN110546647B (en) | Optical fingerprint sensor under screen based on utilize off-axis pinhole to carry out lens-pinhole formation of image | |
CN111602074B (en) | Integrated enhanced diffuser panel for liquid crystal module and liquid crystal module | |
CN111357010B (en) | Enhancement film for an off-screen optical fingerprint sensor | |
CN111566662A (en) | Asymmetric brightness enhancement film for liquid crystal display assembly |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
AS | Assignment |
Owner name: JENETRIC GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MICHALSKY, TOM;RICHTER, UNDINE;RIEHL, PHILIPP;AND OTHERS;SIGNING DATES FROM 20220303 TO 20220316;REEL/FRAME:059468/0835 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: DERMALOG JENETRIC GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:JENETRIC GMBH;REEL/FRAME:066439/0546 Effective date: 20230811 |
|
AS | Assignment |
Owner name: DERMALOG JENETRIC GMBH, GERMANY Free format text: ADDRESS CHANGE;ASSIGNOR:JENETRIC GMBH;REEL/FRAME:067592/0854 Effective date: 20231116 |