CN109475328A - For detecting the integrated light-emitting display and sensor of biological nature - Google Patents

Abstract

A kind of surface of the biosensor arrangement integrated with display part comprising being used for the physical feeling touch for such as finger.Light source, such as LED array are reflected and are partially absorbed by the physical feeling by the surface emitting light.Photodetector array detects the light by the physical feeling retroeflection and generates the signal for corresponding to the image of light reflection, and described image corresponds to the light absorption pattern in the physical feeling.The light absorption pattern can be related to fingerprint, vascular patterns, the movement of endovascular blood, a combination thereof or other biometrics.Processor receives the signal and the analysis signal from the photoelectric detector with the characteristic of the determination physical feeling.The characteristic can be used to detected characteristic described in comparison and institute's storage characteristics to authenticate the user of the biosensor arrangement.

Description

For detecting the integrated light-emitting display and sensor of biological nature

The cross reference of related application

Present application is that the part of the 15/600th, No. 480 US application case filed on May 19th, 2017 connects, and base And advocate by Jerome Chandra Bhat in No. 62/348,096 US provisional patent Shen filed on June 9th, 2016 Please case and by Jerome Chandra Bhat and Richard Ian Olsen the 62/340th filed on May 23rd, 2016, The priority of No. 218 U.S. provisional patent application cases, the case transfer this case assignee and incorporated herein by reference.

Technical field

The present invention relates to sensing biological nature, such as blood flow, blood constituent, fingerprint, vascular patterns, face etc., and it is specific For be related to sensing this class feature using light and photoelectric detector.

Background technique

The known light (for example, feux rouges or IR light) by specific wavelength is applied to human body (for example, finger) and measurement is saturating The light for crossing human body can be used to detect blood flow (for example, pulse), the ingredient (such as hemoglobin) in blood, fat and other Characteristic.In general, light absorption is related to specific feature.

However, such system is normally limited to only execute the medical device of simple function.Further, since the measurement of light absorption is It is carried out by physical feeling, it is therefore necessary to particularly make device ring around tested particular body portion, such as finger.

It needs one kind to can be used for various functions and can be used for the cleverer of medical and non-medical purpose (such as user authentication) Biosensor living and compact.For user authentication, biosensor should be able to be easily integrated into existing consumer products.

No. 9,570,002 United States Patent (USP) description in special column 31 adds IR LED emitter together with photoelectric detector It is added in the matrix of total colouring screen.Then, user can touch screen, and can pass through the anti-of the ridge of the finger tip of detection touching screen It penetrates to detect the image of user fingerprints.It detects the surface only for finger tip and does not measure any light absorption for going deep into finger, so as to Detect blood vessel or blood flow.Therefore, if device is for authenticating, simulating/forge fingerprint may deception device.In addition, display Screen is the red, green and blue LED arrays of compact package, and is difficult to IR LED and photoelectric detector being added to existing LED Without losing resolution ratio in array.In addition, it will be very high that exploitation, which has the new display screen of integrative display pixel and detection pixel, Expensive.

Summary of the invention

A kind of integrated and compact photophore and sensor device are described, can be used to the life for detecting people using described device Object characteristic.The characteristic can be used for medical treatment/diagnostic purpose and people's certification.For example, described device is mountable in smart phone, meter To authenticate user in calculation machine or even rifle.

In one embodiment, it is being applied by the high-resolution pixel that multi wave length illuminating source (such as LED or filtering white light) is formed The light of penetrating body position (such as finger) is provided when being added to skin.Photodetector array be integrated in photophore and detect from The amplitude of the light of physical feeling retroeflection, wherein the amplitude of institute's retroreflection light is absorbed shadow by physical feeling and rung.Photodetector array It can produce the high-definition picture of light absorption.Controllable pixels (for example, launch wavelength) are to aim at certain biological natures, and device Resolution ratio can for height to detect detailed characteristics, such as fingerprint and vascular patterns.Video image can even be captured.Optical element is available Only to detect at certain skin depth and absorb, to detect the position of blood vessel.Processor in device can be programmed to analyze Signal from photoelectric detector and generate as a result, such as user authentication.

It is extremely difficult due to forging both fingerprint and vascular patterns simultaneously, compared with only fingerprint detector, device tool There is higher authentication reliability.

In another embodiment, LED light (for example, IR light) is coupled in the edge of transparent light guide, and be attributed to light guide and The refractive index of air is very different, guides the light by TIR in light guide.Assuming that the finger of user is pressed in light guide surface To carry out fingerprint detection on (such as glass), then the refractive index tight fit of finger and glass.Fingerprint top (ridge) contacts glass Surface, and slot will generate air gap.Therefore, light only will pull out from light guide in top pattern and enter finger.Therefore, light guide can be transparent 's.High-resolution photodetector array is located at light guide rear.Then, from the physical feeling (example of the top surface of contact light guide Such as, finger) reflection light reversely penetrate light guide and detected by photodetector array.Also optionally operation is display to device Device, wherein display pixel is located at light guide rear.Gained institute detection image can be used for special by fingerprint, vascular patterns or other biologies Property combination attestation user.In one embodiment, light guide is also the display of the display screen spaced with detector portion Glass, therefore detector and display are integrated.Display pixel can be to be conventional, such as OLED, and only detector light source makes Use display glass as light guide.By light guide and protective layer (or the touch of display that display glass is used as to display Screen) dual purpose, there is synergistic effect and integrated, and the uniformly distributed light of TIR is detected to carry out fingerprint/blood vessel.Detector Light source can be optically coupled to any adjacent edges of display glass.

Detector array can be distributed in entire display pixel or spaced with display part.

Light will enter certain finger distance via fingerprint jacking, and scatter also in finger and inhaled by the blood vessel in certain depth It receives.This will generate secondary reflection pattern, be used to detect the positional relationship between fingerprint and vascular patterns in combination with fingerprint pattern. Fingerprint pattern will be high contrast, and vascular patterns will be effectively superimposed upon above fingerprint pattern.

In one embodiment, light source and light sensor portion are for example lateral along the side of display part and display pixel It is spaced apart, in order to avoid occupy any space in display part.Display part transmits panel (such as thin glass face by light Plate) emit light to generate image.Glass panel may include even capacitive touch sensors.The light source example of biosensors part As close to light sensor portion and display part is spaced or light source optical be coupled to the edge that light transmits panel, And light transmitting panel serves as the waveguide of light source, as described previously.Therefore, detection be region by being separated with display area into Row.Light source can emit IR light, and display part emits feux rouges, green light and blue light from pixel array.In this way, light source and Detector portion does not influence display part, and both display part and detector portion transmit panel using same light.Cause This, display and sensor are integrated but spaced.

Device also acts as pulse transducer or the sensor as the certain blood constituents for absorbing target wavelength.

Can independent drive transmitting different wave length different LED, and by wide spectrum photoelectric detector detection institute's reflected light with determination The different types of biological characteristic of physical feeling.

Optical element can be used to focus light only to detect biological characteristic in certain physical feeling (such as blood vessel) depth.

Additional sensors can be integrated into optical sensor, such as gas sensor, electrode for detecting pulse etc..

Device can be compact and cheap, so that it can be used in the life for authenticating or analyzing in a portable device user Object characteristic.

The various other designs and purposes of such device are described.

Detailed description of the invention

Fig. 1 is the top view that can emit the high-resolution photophore of light of selected wavelength in selection area, wherein described Device is also in each multi-wavelength pixel region comprising photodetector array to sense the human body portion from contact light-emitting area The light absorption of position.

Fig. 2 is the viewgraph of cross-section of the device of Fig. 1, shows that the finger of people is placed on light-emitting area to detect fingerprint, blood Stream, the hemoglobin in blood or for authenticating or other characteristics of medical diagnosis.

Fig. 3 illustrates the correlation that optical wavelength is absorbed with hemoglobin in blood and oxyhemoglobin, can be by Fig. 1 and 2 Device in processor be used to determine the concentration of such components in the blood of people.

Fig. 4 is the cross section view comprising another embodiment for detecting the light source of biological nature and the device of optical sensor Figure, wherein front surface transmitting of the optoinjection into the marginal portion of transparent or semitransparent light guide and from light guide, and wherein photoelectricity two Pole pipe array is located at light guide rear to detect the light absorbing image of human body.

Fig. 5 explanation is fixed to hyaline layer (such as outside the protection of smart phone, laptop computer or other consumption devices Layer) Fig. 4 device.

The device of Fig. 6 explanatory diagram 4 is augmented with for sensing the electric signal from human body (such as combining The detection of reflected light detects EKG signal) electrode.

The device of Fig. 7 explanatory diagram 5 is further augmented with the sensitive gas sensing for detecting the gas gone out from human hair Part.

The device of Fig. 8 explanatory diagram 6 is further augmented with for determining the physical feeling contacted with device (for example, hand Refer to) temperature contactless, infrared temperature sensor.

Fig. 9 illustrates another embodiment of the present invention, and wherein the adjacent photosensor arrays of condenser lens are to obtain more high score Resolution, more high s/n ratio and the more compact device of formation.

Figure 10 is the front view with the single IC for both chip of high-resolution photodetector array.Lens array position Above detector array, focuses incident light and reduce the direct projection light quantity for entering photoelectric detector to increase signal-to-noise ratio.Light source can With many suitable designs, such as transparent light guide, the light guide is only along the direction for the human body being in contact with it transmitting light.Institute is anti- It penetrates light and reversely penetrates light guide to photoelectric detector.

Figure 11 is similar to Figure 10, but light source (for example, LED or laser) and photoelectric detector are integrated in same surface On.

The function that Figure 12 mark can be executed using various devices.

Figure 13 is executed by device to detect the flow chart of the example of the basic step of the biological nature of user.

Figure 14 is the top view of another embodiment of integrated sensor and display, wherein Sensor section and display portion Divide spaced but uses same cover glass with display part.

Figure 15 is the viewgraph of cross-section of the device of Figure 14, shows that Sensor section and IR transmitter and display part are lateral It is spaced apart in order to avoid influencing display part.In order to make it easy to understand, the more acurrate cross section of comparative diagram 14 shows biography side by side in Figure 15 Sensor and IR transmitter.

Figure 16 is integrated display/sensor viewgraph of cross-section, shows the sensor portion along the edge of display part The more details divided.

Figure 17 is integrated display/sensor viewgraph of cross-section, shows the bottom part for being electrically coupled to detector element Conductive trace.

Figure 18 illustrates to emit the device of the Figure 15 for the light for being reflected and being absorbed by physical feeling, wherein detection institute's reflected light is to produce It is raw reflect/light absorbing sensed image to authenticate user.

Figure 19 illustrates another embodiment, and wherein display area is partially transparent, and sensor passes through display area from body Body region receives light.

Figure 20 is the viewgraph of cross-section of the example of the embodiment of Figure 19, and wherein display part has distributed clear area Domain, institute's reflected light from physical feeling are transmitted by the transparent region by the detector array sense below display part It surveys.Light source can be provided for detector array for display pixel (for example, red, green and blue subpixels) or light source can be independent light Source, such as IR transmitter.

Figure 21 is the viewgraph of cross-section of another embodiment, wherein red, green and Blue OLED sub-pixel are formed in top On substrate, and one or more photodiodes are formed together in base substrate together with thin film transistor (TFT) to detect from body Institute's reflected light of position, while thin film transistor (TFT) controls display pixel.

Figure 22 is the viewgraph of cross-section of another embodiment, wherein IR transmitter (such as one or more IR LED) optically coupling The edge for closing the display glass of display serves as light guide, and wherein display glass emits light to connect from the glass The physical feeling of touching reflects.Can the only detection light in the region spaced with display area, or can be by being distributed in viewing area Photoelectric detector detection light in domain.

Figure 23 is the viewgraph of cross-section of another embodiment, and wherein liquid crystal pixel is formed together together with photodiode transparent On substrate (for example, glass), wherein the light from backlight is transmitted by liquid crystal layer and is reflected from physical feeling by photoelectricity two Pole pipe detection.

Identical or equivalent element is marked with same numbers in each figure.

Specific embodiment

Various types of biosensor arrangements are described, the light of specific wavelength is emitted and are connect using image capture to detect The light absorption of the human body of touching (or close) luminescence window.Other purposes are described.

Fig. 1 is the top view of biosensor arrangement 10, has the size for being suitable for capturing physical feeling reflected image.? In one embodiment, device 10 is only large enough to the finger that its surface is touched in detection.

Device 10 includes the pixel array 11 formed by micro- LED 12 or other light sources, such as Vertical Cavity Surface emits laser (VCSEL).Such laser is considered to be the subgroup of light emitting diode.LED 12 can be the different peak wavelength of interest of transmitting Variety classes or LED 12 can be to emit the identical type of different wavelengths of interest with different phosphors (for example, UV LED).In shown example, the LED 12 in single pixel 11 includes that red R, blue B, green G and IR emit LED.It is different Wavelength penetrates skin with not same amount；Shorter wavelength (blue, green) compares long wavelength's (red, infrared ray) and more shallowly is penetrated into skin In skin.In another embodiment, device 10 is only used for specific function, such as the blood flow in detection finger, and LED 12 only for Specific function emits single narrow wavelength band, such as red or IR.Each pixel 11 also includes broad band photodiode 14 or other The photoelectric detector of type.Can independent drive transmitting different wave length LED 12, therefore the output of photodiode 14 can with by The wavelength for motivating LED 12 to emit is related.The resolution ratio of device 10 can be identical as high resolution display.

Optionally, the LED of any peak wavelength in pixel array can also sequentially irradiated, while reads and comes from pixel One or more detectors in array, with eliminate crosstalk so as to realize the image obtained by digital processing resolution ratio into one Step enhancing.For example, this irradiates the position for realizing the Absorption Characteristics (for example, blood vessel) in physical feeling in proper order and only scatters still The enhancing of not light absorbing position is distinguished.In addition, the detector that (several) are read can be only the inspection of those of neighbouring irradiation LED Device is surveyed, so that high localized sampled physical feeling region.

LED can be OLED or inorganic LED.

Alternatively, various colors pixel can be formed by liquid crystal display (LCD).Typical LCD, which is used, has wide wave-length coverage White light backlight.Color filter (such as red, green, blue and IR color filter) forms sub-pixel and is located at controllable Liquid crystal layer rear.Liquid crystal layer effectively has the optical gate for each sub-pixel position.Each picture is controlled by control optical gate Different colours in element.Then, photodiode 14 may be formed at the clear laminate layer below LCD layer over top or LCD layer In.

In any embodiment, photodiode 14 and light emitting pixel are located at the same side of the human body to be analyzed, make The image that photodiode 14 detects institute's reflected light is obtained, to absorb light by the skin for detecting people.This is transferred through people with detection The known devices of the light quantity of body region are contrasted.The image of institute's reflected light corresponds to the light absorbing image of institute, because being detected Physical feeling in local absorption substantially pass through detection by between the received institute's reflected light of different photodiodes 14 Difference determines.Such difference, which can be used to draw, to be absorbed pattern and compares it and store absorption pattern.Therefore, institute reflected light Absolute amplitude can based on the physical feeling being sampled, any environment light, change to the electric current of LED etc., but light reflected amplitudes Difference will correspond to physical feeling in absorption pattern.

The example of the pixel array 11 of combination fingerprint detector and vessel position detector can be 2cm x 2cm and include The array of 800 pixels 11.Resolution ratio can be down to 0.25mm.This array sizes may be incorporated into smart phone or other handheld type devices In to use two different test certification users.

LED controller 18 addresses to control the excitation of LED 12 using such as rows and columns, and by photoelectric detector controller 20 control photodiodes 14.Processor 22 provides the overall control of controller 18 and 20 and detects various photodiodes 14 To be further processed, this depends on desired function for output.In one embodiment, 22 control device of processor is to detect Ingredient in the position of fingerprint and finger medium vessels, pulse and blood.Multiple images (such as video) be can get to analyze blood Stream.Processor 22 may compare the stored information in data and memory to authenticate user or data can be used for medical analysis.

In one embodiment, LED controller 18 carries out rasterisation to the irradiation of LED or carries out space row in other ways Sequence, while the capture of photoelectric detector controller 20 corresponds to the image sequence of a variety of different irradiating states.Processor 22 can be handled Thus data sequence is increased with compensating the captured images of scattered light by absorbing the spy in the physical feeling contacted with device Levy the resolution ratio of the combined image formed.

Whole device 10 includes processor 22 and controller 18/20, is formed as only needing the list of power supply line and data line One modular unit.

Can independent drive pixel array different sections or one of pixel 11 to reduce the light from different pixels 11 Crosstalk between electric diode 14 and LED 12.It is desirable that physical feeling is directly contacted with device 10 to minimize and hit and anti- The scattering of light is penetrated to obtain highest resolution image.It focuses and directing optical part can also be used to further increase resolution ratio.

Fig. 2 is the simplification viewgraph of cross-section of the device 10 of Fig. 1, shows the finger 23 of people and the protection glass cover of described device 24 directly contact.Also show that the blood vessel 25 in finger 23.Be attributed to finger 23 have much higher than air refractive index (for example, 1.5), but the refractive index of glass cover 24, fingerprint ridge 26 (directly contact glass) and fingerprint valley 27 (separating with glass) are analogous to It will cause different amounts of light reflection 28 in those regions.Reflection is carried out in the TIR being attributed at glass/air interface, paddy region From the light of the relatively high percentage of glass surface, and ridge region will absorb the light of relatively high percentage.It is attributed to photodiode 14 high-resolution, some photodiodes 14 will be located at 27 lower section of paddy and other photodiodes 14 will be located at 26 lower section of ridge, Therefore the image of fingerprint can be detected by processor 22 (Fig. 1) and can by for authenticate user to be stored fingerprint related.

Glass cover 24 may include unorganic glass, crystalline material (such as sapphire), glass ceramics or polymer.

The known mode for being used to prevent fingerprint detector.As the additional assurance for preventing fraud, processor 22 also handles light 14 data of electric diode are with the determining pattern absorbed with the consistent low wavelength (for example, red, IR) of blood vessel in finger.Light via Fingerprint ridge enters finger up to certain distance.Blood vessel is unique and very difficult in individual relative to the shape of fingerprint and position To forge.This data is related to institute's storing data for certification.For example, user execute initial baseline detection, wherein detection and Storage combination fingerprint pattern and vascular patterns.For certification, if new detection substantially matches baseline pattern, certification is used Family.It can get other blood datas also to carry out medical analysis.Fig. 2 shows the light reflectivity 28 at the skin depth of blood vessel 25, Wherein compared with the finger areas for not including the blood vessel in target depth, feux rouges/IR light absorption at vessel position is higher.It connects Can draw the figure (in conjunction with fingerprint pattern or separating) of detected blood vessel by processor 22, and store figure with reference vessel It is compared.

14 signal of photodiode can be subtracted from one another by processor 22 so that difference is related to the absorption of wavelengths of interest. The difference of the signal exported by high-resolution photodiode 14 rather than be only its absolute value allow by photodiode 14 from The common mode inhibition of the directly received light of LED, therefore greatly increase signal-to-noise ratio.

In general, photodiode array 14 across elongated area allows device 10 to serve as contacting or close to glass The image capture apparatus of the appropriate contrast article of lid 24.Therefore, at physical feeling (such as finger, palm, wrist or face) Contact or close in the case where glass cover 24, device 10 can be used to capture beneficial biological identification and biometric data (such as Fingerprint), shallow subcutaneous biometric authentication data (such as vascular patterns), face and other Skin Color Informations and skin be resident pathogen In the presence of.

In addition, pixel array simply can be used to detect contact or one or more fingers or other bodies close to glass cover 24 The presence and movement of body region, thus allow the array to be used to sense various postures or be used as touch screen or simple " button " and Without further dedicated touch sensing array, mechanical button or discrete posture subsystem.

In addition, being ranked up by the LED 12 to different colours, spectroscopic methodology can be executed to physical feeling, to generate light Learn the biometric data of acquisition.In the case where wavelength penetrates skin and reaches to a certain degree, it can get subcutaneous biometric data. For example, both red and greens can be used to detect blood flow, blood vessel and confirmation heart rate, and the appropriate red of wavelength and the group of infrared ray Conjunction can be used to confirm blood oxygenation.

Different wave length penetrates skin with not same amount；Shorter wavelength (blue, green) compares long wavelength's (red, infrared ray) more Shallowly it is penetrated into skin.Therefore, by being scanned in pixel wavelength, it can get and the corium of different depth is sampled The image of sampling.Then the data from different images can be made to be subtracted from one another to generate additional resolution.For example, can be shallow from capture The red image of both table data and subcutaneous data subtracts the blue image of capture Data Data only to show subcutaneous data.

Extension wavelength response range can acquire even more information.Have under higher or lower frequency by mixing or adding There are the additional pixels of responsiveness, can confirm additional functionality, such as pathogen detection, UV expose, aquation and body chemistry are anti- It answers.In some cases, UV can be used to detect the fluorescent component in blood or skin.

In addition, by capture image sequence (that is, video), can get blood pulse along blood vessel migration, thus provide into One step biometric data, such as heart rate, the blood pulse wave velocily that can therefrom infer blood pressure, cardiac output, stroke output- Directly or by reasoning.Image sequence may further be used to observation blood flow and infer that examined physical feeling includes living body position really It and does not include attempting for example to forge biological identification event by using deception sample of material or the physical feeling of separation or death. Similarly, it is applied in combination together with photoelectric detector and generates the LED of various colors and can provide for example applied to possessing fingerprint pair The identification of the material of this finger, but show that physiology is verified simultaneously.This " video " ability can then help to prevent conformal The fingerprint spoof of material.

In the case where capturing and handling expanded images sequence, it may be necessary to be mentioned during video capture for the movement of object For compensation.In this case, it can be used to using the movement of such as blue, green or the superficial image of other appropriate light source captures The movement of tracking object and it can be used to compensate and for example captured subcutaneously using what feux rouges or infrared light captured during video capture The movement of image.

In view of the light being penetrated into finger by the influence of change of backscattering and reflection based on structure in finger, preferably will Fingerprint is detected from the light (such as blue light) at least penetrated into finger.But using the visible and near-infrared wavelength of wide scope Read fingerprint.

Using more long wavelength, subcutaneous images can be taken.For example, using allowing 2mm to 3mm or more to be penetrated into corium Illumination wavelength and power will allow light to be penetrated into can be in the subcutaneous area for wherein finding capillary and vein.It will be in view of blood vessel Fingerprint ridge and Gu Chonghe, the image collected from blood vessel will likely also be influenced by the presence of fingerprint ridge and paddy.Therefore, fingerprint ridge and paddy Presence can enhance the specificity of the layer for identification or can be removed from the image of blood vessel.The one of fingerprint is removed in wherein expectation In a example, the technology for simply subtracting the fingerprint image by shorter-wavelength light capture as discussed previously can be disposed.Substitution Ground, this can be completed via image procossing, such as by filtering or with the similar other technologies influenced.It can also be examined by setting Survey device array make the focus of that detector substantially individually or it is most of be subcutaneous, such as by systems including optics Part (showing in rear figure) minimizes the influence of fingerprint.

Moreover, orientation of the finger on device can be at random, because of fingerprint by detection both fingerprint and blood-vessel image Image can provide reference for blood-vessel image.Therefore, the position regardless of finger on device, still can accurately compare relative to Mutual image and stored relative image.

As the artefact of this biological authentication method, while it can extract important physiologic information.By studying in difference The image of the lower blood vessel captured of irradiation, can execute the spectrum analysis of tissue directly below sensing region, can be from the sensing area The chemical reaction of domain execution blood, interstitial fluid or tissue.For example, by two different wave lengths (such as 680nm and 850nm) Lower research image (hemoglobin and oxyhemoglobin have different extinction coefficients variation (Fig. 3) in the wavelength), can survey Measure blood oxygen saturation SpO2.For spreading, by studying the captured image under suitable radiation wavelength, blood glucose, red can detect Cell count, white blood cell count(WBC), blood CO2, blood glucose and other blood and interstitial fluid solute.

In all above-mentioned configurations, it may be necessary to consider the influence of environment light.Specifically, in Study of Thin body region (example Such as finger) in the case where, environment light can travel to detector array by finger, to interfere received signal or image.Cause This, it may be necessary to consider the influence of environment light.Environment light may include the light source (such as daylight) or modulated light source of substantially stable state (such as incandescent lighting or modulation LED illumination).Can by when array light source is in "Off" state first to detector array It is sampled to quantify the part of the detected optical signalling from environment light.Then, when array light source is in "On" state, The signal that can then capture from detector array subtracts this signal to infer only signal related with the irradiation of array light source. In addition, environment light can be offset by subtracting common-mode signal since all photodiodes 14 can detect same amount of environment light.

By the option of multiple photoelectric detectors in photoelectric detector configuration and each pixel, this phase can be further enhanced Close double sampling methods.By in the frequency modulated array light source and array detector sampling for being much higher than any environment light modulation Time can promote this " environment Xanthophyll cycle ".The frequency of any environment light modulation can be further detected by detector array itself.

Although the example that above description utilizes micro- light-emitting diode display, can be suitable by the way that extension detector array to be integrated into When functionally equivalent to realize in any other display (such as OLED display or active matrix LCD display) of resolution ratio Mode.Specifically, if display includes integrated semiconductor components (such as amorphous silicon, polysilicon or organic semiconductor), It so substantially similar semiconductor processes can be used to form photodiode array in the display, therefore have outside jot Processing cost and higher resolution.

Chip is (direct on such as optical module, chip on glass (chip for being directly attached to cover glass) or display Be attached to the chip of display glass) in individual extension detector array can also be used realize functionally equivalent mode.This Chip can be directly integrated together with display on module, chip on glass or display, or may include independent array；And it can wrap Its own irradiation source is included, or can be arranged to just utilize external light source (such as from display) or any other appropriate existing picture Elementization, uniform, side, point or other irradiation sources.

Extension detector array may include integrated sensors array (such as cmos image sensor), and can have such as Fig. 4 It is middle describe as integrate optical element (being described later on).Module cover glass itself is optionally completely or partially coated with optics Enhancing, optical filtering or optical barrier layer, anti-reflection coating etc..

This module is operable as multiple man-machine interfaces and physiology enhancing to the integrated point of terminal applies.Feature (such as but not The optics running ON/OFF or other " button " being limited in consumption device), the gesture recognitions of Premium Features (such as mediate, scaling, Rolling, control stick, trace ball, signature) existing operation can be added to via algorithm or software.

Also enhance integrated or standalone sensor module using pressure sensor or pressure-sensing array to provide additional machine Tool button actions.Can also integrated layer voltage capacitance formula sensor array layer, therefrom can determine " touching " event generation and touching thing The associated power of part.The determination of the power of touch event also acts as the feedback to consumer: the amplitude of touch event is not directed to most Excellent biological identification or biometric data optimize.For example, possible limit blood is excessively pressed in module flows to capillary, Thus the signal received from it is influenced.

Integrally or separately sensor module can also be via optically clear adhesive (such as epoxy resin, silicone, acrylic acid tree Rouge or watery fusion glass (such as welding glass or composite semiconductor glass)) further it is directly connectcted to display or lid glass Glass.In this case, engagement may include the adhesive of the entire interface extension of cross-module cover glass and display glass.Substitution Ground, adhesive can be applied only in a part for fitting over the interface (for example, in edge), and most of module cover glass and display Device glass can simply contact or close to.

Fig. 4 illustrates another embodiment, and wherein light source 30 (such as the LED for emitting identical or different wavelength) is only located at light guide 32 Outer edge around, light guide 32 also serves as protection cap.Light is for example by the way that LED to be embedded in light guide 32 or in other ways by optocoupler It closes into edge and is coupled in the marginal portion of light guide 32.Light is carried to all areas of light guide by TIR and only passes through light The top surface for leading 32 leaves.

If physical feeling will directly be contacted with light guide 32, due to skin has the refraction similar to the light guide Rate will extract naturally light from the light guide at the contact point of physical feeling.If the physical feeling to be detected can be with light guide 32 are spaced apart, then light guide 32 can have the light extraction features for booting up light and mixed light, such as molding micro-reflector (rib Mirror).It is well known that such distributed micro-reflector in light guide, which is used for back lighting,.Therefore, the light for carrying out autoexcitation LED can base Contact is equably emitted in sheet upwards or close in the physical feeling of light guide surface.Light guide 32 emits seldom downward light or does not send out Light under directive.Most of light guide 32 is transparent to transmit from the light of physical feeling retroeflection by light guide 32.With by IR LED And photoelectric detector is integrated into display screen together with display pixel LED and compares, it is relatively cheap using this design of light guide.This Outside, the resolution ratio of photodetector array is unrelated with any display pixel array and therefore may achieve higher resolution.

Optical element 34 may include focusing lenslet, and the focusing lenslet is by institute's reflected light from only certain physical feeling distance It focuses on photodiode array 38.Incident light from physical feeling can also be limited to only vertical with light guide by optical element 34 Narrow angle is to reduce crosstalk and preferably draw the feature of analyzed physical feeling.Photodiode array 38 can scheme for CMOS As sensor, ccd image sensor or any other imaging sensor.

Photoresist retaining wall 40 can be used to that direct light is stopped to impinge upon on photodiode array 38.Module may include nontransparent leads Hot shell 42 is with from LED draw heat.The control electronic device of Fig. 1 could attach to module or separate with module.Module can have For being welded to the engagement pad of printed circuit board.

Fig. 5 shows the mould of Fig. 4 of adjacent protection transparency cover 44 (such as transparent surface layer of smart phone or other devices) Block.

As will be described in later, the IR transmitter in Fig. 2 can be deleted out of display pixel array and edge be coupled to it is aobvious Show in device glass.Then IR light is uniformly dispersed in display glass by TIR, until IR light encounters directly contact display The skin histology (for example, finger) of device glass.At contact point, light will be by skin histology reflection/absorption and by display pixel battle array Distributed photodiode 14 in column detects.Therefore, physical feeling can be in any portion of any orientation touch display glass Divide to be detected.

As illustrated in figure 6, integrally or separately sensor module can further comprise one or more electrodes 48 and 50, electrode 48 and 50 extend through or around light guide 32 or are located at module-external but are electrically connected to module to allow pyroelectric monitor user.Example Such as, such electrode 49 and 50 can be used to detect the electrocardiogram (ECG or EKG) or bio-impedance of user.Can be used alone ECG signal To determine the heart rate such as determined by the form of ECG signal or relevant will occur or actual medical situation.Alternatively, ECG can It is used in series with the photoplethysmogra (PPG) of optical diffraction to determine blood pressure and other medically important indexs.It is raw Object impedance may be used to determine aquation, fat content or other vital signs.It can also pyroelectric monitor muscle movement.All such prisons Surveying device can be combined in single module.

ECG signal also acts as biological identification signature.

It therefore, can be via single mode (such as fingerprint, blood vessel imaging or ECG)；Or the combination for passing through multiple modalities；It is a kind of The multifactor authentication of form executes biological identification.In view of all biological identification events in the form of false positive and false negative There is mistake, the accuracy of biological identification can be improved using multifactor biological identification.For example, multifactor biological identification scheme can be through Thus configuration reduces user and is attributed to vacation to confirm that authentication event includes actively authenticating two factors and inhibiting certification third factor Although at least two factors are authenticated by requiring to reduce safety as cost-by the probability-of system lock negative Increase the safety for preventing false positive and deception.Alternatively, there is different authentication time, dual factor anthentication scheme in view of different modalities It can be configured based on single rapid authentication factor and the extension time needed for acquiring and handling additional slower authentication factor One or more subsequent levels for increasing safety certification in section provide first, quick, lower security certification.

As shown in fig. 7, module can further be augmented with integrated gas sensing element 54.Gas-sensing element 54 can generation It is alternately discrete apparatus adjacent.Use high specific, the gas sensor (such as appropriate electrochemical sensing element) of high directivity It can be used to detect current or imminent medical conditions, just as dog can smell the disease of people.This data can independent or knot It closes and states optics and the use of electric data to provide the more complete background of wherein interpretable data entity, thus causes more (statistically) accurately Medical diagnosis or general health (health/wellness) diagnosis.

The purposes of complementary gas-sensing element 54 can also be used for biological identification application.Fingerprint spoof sample may include that fingerprint is multiple Make in organic material or on, such as timber, glue, putty, acetate fiber plate etc..It is organic that such material mainly distributes volatility Compound-is especially within the short time after formation or solidification.In addition, volatility, which is discharged, by skin and sweat per capita has Machine compound (VOC).Therefore, contact point or (wherein basic with biological identification event close to fingerprint or other biological identification events Gaseous environment at upper butt contact simultaneously is sampled) have an opportunity the presence of " smelling " deception material or direct cutaneous.In addition, It can be different enough by the specific ratio of the VOC of any personal (personal " smell ") discharge: if there is foot in gas-sensing element Enough resolution ratio, then it can be used as further bio-identification factor or mode.It is sensed in Fig. 7 by photodiode array 38 Fingerprint and/or vessel position detect the presence of practical finger 23 to the absorption combination gas-sensing element 54 of light to describe this sense Survey scheme.

Integrally or separately sensor module may be disposed so that finger can carry out physical scan or the compact line scanned scanning across it Device (single or narrow pixel line).This can provide can scan finger or other bodies in the case where reducing sensor area occupied The advantages of extension position at position.In the case where standalone sensor module, reduce area occupied can promote be designed into space by In limit platform (such as mobile phone, wrist-watch and other wearable devices) and it can promote reduction module cost.The sliding action of finger can Small form factor sensor is allowed to survey the bodily tissue of spreading range.Offer can be provided in the bodily tissue of spreading range Following advantages: particular organisms certification and biometric label can be in the specific organization regions for wherein marking most strong or highest to limit Sampling.For example, the tissue scanned on last phalanges will provide most useful information if attempting to obtain conventional fingerprint, because that It is the region rich in superficial skin characteristic (ridge and paddy).On the other hand, (such as finger vena identifies number to the unique subcutaneous information of capture According to) most successful in the biggish middle phalanxes of vein wherein can be proved to, therefore be not only more readily detected but also less by by life The influence that pressure is applied to finger is contacted during object authentication event with sensor module.Therefore, optical bio certification line scanning Device can be configured optimally to capture finger print data from last phalanges when scanning finger on it and from middle phalanxes Finger vena identifies data.Module can further sense finger by for example working as sensor above module and during fingers scan Changed when by below one of interphalangeal joint by irradiation source or focal length to change the operation of module.

Line array sensor can be further formed on flat cover glass or bending cover glass or rear, the curve approximation of glass Match the curve of finger or wrist.Then this sensor can be incorporated into wearable device (such as bracelet or wrist-watch), if Networking, then can be used as providing the wearable device of the biological identification of user.Disposable biological authentication event can be performed in this device. Then, described device continuously or periodically carries out polarity adjustment to sensor array to confirm that wearable device is not yet gone It removes and user still lives.Then, wearable device susceptible of proof user keeps biological identification, recognizes without executing any subsequent bio Card event.Then, this device can such as with Wireless Networking phone, credit card-based payment system, ATM, automobile, door, database with Promote express user certification.This mode is particularly useful in the case where biological identification event includes tediously long event, for example, if its Analysis including that may need to capture the ECG signal of several heartbeats.

As demonstrated in Figure 8, the signal from integrally or separately sensor module can further be augmented with from integrated or The data of discrete neighbouring contact or non-contact temperature sensor 58.Low wavelength (red or IR) filter 60 can cover sensing Device 58.Temperature data can be used as independent biochemical measurement or can be used to provide the further back for explaining other biometrics in it Scape.

Fig. 9 shows that wherein control circuit and photodiode are integrated in sensor chip 62 and focus optical element 64 directly It is formed in the embodiment on photodiode array more accurately to focus.Focusing can be in the physical feeling of contact light guide 32 Certain distance in.Also show that edge couples LED light source 30.Gained module is very thin and is easily incorporated into various applications.

Figure 10 is the top view of one embodiment of sensor chip 62 and the optical element of Fig. 9.Each full optical lens 68 with The array group of photodiode 14 is overlapped, and lenticule 66 can cover each photodiode 14.Between photodiode 14 Pitch be smaller than 0.25mm to form compact array.In this scheme, the photodiode (inspection of each complete 68 lower section of optical lens Survey device pixel) array 14 leads to a macro pixel with 0.25mm resolution ratio.It is each micro- above each photodiode 14 Lens 66 improve light capture and the property of could provide direction.Each full optical lens 68 and about 16 photodiode 14 in the example Overlapping.Full optical lens 68 can focus at different depth and tool directionality is to acquire about institute's reflected light from physical feeling More information.Various lens can be laminated described by molded clear piece and above photodiode array to be formed, or can It is formed by being laminated described above photodiode array.Although for simplicity showing hemispherical lens 68, It is the lens can be any shape suitable for focusing.Chip can be fixed to any optical glass rear.In another embodiment, Optical element is spaced apart by spacer with photodiode array.Reference photodiode 69 can be located at full optical lens 68 outside with Detect environment light.System logic 70 and photodiode array for handling detected signal are formed on the same chip with reality Existing compactedness and raising signal-to-noise ratio.The logic may include analog-digital converter and digital processing circuit.

Figure 11 illustrates the module for being augmented with Figure 10 of LED light source 72.Light source 72 can by optoinjection to above cover in light guide with will Light is dispersed in above photodiode array, as described previously.From physical feeling reflect light by light guide back transfer to Photodiode array.In another embodiment, be not necessarily to light guide because module may very little (for example, be less than 2cm x 2cm) and Light from LED light source 72 is scattered and is reflected on photodiode array in physical feeling.

Since LED performance reduces at any time, photodiode 14 may further be used to compare LED light output and baseline and incite somebody to action Feedback is supplied to LED exciting circuit to realize baseline performance.

Although above-described embodiment includes the spectrum analysis executed by broadband detector array combination narrow band emitter, function Can also by combine broadband emitters (such as phosphor converted White LED) using wavelength specific detectors (such as on it Or with the detector of optical filter in its optical path) implement.

Figure 12 identifies the various possible purposes of module described herein.

Figure 13 is the flow chart of the basic step according to an embodiment of the invention for identifying and being executed by various modules.

In step 80, relative to photodetector array arrangement light-emitting diode display panel, light guiding panel or other light sources with Form biosensor.

In step 82, the output window of biosensor is touched to be analyzed by physical feeling.Touch sensor or Shadow sensor may be incorporated into device with detect physical feeling when above output window to start image-detection process.

In step 84, motivate LED desired wavelength is applied to physical feeling to detect the local light of physical feeling It absorbs for fingerprint detection, blood vessel detection, pulse etc..LED can be motivated simultaneously or sequentially.If sequentially motivating LED, Optionally read photoelectric detector so as to preferably by light absorption it is related with the position in the neighbouring physical feeling for motivating LED Connection.Irradiation can be in any pattern in proper order.

In step 86, such as by column and row the signal from photodetector array is scanned, to detect the institute across array The relative magnitude of detection light is to effectively obtain the detail image of the light absorption of physical feeling.

In the case where sequentially motivating LED, the method can be then circulated back to after each excitation step 84 with Exceptional space is provided and absorbs data.

In step 88, initial data is handled to obtain as a result, such as user authentication, medical analysis by the processor of module Deng.

Various other embodiments are disclosed below, are located at display area outside comprising wherein photoelectric detector and light source in order to avoid shadow Ring the embodiment of display part itself.Therefore, display part generally can be conventional.Photoelectric detector is shown by covering The same glass covering of screen.Light for the transmitting of biological sensor function may be from the marginal portion of display or come from and display Partially separated light source.

Also describing wherein display part includes that the light reflected by physical feeling is transmitted by it and by the Photoelectric Detection that underlies The embodiment of the distributed transparent part of device array detection.

Figure 14 to 18 illustrates integrated display and optical sensor, wherein the sensor and display part lateral separation It opens but uses same display glass or cover glass.Display area 90 includes through addressing to show the red, green of any image Color and blue pixel array.Described device can be smart phone display.Display area 90 is by may include touch panel sensor Thin display glass 92 (or other types of light transmits panel) covering of layer.

For beautiful purpose, the effective coverage of display area 90 is surround by black ink 94.Ink is usually black But it can be any color.

Display area 90 is close to the sensor region 96 using same glass 92.In the feelings opaque to IR of black ink 94 Under condition, sensor region 96 is not covered by the IR ink 98 that ink covered or be not passed IR.IR ink 98 can seem black.

One or more fluorescence detector elements 100 (such as photodiode tube core) are mounted on 98 lower section of IR ink, so that Its detectable light for being transferred through IR ink, as shown in Figure 16.Motivate IR transmitter 102 (such as IR LED) to apply light It is added to the physical feeling of the glass 92 of 96 top of contact sensor region.Other wavelength LED (such as red) can also be in sensor In region 96, this depends on the biological nature to be detected.Assuming that physical feeling is finger, then IR light or red light portion from hand Refer to surface reflection and also into finger, the especially place of fingerprint top contact glass 92.Some light are absorbed by blood and blood vessel, Or by certain ingredient draws in blood, and detect and absorb pattern, as described previously.

In another embodiment, the light emitted by sensor region 96 can be white light, and detector element 100 is in sensor Image of the white light from any object (comprising physical feeling or printed code) reflection is detected in front of region 96.

It is spaced by will test device element 100 and IR transmitter 102 and display area 90, display area 90 not by Sensor region 96 influences.Therefore, display area 90 can have very high-resolution pixel array.

Optical element can be incorporated into the optical path of detector.For example, optical element may be molded above detector tube core or It is installed to detector tube core.Alternatively, optical element may be molded on display glass 92 or IR ink 98, or pacify in other ways It is attached to display glass 92 or IR ink 98.Optical element also optionally etches into display glass 92.Optical filter (example Such as organic dyestuff, medium filter or metal medium filter) photoelectric detector tube core, display glass can also be directly placed at 92 or optical path in any other appropriate element on.Detector may include pixel array or focal plane arrays (FPA).

Detector element 100 is described in more detail in Figure 16.Institute's reflected light 104 is transferred through IR ink 98 and by detector member Part 100 detects, detector element 100 can for single detector element or array of detector elements with generate physical feeling (such as Finger) reflection/light absorbing high-definition picture.

In another embodiment, the LED in display area 90 supplies the light reflected from physical feeling, because in physical feeling The some light scattering for reaching detector element 100 inside will be present.

The advantages of device of Figure 14 to 18 is construction or the operation that sensor region 96 does not influence display area 90, viewing area Domain 90 can be smart phone display.

Sensor region 96 can be used to detect fingerprint and/or the vascular patterns of user to authenticate.

If shown in Figure 16, electrical interconnection can be via the conductive trace deposited on IR ink 98 to detector element 100 106 and 108 and appropriate interconnection piece 110 and 112 (for example, electroconductive binder, solder etc.).Alternatively, conductive trace 106/108 It can be directly deposited on glass 92, and pattern IR ink 98 to be deposited on 92 top of glass.Conductive trace 106/108 can wrap Include such as or mixtures thereof conductive oxide, conducting organic material, semiconductor, metal.Interconnection piece 110/112 may include for example welding Material, metal, conductive paste, conductive film or anisotropic conductive element.Detector element 100 may include independent photoreceptor or its two dimension Or linear array, or may include by one or more photoreceptor elements (such as photodiode) and Analogical Electronics and optional mould The element that number converter, digital control logic, digital-to-analog circuit and processing circuit integrate.Detector element 100 may include Cmos image sensor or similar device.

Rear cover 113 is also showed that in Figure 16.

As shown in Figure 17, it can also for example pass through flexible PCB (flexible circuit), PCB, strip connector, conductor combination Part or any other appropriate element for being connected to 100 back side of detector element are electrically connected to detector element independently of glass 92 100.Metal trace 114 is shown in the example.Also inspection can be electrically connected to via spring connector or other similar interconnection schemes Survey 100 back side of device element.In such scheme, detector element 100 may include for example for backside illuminated (BSI) cmos image The technology of sensor.

One or more light emitting devices (such as LED or VCSEL) also may be mounted to glass 92.Light emitting device and detector element 100 can be installed to glass 92 in a similar manner.Optical element can be incorporated into the optical path of light emitting device.For example, optical element can It is molded in above transmitter or is installed to transmitter.Alternatively, optical element may be molded on display glass 92 or IR ink 98, Or it is otherwise mounted to display glass 92 or IR ink 98.Optical element also optionally etches into display glass 92 In.Optical filter (such as organic dyestuff, medium filter or metal medium filter) can also be directly placed at Photoelectric Detection On any other appropriate element in device tube core, display glass or optical path.In this case, light is sent out from light emitting device Be shot through IR ink 98 and be incident on the top of display glass 92 or the part reflecting body contacted with display glass 92 (such as Face, hand or the finger of user) on.As shown in Figure 18, light emitted 117 from IR transmitter 102 are from physical feeling It 116 retroeflection (light 118) and is detected by detector element 100.Alternatively, display itself can be used as transmitter, and detector Element 100 can simply detect institute's reflected light from display.

Although example given above includes the detector element 100 positioned at 98 rear of IR ink, detector member Part 100 can be located on glass 92 in the case where lacking any ink.

In the examples detailed above for wherein needing the light emitted part as sensing scheme, in the time that photophore is opened and is closed Point, which carries out dual coherent sampling, can help distinguish between reflected signal and bias light.

Figure 19 and 20 declaratives transparent displays 119, such as partially transparent OLED display, wherein one or more optics Detector element 100 is installed to 119 back side of display, such as is mounted on backside glass plate 120.Display 119 may include figure Intentional transparent region (" the transparent pixels ") array 121 shown in 20, the purpose of the array are to provide through display 119 Optical path, thus make display 119 partially transparent.In this example, it is installed to the inspection at partially transparent 119 rear of display Survey device element 100 (it can be photodiode or other photodetector arrays) optionally with partially transparent display 119 Pixel array alignment so that clear area of the light-sensitive element in partially transparent display 119 in detector array 121 lower section of domain.The light reflected from physical feeling 16 may be from display pixel 124 or from dedicated transmitter 102.In Figure 19, Light 125 is shown as being emitted by dedicated transmitter 102, and in Figure 20, and light 126 is shown as being sent out by red pixel 124 It penetrates.Institute's reflected light 127 is shown as being detected by detector element 100.

Optical element can be incorporated into the optical path of detector element 100.For example, optical element may be molded in detector tube core Go up or be installed to detector tube core.Alternatively, optical element may be molded on backside glass plate 120 or be otherwise mounted to back Side glass plate 120, or etch or patterned in backside glass plate 120 in other ways.Optical filter (such as have engine dyeing Material, medium filter or metal medium filter) photoelectric detector tube core, display glass or optics road can also be directly placed at On any other appropriate element in diameter.Detector element 100 may include pixel array or focal plane arrays (FPA).

Any display element can be used as light source, and institute's reflected light from physical feeling can be detected by detector element 100. Show red, green and blue led 124 (being labeled as RGB) in each display pixel area of neighbouring transparent region 121.It can Expand display pixel array itself (generally including red, green and blue array pixel) optionally to emit picture comprising infrared ray The transmitting pixel of element, ultraviolet light transmitting pixel or any other appropriate wavelength.In this scheme, it may be used at infrared ray, ultraviolet The OLED material emitted in line or other appropriate wave-length coverages.In the case where micro- light-emitting diode display, respectively by for example Al_xIn_yGa_zP and Al_xGa_yInfrared ray made of N and ultraviolet light LED can be used as the portion of red, green and blue LED pixels array Point；And other appropriate wavelength can be generated by these identical materials or other composite semiconductor alloys.

Alternatively, one or more independent optical launchers 102 are mountable at partially transparent 119 rear of display.From this The light of a little transmitters 102 can pass through partially transparent display 119, reflect from external physical feeling 116 and by detector element 100 Detection.Optical element can be incorporated into the optical path of transmitter 102.For example, optical element may be molded on transmitter tube core or pacify It is attached to transmitter tube core.Alternatively, optical element may be molded on backside glass panel 120 or be otherwise mounted to back side glass Glass panel 120, or etch or patterned in backside glass panel 120 in other ways.Optical filter (such as have engine dyeing Material, medium filter or metal medium filter) photoelectric detector tube core, display glass or optics road can also be directly placed at On any other appropriate element in diameter.

Similar to the design of Figure 14, independent transmitter alternatively is installed along the side of display.These independent transmitters It may include the transmitter of RF transmitter, actinolyte or any appropriate wavelength, and may include such as LED or phosphor Conversion LED.Alternatively, (such as camera flash-light, indicator LED, to be incorporated into other light logical for the independent transmitter in final products Light source or any other light source in letter link) it can be used as irradiation source, it is detectable whereby to reflect letter from neighbouring body Number.In addition, as described previously, light source can edge be coupled in display glass and display glass inside by TIR dissipate Lighting escapes at the contact point of physical feeling and display glass until light.

Figure 21 illustrates the single pixel in display 130, such as displayer, further comprises semiconductor backplate 132, semiconductor backplate 132 includes the film crystal being formed in low temperature polycrystalline silicon (LPTS), amorphous silicon (a-Si) or silicon metal Manage (TFT) array 134.In this embodiment, before depositing superficial organic electro luminescent layer, the shape in semiconductor backplate 132 At one or more light sensitive detector elements 100.Detector element 100 may include such as photodiode, such as p-i-n photoelectricity two Pole pipe.It can be grown above tft array 134 or deposit OLED material to form red, green and blue subpixels 135.It is infrared Line sub-pixel can also be thusly-formed as the part of the array.Optical element 136 may be optionally formed or be otherwise disposed on In detector element 100.Such optical element may include for example formed for example, by Photoresist reflow process or printing process it is saturating Mirror.One or more detector elements 100 can be used as being directly integrated into fluorescence detector or detector array in display.Also open up Show light 138.

Optical filter (such as organic dyestuff, medium filter or metal medium filter) may be optionally incorporated detector The pixel to specific wavelength with sensitivity is generated above element 100.For example, red, green, blue, cyan, magenta Color, yellow, IR and UV absorb dyestuff and are optionally placed on different detectors element in order to provide color detection is able to carry out Or more pixel detectors of spectroscopic methodology.OLED material itself is optionally placed in above photodiode；Red, green and indigo plant Color OLED material all has different absorption spectrums-therefore serves as different optical filters.

Figure 22 shows another embodiment of integrated display and detector, and display/detector of Figure 23 display diagram 22 In single pixel region.

Full-color display 140 includes backboard 142 (such as TFT-LCD), and backboard 142 includes being formed in low temperature polycrystalline silicon (LPTS), thin film transistor (TFT) (TFT) array in amorphous silicon (a-Si) or silicon metal.Transistor can be patterned and be doped it is heavy Amorphous silicon (Figure 23) of the product in transparent glass substrate 146, and patterned conductor can be transparent, such as ITO.Thin film transistor (TFT) 147 arrays are formed together in glass substrate 146 together with LCD layer 148, and wherein transistor 144 passes through conventional column and row decoder It connects to control each LCD pixel, one of described LCD pixel is shown in Figure 23.

Color filter 150 (such as blue, red and green filters) is formed in above or below LCD layer 148 with shape Au bleu, red and green sub-pixels.The part that infrared ray sub-pixel can also be thusly-formed as pixel.Black mask 152 prints With preferably optical fractionation sub-pixel on overhead displays glass 154.

The display part of backboard 142 can be conventional.

White backlight lamp 156 is located at 142 lower section of backboard, and LCD sub-pixel serves as controllable optical gate as each pixel emission A selected amount of blue light, feux rouges and green light are to generate wide colour gamut.

Photoetching process is commonly used to form backboard 142, and can get very high resolution ratio.

In order to make this display be augmented with detector, also deposits and pattern one or more on backboard 142 by photoetching process A light-sensitive element 158, such as amorphous silicon photodiodes.Photodiode can be the silicon transistor 147 being formed in tft array Variant and formed using additional masking steps.Tft array and photodiode may be formed at same in glass substrate 146 In plane.Photodiode is connected to detector circuit by the suitable conductor on substrate 146.Photodiode can be in display area Outside is distributed in entire display area.Light-sensitive element 158 may include such as photodiode, such as two pole of p-i-n photoelectricity Pipe.

As shown in Figure 22, IR transmitter 159 or other peak wavelength LED lights ground are coupled to display glass 154 Edge in, wherein display glass 154 be used as waveguide with spread IR light 164 and only photoelectric detector components 158 above far Emit IR light 164 from backboard 142.Only from display glass at the region of wherein physical feeling 116 contact display glass 154 154 extract light, as described previously.If physical feeling is without contacting display glass, the surface of display glass 154 It can be roughened on photoelectric detector components 158 to extract Waveguide.Display glass can be in the display part of pixel Clearly.

IR optical filter 162 also can print in the bottom surface of display glass 154 and can be with RGB color filter 150 It is coplanar.

Figure 23 is shown as detector and provides the backlight 156 of light 168；However, the light of detector can be coupled to display glass In the edge of glass 154, as shown in Figure 22.

Optical element be may be optionally formed or be otherwise disposed on light-sensitive element 158.Such optical element may include example The lens such as formed for example, by Photoresist reflow process or printing process.This one or more light-sensitive element can be used as being directly integrated Fluorescence detector or detector array into display.In this example, photoresist layer be incorporated into growth substrates with it is photosensitive To stop backlight to the direct irradiation of light-sensitive element between element.

Optical filter (such as organic dyestuff, medium filter or metal medium filter) may be optionally incorporated and detect The pixel to specific wavelength with sensitivity is generated in device pixel.For example, red, green, blue, cyan, magenta, Huang Color, IR and UV absorb dyestuff and are optionally placed in different detectors pixel in order to provide color detection or spectrum is able to carry out More pixel detectors of method.Standard LCD color filter material itself is optionally placed on photodiode.

In some embodiments, detector pixel can also be directly arranged at below LCD element, so that LCD matrix can be used to Detector pixel is closed, so that array be promoted to capture image.

The display part of Figure 22 is normally operated to show any image or instruction, while motivating the IR LED of Figure 22 159 to cause display glass 154 to emit IR light in the region of photoelectric detector components 158.By in neighbouring photoelectric detector 154 top of display glass of element 158 or the reflection of physical feeling 116 and absorption contacted with display glass 154 are emitted Light, and the signal from photoelectric detector components 158 is handled to identify the characteristic of physical feeling 116 by detector circuit, such as Fingerprint, blood vessel, facial recognition, a combination thereof etc..It includes any number that photoelectric detector components 158, which may depend on desired resolution ratio, Pixel.Therefore, all transmittings for detection, therefore IR transmitter are generated by side-emitting light source (such as IR LED 159) It is not take up display pixel area.

At the point that glass is contacted with tissue, the close refractive index of glass 154 and tissue arrives light transmission In tissue.Then, be attenuated and be backscattered to from tissue can be therefrom in the detector array of detection light for light.It can be examined from this Survey light confirmation biological identification signature or biometric data.

Wavelength other than ir can be used to detect other biological natures, in particular for facial recognition.

In one embodiment, display part can be the high-resolution for showing normal image, and detector portion It may include the visible light pixel of low resolution of the position of the detection part below display glass for identification.For example, test section Light emitting pixel (for example, RGB or white) in point can provide the profile of detector region or identify simple instruction for user.Herein In embodiment, the pixel in display part is operated independently of the light emitting pixel in detection zone.Hair in detector region Light pixel also acts as the irradiation pixel for the physical feeling to be detected.

In all embodiments, the detection circuit and control circuit of Fig. 1 can be integrated into device.

Although having shown that and describing the particular embodiment of the present invention, will show to those of ordinary skill in the art And be clear to, it can be changed and modify in the case where not departing from broader aspect of the invention and therefore, appended right Claim by true spirit and range of the invention it is all it is such change and modification cover within its scope.

Claims (29)

1. a kind of biosensor arrangement comprising:

Display part transmits panel with light, and the display part emits light within the pixel to generate image, the picture Element generates the light with first group of peak wavelength；

Detector portion, a part for being configured to pass the light transmitting panel receive light, the detector portion and hair The pixel penetrated in the display part of light is spaced；

Light source, is configured to pass light transmitting panel transmitting light to be reflected by the physical feeling part of people and to be absorbed, The light source is not intended to generate the pixel in the display part of described image；

Between one or more photoelectric detectors in the detector portion, with the pixel transverse direction in the display part It separates, is arranged to detect the light at least by the physical feeling retroeflection, the photoelectric detector, which generates, corresponds to described return Penetrate the first signal of light；And

Detection circuit is coupled to one or more described photoelectric detectors, is configured for analyzing first signal with determination The characteristic of the physical feeling.

2. the apparatus according to claim 1, wherein the pixel generates feux rouges, green light and blue light, and the light source generates Infrared light.

3. the apparatus according to claim 1, wherein the light source optical be coupled in the light transmitting panel edge it is attached Closely, wherein light transmitting panel serves as waveguide to guide the light from the light source and transmit panel by the light Light-emitting area emits the light from the light source.

4. device according to claim 3, wherein light transmitting panel is arranged such that light substantially only through described Light transmits the light-emitting area transmitting of panel, wherein the physical feeling is directly contacted with the light-emitting area.

5. the apparatus according to claim 1, wherein between the pixel transverse direction in the light source and the display part It separates.

6. the apparatus according to claim 1, wherein the light source includes one or more light emitting diodes.

7. the apparatus according to claim 1, wherein the light source includes the light-emitting diodes for emitting the light of different peak wavelengths Pipe.

8. the apparatus according to claim 1, wherein light source transmitting has the light of the wavelength absorbed by blood vessel.

9. the apparatus according to claim 1 wherein the light source includes light guide, and wherein comes from one or more light-emitting diodes The light of pipe is optically coupled to the light guide, and the light guide is configured for through its surface emitting light.

10. device according to claim 9, wherein light transmitting panel is the light guide.

11. device according to claim 9 makes wherein one or more described photoelectric detectors are located at the light guide rear Institute's reflected light from the physical feeling is obtained to transmit by the light guide to be detected by one or more described photoelectric detectors.

12. the apparatus according to claim 1 further comprises the lens above one or more described photoelectric detectors, The lens are used to limit the angular range of institute's reflected light from the physical feeling.

13. the apparatus according to claim 1 further comprises the lens above the photoelectric detector, the lens For by institute's reflected light from the physical feeling out of described physical feeling only at a certain distance from focus on it is described one or more On a photoelectric detector.

14. the apparatus according to claim 1 further comprises the non-optical sensor being integrated into described device.

15. device according to claim 14, wherein the non-optical sensor includes for being touched by the physical feeling The electrode touched.

16. the apparatus according to claim 1, wherein the physical feeling includes finger, and described device is configured to examine Survey fingerprint.

17. the apparatus according to claim 1, wherein the physical feeling includes finger, and described device is configured to examine Survey the blood vessel in the finger.

18. the apparatus according to claim 1, wherein the physical feeling includes finger, and described device is configured to examine Survey the fingerprint and blood vessel in the finger.

19. the apparatus according to claim 1 further comprises the processor being integrated into described device, the processing Device controls the excitation of the light source and the detection by the received institute's reflected light of one or more described photoelectric detectors.

20. the apparatus according to claim 1 further comprises processor, the processor is configured to processing and comes from The data of the photoelectric detector, the data and institute's storing data, and indicate the certification of the user of described device.

21. the apparatus according to claim 1 further comprises processor, wherein the light source includes multiple luminous two Pole pipe wherein the processor is configured to control the light emitting diode and sequentially irradiate, while being read by the processor And signal of the processing from one or more of the photoelectric detector.

22. the apparatus according to claim 1 further comprises processor, wherein the processor is configured to detect The light reflected image of the physical feeling absorbs the region of the light to determine in the physical feeling.

23. the apparatus according to claim 1 further comprises processor, the processor is configured to processing and comes from The data of one or more photoelectric detectors, wherein the processor detects the movement of the physical feeling to detect posture.

24. a kind of biosensor arrangement comprising:

Display part transmits panel with light, and the display part emits light within the pixel to generate image, the picture Element generates the light with first group of peak wavelength；

Light source is optically coupled to the adjacent edges of light transmitting panel, wherein light transmitting panel serve as light guide with It guides the light from the light source and is emitted by the light-emitting area that the light transmits panel from described in the light source Light, the light source are not intended to generate the pixel in the display part of described image；

One or more photoelectric detectors are arranged to detect the light of the physical feeling retroeflection by contacting the light transmitting panel, Light from the light source is at the region of the transmitting panel of the light described in the wherein body contact from the smooth transfer surface Plate extracts, and the photoelectric detector generates the first signal for corresponding to institute's retroreflection light；And

Detection circuit is coupled to one or more described photoelectric detectors, is configured for analyzing first signal with determination The characteristic of the physical feeling.

25. device according to claim 24, wherein one or more described photoelectric detectors and the display part are horizontal To be spaced apart.

26. device according to claim 24, wherein one or more described photoelectric detectors are distributed in the display portion In point.

27. detector according to claim 24, wherein the detection circuit detects fingerprint, wherein the apical grafting of the fingerprint It touches the light transmitting panel and extracts light from light transmitting panel.

28. detector according to claim 27, wherein the detection circuit also detects the vascular patterns in finger.

29. detector according to claim 28, wherein the detection circuit detects fingerprint and blood vessel in the finger Combination pattern.