TWM608710U - Under-screen fingerprint sensing device - Google Patents

Under-screen fingerprint sensing device Download PDF

Info

Publication number
TWM608710U
TWM608710U TW109215752U TW109215752U TWM608710U TW M608710 U TWM608710 U TW M608710U TW 109215752 U TW109215752 U TW 109215752U TW 109215752 U TW109215752 U TW 109215752U TW M608710 U TWM608710 U TW M608710U
Authority
TW
Taiwan
Prior art keywords
finger
image sensor
under
fingerprint
display
Prior art date
Application number
TW109215752U
Other languages
Chinese (zh)
Inventor
林冠儀
Original Assignee
神盾股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 神盾股份有限公司 filed Critical 神盾股份有限公司
Publication of TWM608710U publication Critical patent/TWM608710U/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • G06V40/1318Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1347Preprocessing; Feature extraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1382Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger
    • G06V40/1388Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger using image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1382Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger
    • G06V40/1394Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger using acquisition arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Input (AREA)
  • Collating Specific Patterns (AREA)

Abstract

An under-screen fingerprint sensing device including an image sensor and a controller is provided. The image sensor is disposed under a display. The display emits an illumination light transmitted to a finger pressing on the display. The finger reflects the illumination light into a signal light carrying fingerprint information of the finger. The signal light passes through the display and then form a fingerprint image on the image sensor. The controller is electrically connected to the image sensor and configured to process the fingerprint image sensed by the image sensor. The controller is configured to calculate inner products of gray levels on axes in two different directions and a Haar-like feature, whereby determining whether the fingerprint image is from a real finger or a fake finger.

Description

屏下式指紋感測裝置Under-screen fingerprint sensing device

本新型創作是有關於一種感測裝置,且特別是有關於一種指紋感測裝置。This new creation relates to a sensing device, and in particular to a fingerprint sensing device.

隨著可攜式電子裝置朝向大屏占比發展,原本置於電子裝置正面的電容式指紋感測器便不再適用,而需改成置於電子裝置的側面或背面。然而,置於側面或背面的指紋感測器在使用上有不便利之處,因此屏下式指紋感測器便被發展出來。With the development of portable electronic devices toward a larger screen-to-body ratio, the capacitive fingerprint sensor originally placed on the front of the electronic device is no longer applicable, and needs to be changed to be placed on the side or back of the electronic device. However, the fingerprint sensor placed on the side or the back is inconvenient to use, so an under-screen fingerprint sensor has been developed.

屏下式指紋感測器大致上可分為光學式指紋感測器與超聲波式指紋感測器,其中又以光學式指紋感測器成本較低且較適合量產。由於指紋感測攸關使用者的個人資料的安全性,因此,尚需發展出反欺騙(anti-spoofing)的功能。例如,欲竊取個人資料的人可能可以在環境中採集使用者的指紋,並製作成具有此指紋的假手指,再用假手指按壓電子裝置以達成指紋成功辨識而解鎖。因此,需發展出能夠辨識出假手指而非真手指的指紋感測器,以進一步提升使用者的個人資料的安全性。Under-screen fingerprint sensors can be roughly divided into optical fingerprint sensors and ultrasonic fingerprint sensors. Among them, optical fingerprint sensors are cheaper and more suitable for mass production. Since fingerprint sensing is critical to the security of the user's personal data, it is still necessary to develop an anti-spoofing function. For example, a person who intends to steal personal data may collect a user's fingerprint in the environment and make a fake finger with the fingerprint, and then press the electronic device with the fake finger to achieve successful fingerprint recognition and unlock. Therefore, it is necessary to develop a fingerprint sensor that can recognize fake fingers instead of real fingers to further enhance the security of the user's personal data.

本新型創作提供一種屏下式指紋感測裝置,其可辨識出真手指與假手指。This new creation provides an under-screen fingerprint sensing device, which can identify real fingers and fake fingers.

本新型創作的一實施例提出一種屏下式指紋感測裝置,用以與一顯示器搭配,顯示器發出一照明光,照明光傳遞至按壓於顯示器上的一手指,手指將照明光反射成攜帶手指的指紋資訊的一訊號光。屏下式指紋感測裝置包括一影像感測器及一控制器。影像感測器配置於顯示器下方,其中訊號光穿透顯示器而在影像感測器上形成一指紋影像。控制器電性連接至影像感測器,處理影像感測器所感測到的指紋影像,對指紋影像的兩個方向不同的軸線上的灰階值與一哈爾特徵(Haar-like feature)作內積,並藉此判斷指紋影像是來自真手指或假手指。An embodiment of the present invention proposes an under-screen fingerprint sensing device for matching with a display. The display emits an illuminating light, which is transmitted to a finger pressed on the display, and the finger reflects the illuminating light into a carrying finger A signal light of fingerprint information. The under-screen fingerprint sensor includes an image sensor and a controller. The image sensor is arranged under the display, and the signal light penetrates the display to form a fingerprint image on the image sensor. The controller is electrically connected to the image sensor, and processes the fingerprint image sensed by the image sensor, and performs the function of the grayscale value and the Haar-like feature on the two axes of the fingerprint image in different directions. The inner product is used to determine whether the fingerprint image is from a real finger or a fake finger.

本新型創作的一實施例提出一種屏下式指紋感測裝置,用以與一顯示器搭配,顯示器發出一照明光,照明光傳遞至按壓於顯示器上的一手指,手指將照明光反射成攜帶手指的指紋資訊的一訊號光。屏下式指紋感測裝置包括一影像感測器及一控制器。影像感測器配置於一顯示器下方,其中訊號光穿透顯示器而在影像感測器上形成一指紋影像。控制器電性連接至影像感測器,且用以處理影像感測器所感測到的指紋影像。控制器用以計算指紋影像的一中心區域的灰階平均值及在中心區域兩側的二周邊區域的各自的灰階平均值,並藉此判斷指紋影像是來自真手指或假手指。An embodiment of the present invention proposes an under-screen fingerprint sensing device for matching with a display. The display emits an illuminating light, which is transmitted to a finger pressed on the display, and the finger reflects the illuminating light into a carrying finger A signal light of fingerprint information. The under-screen fingerprint sensor includes an image sensor and a controller. The image sensor is arranged under a display, and the signal light penetrates the display to form a fingerprint image on the image sensor. The controller is electrically connected to the image sensor and used for processing the fingerprint image sensed by the image sensor. The controller is used to calculate the average gray level of a central area of the fingerprint image and the respective average gray levels of the two peripheral areas on both sides of the central area, and thereby determine whether the fingerprint image is from a real finger or a fake finger.

本新型創作的一實施例提出一種屏下式指紋感測裝置,用以與一顯示器搭配,顯示器發出一照明光,照明光傳遞至按壓於顯示器上的一手指,手指將照明光反射成攜帶手指的指紋資訊的一訊號光。屏下式指紋感測裝置包括一影像感測器及一控制器。影像感測器配置於一顯示器下方,其中訊號光穿透顯示器而在影像感測器上形成一指紋影像。控制器電性連接至影像感測器,且用以處理影像感測器所感測到的指紋影像。控制器用以對指紋影像的兩個方向不同的軸線上的灰階值與一哈爾特徵作內積,以獲得一第一結果。控制器用以計算指紋影像的一中心區域的灰階平均值及在中心區域兩側的二周邊區域的各自的灰階平均值,以獲得一第二結果。控制器用以綜合第一結果與第二結果來判斷指紋影像是來自真手指或假手指。An embodiment of the present invention proposes an under-screen fingerprint sensing device for matching with a display. The display emits an illuminating light, which is transmitted to a finger pressed on the display, and the finger reflects the illuminating light into a carrying finger A signal light of fingerprint information. The under-screen fingerprint sensor includes an image sensor and a controller. The image sensor is arranged under a display, and the signal light penetrates the display to form a fingerprint image on the image sensor. The controller is electrically connected to the image sensor and used for processing the fingerprint image sensed by the image sensor. The controller is used to internally product the grayscale values on the two axes of the fingerprint image in different directions and a Haar feature to obtain a first result. The controller is used to calculate the average gray scale of a central area of the fingerprint image and the respective gray scale averages of the two peripheral areas on both sides of the central area to obtain a second result. The controller is used to synthesize the first result and the second result to determine whether the fingerprint image is from a real finger or a fake finger.

在本新型創作的實施例的屏下式指紋感測裝置中,控制器對指紋影像的兩個方向不同的軸線上的灰階值與一哈爾特徵作內積,及/或計算指紋影像的中心區域的灰階平均值及在中心區域兩側的二個周邊區域的各自的灰階平均值,並藉此判斷指紋影像是來自真手指或假手指。因此,本新型創作的實施例的屏下式指紋感測裝置在指紋感測上可以達到防欺騙的效果,進而提升使用者的個人資料的安全性。In the under-screen fingerprint sensing device of the embodiment of the present invention, the controller performs the inner product of the grayscale values on the two axes of the fingerprint image in different directions and a Haar feature, and/or calculates the fingerprint image The average gray level of the central area and the average gray levels of the two peripheral areas on both sides of the central area are used to determine whether the fingerprint image comes from a real finger or a fake finger. Therefore, the under-screen fingerprint sensing device of the inventive embodiment of the present invention can achieve the effect of anti-spoofing in fingerprint sensing, thereby improving the security of the user's personal data.

圖1為本新型創作的一實施例的電子裝置的剖面示意圖。請參照圖1,本實施例的電子裝置100包括一顯示器105及一屏下式指紋感測裝置200。電子裝置100例如為智慧型手機、平板電腦、筆記型電腦、個人數位助理(personal digital assistant, PDA)或其他適當的電子裝置。屏下式指紋感測裝置200用以與一顯示器105搭配,且包括一影像感測器210及一控制器230。影像感測器210配置於顯示器105下方。顯示器105發出一照明光60,照明光60傳遞至按壓於顯示器105上的一手指50,手指50將照明光60反射成攜帶手指的指紋資訊的一訊號光70。訊號光70穿透顯示器105而在影像感測器210上形成一指紋影像。如此一來,影像感測器210便能夠感測到手指50的指紋影像。控制器230電性連接至影像感測器210,且用以處理影像感測器210所感測到的指紋影像。FIG. 1 is a schematic cross-sectional view of an electronic device according to an embodiment of the new creation. Please refer to FIG. 1, the electronic device 100 of this embodiment includes a display 105 and an under-screen fingerprint sensor 200. The electronic device 100 is, for example, a smart phone, a tablet computer, a notebook computer, a personal digital assistant (PDA) or other appropriate electronic devices. The under-screen fingerprint sensor device 200 is used to match with a display 105 and includes an image sensor 210 and a controller 230. The image sensor 210 is disposed under the display 105. The display 105 emits an illuminating light 60, and the illuminating light 60 is transmitted to a finger 50 pressed on the display 105, and the finger 50 reflects the illuminating light 60 into a signal light 70 carrying fingerprint information of the finger. The signal light 70 penetrates the display 105 to form a fingerprint image on the image sensor 210. In this way, the image sensor 210 can sense the fingerprint image of the finger 50. The controller 230 is electrically connected to the image sensor 210 and used for processing the fingerprint image sensed by the image sensor 210.

在本實施例中,顯示器105包括一玻璃蓋(cover glass)120、一線偏振片116、一相位延遲膜114及一有機發光二極體顯示面板112。手指按壓於玻璃蓋120上。線偏振片116配置於玻璃蓋120與影像感測器210之間。相位延遲膜114配置於線偏振片116與影像感測器210之間,其中相位延遲膜114例如為波片(wave plate),其可以是顯示器本身的材料所形成,或是額外加入的波片所形成。有機發光二極體顯示面板112配置於相位延遲膜114與影像感測器210之間。在其他實施例中,亦可以用液晶顯示面板、微發光二極體顯示面板、電泳顯示面板或其他適當的顯示面板來取代有機發光二極體顯示面板112。In this embodiment, the display 105 includes a cover glass 120, a linear polarizer 116, a phase retardation film 114, and an organic light emitting diode display panel 112. The finger presses on the glass cover 120. The linear polarizer 116 is disposed between the glass cover 120 and the image sensor 210. The phase retardation film 114 is disposed between the linear polarizer 116 and the image sensor 210. The phase retardation film 114 is, for example, a wave plate, which may be formed of the material of the display itself, or an additional wave plate. Formed. The organic light emitting diode display panel 112 is disposed between the phase retardation film 114 and the image sensor 210. In other embodiments, a liquid crystal display panel, a micro-light-emitting diode display panel, an electrophoretic display panel, or other suitable display panels can also be used to replace the organic light-emitting diode display panel 112.

在本實施例中,屏下式指紋感測裝置200更包括一鏡頭220,配置於訊號光70的路徑上,且位於顯示器105與影像感測器210之間。鏡頭220可包括一或多片透鏡,其可將訊號光70成像於影像感測器210上,以在影像感測器210上形成指紋影像。In this embodiment, the under-screen fingerprint sensing device 200 further includes a lens 220 disposed on the path of the signal light 70 and located between the display 105 and the image sensor 210. The lens 220 may include one or more lenses, which can image the signal light 70 on the image sensor 210 to form a fingerprint image on the image sensor 210.

具體而言,有機發光二極體顯示面板112發出的照明光60是不具有偏振性的,且當其穿透相位延遲膜114後,仍不具有偏振性。然而,當照明光60穿透線偏振片116後,會具有偏振方向K0,其中偏振方向K0可被分解成第一偏振方向K1與第二偏振方向K2兩個分量,如圖2A及圖2B所示,第一偏振方向K1為P偏振方向,而第二偏振方向K2為S偏振方向。換言之,具有偏振方向K0的照明光60可視為具有第一偏振方向K1的照明光62與具有第二偏振方向K2的照明光64所合成。Specifically, the illuminating light 60 emitted by the organic light emitting diode display panel 112 does not have polarization, and after it penetrates the phase retardation film 114, it still does not have polarization. However, when the illumination light 60 penetrates the linear polarizer 116, it will have a polarization direction K0, where the polarization direction K0 can be decomposed into two components, a first polarization direction K1 and a second polarization direction K2, as shown in FIGS. 2A and 2B As shown, the first polarization direction K1 is the P polarization direction, and the second polarization direction K2 is the S polarization direction. In other words, the illumination light 60 having the polarization direction K0 can be regarded as a combination of the illumination light 62 having the first polarization direction K1 and the illumination light 64 having the second polarization direction K2.

圖2A繪示圖1中具有P偏振方向的照明光被手指反射的情形,而圖2B繪示圖1中具有S偏振方向的照明光被手指反射的情形。請參照圖1、圖2A及圖2B,具有第一偏振方向K1的照明光62在玻璃蓋120中行進(如圖2A),並在玻璃蓋120的上表面122處被手指50部分反射成訊號光72,而另一部分的照明光82則在手指50中傳遞。另一方面,具有第二偏振方向K2的照明光64在玻璃蓋120中行進(如圖2B),並在玻璃蓋120的上表面122處被手指50部分反射成訊號光74,而另一部分的照明光84則在手指50中傳遞。其中,訊號光72與訊號光74合成訊號光70,而往影像感測器210的方向傳遞。FIG. 2A illustrates a situation in which the illumination light with a P polarization direction in FIG. 1 is reflected by a finger, and FIG. 2B illustrates a situation in which the illumination light with an S polarization direction in FIG. 1 is reflected by a finger. 1, 2A and 2B, the illumination light 62 with the first polarization direction K1 travels in the glass cover 120 (as shown in FIG. 2A), and is partially reflected by the finger 50 at the upper surface 122 of the glass cover 120 as a signal Light 72, and another part of the illuminating light 82 is transmitted in the finger 50. On the other hand, the illuminating light 64 with the second polarization direction K2 travels in the glass cover 120 (as shown in FIG. 2B), and is partially reflected by the finger 50 at the upper surface 122 of the glass cover 120 as the signal light 74, and the other part The illuminating light 84 is transmitted in the finger 50. Among them, the signal light 72 and the signal light 74 combine the signal light 70 and transmit it in the direction of the image sensor 210.

影像感測器210所感測到的訊號光72與訊號光74的光強度及其比例是有關於手指50與玻璃蓋120的折射率所造成的反射率。圖3為圖1的手指與玻璃蓋的界面對照明光的反射率及穿透率相對於入射此界面的入射角的分佈曲線,其中,R p為此界面對照明光62的反射率相對於入射角的分佈曲線,R s為此界面對照明光64的反射率相對於入射角的分佈曲線,T p為此界面對照明光62的穿透率相對於入射角的分佈曲線,而T s為此界面對照明光64的穿透率相對於入射角的分佈曲線。其中,T p=1-R p,且T s=1-R s。由圖3可知,在入射角較大處所對應的訊號光72(P偏振光)與訊號光74(S偏振光)的光強度差異越大。由於影像感測器210在越外圈處是收到越大入射角的照明光60所反射成的訊號光70,因此越外圈處所感測到的訊號光72(P偏振光)與訊號光74(S偏振光)的光強度差異越大。 The light intensity and the ratio of the signal light 72 and the signal light 74 sensed by the image sensor 210 are related to the reflectance caused by the refractive index of the finger 50 and the glass cover 120. Fig. 3 is a distribution curve of the reflectance and transmittance of the illuminating light at the interface between the finger and the glass cover of Fig. 1 with respect to the incident angle of the interface, where R p is the reflectance of the interface to the illuminating light 62 with respect to the incident angle R s is the distribution curve of the reflectance of the interface to the illumination light 64 with respect to the angle of incidence, T p is the distribution curve of the interface’s transmittance of the illumination light 62 with respect to the angle of incidence, and T s is the interface control The distribution curve of the transmittance of the bright light 64 with respect to the incident angle. Among them, T p =1-R p , and T s =1-R s . It can be seen from FIG. 3 that the light intensity difference between the signal light 72 (P polarized light) and the signal light 74 (S polarized light) corresponding to a larger incident angle is greater. Since the image sensor 210 receives the signal light 70 reflected by the illumination light 60 with a larger incident angle at the outer ring, the signal light 72 (P polarized light) and the signal light at the outer ring are sensed The greater the difference in light intensity of 74 (S-polarized light).

圖4A為圖1的影像感測器所感測到的指紋影像與其所接收到的P偏振光與S偏振光的區域對照圖。請參照圖1、圖2A、圖2B及圖4A,圖4A中,P所在區域的影像亮度主要是由訊號光72(P偏振光)所貢獻,S所在區域的影像亮度主要是由訊號光74(S偏振光)所貢獻,而S+P所在區域的影像亮度主要是由訊號光72(P偏振光)與訊號光74(S偏振光)兩者所共同貢獻。P所在區域因為穿透光多,所以指紋影像的對比度較強;S所在區域因為穿透光少,所以指紋影像的對比度較弱;P所在區域因為反射光少,所以指紋影像的直流值(DC value)低,也就是平均亮度較低;S所在區域因為反射光多,所以指紋影像的直流值高,也就是平均亮度較高。4A is a comparison diagram of the fingerprint image sensed by the image sensor of FIG. 1 and the area of the P-polarized light and S-polarized light it receives. Please refer to Figure 1, Figure 2A, Figure 2B and Figure 4A. In Figure 4A, the image brightness in the area where P is mainly contributed by the signal light 72 (P polarized light), and the image brightness in the area where S is mainly contributed by the signal light 74 (S-polarized light), and the image brightness of the area where S+P is located is mainly contributed by the signal light 72 (P-polarized light) and the signal light 74 (S-polarized light). The area where P is located because there is a lot of penetrating light, so the contrast of the fingerprint image is stronger; the area where S is located because there is less penetrating light, so the contrast of the fingerprint image is weak; the area where P is located because there is less reflected light, so the DC value of the fingerprint image value) is low, that is, the average brightness is low; because the area where S is located, the DC value of the fingerprint image is high, that is, the average brightness is high.

圖4B為圖1的影像感測器感測到假手指的指紋影像。圖5A為圖1的影像感測器所感測到的真手指的指紋影像於對角線M-N上的平均灰階分佈圖,而圖5B為圖1的影像感測器所感測到的假手指的指紋影像於對角線M-N上的平均灰階分佈圖。在圖5A與圖5B的對角線M-N上的某個畫素的平均灰階是藉由將此畫素附近的幾個畫素的灰階值與此畫素本身的灰階值取平均值而得。比較圖4A與圖4B,以及圖5A與圖5B,可發現真手指的指紋影像於中央的平均亮度較低,而對角線M-N上靠近兩端的平均亮度較高。相反地,假手指的指紋影像於中央的平均亮度較高,而對角線M-N上靠近兩端的平均亮度較低。會造成此種現象的主要原因之一是假手指的折射率與真手指有差異,因此會造成P偏振光與S偏振光的反射率不同,進而造成平均亮度在不同位置的分佈曲線的不同。因此,本新型創作的實施例便可對此現象加以利用,以產生辨識真手指與假手指的方案,這將於以下內容中詳述。FIG. 4B shows the fingerprint image of the fake finger detected by the image sensor of FIG. 1. 5A is an average grayscale distribution diagram on the diagonal MN of the fingerprint image of the real finger sensed by the image sensor of FIG. 1, and FIG. 5B is the fake finger image of the fake finger sensed by the image sensor of FIG. 1 The average gray scale distribution map of the fingerprint image on the diagonal MN. The average gray scale of a certain pixel on the diagonal MN of Fig. 5A and Fig. 5B is obtained by averaging the gray scale values of several pixels near the pixel and the gray scale value of the pixel itself. And gotta. Comparing FIGS. 4A and 4B, and FIGS. 5A and 5B, it can be found that the average brightness of the fingerprint image of the real finger at the center is lower, while the average brightness near the two ends on the diagonal line M-N is higher. Conversely, the average brightness of the fingerprint image of the fake finger is higher in the center, while the average brightness near the two ends on the diagonal line M-N is lower. One of the main reasons for this phenomenon is that the refractive index of the fake finger is different from that of the real finger, which will cause the reflectivity of P-polarized light and S-polarized light to be different, resulting in different distribution curves of average brightness at different positions. Therefore, the embodiment of the present invention can take advantage of this phenomenon to generate a scheme for identifying the real finger and the fake finger, which will be described in detail in the following content.

圖6為圖1中的控制器處理指紋影像的示意圖。請參照圖1與圖6,在本實施例中,控制器230用以對指紋影像的兩個方向不同的軸線L1與L2上的灰階值與一哈爾特徵作內積(inner product),以獲得一第一結果。具體而言,在本實施例中,控制器先對指紋影像作模糊化處理後,再對經模糊化的指紋影像的兩個方向不同的軸線L1與L2上的灰階值與哈爾特徵作內積。此處的模糊化例如是平均模糊化(mean blur)或高斯模糊化(Gaussian blur),例如將每個畫素的灰階值與此畫素的周圍的幾個畫素的灰階值取平均值,並以此平均值作為此畫素的新灰階值。FIG. 6 is a schematic diagram of the controller in FIG. 1 processing fingerprint images. 1 and FIG. 6, in this embodiment, the controller 230 is used to make the inner product of the grayscale value and a Haar feature on the two axes L1 and L2 of the fingerprint image in different directions. To obtain a first result. Specifically, in this embodiment, the controller first performs blurring processing on the fingerprint image, and then performs grayscale values and Haar characteristics on the two axes L1 and L2 of the blurred fingerprint image in different directions. Inner product. The blur here is, for example, mean blur or Gaussian blur. For example, the grayscale value of each pixel is averaged with the grayscale values of several pixels around the pixel. Value, and use the average value as the new grayscale value of this pixel.

在本實施例中,哈爾特徵為中間區域C1具有一第一數值而兩側區域C2與C3具有一第二數值的函數,其中第一數值大於第二數值。舉例而言,第一數值為+1,而第二數值為-1。經模糊化後的指紋影像例如具有200×200個像素,而哈爾特徵從左端數來的第1到75個像素所各自具有的數值例如設為-1,第76至125個像素所各自具有的數值例如設為+1,而第126至第200個像素所各自具有的數值例如設為-1。經模糊化後的指紋影像的軸線L1上亦具有200個畫素,而每個畫素具有各自的灰階值,而此灰階值代表經模糊化後的指紋影像的亮度。接著,將軸線L1上的這200個畫素所具有的灰階值依序分別地與哈爾特徵的這200個像素的數值(即-1或+1)相乘,以得到200個積,而後再將這200個積相加,即可獲得上述經內積運算後所得到的數值。In this embodiment, the Haar feature is that the middle area C1 has a first value and the side areas C2 and C3 have a function of a second value, wherein the first value is greater than the second value. For example, the first value is +1, and the second value is -1. The blurred fingerprint image has, for example, 200×200 pixels, and the first to 75th pixels from the left end of the Haar feature each have a value of, for example, -1, and the 76th to 125th pixels each have The value of is set to, for example, +1, and the value of each of the 126th to 200th pixels is set to, for example, -1. The blurred fingerprint image also has 200 pixels on the axis L1, and each pixel has its own grayscale value, and the grayscale value represents the brightness of the blurred fingerprint image. Then, the grayscale values of the 200 pixels on the axis L1 are sequentially and respectively multiplied by the value of the 200 pixels of the Haar feature (that is, -1 or +1) to obtain 200 products, Then, the 200 products are added together to obtain the value obtained after the inner product operation.

然後,控制器230將分別對應於軸線L1與軸線L2的兩個內積值相加,以獲得一第一特徵值。比較圖5A、圖5B與圖6可知,軸線L1與L2上的灰階值經由與哈爾特徵作內積運算後,圖5A的真手指的內積值或第一特徵值越小,而圖5B的假手指的內積值或第一特徵值越大,因此所運算出的第一特徵值可用以分辨所感測的是真手指或假手指。Then, the controller 230 adds the two inner product values respectively corresponding to the axis L1 and the axis L2 to obtain a first characteristic value. Comparing Fig. 5A, Fig. 5B and Fig. 6, it can be seen that the inner product value or the first characteristic value of the real finger in Fig. 5A is smaller after the gray scale values on the axes L1 and L2 are calculated with the Haar feature. The inner product value or the first feature value of the fake finger of 5B is larger, so the calculated first feature value can be used to distinguish whether the sensed finger is a real finger or a fake finger.

圖7為圖1中的控制器處理指紋影像的另一示意圖。請參照圖1與圖7,控制器230用以計算指紋影像的一中心區域D2的灰階平均值及在中心區域D2兩側的二周邊區域D1與D3的各自的灰階平均值,以獲得一第二結果。此外,控制器230用以綜合第一結果與第二結果來判斷指紋影像是來自真手指或假手指。FIG. 7 is another schematic diagram of the controller in FIG. 1 processing fingerprint images. 1 and 7, the controller 230 is used to calculate the average gray level of a central area D2 of the fingerprint image and the respective gray level averages of the two peripheral areas D1 and D3 on both sides of the central area D2 to obtain A second result. In addition, the controller 230 is used to synthesize the first result and the second result to determine whether the fingerprint image is from a real finger or a fake finger.

具體而言,中心區域D2的灰階平均值為R2,二周邊區域D1與D3的灰階平均值分別為R1與R3,控制器230用以對R1、R2、R3作算術運算,以獲得一第二特徵值。在本實施例中,中心區域D2與該二周邊區域D1與D3排列於指紋影像的一對角線上,而此對角線的方向可依據線偏振片116的穿透軸方向來作決定,也就是選擇真手指與假手指的第二特徵值的區別較大的方向作為此對角線的方向。在一實施例中,上述的算術運算例如為(R2-R1)+(R2-R3),或者上述的算術運算例如為R2-R1-R3,在比較圖5A、圖5B及圖7可知,對於這兩種算數運算所獲得的第二特徵值而言,都是真手指的第二特徵值較小,而假手指的第二特徵值較大,因此所運算出的第二特徵值可用以分辨所感測的是真手指或假手指。Specifically, the average gray level of the central area D2 is R2, and the average gray levels of the two peripheral areas D1 and D3 are R1 and R3, respectively. The controller 230 is used to perform arithmetic operations on R1, R2, and R3 to obtain a The second characteristic value. In this embodiment, the central area D2 and the two peripheral areas D1 and D3 are arranged on the diagonal of the fingerprint image, and the direction of the diagonal can be determined according to the direction of the penetration axis of the linear polarizer 116. That is, the direction with the greater difference between the second feature value of the real finger and the fake finger is selected as the direction of the diagonal. In one embodiment, the above-mentioned arithmetic operation is, for example, (R2-R1)+(R2-R3), or the above-mentioned arithmetic operation is, for example, R2-R1-R3. Comparing FIG. 5A, FIG. 5B, and FIG. The second characteristic value obtained by these two arithmetic operations is that the second characteristic value of the real finger is smaller, while the second characteristic value of the fake finger is larger, so the calculated second characteristic value can be used to distinguish What is sensed is a real finger or a fake finger.

圖8為圖1中的控制器處理指紋影像的第一特徵值與第二特徵值的示意圖。請參照圖1與圖8,控制器230用以判斷第一特徵值與第二特徵值所形成的一二維座標(如在圖8的座標平面中的座標)是否落在一預設區域F1或F2內(例如是否落在預設區域F1的橢圓區域內,或是否落在預設區域F2的橢圓區域內),而預設區域F1、預設區域F2或其他區域的選擇可根據所實驗的真手指與假手指的案例來決定。若二維座標落在預設區域F1或F2內,則控制器230判斷指紋影像是來自真手指。若二維座標落在預設區域F1或F2外,則控制器230判斷指紋影像是來自假手指。如此一來,本實施例的屏下式指紋感測裝置100在指紋感測上便可以達到防欺騙的效果,進而提升使用者的個人資料的安全性。FIG. 8 is a schematic diagram of the controller in FIG. 1 processing the first characteristic value and the second characteristic value of the fingerprint image. 1 and 8, the controller 230 is used to determine whether a two-dimensional coordinate formed by the first characteristic value and the second characteristic value (such as the coordinate in the coordinate plane of FIG. 8) falls in a predetermined area F1 Or F2 (for example, whether it falls within the elliptical area of the preset area F1, or whether it falls within the elliptical area of the preset area F2), and the selection of the preset area F1, the preset area F2 or other areas can be based on the experiment It is decided by the case of real finger and fake finger. If the two-dimensional coordinates fall within the predetermined area F1 or F2, the controller 230 determines that the fingerprint image is from a real finger. If the two-dimensional coordinates fall outside the preset area F1 or F2, the controller 230 determines that the fingerprint image is from a fake finger. In this way, the under-screen fingerprint sensing device 100 of this embodiment can achieve an anti-spoofing effect in fingerprint sensing, thereby enhancing the security of the user's personal data.

上述實施例是以綜合第一特徵值與第二特徵值的結果來判斷出真手指與假手指。然而,在其他實施例中,也可以單就第一特徵值來判斷出真手指與假手指,或者是單就第二特徵值來判斷出真手指與假手指。舉例而言,控制器230可以只計算出第一特徵值,並判斷第一特徵值是否落在一預設範圍內。若第一特徵值落在預設範圍內,則判斷指紋影像是來自真手指;若第一特徵值落在預設範圍外,則判斷指紋影像是來自假手指。或者,控制器230可以只計算出第二特徵值,並判斷第二特徵值是否落在一預設範圍內。若第二特徵值落在預設範圍內,則判斷指紋影像是來自真手指;若第二特徵值落在預設範圍外,則判斷指紋影像是來自假手指。In the above embodiment, the real finger and the fake finger are judged based on the result of combining the first feature value and the second feature value. However, in other embodiments, the real finger and the fake finger can also be judged based on the first feature value alone, or the real finger and the fake finger can be judged based on the second feature value alone. For example, the controller 230 may only calculate the first characteristic value, and determine whether the first characteristic value falls within a preset range. If the first feature value falls within the preset range, it is determined that the fingerprint image is from a real finger; if the first feature value falls outside the preset range, it is determined that the fingerprint image is from a fake finger. Alternatively, the controller 230 may only calculate the second characteristic value and determine whether the second characteristic value falls within a preset range. If the second feature value falls within the preset range, it is determined that the fingerprint image is from a real finger; if the second feature value falls outside the preset range, it is determined that the fingerprint image is from a fake finger.

在一實施例中,控制器230例如為中央處理單元(central processing unit, CPU)、微處理器(microprocessor)、數位訊號處理器(digital signal processor, DSP)、可程式化控制器、可程式化邏輯裝置(programmable logic device, PLD)或其他類似裝置或這些裝置的組合,本新型創作並不加以限制。此外,在一實施例中,控制器230的各功能可被實作為多個程式碼。這些程式碼會被儲存在一個記憶體中,由控制器230來執行這些程式碼。或者,在一實施例中,控制器230的各功能可被實作為一或多個電路。本新型創作並不限制用軟體或硬體的方式來實作控制器230的各功能。In one embodiment, the controller 230 is, for example, a central processing unit (CPU), a microprocessor (microprocessor), a digital signal processor (DSP), a programmable controller, and a programmable controller. Logic device (programmable logic device, PLD) or other similar devices or combinations of these devices are not restricted by the creation of this new model. In addition, in one embodiment, each function of the controller 230 can be implemented as a plurality of program codes. These codes are stored in a memory, and the controller 230 executes these codes. Alternatively, in an embodiment, each function of the controller 230 may be implemented as one or more circuits. The present invention does not limit the use of software or hardware to implement the functions of the controller 230.

綜上所述,在本新型創作的實施例的屏下式指紋感測裝置中,控制器對指紋影像的兩個方向不同的軸線上的灰階值與一哈爾特徵作內積,及/或計算指紋影像的中心區域的灰階平均值及在中心區域兩側的二個周邊區域的各自的灰階平均值,並藉此判斷指紋影像是來自真手指或假手指。因此,本新型創作的實施例的屏下式指紋感測裝置在指紋感測上可以達到防欺騙的效果,進而提升使用者的個人資料的安全性。To sum up, in the under-screen fingerprint sensing device of the inventive embodiment of the present invention, the controller makes the inner product of the grayscale values on the two axes of the fingerprint image in different directions and a Haar feature, and/ Or calculate the average gray level of the central area of the fingerprint image and the respective average gray levels of the two peripheral areas on both sides of the central area, and determine whether the fingerprint image comes from a real finger or a fake finger. Therefore, the under-screen fingerprint sensing device of the inventive embodiment of the present invention can achieve the effect of anti-spoofing in fingerprint sensing, thereby improving the security of the user's personal data.

50:手指 60、62、64、82、84:照明光 70、72、74:訊號光 100:電子裝置 105:顯示器 112:有機發光二極體顯示面板 114:相位延遲膜 116:線偏振片 120:玻璃蓋 122:上表面 200:屏下式指紋感測裝置 210:影像感測器 220:鏡頭 230:控制器 C1:中間區域 C2、C3:兩側區域 D2:中心區域 D1、D3:周邊區域 F1、F2:預設區域 K0:偏振方向 K1:第一偏振方向 K2:第二偏振方向 L1、L2:軸線 50: finger 60, 62, 64, 82, 84: Illumination light 70, 72, 74: signal light 100: electronic device 105: display 112: organic light-emitting diode display panel 114: Phase retardation film 116: Linear polarizer 120: glass cover 122: upper surface 200: Under-screen fingerprint sensor 210: image sensor 220: lens 230: Controller C1: Middle area C2, C3: Areas on both sides D2: Central area D1, D3: surrounding area F1, F2: preset area K0: Polarization direction K1: first polarization direction K2: second polarization direction L1, L2: axis

圖1為本新型創作的一實施例的電子裝置的剖面示意圖。 圖2A繪示圖1中具有P偏振方向的照明光被手指反射的情形。 圖2B繪示圖1中具有S偏振方向的照明光被手指反射的情形。 圖3為圖1的手指與玻璃蓋的界面對照明光的反射率及穿透率相對於入射此界面的入射角的分佈曲線。 圖4A為圖1的影像感測器所感測到的指紋影像與其所接收到的P偏振光與S偏振光的區域對照圖。 圖4B為圖1的影像感測器感測到假手指的指紋影像。 圖5A為圖1的影像感測器所感測到的真手指的指紋影像於對角線M-N上的平均灰階分佈圖。 圖5B為圖1的影像感測器所感測到的假手指的指紋影像於對角線M-N上的平均灰階分佈圖。 圖6為圖1中的控制器處理指紋影像的示意圖。 圖7為圖1中的控制器處理指紋影像的另一示意圖。 圖8為圖1中的控制器處理指紋影像的第一特徵值與第二特徵值的示意圖。 FIG. 1 is a schematic cross-sectional view of an electronic device according to an embodiment of the new creation. FIG. 2A illustrates a situation in which the illumination light with the P polarization direction in FIG. 1 is reflected by a finger. FIG. 2B illustrates a situation in which the illumination light with the S polarization direction in FIG. 1 is reflected by the finger. 3 is a distribution curve of the reflectance and transmittance of the illuminating light at the interface of the finger and the glass cover of FIG. 1 with respect to the incident angle of the interface. 4A is a comparison diagram of the fingerprint image sensed by the image sensor of FIG. 1 and the area of the P-polarized light and S-polarized light it receives. FIG. 4B shows the fingerprint image of the fake finger detected by the image sensor of FIG. 1. FIG. 5A is an average gray scale distribution diagram of a fingerprint image of a real finger sensed by the image sensor of FIG. 1 on a diagonal line M-N. FIG. 5B is an average gray scale distribution diagram of the fingerprint image of the fake finger sensed by the image sensor of FIG. 1 on the diagonal line M-N. FIG. 6 is a schematic diagram of the controller in FIG. 1 processing fingerprint images. FIG. 7 is another schematic diagram of the controller in FIG. 1 processing fingerprint images. FIG. 8 is a schematic diagram of the controller in FIG. 1 processing the first characteristic value and the second characteristic value of the fingerprint image.

50:手指 50: finger

60:照明光 60: Illumination light

70:訊號光 70: Signal Light

100:電子裝置 100: electronic device

105:顯示器 105: display

112:有機發光二極體顯示面板 112: organic light-emitting diode display panel

114:相位延遲膜 114: Phase retardation film

116:線偏振片 116: Linear polarizer

120:玻璃蓋 120: glass cover

122:上表面 122: upper surface

200:屏下式指紋感測裝置 200: Under-screen fingerprint sensor

210:影像感測器 210: image sensor

220:鏡頭 220: lens

230:控制器 230: Controller

K0:偏振方向 K0: Polarization direction

Claims (20)

一種屏下式指紋感測裝置,用以與一顯示器搭配,該顯示器發出一照明光,該照明光傳遞至按壓於該顯示器上的一手指,該手指將該照明光反射成攜帶該手指的指紋資訊的一訊號光,該屏下式指紋感測裝置包括: 一影像感測器,配置於該顯示器下方,其中該訊號光穿透該顯示器而在該影像感測器上形成一指紋影像;以及 一控制器,電性連接至該影像感測器,處理該影像感測器所感測到的指紋影像,對該指紋影像的兩個方向不同的軸線上的灰階值與一哈爾特徵作內積,並藉此判斷該指紋影像是來自真手指或假手指。 An under-screen fingerprint sensing device for matching with a display, the display emits an illuminating light, the illuminating light is transmitted to a finger pressed on the display, and the finger reflects the illuminating light into a fingerprint carrying the finger A signal light of information, the under-screen fingerprint sensing device includes: An image sensor disposed under the display, wherein the signal light penetrates the display to form a fingerprint image on the image sensor; and A controller, electrically connected to the image sensor, processes the fingerprint image sensed by the image sensor, and internalizes the grayscale values on the two axes of the fingerprint image in different directions and a Haar feature To determine whether the fingerprint image is from a real finger or a fake finger. 如請求項1所述的屏下式指紋感測裝置,其中該控制器先對該指紋影像作模糊化處理後,再對經模糊化的該指紋影像的兩個方向不同的軸線上的灰階值與該哈爾特徵作內積。The under-screen fingerprint sensing device according to claim 1, wherein the controller first performs a blurring process on the fingerprint image, and then calculates the gray scales on the two different axes of the blurred fingerprint image The inner product of the value and the Haar characteristic. 如請求項2所述的屏下式指紋感測裝置,其中該控制器將對應於兩個方向不同的軸線的兩個內積值相加,並判斷相加後的數值是否落在一預設範圍內,該控制器反應於該相加後的數值是落在該預設範圍內而判斷該指紋影像是來自真手指,且該控制器反應於該相加後的數值是落在該預設範圍外而判斷該指紋影像是來自假手指。The under-screen fingerprint sensing device according to claim 2, wherein the controller adds two inner product values corresponding to axes in two different directions, and determines whether the added value falls within a preset value Within the range, the controller reflects that the added value falls within the preset range and determines that the fingerprint image is from a real finger, and the controller reflects that the added value falls within the preset range Outside the range, it is determined that the fingerprint image is from a fake finger. 如請求項1所述的屏下式指紋感測裝置,其中該哈爾特徵為中間區域具有一第一數值而兩側區域具有一第二數值的函數,其中該第一數值大於該第二數值。The under-screen fingerprint sensing device according to claim 1, wherein the Haar feature is a function of a first value in the middle area and a second value in the areas on both sides, wherein the first value is greater than the second value . 如請求項1所述的屏下式指紋感測裝置,其中該顯示器包括: 一玻璃蓋,其中該手指按壓於該玻璃蓋上; 一線偏振片,配置於該玻璃蓋與該影像感測器之間; 一相位延遲膜,配置於該線偏振片與該影像感測器之間;以及 一有機發光二極體顯示面板,配置於該相位延遲膜與該影像感測器之間。 The under-screen fingerprint sensing device according to claim 1, wherein the display includes: A glass cover, wherein the finger presses on the glass cover; A linear polarizer arranged between the glass cover and the image sensor; A phase retardation film disposed between the linear polarizer and the image sensor; and An organic light emitting diode display panel is arranged between the phase retardation film and the image sensor. 如請求項1所述的屏下式指紋感測裝置,更包括一鏡頭,配置於該訊號光的路徑上,且位於該顯示器與該影像感測器之間。The under-screen fingerprint sensor according to claim 1, further comprising a lens arranged on the path of the signal light and located between the display and the image sensor. 一種屏下式指紋感測裝置,用以與一顯示器搭配,該顯示器發出一照明光,該照明光傳遞至按壓於該顯示器上的一手指,該手指將該照明光反射成攜帶該手指的指紋資訊的一訊號光,該屏下式指紋感測裝置包括: 一影像感測器,配置於該顯示器下方,其中該訊號光穿透該顯示器而在該影像感測器上形成一指紋影像;以及 一控制器,電性連接至該影像感測器,處理該影像感測器所感測到的指紋影像,計算該指紋影像的一中心區域的灰階平均值及在該中心區域兩側的二周邊區域的各自的灰階平均值,並藉此判斷該指紋影像是來自真手指或假手指。 An under-screen fingerprint sensing device for matching with a display, the display emits an illuminating light, the illuminating light is transmitted to a finger pressed on the display, and the finger reflects the illuminating light into a fingerprint carrying the finger A signal light of information, the under-screen fingerprint sensing device includes: An image sensor disposed under the display, wherein the signal light penetrates the display to form a fingerprint image on the image sensor; and A controller, electrically connected to the image sensor, processes the fingerprint image sensed by the image sensor, and calculates the average gray level of a central area of the fingerprint image and two peripheral edges on both sides of the central area The average value of the respective gray levels of the area, and by this, it can be judged whether the fingerprint image is from a real finger or a fake finger. 如請求項7所述的屏下式指紋感測裝置,其中該中心區域與該二周邊區域排列於該指紋影像的一對角線上。The under-screen fingerprint sensing device according to claim 7, wherein the central area and the two peripheral areas are arranged on a diagonal of the fingerprint image. 如請求項7所述的屏下式指紋感測裝置,其中該中心區域的灰階平均值為R2,該二周邊區域的灰階平均值分別為R1與R3,該控制器用以對R1、R2、R3作算術運算,以獲得一特徵值,並判斷該特徵值是否落在一預設範圍內,該控制器反應於該特徵值是落在該預設範圍內而判斷該指紋影像是來自真手指,且該控制器反應於該特徵值是落在該預設範圍外而判斷該指紋影像是來自假手指。The under-screen fingerprint sensing device according to claim 7, wherein the average gray level of the central area is R2, and the average gray levels of the two peripheral areas are R1 and R3, respectively, and the controller is used for comparing R1 and R2. , R3 performs arithmetic operations to obtain a feature value, and determines whether the feature value falls within a preset range, the controller responds that the feature value falls within the preset range and determines that the fingerprint image is from a true Finger, and the controller determines that the fingerprint image is from a fake finger in response to the characteristic value falling outside the preset range. 如請求項9所述的屏下式指紋感測裝置,其中該算術運算為(R2-R1)+(R2-R3),或者該算術運算為R2-R1-R3。The under-screen fingerprint sensing device according to claim 9, wherein the arithmetic operation is (R2-R1)+(R2-R3), or the arithmetic operation is R2-R1-R3. 如請求項7所述的屏下式指紋感測裝置,其中該顯示器包括: 一玻璃蓋,其中該手指按壓於該玻璃蓋上; 一線偏振片,配置於該玻璃蓋與該影像感測器之間; 一相位延遲膜,配置於該線偏振片與該影像感測器之間;以及 一有機發光二極體顯示面板,配置於該相位延遲膜與該影像感測器之間。 The under-screen fingerprint sensing device according to claim 7, wherein the display includes: A glass cover, wherein the finger presses on the glass cover; A linear polarizer arranged between the glass cover and the image sensor; A phase retardation film disposed between the linear polarizer and the image sensor; and An organic light emitting diode display panel is arranged between the phase retardation film and the image sensor. 如請求項7所述的屏下式指紋感測裝置,更包括一鏡頭,配置於該訊號光的路徑上,且位於該顯示器與該影像感測器之間。The under-screen fingerprint sensing device according to claim 7, further comprising a lens arranged on the path of the signal light and located between the display and the image sensor. 一種屏下式指紋感測裝置,用以與一顯示器搭配,該顯示器發出一照明光,該照明光傳遞至按壓於該顯示器上的一手指,該手指將該照明光反射成攜帶該手指的指紋資訊的一訊號光,該屏下式指紋感測裝置包括: 一影像感測器,配置於該顯示器下方,其中該訊號光穿透該顯示器而在該影像感測器上形成一指紋影像;以及 一控制器,電性連接至該影像感測器,處理該影像感測器所感測到的指紋影像,對該指紋影像的兩個方向不同的軸線上的灰階值與一哈爾特徵作內積,以獲得一第一結果,該控制器用以計算該指紋影像的一中心區域的灰階平均值及在該中心區域兩側的二周邊區域的各自的灰階平均值,以獲得一第二結果,且該控制器用以綜合該第一結果與該第二結果來判斷該指紋影像是來自真手指或假手指。 An under-screen fingerprint sensing device for matching with a display, the display emits an illuminating light, the illuminating light is transmitted to a finger pressed on the display, and the finger reflects the illuminating light into a fingerprint carrying the finger A signal light of information, the under-screen fingerprint sensing device includes: An image sensor disposed under the display, wherein the signal light penetrates the display to form a fingerprint image on the image sensor; and A controller, electrically connected to the image sensor, processes the fingerprint image sensed by the image sensor, and internalizes the grayscale values on the two axes of the fingerprint image in different directions and a Haar feature To obtain a first result. The controller is used to calculate the average gray level of a central area of the fingerprint image and the average gray levels of the two peripheral areas on both sides of the central area to obtain a second As a result, the controller is used to synthesize the first result and the second result to determine whether the fingerprint image is from a real finger or a fake finger. 如請求項13所述的屏下式指紋感測裝置,其中該控制器用以先對該指紋影像作模糊化處理後,再對經模糊化的該指紋影像的兩個方向不同的軸線上的灰階值與該哈爾特徵作內積。The under-screen fingerprint sensing device according to claim 13, wherein the controller is used to first blur the fingerprint image, and then perform the blurring of the gray on the two different axes of the blurred fingerprint image. The order value is the inner product of the Haar characteristic. 如請求項14所述的屏下式指紋感測裝置,其中該控制器將對應於兩個方向不同的軸線的兩個內積值相加,以獲得一第一特徵值,該中心區域的灰階平均值為R2,該二周邊區域的灰階平均值分別為R1與R3,該控制器用以對R1、R2、R3作算術運算,以獲得一第二特徵值,該控制器用以判斷該第一特徵值與該第二特徵值所形成的一二維座標是否落在一預設區域內,該控制器反應於該二維座標是落在該預設區域內而判斷該指紋影像是來自真手指,且該控制器反應於該二維座標是落在該預設區域外而判斷該指紋影像是來自假手指。The under-screen fingerprint sensing device according to claim 14, wherein the controller adds two inner product values corresponding to axes in two different directions to obtain a first characteristic value, and the gray in the central area The average value of the order is R2, and the average values of the gray levels of the two peripheral areas are R1 and R3 respectively. The controller is used to perform arithmetic operations on R1, R2, and R3 to obtain a second characteristic value. The controller is used to determine the first characteristic value. Whether a two-dimensional coordinate formed by a feature value and the second feature value falls within a preset area, the controller responds to whether the two-dimensional coordinate falls within the preset area and determines that the fingerprint image is from a real Finger, and the controller determines that the fingerprint image is from a fake finger in response to the two-dimensional coordinates falling outside the predetermined area. 如請求項15所述的屏下式指紋感測裝置,其中該哈爾特徵為中間區域具有一第一數值而兩側區域具有一第二數值的函數,其中該第一數值大於該第二數值。The under-screen fingerprint sensing device according to claim 15, wherein the Haar feature is a function in which the middle area has a first value and the side areas have a second value, wherein the first value is greater than the second value . 如請求項15所述的屏下式指紋感測裝置,其中該算術運算為(R2-R1)+(R2-R3),或者該算術運算為R2-R1-R3。The under-screen fingerprint sensing device according to claim 15, wherein the arithmetic operation is (R2-R1)+(R2-R3), or the arithmetic operation is R2-R1-R3. 如請求項13所述的屏下式指紋感測裝置,其中該中心區域與該二周邊區域排列於該指紋影像的一對角線上。The under-screen fingerprint sensing device according to claim 13, wherein the central area and the two peripheral areas are arranged on a diagonal of the fingerprint image. 如請求項13所述的屏下式指紋感測裝置,其中該顯示器包括: 一玻璃蓋,其中該手指按壓於該玻璃蓋上; 一線偏振片,配置於該玻璃蓋與該影像感測器之間; 一相位延遲膜,配置於該線偏振片與該影像感測器之間;以及 一有機發光二極體顯示面板,配置於該相位延遲膜與該影像感測器之間。 The under-screen fingerprint sensing device according to claim 13, wherein the display includes: A glass cover, wherein the finger presses on the glass cover; A linear polarizer arranged between the glass cover and the image sensor; A phase retardation film disposed between the linear polarizer and the image sensor; and An organic light emitting diode display panel is arranged between the phase retardation film and the image sensor. 如請求項13所述的屏下式指紋感測裝置,更包括一鏡頭,配置於該訊號光的路徑上,且位於該顯示器與該影像感測器之間。The under-screen fingerprint sensing device according to claim 13, further comprising a lens arranged on the path of the signal light and located between the display and the image sensor.
TW109215752U 2020-06-05 2020-11-30 Under-screen fingerprint sensing device TWM608710U (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202063035003P 2020-06-05 2020-06-05
US63/035,003 2020-06-05
US202063035841P 2020-06-08 2020-06-08
US63/035,841 2020-06-08

Publications (1)

Publication Number Publication Date
TWM608710U true TWM608710U (en) 2021-03-01

Family

ID=74426035

Family Applications (2)

Application Number Title Priority Date Filing Date
TW109141947A TWI762053B (en) 2020-06-05 2020-11-30 Under-screen fingerprint sensing device
TW109215752U TWM608710U (en) 2020-06-05 2020-11-30 Under-screen fingerprint sensing device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
TW109141947A TWI762053B (en) 2020-06-05 2020-11-30 Under-screen fingerprint sensing device

Country Status (3)

Country Link
CN (1) CN112287903A (en)
TW (2) TWI762053B (en)
WO (1) WO2021243986A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI762053B (en) * 2020-06-05 2022-04-21 神盾股份有限公司 Under-screen fingerprint sensing device

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200719242A (en) * 2005-11-03 2007-05-16 Wison Technology Corp Method of determining fingerprint of living body
US8090163B2 (en) * 2006-10-10 2012-01-03 West Virginia University Research Corp. Multi-resolutional texture analysis fingerprint liveness systems and methods
CN101789075B (en) * 2010-01-26 2012-09-26 哈尔滨工程大学 Finger vein identifying method based on characteristic value normalization and bidirectional weighting
CN102446268A (en) * 2010-09-30 2012-05-09 神盾股份有限公司 Fingerprint anti-counterfeit device and method thereof
WO2014039732A2 (en) * 2012-09-05 2014-03-13 Element, Inc. System and method for biometric authentication in connection with camera-equipped devices
TWI519993B (en) * 2013-12-17 2016-02-01 神盾股份有限公司 Fake finger discrimination device and method
US9639765B2 (en) * 2014-09-05 2017-05-02 Qualcomm Incorporated Multi-stage liveness determination
CN104794440B (en) * 2015-04-15 2018-03-13 杭州景联文科技有限公司 A kind of false fingerprint detection method based on the multiple dimensioned LBP of more piecemeals
CN108304759A (en) * 2017-01-11 2018-07-20 神盾股份有限公司 Identify the method and electronic device of finger
TWM570473U (en) * 2018-07-03 2018-11-21 金佶科技股份有限公司 Image capturing module
CN109740575A (en) * 2019-01-30 2019-05-10 北京一维大成科技有限公司 A kind of method, apparatus of authentication, computer-readable medium and equipment
CN110334694B (en) * 2019-07-18 2023-05-09 上海菲戈恩微电子科技有限公司 Under-screen optical fingerprint anti-attack method based on polarized light
WO2021072768A1 (en) * 2019-10-18 2021-04-22 深圳市汇顶科技股份有限公司 Fingerprint recognition device and electronic apparatus
TWI762053B (en) * 2020-06-05 2022-04-21 神盾股份有限公司 Under-screen fingerprint sensing device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI762053B (en) * 2020-06-05 2022-04-21 神盾股份有限公司 Under-screen fingerprint sensing device

Also Published As

Publication number Publication date
TW202147170A (en) 2021-12-16
TWI762053B (en) 2022-04-21
WO2021243986A1 (en) 2021-12-09
CN112287903A (en) 2021-01-29

Similar Documents

Publication Publication Date Title
CN109325400B (en) Display and electronic device for identifying fingerprint
WO2020063111A1 (en) Print detection method and apparatus, print image compensation method and apparatus, and electronic apparatus
US10116868B2 (en) Display-integrated user-classification, security and fingerprint system
US20180349721A1 (en) Biometric object spoof detection based on image intensity variations
US20190102594A1 (en) Fingerprint acquisition method and electronic device thereof
EP3514727A2 (en) Sensor and electronic apparatus for fingerprint recognition
TWI470478B (en) Virtual keyboard of an electronic device and a data inputting method therefor
CN110364551A (en) Display panel and fingerprint sensing system including it
JP3231956U (en) Integrated spectrum sensing device for judging the real finger
CN114450727A (en) Anti-spoofing of transparent false object coverage with optical sensing module
TW201727536A (en) Reflective fingerprint identification system
TWI762053B (en) Under-screen fingerprint sensing device
WO2019062274A1 (en) Surface texture identification sensor, surface texture identification device and surface texture identification method thereof, and display device
US9377900B1 (en) Optical touch sensor
WO2020124792A1 (en) Fingerprint identification display panel and fingerprint identification method
TWI767285B (en) Fingerprint identification device, electronic device for identificating fingerprint image and fingerprint identification method
JP6861835B2 (en) Touch panel device
TW202244699A (en) Integrating optical fingerprinting into a front-facing smartphone camera
US20210357611A1 (en) Electronic device having fingerprint sensing function and fingerprint sensing method
US11423687B2 (en) Electronic device including point detector and biometric information obtaining method using the same
TWI803870B (en) Fingerprint imaging device and fingerprint imaging method
TWI658411B (en) Non-directional finger palm print recognition method and non-directional finger palm print data establishment method
TW201812247A (en) Tapping detecting device, tapping detecting method and smart projecting system using the same
WO2021003877A1 (en) Display apparatus and electronic device
Lee et al. 42‐5: Spoof Detection Scheme for Optical Fingerprint Sensors under the Display