WO2020077490A1 - 生物特征识别方法、装置和电子设备 - Google Patents
生物特征识别方法、装置和电子设备 Download PDFInfo
- Publication number
- WO2020077490A1 WO2020077490A1 PCT/CN2018/110230 CN2018110230W WO2020077490A1 WO 2020077490 A1 WO2020077490 A1 WO 2020077490A1 CN 2018110230 W CN2018110230 W CN 2018110230W WO 2020077490 A1 WO2020077490 A1 WO 2020077490A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- optical sensor
- scanning area
- exposure time
- scanning
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
- G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
Definitions
- the present application relates to the field of biometric identification, and more specifically, to a biometric identification method, device, and electronic device.
- biometrics technology is gaining more and more attention, and more convenient off-screen biometrics technology, such as liquid crystal display (Liquid Crystal) Display, LCD)
- liquid crystal display Liquid Crystal
- LCD liquid crystal display
- Under-screen optical fingerprint technology uses infrared lamps for supplementary light based on the characteristics of strong infrared light penetration and invisibility.
- the application scenarios of mobile communication devices are very rich. They will follow users in high temperature, low temperature, outdoor and other scenes, especially in outdoor scenes with strong sunlight. For example, in summer, the intensity can reach 120,000 lux. Sunlight contains a large number of infrared wavelengths. In a scene with strong sunlight, the optical sensor may not work properly due to strong infrared light, which affects the optical fingerprint recognition.
- the present application provides a biometrics recognition method, device and electronic equipment, which can implement biometrics recognition under strong infrared light scenes based on the under-screen optical fingerprint technology.
- a biometric identification method including:
- the light supplementing method of the optical sensor when performing biometric identification is determined.
- the biometric feature may be a fingerprint.
- the first exposure time is shorter to achieve the purpose of quickly collecting the first optical signal, thereby improving the user experience.
- the biometric identification method can be applied to a strong sunlight environment.
- the biometrics recognition method provided by the embodiments of the present application, it is possible to determine the light supplementing method of the optical sensor when performing biometrics recognition based on the optical signals collected in multiple scanning areas in a short exposure time, so that it can be Based on the optical signal, different fill light modes can be flexibly selected. Furthermore, the problem that the strong infrared light causes the optical sensor to be overexposed and cannot work normally is avoided.
- the method further includes:
- the multiple scanning areas are configured, and each of the multiple scanning areas corresponds to multiple pixel points of the optical sensor.
- the scanning area can be flexibly configured, and at the same time, the optical sensor also supports the fast scanning function.
- the multiple scanning areas equally divide the photosensitive surface of the optical sensor.
- the multiple scanning areas are equally divided into the photosensitive surfaces of the optical sensor, it is easier to determine the fill light when the optical sensor performs biometric recognition based on the optical signals collected in the multiple scanning areas, respectively the way.
- the multiple scanning areas are arranged on the photosensitive surface of the optical sensor in a checkerboard form.
- the method further includes: configuring the first exposure time.
- the first exposure time can be flexibly configured, so that the first exposure time can be made short enough to meet the requirement of quickly scanning to acquire the first optical signal.
- the first threshold is 10 milliseconds.
- the fill-in light mode includes external strong light-fill light and infrared fill-in light source fill light.
- the method further includes:
- the optical sensor When the optical sensor collects the first light signal within the first exposure time, the optical sensor is configured to turn on the exposure and turn off the infrared fill light source.
- determining the light supplementing method of the optical sensor when performing biometric recognition according to the first light signals collected in the multiple scanning areas includes:
- the first scanning area is determined according to the first light intensity of each scanning area, and the first scanning area is the brightest scanning area among the plurality of scanning areas at the first light intensity;
- the light supplementing method of the optical sensor when performing biometric identification is determined.
- each scanning area corresponds to multiple pixels, and each pixel collects a first optical signal, and the first optical signals collected by multiple pixels are averaged, that is, the first light of each scanning area Strong.
- the scanning area A corresponds to 25 pixels, and each pixel collects an optical signal X.
- the 25 optical signals X collected by the 25 pixels are averaged to obtain the light intensity Y of the scanning area A.
- the method before averaging the first optical signals collected in each of the multiple scanning areas, the method further includes:
- the first optical signal collected in each scanning area is subjected to dead spot processing.
- a dead pixel can be understood as a pixel point where the collected first optical signal is abnormal.
- the processing for removing bad spots is to remove the first light signals collected by some pixel points with abnormal light signal collection in each scanning area, and these mean spots are not considered when taking the average.
- the scanning area A corresponds to 25 pixels, and each pixel collects an optical signal X. Among them, if the optical signal X collected by pixel 3, pixel 5, and pixel 12 is abnormal, pixels 3 and pixels are excluded. The 22 light signals X collected at the 22 pixel points other than the point 5 and the pixel point 12 are averaged to obtain the light intensity Y of the scanning area A.
- the pixel 3 when the optical signal X collected by the pixel 3, the pixel 5 and the pixel 12 is significantly different from the optical signal X collected by the surrounding pixels, the pixel 3, the pixel 5 and the pixel 12 can be considered The collected optical signal X is abnormal.
- the method further includes:
- the brightest scanning area is newly determined among the scanning areas other than the first scanning area among the plurality of scanning areas.
- the first scanning area is located at the edge of the photosensitive surface of the optical sensor, it can be determined that the finger is not pressed fully or strong light is incident through the edge. At this time, the brightest scanning area cannot be used to determine the external light Strong (ambient light intensity).
- the determining the light supplementing method of the optical sensor when performing biometric recognition according to the first light intensity of the first scanning area includes:
- T represents the second exposure time
- Vm represents the target light intensity in the linear region
- Vn represents the first light intensity in the brightest scanning area
- Dk represents the reference light intensity of the optical sensor
- the optical sensor uses external strong light for supplementary light when performing biometric recognition, or
- the optical sensor uses an infrared fill light source for fill light when performing biometric recognition.
- Vm and Dk are known parameters.
- the method further includes:
- the second exposure time is determined as the exposure time of the optical sensor when performing biometric identification.
- the method further includes:
- the optical sensor is configured to obtain an optical signal carrying biometric information within the second exposure time using an external strong light supplement.
- the method further includes:
- the third exposure time for biometrics recognition by the optical sensor is determined.
- the method before averaging the second optical signals collected in each scanning area of the plurality of scanning areas, the method further includes:
- the second optical signal collected in each scanning area is subjected to dead spot processing.
- the method further includes:
- the brightest scanning area is newly determined among the scanning areas other than the second scanning area among the plurality of scanning areas.
- the determining the third exposure time for the optical sensor to perform biometric identification according to the light intensity of the second scanning area includes:
- T ′ represents the third exposure time
- Vm represents the target light intensity in the linear region
- Vn ′ represents the second light intensity in the brightest scanning area
- Dk represents the reference light intensity of the optical sensor
- the infrared fill light source works with a DC driving mode, and when performing fill light, the infrared fill light source is driven based on the maximum current.
- the method further includes:
- the optical sensor is configured to obtain an optical signal carrying biometric information within the third exposure time by using an infrared fill light source fill light mode.
- the exposure time of the optical sensor when performing biometrics recognition can also be determined based on the optical signals respectively collected in multiple scanning areas within a short exposure time. Based on the optical signal, the exposure time is accurately determined, and further, the biometrics recognition efficiency is increased.
- a biometric identification device including:
- An acquiring unit configured to acquire first optical signals respectively collected by the optical sensor in a plurality of scanning areas within a first exposure time, and the first exposure time is less than a first threshold;
- the processing unit is configured to determine the light supplementing mode of the optical sensor when performing biometric identification according to the first optical signals collected in the multiple scanning areas.
- the processing unit is further configured to configure the multiple scanning areas, and each of the multiple scanning areas corresponds to multiple pixel points of the optical sensor.
- the multiple scanning areas equally divide the photosensitive surface of the optical sensor.
- the multiple scanning areas are arranged on the photosensitive surface of the optical sensor in a checkerboard form.
- the processing unit is further configured to configure the first exposure time.
- the first threshold is 10 milliseconds.
- the fill-in light mode includes external strong light-fill light and infrared fill-in light source fill light.
- the processing unit is further configured to configure the optical sensor to turn on the exposure and turn off the infrared fill light source when the optical sensor collects the first light signal within the first exposure time.
- the processing unit is specifically used to:
- the first scanning area is determined according to the first light intensity of each scanning area, and the first scanning area is the brightest scanning area among the plurality of scanning areas at the first light intensity;
- the light supplementing method of the optical sensor when performing biometric identification is determined.
- the processing unit before averaging the first optical signals collected in each scanning area of the plurality of scanning areas, is further configured to divide the first optical signals collected in each scanning area The optical signal is processed to remove dead pixels.
- the processing unit is also used to:
- the brightest scanning area is newly determined among the scanning areas other than the first scanning area among the plurality of scanning areas.
- the processing unit is specifically used to:
- T represents the second exposure time
- Vm represents the target light intensity in the linear region
- Vn represents the first light intensity in the brightest scanning area
- Dk represents the reference light intensity of the optical sensor
- the optical sensor uses external strong light for supplementary light when performing biometric recognition, or
- the optical sensor uses an infrared fill light source for fill light when performing biometric recognition.
- the processing unit is further configured to determine the second exposure time as the exposure time of the optical sensor when performing biometric identification.
- the processing unit is further configured to configure the optical sensor to obtain an optical signal carrying biometric information within the second exposure time by using external strong light supplement.
- the processing unit is further configured to:
- the third exposure time for biometrics recognition by the optical sensor is determined.
- the processing unit before averaging the second optical signals collected in each scanning area of the plurality of scanning areas, the processing unit is further used to collect the second light signals collected in each scanning area The optical signal is processed to remove dead pixels.
- the processing unit is also used to:
- the brightest scanning area is newly determined among the scanning areas other than the second scanning area among the plurality of scanning areas.
- the processing unit is specifically used to:
- T ′ represents the third exposure time
- Vm represents the target light intensity in the linear region
- Vn ′ represents the second light intensity in the brightest scanning area
- Dk represents the reference light intensity of the optical sensor
- the infrared fill light source works with a DC driving mode, and when performing fill light, the infrared fill light source is driven based on the maximum current.
- the processing unit is further configured to configure the optical sensor to use an infrared fill light source fill light mode to acquire an optical signal carrying biometric information within the third exposure time.
- an electronic device including:
- Optical sensors used to obtain optical signals
- An infrared fill light source for infrared fill light to the optical sensor for infrared fill light to the optical sensor
- the controller includes a memory for storing programs and data and a processor for calling and running the programs and data stored in the memory, and the controller is configured to:
- a biometric identification device including:
- Optical sensors used to obtain optical signals carrying biometric information
- An optical filter is used to filter infrared light except the first wavelength band before the optical sensor acquires an optical signal carrying biometric information.
- biometric identification device can be applied to a strong sunlight environment.
- the sensitivity of the optical sensor in the first waveband is greater than the sensitivity of other wavebands.
- the first band is the 940 nm band.
- the optical sensor uses an infrared fill light source for fill light.
- the biometric recognition device is applied to face recognition or fingerprint recognition.
- a chip includes an input-output interface, at least one processor, at least one memory, and a bus.
- the at least one memory is used to store instructions, and the at least one processor is used to call the at least one memory. Instructions to perform the method in the first aspect or any possible implementation manner of the first aspect.
- an electronic device including the chip as in the fifth aspect.
- a computer storage medium stores program code, and the program code may be used to instruct to execute the method in the first aspect or any possible implementation manner thereof.
- a computer program product containing instructions which when executed on a computer, causes the computer to execute the method in the first aspect or any possible implementation manner thereof.
- the biometric recognition solution provided in the embodiments of the present application can determine the light supplement method and exposure of the optical sensor when performing biometric recognition based on the optical signals collected in multiple scanning areas within a short exposure time Time, so that you can flexibly select the fill light method based on the optical signal, and accurately determine the exposure time, thereby avoiding the problem of strong infrared light caused by the optical sensor overexposure and not working properly, and increasing the efficiency of biometric recognition.
- FIG. 1 is a schematic diagram of an application scenario according to an embodiment of the present application.
- FIG. 2 is a schematic flowchart of a biometrics recognition method according to an embodiment of the present application.
- FIG. 3 is a schematic diagram of multiple scanning areas according to an embodiment of the present application.
- FIG. 4 is a flowchart of biometric recognition according to an embodiment of the present application.
- FIG. 5 is a schematic block diagram of a biometric identification device according to an embodiment of the present application.
- FIG. 6 is a schematic block diagram of an electronic device according to an embodiment of the present application.
- FIG. 7 is a schematic block diagram of another apparatus for biometric identification according to an embodiment of the present application.
- embodiments of the present application may be applied to fingerprint systems, including but not limited to optical, ultrasonic or other fingerprint recognition systems and medical diagnostic products based on optical, ultrasonic or other fingerprint imaging, and the embodiments of the present application only take optical fingerprint systems as examples The description will be made, but it should not constitute any limitation to the embodiments of the present application.
- the embodiments of the present application are also applicable to other systems that use optical, ultrasonic, or other imaging technologies.
- biometric identification in addition to fingerprint identification, the technical solutions of the embodiments of the present application may also perform other biometric identification, such as living body identification, etc., which are not limited in the embodiments of the present application.
- the optical fingerprint system provided by the embodiments of the present application can be applied to smartphones, tablet computers, and other mobile terminals or other terminal devices with display screens; more specifically, in the above terminal devices, fingerprint collection
- the device may be specifically an optical fingerprint device, which may be provided in a partial area or all areas below the display screen, thereby forming an under-display optical fingerprint system.
- the terminal device 100 includes a display screen 120 and an optical fingerprint device 130, where the optical fingerprint device 130 is disposed in a partial area below the display screen 120 .
- the optical fingerprint device 130 includes a sensing array having a plurality of optical sensing units.
- the area where the sensing array is located is a fingerprint detection area 103 of the optical fingerprint device 130.
- the fingerprint detection area 103 is located in the display area 102 of the display screen 120. Therefore, when the user needs to unlock the terminal device or other fingerprint verification, he only needs to press his finger on the The fingerprint detection area 103 of the display screen 120 can realize fingerprint input.
- the terminal device 100 adopting the above structure does not need a special reserved space on the front to set fingerprint keys (such as the Home key), so a full screen solution can be adopted, that is, the display area of the display screen 120 This basically extends to the entire front of the terminal device 100.
- the display screen 120 may be a liquid crystal display (Liquid Crystal Display, LCD) or other passive light-emitting display screen.
- LCD Liquid Crystal Display
- the display screen 120 may specifically be a touch screen display, which can not only display images, but also detect a user's touch or press operation, thereby providing the user with a human-computer interaction interface.
- the terminal device 100 may include a touch sensor, and the touch sensor may specifically be a touch panel (Touch Panel, TP), which may be provided on the surface of the display screen 120, or may be partially integrated Or the whole is integrated into the display screen 120 to form the touch display screen.
- Touch Panel Touch Panel
- the terminal device 100 further includes a transparent protective cover, which may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the front of the terminal device 100 .
- a transparent protective cover which may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the front of the terminal device 100 .
- the so-called finger pressing on the display screen 120 actually means pressing on the cover plate above the display screen 120 or covering the surface of the protective layer of the cover plate.
- the optical fingerprint device 130 includes at least one light detection portion 134 and a plurality of optical components 132, the light detection portion 134 includes the sensing array and is electrically connected to the sensing array
- the reading circuit and other auxiliary circuits can be fabricated on a chip through a semiconductor process; the optical component 132 can be disposed above the sensing array of the light detecting portion 134, which can specifically include a filter layer (Filter ), A light guide layer and other optical components, the filter layer can be used to filter out ambient light penetrating the finger, and the light guide layer is mainly used to guide the reflected light reflected from the finger surface to the sensing array for optical Detection.
- the multiple optical components 132 and the at least one light detection portion 134 may be packaged in the same optical fingerprint chip.
- the light guide layer may be specifically a lens layer made of a semiconductor silicon wafer, which has a plurality of lens units.
- the terminal device 100 further includes an infrared fill light source 140.
- the infrared fill light source 140 may be, for example, an infrared lamp for performing infrared fill light when the optical fingerprint device 130 is exposed. It should be understood that the position of the infrared fill light source 140 in FIG. 1 is only an example, and the infrared fill light source 140 may also be located in other positions, which is not limited in the embodiment of the present application.
- the optical sensor may also be referred to as an image sensor (Sensor) or a photoelectric sensor, which may be fabricated into a chip (DIE) after being processed by a semiconductor process, that is, the DIE includes an image sensor.
- Sensor image sensor
- DIE photoelectric sensor
- optical sensor in the embodiments of the present application may also be referred to as an optical fingerprint device, an optical fingerprint recognition module, a fingerprint device, a fingerprint recognition device, a fingerprint recognition module, a fingerprint module, a fingerprint collection device, and the like.
- biometric identification solution of the embodiments of the present application is applicable to the use of infrared fill-in optical fingerprint systems, including fingerprint access control, fingerprint punch card machines, off-screen fingerprint mobile phones, face recognition mobile phones, living body recognition mobile phones, computers, automobiles, etc. Under strong light, adjust the fill light mode, fill light intensity and exposure time to adapt to different environments.
- FIG. 2 is a schematic flowchart of a biometrics recognition method 200 according to an embodiment of the present application. As shown in FIG. 2, the method 200 includes:
- S220 according to the first optical signals respectively collected in the multiple scanning areas, determine the light supplementing method of the optical sensor when performing biometric identification.
- the method 200 can be applied to a strong sunlight environment.
- the method 200 may be performed by an electronic device.
- the method 200 may be performed by a controller (Host) in the electronic device (for example, a microprogrammed controller (Microprogrammed Control Unit, MCU) )) or a processor (for example, a central processing unit (Central Processing Unit, CPU)), the method 200 may also be executed by a controller or processor to control a specific software
- the electronic device may include an optical sensor
- the optical The sensor may correspond to the optical fingerprint device 130 in FIG. 1
- the method 200 may include a plurality of optical sensors, which may be used to realize fingerprint recognition on a large area.
- the method 200 is executed by the controller in the electronic device as an example for specific description.
- the first exposure time is shorter to achieve the purpose of quickly collecting the first optical signal, thereby improving the user experience.
- an appropriate fill-in light mode is selected so that most areas of the optical sensor work in a linear area, so that biometric information can be correctly collected.
- the controller may configure the multiple scanning areas, and each of the multiple scanning areas corresponds to multiple pixel points of the optical sensor.
- the controller can be configured with 5 * 5 scanning areas, and each scanning area corresponds to 10 * 10 pixels.
- the controller can flexibly configure the scanning area, and at the same time, the optical sensor also supports the fast scanning function.
- the multiple scanning areas equally divide the photosensitive surface of the optical sensor.
- the photosensitive surface of the optical sensor may be divided into a plurality of regular scanning areas.
- the photosensitive surface of the optical sensor is divided into a plurality of circular scanning areas.
- the photosensitive surface of the optical sensor is equally divided into a plurality of square scanning areas.
- the multiple scanning areas are arranged on the photosensitive surface of the optical sensor in a checkerboard form.
- the first optical signal may or may not carry biometric information.
- the controller may configure the first exposure time.
- the first exposure time can be flexibly configured, so that the first exposure time can be made short enough to meet the requirement of quickly scanning and acquiring the first optical signal.
- the first threshold is 10 milliseconds. That is, the first exposure time ⁇ 10 milliseconds.
- the fill-in light mode includes external strong light fill-in and infrared fill light source fill-in light.
- the controller when the optical sensor collects the first light signal within the first exposure time, the controller is configured to turn on the optical sensor exposure and turn off the infrared fill light source.
- controller when the controller is configured to turn on the exposure of the optical sensor and turn off the infrared fill light source, external strong light can fill the optical sensor.
- the controller may determine the light supplementing method of the optical sensor when performing biometric recognition according to the following manner:
- the first scanning area is determined according to the first light intensity of each scanning area, and the first scanning area is the brightest scanning area among the plurality of scanning areas at the first light intensity;
- the light supplementing method of the optical sensor when performing biometric identification is determined.
- each scanning area corresponds to multiple pixels, and each pixel collects a first optical signal, and the first optical signals collected by multiple pixels are averaged, that is, the first light of each scanning area Strong.
- the scanning area A corresponds to 25 pixels, and each pixel collects an optical signal X.
- the 25 optical signals X collected by the 25 pixels are averaged to obtain the light intensity Y of the scanning area A.
- the controller before averaging the first light signals collected in each scanning area of the plurality of scanning areas, divides the first light signals collected in each scanning area The signal is processed to remove dead pixels.
- a dead pixel can be understood as a pixel point where the collected first optical signal is abnormal.
- the processing for removing bad spots is to remove the first light signals collected by some pixel points with abnormal light signal collection in each scanning area, and these mean spots are not considered when taking the average.
- the scanning area A corresponds to 25 pixels, and each pixel collects an optical signal X. Among them, if the optical signal X collected by pixel 3, pixel 5, and pixel 12 is abnormal, pixels 3 and pixels are excluded. The 22 light signals X collected at the 22 pixel points other than the point 5 and the pixel point 12 are averaged to obtain the light intensity Y of the scanning area A.
- the pixel 3 when the optical signal X collected by the pixel 3, the pixel 5 and the pixel 12 is significantly different from the optical signal X collected by the surrounding pixels, the pixel 3, the pixel 5 and the pixel 12 can be considered The collected optical signal X is abnormal.
- the controller restarts in the scanning areas other than the first scanning area among the plurality of scanning areas Determine the brightest scanning area.
- the first scanning area when a part of the first scanning area that is greater than a certain threshold is located at the edge position of the photosensitive surface of the optical sensor, it can be determined that the first scanning area is located at the edge position of the photosensitive surface of the optical sensor.
- the first scanning area is located at the edge position of the photosensitive surface of the optical sensor, it can be determined that the finger is not fully pressed or strong light is incident through the edge. At this time, the brightest scanning area cannot be used to determine the external light intensity ( Ambient light intensity).
- the controller may determine the light supplementing method of the optical sensor when performing biometric recognition according to the following manner:
- the optical sensor uses external strong light for supplementary light when performing biometric recognition, or
- the optical sensor uses an infrared fill light source for fill light when performing biometric recognition.
- T represents the second exposure time
- Vm represents the target light intensity in the linear region
- Vn represents the first light intensity in the brightest scanning area
- Dk represents the reference light intensity of the optical sensor.
- Vm and Dk are known parameters.
- the controller determines the second exposure time as the exposure time of the optical sensor when performing biometric recognition.
- the controller determines the second exposure time as the exposure time when the optical sensor performs biometric recognition.
- the controller configures the optical sensor to obtain an optical signal carrying biometric information within the second exposure time by using an external strong light supplement.
- the controller may determine the exposure time when the infrared fill light source is used for fill light as follows:
- the third exposure time for biometrics recognition by the optical sensor is determined.
- the controller before averaging the second optical signals collected in each scanning area of the plurality of scanning areas, the controller performs dead pixel processing on the second optical signals collected in each scanning area .
- the controller restarts in the scanning areas other than the second scanning area among the plurality of scanning areas Determine the brightest scanning area.
- the second scanning area greater than a certain threshold when a part of the second scanning area greater than a certain threshold is located at the edge position of the photosensitive surface of the optical sensor, it can be determined that the second scanning area is located at the edge position of the photosensitive surface of the optical sensor.
- the controller may determine the third exposure time for the optical sensor to perform biometric identification according to the following manner:
- the third exposure time is determined according to Equation 2.
- T ′ represents the third exposure time
- Vm represents the target light intensity in the linear region
- Vn ′ represents the second light intensity in the brightest scanning area
- Dk represents the reference light intensity of the optical sensor.
- the infrared fill light source works in a DC driving mode, and when performing fill light, the infrared fill light source is driven based on the maximum current.
- the controller configures the optical sensor to use an infrared fill light source fill light method to acquire an optical signal carrying biometric information within the third exposure time.
- the biometrics identification party 300 may include the following steps:
- the first exposure time is less than a first threshold, for example, the first threshold is 10 milliseconds.
- S302 Configure a plurality of scanning areas.
- each of the multiple scanning areas corresponds to multiple pixel points of the optical sensor.
- the multiple scanning areas equally divide the photosensitive surface of the optical sensor.
- the multiple scanning areas are arranged on the photosensitive surface of the optical sensor in a checkerboard form.
- the first optical signals respectively collected by the optical sensor in the multiple scanning areas within the first exposure time are acquired.
- the optical sensor when acquiring the first light signal, is configured to turn on the exposure and turn off the infrared fill light source.
- the first scanning area (not shown in FIG. 4) can be determined by the following steps:
- S3041 Perform a dead spot processing on the first optical signal collected in each scanning area of the multiple scanning areas;
- S3043 Determine a first scanning area according to the first light intensity of each scanning area, where the first scanning area is the brightest scanning area among the plurality of scanning areas at the first light intensity.
- the first scanning area is the scanning area with the largest first light intensity among the plurality of scanning areas.
- the first scanning area is located at the edge position of the photosensitive surface of the optical sensor.
- the first scanning area when a part of the first scanning area that is greater than a certain threshold is located at the edge position of the photosensitive surface of the optical sensor, it can be determined that the first scanning area is located at the edge position of the photosensitive surface of the optical sensor.
- S306-S307 is executed, otherwise, S307 is executed.
- S306 Re-determine the brightest scanning area under the first light intensity.
- the brightest scanning area is newly determined in the scanning areas other than the first scanning area among the plurality of scanning areas.
- the second exposure time is determined according to the above formula 1.
- S308 Determine whether the second exposure time is greater than the second threshold.
- the optical sensor uses external strong light for supplementary light when performing biometric recognition.
- the infrared fill light source is used for fill light.
- the optical sensor uses an infrared fill light source for fill light when performing biometric recognition.
- the second optical signals respectively collected by the optical sensor in the multiple scanning areas within the first exposure time are acquired.
- the optical sensor exposure and the infrared fill light source fill light are configured to be turned on.
- the infrared fill light source works in a DC driving mode, and when performing fill light, the infrared fill light source is driven based on the maximum current.
- the second scanning area (not shown in FIG. 4) can be determined by the following steps:
- S3133 Determine a second scanning area according to the second light intensity of each scanning area, where the second scanning area is the brightest scanning area among the plurality of scanning areas at the second light intensity.
- the second scanning area is the scanning area with the second largest light intensity among the plurality of scanning areas.
- S314 Determine whether the second scanning area is located at an edge position.
- the second scanning area is located at the edge position of the photosensitive surface of the optical sensor.
- the second scanning area greater than a certain threshold when a part of the second scanning area greater than a certain threshold is located at the edge position of the photosensitive surface of the optical sensor, it can be determined that the second scanning area is located at the edge position of the photosensitive surface of the optical sensor.
- the brightest scanning area is newly determined in the scanning areas other than the second scanning area among the plurality of scanning areas.
- the third exposure time is the exposure time for the biometric recognition of the optical sensor when the infrared fill light source is used for fill light.
- the third exposure time is determined according to the above formula 2.
- S317 Collect an optical signal carrying biometric information.
- the optical sensor is configured to use an external strong light supplementary light method to acquire an optical signal carrying biometric information within the second exposure time.
- the optical sensor is configured to obtain an optical signal carrying biometric information within the third exposure time using an infrared fill light source fill light method.
- the biometrics recognition scheme provided by the embodiments of the present application can determine the fill-in light method and exposure time of the optical sensor when performing biometrics recognition based on the optical signals collected in multiple scanning areas in a short exposure time It can flexibly select the fill light method based on the optical signal and accurately determine the exposure time. In addition, it avoids the problem that the strong infrared light causes the optical sensor to overexposure and cannot work normally, and increases the efficiency of biometric recognition.
- FIG. 5 is a schematic block diagram of a biometric identification device 400 according to an embodiment of the present application. As shown in FIG. 5, the biometric identification device 400 includes:
- the obtaining unit 410 is configured to obtain first light signals respectively collected by the optical sensor in a plurality of scanning areas within a first exposure time, and the first exposure time is less than a first threshold;
- the processing unit 420 is configured to determine, according to the first optical signals respectively collected in the multiple scanning areas, the light supplement mode of the optical sensor when performing biometric identification.
- the processing unit 420 is further configured to configure the multiple scanning areas, and each scanning area in the multiple scanning areas corresponds to multiple pixel points of the optical sensor.
- the multiple scanning areas equally divide the photosensitive surface of the optical sensor.
- the multiple scanning areas are arranged on the photosensitive surface of the optical sensor in a checkerboard form.
- the processing unit 420 is further configured to configure the first exposure time.
- the first threshold is 10 milliseconds.
- the light supplement method includes external strong light supplement light and infrared fill light source light supplement.
- the processing unit 420 is further configured to configure to turn on the optical sensor exposure and turn off the infrared fill light source when the optical sensor collects the first light signal during the first exposure time.
- processing unit 420 is specifically used to:
- the first scanning area is determined according to the first light intensity of each scanning area, and the first scanning area is the brightest scanning area among the plurality of scanning areas at the first light intensity;
- the light supplementing method of the optical sensor when performing biometric identification is determined.
- the processing unit 420 is further configured to perform the first optical signals collected in each scanning area Remove dead pixels.
- processing unit 420 is also used to:
- the brightest scanning area is newly determined among the scanning areas other than the first scanning area among the plurality of scanning areas.
- processing unit 420 is specifically used to:
- T represents the second exposure time
- Vm represents the target light intensity in the linear region
- Vn represents the first light intensity in the brightest scanning area
- Dk represents the reference light intensity of the optical sensor
- the optical sensor uses external strong light for supplementary light when performing biometric recognition, or
- the optical sensor uses an infrared fill light source for fill light when performing biometric recognition.
- the processing unit 320 is further configured to determine the second exposure time as the exposure time of the optical sensor when performing biometric recognition.
- the processing unit 420 is further configured to configure the optical sensor to obtain an optical signal carrying biometric information within the second exposure time by using external strong light supplement.
- the processing unit 420 is further used to:
- a third exposure time for biometrics recognition by the optical sensor is determined.
- the processing unit 420 is further configured to perform the second optical signals collected in each scanning area Remove dead pixels.
- processing unit 420 is also used to:
- the brightest scanning area is newly determined among the scanning areas other than the second scanning area among the plurality of scanning areas.
- processing unit 420 is specifically used to:
- T ′ represents the third exposure time
- Vm represents the target light intensity in the linear region
- Vn ′ represents the second light intensity in the brightest scanning area
- Dk represents the reference light intensity of the optical sensor
- the infrared fill light source works in a DC driving mode, and when performing fill light, the infrared fill light source is driven based on the maximum current.
- the processing unit 420 is further configured to configure the optical sensor to obtain an optical signal carrying biometric information within the third exposure time by using an infrared fill light source fill light mode.
- FIG. 6 is a schematic block diagram of an electronic device 500 according to an embodiment of the present application. As shown in FIG. 6, the electronic device 500 includes:
- the optical sensor 510 is used to obtain an optical signal
- Infrared fill light source 520 for infrared fill light to the optical sensor
- the controller 530 includes a memory 531 for storing programs and data and a processor 532 for calling and running the programs and data stored in the memory, and the controller is configured to: execute the above-described FIGS. 2 to 4 The method shown.
- FIG. 7 is a schematic block diagram of a biometric identification device 600 according to an embodiment of the present application. As shown in FIG. 7, the biometric identification device 600 includes:
- the optical sensor 610 is used to obtain an optical signal carrying biometric information
- the optical filter 620 is used to filter infrared light except the first wavelength band before the optical sensor acquires the optical signal carrying biometric information.
- the sensitivity of the optical sensor in the first waveband is greater than the sensitivity of other wavebands.
- the first wavelength band is the 940 nm wavelength band.
- the infrared light intensity at the 940nm band is significantly weaker than the infrared light intensity at the band around the 940nm band (for example, 800nm-1000nm), that is, at the 940nm band, even if the surrounding In a strong sunlight environment, its influence on the infrared compensation of the optical sensor 610 is also weak, and the optical sensor 610 can still work in the linear region.
- biometrics collection in the 940nm band can achieve the effect of resisting the surrounding strong light.
- the biometric recognition device is applied to face recognition or fingerprint recognition.
- the optical sensor uses infrared fill light source for fill light.
- the biometric identification device 600 can be applied to a strong sunlight environment.
- the processor in the embodiments of the present application may be an integrated circuit chip, which has signal processing capabilities.
- each step of the foregoing method embodiment may be completed by an integrated logic circuit of hardware in a processor or instructions in the form of software.
- the above-mentioned processor may be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an existing programmable gate array (Field Programmable Gate Array, FPGA), or other available Programming logic devices, discrete gates or transistor logic devices, discrete hardware components.
- DSP Digital Signal Processor
- ASIC Application Specific Integrated Circuit
- FPGA Field Programmable Gate Array
- the methods, steps, and logical block diagrams disclosed in the embodiments of the present application may be implemented or executed.
- the general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
- the steps of the method disclosed in conjunction with the embodiments of the present application may be directly embodied and executed by a hardware decoding processor, or may be executed and completed by a combination of hardware and software modules in the decoding processor.
- the software module may be located in a mature storage medium in the art, such as a random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, and register.
- the storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
- the terminal or the electronic device in the embodiments of the present application may further include a memory
- the memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory.
- the non-volatile memory can be read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electronic Erasable programmable read only memory (Electrically EPROM, EEPROM) or flash memory.
- the volatile memory may be a random access memory (Random Access Memory, RAM), which is used as an external cache.
- RAM static random access memory
- DRAM dynamic random access memory
- DRAM synchronous dynamic random access memory
- SDRAM double data rate synchronous dynamic random access memory
- Double Data Rate SDRAM DDR SDRAM
- enhanced SDRAM ESDRAM
- Synchlink DRAM SLDRAM
- Direct Rambus RAM Direct Rambus RAM
- Embodiments of the present application also provide a computer-readable storage medium that stores one or more programs, the one or more programs include instructions, and when the instructions are included in a portable electronic device of multiple application programs When it is executed, the portable electronic device can perform the method of the embodiments shown in FIGS. 2 to 4.
- An embodiment of the present application also proposes a computer program including instructions.
- the computer program When the computer program is executed by a computer, the computer can execute the method of the embodiments shown in FIGS. 2 to 4.
- An embodiment of the present application further provides a chip including an input and output interface, at least one processor, at least one memory, and a bus, the at least one memory is used to store instructions, and the at least one processor is used to call the at least one memory To execute the method of the embodiment shown in FIG. 2 to FIG. 4.
- the disclosed system, device, and method may be implemented in other ways.
- the device embodiments described above are only schematic.
- the division of the units is only a division of logical functions.
- there may be other divisions for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.
- the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
- the function is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium.
- the technical solution of the present application can essentially be a part that contributes to the existing technology or a part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application.
- the foregoing storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks or optical disks and other media that can store program codes .
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Image Input (AREA)
Abstract
一种生物特征识别方法、装置和电子设备,可以基于屏下光学指纹技术,在强红外光场景下实现生物特征识别。该生物特征识别方法,包括:获取第一曝光时间内光学传感器在多个扫描区域内分别采集的第一光信号,该第一曝光时间小于第一阈值(S210);根据该多个扫描区域内分别采集的第一光信号,确定该光学传感器在进行生物特征识别时的补光方式(S220)。
Description
本申请涉及生物特征识别领域,并且更具体地,涉及一种生物特征识别方法、装置和电子设备。
随着电子设备行业的快速发展,尤其是移动通信设备(例如,手机)的高速发展,生物识别技术越来越受到人们重视,更加便捷的屏下生物特征识别技术,例如液晶显示屏(Liquid Crystal Display,LCD)屏下光学指纹识别技术的实用化已成为大众所需。
屏下光学指纹技术基于红外光穿透性强、不可见性的特性选用红外灯进行补光。移动通信设备的应用场景非常丰富,会跟随用户出现在高温、低温、户外等场景,特别是在户外场景中太阳光较强,例如,在夏日强度可以达到12万勒克斯(LUX),同时,在太阳光中含有大量的红外光波长。在太阳光较强的场景中,可能会由于强红外光导致光学传感器过曝而不能正常工作,影响了光学指纹识别。
因此,如何在强红外光场景下实现屏下光学指纹技术,成为一个亟待解决的技术问题。
发明内容
本申请提供一种生物特征识别方法、装置和电子设备,可以基于屏下光学指纹技术,在强红外光场景下实现生物特征识别。
第一方面,提供了一种生物特征识别方法,包括:
获取第一曝光时间内光学传感器在多个扫描区域内分别采集的第一光信号,该第一曝光时间小于第一阈值;
根据该多个扫描区域内分别采集的第一光信号,确定该光学传感器在进行生物特征识别时的补光方式。
可选地,生物特征可以是指纹。
需要说明的是,该第一曝光时间较短,以实现快速采集第一光信号的目的,从而,提升用户使用体验。
可选地,该生物特征识别方法可以应用于强太阳光环境。
因此,本申请实施例提供的生物特征识别方法中,可以基于较短的曝光时间内在多个扫描区域内分别采集的光信号,确定光学传感器在进行生物特征识别时的补光方式,从而,可以基于光信号,灵活选择不同的补光方式,进而,避免了强红外光导致光学传感器过曝而不能正常工作的问题。
在一些可能的实现方式中,该方法还包括:
配置该多个扫描区域,且该多个扫描区域中的每个扫描区域对应该光学传感器的多个像素点。
因此,在本申请实施例中,可以灵活配置扫描区域,同时,光学传感器也支持快速扫描功能。
在一些可能的实现方式中,该多个扫描区域均分该光学传感器的感光面。
需要说明的是,在该多个扫描区域均分该光学传感器的感光面时,可以更为容易的基于多个扫描区域内分别采集的光信号,确定光学传感器在进行生物特征识别时的补光方式。
在一些可能的实现方式中,该多个扫描区域以棋盘格形式布局于该光学传感器感光面上。
在一些可能的实现方式中,该方法还包括:配置该第一曝光时间。
因此,可以灵活配置第一曝光时间,从而可以使得第一曝光时间足够短,满足快速扫描获取第一光信号的要求。
在一些可能的实现方式中,该第一阈值为10毫秒。
在一些可能的实现方式中,该补光方式包括外部强光补光和红外补光光源补光。
在一些可能的实现方式中,该方法还包括:
在该光学传感器在该第一曝光时间内采集第一光信号时,配置开启该光学传感器曝光和关闭红外补光光源。
需要说明的是,在配置开启该光学传感器曝光和关闭红外补光光源时,外部强光可以对该光学传感器进行补光。
在一些可能的实现方式中,该根据该多个扫描区域内分别采集的第一光信号,确定该光学传感器在进行生物特征识别时的补光方式,包括:
将该多个扫描区域中每个扫描区域内所采集的第一光信号取平均,以得 到该每个扫描区域的第一光强;
根据该每个扫描区域的第一光强,确定第一扫描区域,该第一扫描区域为第一光强下该多个扫描区域中的最亮扫描区域;
根据该第一扫描区域的第一光强,确定该光学传感器在进行生物特征识别时的补光方式。
应理解,每个扫描区域对应多个像素点,每个像素点采集一个第一光信号,将多个像素点所采集的第一光信号取平均值,即为每个扫描区域的第一光强。
例如,扫描区域A对应25个像素点,每个像素点采集一个光信号X,将这25个像素点所采集的25个光信号X取平均值,即可得到扫描区域A的光强Y。
在一些可能的实现方式中,在将该多个扫描区域中每个扫描区域内所采集的第一光信号取平均之前,该方法还包括:
将该每个扫描区域内所采集的第一光信号进行去坏点处理。
坏点可以理解为是所采集的第一光信号异常的像素点。
需要说明的是,去坏点处理是将每个扫描区域内的一些光信号采集异常的像素点所采集的第一光信号去除,在取平均时,不考虑这些坏点。
例如,扫描区域A对应25个像素点,每个像素点采集一个光信号X,其中,像素点3、像素点5和像素点12所采集的光信号X异常,则将除像素点3、像素点5和像素点12之外的22个像素点所采集的22个光信号X取平均值,即可得到扫描区域A的光强Y。
应理解,在像素点3、像素点5和像素点12所采集的光信号X与周围像素点所采集的光信号X明显不同时,即可以认为像素点3、像素点5和像素点12所采集的光信号X异常。
在一些可能的实现方式中,该方法还包括:
若该第一扫描区域位于该光学传感器的感光面的边缘位置,在该多个扫描区域中除该第一扫描区域之外的扫描区域中重新确定最亮扫描区域。
可选地,若该第一扫描区域位于该光学传感器的感光面的边缘位置,则可以判断为是手指按压不全或是强光通过边缘射入,此时,无法通过最亮扫描区域判断外部光强(环境光强)。
在一些可能的实现方式中,该根据该第一扫描区域的第一光强,确定该 光学传感器在进行生物特征识别时的补光方式,包括:
若该第二曝光时间小于或者等于第二阈值,确定该光学传感器在进行生物特征识别时采用外部强光进行补光,或者
若该第二曝光时间大于第二阈值,确定该光学传感器在进行生物特征识别时采用红外补光光源进行补光。
应理解,Vm和Dk为已知参数。
在一些可能的实现方式中,若该第二曝光时间小于或者等于第二阈值,该方法还包括:
将该第二曝光时间确定为该光学传感器在进行生物特征识别时的曝光时间。
在一些可能的实现方式中,该方法还包括:
配置该光学传感器采用外部强光补光方式在该第二曝光时间内获取承载生物特征信息的光信号。
在一些可能的实现方式中,若该第二曝光时间大于第二阈值,该方法还包括:
配置开启该光学传感器曝光和红外补光光源补光;
获取该第一曝光时间内该光学传感器在该多个扫描区域内分别采集的第二光信号;
将该多个扫描区域中每个扫描区域内所采集的第二光信号取平均,以得到该每个扫描区域的第二光强;
根据该每个扫描区域的第二光强,确定第二扫描区域,该第二扫描区域为第二光强下该多个扫描区域中的最亮扫描区域;
根据该第二扫描区域的第二光强,确定用于该光学传感器进行生物特征识别的第三曝光时间。
在一些可能的实现方式中,在将该多个扫描区域中每个扫描区域内所采集的第二光信号取平均之前,该方法还包括:
将该每个扫描区域内所采集的第二光信号进行去坏点处理。
在一些可能的实现方式中,该方法还包括:
若该第二扫描区域位于该光学传感器的感光面的边缘位置,在该多个扫描区域中除该第二扫描区域之外的扫描区域中重新确定最亮扫描区域。
在一些可能的实现方式中,该根据该第二扫描区域的光强,确定用于该光学传感器进行生物特征识别的第三曝光时间,包括:
在一些可能的实现方式中,该红外补光光源采用直流驱动方式进行工作,以及在进行补光时,该红外补光光源基于最大电流驱动。
在一些可能的实现方式中,该方法还包括:
配置该光学传感器采用红外补光光源补光方式在该第三曝光时间内获取承载生物特征信息的光信号。
因此,本申请实施例提供的生物特征识别方法中,还可以基于较短的曝光时间内在多个扫描区域内分别采集的光信号,确定光学传感器在进行生物特征识别时的曝光时间,从而,可以基于光信号,准确确定曝光时间,进而,增加了生物特征识别效率。
第二方面,提供了一种生物特征识别装置,包括:
获取单元,用于获取第一曝光时间内光学传感器在多个扫描区域内分别采集的第一光信号,该第一曝光时间小于第一阈值;
处理单元,用于根据该多个扫描区域内分别采集的第一光信号,确定该光学传感器在进行生物特征识别时的补光方式。
在一些可能的实现方式中,该处理单元还用于配置该多个扫描区域,且该多个扫描区域中的每个扫描区域对应该光学传感器的多个像素点。
在一些可能的实现方式中,该多个扫描区域均分该光学传感器的感光面。
在一些可能的实现方式中,该多个扫描区域以棋盘格形式布局于该光学传感器感光面上。
在一些可能的实现方式中,该处理单元还用于配置该第一曝光时间。
在一些可能的实现方式中,该第一阈值为10毫秒。
在一些可能的实现方式中,该补光方式包括外部强光补光和红外补光光源补光。
在一些可能的实现方式中,该处理单元还用于在该光学传感器在该第一曝光时间内采集第一光信号时,配置开启该光学传感器曝光和关闭红外补光光源。
在一些可能的实现方式中,该处理单元具体用于:
将该多个扫描区域中每个扫描区域内所采集的第一光信号取平均,以得到该每个扫描区域的第一光强;
根据该每个扫描区域的第一光强,确定第一扫描区域,该第一扫描区域为第一光强下该多个扫描区域中的最亮扫描区域;
根据该第一扫描区域的第一光强,确定该光学传感器在进行生物特征识别时的补光方式。
在一些可能的实现方式中,在将该多个扫描区域中每个扫描区域内所采集的第一光信号取平均之前,该处理单元还用于将该每个扫描区域内所采集的第一光信号进行去坏点处理。
在一些可能的实现方式中,该处理单元还用于:
若该第一扫描区域位于该光学传感器的感光面的边缘位置,在该多个扫描区域中除该第一扫描区域之外的扫描区域中重新确定最亮扫描区域。
在一些可能的实现方式中,该处理单元具体用于:
若该第二曝光时间小于或者等于第二阈值,确定该光学传感器在进行生物特征识别时采用外部强光进行补光,或者
若该第二曝光时间大于第二阈值,确定该光学传感器在进行生物特征识别时采用红外补光光源进行补光。
在一些可能的实现方式中,若该第二曝光时间小于或者等于第二阈值,该处理单元还用于将该第二曝光时间确定为该光学传感器在进行生物特征识别时的曝光时间。
在一些可能的实现方式中,该处理单元还用于配置该光学传感器采用外部强光补光方式在该第二曝光时间内获取承载生物特征信息的光信号。
在一些可能的实现方式中,若该第二曝光时间大于第二阈值,该处理单元还用于:
配置开启该光学传感器曝光和红外补光光源补光;
控制该获取单元获取该第一曝光时间内该光学传感器在该多个扫描区域内分别采集的第二光信号;
将该多个扫描区域中每个扫描区域内所采集的第二光信号取平均,以得到该每个扫描区域的第二光强;
根据该每个扫描区域的第二光强,确定第二扫描区域,该第二扫描区域为第二光强下该多个扫描区域中的最亮扫描区域;
根据该第二扫描区域的第二光强,确定用于该光学传感器进行生物特征识别的第三曝光时间。
在一些可能的实现方式中,在将该多个扫描区域中每个扫描区域内所采集的第二光信号取平均之前,该处理单元还用于将该每个扫描区域内所采集的第二光信号进行去坏点处理。
在一些可能的实现方式中,该处理单元还用于:
若该第二扫描区域位于该光学传感器的感光面的边缘位置,在该多个扫描区域中除该第二扫描区域之外的扫描区域中重新确定最亮扫描区域。
在一些可能的实现方式中,该处理单元具体用于:
在一些可能的实现方式中,该红外补光光源采用直流驱动方式进行工作,以及在进行补光时,该红外补光光源基于最大电流驱动。
在一些可能的实现方式中,该处理单元还用于配置该光学传感器采用红外补光光源补光方式在该第三曝光时间内获取承载生物特征信息的光信号。
第三方面,提供了一种电子设备,包括:
光学传感器,用于获取光信号;
红外补光光源,用于对所述光学传感器进行红外补光;以及
控制器,包括用于存储程序和数据的存储器和用于调用并运行所述存储器中存储的程序和数据的处理器,所述控制器被配置为:
执行上述第一方面或其任意可能的实现方式中的方法。
第四方面,提供了一种生物特征识别装置,包括:
光学传感器,用于获取承载生物特征信息的光信号;
光学滤波片,用于在该光学传感器获取承载生物特征信息的光信号之前过滤除第一波段之外的红外光。
需要说明的是,该生物特征识别装置可以应用于强太阳光环境。
在一些可能的实现方式中,该光学传感器在该第一波段的灵敏度大于其他波段的灵敏度。
在一些可能的实现方式中,该第一波段为940nm波段。
在一些可能的实现方式中,该光学传感器采用红外补光光源进行补光。
在一些可能的实现方式中,该生物特征识别装置应用于人脸识别或指纹识别。
第五方面,提供了一种芯片,该芯片包括输入输出接口、至少一个处理器、至少一个存储器和总线,该至少一个存储器用于存储指令,该至少一个处理器用于调用该至少一个存储器中的指令,以执行第一方面或第一方面的任一可能的实现方式中的方法。
第六方面,提供了一种电子设备,包括如第五方面中的芯片。
第七方面,提供了一种计算机存储介质,该计算机存储介质中存储有程序代码,该程序代码可以用于指示执行上述第一方面或其任意可能的实现方式中的方法。
第八方面,提供了一种包含指令的计算机程序产品,其在计算机上运行时,使得计算机执行上述第一方面或其任意可能的实现方式中的方法。
基于上述技术方案,本申请实施例提供的生物特征识别方案,可以基于较短的曝光时间内在多个扫描区域内分别采集的光信号,确定光学传感器在进行生物特征识别时的补光方式和曝光时间,从而,可以基于光信号,灵活选取补光方式,以及准确确定曝光时间,进而,避免了强红外光导致光学传感器过曝而不能正常工作的问题,且增加了生物特征识别效率。
图1是本申请实施例的一种应用场景的示意图。
图2是根据本申请实施例的生物特征识别方法的示意性流程图。
图3是根据本申请实施例的多个扫描区域的示意图。
图4是根据本申请实施例的生物特征识别的流程图。
图5是根据本申请实施例的一种生物特征识别装置的示意性框图。
图6是根据本申请实施例的一种电子设备的示意性框图。
图7是根据本申请实施例的另一种生物特征识别装置的示意性框图。
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚地描述。
应理解,本申请实施例可以应用于指纹系统,包括但不限于光学、超声波或其他指纹识别系统和基于光学、超声波或其他指纹成像的医疗诊断产品,本申请实施例仅以光学指纹系统为例进行说明,但不应对本申请实施例构成任何限定,本申请实施例同样适用于其他采用光学、超声波或其他成像技术的系统等。
还应理解,本申请实施例的技术方案除了可以进行指纹识别外,还可以进行其他生物特征识别,例如,活体识别等,本申请实施例对此也不限定。
作为一种常见的应用场景,本申请实施例提供的光学指纹系统可以应用在智能手机、平板电脑以及其他具有显示屏的移动终端或者其他终端设备;更具体地,在上述终端设备中,指纹采集装置可以具体为光学指纹装置,其可以设置在显示屏下方的局部区域或者全部区域,从而形成屏下(Under-display)光学指纹系统。
如图1所示为本申请实施例可以适用的终端设备的结构示意图,该终端设备100包括显示屏120和光学指纹装置130,其中,该光学指纹装置130设置在该显示屏120下方的局部区域。该光学指纹装置130包括具有多个光学感应单元的感应阵列,该感应阵列所在区域为该光学指纹装置130的指纹检测区域103。如图1所示,该指纹检测区域103位于该显示屏120的显示区域102之中,因此,使用者在需要对该终端设备进行解锁或者其他指纹验证的时候,只需要将手指按压在位于该显示屏120的指纹检测区域103,便可以实现指纹输入。由于指纹检测可以在屏内实现,因此采用上述结构的终端设备100无需其正面专门预留空间来设置指纹按键(比如Home键),因而可以采用全面屏方案,即该显示屏120的显示区域可以基本扩展到该终端设备100的整个正面。
该显示屏120可以为液晶显示屏(Liquid Crystal Display,LCD)或者其他被动发光显示屏。
可选地,该显示屏120具体可以为触控显示屏,其不仅可以进行画面显示,还可以检测用户的触摸或者按压操作,从而为用户提供一个人机交互界面。比如,在一种实施例中,该终端设备100可以包括触摸传感器,所述触摸传感器可以具体为触控面板(Touch Panel,TP),其可以设置在所述显示屏120表面,也可以部分集成或者整体集成到所述显示屏120内部,从而形成所述触控显示屏。
应当理解的是,在具体实现上,该终端设备100还包括透明保护盖板,该盖板可以为玻璃盖板或者蓝宝石盖板,其位于该显示屏120的上方并覆盖该终端设备100的正面。因为,本申请实施例中,所谓的手指按压在该显示屏120实际上是指按压在该显示屏120上方的盖板或者覆盖该盖板的保护层表面。
作为一种可选的实现方式,如图1所示,该光学指纹装置130包括至少一个光检测部分134和多个光学组件132,该光检测部分134包括该感应阵列以及与该感应阵列电连接的读取电路及其他辅助电路,其可以在通过半导体工艺制作在一个芯片(Die);该光学组件132可以设置在该光检测部分134的感应阵列的上方,其可以具体包括滤光层(Filter)、导光层以及其他光学元件,该滤光层可以用于滤除穿透手指的环境光,而该导光层主要用于从手指表面反射回来的反射光导引至该感应阵列进行光学检测。
在具体实现上,该多个光学组件132可以与该至少一个光检测部分134封装在同一个光学指纹芯片。其中,该导光层可以具体为在半导体硅片制作而成的透镜(Lens)层,其具有多个透镜单元。当手指按压在所述显示屏120的指纹检测区域103时,光源发出的光信号在手指表面发生反射并形成反射光,从手指反射回来的反射光经该透镜单元,并被其下方的光学感应单元接收,据此,该感应阵列可以检测出手指的指纹图像。
可选地,如图1所示,该终端设备100还包括红外补光光源140,该红外补光光源140例如可以是红外灯,用于在该光学指纹装置130曝光时进行红外补光。应理解,图1中红外补光光源140所处位置仅仅只是示例,该红外补光光源140还可以位于其他位置,本申请实施例对此不作限定。
应理解,在本申请实施例中,光学传感器也可以称之为图像传感器(Sensor),或光电传感器,经半导体工艺加工处理可以制作成一个芯片(DIE),即DIE包括图像传感器。
还应理解,本申请实施例中的光学传感器也可以称为光学指纹装置、光学指纹识别模组、指纹装置、指纹识别装置、指纹识别模组、指纹模组、指纹采集装置等。
还应理解,本申请实施例生物特征识别方案适用利用红外补光光学指纹系统,包括指纹门禁、指纹打卡机、屏下指纹手机、人脸识别手机、活体识别手机、电脑、汽车等领域,在强光下通过调整补光方式、补光强度、曝光时间以适应不同环境。
图2是根据本申请实施例的生物特征识别方法200的示意性流程图,如图2所示,该方法200包括:
S210,获取第一曝光时间内光学传感器在多个扫描区域内分别采集的第一光信号,该第一曝光时间小于第一阈值;
S220,根据该多个扫描区域内分别采集的第一光信号,确定该光学传感器在进行生物特征识别时的补光方式。
可选地,该方法200可以应用于强太阳光环境。
应理解,在本申请实施例中,该方法200可以由电子设备执行,具体地,该方法200可以由该电子设备中的控制器(Host)(例如,微程序控制器(Microprogrammed Control Unit,MCU))或者处理器(例如,中央处理器(Central Processing Unit,CPU))执行,该方法200还可以是由控制器或者处理器控制一具体的软件执行,该电子设备可以包括光学传感器,该光学传感器可以对应于图1中的光学指纹装置130,在该方法200中可以包括多个光学传感器,可以用于实现大面积的指纹识别。
以下,以该方法200由该电子设备中的控制器执行为例进行具体说明。
需要说明的是,该第一曝光时间较短,以实现快速采集第一光信号的目的,从而,提升用户使用体验。
在本申请实施例中,选择合适的补光方式,使得光学传感器的大部分区域工作在线性区域,从而,可以正确采集生物特征信息。
可选地,在一些实施例中,该控制器可以配置该多个扫描区域,且该多个扫描区域中的每个扫描区域对应该光学传感器的多个像素点。
例如,该控制器可以配置5*5个扫描区域,每个扫描区域对应10*10个像素点。
也就是说,在本申请实施例中,该控制器可以灵活配置扫描区域,同时, 光学传感器也支持快速扫描功能。
需要说明的是,仅读取该多个扫描区域内的第一光信号,避免了读取整个光学传感器上的第一光信号,从而,可以提高读取传感器的速率,以及处理第一光信号的速率,进而,提高确定补光方式的效率。
可选地,该多个扫描区域均分该光学传感器的感光面。具体地,可以是将该光学传感器的感光面均分为多个规则的扫描区域。例如,将该光学传感器的感光面均分为多个圆形的扫描区域。又例如,将该光学传感器的感光面均分为多个正方形的扫描区域。
又例如,如图3所示,该多个扫描区域以棋盘格形式布局于该光学传感器感光面上。
需要说明的是,第一光信号可以承载生物特征信息,也可以不承载生物特征信息。
应理解,在该多个扫描区域均分该光学传感器的感光面时,可以更为容易的基于多个扫描区域内分别采集的光信号,确定光学传感器在进行生物特征识别时的补光方式。
可选地,在一些实施例中,该控制器可以配置该第一曝光时间。
换句话说,可以灵活配置第一曝光时间,从而可以使得第一曝光时间足够短,以满足快速扫描并获取第一光信号的要求。
可选地,在一些实施例中,该第一阈值为10毫秒。即,该第一曝光时间≤10毫秒。
可选地,在一些实施例中,该补光方式包括外部强光补光和红外补光光源补光。
可选地,在一些实施例中,在该光学传感器在该第一曝光时间内采集第一光信号时,该控制器配置开启该光学传感器曝光和关闭红外补光光源。
需要说明的是,在控制器配置开启该光学传感器曝光和关闭红外补光光源时,外部强光可以对该光学传感器进行补光。
具体地,在本申请实施例中,该控制器可以根据如下方式确定该光学传感器在进行生物特征识别时的补光方式:
将该多个扫描区域中每个扫描区域内所采集的第一光信号取平均,以得到该每个扫描区域的第一光强;
根据该每个扫描区域的第一光强,确定第一扫描区域,该第一扫描区域 为第一光强下该多个扫描区域中的最亮扫描区域;
根据该第一扫描区域的第一光强,确定该光学传感器在进行生物特征识别时的补光方式。
应理解,每个扫描区域对应多个像素点,每个像素点采集一个第一光信号,将多个像素点所采集的第一光信号取平均值,即为每个扫描区域的第一光强。
例如,扫描区域A对应25个像素点,每个像素点采集一个光信号X,将这25个像素点所采集的25个光信号X取平均值,即可得到扫描区域A的光强Y。
可选地,在一些实施例中,在将该多个扫描区域中每个扫描区域内所采集的第一光信号取平均之前,该控制器将该每个扫描区域内所采集的第一光信号进行去坏点处理。
坏点可以理解为是所采集的第一光信号异常的像素点。
需要说明的是,去坏点处理是将每个扫描区域内的一些光信号采集异常的像素点所采集的第一光信号去除,在取平均时,不考虑这些坏点。
例如,扫描区域A对应25个像素点,每个像素点采集一个光信号X,其中,像素点3、像素点5和像素点12所采集的光信号X异常,则将除像素点3、像素点5和像素点12之外的22个像素点所采集的22个光信号X取平均值,即可得到扫描区域A的光强Y。
应理解,在像素点3、像素点5和像素点12所采集的光信号X与周围像素点所采集的光信号X明显不同时,即可以认为像素点3、像素点5和像素点12所采集的光信号X异常。
可选地,在一些实施例中,若该第一扫描区域位于该光学传感器的感光面的边缘位置,该控制器在该多个扫描区域中除该第一扫描区域之外的扫描区域中重新确定最亮扫描区域。
可选地,在该第一扫描区域中大于一定阈值的部分位于该光学传感器的感光面的边缘位置时,即可判断该第一扫描区域位于该光学传感器的感光面的边缘位置。
应理解,若该第一扫描区域位于该光学传感器的感光面的边缘位置,则可以判断为是手指按压不全或是强光通过边缘入射,此时,无法通过最亮扫描区域判断外部光强(环境光强)。
具体地,在本申请实施例中,该控制器可以根据如下方式确定该光学传感器在进行生物特征识别时的补光方式:
根据公式1确定第二曝光时间;
若该第二曝光时间小于或者等于第二阈值,确定该光学传感器在进行生物特征识别时采用外部强光进行补光,或者
若该第二曝光时间大于第二阈值,确定该光学传感器在进行生物特征识别时采用红外补光光源进行补光。
其中,T表示第二曝光时间,Vm表示线性区的目标光强,Vn表示最亮扫描区域的第一光强,Dk表示光学传感器的基准光强。
应理解,Vm和Dk为已知参数。
可选地,在一些实施例中,若该第二曝光时间小于或者等于第二阈值,该控制器将该第二曝光时间确定为该光学传感器在进行生物特征识别时的曝光时间。
即在确定该光学传感器在进行生物特征识别时采用外部强光进行补光时,该控制器将该第二曝光时间确定为该光学传感器在进行生物特征识别时的曝光时间。
可选地,在一些实施例中,该控制器配置该光学传感器采用外部强光补光方式在该第二曝光时间内获取承载生物特征信息的光信号。
可选地,在一些实施例中,若该第二曝光时间大于第二阈值,该控制器可以根据如下方式确定采用红外补光光源补光时的曝光时间:
配置开启该光学传感器曝光和红外补光光源补光;
获取该第一曝光时间内该光学传感器在该多个扫描区域内分别采集的第二光信号;
将该多个扫描区域中每个扫描区域内所采集的第二光信号取平均,以得到该每个扫描区域的第二光强;
根据该每个扫描区域的第二光强,确定第二扫描区域,该第二扫描区域为第二光强下该多个扫描区域中的最亮扫描区域;
根据该第二扫描区域的第二光强,确定用于该光学传感器进行生物特征识别的第三曝光时间。
可选地,该控制器在将该多个扫描区域中每个扫描区域内所采集的第二 光信号取平均之前,将该每个扫描区域内所采集的第二光信号进行去坏点处理。
可选地,在一些实施例中,若该第二扫描区域位于该光学传感器的感光面的边缘位置,该控制器在该多个扫描区域中除该第二扫描区域之外的扫描区域中重新确定最亮扫描区域。
可选地,在该第二扫描区域中大于一定阈值的部分位于该光学传感器的感光面的边缘位置时,即可判断该第二扫描区域位于该光学传感器的感光面的边缘位置。
具体地,在本申请实施例中,该控制器可以根据如下方式确定用于该光学传感器进行生物特征识别的第三曝光时间:
根据公式2确定第三曝光时间。
其中,T′表示第三曝光时间,Vm表示线性区的目标光强,Vn′表示最亮扫描区域的第二光强,Dk表示光学传感器的基准光强。
可选地,在一些实施例中,该红外补光光源采用直流驱动方式进行工作,以及在进行补光时,该红外补光光源基于最大电流驱动。
可选地,在一些实施例中,该控制器配置该光学传感器采用红外补光光源补光方式在该第三曝光时间内获取承载生物特征信息的光信号。
可选地,可以作为一个实施例,如图4所示,该生物特征识别方300可以包括如下步骤:
S301,配置第一曝光时间。
可选地,该第一曝光时间小于第一阈值,例如,该第一阈值为10毫秒。
S302,配置多个扫描区域。
需要说明的是,该多个扫描区域中的每个扫描区域对应该光学传感器的多个像素点。
可选地,该多个扫描区域均分该光学传感器的感光面。
例如,该多个扫描区域以棋盘格形式布局于该光学传感器感光面上。
S303,获取第一光信号。
具体地,获取第一曝光时间内光学传感器在多个扫描区域内分别采集的第一光信号。
需要说明的是,在获取第一光信号时,配置开启该光学传感器曝光和关 闭红外补光光源。
S304,确定第一扫描区域。
具体地,可以通过如下步骤确定该第一扫描区域(图4中未示出):
S3041,将该多个扫描区域中每个扫描区域内所采集的第一光信号进行去坏点处理;
S3042,将该多个扫描区域中每个扫描区域内所采集的第一光信号取平均,以得到该每个扫描区域的第一光强;
S3043,根据该每个扫描区域的第一光强,确定第一扫描区域,该第一扫描区域为第一光强下该多个扫描区域中的最亮扫描区域。
需要说明的是,该第一扫描区域为该多个扫描区域中第一光强最大的扫描区域。
S305,判断该第一扫描区域是否位于边缘位置。
具体地,判断该第一扫描区域是否位于该光学传感器的感光面的边缘位置。
可选地,在该第一扫描区域中大于一定阈值的部分位于该光学传感器的感光面的边缘位置时,即可判断该第一扫描区域位于该光学传感器的感光面的边缘位置。
若该第一扫描区域位于边缘位置,则执行S306-S307,否则,执行S307。
S306,重新确定第一光强下的最亮扫描区域。
具体地,在该多个扫描区域中除该第一扫描区域之外的扫描区域中重新确定最亮扫描区域。
S307,确定第二曝光时间。
具体地,根据上述公式1确定该第二曝光时间。
S308,判断第二曝光时间是否大于第二阈值。
若该第二曝光时间小于或者等于第二阈值,执行S309-S310;若该第二曝光时间大于第二阈值,执行S311-S316。
S309,采用外部强光进行补光。
具体地,该光学传感器在进行生物特征识别时采用外部强光进行补光。
S310,将第二曝光时间确定为光学传感器在进行生物特征识别时的曝光时间。
S311,采用红外补光光源进行补光。
具体地,该光学传感器在进行生物特征识别时采用红外补光光源进行补光。
S312,获取第二光信号。
具体地,获取第一曝光时间内光学传感器在多个扫描区域内分别采集的第二光信号。
需要说明的是,在获取第二光信号时,配置开启光学传感器曝光和红外补光光源补光。
可选地,该红外补光光源采用直流驱动方式进行工作,以及在进行补光时,该红外补光光源基于最大电流驱动。
S313,确定第二扫描区域。
具体地,可以通过如下步骤确定该第二扫描区域(图4中未示出):
S3131,将该多个扫描区域中每个扫描区域内所采集的第二光信号进行去坏点处理;
S3132,将该多个扫描区域中每个扫描区域内所采集的第二光信号取平均,以得到该每个扫描区域的第二光强;
S3133,根据该每个扫描区域的第二光强,确定第二扫描区域,该第二扫描区域为第二光强下该多个扫描区域中的最亮扫描区域。
需要说明的是,该第二扫描区域为该多个扫描区域中第二光强最大的扫描区域。
S314,判断该第二扫描区域是否位于边缘位置。
具体地,判断该第二扫描区域是否位于该光学传感器的感光面的边缘位置。
可选地,在该第二扫描区域中大于一定阈值的部分位于该光学传感器的感光面的边缘位置时,即可判断该第二扫描区域位于该光学传感器的感光面的边缘位置。
若该第二扫描区域位于边缘位置,则执行S315-S316,否则,执行S316。
S315,重新确定第二光强下的最亮扫描区域。
具体地,在该多个扫描区域中除该第二扫描区域之外的扫描区域中重新确定最亮扫描区域。
S316,确定第三曝光时间。
需要说明的是,该第三曝光时间为采用红外补光光源进行补光时,该光 学传感器进行生物特征识别的曝光时间。
具体地,根据上述公式2确定该第三曝光时间。
S317,采集承载生物特征信息的光信号。
可选地,若执行步骤S310,则配置该光学传感器采用外部强光补光方式在该第二曝光时间内获取承载生物特征信息的光信号。
可选地,若执行步骤S316,则配置该光学传感器采用红外补光光源补光方式在该第三曝光时间内获取承载生物特征信息的光信号。
因此,本申请实施例提供的生物特征识别方案,可以基于较短的曝光时间内在多个扫描区域内分别采集的光信号,确定光学传感器在进行生物特征识别时的补光方式和曝光时间,从而,可以基于光信号,灵活选取补光方式,以及准确确定曝光时间,进而,避免了强红外光导致光学传感器过曝而不能正常工作的问题,且增加了生物特征识别效率。
图5是根据本申请实施例的生物特征识别装置400的示意性框图,如图5所示,该生物特征识别装置400包括:
获取单元410,用于获取第一曝光时间内光学传感器在多个扫描区域内分别采集的第一光信号,该第一曝光时间小于第一阈值;
处理单元420,用于根据该多个扫描区域内分别采集的第一光信号,确定该光学传感器在进行生物特征识别时的补光方式。
可选地,该处理单元420还用于配置该多个扫描区域,且该多个扫描区域中的每个扫描区域对应该光学传感器的多个像素点。
可选地,该多个扫描区域均分该光学传感器的感光面。
可选地,该多个扫描区域以棋盘格形式布局于该光学传感器感光面上。
可选地,该处理单元420还用于配置该第一曝光时间。
可选地,该第一阈值为10毫秒。
可选地,该补光方式包括外部强光补光和红外补光光源补光。
可选地,该处理单元420还用于在该光学传感器在该第一曝光时间内采集第一光信号时,配置开启该光学传感器曝光和关闭红外补光光源。
可选地,该处理单元420具体用于:
将该多个扫描区域中每个扫描区域内所采集的第一光信号取平均,以得到该每个扫描区域的第一光强;
根据该每个扫描区域的第一光强,确定第一扫描区域,该第一扫描区域 为第一光强下该多个扫描区域中的最亮扫描区域;
根据该第一扫描区域的第一光强,确定该光学传感器在进行生物特征识别时的补光方式。
可选地,在将该多个扫描区域中每个扫描区域内所采集的第一光信号取平均之前,该处理单元420还用于将该每个扫描区域内所采集的第一光信号进行去坏点处理。
可选地,该处理单元420还用于:
若该第一扫描区域位于该光学传感器的感光面的边缘位置,在该多个扫描区域中除该第一扫描区域之外的扫描区域中重新确定最亮扫描区域。
可选地,该处理单元420具体用于:
若该第二曝光时间小于或者等于第二阈值,确定该光学传感器在进行生物特征识别时采用外部强光进行补光,或者
若该第二曝光时间大于第二阈值,确定该光学传感器在进行生物特征识别时采用红外补光光源进行补光。
可选地,若该第二曝光时间小于或者等于第二阈值,该处理单元320还用于将该第二曝光时间确定为该光学传感器在进行生物特征识别时的曝光时间。
可选地,该处理单元420还用于配置该光学传感器采用外部强光补光方式在该第二曝光时间内获取承载生物特征信息的光信号。
可选地,若该第二曝光时间大于第二阈值,该处理单元420还用于:
配置开启该光学传感器曝光和红外补光光源补光;
控制该获取单元410获取该第一曝光时间内该光学传感器在该多个扫描区域内分别采集的第二光信号;
将该多个扫描区域中每个扫描区域内所采集的第二光信号取平均,以得到该每个扫描区域的第二光强;
根据该每个扫描区域的第二光强,确定第二扫描区域,该第二扫描区域为第二光强下该多个扫描区域中的最亮扫描区域;
根据该第二扫描区域的第二光强,确定用于该光学传感器进行生物特征 识别的第三曝光时间。
可选地,在将该多个扫描区域中每个扫描区域内所采集的第二光信号取平均之前,该处理单元420还用于将该每个扫描区域内所采集的第二光信号进行去坏点处理。
可选地,该处理单元420还用于:
若该第二扫描区域位于该光学传感器的感光面的边缘位置,在该多个扫描区域中除该第二扫描区域之外的扫描区域中重新确定最亮扫描区域。
可选地,该处理单元420具体用于:
可选地,该红外补光光源采用直流驱动方式进行工作,以及在进行补光时,该红外补光光源基于最大电流驱动。
可选地,该处理单元420还用于配置该光学传感器采用红外补光光源补光方式在该第三曝光时间内获取承载生物特征信息的光信号。
图6是根据本申请实施例的电子设备500的示意性框图,如图6所示,该电子设备500包括:
光学传感器510,用于获取光信号;
红外补光光源520,用于对所述光学传感器进行红外补光;以及
控制器530,包括用于存储程序和数据的存储器531和用于调用并运行所述存储器中存储的程序和数据的处理器532,所述控制器被配置为:执行上述图2至图4中所示的方法。
图7是根据本申请实施例的生物特征识别装置600的示意性框图,如图7所示,该生物特征识别装置600包括:
光学传感器610,用于获取承载生物特征信息的光信号;
光学滤波片620,用于在该光学传感器获取承载生物特征信息的光信号之前过滤除第一波段之外的红外光。
可选地,该光学传感器在该第一波段的灵敏度大于其他波段的灵敏度。
可选地,该第一波段为940nm波段。
需要说明的是,在太阳光谱中,940nm波段处的红外光强明显弱于位于940nm波段周围波段(例如,800nm-1000nm)处的红外光强,也就是说, 在940nm波段处,即使周围处于强太阳光环境,其对光学传感器610进行红外补光的影响也较弱,光学传感器610依然可以工作在线性区域。
因此,在940nm波段进行生物特征采集,可以实现抵御周围强光的效果。
可选地,该生物特征识别装置应用于人脸识别或指纹识别。
可选地,该光学传感器采用红外补光光源进行补光。
可选地,该生物特征识别装置600可以应用于强太阳光环境。
应理解,本申请实施例的处理器可以是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法实施例的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器可以是通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成上述方法的步骤。
可以理解,本申请实施例的终端或电子设备还可以包括存储器,存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(Read-Only Memory,ROM)、可编程只读存储器(Programmable ROM,PROM)、可擦除可编程只读存储器(Erasable PROM,EPROM)、电可擦除可编程只读存储器(Electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(Static RAM,SRAM)、动态随机存取存储器(Dynamic RAM,DRAM)、同步动态随机存取存储器(Synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM,DDR SDRAM)、增强型同步动态随 机存取存储器(Enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(Synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM,DR RAM)。应注意,本文描述的系统和方法的存储器旨在包括但不限于这些和任意其它适合类型的存储器。
本申请实施例还提出了一种计算机可读存储介质,该计算机可读存储介质存储一个或多个程序,该一个或多个程序包括指令,该指令当被包括多个应用程序的便携式电子设备执行时,能够使该便携式电子设备执行图2至图4所示实施例的方法。
本申请实施例还提出了一种计算机程序,该计算机程序包括指令,当该计算机程序被计算机执行时,使得计算机可以执行图2至图4所示实施例的方法。
本申请实施例还提供了一种芯片,该芯片包括输入输出接口、至少一个处理器、至少一个存储器和总线,该至少一个存储器用于存储指令,该至少一个处理器用于调用该至少一个存储器中的指令,以执行图2至图4所示实施例的方法。
应理解,在本申请的各种实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应所述理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之 间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者所述技术方案的部分可以以软件产品的形式体现出来,所述计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应所述以权利要求的保护范围为准。
Claims (46)
- 一种生物特征识别方法,其特征在于,包括:获取第一曝光时间内光学传感器在多个扫描区域内分别采集的第一光信号,所述第一曝光时间小于第一阈值;根据所述多个扫描区域内分别采集的第一光信号,确定所述光学传感器在进行生物特征识别时的补光方式。
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:配置所述多个扫描区域,且所述多个扫描区域中的每个扫描区域对应所述光学传感器的多个像素点。
- 根据权利要求1或2所述的方法,其特征在于,所述多个扫描区域均分所述光学传感器的感光面。
- 根据权利要求1至3中任一项所述的方法,其特征在于,所述多个扫描区域以棋盘格形式布局于所述光学传感器感光面上。
- 根据权利要求1至4中任一项所述的方法,其特征在于,所述方法还包括:配置所述第一曝光时间。
- 根据权利要求1至5中任一项所述的方法,其特征在于,所述第一阈值为10毫秒。
- 根据权利要求1至6中任一项所述的方法,其特征在于,所述补光方式包括外部强光补光和红外补光光源补光。
- 根据权利要求7所述的方法,其特征在于,所述方法还包括:在所述光学传感器在所述第一曝光时间内采集第一光信号时,配置开启所述光学传感器曝光和关闭红外补光光源。
- 根据权利要求8所述的方法,其特征在于,所述根据所述多个扫描区域内分别采集的第一光信号,确定所述光学传感器在进行生物特征识别时的补光方式,包括:将所述多个扫描区域中每个扫描区域内所采集的第一光信号取平均,以得到所述每个扫描区域的第一光强;根据所述每个扫描区域的第一光强,确定第一扫描区域,所述第一扫描区域为第一光强下所述多个扫描区域中的最亮扫描区域;根据所述第一扫描区域的第一光强,确定所述光学传感器在进行生物特征识别时的补光方式。
- 根据权利要求9所述的方法,其特征在于,在将所述多个扫描区域中每个扫描区域内所采集的第一光信号取平均之前,所述方法还包括:将所述每个扫描区域内所采集的第一光信号进行去坏点处理。
- 根据权利要求9或10所述的方法,其特征在于,所述方法还包括:若所述第一扫描区域位于所述光学传感器的感光面的边缘位置,在所述多个扫描区域中除所述第一扫描区域之外的扫描区域中重新确定最亮扫描区域。
- 根据权利要求12所述的方法,其特征在于,若所述第二曝光时间小于或者等于第二阈值,所述方法还包括:将所述第二曝光时间确定为所述光学传感器在进行生物特征识别时的曝光时间。
- 根据权利要求13所述的方法,其特征在于,所述方法还包括:配置所述光学传感器采用外部强光补光方式在所述第二曝光时间内获取承载生物特征信息的光信号。
- 根据权利要求12所述的方法,其特征在于,若所述第二曝光时间大于第二阈值,所述方法还包括:配置开启所述光学传感器曝光和红外补光光源补光;获取所述第一曝光时间内所述光学传感器在所述多个扫描区域内分别采集的第二光信号;将所述多个扫描区域中每个扫描区域内所采集的第二光信号取平均,以得到所述每个扫描区域的第二光强;根据所述每个扫描区域的第二光强,确定第二扫描区域,所述第二扫描区域为第二光强下所述多个扫描区域中的最亮扫描区域;根据所述第二扫描区域的第二光强,确定用于所述光学传感器进行生物特征识别的第三曝光时间。
- 根据权利要求15所述的方法,其特征在于,在将所述多个扫描区域中每个扫描区域内所采集的第二光信号取平均之前,所述方法还包括:将所述每个扫描区域内所采集的第二光信号进行去坏点处理。
- 根据权利要求15或16所述的方法,其特征在于,所述方法还包括:若所述第二扫描区域位于所述光学传感器的感光面的边缘位置,在所述多个扫描区域中除所述第二扫描区域之外的扫描区域中重新确定最亮扫描区域。
- 根据权利要求15至18中任一项所述的方法,其特征在于,所述红外补光光源采用直流驱动方式进行工作,以及在进行补光时,所述红外补光光源基于最大电流驱动。
- 根据权利要求15至19中任一项所述的方法,其特征在于,所述方法还包括:配置所述光学传感器采用红外补光光源补光方式在所述第三曝光时间内获取承载生物特征信息的光信号。
- 一种生物特征识别装置,其特征在于,包括:获取单元,用于获取第一曝光时间内光学传感器在多个扫描区域内分别采集的第一光信号,所述第一曝光时间小于第一阈值;处理单元,用于根据所述多个扫描区域内分别采集的第一光信号,确定所述光学传感器在进行生物特征识别时的补光方式。
- 根据权利要求21所述的生物特征识别装置,其特征在于,所述处理单元还用于配置所述多个扫描区域,且所述多个扫描区域中的每个扫描区 域对应所述光学传感器的多个像素点。
- 根据权利要求21或22所述的生物特征识别装置,其特征在于,所述多个扫描区域均分所述光学传感器的感光面。
- 根据权利要求21至23中任一项所述的生物特征识别装置,其特征在于,所述多个扫描区域以棋盘格形式布局于所述光学传感器感光面上。
- 根据权利要求21至24中任一项所述的生物特征识别装置,其特征在于,所述处理单元还用于配置所述第一曝光时间。
- 根据权利要求21至25中任一项所述的生物特征识别装置,其特征在于,所述第一阈值为10毫秒。
- 根据权利要求21至26中任一项所述的生物特征识别装置,其特征在于,所述补光方式包括外部强光补光和红外补光光源补光。
- 根据权利要求27所述的生物特征识别装置,其特征在于,所述处理单元还用于在所述光学传感器在所述第一曝光时间内采集第一光信号时,配置开启所述光学传感器曝光和关闭红外补光光源。
- 根据权利要求28所述的生物特征识别装置,其特征在于,所述处理单元具体用于:将所述多个扫描区域中每个扫描区域内所采集的第一光信号取平均,以得到所述每个扫描区域的第一光强;根据所述每个扫描区域的第一光强,确定第一扫描区域,所述第一扫描区域为第一光强下所述多个扫描区域中的最亮扫描区域;根据所述第一扫描区域的第一光强,确定所述光学传感器在进行生物特征识别时的补光方式。
- 根据权利要求29所述的生物特征识别装置,其特征在于,在将所述多个扫描区域中每个扫描区域内所采集的第一光信号取平均之前,所述处理单元还用于将所述每个扫描区域内所采集的第一光信号进行去坏点处理。
- 根据权利要求29或30所述的生物特征识别装置,其特征在于,所述处理单元还用于:若所述第一扫描区域位于所述光学传感器的感光面的边缘位置,在所述多个扫描区域中除所述第一扫描区域之外的扫描区域中重新确定最亮扫描区域。
- 根据权利要求32所述的生物特征识别装置,其特征在于,若所述第二曝光时间小于或者等于第二阈值,所述处理单元还用于将所述第二曝光时间确定为所述光学传感器在进行生物特征识别时的曝光时间。
- 根据权利要求33所述的生物特征识别装置,其特征在于,所述处理单元还用于配置所述光学传感器采用外部强光补光方式在所述第二曝光时间内获取承载生物特征信息的光信号。
- 根据权利要求32所述的生物特征识别装置,其特征在于,若所述第二曝光时间大于第二阈值,所述处理单元还用于:配置开启所述光学传感器曝光和红外补光光源补光;控制所述获取单元获取所述第一曝光时间内所述光学传感器在所述多个扫描区域内分别采集的第二光信号;将所述多个扫描区域中每个扫描区域内所采集的第二光信号取平均,以得到所述每个扫描区域的第二光强;根据所述每个扫描区域的第二光强,确定第二扫描区域,所述第二扫描区域为第二光强下所述多个扫描区域中的最亮扫描区域;根据所述第二扫描区域的第二光强,确定用于所述光学传感器进行生物特征识别的第三曝光时间。
- 根据权利要求35所述的生物特征识别装置,其特征在于,在将所述多个扫描区域中每个扫描区域内所采集的第二光信号取平均之前,所述处理单元还用于将所述每个扫描区域内所采集的第二光信号进行去坏点处理。
- 根据权利要求35或36所述的生物特征识别装置,其特征在于,所述处理单元还用于:若所述第二扫描区域位于所述光学传感器的感光面的边缘位置,在所述 多个扫描区域中除所述第二扫描区域之外的扫描区域中重新确定最亮扫描区域。
- 根据权利要求35至38中任一项所述的生物特征识别装置,其特征在于,所述红外补光光源采用直流驱动方式进行工作,以及在进行补光时,所述红外补光光源基于最大电流驱动。
- 根据权利要求35至39中任一项所述的生物特征识别装置,其特征在于,所述处理单元还用于配置所述光学传感器采用红外补光光源补光方式在所述第三曝光时间内获取承载生物特征信息的光信号。
- 一种电子设备,其特征在于,包括:光学传感器,用于获取光信号;红外补光光源,用于对所述光学传感器进行红外补光;以及控制器,包括用于存储程序和数据的存储器和用于调用并运行所述存储器中存储的程序和数据的处理器,所述控制器被配置为:执行如权利要求1至20中任一项所述的方法。
- 一种生物特征识别装置,其特征在于,包括:光学传感器,用于获取承载生物特征信息的光信号;光学滤波片,用于在所述光学传感器获取承载生物特征信息的光信号之前过滤除第一波段之外的红外光。
- 根据权利要求42所述的生物特征识别装置,其特征在于,所述光学传感器在所述第一波段的灵敏度大于其他波段的灵敏度。
- 根据权利要求42或43所述的生物特征识别装置,其特征在于,所述第一波段为940nm波段。
- 根据权利要求42至44中任一项所述的生物特征识别装置,所述光学传感器采用红外补光光源进行补光。
- 根据权利要求42至45中任一项所述的生物特征识别装置,其特征 在于,所述生物特征识别装置应用于人脸识别或指纹识别。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2018/110230 WO2020077490A1 (zh) | 2018-10-15 | 2018-10-15 | 生物特征识别方法、装置和电子设备 |
| CN201880002031.7A CN109496312B (zh) | 2018-10-15 | 2018-10-15 | 生物特征识别方法、装置和电子设备 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2018/110230 WO2020077490A1 (zh) | 2018-10-15 | 2018-10-15 | 生物特征识别方法、装置和电子设备 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020077490A1 true WO2020077490A1 (zh) | 2020-04-23 |
Family
ID=65713857
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2018/110230 Ceased WO2020077490A1 (zh) | 2018-10-15 | 2018-10-15 | 生物特征识别方法、装置和电子设备 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109496312B (zh) |
| WO (1) | WO2020077490A1 (zh) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113869118A (zh) * | 2021-08-25 | 2021-12-31 | 北京极豪科技有限公司 | 光学传感器、指纹识别模组以及电子设备 |
| EP4120124A4 (en) * | 2021-05-25 | 2023-03-08 | Shenzhen Goodix Technology Co., Ltd. | BIOMETRIC DETECTION PROCESS AND CHIP AS WELL AS COMPUTER-READABLE STORAGE MEDIUM |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110378223A (zh) * | 2019-06-14 | 2019-10-25 | 北京集创北方科技股份有限公司 | 生物特征识别方法、装置及其电子设备 |
| CN112149469B (zh) * | 2019-06-28 | 2025-02-14 | 北京小米移动软件有限公司 | 指纹识别方法及装置 |
| CN111709380B (zh) * | 2020-06-19 | 2024-06-14 | 京东方科技集团股份有限公司 | 一种屏幕的光学指纹识别方法及相关产品 |
| CN113191327B (zh) * | 2021-05-25 | 2025-03-28 | 深圳市汇顶科技股份有限公司 | 生物特征采集方法、芯片及计算机可读存储介质 |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105049741A (zh) * | 2015-08-14 | 2015-11-11 | 上海与德通讯技术有限公司 | 一种拍照补光方法及电子设备 |
| CN106462756A (zh) * | 2016-09-17 | 2017-02-22 | 深圳市汇顶科技股份有限公司 | 指纹采集装置及方法、终端设备及屏幕亮灭的控制方法 |
| CN106774685A (zh) * | 2017-01-18 | 2017-05-31 | 张帆 | 一种全屏显示终端 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104598899A (zh) * | 2015-02-16 | 2015-05-06 | 上海箩箕技术有限公司 | 指纹成像方法和指纹成像系统 |
| CN106534712A (zh) * | 2016-10-24 | 2017-03-22 | 北京旷视科技有限公司 | 控制方法、图像处理单元、补光单元和摄像装置 |
| KR101850378B1 (ko) * | 2016-12-30 | 2018-05-10 | 주식회사 베프스 | 생체 정보 인식을 통한 인증 장치 및 방법 |
| CN107958185B (zh) * | 2017-08-17 | 2020-05-19 | 深圳信炜科技有限公司 | 显示模组的生物特征信息感测方法 |
-
2018
- 2018-10-15 WO PCT/CN2018/110230 patent/WO2020077490A1/zh not_active Ceased
- 2018-10-15 CN CN201880002031.7A patent/CN109496312B/zh active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105049741A (zh) * | 2015-08-14 | 2015-11-11 | 上海与德通讯技术有限公司 | 一种拍照补光方法及电子设备 |
| CN106462756A (zh) * | 2016-09-17 | 2017-02-22 | 深圳市汇顶科技股份有限公司 | 指纹采集装置及方法、终端设备及屏幕亮灭的控制方法 |
| CN106774685A (zh) * | 2017-01-18 | 2017-05-31 | 张帆 | 一种全屏显示终端 |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4120124A4 (en) * | 2021-05-25 | 2023-03-08 | Shenzhen Goodix Technology Co., Ltd. | BIOMETRIC DETECTION PROCESS AND CHIP AS WELL AS COMPUTER-READABLE STORAGE MEDIUM |
| US11776306B2 (en) | 2021-05-25 | 2023-10-03 | Shenzhen GOODIX Technology Co., Ltd. | Method and chip for biometric characteristic acquisition, and computer readable storage medium |
| CN113869118A (zh) * | 2021-08-25 | 2021-12-31 | 北京极豪科技有限公司 | 光学传感器、指纹识别模组以及电子设备 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109496312A (zh) | 2019-03-19 |
| CN109496312B (zh) | 2022-02-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11062112B2 (en) | Fingerprint detection device and method and electronic device | |
| US11275960B2 (en) | Multi-sensor-based under-screen fingerprint capturing method and system and electronic device | |
| CN109496312B (zh) | 生物特征识别方法、装置和电子设备 | |
| EP3693887B1 (en) | Fingerprint recognition apparatus and method, and electronic device | |
| CN110268418B (zh) | 指纹检测的方法、装置和电子设备 | |
| EP3690701B1 (en) | Fingerprint recognition method, fingerprint recognition device and terminal equipment | |
| CN109496314B (zh) | 屏下指纹识别装置和电子设备 | |
| US11157716B2 (en) | Multi-sensor-based under-screen fingerprint capturing method and system and electronic device | |
| EP3657381A1 (en) | Fingerprint recognition apparatus and method, and terminal device | |
| EP3352221A2 (en) | Array substrate and fabricating method thereof, display panel, display apparatus, electronic device, computer program and recording medium | |
| CN110088769B (zh) | 指纹采集的方法、系统和电子设备 | |
| WO2020093251A1 (zh) | 基于双感应区的识别指纹方法、指纹识别系统和电子设备 | |
| CN111066027B (zh) | 图像采集的装置、方法和电子设备 | |
| CN108960105B (zh) | 柔性电路板、终端设备及指纹识别方法 | |
| WO2020061754A1 (zh) | 基于多传感器的屏下指纹认证方法、系统和电子设备 | |
| US10997393B2 (en) | Method and apparatus for identifying fingerprint logo and electronic device | |
| WO2018185992A1 (ja) | 生体認証装置、及び方法 | |
| CN113936304A (zh) | 一种指纹识别方法、移动终端和存储介质 | |
| WO2016208216A1 (ja) | ユーザインタフェース装置および距離センサ | |
| JP2003263628A (ja) | センサ | |
| WO2019140624A1 (zh) | 电子设备 | |
| WO2019140647A1 (zh) | 生物特征信息感测装置、电子设备 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18937089 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 18937089 Country of ref document: EP Kind code of ref document: A1 |