WO2020082968A1 - 摄像头、电子设备和身份验证方法 - Google Patents

摄像头、电子设备和身份验证方法 Download PDF

Info

Publication number
WO2020082968A1
WO2020082968A1 PCT/CN2019/107832 CN2019107832W WO2020082968A1 WO 2020082968 A1 WO2020082968 A1 WO 2020082968A1 CN 2019107832 W CN2019107832 W CN 2019107832W WO 2020082968 A1 WO2020082968 A1 WO 2020082968A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
lens
electronic device
fingerprint
image
Prior art date
Application number
PCT/CN2019/107832
Other languages
English (en)
French (fr)
Inventor
叶连杰
郭玉坤
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2020082968A1 publication Critical patent/WO2020082968A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1626Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details

Definitions

  • This application relates to the field of electronic technology, in particular to a camera, electronic equipment, and identity verification method.
  • the camera 1 in the electronic device is used to collect a face image, and the collected face image is compared with a pre-stored image to realize face recognition.
  • the off-screen camera 2 is used to collect the fingerprint image to unlock the screen fingerprint.
  • the application discloses a camera, an electronic device and an identity verification method, which can save the internal space of the electronic device and reduce the complexity of the manufacturing process of the display screen.
  • the technical solution of the present application provides a camera, which is used for face recognition and fingerprint recognition by an electronic device;
  • the camera includes a first lens, a second lens, and an image sensor; wherein: the camera includes a A state and a second state, in the first state, the first lens, the second lens, and the image sensor participate in image acquisition; in the second state, the second lens and the The image sensor participates in image acquisition; in the first state of the camera, the first lens, the second lens and the image sensor are used to collect fingerprint images for fingerprint recognition; the camera is in the In the second state, the second lens and the image sensor are used to collect facial images for face recognition; or in the first state, the first lens, the first Two lenses and the image sensor collect face images for face recognition; in the second state of the camera, the second lens and the image sensor collect fingers Image to fingerprinting.
  • the above camera is used in electronic equipment. By changing the focal length of the lens in the camera, the camera can collect both face images and fingerprint images, which can save the internal space of the electronic device. When the camera is an off-screen camera, it can be reduced The complexity of the production process of the display screen brought by the camera.
  • the camera provided by the technical solution of the present application can be used for unlocking electronic devices, payment scenarios, identity verification, and unlocking application scenarios.
  • the combination of the second lens and the image sensor corresponds to face recognition
  • the combination of the first lens, the second lens and the image sensor corresponds to screen fingerprint recognition
  • the second lens and the image sensor in the camera collect a face image
  • the human face can form a clear human face image on the image sensor through the second lens.
  • the clear face image can provide enough face image features to realize face recognition.
  • the fingerprint can form a clear fingerprint image on the image sensor through the first lens and the second lens.
  • the clear fingerprint image can provide enough fingerprint features to realize fingerprint recognition.
  • the first lens, the second lens, and the image sensor corresponds to face recognition
  • the combination of the second lens and the image sensor corresponds to screen fingerprint recognition
  • the first lens, the second lens, and the image sensor in the camera collect face images
  • a clear human face image can be formed on the image sensor.
  • the clear face image can provide enough face image features to realize face recognition.
  • the second lens and the image sensor in the camera collect the fingerprint image
  • the fingerprint can form a clear fingerprint image on the image sensor through the second lens.
  • the clear fingerprint image can provide enough fingerprint features to realize fingerprint recognition.
  • the focal lengths of the first lens and the second lens can be set to achieve clear fingerprint images and face images.
  • the first lens may be a convex lens.
  • the first lens is fixed on a movable bracket and driven by the movable bracket, wherein: the first lens is used to be driven by the movable bracket to a position capable of participating in image acquisition, The camera is in the first state; the first lens is also used to be moved away from the position capable of participating in image acquisition by the movable bracket, so that the camera is in the second state.
  • the first lens may be a concave lens.
  • the camera that collects the image of the object includes the first lens, the second lens, and the image sensor.
  • the optical axis of the first lens overlaps with the optical axis of the second lens.
  • the second lens may be packaged with the image sensor, then the first lens may be between the display screen and the second lens, and the optical axis of the first lens may overlap the optical axis of the second lens.
  • a memory alloy spring is fixed on the movable support, and the memory alloy spring includes a third state and a fourth state; when the memory alloy spring becomes the third state, the The first lens is driven to the position capable of participating in image acquisition by the memory alloy spring on the movable bracket, so that the camera is in the first state; when the memory alloy spring becomes the fourth state , The first lens is also moved away from the position capable of participating in image acquisition by the memory alloy spring on the movable bracket, so that the camera is in the second state.
  • the memory alloy spring may be helical.
  • the memory alloy spring becomes the third state, including: the memory alloy spring is deformed by heating, and the first lens is driven by the memory alloy spring on the movable bracket To the position capable of participating in image acquisition, so that the camera is in the first state; the memory alloy spring becomes the fourth state, including: the memory alloy spring is turned off and heated to recover the shape, the first A lens is moved away from the position capable of participating in image acquisition by the memory alloy spring on the movable bracket, so that the camera is in the second state.
  • the second lens and the image sensor can be packaged together.
  • the first lens, the second lens and the image sensor may be located below the display plane of the display screen.
  • the first lens can be connected to the structural member through a movable bracket.
  • the structural member 600 can be used to fix the display screen.
  • the structural member may be the middle frame of the electronic device.
  • the display screen may be an OLED display screen. It can also be a liquid crystal display.
  • the display screen is an LCD, at the position on the display screen corresponding to the camera, the reflective film and the diffusion film in the LCD backlight module need openings to allow the camera under the screen to receive sufficient light.
  • the movable bracket is driven by a motor, and when the motor drives the movable bracket to a first position, the first lens fixed on the movable bracket is driven to the The position involved in image acquisition makes the camera in the first state; when the motor drives the movable bracket to move to the second position, the first lens fixed on the movable bracket is driven from the The position capable of participating in image acquisition is moved away so that the camera is in the second state.
  • the movable bracket is driven by the motor through the rotation of the guide rail, and the motor drives the movable bracket to move to the first position, including: the motor drives the guide rail to rotate, and the guide rail drives The movable bracket moves to the first position; the motor drives the movable bracket to move to the second position, including: the motor drives the guide rail to rotate, and the guide rail drives the movable bracket to move to the first position Second position.
  • the outer side of the guide rail may contain threads.
  • the nut can engage with the thread and move along the guide rail as the guide rail rotates.
  • the movable bracket can be fixed on the nut, and can move along the guide rail as the nut moves, and the first lens fixed on the movable bracket can be moved away from the position capable of participating in image acquisition or moved to the position capable of participating in image acquisition.
  • the first lens is a convex lens: in the first state of the camera, the first lens, the second lens, and the image sensor collect fingerprints Image for fingerprint recognition; in the second state of the camera, the second lens and the image sensor collect face images for face recognition; in the following cases, the first lens is Concave lens: when the camera is in the first state, the first lens, the second lens, and the image sensor collect face images for face recognition; the camera is in the second state , The second lens and the image sensor collect fingerprint images for fingerprint recognition.
  • the camera is an infrared camera
  • the camera is used to receive infrared rays reflected by the fingerprint to collect fingerprint images
  • the camera is also used to receive infrared rays reflected by the human face to collect human faces image.
  • the electronic device may further include an infrared emitter.
  • the infrared emitter can be fixed on the motherboard.
  • the camera is located below the display plane of the display screen of the electronic device, and the infrared rays reflected by the fingerprint and the infrared rays reflected by the face are infrared emitters of the electronic device in the
  • the display is launched at intervals of refresh.
  • the infrared emitter can periodically emit infrared light, and the infrared light is projected onto the object and can be collected by the camera after reflection, thereby realizing the collection of the image of the object.
  • an infrared emitter and an infrared camera to unlock the face can still unlock the face in a scene with insufficient external light, such as at night, thereby improving the convenience of unlocking the face.
  • the camera is also used to restore to an initial state after completing face recognition or fingerprint recognition, the initial state being any one of the first state and the second state status.
  • the corresponding camera state can be set to the initial state when the memory alloy spring is turned off and heated, so that the electronic device is not in the unlocking period, no power supply is needed to continuously heat the memory alloy spring, thereby saving power consumption , To reduce the accumulation of heat inside the electronic equipment and extend the life of the memory alloy spring.
  • the initial state of the camera state may also be obtained by performing statistical learning on user unlock data.
  • the technical solution of the present application provides a camera, which is used for face recognition and fingerprint recognition by an electronic device; the camera includes a liquid lens and an image sensor, the focal length of the liquid lens is adjustable, and the image The sensor is used to collect images; wherein: when the focal length of the liquid lens is the first focal length, the camera is used to collect fingerprint images for fingerprint recognition; when the liquid lens is the second focal length, the camera is used to collect the image Face image to perform face recognition.
  • the above camera is used in electronic equipment. By changing the focal length of the lens in the camera, the camera can collect both face images and fingerprint images, which can save the internal space of the electronic device and reduce the display screen brought by the camera. The complexity of the process.
  • the camera can be located below the display plane of the display screen.
  • the display screen may be an OLED display screen. It can also be a liquid crystal display.
  • the display screen is an LCD, at the position on the display screen corresponding to the camera, the reflective film and the diffusion film in the LCD backlight module need openings to allow the camera under the screen to receive sufficient light.
  • the camera provided by the technical solution of the present application can be used for unlocking electronic devices, payment scenarios, identity verification, and unlocking application scenarios.
  • the focal length of the liquid lens periodically changes between the first focal length and the second focal length.
  • the liquid lens can achieve two focal lengths, namely the focal length corresponding to the face and the focal length corresponding to the fingerprint.
  • the focal length corresponding to the fingerprint is the first focal length
  • the focal length corresponding to the human face is the second focal length.
  • the face outside the display screen can form a clear face image on the image sensor through the liquid lens.
  • the clear face image can provide enough face image features to complete face recognition.
  • the fingerprint outside the display screen can form a clear fingerprint image on the image sensor through the liquid lens.
  • the clear fingerprint image can provide enough fingerprint features to complete fingerprint recognition.
  • the electronic device collects the image of the human face from the outside of the display screen through the liquid lens during the time when the focal length corresponding to the human face is maintained.
  • the electronic device collects the image of the fingerprint from the surface of the display screen through the liquid lens during the time that the focal length corresponding to the fingerprint is maintained.
  • the technical solution of the present application provides an identity verification method in an electronic device.
  • the method includes: when a parameter detected by a sensor in the electronic device satisfies a parameter range corresponding to screen fingerprint recognition, the processor of the electronic device uses the fingerprint of the camera Collect fingerprint images in the recognition state to perform fingerprint recognition; when the parameters detected by the sensors in the electronic device meet the parameter range corresponding to face recognition, the processor of the electronic device uses the face recognition state of the camera to collect the face images to perform Face recognition; wherein the camera includes a first lens, a second lens and an image sensor; in the fingerprint recognition state of the camera, the first lens, the second lens and the image sensor collect fingerprint images ; In the face recognition state of the camera, the second lens and the image sensor collect face images;
  • the second lens and the image sensor collect fingerprint images; in the face recognition state of the camera, the first lens, the second lens, and the image The sensor collects face images.
  • the camera can collect both face images and fingerprint images by changing the focal length of the lens in the camera, which can save the internal space of the electronic device and reduce the production process of the display screen brought by the camera Complexity.
  • the identity verification method provided by the technical solution of the present application can be used for unlocking electronic devices, payment scenarios, identity verification, and unlocking application scenarios.
  • the processor of the electronic device uses the fingerprint recognition state of the camera to collect fingerprint images for fingerprint recognition, or the processor of the electronic device uses the face recognition state of the camera to collect human faces After the image is used for face recognition, the method further includes: the processor of the electronic device restores the camera to an initial state, the initial state being the fingerprint recognition state and the face recognition state Any state.
  • the camera may not need to restore to a certain state after performing any of the unlocking methods of screen fingerprint unlocking and face unlocking after capturing the image of the object to be captured.
  • the first lens may still be at a position deviating from the position capable of participating in image acquisition.
  • the processor of the electronic device can perform the following steps:
  • Step1 Record the unlock method used for the n-th unlock as the face unlock.
  • Step2 In the next unlock, the parameter detected by the sensor in the electronic device during the n + 1 unlock meets the parameter range corresponding to the screen fingerprint recognition, and the processor detects the n + 1 unlock method and the nth unlock in the electronic device The unlocking method is different.
  • Step3 The processor driving motor in the electronic device drives the guide rail to rotate, and moves the movable bracket fixed on the nut and the first lens fixed on the movable bracket along the direction of the guide rail, so that the first lens moves to a position capable of participating in image acquisition. Move the first lens to a position capable of participating in image collection to participate in fingerprint image collection. After performing screen fingerprint unlocking, the first lens can still be in a position capable of participating in image acquisition.
  • step 1 if the parameter detected by the sensor in the electronic device meets the parameter range corresponding to face recognition, there is no need to adjust the camera, and the second lens and the image sensor are used to directly collect the face image to unlock the face. It is not necessary to adjust the camera in the face unlocking scene, thereby shortening the unlocking time and improving the unlocking efficiency of the electronic device.
  • the parameter detected by the sensor in the electronic device satisfies the parameter range corresponding to screen fingerprint recognition, including one or more of the following: a touch operation is detected on the area corresponding to the camera on the touch screen; an infrared detector It is detected that the brightness of the reflected light from outside the area corresponding to the camera on the touch screen is greater than or equal to the first threshold; the pressure sensor detects that the pressure intensity or the amount of change in pressure intensity on the area corresponding to the camera on the touch screen is greater than or equal to the first Two thresholds; the distance sensor detects that the distance between the subject and the area corresponding to the camera on the touch screen is less than or equal to the third threshold or the change in distance is greater than or equal to the fourth threshold; the image collected by the camera is classified as a fingerprint image.
  • the infrared detector can also cooperate with the ambient light sensor to detect whether the electronic device is in the pocket to prevent accidental touch.
  • the camera can be an infrared camera, and there is no need to install an additional infrared detector, and the infrared camera can be used to realize the function of the infrared detector.
  • the classification of the image collected by the camera can use a classifier algorithm, which can classify face images and fingerprint images.
  • the classifier algorithm can be obtained through machine learning.
  • the parameter detected by the sensor in the electronic device satisfies the parameter range corresponding to face recognition, including one or more of the following: the gyro sensor detects that the motion parameter of the electronic device is greater than or equal to The fifth threshold; the distance sensor detects that the distance between the object and the area corresponding to the camera on the touch screen is greater than or equal to the sixth threshold; the image collected by the camera is classified as a face image.
  • the gyro sensor can also cooperate with one or more of the acceleration sensor, the gravity sensor, and the light sensor to more accurately determine the movement of lifting the wrist, and then determine the face unlocking scene to prevent misoperation.
  • the method further includes: the electronic The processor of the device controls the switch for heating the memory alloy spring to close, and the first lens is driven by the memory alloy spring to the position capable of participating in image acquisition; or, the processor of the electronic device controls the motor to drive Before the first lens reaches the position capable of participating in image collection; the processor of the electronic device uses the face recognition state of the camera to collect face images to perform face recognition, the method further includes: the electronic The processor of the device controls the switch for heating the memory alloy spring to be turned off, and the first lens is The alloy spring drives away from the position capable of participating in image acquisition; or, the processor of the electronic device controls the motor to drive the first lens away from the position capable of participating in image acquisition.
  • the processor of the electronic device controls the motor to drive the first lens to the position capable of participating in image acquisition, including: the processor drives the motor in the electronic device to drive the guide rail to rotate, and the movable bracket fixed on the nut and fixed The first lens on the movable bracket moves along the direction of the guide rail, so that the first lens moves to a position capable of participating in image acquisition.
  • the processor of the electronic device controls the motor to drive the first lens away from the position capable of participating in image acquisition, including: the processor in the electronic device enables the motor to be controlled to drive the guide rail to rotate and be fixed on the nut
  • the movable bracket on the top and the first lens fixed on the movable bracket move in the direction of the guide rail, so that the first lens is moved away from the position capable of participating in image acquisition.
  • the processor of the electronic device uses the fingerprint recognition status of the camera to collect fingerprint images for fingerprint recognition, and the method further includes: the electronic The processor of the device controls the switch for heating the memory alloy spring to be opened, so that the first lens is driven by the memory alloy spring to move away from the position capable of participating in image acquisition; or, the processing of the electronic device The controller controls the motor to drive the first lens away from the position capable of participating in image collection; the processor of the electronic device uses the face recognition state of the camera to collect face images to perform face recognition.
  • the method further includes: the processor of the electronic device controls a switch for heating the memory alloy spring to close so that all The first lens is driven to the memory alloy spring capable of participating in the image acquisition position; or, a processor controlling the electronic device of the first motor to drive said lens to the image acquisition position to participate.
  • the camera is an infrared camera
  • the camera is used to receive infrared rays reflected by the fingerprint to collect fingerprint images, and the camera is also used to receive infrared rays reflected by the human face to collect people Face image
  • the camera is located below the display plane of the display screen of the electronic device, and the method further includes: the processor of the electronic device controls the infrared emitter to emit infrared rays at intervals refreshed by the display screen.
  • the display screen may be an OLED display screen. It can also be a liquid crystal display.
  • the display screen is an LCD, at the position on the display screen corresponding to the camera, the reflective film and the diffusion film in the LCD backlight module need openings to allow the camera under the screen to receive sufficient light.
  • the technical solution of the present application provides an electronic device, the electronic device includes a processor, a camera, and a display screen, and the camera is located on the front case of the electronic device, wherein: the camera is the first aspect or The camera described in any possible implementation manner of the first aspect; the processor is used to control a switch for heating the memory alloy spring to be closed or opened, or to control the motor to drive the first lens mobile.
  • the technical solution of the present application provides an electronic device, wherein the electronic device includes a processor and a camera, and the camera is located on a front case of the electronic device, wherein: the camera is the second aspect Or the camera described in any possible implementation manner of the second aspect; the processor is configured to control the focal length of the liquid lens to switch between the first focal length and the second focal length.
  • the technical solution of the present application provides an electronic device that is used to execute the identity verification method in the electronic device described in the third aspect or any possible implementation manner of the third aspect.
  • the technical solution of the present application provides an electronic device including a module or a unit for performing the method provided in the third aspect and any possible technical solution of the third aspect.
  • the technical solution of the present application provides a chip system including at least one processor, a memory and an interface circuit, the memory, the interface circuit and the at least one processor are connected, and the at least one memory stores a program Instructions; when the program instructions are executed by the processor, the third aspect and the method provided in any possible technical solution of the third aspect are implemented.
  • the technical solution of the present application provides a computer-readable storage medium that stores program instructions, and when the program instructions are executed by a processor, any one of the third aspect and the third aspect may be realized The method provided by the technical solution.
  • the technical solution of the present application provides a computer program product.
  • the computer program product is run on a processor, the third aspect and the method provided in any possible technical solution of the third aspect are implemented.
  • FIG. 1 is a schematic diagram of fingerprint unlocking and face unlocking provided by the prior art
  • FIG. 2 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 3 is a block diagram of a software structure of an electronic device 100 provided by this pickup embodiment
  • FIG. 4 is a schematic diagram of a focal length and an object distance in a camera provided by an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of a camera provided by an embodiment of the present application.
  • FIG. 6 is a schematic flowchart of an electronic device unlocking method provided by an embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of a movable bracket provided by an embodiment of the present application for rotating the first lens to a position capable of participating in image acquisition;
  • FIG. 8 is a schematic structural diagram of a movable bracket provided by an embodiment of the present application for rotating to move a first lens away from a position capable of participating in image acquisition;
  • FIG. 9 is a schematic structural view of a movable bracket provided by an embodiment of the present application to place a first lens in a position capable of participating in image acquisition;
  • FIG. 10 is a schematic structural diagram of a movable bracket moving to move a first lens away from a position capable of participating in image acquisition according to an embodiment of the present application;
  • FIG. 11 is a schematic flowchart of another method for unlocking an electronic device according to an embodiment of the present application.
  • 12 is a schematic diagram of the time when an infrared emitter provides infrared light provided by an embodiment of the present application;
  • FIG. 13 is a schematic structural diagram of another camera provided by an embodiment of the present application.
  • FIG. 14 is a schematic diagram of positions of a display screen and a camera in an electronic device provided by an embodiment of the present application.
  • the processor in the electronic device can call the camera to collect facial images, perform facial image recognition, and unlock the face.
  • the processor in the electronic device can also call the camera to collect the fingerprint image, perform fingerprint image recognition and then unlock the screen fingerprint.
  • face recognition or fingerprint recognition is also required to complete identity verification.
  • FIG. 2 is a schematic structural diagram of an electronic device 100 according to an embodiment of the present application.
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, and a battery 142 , Antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 , A display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100.
  • the electronic device 100 may include more or less components than shown, or combine some components, or split some components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 is used to read the program code stored in the memory 1302 and execute the identity verification method provided in the embodiment of the present application, such as the identity verification method described in FIG. 6 or FIG. 11.
  • the processor 110 is used to read the program code stored in the memory 1302 to obtain the parameters detected by the sensor. For example, the processor 110 acquires the touch operation detected by the touch screen, the infrared light detected by the infrared detector, the pressure intensity or the amount of change in pressure intensity detected by the pressure sensor, the distance or the amount of change in distance detected by the distance sensor, and detection by the gyro sensor To the movement parameters.
  • the processor is also used to read the program code stored in the memory 1302 and move the first lens.
  • the processor 110 is used to read the program code stored in the memory 1302, control the switch for heating the memory alloy spring to close, and the first lens is driven by the memory alloy spring to a position capable of participating in image acquisition.
  • the processor 110 is used to read the program code stored in the memory 1302, and control the motor to drive the first lens to a position capable of participating in image acquisition.
  • the processor 110 is used to read the program code stored in the memory 1302, control the switch for heating the memory alloy spring to be opened, and the first lens is driven by the memory alloy spring to move away from a position capable of participating in image acquisition.
  • the processor 110 is used to read the program code stored in the memory 1302, and controls the motor to move the first lens away from the position capable of participating in image acquisition.
  • the camera 193 may include a first lens, a second lens, and an image sensor.
  • the camera 193 may be the camera described in any one of FIGS. 7-10.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), and an image signal processor. (image) signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural-network processing unit (NPU) Wait.
  • image image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • different processing units may be independent devices, or may be integrated in one or more processors.
  • the controller may be the nerve center and command center of the electronic device 100.
  • the controller can generate the operation control signal according to the instruction operation code and the timing signal to complete the control of fetching instructions and executing instructions.
  • the processor 110 may also be provided with a memory for storing instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory may store instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. The repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
  • the processor 110 may include one or more interfaces.
  • Interfaces can include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit, sound, I2S) interface, pulse code modulation (pulse code modulation (PCM) interface, universal asynchronous transceiver (universal asynchronous) receiver / transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input / output (GPIO) interface, subscriber identity module (SIM) interface, and / Or universal serial bus (USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input / output
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL).
  • the processor 110 may include multiple sets of I2C buses.
  • the processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces.
  • the processor 110 may couple the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100.
  • the I2S interface can be used for audio communication.
  • the processor 110 may include multiple sets of I2S buses.
  • the processor 110 may be coupled to the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170.
  • the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, to realize the function of answering the phone call through the Bluetooth headset.
  • the PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals.
  • the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.
  • the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface to realize the function of answering the call through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • the UART interface is generally used to connect the processor 110 and the wireless communication module 160.
  • the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function.
  • the audio module 170 may transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
  • the MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193.
  • MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI) and so on.
  • the processor 110 and the camera 193 communicate through a CSI interface to implement the shooting function of the electronic device 100.
  • the processor 110 and the display screen 194 communicate through the DSI interface to realize the display function of the electronic device 100.
  • the GPIO interface can be configured via software.
  • the GPIO interface can be configured as a control signal or a data signal.
  • the GPIO interface may be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like.
  • GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface 130 is an interface that conforms to the USB standard, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.
  • the USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones and play audio through the headphones.
  • the interface can also be used to connect other electronic devices, such as AR devices.
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic description, and does not constitute a limitation on the structure of the electronic device 100.
  • the electronic device 100 may also use different interface connection methods in the foregoing embodiments, or a combination of multiple interface connection methods.
  • the charging management module 140 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 140 may receive the charging input of the wired charger through the USB interface 130.
  • the charging management module 140 may receive wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters.
  • the power management module 141 may also be disposed in the processor 110.
  • the power management module 141 and the charging management module 140 may also be set in the same device.
  • the wireless communication function of the electronic device 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide a wireless communication solution including 2G / 3G / 4G / 5G and the like applied to the electronic device 100.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like.
  • the mobile communication module 150 can receive the electromagnetic wave from the antenna 1, filter and amplify the received electromagnetic wave, and transmit it to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it to electromagnetic wave radiation through the antenna 1.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110.
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low-frequency baseband signal to be transmitted into a high-frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is processed by the baseband processor and then passed to the application processor.
  • the application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194.
  • the modem processor may be an independent device.
  • the modem processor may be independent of the processor 110, and may be set in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (bluetooth, BT), and global navigation satellites that are applied to the electronic device 100. Wireless communication solutions such as global navigation (satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives the electromagnetic wave via the antenna 2, frequency-modulates and filters the electromagnetic wave signal, and sends the processed signal to the processor 110.
  • the wireless communication module 160 may also receive the signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and convert it to electromagnetic waves through the antenna 2 to radiate it out.
  • the antenna 1 of the electronic device 100 and the mobile communication module 150 are coupled, and the antenna 2 and the wireless communication module 160 are coupled so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global mobile communication system (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long-term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and / or IR technology, etc.
  • the GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidou navigation system (BDS), and a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and / or satellite-based augmentation system (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS beidou navigation system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation system
  • the electronic device 100 realizes a display function through a GPU, a display screen 194, and an application processor.
  • the GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations, and is used for graphics rendering.
  • the processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos and the like.
  • the display screen 194 includes a display panel.
  • the display panel may use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode (active-matrix organic light) emitting diode, AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc.
  • the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • the electronic device 100 can realize a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • the ISP processes the data fed back by the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, and the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, which is converted into an image visible to the naked eye.
  • ISP can also optimize the algorithm of image noise, brightness and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be set in the camera 193.
  • the camera 193 is used to capture still images or videos.
  • the object generates an optical image through the lens and projects it onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (charge coupled device, CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CCD charge coupled device
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
  • the digital signal processor is used to process digital signals. In addition to digital image signals, it can also process other digital signals. For example, when the electronic device 100 is selected at a frequency point, the digital signal processor is used to perform Fourier transform on the energy at the frequency point.
  • Video codec is used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
  • MPEG moving picture experts group
  • NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • the NPU can realize applications such as intelligent recognition of the electronic device 100, such as image recognition, face recognition, voice recognition, and text understanding.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.
  • the internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area may store an operating system, at least one function required application programs (such as sound playback function, image playback function, etc.) and so on.
  • the storage data area may store data (such as audio data, phone book, etc.) created during use of the electronic device 100 and the like.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and so on.
  • a non-volatile memory such as at least one disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and so on.
  • the electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, and an application processor. For example, music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and also used to convert analog audio input into digital audio signal.
  • the audio module 170 can also be used to encode and decode audio signals.
  • the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.
  • the speaker 170A also called “speaker” is used to convert audio electrical signals into sound signals.
  • the electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • the receiver 170B also known as "handset" is used to convert audio electrical signals into sound signals.
  • the voice can be received by bringing the receiver 170B close to the ear.
  • Microphone 170C also known as “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 170C through a person's mouth, and input a sound signal to the microphone 170C.
  • the electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C. In addition to collecting sound signals, it may also implement a noise reduction function. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
  • the headset interface 170D is used to connect wired headsets.
  • the earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile electronic device (open mobile terminal) platform (OMTP) standard interface, the American Telecommunications Industry Association (cellular telecommunications industry association of the United States, CTIA) standard interface.
  • OMTP open mobile electronic device
  • CTIA cellular telecommunications industry association of the United States
  • the pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal.
  • the pressure sensor 180A may be provided on the display screen 194.
  • the capacitive pressure sensor may be a parallel plate including at least two conductive materials. When force is applied to the pressure sensor 180A, the capacitance between the electrodes changes.
  • the electronic device 100 determines the intensity of the pressure according to the change in capacitance.
  • the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A.
  • the electronic device 100 may also calculate the touched position based on the detection signal of the pressure sensor 180A.
  • touch operations that act on the same touch position but have different touch operation intensities may correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
  • the gyro sensor 180B may be used to determine the movement posture of the electronic device 100.
  • the angular velocity of the electronic device 100 around three axes ie, x, y, and z axes
  • the gyro sensor 180B can be used for shooting anti-shake.
  • the gyro sensor 180B detects the shaking angle of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shaking of the electronic device 100 through reverse movement to achieve anti-shake.
  • the gyro sensor 180B can also be used for navigation and somatosensory game scenes.
  • the air pressure sensor 180C is used to measure air pressure.
  • the electronic device 100 calculates the altitude by using the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
  • the magnetic sensor 180D includes a Hall sensor.
  • the electronic device 100 can detect the opening and closing of the flip holster using the magnetic sensor 180D.
  • the electronic device 100 may detect the opening and closing of the clamshell according to the magnetic sensor 180D.
  • characteristics such as automatic unlocking of the flip cover are set.
  • the acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to recognize the posture of electronic devices, and be used in applications such as horizontal and vertical screen switching and pedometers.
  • the distance sensor 180F is used to measure the distance.
  • the electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting scenes, the electronic device 100 may use the distance sensor 180F to measure distance to achieve fast focusing.
  • the proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode.
  • the light emitting diode may be an infrared light emitting diode.
  • the electronic device 100 emits infrared light outward through the light emitting diode.
  • the electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it may be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there is no object near the electronic device 100.
  • the electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power.
  • the proximity light sensor 180G can also be used in leather case mode, pocket mode automatically unlocks and locks the screen.
  • the ambient light sensor 180L is used to sense the brightness of ambient light.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light.
  • the ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touch.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the electronic device 100 can utilize the collected fingerprint characteristics to unlock the screen fingerprints, access applications, take pictures with fingerprints, and answer incoming calls with fingerprints.
  • the temperature sensor 180J is used to detect the temperature.
  • the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 performs performance reduction of the processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In some other embodiments, when the temperature is below another threshold, the electronic device 100 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.
  • Touch sensor 180K also known as "touch panel”.
  • the touch sensor 180K may be provided on the display screen 194, and the touch sensor 180K and the display screen 194 constitute a touch screen, also called a "touch screen”.
  • the touch sensor 180K is used to detect a touch operation acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the visual output related to the touch operation can be provided through the display screen 194.
  • the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the location where the display screen 194 is located.
  • the bone conduction sensor 180M can acquire vibration signals.
  • the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human body part.
  • the bone conduction sensor 180M can also contact the pulse of the human body and receive a blood pressure beating signal.
  • the bone conduction sensor 180M may also be provided in the earphone and combined into a bone conduction earphone.
  • the audio module 170 may parse out the voice signal based on the vibration signal of the vibrating bone block of the voice part acquired by the bone conduction sensor 180M to realize the voice function.
  • the application processor may analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M to implement the heart rate detection function.
  • the key 190 includes a power-on key, a volume key, and the like.
  • the key 190 may be a mechanical key. It can also be a touch button.
  • the electronic device 100 can receive key input and generate key signal input related to user settings and function control of the electronic device 100.
  • the motor 191 may generate a vibration prompt.
  • the motor 191 can be used for vibration notification of incoming calls and can also be used for touch vibration feedback.
  • touch operations applied to different applications may correspond to different vibration feedback effects.
  • the motor 191 can also correspond to different vibration feedback effects.
  • Different application scenarios for example: time reminder, receiving information, alarm clock, game, etc.
  • Touch vibration feedback effect can also support customization.
  • the indicator 192 may be an indicator light, which may be used to indicate a charging state, a power change, and may also be used to indicate a message, a missed call, a notification, and the like.
  • the SIM card interface 195 is used to connect a SIM card.
  • the SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
  • the electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.
  • the same SIM card interface 195 can insert multiple cards at the same time. The types of the multiple cards may be the same or different.
  • the SIM card interface 195 can also be compatible with different types of SIM cards.
  • the SIM card interface 195 can also be compatible with external memory cards.
  • the electronic device 100 interacts with the network through a SIM card to realize functions such as call and data communication.
  • the electronic device 100 uses eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
  • the software system of the electronic device 100 may adopt a layered architecture, event-driven architecture, micro-core architecture, micro-service architecture, or cloud architecture.
  • the embodiment of the present application takes an Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 by way of example.
  • FIG. 3 is a block diagram of a software structure of an electronic device 100 provided by the pickup embodiment.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor.
  • the layers communicate with each other through a software interface.
  • the Android system is divided into four layers, from top to bottom are the application layer, the application framework layer, the Android runtime and the system library, and the kernel layer.
  • the application layer may include a series of application packages.
  • the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
  • the application framework layer provides an application programming interface (application programming interface) and programming framework for applications at the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and so on.
  • the window manager is used to manage window programs.
  • the window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, intercept the screen, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications.
  • the data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls for displaying text and controls for displaying pictures.
  • the view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • a display interface including an SMS notification icon may include a view that displays text and a view that displays pictures.
  • the phone manager is used to provide the communication function of the electronic device 100. For example, the management of the call state (including connection, hang up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear after a short stay without user interaction.
  • the notification manager is used to notify the completion of downloading, message reminders, etc.
  • the notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or scroll bar text, such as a notification for an application running in the background, or a notification that appears on the screen in the form of a dialog window.
  • the text message is displayed in the status bar, a prompt sound is emitted, the electronic device vibrates, and the indicator light flashes.
  • Android Runtime includes core library and virtual machine. Android runtime is responsible for the scheduling and management of the Android system.
  • the core library contains two parts: one part is the function function that Java language needs to call, and the other part is the core library of Android.
  • the application layer and the application framework layer run in the virtual machine.
  • the virtual machine executes the java files of the application layer and the application framework layer into binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
  • the system library may include multiple functional modules. For example: surface manager (surface manager), media library (Media library), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
  • surface manager surface manager
  • media library Media library
  • 3D graphics processing library for example: OpenGL ES
  • 2D graphics engine for example: SGL
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports a variety of commonly used audio, video format playback and recording, and still image files.
  • the media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to realize 3D graphics drawing, image rendering, synthesis, and layer processing.
  • the 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
  • the workflow of the software and hardware of the electronic device 100 will be exemplarily described in conjunction with capturing a photographing scene.
  • the touch sensor 180K receives the touch operation
  • the corresponding hardware interrupt is sent to the kernel layer.
  • the kernel layer processes touch operations into original input events (including touch coordinates, time stamps and other information of touch operations).
  • the original input events are stored in the kernel layer.
  • the application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation, for example, the control corresponding to the click operation is a camera application icon.
  • the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer.
  • the camera 193 captures a still image or video.
  • the camera in the electronic device can be used for face recognition to unlock the electronic device, and can also be used for screen fingerprint recognition to unlock the electronic device.
  • the processor in the electronic device recognizes the scene where the face is unlocked, the focal length of the lens in the camera is increased to increase the object distance imaged by the camera, and the camera is used to collect the face image. Use the collected face images to perform face recognition and then unlock the electronic device.
  • the focal length of the lens in the camera is reduced to reduce the object distance imaged by the camera.
  • the camera can collect both face images and fingerprint images, which can save the internal space of the electronic device and reduce the complexity of the display manufacturing process brought by the camera.
  • the focal length can measure the degree of concentration or divergence of light, and refers to the distance from the optical center to the focal point of light focusing.
  • the lens of the camera may include a group of lenses, and when the light parallel to the main optical axis passes through the lens, it will converge to a point, namely the focal point.
  • the distance from the focal point to the optical center is called the focal length.
  • the lens whose focal length can be adjusted is a zoom lens.
  • the object distance is the distance between the object and the optical center.
  • the image distance is the distance between the optical center and the image sensor.
  • FIG. 4 is a schematic diagram of a focal length and an object distance in a camera provided by an embodiment of the present application.
  • the focal length can also be regarded as the distance from the optical center to the imaging plane where the image sensor is located.
  • the lens can be adjusted to infinity, and the distance between the optical center of the lens and the image sensor can be adjusted to the focal length, so that distant objects can form a clear image on the image sensor .
  • the optical center of the lens can usually be adjusted as far away from the image sensor as possible, so that objects with limited distance can be clearly imaged on the image sensor.
  • the shooting distance is the shooting distance, which is the distance between the image sensor and the subject, at which the subject can form a clear image on the image sensor.
  • the clear image can provide enough face image features to realize face unlocking
  • the screen fingerprint unlocking scenario provided by the embodiment of the present application, the clear image can provide sufficient Fingerprint features to unlock screen fingerprints.
  • a concave lens or a convex lens can be added to the camera to increase the focal length, thereby increasing the shooting distance so that the subject is clearly imaged on the image sensor.
  • the focal length of the camera can be adjusted smaller to increase the distance.
  • a convex lens or a concave lens can be added to the lens group of the lens to reduce the focal length, thereby reducing the shooting distance to make the subject image clearly on the image sensor.
  • the face unlocking process can include four steps: Step 1: Face image collection and detection.
  • Step 2 Face image preprocessing.
  • Step 3 Face image feature extraction.
  • Step 4 Match and identify.
  • step one collecting a face image may be implemented using a camera.
  • the camera can collect an image of the face. Face detection is to mark the position and size of the face in the collected image.
  • step two the image is preprocessed to serve step three, which includes performing face light compensation, grayscale transformation, histogram equalization, normalization, geometric correction, filtering, and sharpening.
  • step three the extracted face image features can be used to match the feature templates in the feature database.
  • the facial image features may include visual features, pixel statistical features, facial image transform coefficient features, facial image algebraic features, and so on.
  • step four the feature data of the face image extracted in step three is searched and matched with the feature template stored in the database.
  • a threshold can be set, and when the similarity exceeds this threshold, the matching result is output.
  • Face recognition is to compare the face features to be recognized with the obtained face feature templates, and judge the identity information of the face according to the degree of similarity. In the face unlocking scenario, if the degree of similarity is greater than a certain threshold, the electronic device is unlocked.
  • Screen fingerprint recognition is realized by the photoelectric fingerprint recognition technology of the fingerprint sensor under the screen.
  • the light from the display illuminates the fingerprint pattern.
  • the light reflected from the fingerprint pattern is captured by the fingerprint sensor under the screen to form a fingerprint image.
  • the comparison process may be to extract fingerprint image features and compare with pre-stored feature templates. When the similarity exceeds a certain threshold, it indicates a successful match.
  • the electronic device may be in a locked state, and the user's authority to operate the electronic device is limited in the locked state. After verifying the user's identity, the user can operate the electronic device. Unlocking the electronic device may refer to releasing the locked state of the electronic device. After the lock state is released, the electronic device can call various applications, such as APPs such as "camera”, "music", and "video” in response to user operations.
  • the methods for verifying the user's identity may include: lock screen password verification, unlock pattern verification, screen fingerprint verification, and face verification.
  • the lock screen password verification refers to verifying whether the characters entered by the user are the same as the pre-stored lock screen password.
  • the unlock pattern verification refers to verifying whether the touch trajectory pattern input by the user is the same as the pre-stored pattern.
  • screen fingerprint verification and face verification please refer to the previous descriptions of screen fingerprint unlocking and face unlocking.
  • the application is in a locked state before being unlocked, and the user's permission to operate the application is limited in the locked state.
  • Unlocking the application may refer to unlocking the locked state of the application.
  • each function control in the application can respond to the user's operation.
  • the following describes an example of a camera provided by an embodiment of the present application.
  • the embodiment of the present application takes the unlocked scene as an example to introduce the specific implementation process of the camera collecting a face image and collecting a fingerprint image. It is understandable that the embodiments of the present application can also be extended to scenarios such as payment, identity verification, and unlocking applications. In these scenarios, the implementation process of fingerprint recognition and face recognition can be analogized to the scenario of unlocking an electronic device.
  • FIG. 5 is a schematic structural diagram of a camera provided by an embodiment of the present application.
  • the camera includes at least two lenses and an image sensor 220.
  • the at least two lenses may include a lens 300 and a lens 210.
  • the lens 300 may participate in the image collection of the photographed object, or may not participate in the image collection of the photographed object.
  • the embodiment of the present application is described by taking at least two lenses as two lenses 300 and 210 as an example. It can be understood that the embodiment of the present application can also be extended to the camera including more lenses.
  • the at least two lenses and the image sensor 220 can be used for the electronic device 10 to perform face unlocking and screen fingerprint unlocking.
  • the combination of lens 210 and image sensor 220 corresponds to one unlocking method in face unlocking and screen fingerprint unlocking
  • the combination of lens 300, lens 210 and image sensor 220 corresponds to another unlocking in face unlocking and screen fingerprint unlocking the way.
  • the following two cases are described in detail: (a) The combination of the lens 210 and the image sensor 220 corresponds to unlocking the face, and the combination of the lens 300, the lens 210 and the image sensor 220 corresponds to unlocking the screen fingerprint. (b) The combination of the lens 210 and the image sensor 220 corresponds to unlocking the screen fingerprint, and the combination of the lens 300, the lens 210 and the image sensor 220 corresponds to unlocking the face.
  • the combination of the lens 210 and the image sensor 220 corresponds to unlocking the face, and the combination of the lens 300, the lens 210 and the image sensor 220 corresponds to unlocking the screen fingerprint.
  • the lens 210 and the image sensor 220 in the camera can be used to collect a face image, so that the face can form a clear face image on the image sensor 220 through the lens 210, and then unlock the face.
  • the face is taken as the subject, and the corresponding distance can be within the preset distance range to form a clear face image on the image sensor 220, the clear face image can provide Enough face image features to unlock faces.
  • the camera composed of the lens 210 and the image sensor 220 may form a clear face image on the image sensor 220 through autofocus.
  • the lens 300 may be a convex lens. Specifically, when the lens 300, the lens 210, and the image sensor 220 in the camera participate in image collection, they can be used to collect fingerprint images, so that the fingerprint can form a clear fingerprint image on the image sensor 220 through the lens 300 and the lens 210.
  • the clear fingerprint image can provide enough fingerprint features to realize fingerprint unlocking.
  • the fingerprint is taken as the object, and the corresponding distance may be that a clear fingerprint image can be formed on the image sensor 220 within a preset distance range to unlock the screen fingerprint.
  • the camera composed of the lens 300, the lens 210, and the image sensor 220 may form a clear fingerprint image on the image sensor 220 through autofocus.
  • an optional auto-focusing principle is that the lens 210 in the camera can be driven by the motor to move along the optical axis to achieve focusing.
  • the motor drive chip to output the corresponding current
  • the camera picks up the image, and the sharpness of the picked up image determines whether the lens has reached the clear position of the captured image.
  • the above autofocus principle is only used to explain the embodiments of the present application, and should not be construed as limiting, and other methods may be used for focusing in the embodiments of the present application.
  • the combination of the lens 210 and the image sensor 220 corresponds to unlocking the screen fingerprint
  • the combination of the lens 300, the lens 210 and the image sensor 220 corresponds to unlocking the face.
  • the lens 210 and the image sensor 220 in the camera can be used to collect fingerprint images, so that the fingerprint can form a clear fingerprint image on the image sensor 220 through the lens 210, and then unlock the screen fingerprint.
  • the fingerprint is taken as the object, and the corresponding distance may be that a clear fingerprint image can be formed on the image sensor 220 within a preset distance range to unlock the screen fingerprint.
  • the camera composed of the lens 210 and the image sensor 220 may form a clear fingerprint image on the image sensor 220 through autofocus.
  • the lens 300 may be a concave lens.
  • the camera including the lens 300, the lens 210, and the image sensor 220 can be used to collect a face image, so that the face can form a clear face image on the image sensor 220 through the lens 300, the lens 210, and then realize the face unlock .
  • the face is taken as the object, and the corresponding distance may be that a clear face image can be formed on the image sensor 220 within a preset distance range to achieve face unlock.
  • the camera composed of the lens 300, the lens 210, and the image sensor 220 may form a clear face image on the image sensor 220 through autofocus.
  • the lens 210 and the image sensor 220 may be packaged together.
  • the lens 300, the lens 210, and the image sensor 220 may be located below the display plane of the display screen 500.
  • the lens 300 may be connected to the structural member 600 through the movable bracket 400.
  • the structural member 600 can be used to fix the display screen.
  • the lens 300 can rotate or move with the movable bracket 400, so that the lens 300 can participate in the image collection of the subject, or can be moved away from the position capable of participating in the image collection, so that only the camera including the lens 210 and the image sensor 220 participates in the Image collection of photographic objects.
  • the structural member 600 may be a middle frame of an electronic device.
  • the electronic device 10 may further include an infrared transmitter 700.
  • the infrared transmitter 700 may be fixed on the main board 800.
  • the camera may be an infrared camera, that is, the image sensor in the camera may receive infrared light reflected by the object to collect an image of the object.
  • the lens 210 and the image sensor 220 in the camera may participate in image acquisition, or the lens 300, the lens 210, and the image sensor 220 may participate in image acquisition.
  • the infrared transmitter 700 can periodically emit infrared light, which is projected onto the object after reflection and can be collected by the camera, thereby realizing the collection of the image of the object.
  • the infrared transmitter 700 and the infrared camera are used to unlock the face. In a scene with insufficient external light, such as at night, the face can still be unlocked, thereby improving the convenience of unlocking the face.
  • the infrared transmitter 700 and infrared camera are used to unlock the screen fingerprint, without lighting the display screen to provide light to collect the fingerprint image, which can reduce the steps of the user operation in the unlocking process, thereby improving the convenience of unlocking the screen fingerprint.
  • the combination of the second lens 210 and the image sensor 220 corresponds to face unlocking
  • the combination of the first lens 300, the second lens 210, and the image sensor 220 corresponds to unlocking the screen fingerprint.
  • FIG. 6 is a schematic flowchart of an electronic device unlocking method provided by an embodiment of the present application.
  • the electronic device unlocking method may include steps S101-S106.
  • steps S101-S103 are the execution steps of screen fingerprint unlocking
  • steps S104-S106 are the execution steps of face unlocking.
  • the embodiment of the present application does not limit the sequence of screen fingerprint unlocking and face unlocking. Steps S104-S106 may also be executed before steps S101-S103.
  • the processor of the electronic device controls the movable bracket to rotate or move to place the first lens in a position capable of participating in image acquisition.
  • the first lens may be the lens 300 in the camera shown in FIG. 5, and the second lens may be the lens 210 in the camera shown in FIG. 5. After the first lens is placed in a position capable of participating in image collection, the camera for collecting fingerprints contains the first lens.
  • the processor in the electronic device acquires the fingerprint image collected by the first lens, the second lens, and the image sensor.
  • the processor in the electronic device unlocks the electronic device according to the acquired fingerprint image.
  • the processor of the electronic device controls the movable bracket to rotate or move to move the first lens away from the position capable of participating in image acquisition.
  • the processor in the electronic device acquires the face image collected by the second lens and the image sensor.
  • the processor in the electronic device unlocks the electronic device according to the acquired face image.
  • step S101 when the parameter detected by the sensor in the electronic device satisfies the parameter range corresponding to screen fingerprint recognition, if the first lens is at a position capable of participating in image acquisition, step S102 may be directly executed to acquire the fingerprint image.
  • step S104 when the parameter detected by the sensor in the electronic device satisfies the parameter range corresponding to face recognition, if the first lens has been moved away from a position capable of participating in image acquisition, step S105 may be directly executed to obtain a face image.
  • the camera that collects the image of the object includes the first lens, the second lens, and the image sensor.
  • the optical axis of the first lens overlaps with the optical axis of the second lens.
  • the second lens may be packaged with the image sensor, then the first lens may be between the display screen and the second lens, and the optical axis of the first lens may overlap the optical axis of the second lens.
  • adding or reducing the first lens in the camera can realize two unlocking methods of the electronic device, thereby saving physical space inside the electronic device.
  • only one camera needs to be processed at a corresponding position on the display screen, which reduces the processing steps for processing on the display screen.
  • the movable bracket may be the movable bracket 400 in the camera shown in FIG. 5.
  • the rotation or movement of the movable bracket can drive the first lens to participate in or not participate in the image collection of the photographed object.
  • the rotation or movement of the movable bracket can be realized by using a memory alloy spring, or by a motor and a guide rail. The following respectively introduces an implementation example of the first lens driven by the memory alloy spring, and introduces an implementation example of the first lens driven by the motor and the guide rail.
  • shape memory function of shape memory alloys can be used to rotate the movable bracket, thereby driving the first lens to rotate.
  • Shape memory alloy is a kind of intelligent material that can remember the original shape. When the alloy is subjected to a limited plastic deformation at a temperature below the phase transformation temperature, it can be restored to its original shape before deformation by heating. For the shape memory alloy with double pass memory effect, the shape corresponding to high temperature can be restored when heated, and the shape corresponding to low temperature can be restored when cooled.
  • the first lens 300 can rotate with the movable bracket 400, so that the first lens 300 can participate in the image acquisition of the subject, and can also be moved away from the position capable of participating in the image acquisition, so that the first The second lens 210 and the image sensor 220 participate in the image collection of the subject.
  • the first lens is the lens 300 in the context and the second lens is the lens 210 in the context.
  • FIG. 7 is a schematic structural diagram of a movable bracket provided by an embodiment of the present application for rotating the first lens to a position capable of participating in image acquisition.
  • the rotation of the movable bracket puts the first lens 300 in a position capable of participating in image acquisition to unlock the screen fingerprint.
  • a memory alloy spring 900 made of a shape memory alloy may be fixed on the movable bracket 400.
  • the first position of the memory alloy spring 900 is fixed and cannot rotate or move with the deformation of the memory alloy spring 900.
  • the position of the second end of the memory alloy spring 900 can rotate with the deformation of the memory alloy spring 900, thereby driving the movable bracket 400 and the first lens 300 fixed on the movable bracket 400 rotates.
  • the memory alloy spring 900 may be helical.
  • step S101 when the parameter detected by the sensor in the electronic device satisfies the parameter range corresponding to screen fingerprint recognition, the processor in the electronic device enables the control power source to change the temperature of the memory alloy spring 900.
  • the processor enables the control switch to be closed to heat the memory alloy spring 900 to rotate the second end of the memory alloy spring 900 to rotate the movable bracket 400 and the first lens 300 fixed on the movable bracket 400. Move the first lens 300 to a position capable of participating in image collection to participate in fingerprint image collection. As shown in FIG.
  • the second lens 210 and the image sensor 220 can be packaged together, and the focal length and shooting distance of the first lens 300 and the second lens 210 can be set so that the image sensor 220 can pass through the first lens 300 and the second lens 210 Collect a clear fingerprint image of the fingerprint from the surface of the display screen.
  • the clear fingerprint image can provide enough fingerprint features to unlock the electronic device.
  • the first lens 300 may be a convex lens.
  • the power supply can act on the memory alloy spring 900, which can be directly connected to both ends of the memory alloy spring 900 through a switch, or can be connected to both ends of an electric heating wire through a switch, and the electric heating wire is used to heat the memory alloy spring 900 .
  • FIG. 8 is a schematic structural diagram of a movable bracket provided by an embodiment of the present application for rotating the first lens away from a position capable of participating in image acquisition.
  • the rotation of the movable bracket moves the first lens away from the position where it can participate in image acquisition to unlock the face.
  • the processor in the electronic device enables the control power source to change the temperature of the memory alloy spring 900.
  • the processor enable control switch in the electronic device is turned off to lower the temperature of the memory alloy spring 900 to rotate the second end of the memory alloy spring 900 to drive the movable bracket 400 and the first lens 300 fixed on the movable bracket 400 to rotate.
  • the first lens 300 is moved away from a position capable of participating in image collection, and does not participate in the collection of face images.
  • the focal length of the second lens 210 and the photographing distance of the camera can be set in the camera 20 so that the image sensor 220 can collect clear face images from faces other than the display screen through the second lens 210.
  • the clear face image can provide enough face image features to unlock the electronic device.
  • the memory alloy spring 900 is used to drive the movable bracket 400 and the first lens 300 fixed on the movable bracket 400 to rotate to correspond to face unlocking and screen fingerprint unlocking, and there may be other designs, which are not limited in the embodiments of the present application.
  • the movement of the movable bracket can be used to drive the first lens, so that the first lens 300 participates or does not participate in the camera to collect the image of the object.
  • FIG. 9 is a schematic structural diagram of moving a movable bracket to place a first lens in a position capable of participating in image acquisition according to an embodiment of the present application.
  • the movable bracket 400 moves to place the first lens 300 in a position capable of participating in image acquisition to unlock the screen fingerprint.
  • the movable bracket 400 can move on the guide rail 1000.
  • the guide rail 1000 can be rotated by the motor 1100 to move the movable bracket 400 and the first lens 300 fixed on the movable bracket 400 to a position capable of participating in image acquisition, or the movable bracket 400 and the first fixed on the movable bracket 400
  • the lens 300 is moved away from a position capable of participating in image acquisition.
  • the outer side of the guide rail 1000 may include threads.
  • the nut can engage with the thread and move along the guide rail as the guide rail rotates.
  • the movable bracket 400 may be fixed on the nut, and may move along the guide rail as the nut moves.
  • step S101 as shown in FIG. 9, when the parameter detected by the sensor in the electronic device satisfies the parameter range corresponding to the screen fingerprint recognition, the processor driving motor 1100 in the electronic device drives the guide rail 1000 to rotate, and the movable bracket 400 fixed on the nut And the first lens 300 fixed on the movable bracket 400 moves in the direction of the guide rail, so that the first lens 300 moves to a position capable of participating in image acquisition. Move the first lens 300 to a position capable of participating in image collection to participate in fingerprint image collection. As shown in FIG.
  • the second lens 210 and the image sensor 220 may be packaged together, and the focal length and shooting distance of the first lens 300 and the second lens 210 may be set so that the image sensor 220 can pass through the first lens 300 and the second lens 210 Collect a clear fingerprint image of the fingerprint from the surface of the display screen.
  • the clear fingerprint image can provide enough fingerprint features to unlock the electronic device.
  • the first lens 300 may be a convex lens.
  • step S104 is a schematic structural diagram of a movable bracket moving an embodiment to move the first lens away from a position capable of participating in image acquisition.
  • the movement of the movable bracket 400 moves the first lens 300 away from the position capable of participating in image acquisition to unlock the face.
  • the processor in the electronic device enables the control motor 1100 to drive the guide rail 1000 to rotate, and the movable bracket 400 fixed on the nut and the fixed
  • the first lens 300 on the movable bracket 400 moves in the direction of the guide rail, so that the first lens 300 is moved away from a position capable of participating in image acquisition.
  • the rotation direction of the guide rail 1000 is opposite to the rotation direction of the guide rail 1000 shown in FIG. 9, and the direction in which the first lens 300 moves along the guide rail 1000 is opposite to the direction along the guide rail 1000 shown in FIG. 9.
  • the focal length of the second lens 210 and the camera's distance can be set in the camera 20 so that the image sensor 220 can collect clear face images from faces other than the display screen through the second lens 210.
  • the clear face image can provide enough face image features to unlock the electronic device.
  • FIGS. 9 and 10 are only used to explain the embodiments of the present application, and should not constitute a limitation.
  • the motor 1100 and the guide rail 1000 are used to drive the movable bracket 400 and the first lens 300 fixed on the movable bracket 400 to correspond to face unlocking and screen fingerprint unlocking, and other designs are also possible, which are not limited in the embodiments of the present application.
  • the combination of the second lens 210 and the image sensor 220 corresponds to unlocking the screen fingerprint
  • the combination of the first lens 300, the second lens 210, and the image sensor 220 corresponds to unlocking the face.
  • FIG. 11 is a schematic flowchart of another method for unlocking an electronic device according to an embodiment of the present application.
  • screen fingerprint unlocking and face unlocking include steps S210-S206.
  • steps S201-S203 are the execution steps of screen fingerprint unlocking
  • steps S204-S206 are the execution steps of face unlocking.
  • the embodiment of the present application does not limit the sequence of screen fingerprint unlocking and face unlocking. Specifically, steps S204-S206 may also be executed before steps S201-S203.
  • the processor of the electronic device controls the movable bracket to rotate or move to move the first lens away from the position capable of participating in image acquisition.
  • the processor in the electronic device acquires the fingerprint image collected by the second lens and the image sensor.
  • the processor in the electronic device unlocks the electronic device according to the acquired fingerprint image.
  • the processor of the electronic device controls the movable bracket to rotate or move to move the first lens to a position capable of participating in image acquisition.
  • the processor in the electronic device acquires the face image collected by the first lens, the second lens, and the image sensor.
  • the processor in the electronic device unlocks the electronic device according to the acquired face image.
  • FIG. 7 and FIG. 8 use the memory alloy spring to drive the movable bracket to rotate to realize the switching between face unlocking and screen fingerprint unlocking.
  • 9 and 10 use the motor and the guide rail to move the movable bracket to realize the switch between unlocking the face and unlocking the fingerprint on the screen.
  • the following describes an implementation example of a first lens driven by a memory alloy spring with reference to FIGS. 7-10, and introduces an implementation example of a first lens driven by a motor and a guide rail.
  • Memory alloy spring drives the first lens
  • the processor in the electronic device enables the control power source to change the temperature of the memory alloy spring 900.
  • the processor enable control switch in the electronic device is turned off to lower the temperature of the memory alloy spring 900 to rotate the second end of the memory alloy spring 900 to drive the movable bracket 400 and the first lens 300 fixed on the movable bracket 400 to rotate.
  • the first lens 300 is removed from the camera and does not participate in the fingerprint image collection.
  • the focal length of the second lens 210 and the shooting distance of the camera can be set in the camera 20 so that the image sensor 220 can collect a clear fingerprint image from the surface of the display screen through the second lens 210.
  • the clear fingerprint image can provide enough fingerprint features to unlock the electronic device.
  • the processor in the electronic device enables the control power source to change the temperature of the memory alloy spring 900.
  • the processor enables the control switch to be closed to heat the memory alloy spring 900 to rotate the second end of the memory alloy spring 900 to rotate the movable bracket 400 and the first lens 300 fixed on the movable bracket 400.
  • the first lens 300 is moved to a position capable of participating in image collection to participate in image collection of a human face. As shown in FIG.
  • the second lens 210 and the image sensor 220 can be packaged together, and the focal length and shooting distance of the first lens 300 and the second lens 210 can be set so that the image sensor 220 can pass through the first lens 300 and the second lens 210
  • a clear face image from a face other than the screen is collected.
  • the clear face image can provide enough face image features to unlock the electronic device.
  • the first lens 300 may be a concave lens.
  • the first lens is driven by the motor and the guide rail
  • the combination of the second lens 210 and the image sensor 220 corresponds to unlocking the screen fingerprint
  • the combination of the first lens 300, the second lens 210, and the image sensor 220 corresponds to unlocking the face.
  • the process of screen fingerprint unlocking and face unlocking in conjunction with Figure 9 and Figure 10 is as follows:
  • the processor in the electronic device enables the control motor 1100 to drive the guide rail 1000 to rotate, moving the movable bracket 400 fixed on the nut and the first lens 300 fixed on the movable bracket 400 along the direction of the guide rail, so that the first The lens 300 is moved away from a position capable of participating in image acquisition.
  • the first lens 300 does not participate in the collection of fingerprint images.
  • the focal length of the second lens 210 and the shooting distance of the camera can be set in the camera 20 so that the image sensor 220 can collect a clear fingerprint image from the surface of the display screen through the second lens 210.
  • the clear fingerprint image can provide enough fingerprint features to unlock the electronic device.
  • the first lens 300 may be a concave lens.
  • the processor driving motor 1100 drives the guide rail 1000 to rotate, and moves the movable bracket 400 fixed on the nut and the first lens 300 fixed on the movable bracket 400 along the direction of the guide rail, so that the first lens 300 moves to be able to participate in image acquisition s position.
  • the first lens 300 is moved to a position capable of participating in image collection to participate in image collection of a human face. As shown in FIG.
  • the second lens 210 and the image sensor 220 may be packaged together, and the focal length and shooting distance of the first lens 300 and the second lens 210 may be set so that the image sensor 220 can pass through the first lens 300 and the second lens 210
  • a clear face image from a face other than the screen is collected.
  • the clear face image can provide enough face image features to unlock the electronic device.
  • FIGS. 7-10 are only used to explain the embodiments of the present application, and should not constitute a limitation.
  • the motor 1100 and the guide rail 1000 are used to drive the movable bracket 400 and the first lens 300 fixed on the movable bracket 400 to correspond to face unlocking and screen fingerprint unlocking, and other designs are also possible, which are not limited in the embodiments of the present application.
  • the memory alloy spring 900 is used to drive the movable bracket 400 and the first lens 300 fixed on the movable bracket 400 to rotate to correspond to face unlocking and screen fingerprint unlocking, and there may be other designs, which are not limited in the embodiments of the present application.
  • the switch when the switch is closed and the memory alloy spring 900 is heated, the first lens is moved away from the position capable of participating in image acquisition. When the switch is off, move the first lens to a position where it can participate in image acquisition.
  • FIGS. 7-10 show that in the camera, when the first lens participates in image acquisition, it may also be located between the second lens and the image sensor, which is not limited in the embodiments of the present application.
  • the camera corresponding to any of screen fingerprint unlocking and face unlocking may be set to an initial state.
  • This initial state corresponds to an unlocking method among screen fingerprint unlocking and face unlocking.
  • the camera can be restored to the initial state.
  • the state of the camera may include two types: one includes the second lens and the image sensor, and the other includes the first lens, the second lens, and the image sensor.
  • the initial state may not be set, and after the camera collects the image of the subject to realize any unlocking method, there is no need to restore. The following describes whether to set the initial state respectively.
  • the processor in the electronic device can disconnect the memory alloy spring When heating, the corresponding camera state is set to the initial state. During the time period when the electronic device is not in the unlocking scene, no power is needed to continuously heat the memory alloy spring, which can save power consumption, reduce the accumulation of heat inside the electronic device, and extend memory The life of alloy springs.
  • the combination of the second lens 210 and the image sensor 220 corresponds to face unlocking
  • the first lens 300, the second lens 210, and the image sensor 220 The combination of corresponds to the scenario where the screen fingerprint is unlocked. If the memory alloy spring 900 is turned off and the switch is turned off, the first lens 300 is moved away from the position where it can participate in image acquisition, and face image acquisition is performed. Then, the processor in the electronic device may use the second lens 210 and the image sensor 220 used for unlocking the face to participate in image recognition as the initial state.
  • step S101 is executed, that is, the switch closes the heating memory alloy spring 900, the cameras of the first lens 300, the second lens 210, and the image sensor 220 collect fingerprint images, Realize screen fingerprint unlocking.
  • step S103 that is, after performing screen fingerprint unlocking, the processor in the electronic device may perform the following steps:
  • Step 1 The enable control switch is turned off, and the memory alloy spring 900 can drive the movable bracket 400 to move the first lens 300 away from the position capable of participating in image acquisition, and restore to the initial state of the camera.
  • Step 2 When the parameters detected by the sensor in the electronic device meet the corresponding parameter range of face recognition, if the camera is in the initial state, there is no need to adjust the camera, and the second lens 210 and the image sensor 220 are used to directly collect the face image to perform face Unlock.
  • the above setting of the initial state of the camera makes it unnecessary to adjust the camera in the face unlocking scene, thereby shortening the unlocking time and improving the unlocking efficiency of the electronic device.
  • the combination of the second lens 210 and the image sensor 220 corresponds to unlocking the screen fingerprint
  • the combination of 220 corresponds to a scene in which the face is unlocked. If the memory alloy spring 900 is turned off and the switch is turned off, the first lens 300 is moved away from the position capable of participating in image acquisition to perform fingerprint image acquisition. Then, the state of the camera used for unlocking the screen fingerprint can be used as the initial state. In the electronic device, the parameters detected by the sensor meet the corresponding parameter range of face recognition.
  • Step S204 is executed, that is, the switch closes the heating memory alloy spring 900, and the first lens 300, the second lens 210, and the image sensor 220 collect face images to realize human Face unlock.
  • the processor in the electronic device may perform steps S207 and S208 (not shown in FIG. 11).
  • the enable switch is turned off, and the memory alloy spring 900 can drive the movable bracket 400 to move the first lens 300 away from the position capable of participating in image acquisition, and restore the initial state of the camera.
  • the above setting of the initial state of the camera makes it unnecessary to adjust the camera in the scene of screen fingerprint unlocking, thereby shortening the unlocking time and improving the unlocking efficiency of the electronic device.
  • the camera includes a first state and a second state.
  • the first lens, the second lens, and the image sensor participate in image acquisition, that is, the first lens is located at a position where the image can be acquired.
  • the second lens and the image sensor participate in image acquisition, that is, the first lens moves away from the position where the image can be acquired.
  • the fingerprint recognition state of the camera is used to collect fingerprint images for fingerprint recognition.
  • the face recognition status of the camera is used to collect face images for face recognition.
  • the first lens, the second lens, and the image sensor collect fingerprint images, that is, the first lens is located at a position capable of capturing images.
  • the second lens and the image sensor collect the face image, that is, the first lens moves away from the position where the image can be collected.
  • the second lens and the image sensor collect the fingerprint image, that is, the first lens moves away from the position where the image can be collected.
  • the first lens, the second lens, and the image sensor collect the face image, that is, the first lens is located at a position where the image can be collected.
  • the memory alloy spring includes a third state and a fourth state.
  • the memory alloy spring becomes the third state
  • the first lens is driven by the memory alloy spring on the movable bracket to a position capable of participating in image acquisition, so that the camera is in the first state.
  • the memory alloy spring becomes the fourth state
  • the first lens is also moved away from the position capable of participating in image acquisition by the memory alloy spring on the movable bracket, so that the camera is in the second state.
  • FIGS. 7 and 8 after the electronic device processor controls the switch to close, the memory alloy spring becomes the third state. After the electronic device processor controls the switch to open, the memory alloy spring becomes the fourth state.
  • the motor drives the movable bracket to move to the first position
  • the first lens fixed on the movable bracket is driven to a position capable of participating in image acquisition, so that the camera is in the first state .
  • the motor drives the movable bracket to move to the second position
  • the first lens fixed on the movable bracket is driven to move away from the position capable of participating in image acquisition, so that the camera is in the second state.
  • the movable bracket 400 moves to the first position.
  • the movable bracket 400 moves to the second position.
  • the face can be unlocked and The camera status corresponding to any unlocking method of screen fingerprint unlocking is set to the initial state.
  • the combination of the second lens 210 and the image sensor 220 corresponds to face unlock, and the first lens 300, the second lens 210, and the image sensor 220
  • the combination of corresponds to the scenario where the screen fingerprint is unlocked, and the camera state used to unlock the face can be used as the initial state.
  • step S101 is executed, that is, the processor drive motor 1100 in the electronic device drives the guide rail 1000 to rotate, and the movable bracket 400 fixed on the nut and the movable bracket are fixed
  • the first lens 300 on 400 moves in the direction of the guide rail, so that the first lens 300 moves to a position capable of participating in image acquisition.
  • the first lens 300 is moved to a position capable of participating in image collection to participate in fingerprint image collection.
  • the processor in the electronic device may perform the following operations: enabling the control motor 1100 to drive the guide rail 1000 to rotate, and fixing the movable bracket 400 fixed on the nut and the first bracket fixed on the movable bracket 400 A lens 300 moves in the direction of the guide rail, so that the first lens 300 moves away from the position capable of participating in image acquisition, and returns to the initial state of the camera.
  • the second lens 210 and the image sensor 220 are used to directly collect face images to unlock the face.
  • the above setting of the initial state of the camera makes it unnecessary to adjust the camera in the face unlocking scene, thereby shortening the unlocking time and improving the unlocking efficiency of the electronic device.
  • the initial state of the camera state may also be obtained by performing statistical learning on user unlock data. For example, if it is statistically obtained that the number of times the user uses the screen fingerprint to unlock is much greater than the number of times the face is used to unlock, the electronic device may set the camera state corresponding to the fingerprint unlock to the initial state. Setting the initial state of the camera through machine learning can reduce the number of times to adjust the focal length of the camera, thereby improving the unlocking efficiency.
  • the fingerprint unlocking area on the display screen may flash to prompt the fingerprint unlocking area.
  • the camera state may not have an initial state. After the camera collects the image of the subject to realize any one of the unlocking methods of screen fingerprint unlocking and face unlocking, the camera does not need to be restored. After any one of the unlocking methods of screen fingerprint unlocking and face unlocking is realized by the camera, the processor in the electronic device can record the unlocking method. The next time when it is detected that the electronic device needs to be unlocked, the processor in the electronic device detects whether the unlocking method that needs to be unlocked this time is the same as the unlocking method recorded last time. If so, you can collect the image of the subject without changing the state of the camera to unlock. If not, you need to change the state of the camera to collect the image of the object to unlock.
  • the combination of the second lens 210 and the image sensor 220 corresponds to face unlocking
  • the combination of the first lens 300, the second lens 210, and the image sensor 220 Corresponding to the scenario where the screen fingerprint is unlocked, the camera does not need to restore to a certain state after the camera collects the image of the subject to achieve any one of the screen fingerprint unlocking and face unlocking.
  • the first lens 300 may still be in a position deviating from the position capable of participating in image acquisition.
  • the processor of the electronic device can perform the following steps:
  • Step1 Record the unlock method used for the n-th unlock as the face unlock.
  • Step2 In the next unlock, the parameter detected by the sensor in the electronic device during the n + 1 unlock meets the parameter range corresponding to the screen fingerprint recognition, and the processor detects the n + 1 unlock method and the nth unlock in the electronic device The unlocking method is different.
  • Step3 The processor driving motor 1100 in the electronic device drives the guide rail 1000 to rotate, and moves the movable bracket 400 fixed on the nut and the first lens 300 fixed on the movable bracket 400 in the direction of the guide rail, so that the first lens 300 moves to participate The location of the image acquisition.
  • the first lens 300 is moved to a position capable of participating in image collection to participate in fingerprint image collection. After performing screen fingerprint unlocking, the first lens 300 may still be in a position capable of participating in image acquisition.
  • step 1 if the parameter detected by the sensor in the electronic device meets the parameter range corresponding to face recognition, there is no need to adjust the camera, and the second lens 210 and the image sensor 220 are used to directly collect the face image to unlock the face. It is not necessary to adjust the camera in the face unlocking scene, thereby shortening the unlocking time and improving the unlocking efficiency of the electronic device.
  • the following describes the implementation of the scenario where the electronic device recognizes the screen fingerprint unlocking and the face unlocking scenario in the unlocking method shown in FIGS. 6 and 11 respectively.
  • the screen fingerprint unlocking scene is determined by the parameter range detected by the sensor in the electronic device satisfying the screen fingerprint identification.
  • the scene of face unlocking is determined by the parameter range detected by the sensor in the electronic device satisfying the face recognition.
  • the processor in the electronic device may determine that the screen fingerprint unlocks the scene.
  • the specific area on the display screen may be the location of the camera under the display screen.
  • One or more of the following methods can be used by the processor in the electronic device to detect that the fingerprint is close to a specific area on the display screen:
  • the capacitor is a conductor.
  • the finger draws a small current from the touch point of the touch screen. This current flows from the electrodes on the four corners of the touch screen, and the current flowing through these four electrodes is proportional to the distance from the contact point to the four corners. Through the ratio of these four currents, the position of the touch point can be calculated.
  • the processor in the electronic device may determine the screen fingerprint to unlock the scene.
  • Infrared emitters and cameras can be set below specific areas of the display.
  • the infrared emitter can periodically emit infrared rays.
  • the infrared detector can receive the infrared rays reflected by the finger.
  • the infrared detector may be a photodiode for detecting infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near a specific area of the display screen. When insufficient reflected light is detected, the electronic device can determine that there is no object near a specific area of the display screen.
  • the infrared detector can also cooperate with the ambient light sensor to detect whether the electronic device is in the pocket to prevent accidental touch.
  • the processor in the electronic device may determine the screen fingerprint to unlock the scene.
  • the sufficient infrared reflected light may be that the intensity of the reflected light is greater than or equal to the first threshold.
  • the camera can be an infrared camera, and there is no need to install an additional infrared detector, and the infrared camera can be used to realize the function of the infrared detector.
  • a pressure sensor may be provided in the display screen, and the pressure sensor may be at least two parallel plates with conductive materials.
  • the electronic device can determine the intensity of the pressure or the amount of change in the intensity of the pressure according to the change in capacitance. Therefore, when it is detected that the pressure intensity or the change in pressure intensity in a specific area of the display screen reaches a certain value, for example, the pressure intensity or the change in pressure intensity is greater than or equal to the second threshold, it can be determined that there is a touch operation in the specific area of the display screen.
  • the processor in the electronic device may determine that the screen fingerprint unlocks the scene.
  • the distance sensor can detect the distance and the amount of distance change, and the distance sensor can be set in the display.
  • the processor in the electronic device may determine that there is a touch in a specific area of the display operating.
  • the processor in the electronic device may determine that the screen fingerprint unlocks the scene.
  • Fingerprint features are very different from facial features.
  • the fingerprint image contains lines, while the face image contains eyes, nose, eyebrows, and mouth.
  • the processor in the electronic device can store a classifier algorithm, which can classify face images and fingerprint images.
  • the classifier algorithm can be obtained through machine learning.
  • the camera In the locked state of the electronic device, the camera can be used to periodically collect images, and the processor in the electronic device classifies the collected images using a separator.
  • the processor in the electronic device may determine the screen fingerprint to unlock the scene.
  • the method of using the classifier to determine that the image collected by the camera is a fingerprint image is only used to explain the embodiments of the present application.
  • Other methods can also be used to classify fingerprint images or face images, which is not limited in the embodiments of the present application.
  • the processor in the electronic device may determine to unlock the scene for the face.
  • the processor in the electronic device detects that the face is close to the display screen by one or more of the following methods:
  • the gyro sensor When the electronic device is locked, the gyro sensor can be used to detect the movement posture of the electronic device.
  • the electronic device When the electronic device is in the locked state, when the motion parameter of the electronic device detected by the gyro sensor meets the parameter requirements of the wrist lift operation, for example, when the gyro sensor detects that the motion parameter of the electronic device is greater than or equal to the fifth threshold, the electronic The processor in the device may determine to unlock the scene for the face.
  • the gyro sensor can also cooperate with one or more of the acceleration sensor, gravity sensor, and light sensor to more accurately determine the face unlocking scene to prevent misoperation.
  • the distance sensor can detect the distance and the amount of distance change, and the distance sensor can be set in the display. When it is detected that the distance satisfies the distance range corresponding to face unlocking or the distance change amount is sufficiently large, for example, the processor in the electronic device whose distance is greater than or equal to the sixth threshold may determine the face unlocking scene.
  • the face image contains eyes, nose, eyebrows, and mouth, while the fingerprint image contains lines.
  • the processor in the electronic device can use the stored classifier algorithm to classify the face image and fingerprint image.
  • the camera can be used to periodically collect images, and the processor in the electronic device classifies the collected images using a separator.
  • the processor in the electronic device may determine to unlock the scene for the face.
  • the classifier algorithm can be obtained through machine learning.
  • the switch between the camera state corresponding to face unlocking and the camera state corresponding to fingerprint unlocking can also be used in scenarios that require identity verification other than unlocking, such as payment scenarios, identity verification, and unlocking application scenarios.
  • the camera when fingerprint verification is required, can be adjusted to a state corresponding to fingerprint recognition.
  • the camera status corresponding to fingerprint identification is, for example, the camera status in which the first lens moves to a position capable of participating in image acquisition in the embodiment shown in FIG. 6.
  • the camera can collect clear fingerprint images from the display surface through the first lens and the second lens.
  • the clear fingerprint image can provide enough fingerprint features for fingerprint verification.
  • the camera when face verification is required for the user, the camera can be adjusted to a state corresponding to face recognition.
  • the camera state corresponding to face recognition is, for example, the camera state where the first lens is moved away from the position capable of participating in image acquisition in the embodiment shown in FIG. 6.
  • the camera when unlocking an application, if the user's fingerprint needs to be verified, the camera can be adjusted to a state corresponding to fingerprint identification.
  • the camera status corresponding to fingerprint identification is, for example, the camera status in which the first lens moves to a position capable of participating in image acquisition in the embodiment shown in FIG. 6. If you need to verify the user's face, you can adjust the camera to the state corresponding to face recognition.
  • the camera state corresponding to face recognition is, for example, the camera state where the first lens is moved away from the position capable of participating in image acquisition in the embodiment shown in FIG. 6.
  • the camera state corresponding to face recognition that is, the camera state corresponding to face unlock shown in FIGS. 6 and 11, that is, the face recognition state of the cameras in the context.
  • the camera status corresponding to fingerprint recognition is the camera status corresponding to the fingerprint unlock shown in FIGS. 6 and 11, that is, the fingerprint recognition status of the cameras in the context.
  • the electronic device may further include an infrared emitter, and the camera may be an infrared camera.
  • the infrared emitter can emit infrared light
  • the image sensor in the infrared camera can receive the light reflected by the face or fingerprint to collect the face image or fingerprint image.
  • Using infrared emitters and infrared cameras to collect face images can still unlock faces even when there is insufficient visible light, such as at night.
  • the infrared emitter and infrared camera are used to collect fingerprint images, and fingerprint images can be collected without lighting the display screen, thereby realizing fingerprint unlocking. The steps of unlocking can be saved, and the convenience of unlocking electronic devices can be improved.
  • the infrared emitter can emit infrared light when the display screen is refreshed and not displayed (ie, the screen is off).
  • FIG. 12 is a schematic diagram of a time when an infrared emitter provides infrared light according to an embodiment of the present application. As shown in Figure 12, the display screen lights up during the time period 0-t0, t1-t2, and goes out during the time period t0-t1, t2-t3. Then, the time for the infrared emitter to emit infrared light may be in the screen off period, such as in the period t0-t1, t2-t3.
  • Emitting infrared rays at intervals not displayed on the display screen can reduce the influence of infrared rays on the display effect of the display screen, such as the influence on the display chromaticity.
  • the use of infrared light and infrared cameras to collect face images and fingerprint images can still achieve face unlocking when the visible light is insufficient, such as at night, which can improve the convenience of face unlocking.
  • the fingerprint image can be collected without lighting the display screen, and the fingerprint can be unlocked. The steps of fingerprint unlocking can be saved, and the convenience of fingerprint unlocking of electronic devices can be improved.
  • the electronic device may use a liquid lens in the camera instead of the first lens and the second lens to achieve adjustable focal length and shooting distance.
  • FIG. 13 is a schematic structural diagram of another camera provided by an embodiment of the present application.
  • the camera 200 includes a liquid lens 230 and an image sensor 220.
  • the electronic device can collect a clear face image on the image sensor 220, and can also collect a clear fingerprint image on the image sensor 220.
  • the liquid lens 230 adjusts the focal length by changing the pressure of the liquid.
  • the liquid lens 230 may contain two different liquids that cannot be fused, and the two liquids have different refractive indexes.
  • Changing the pressure of the liquid can change the shape of the crescent-shaped surface at the junction of the two liquids, thereby changing the focal length of the liquid lens 230.
  • changing the pressure of the liquid can be achieved by pressurizing the liquid lens through a spring.
  • the outer wall of the liquid lens can also be made of piezoelectric material.
  • the processor of the electronic device can adjust the voltage across the liquid lens 230 and use the inverse piezoelectric effect to change the pressure of the liquid.
  • the liquid lens 230 can achieve two focal lengths, namely a focal length corresponding to a human face and a focal length corresponding to a fingerprint.
  • the face outside the display screen can form a clear face image on the image sensor through the liquid lens.
  • the clear face image can provide enough face image features to complete face recognition.
  • the fingerprint outside the display screen can form a clear fingerprint image on the image sensor through the liquid lens.
  • the clear fingerprint image can provide enough fingerprint features to complete fingerprint recognition.
  • the focal length corresponding to the fingerprint is the first focal length
  • the focal length corresponding to the human face is the second focal length.
  • the processor of the electronic device When the processor of the electronic device detects the scene where the screen fingerprint is unlocked, the processor of the electronic device adjusts the focal length of the liquid lens 230 to the focal length corresponding to the fingerprint.
  • a camera containing a liquid lens is used to collect fingerprint images of fingerprints on the surface of the display screen to implement fingerprint verification.
  • the processor of the electronic device adjusts the focal length of the liquid lens to the focal length corresponding to the human face.
  • a camera including a liquid lens 230 is used to collect face images of faces other than the display screen to implement face verification.
  • the liquid lens 230 may be provided with periodically varying pressure. Under the effect of this periodically changing pressure, the focal length of the liquid lens 230 periodically changes between the focal length corresponding to the human face and the focal length corresponding to the fingerprint.
  • the electronic device does not need to determine whether the unlocking scene is a face unlocking scene or a fingerprint unlocking scene.
  • the electronic device collects images of the face from the outside of the display screen through the liquid lens 230 during the time that the focal length corresponding to the face is maintained.
  • the electronic device collects the image of the fingerprint from the surface of the display screen through the liquid lens 230 during the time that the focal length corresponding to the fingerprint is maintained.
  • the human face can form a clear human face image on the image sensor through the liquid lens.
  • the fingerprint can form a clear fingerprint image on the image sensor through the liquid lens.
  • the display screen 500 For the description of the electronic device 100, the display screen 500, the structural member 600, the infrared emitter 700, and the main board 800, reference may be made to the embodiment described in FIG. 5, which will not be repeated here.
  • the camera is an under-screen camera disposed below the display screen.
  • the display screen may be an organic light-emitting diode (OLED) display screen.
  • the display screen may also be a liquid crystal display (liquid crystal display, LCD).
  • LCD liquid crystal display
  • the reflective film and the diffusion film in the LCD backlight module need openings to allow the camera under the screen to receive sufficient light.
  • the reflective film in the backlight module is used to change the emission direction of the light emitted by the backlight to provide backlight for the LCD.
  • the diffusion film is used to make the backlight brightness uniform.
  • a reflective film that can transmit infrared light can also be used, and there is no need to open the reflective film.
  • FIG. 14 is a schematic diagram of positions of a display screen and a camera in an electronic device provided by an embodiment of the present application.
  • the camera 20 is disposed below the display plane of the display screen 500.
  • the display screen 500 includes an area 510 corresponding to the camera 20.
  • the camera 20 can use the light passing through the area 510 on the display screen 500 to collect a fingerprint image or a face image. Among them, the focal length of the camera 20 can be adjusted, so that the camera 20 can collect a clear fingerprint image and a clear face image.
  • the camera 20 may be the camera shown in any of FIGS. 7-10 and 13.
  • the electronic device may be used to perform the unlocking method shown in FIG. 6 or FIG. 9.
  • the pixel density of the area 510 can be reduced to increase the light transmittance, so that the camera 20 can receive more light reflected by the face and fingerprint.
  • the area 510 may be disposed at a position near the lower edge of the display plane of the display screen 500 to provide convenience for the user to perform face verification and fingerprint verification. It can be understood that the example of the position of the area 510 on the display screen 500 in FIG. 14 is only used to explain the embodiment of the present application, and should not be construed as a limitation. The area 510 may also be provided at other positions of the display screen 500.
  • the above description is based on the example in which the camera 20 is located on the display plane of the display screen 500 and should not be construed as a limitation.
  • the camera 20 may also be in other parts of the front case of the electronic device.
  • the camera may also be located in a trenched area obtained by trenching the display screen.
  • An embodiment of the present application further provides an electronic device including a module or unit for implementing the method described in FIG. 6 or FIG. 11.
  • the electronic device may include the camera described in any one of FIGS. 7-10.
  • An embodiment of the present application further provides a chip system, the chip system includes at least one processor, a memory and an interface circuit, the memory, the interface circuit and the at least one processor are connected, the at least one memory stores program instructions; When the program instructions are executed by the processor, the method described in FIG. 6 or FIG. 11 may be implemented.
  • Embodiments of the present application also provide a computer-readable storage medium, which stores program instructions, and when the program instructions are executed by a processor, the method described in FIG. 6 or FIG. 11 is implemented.
  • all or part of the functions may be implemented by software, hardware, or a combination of software and hardware.
  • the computer program product includes one or more computer instructions.
  • the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the computer instructions may be stored in a computer-readable storage medium.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device including a server, a data center, and the like integrated with one or more available media.
  • the usable medium may be a magnetic medium (eg, floppy disk, hard disk, magnetic tape), optical medium (eg, DVD), or semiconductor medium (eg, solid state disk (SSD)), or the like.
  • the process may be completed by a computer program instructing relevant hardware.
  • the program may be stored in a computer-readable storage medium.
  • When the program is executed May include the processes of the foregoing method embodiments.
  • the foregoing storage media include various media that can store program codes, such as ROM or random storage memory RAM, magnetic disks, or optical disks.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Image Input (AREA)

Abstract

一种摄像头、电子设备和身份验证方法,该摄像头包含两个镜头(210,300)和图像传感器(220),其中一个镜头(300)可以活动;在一种情况下,两个镜头(210,300)和图像传感器(220)都参与图像采集;在另一种情况下,只有一个镜头(210)和图像传感器(220)参与图像采集,从而这一个摄像头可以分别用于指纹识别和人脸识别。上述方法可以节省电子设备的内部空间。

Description

摄像头、电子设备和身份验证方法 技术领域
本申请涉及电子技术领域,尤其涉及一种摄像头、电子设备和身份验证方法。
背景技术
随着电子设备功能的不断发展,电子设备的安全要求越来越引起重视。在进行电子设备解锁时,可以利用指纹进行解锁,也可以利用人脸进行解锁。
如图1所示,在进行人脸解锁时,电子设备中摄像头1用来采集人脸图像,将采集到的人脸图像和预存的图像进行比对来实现人脸识别。另外,在指纹解锁时,屏下摄像头2用来采集指纹图像,实现屏幕指纹解锁。
发明内容
本申请公开了一种摄像头、电子设备和身份验证方法可以节省电子设备的内部空间,降低显示屏制作工艺流程的复杂度。
第一方面,本申请技术方案提供一种摄像头,所述摄像头用于电子设备进行人脸识别和指纹识别;所述摄像头包含第一镜头、第二镜头和图像传感器;其中:所述摄像头包含第一状态和第二状态,在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器参与图像采集;在所述第二状态下,所述第二镜头和所述图像传感器参与图像采集;所述摄像头在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器用于采集指纹图像,来进行指纹识别;所述摄像头在所述第二状态下,所述第二镜头和所述图像传感器用于采集人脸图像,来进行人脸识别;或者所述摄像头在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器采集人脸图像,来进行人脸识别;所述摄像头在所述第二状态下,所述第二镜头和所述图像传感器采集指纹图像,来进行指纹识别。
将上述摄像头应用在电子设备中,通过改变摄像头中镜头的焦距来使摄像头既可以采集人脸图像,又可以采集指纹图像,从而可以节省电子设备的内部空间,在摄像头为屏下摄像头时,降低摄像头带来的显示屏制作工艺流程的复杂度。
其中,本申请技术方案提供的摄像头可以用于电子设备的解锁、支付场景、身份验签和解锁应用场景等。
其中,在第二镜头和图像传感器的组合对应人脸识别,第一镜头、第二镜头和图像传感器的组合对应屏幕指纹识别的情况下,摄像头中第二镜头和图像传感器采集人脸图像时,使得人脸通过第二镜头可以在图像传感器上形成清晰的人脸图像。清晰的人脸图像可以提供足够的人脸图像特征实现人脸识别。摄像头中第一镜头、第二镜头和图像传感器采集指纹图像时,使得指纹通过第一镜头和第二镜头可以在图像传感器上形成清晰的指纹图像。清晰的指纹图像可以提供足够的指纹特征实现指纹识别。
在第一镜头、第二镜头和图像传感器的组合对应人脸识别,第二镜头和图像传感器的组合对应屏幕指纹识别的情况下,摄像头中第一镜头、第二镜头和图像传感器采集人脸图像时,使得人脸通过第一镜头和第二镜头可以在图像传感器上形成清晰的人脸图像。清晰的人脸图像可以提供足够的人脸图像特征实现人脸识别。摄像头中第二镜头和图像传感器 采集指纹图像时,使得指纹通过第二镜头可以在图像传感器上形成清晰的指纹图像。清晰的指纹图像可以提供足够的指纹特征实现指纹识别。可以设定第一镜头和第二镜头的焦距来实现采集到清晰的指纹图像和人脸图像。第一镜头可以是凸透镜。
作为一种可能的技术方案,所述第一镜头固定在活动支架上,被所述活动支架带动,其中:所述第一镜头,用于被所述活动支架带动到能够参与图像采集的位置,使得所述摄像头处于所述第一状态;所述第一镜头,还用于被所述活动支架带动从所述能够参与图像采集的位置移开,使得所述摄像头处于所述第二状态。第一镜头可以是凹透镜。
其中,第一镜头在能够参与图像采集的位置时,采集被摄物体图像的摄像头包含第一镜头、第二镜头和图像传感器。可选的,第一镜头在能够参与图像采集的位置时,第一镜头的光轴与第二镜头的光轴重叠。第二镜头可以与图像传感器封装在一起,则第一镜头可以在显示屏与第二镜头之间,且第一镜头的光轴可以与第二镜头的光轴重叠。
作为一种可能的技术方案,所述活动支架上固定有记忆合金弹簧,所述记忆合金弹簧包含第三状态和第四状态;在所述记忆合金弹簧变为所述第三状态时,所述第一镜头被所述活动支架上所述记忆合金弹簧带动到所述能够参与图像采集的位置,使得所述摄像头处于所述第一状态;在所述记忆合金弹簧变为所述第四状态时,所述第一镜头还被所述活动支架上所述记忆合金弹簧带动从所述能够参与图像采集的位置移开,使得所述摄像头处于所述第二状态。
具体实现中,记忆合金弹簧可以是螺旋状的。
作为一种可能的技术方案,所述记忆合金弹簧变为所述第三状态,包括:所述记忆合金弹簧被加热产生形变,所述第一镜头被所述活动支架上所述记忆合金弹簧带动到所述能够参与图像采集的位置,使得所述摄像头处于所述第一状态;所述记忆合金弹簧变为所述第四状态,包括:所述记忆合金弹簧断开加热恢复形状,所述第一镜头被所述活动支架上所述记忆合金弹簧带动从所述能够参与图像采集的位置移开,使得所述摄像头处于所述第二状态。
可选的,第二镜头和图像传感器可以封装在一起。第一镜头、第二镜头和图像传感器可以位于显示屏的显示平面以下。第一镜头可以通过活动支架连接在结构件上。结构件600可以用于固定显示屏。例如,结构件可以是电子设备的中框。
显示屏可以是OLED显示屏。还可以是液晶显示屏。在显示屏为LCD的情况下,在显示屏上与摄像头对应的位置上,LCD背光模组中的反射膜和扩散膜需要开孔,来使屏下摄像头接收到足够的光线。
作为一种可能的技术方案,所述活动支架被电机带动,所述电机带动所述活动支架移动到第一位置时,固定在所述活动支架上的所述第一镜头被带动到所述能够参与图像采集的位置,使得所述摄像头处于所述第一状态;所述电机带动所述活动支架移动到第二位置时,固定在所述活动支架上的所述第一镜头被带动从所述能够参与图像采集的位置移开,使得所述摄像头处于所述第二状态。
作为一种可能的技术方案,所述活动支架通过导轨旋转被所述电机带动,所述电机带动所述活动支架移动到第一位置,包括:所述电机带动所述导轨旋转,所述导轨带动所述活动支架移动到所述第一位置;所述电机带动所述活动支架移动到第二位置,包括:所述 电机带动所述导轨旋转,所述导轨带动所述活动支架移动到所述第二位置。
具体实现中,导轨外侧可以包含螺纹。螺母可以与螺纹咬合,随着导轨的旋转而沿导轨移动。活动支架可以固定在螺母上,可以随着螺母的移动而沿导轨移动,将固定在活动支架上的第一镜头从能够参与图像采集的位置移开或者移动到能够参与图像采集的位置。
作为一种可能的技术方案,在以下情况下,所述第一镜头为凸透镜:所述摄像头在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器采集指纹图像,来进行指纹识别;所述摄像头在所述第二状态下,所述第二镜头和所述图像传感器采集人脸图像,来进行人脸识别;在以下情况下,所述第一镜头为凹透镜:所述摄像头在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器采集人脸图像,来进行人脸识别;所述摄像头在所述第二状态下,所述第二镜头和所述图像传感器采集指纹图像,来进行指纹识别。
作为一种可能的技术方案,所述摄像头为红外摄像头,所述摄像头用于接收所述指纹反射的红外线来采集指纹图像,所述摄像头还用于接收所述人脸反射的红外线来采集人脸图像。
可选的,电子设备中还可以包含红外发射器。可选的,该红外发射器可以固定在主板上。
作为一种可能的技术方案,所述摄像头位于所述电子设备的显示屏的显示平面以下,所述指纹反射的红外线和所述人脸反射的红外线是所述电子设备中红外发射器在所述显示屏刷新的间隔发射的。
其中,红外发射器可以周期性的发射红外光,该红外光投射到被摄物体上经反射可以被摄像头采集,从而实现被摄物体图像的采集。
使用红外发射器和红外摄像头来进行人脸解锁,可以在外界光线不足的场景下例如夜间,仍然可以实现人脸解锁,从而提高人脸解锁的便利性。使用红外发射器和红外摄像头来进行屏幕指纹解锁,无需点亮显示屏提供光线来采集指纹图像,可以减少解锁过程中用户操作的步骤,从而提高屏幕指纹解锁的便利性。
作为一种可能的技术方案,所述摄像头还用于在完成人脸识别或者完成指纹识别之后,恢复到初始状态,所述初始状态为所述第一状态和所述第二状态中的任一个状态。
可选的,可以将记忆合金弹簧断开加热时对应的摄像头状态设置为初始状态,则在电子设备未处于解锁场景的时间段内,无需电源持续为记忆合金弹簧进行加热,从而可以节省功耗,减少电子设备内部热量的聚集,延长记忆合金弹簧的寿命。
可选的,摄像头状态的初始状态还可以是对用户解锁数据进行统计学习得到的。
第二方面,本申请技术方案提供一种摄像头,所述摄像头用于电子设备进行人脸识别和指纹识别;所述摄像头包含液体镜头和图像传感器,所述液体镜头的焦距可调,所述图像传感器用于采集图像;其中:所述液体镜头的焦距为第一焦距时,所述摄像头用于采集指纹图像,来进行指纹识别;所述液体镜头为第二焦距时,所述摄像头用于采集人脸图像,来进行人脸识别。
将上述摄像头应用在电子设备中,通过改变摄像头中镜头的焦距来使摄像头既可以采集人脸图像,又可以采集指纹图像,从而可以节省电子设备的内部空间,并降低摄像头带来的显示屏制作工艺流程的复杂度。
其中,摄像头可以位于显示屏的显示平面以下。
显示屏可以是OLED显示屏。还可以是液晶显示屏。在显示屏为LCD的情况下,在显示屏上与摄像头对应的位置上,LCD背光模组中的反射膜和扩散膜需要开孔,来使屏下摄像头接收到足够的光线。
其中,本申请技术方案提供的摄像头可以用于电子设备的解锁、支付场景、身份验签和解锁应用场景等。
作为一种可能的技术方案,所述液体镜头的焦距在所述第一焦距和所述第二焦距之间周期性变化。
液体镜头可以实现两种焦距,即人脸对应的焦距和指纹对应的焦距。指纹对应的焦距即为第一焦距,人脸对应的焦距即为第二焦距。在人脸对应的焦距下,显示屏以外的人脸可以通过液体镜头在图像传感器上形成清晰的人脸图像。该清晰的人脸图像可以提供足够的人脸图像特征来完成人脸识别。在指纹对应的焦距下,显示屏以外的指纹可以通过液体镜头在图像传感器上形成清晰的指纹图像。该清晰的指纹图像可以提供足够的指纹特征来完成指纹识别。
可选的,电子设备在人脸对应的焦距维持的时间内通过液体镜头采集来自显示屏以外的人脸的图像。屏幕指纹解锁场景下,电子设备在指纹对应的焦距维持的时间内通过液体镜头采集来自显示屏表面的指纹的图像。
第三方面,本申请技术方案提供一种电子设备中身份验证方法,所述方法包括:当电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,电子设备的处理器使用摄像头的指纹识别状态采集指纹图像,来进行指纹识别;当电子设备中传感器检测的参数满足人脸识别对应的参数范围时,电子设备的处理器使用所述摄像头的人脸识别状态采集人脸图像,来进行人脸识别;其中,所述摄像头包含第一镜头、第二镜头和图像传感器;在所述摄像头的指纹识别状态下,所述第一镜头、所述第二镜头和所述图像传感器采集指纹图像;在所述摄像头的人脸识别状态下,所述第二镜头和所述图像传感器采集人脸图像;
或者
在所述摄像头的指纹识别状态下,所述第二镜头和所述图像传感器采集指纹图像;在所述摄像头的人脸识别状态下,所述第一镜头、所述第二镜头和所述图像传感器采集人脸图像。
上述的身份验证方法中,通过改变摄像头中镜头的焦距来使摄像头既可以采集人脸图像,又可以采集指纹图像,从而可以节省电子设备的内部空间,并降低摄像头带来的显示屏制作工艺流程的复杂度。
其中,本申请技术方案提供的身份验证方法可以用于电子设备的解锁、支付场景、身份验签和解锁应用场景等。
在一种可能的技术方案中,所述电子设备的处理器使用摄像头的指纹识别状态采集指纹图像,来进行指纹识别之后,或者所述电子设备的处理器使用摄像头的人脸识别状态采集人脸图像,来进行人脸识别之后,所述方法还包括:所述电子设备的处理器将所述摄像头恢复到初始状态,所述初始状态为所述指纹识别状态和所述人脸识别状态中的任一个状态。
可选的,摄像头在进行被摄物体的图像采集,以实现屏幕指纹解锁和人脸解锁中任一种解锁方式之后,也可以无需恢复到某一个状态。具体的,在电子设备第n次执行人脸解锁之后,第一镜头仍然可以处在偏离能够参与图像采集的位置。电子设备的处理器可以执行以下步骤:
Step1:记录该第n次解锁所使用的解锁方式为人脸解锁。
Step2:下一次解锁中,在第n+1次解锁时电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围,电子设备中处理器检测到第n+1次解锁的方式与第n次解锁的方式不同。
Step3:电子设备中处理器驱动电机带动导轨旋转,将固定在螺母上的活动支架和固定在活动支架上的第一镜头沿导轨方向移动,使得第一镜头移动到能够参与图像采集的位置。将第一镜头移动到能够参与图像采集的位置参与指纹的图像采集。在执行屏幕指纹解锁之后,第一镜头仍然可以处在能够参与图像采集的位置。
在step1之后,如果电子设备中传感器检测的参数满足人脸识别对应的参数范围,则无需调整摄像头,直接利用第二镜头和图像传感器采集人脸图像,进行人脸解锁。可以在人脸解锁场景下无需调整摄像头,从而缩短解锁时间,提高电子设备的解锁效率。
在一种可能的技术方案中,所述电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围,包括以下一项或多项:触摸屏上摄像头对应的区域上检测到触摸操作;红外检测器检测到来自所述触摸屏上摄像头对应的区域以外的反射光的亮度大于或等于第一阈值;压力传感器检测到所述触摸屏上摄像头对应的区域上的压力强度或者压力强度的变化量大于或等于第二阈值;距离传感器检测到被摄物体与所述触摸屏上摄像头对应的区域的距离小于或等于第三阈值或者距离的变化量大于或等于第四阈值;所述摄像头采集到的图像被分类为指纹图像。
其中,红外检测器还可以与环境光传感器配合,检测电子设备是否在口袋里,以防误触。摄像头可以是红外摄像头,则可以无需额外安装红外检测器,利用红外摄像头来实现红外检测器的功能。
其中,所述摄像头采集到的图像的分类可以利用分类器算法,该分类器算法可以分类人脸图像和指纹图像。该分类器算法可以通过机器学习获得。
在一种可能的技术方案中,所述电子设备中传感器检测的参数满足人脸识别对应的参数范围,包括以下一项或多项:陀螺仪传感器检测到所述电子设备的运动参数大于或等于第五阈值;距离传感器检测到所述被摄物体与所述触摸屏上所述摄像头对应的区域的距离大于或等于第六阈值;所述摄像头采集到的图像被分类为人脸图像。
可选的,陀螺仪传感器还可以与加速度传感器、重力传感器和光线传感器中的一个或多个配合,更加准确的确定抬腕动作,进而确定人脸解锁场景,以防误操作。
在一种可能的技术方案中,在以下情况下:在摄像头的所述指纹识别状态,所述第一镜头、所述第二镜头和所述图像传感器采集指纹图像;在摄像头的所述人脸识别状态,所述第二镜头和所述图像传感器采集人脸图像,所述电子设备的处理器使用摄像头的指纹识别状态采集指纹图像,来进行指纹识别之前,所述方法还包括:所述电子设备的处理器控制用于对记忆合金弹簧加热的开关闭合,所述第一镜头被所述记忆合金弹簧带动到所述能 够参与图像采集的位置;或者,所述电子设备的处理器控制电机带动所述第一镜头到所述能够参与图像采集的位置;所述电子设备的处理器使用摄像头的人脸识别状态采集人脸图像,来进行人脸识别之前,所述方法还包括:所述电子设备的处理器控制用于对所述记忆合金弹簧加热的开关断开,所述第一镜头被所述记忆合金弹簧带动从所述能够参与图像采集的位置移开;或者,所述电子设备的处理器控制所述电机带动所述第一镜头从所述能够参与图像采集的位置移开。
其中,所述电子设备的处理器控制电机带动所述第一镜头到所述能够参与图像采集的位置,包括:电子设备中处理器驱动电机带动导轨旋转,将固定在螺母上的活动支架和固定在活动支架上的第一镜头沿导轨方向移动,使得第一镜头移动到能够参与图像采集的位置。
其中,所述电子设备的处理器控制所述电机带动所述第一镜头从所述能够参与图像采集的位置移开,包括:电子设备中处理器使能控制电机带动导轨旋转,将固定在螺母上的活动支架和固定在活动支架上的第一镜头沿导轨方向移动,使得第一镜头从能够参与图像采集的位置移开。
在一种可能的技术方案中,在以下情况下:在摄像头的所述指纹识别状态,所述第二镜头和所述图像传感器采集指纹图像;在摄像头的所述人脸识别状态,所述第一镜头、所述第二镜头和所述图像传感器采集人脸图像,所述电子设备的处理器使用摄像头的指纹识别状态采集指纹图像,来进行指纹识别之前,所述方法还包括:所述电子设备的处理器控制用于对记忆合金弹簧加热的开关断开,使得所述第一镜头被所述记忆合金弹簧带动从所述能够参与图像采集的位置移开;或者,所述电子设备的处理器控制所述电机带动所述第一镜头从所述能够参与图像采集的位置移开;所述电子设备的处理器使用摄像头的人脸识别状态采集人脸图像,来进行人脸识别之前,所述方法还包括:所述电子设备的处理器控制用于对所述记忆合金弹簧加热的开关闭合,使得所述第一镜头被所述记忆合金弹簧带动到所述能够参与图像采集的位置;或者,所述电子设备的处理器控制所述电机带动所述第一镜头到所述能够参与图像采集的位置。
在一种可能的技术方案中,所述摄像头为红外摄像头,所述摄像头用于接收所述指纹反射的红外线来采集指纹图像,所述摄像头还用于接收所述人脸反射的红外线来采集人脸图像;所述摄像头位于所述电子设备的显示屏的显示平面以下,所述方法还包括:电子设备的处理器控制红外发射器在所述显示屏刷新的间隔发射红外线。
显示屏可以是OLED显示屏。还可以是液晶显示屏。在显示屏为LCD的情况下,在显示屏上与摄像头对应的位置上,LCD背光模组中的反射膜和扩散膜需要开孔,来使屏下摄像头接收到足够的光线。
第四方面,本申请技术方案提供了一种电子设备,所述电子设备包括处理器、摄像头和显示屏,所述摄像头位于所述电子设备的前壳,其中:所述摄像头是第一方面或者第一方面任一种可能的实施方式所描述的摄像头;所述处理器,用于控制用于对所述记忆合金弹簧加热的开关闭合或断开,或者控制所述电机带动所述第一镜头移动。
第五方面,本申请技术方案提供了一种电子设备,其特征在于,所述电子设备包括处理器和摄像头,所述摄像头位于所述电子设备的前壳,其中:所述摄像头是第二方面或者 第二方面任一种可能的实施方式所描述的摄像头;所述处理器,用于控制所述液体镜头的焦距在所述第一焦距和所述第二焦距之间切换。
第六方面,本申请技术方案提供了一种电子设备,所述电子设备用于执行第三方面或者第三方面任一种可能的实施方式所描述的电子设备中身份验证方法。
第七方面,本申请技术方案提供一种电子设备,该电子设备包括用于执行第三方面和第三方面任一个可能的技术方案所提供的方法的模块或单元。
第八方面,本申请技术方案提供一种芯片系统,该芯片系统包括至少一个处理器,存储器和接口电路,该存储器、该接口电路和该至少一个处理器连接,该至少一个存储器中存储有程序指令;该程序指令被该处理器执行时,实现第三方面和第三方面任一个可能的技术方案所提供的方法。
第九方面,本申请技术方案提供一种计算机可读存储介质,该计算机可读存储介质中存储有程序指令,当该程序指令由处理器运行时,实现第三方面和第三方面任一个可能的技术方案所提供的方法。
第十方面,本申请技术方案提供一种计算机程序产品,当该计算机程序产品在由处理器上运行时,实现第三方面和第三方面任一个可能的技术方案所提供的方法。
附图说明
下面对本申请实施例用到的附图进行介绍。
图1是现有技术提供的一种指纹解锁和人脸解锁的示意图;
图2是本申请实施例提供的一种电子设备的结构示意图;
图3是本拾取实施例提供的一种的电子设备100的软件结构框图;
图4是本申请实施例提供的一种摄像头中焦距、物距的示意图;
图5是本申请实施例提供的一种摄像头的结构示意图;
图6是本申请实施例提供的一种电子设备的解锁方法的流程示意图;
图7是本申请实施例提供的一种活动支架旋转将第一镜头置于能够参与图像采集的位置的结构示意图;
图8是本申请实施例提供的一种活动支架旋转将第一镜头从能够参与图像采集的位置移开的结构示意图;
图9是本申请实施例提供的一种活动支架的移动将第一镜头置于能够参与图像采集的位置的结构示意图;
图10是本申请实施例提供的一种活动支架移动将第一镜头从能够参与图像采集的位置移开的结构示意图;
图11是本申请实施例提供的另一种电子设备的解锁方法的流程示意图;
图12是本申请实施例提供的一种红外发射器发射红外光线的时间示意图;
图13是本申请实施例提供的另一种摄像头的结构示意图;
图14是本申请实施例提供的一种电子设备中显示屏和摄像头的位置示意图。
具体实施方式
下面结合本申请实施例中的附图对本申请实施例进行描述。本申请实施例的实施方式部分使用的术语仅用于对本申请的具体实施例进行解释,而非旨在限定本申请。
下面介绍本申请实施例涉及的应用场景。在手机、平板电脑、笔记本电脑或者包含摄像头的其他设备等这些电子设备中,电子设备中的处理器可以调用摄像头采集人脸图像,进行人脸图像识别进而实现人脸解锁。电子设备中的处理器还可以调用摄像头来采集指纹图像,进行指纹图像识别进而实现屏幕指纹解锁。另外,在支付、身份验签、解锁应用等场景下,也需要进行人脸识别或者指纹识别来完成身份验证。
请参阅图2,图2是本申请实施例提供的一种电子设备100的结构示意图。
如图2所示,电子设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本申请实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110用于读取存储器1302中存储的程序代码,执行本申请实施例提供的身份验证方法,例如图6或图11所描述的身份验证方法。
具体的,处理器110用于读取存储器1302中存储的程序代码,获取传感器检测到的参数。例如,处理器110获取触摸屏检测到的触摸操作、红外检测器检测到的红外光、压力传感器检测到的压力强度或压力强度变化量、距离传感器检测到的距离或距离变化量、陀螺仪传感器检测到的运动参数等。
处理器还用于读取存储器1302中存储的程序代码,对第一镜头进行移动。具体的,处理器110用于读取存储器1302中存储的程序代码,控制用于加热记忆合金弹簧的开关闭合,第一镜头被记忆合金弹簧带动到能够参与图像采集的位置。处理器110用于读取存储器1302中存储的程序代码,控制电机带动第一镜头到能够参与图像采集的位置。处理器110用于读取存储器1302中存储的程序代码,控制用于对记忆合金弹簧加热的开关断开,第一镜头被记忆合金弹簧带动从能够参与图像采集的位置移开。处理器110用于读取存储器1302中存储的程序代码,控制电机带动第一镜头从能够参与图像采集的位置移开。
本申请实施例中,摄像头193可以包含第一镜头、第二镜头和图像传感器。摄像头193可以是图7-图10任一项所描述的摄像头。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU), 图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
其中,控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
I2C接口是一种双向同步串行总线,包括一根串行数据线(serial data line,SDA)和一根串行时钟线(derail clock line,SCL)。在一些实施例中,处理器110可以包含多组I2C总线。处理器110可以通过不同的I2C总线接口分别耦合触摸传感器180K,充电器,闪光灯,摄像头193等。例如:处理器110可以通过I2C接口耦合触摸传感器180K,使处理器110与触摸传感器180K通过I2C总线接口通信,实现电子设备100的触摸功能。
I2S接口可以用于音频通信。在一些实施例中,处理器110可以包含多组I2S总线。处理器110可以通过I2S总线与音频模块170耦合,实现处理器110与音频模块170之间的通信。在一些实施例中,音频模块170可以通过I2S接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。
PCM接口也可以用于音频通信,将模拟信号抽样,量化和编码。在一些实施例中,音频模块170与无线通信模块160可以通过PCM总线接口耦合。在一些实施例中,音频模块170也可以通过PCM接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信。
UART接口是一种通用串行数据总线,用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中,UART接口通常被用于连接处理器110与无线通信模块160。例如:处理器110通过UART接口与无线通信模块160中的蓝牙模块通信,实现蓝牙功能。在一些实施例中,音频模块170可以通过UART接口向无线通信模块160传递音频信号,实现通过蓝牙耳机播放音乐的功能。
MIPI接口可以被用于连接处理器110与显示屏194,摄像头193等外围器件。MIPI接口包括摄像头串行接口(camera serial interface,CSI),显示屏串行接口(display serial interface,DSI)等。在一些实施例中,处理器110和摄像头193通过CSI接口通信,实现 电子设备100的拍摄功能。处理器110和显示屏194通过DSI接口通信,实现电子设备100的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号,也可被配置为数据信号。在一些实施例中,GPIO接口可以用于连接处理器110与摄像头193,显示屏194,无线通信模块160,音频模块170,传感器模块180等。GPIO接口还可以被配置为I2C接口,I2S接口,UART接口,MIPI接口等。
USB接口130是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口130可以用于连接充电器为电子设备100充电,也可以用于电子设备100与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如AR设备等。
可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备100的结构限定。在本申请另一些实施例中,电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,外部存储器,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信 号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP 处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备100可以通过扬声器170A收听音乐,或收听免提通话。
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。
麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风170C发声,将声音信号输入到麦克风170C。电子设备100可以设置至少一个麦克风170C。在另一些实施例中,电子设备100可以设置两个麦克风170C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,电子设备100还可以设置三个,四个或更多麦克风170C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194。压力传感器180A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A,电极之间的电容改变。电子设备100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194,电子设备100根据压力传感器180A检测所述触摸操作强度。电子设备100也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中,作用于相同触摸位置,但不同触摸操作强度的触摸操作,可以对应不同的操作指令。例如:当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时,执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时,执行新建短消息的指令。
陀螺仪传感器180B可以用于确定电子设备100的运动姿态。在一些实施例中,可以通过陀螺仪传感器180B确定电子设备100围绕三个轴(即,x,y和z轴)的角速度。陀螺仪传感器180B可以用于拍摄防抖。示例性的,当按下快门,陀螺仪传感器180B检测电子设备100抖动的角度,根据角度计算出镜头模组需要补偿的距离,让镜头通过反向运动抵消电子设备100的抖动,实现防抖。陀螺仪传感器180B还可以用于导航,体感游戏场景。
气压传感器180C用于测量气压。在一些实施例中,电子设备100通过气压传感器180C测得的气压值计算海拔高度,辅助定位和导航。
磁传感器180D包括霍尔传感器。电子设备100可以利用磁传感器180D检测翻盖皮套的开合。在一些实施例中,当电子设备100是翻盖机时,电子设备100可以根据磁传感器180D检测翻盖的开合。进而根据检测到的皮套的开合状态或翻盖的开合状态,设置翻盖自动解锁等特性。
加速度传感器180E可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。还可以用于识别电子设备姿态,应用于横竖屏切换,计步器等应用。
距离传感器180F,用于测量距离。电子设备100可以通过红外或激光测量距离。在一些实施例中,拍摄场景,电子设备100可以利用距离传感器180F测距以实现快速对焦。
接近光传感器180G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。发光二极管可以是红外发光二极管。电子设备100通过发光二极管向外发射红外光。电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时,可以确定电子设备100附近有物体。当检测到不充分的反射光时,电子设备100可以确定电子设备100附近没有物体。电子设备100可以利用接近光传感器180G检测用户手持电子设备100贴近耳朵通话,以便自动熄灭屏幕达到省电的目的。接近光传感器180G也可用于皮套模式,口袋模式自动解锁与锁屏。
环境光传感器180L用于感知环境光亮度。电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合,检测电子设备100是否在口袋里,以防误触。
指纹传感器180H用于采集指纹。电子设备100可以利用采集的指纹特性实现屏幕指纹解锁,访问应用,指纹拍照,指纹接听来电等。
温度传感器180J用于检测温度。在一些实施例中,电子设备100利用温度传感器180J检测的温度,执行温度处理策略。例如,当温度传感器180J上报的温度超过阈值,电子设备100执行降低位于温度传感器180J附近的处理器的性能,以便降低功耗实施热保护。在另一些实施例中,当温度低于另一阈值时,电子设备100对电池142加热,以避免低温导致电子设备100异常关机。在其他一些实施例中,当温度低于又一阈值时,电子设备100对电池142的输出电压执行升压,以避免低温导致的异常关机。
触摸传感器180K,也称“触控面板”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器180K也可以设置于电子设备100的表面,与显示屏194所处的位置不同。
骨传导传感器180M可以获取振动信号。在一些实施例中,骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏,接收血压跳动信号。在一些实施例中,骨传导传感器180M也可以设置于耳机中,结合成骨传导耳机。音频模块170可以基于所述骨传导传感器180M获取的声部振动骨块的振动信号,解析出语音信号,实现语音功能。应用处理器可以基于所述骨传导传感器180M获取的血压跳动信号解析心率信息,实现心率检测功能。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195,或从SIM卡接口195拔出,实现和电子设备100的接触和分离。电子设备100可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡,Micro SIM卡,SIM卡等。同一个SIM卡接口195可以同时插入多张卡。所述多张卡的类型可以相同,也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。电子设备100通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,电子设备100采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在电子设备100中,不能和电子设备100分离。
电子设备100的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本申请实施例以分层架构的Android系统为例,示例性说明电子设备100的软件结构。
请参阅图3,图3是本拾取实施例提供的一种的电子设备100的软件结构框图。
如图3所示,分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,以及内核层。
应用程序层可以包括一系列应用程序包。
如图3所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图3所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供电子设备100的通信功能。例如通话状态的管理(包括接通,挂断等)。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例 如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
下面结合捕获拍照场景,示例性说明电子设备100软件以及硬件的工作流程。当触摸传感器180K接收到触摸操作,相应的硬件中断被发给内核层。内核层将触摸操作加工成原始输入事件(包括触摸坐标,触摸操作的时间戳等信息)。原始输入事件被存储在内核层。应用程序框架层从内核层获取原始输入事件,识别该输入事件所对应的控件。以该触摸操作是触摸单击操作,该单击操作所对应的控件为相机应用图标的控件为例,相机应用调用应用框架层的接口,启动相机应用,进而通过调用内核层启动摄像头驱动,通过摄像头193捕获静态图像或视频。
基于图2所示的电子设备的结构图和图3所示的电子设备的软件结构框图,为了节省电子设备的内部空间,并降低摄像头带来的显示屏制作工艺流程的复杂度,本申请实施例提供一种摄像头和电子设备。本申请实施例涉及的主要发明原理为:电子设备中该摄像头可以用于人脸识别实现电子设备解锁,也可以用于屏幕指纹识别实现电子设备解锁。具体的,在电子设备中处理器识别到人脸解锁的场景时,增大摄像头中镜头的焦距,以增大摄像头成像的物距,利用摄像头采集人脸图像。利用采集到的人脸图像进行人脸识别进而实现电子设备解锁。在电子设备中处理器识别到屏幕指纹解锁的场景时,减小摄像头中镜头的焦距,以减小摄像头成像的物距。通过改变摄像头中镜头的焦距来使摄像头既可以采集人脸图像,又可以采集指纹图像,从而可以节省电子设备的内部空间,并降低摄像头带来的显示屏制作工艺流程的复杂度。
为了便于理解本申请实施例,下面介绍本申请实施例涉及的概念。
(1)焦距、物距
在光学系统中焦距可以衡量光的聚集或发散的程度,是指从光学中心到光线聚焦的焦点之间的距离。摄像头的镜头可以包含一组透镜,当平行于主光轴的光线穿过镜头时,会聚到一点上,即焦点。焦点到光学中心的距离称为焦距。焦距可以调节的镜头是变焦镜头。
物距即为被摄物体与光学中心之间的距离。
在摄像头中像距是光学中心到图像传感器之间的距离。
请参阅图4,图4是本申请实施例提供的一种摄像头中焦距、物距的示意图。如图4所示,在摄像头中,焦距也可以看作是从光学中心到图像传感器所在的成像平面之间的距离。当镜头需要拍摄远距离的物体时,可以将镜头调整到无限远,将镜头的光学中心与图像传感器之间的距离调整为焦距的长度,使远距离的物体能在图像传感器上形成清晰的影像。当摄像头要拍摄离镜头较近的物体时,通常可以调节镜头的光学中心尽可能的远离图像传感器,使得有限距离的物体得以在图像传感器上清晰成像。
在摄像头中,镜头的焦距越短则摄距越近。如图4所示,摄距即为拍摄距离,是图像传感器到被摄物体之间的距离,在该摄距下被摄物体可以在图像传感器上形成清晰的图像。在本申请实施例提供的人脸解锁场景下,清晰的图像可以提供足够的人脸图像特征来实现人脸解锁,在本申请实施例提供的屏幕指纹解锁场景下,清晰的图像可以提供足够的指纹特征来实现屏幕指纹解锁。
在物距变大的场景下,即被摄物体与摄像头之间的距离变大,可以将摄像头的焦距调大来调大摄距。具体实现中,可以在摄像头中增加凹透镜或者减少凸透镜来增大焦距,从而增大摄距来使被摄物体在图像传感器上清晰成像。在物距变小的场景下,即被摄物体与摄像头之间的距离变小,可以将摄像头的焦距调小来调大摄距。具体实现中,可以在镜头的透镜组中增加凸透镜或者减少凹透镜来减小焦距,从而减小摄距来使被摄物体在图像传感器上清晰成像。
(2)人脸识别
人脸解锁过程可以包含四个步骤:步骤一:人脸图像采集及检测。步骤二:人脸图像预处理。步骤三:人脸图像特征提取。步骤四:匹配与识别。
具体的,在步骤一中,采集人脸图像可以使用摄像头实现。当摄像头拍摄范围内出现人脸时,摄像头可以采集到该人脸的图像。人脸检测即在采集到的图像中标定出人脸的位置和大小。在步骤二中,对图像进行预处理用于服务于步骤三,包含进行人脸图像的光线补偿、灰度变换、直方图均衡化、归一化、几何校正、滤波以及锐化等。在步骤三中,提取得到的人脸图像特征可以用于与特征数据库中的特征模板进行匹配。人脸图像特征可以包括视觉特征、像素统计特征、人脸图像变换系数特征、人脸图像代数特征等。在步骤四中,将步骤三提取的人脸图像的特征数据与数据库中存储的特征模板进行搜索匹配。可以设定一个阈值,当相似度超过这一阈值,把匹配得到的结果输出。人脸识别即是将待识别的人脸特征与已得到的人脸特征模板进行比较,根据相似程度对人脸的身份信息进行判断。在人脸解锁场景下,如果相似程度大于一定阈值,则解锁电子设备。
(3)屏幕指纹识别
屏幕指纹识别利用屏下指纹传感器的光电指纹识别技术实现。在显示屏点亮状态下,显示屏发出的光照亮指纹纹路。指纹纹路上反射的光线被屏下指纹传感器捕获形成指纹图 像。将该指纹图像与预存的指纹图像对比。在屏幕指纹解锁场景下,如果匹配成功即执行电子设备的解锁。比对的过程可以是提取指纹图像特征来和预存的特征模板进行比对。在相似度超过一定阈值时表明匹配成功。
(4)解锁电子设备
为保护用户隐私和信息安全,电子设备可以处于锁定状态,在锁定状态下对用户操作电子设备的权限进行限定。在验证用户身份之后,用户才能够对电子设备进行操作。解锁电子设备可以是指解除电子设备的锁定状态。解除锁定状态后,电子设备可以响应用户的操作来调用各类应用,例如“相机”、“音乐”和“视频”等APP。
验证用户身份的方式可以包括:锁屏密码验证、解锁图案验证、屏幕指纹验证和人脸验证。其中,锁屏密码验证是指验证用户输入的字符是否与预存的锁屏密码相同。解锁图案验证是指验证用户输入的触摸轨迹图案是否与预存的图案相同。屏幕指纹验证和人脸验证可以参考前述屏幕指纹解锁和人脸解锁的相关描述。
类似的,应用在解锁之前也处于锁定状态,在锁定状态下对用户操作应用的权限进行限定。在验证用户身份之后,用户才能够对应用进行操作。解锁应用可以是指解除应用的锁定状态。解除锁定状态后,应用中各功能控件可以响应用户的操作。
基于上述主要发明原理,下面介绍本申请实施例提供的摄像头的示例。本申请实施例以解锁的场景为例介绍摄像头采集人脸图像并采集指纹图像的具体实现过程。可以理解的,本申请实施例也可以扩展到支付、身份验签、解锁应用等场景下,在这些场景下指纹识别和人脸识别的实现过程可以类比电子设备解锁的场景。
请参阅图5,图5是本申请实施例提供的一种摄像头的结构示意图。如图5所示,该摄像头包括至少两个镜头和图像传感器220,如图5所示,至少两个镜头可以包含镜头300和镜头210。其中,镜头300可以参与到被摄物体的图像采集,也可以不参与到被摄物体的图像采集。本申请实施例以至少两个镜头是两个镜头300和210为例进行介绍,可以理解的,本申请实施例也可以扩展到摄像头包含更多的镜头。这至少两个镜头和图像传感器220可以用于电子设备10进行人脸解锁和屏幕指纹解锁。
其中,镜头210和图像传感器220的组合对应人脸解锁和屏幕指纹解锁中的一种解锁方式,镜头300、镜头210和图像传感器220的组合对应人脸解锁和屏幕指纹解锁中的另一种解锁方式。以下分两种情况进行详细介绍:(a)镜头210和图像传感器220的组合对应人脸解锁,镜头300、镜头210和图像传感器220的组合对应屏幕指纹解锁。(b)镜头210和图像传感器220的组合对应屏幕指纹解锁,镜头300、镜头210和图像传感器220的组合对应人脸解锁。
(a)镜头210和图像传感器220的组合对应人脸解锁,镜头300、镜头210和图像传感器220的组合对应屏幕指纹解锁。
摄像头中镜头210和图像传感器220参与图像采集时,可以用来采集人脸图像,使得人脸通过镜头210可以在图像传感器220上形成清晰的人脸图像,进而实现人脸解锁。在该人脸解锁的场景下,人脸作为被摄物体,对应的摄距可以是在预设距离范围内均能够在图像传感器220上形成清晰的人脸图像,该清晰的人脸图像可以提供足够的人脸图像特征 实现人脸解锁。可选的,摄距在预设距离范围内,镜头210和图像传感器220组成的摄像头可以通过自动对焦来在图像传感器220上形成清晰的人脸图像。
在包含镜头210和图像传感器220的摄像头中增加镜头300可以实现屏幕指纹解锁。镜头300可以是凸透镜。具体的,摄像头中镜头300、镜头210和图像传感器220参与图像采集时,可以用来采集指纹图像,使得指纹通过镜头300、镜头210可以在图像传感器220上形成清晰的指纹图像。该清晰的指纹图像可以提供足够的指纹特征实现指纹解锁。在该屏幕指纹解锁的场景下,指纹作为被摄物体,对应的摄距可以是在预设距离范围内均能够在图像传感器220上形成清晰的指纹图像以实现屏幕指纹解锁。
可选的,摄距在预设距离范围内,镜头300、镜头210和图像传感器220组成的摄像头可以通过自动对焦来在图像传感器220上形成清晰的指纹图像。
本申请实施例中,一种可选的自动对焦原理为:可以利用马达带动摄像头中镜头210沿光轴移动来实现对焦。利用马达驱动芯片输出对应的电流,马达会做出相应的位移,在该位移下摄像头拾取图像,通过拾取的图像的清晰度来判断镜头是否达到拍摄图像清晰的位置,如果未达到清晰的位置,重新通知马达驱动芯片调整输出电流,并重复执行上述流程直至判断结果是镜头达到拍摄图像清晰的位置。通过上述闭环调节过程完成对焦。上述自动对焦原理仅用于解释本申请实施例,不应构成限定,本申请实施例中的对焦还可以使用其他的方法。
(b)镜头210和图像传感器220的组合对应屏幕指纹解锁,镜头300、镜头210和图像传感器220的组合对应人脸解锁。
摄像头中镜头210和图像传感器220参与图像采集时,可以用来采集指纹图像,使得指纹通过镜头210可以在图像传感器220上形成清晰的指纹图像,进而实现屏幕指纹解锁。在该屏幕指纹解锁的场景下,指纹作为被摄物体,对应的摄距可以是在预设距离范围内均能够在图像传感器220上形成清晰的指纹图像以实现屏幕指纹解锁。可选的,摄距在预设距离范围内,镜头210和图像传感器220组成的摄像头可以通过自动对焦来在图像传感器220上形成清晰的指纹图像。
在包含镜头210和图像传感器220的摄像头中增加镜头300可以实现人脸解锁。镜头300可以是凹透镜。具体的,包含镜头300、镜头210和图像传感器220的摄像头可以用来采集人脸图像,使得人脸通过镜头300、镜头210可以在图像传感器220上形成清晰的人脸图像,进而实现人脸解锁。在该人脸解锁的场景下,人脸作为被摄物体,对应的摄距可以是在预设距离范围内均能够在图像传感器220上形成清晰的人脸图像以实现人脸解锁。可选的,摄距在预设距离范围内,镜头300、镜头210和图像传感器220组成的摄像头可以通过自动对焦来在图像传感器220上形成清晰的人脸图像。
如图5所示,镜头210和图像传感器220可以封装在一起。镜头300、镜头210和图像传感器220可以位于显示屏500的显示平面以下。镜头300可以通过活动支架400连接在结构件600上。结构件600可以用于固定显示屏。其中,镜头300可以随活动支架400旋转或移动,使得镜头300可以参与被摄物体的图像采集,也可以从能够参与图像采集的位置移开,从而仅包含镜头210和图像传感器220的摄像头参与被摄物体的图像采集。可选的,结构件600可以是电子设备的中框。
可选的,电子设备10中还可以包含红外发射器700。可选的,该红外发射器700可以固定在主板800上。摄像头可以是红外摄像头,即摄像头中的图像传感器可以接收被摄物体反射的红外光来采集被摄物体的图像。摄像头中镜头210和图像传感器220可以参与图像采集,或者镜头300、镜头210和图像传感器220参与图像采集。红外发射器700可以周期性的发射红外光,该红外光投射到被摄物体上经反射可以被摄像头采集,从而实现被摄物体图像的采集。
使用红外发射器700和红外摄像头来进行人脸解锁,可以在外界光线不足的场景下例如夜间,仍然可以实现人脸解锁,从而提高人脸解锁的便利性。使用红外发射器700和红外摄像头来进行屏幕指纹解锁,无需点亮显示屏提供光线来采集指纹图像,可以减少解锁过程中用户操作的步骤,从而提高屏幕指纹解锁的便利性。
基于上述主要发明原理,下面介绍电子设备的解锁方法的示例。
在一种可能的实施例中,第二镜头210和图像传感器220的组合对应人脸解锁,第一镜头300、第二镜头210和图像传感器220的组合对应屏幕指纹解锁。请参阅图6,图6是本申请实施例提供的一种电子设备的解锁方法的流程示意图。如图6所示,该电子设备解锁方法可以包括步骤S101-S106。其中,步骤S101-S103是屏幕指纹解锁的执行步骤,步骤S104-S106是人脸解锁的执行步骤。本申请实施例对屏幕指纹解锁对应与人脸解锁执行先后不作限定。步骤S104-S106也可以是在步骤S101-S103之前执行。
S101、当电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,电子设备的处理器控制活动支架旋转或移动,来将第一镜头置于能够参与图像采集的位置。
其中,第一镜头可以是图5所示的摄像头中的镜头300,第二镜头可以是图5所示的摄像头中的镜头210。将第一镜头置于能够参与图像采集的位置之后,用于采集指纹的摄像头中包含第一镜头。
S102、电子设备中处理器获取通过第一镜头、第二镜头和图像传感器采集的指纹图像。
S103、电子设备中处理器根据获取到的指纹图像解锁电子设备。
S104、当电子设备中传感器检测的参数满足人脸识别对应的参数范围时,电子设备的处理器控制活动支架旋转或移动,来将第一镜头从能够参与图像采集的位置移开。
S105、电子设备中处理器获取通过第二镜头和图像传感器采集的人脸图像。
S106、电子设备中处理器根据获取到的人脸图像解锁电子设备。
可以理解的,在步骤S101中当电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,如果第一镜头在能够参与图像采集的位置,可以直接执行步骤S102获取指纹图像。在步骤S104中当电子设备中传感器检测的参数满足人脸识别对应的参数范围时,如果第一镜头已经从能够参与图像采集的位置移开,可以直接执行步骤S105获取人脸图像。
其中,第一镜头在能够参与图像采集的位置时,采集被摄物体图像的摄像头包含第一镜头、第二镜头和图像传感器。可选的,第一镜头在能够参与图像采集的位置时,第一镜头的光轴与第二镜头的光轴重叠。第二镜头可以与图像传感器封装在一起,则第一镜头可以在显示屏与第二镜头之间,且第一镜头的光轴可以与第二镜头的光轴重叠。
上述的电子设备的解锁方法中,在摄像头中增加或减少第一镜头,即可以实现电子设 备的两种解锁方式,从而节约了电子设备内部物理空间。另外,仅需对这一个摄像头在显示屏上对应的位置上进行处理,减少了显示屏上进行处理的工艺步骤。
本申请实施例中,活动支架可以是图5所示出的摄像头中的活动支架400。活动支架的旋转或移动可以带动第一镜头参与或者不参与被摄物体的图像采集。活动支架的旋转或移动可以使用记忆合金弹簧实现,也可以通过电机和导轨实现。下面分别介绍一种记忆合金弹簧带动第一镜头的实现示例,并介绍一种电机和导轨带动第一镜头的实现示例。
(1)记忆合金弹簧带动第一镜头
可以利用形状记忆合金(shape memory alloys,SMA)的形状记忆功能来带动活动支架旋转,进而带动第一镜头旋转。形状记忆合金是一种能够记忆原有形状的智能材料。当合金在低于相变态温度下,受到一有限度的塑性变形后,可由加热的方式使其恢复到变形前的原始形状。对于双程记忆效应的形状记忆合金来说,加热时能够恢复高温对应的形状,冷却时又能够恢复低温对应的形状。利用形状记忆合金的形变带动活动支架,第一镜头300可以随活动支架400旋转,使得第一镜头300可以参与被摄物体的图像采集,也可以从能够参与图像采集的位置移开,从而使第二镜头210和图像传感器220参与被摄物体的图像采集。本申请实施例中,第一镜头即前后文中的镜头300,第二镜头即前后文中的镜头210。
请参阅图7,图7是本申请实施例提供的一种活动支架旋转将第一镜头置于能够参与图像采集的位置的结构示意图。活动支架旋转将第一镜头300置于能够参与图像采集的位置来实现屏幕指纹解锁。具体的,如图7所示,活动支架400上可以固定有形状记忆合金制成的记忆合金弹簧900。该记忆合金弹簧900的第一端的位置固定,不能随记忆合金弹簧900的形变旋转或移动,该记忆合金弹簧900的第二端的位置可以随记忆合金弹簧900的形变而旋转,进而带动活动支架400及固定在活动支架400上的第一镜头300旋转。
具体实现中,该记忆合金弹簧900可以是螺旋状的。
关于步骤S101,如图7所示,在电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,电子设备中处理器使能控制电源改变记忆合金弹簧900的温度。例如处理器使能控制开关闭合使电源对记忆合金弹簧900加热,来使记忆合金弹簧900的第二端旋转,带动活动支架400及固定在活动支架400上的第一镜头300旋转。将第一镜头300移至能够参与图像采集的位置,参与指纹的图像采集。如图7所示,可以将第二镜头210和图像传感器220封装在一起,并设置第一镜头300和第二镜头210的焦距和摄距使得图像传感器220可以通过第一镜头300和第二镜头210采集到来自显示屏表面的指纹的清晰的指纹图像。该清晰的指纹图像可以提供足够的指纹特征来解锁电子设备。其中,第一镜头300可以是凸透镜。
其中,电源可以作用于记忆合金弹簧900,可以是直接通过开关连接在记忆合金弹簧900的两端,也可以是通过开关连接在电热丝的两端,该电热丝用于为记忆合金弹簧900加热。
关于步骤S104,请参阅图8,图8是本申请实施例提供的一种活动支架旋转将第一镜头从能够参与图像采集的位置移开的结构示意图。活动支架旋转将第一镜头从能够参与图像采集的位置移开来实现人脸解锁。如图8所示,在电子设备中传感器检测的参数满足人脸识别对应的参数范围时,电子设备中处理器使能控制电源改变记忆合金弹簧900的温度。 例如电子设备中处理器使能控制开关断开使记忆合金弹簧900温度降低,来使记忆合金弹簧900的第二端旋转,带动活动支架400及固定在活动支架400上的第一镜头300旋转。将第一镜头300从能够参与图像采集的位置移开,不参与人脸图像的采集。如图8所示,可以在摄像头20中设置第二镜头210的焦距和摄像头的摄距,使得图像传感器220可以通过第二镜头210采集到来自显示屏以外的人脸的清晰的人脸图像。该清晰的人脸图像可以提供足够的人脸图像特征来解锁电子设备。
可以理解的,图7和图8示出示例仅用于解释本申请实施例,不应构成限定。利用记忆合金弹簧900带动活动支架400及固定在活动支架400上的第一镜头300旋转,来对应人脸解锁和屏幕指纹解锁,还可以有其他的设计,本申请实施例对此不作限定。
(2)电机和导轨带动第一镜头
可选的,可以利用活动支架的移动带动第一镜头,使得第一镜头300参与或者不参与摄像头采集被摄物体的图像。
请参阅图9,图9是本申请实施例提供的一种活动支架的移动将第一镜头置于能够参与图像采集的位置的结构示意图。活动支架400移动将第一镜头300置于能够参与图像采集的位置来实现屏幕指纹解锁。如图9所示,活动支架400可以在导轨1000上移动。导轨1000可以被电机1100带动旋转,从而将活动支架400以及固定在活动支架400上的第一镜头300移动到能够参与图像采集的位置,或者将活动支架400以及固定在活动支架400上的第一镜头300从能够参与图像采集的位置移开。具体实现中,导轨1000外侧可以包含螺纹。螺母可以与螺纹咬合,随着导轨的旋转而沿导轨移动。活动支架400可以固定在螺母上,可以随着螺母的移动而沿导轨移动。
关于步骤S101,如图9所示,在电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,电子设备中处理器驱动电机1100带动导轨1000旋转,将固定在螺母上的活动支架400和固定在活动支架400上的第一镜头300沿导轨方向移动,使得第一镜头300移动到能够参与图像采集的位置。将第一镜头300移至能够参与图像采集的位置,参与指纹的图像采集。如图9所示,可以将第二镜头210和图像传感器220封装在一起,并设置第一镜头300和第二镜头210的焦距和摄距使得图像传感器220可以通过第一镜头300和第二镜头210采集到来自显示屏表面的指纹的清晰的指纹图像。该清晰的指纹图像可以提供足够的指纹特征来解锁电子设备。其中,第一镜头300可以是凸透镜。
关于步骤S104,请参阅图10,图10是本申请实施例提供的一种活动支架移动将第一镜头从能够参与图像采集的位置移开的结构示意图。活动支架400移动将第一镜头300从能够参与图像采集的位置移开来实现人脸解锁。如图10所示,在电子设备中传感器检测的参数满足人脸识别对应的参数范围时,电子设备中处理器使能控制电机1100带动导轨1000旋转,将固定在螺母上的活动支架400和固定在活动支架400上的第一镜头300沿导轨方向移动,使得第一镜头300从能够参与图像采集的位置移开。其中,导轨1000的旋转方向与图9所示的导轨1000的旋转方向相反,第一镜头300沿导轨1000移动的方向与图9所示的沿导轨1000移动的方向相反。如图10所示,可以在摄像头20中设置第二镜头210的焦距和摄像头的摄距,使得图像传感器220可以通过第二镜头210采集到来自显示屏以外的人脸的清晰的人脸图像。该清晰的人脸图像可以提供足够的人脸图像特征来解锁电子设 备。
可以理解的,图9和图10示出示例仅用于解释本申请实施例,不应构成限定。利用电动机1100和导轨1000带动活动支架400及固定在活动支架400上的第一镜头300移动,来对应人脸解锁和屏幕指纹解锁,还可以有其他的设计,本申请实施例对此不作限定。
在另一种可能的实施例中,第二镜头210和图像传感器220的组合对应屏幕指纹解锁,第一镜头300、第二镜头210和图像传感器220的组合对应人脸解锁。请参阅图11,图11是本申请实施例提供的另一种电子设备的解锁方法的流程示意图。如图11所示,屏幕指纹解锁和人脸解锁包含步骤S210-S206。其中,步骤S201-S203是屏幕指纹解锁的执行步骤,步骤S204-S206是人脸解锁的执行步骤。本申请实施例对屏幕指纹解锁对应与人脸解锁执行先后不作限定。具体的,步骤S204-S206也可以是在步骤S201-S203之前执行。
S201、当电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,电子设备的处理器控制活动支架旋转或移动,来将第一镜头从能够参与图像采集的位置移开。
S202、电子设备中处理器获取通过第二镜头和图像传感器采集的指纹图像。
S203、电子设备中处理器根据获取到的指纹图像解锁电子设备。
S204、当电子设备中传感器检测的参数满足人脸识别对应的参数范围时,电子设备的处理器控制活动支架旋转或移动,来将第一镜头移动到能够参与图像采集的位置。
S205、电子设备中处理器获取通过第一镜头、第二镜头和图像传感器采集的人脸图像。
S206、电子设备中处理器根据获取到的人脸图像解锁电子设备。
其中,图7和图8是使用记忆合金弹簧带动活动支架旋转来实现人脸解锁和屏幕指纹解锁之间的切换。图9和图10是利用电机和导轨使活动支架移动实现人脸解锁和屏幕指纹解锁之间的切换。下面结合图7-10分别介绍一种记忆合金弹簧带动第一镜头的实现示例,并介绍一种电机和导轨带动第一镜头的实现示例。
一、记忆合金弹簧带动第一镜头
具体的,当电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,如图8所示,电子设备中处理器使能控制电源改变记忆合金弹簧900的温度。例如电子设备中处理器使能控制开关断开使记忆合金弹簧900温度降低,来使记忆合金弹簧900的第二端旋转,带动活动支架400及固定在活动支架400上的第一镜头300旋转。将第一镜头300从摄像头中移出,不参与指纹图像的采集。
如图8所示,可以在摄像头20中设置第二镜头210的焦距和摄像头的摄距,使得图像传感器220可以通过第二镜头210采集到来自显示屏表面的清晰的指纹图像。该清晰的指纹图像可以提供足够的指纹特征来解锁电子设备。
在电子设备中传感器检测的参数满足人脸识别对应的参数范围时,电子设备中处理器使能控制电源改变记忆合金弹簧900的温度。例如处理器使能控制开关闭合使电源对记忆合金弹簧900加热,来使记忆合金弹簧900的第二端旋转,带动活动支架400及固定在活动支架400上的第一镜头300旋转。将第一镜头300移至能够参与图像采集的位置参与人脸的图像采集。如图7所示,可以将第二镜头210和图像传感器220封装在一起,并设置第一镜头300和第二镜头210的焦距和摄距使得图像传感器220可以通过第一镜头300和 第二镜头210采集到来自显示屏以外的人脸的清晰的人脸图像。该清晰的人脸图像可以提供足够的人脸图像特征来解锁电子设备。其中,第一镜头300可以是凹透镜。
二、电机和导轨带动第一镜头
第二镜头210和图像传感器220的组合对应屏幕指纹解锁,第一镜头300、第二镜头210和图像传感器220的组合对应人脸解锁。结合图9和图10屏幕指纹解锁和人脸解锁的过程如下:
当传感器检测的参数满足指纹识别对应的参数范围时,确定为指纹解锁的场景。如图10所示,电子设备中处理器使能控制电机1100带动导轨1000旋转,将固定在螺母上的活动支架400和固定在活动支架400上的第一镜头300沿导轨方向移动,使得第一镜头300从能够参与图像采集的位置移开。第一镜头300不参与指纹图像的采集。如图8所示,可以在摄像头20中设置第二镜头210的焦距和摄像头的摄距,使得图像传感器220可以通过第二镜头210采集到来自显示屏表面的清晰的指纹图像。该清晰的指纹图像可以提供足够的指纹特征来解锁电子设备。其中,第一镜头300可以是凹透镜。
当传感器检测的参数满足人脸识别对应的参数范围时,确定为人脸解锁的场景。电子设备中处理器驱动电机1100带动导轨1000旋转,将固定在螺母上的活动支架400和固定在活动支架400上的第一镜头300沿导轨方向移动,使得第一镜头300移动到能够参与图像采集的位置。将第一镜头300移至能够参与图像采集的位置参与人脸的图像采集。如图9所示,可以将第二镜头210和图像传感器220封装在一起,并设置第一镜头300和第二镜头210的焦距和摄距使得图像传感器220可以通过第一镜头300和第二镜头210采集到来自显示屏以外的人脸的清晰的人脸图像。该清晰的人脸图像可以提供足够的人脸图像特征来解锁电子设备。
可以理解的,图7-图10示出示例仅用于解释本申请实施例,不应构成限定。利用电动机1100和导轨1000带动活动支架400及固定在活动支架400上的第一镜头300移动,来对应人脸解锁和屏幕指纹解锁,还可以有其他的设计,本申请实施例对此不作限定。利用记忆合金弹簧900带动活动支架400及固定在活动支架400上的第一镜头300旋转,来对应人脸解锁和屏幕指纹解锁,还可以有其他的设计,本申请实施例对此不作限定。例如,可以利用机械结构设计实现,在开关闭合对记忆合金弹簧900加热时,将第一镜头从能够参与到图像采集的位置移开。在开关断开时,将第一镜头移至能够参与到图像采集的位置。上述示例均用于解释本申请实施例,不应构成限定。
可以理解的,图7-10示出摄像头中,第一镜头参与图像采集时,也可以是位于第二镜头和图像传感器之间,本申请实施例对此不作限定。
在电子设备中利用摄像头进行人脸解锁和屏幕指纹解锁的具体实现时,可以将屏幕指纹解锁和人脸解锁中的任一个对应的摄像头设置为初始状态。该初始状态对应屏幕指纹解锁和人脸解锁中的一种解锁方式。在摄像头从初始状态改变为另一状态采集被摄物体的图像以实现另一种解锁方式之后,摄像头可以恢复到初始状态。其中的摄像头的状态可以包括两种:一种是包含第二镜头和图像传感器,另一种是包含第一镜头、第二镜头和图像传感器。具体实现时,也可以不设置初始状态,在摄像头采集被摄物体的图像以实现任一种 解锁方式之后,无需恢复。下面分别介绍是否设置初始状态这两种情况。
①设置一种解锁方式对应的摄像头状态为初始状态
在使用记忆合金弹簧旋转活动支架带动第一镜头来切换解锁方式的场景下,具体如图7和图8所示出的切换解锁方式的场景下,电子设备中处理器可以将记忆合金弹簧断开加热时对应的摄像头状态设置为初始状态,则在电子设备未处于解锁场景的时间段内,无需电源持续为记忆合金弹簧进行加热,从而可以节省功耗,减少电子设备内部热量的聚集,延长记忆合金弹簧的寿命。
例如,结合图6所示出的实施例,如图7和图8所示,在第二镜头210和图像传感器220的组合对应人脸解锁,第一镜头300、第二镜头210和图像传感器220的组合对应屏幕指纹解锁的场景下,如果在开关断开加热记忆合金弹簧900的状态下,第一镜头300被从能够参与图像采集的位置移开,进行人脸图像采集。则电子设备中处理器可以将人脸解锁所使用的第二镜头210和图像传感器220参与图像识别的摄像头状态作为初始状态。在电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围下,执行步骤S101,即开关闭合加热记忆合金弹簧900,第一镜头300、第二镜头210和图像传感器220的摄像头采集指纹图像,实现屏幕指纹解锁。在步骤S103之后,即执行屏幕指纹解锁之后,电子设备中处理器可以执行以下步骤:
步骤一:使能控制开关断开,记忆合金弹簧900可以带动活动支架400将第一镜头300从能够参与图像采集的位置移开,恢复到摄像头的初始状态。
步骤二:在电子设备中传感器检测的参数满足人脸识别对应的参数范围下,如果摄像头处于初始状态,则无需调整摄像头,直接利用第二镜头210和图像传感器220采集人脸图像,进行人脸解锁。
上述设置摄像头初始状态,可以在人脸解锁场景下无需调整摄像头,从而缩短解锁时间,提高电子设备的解锁效率。
再例如,结合图11所示出的实施例,如图7和图8所示,在第二镜头210和图像传感器220的组合对应屏幕指纹解锁,第一镜头300、第二镜头210和图像传感器220的组合对应人脸解锁的场景下,如果在开关断开加热记忆合金弹簧900的状态下,第一镜头300被从能够参与图像采集的位置移开,来进行指纹图像采集。则可以将屏幕指纹解锁所使用的摄像头状态作为初始状态。在电子设备中传感器检测的参数满足人脸识别对应的参数范围,执行步骤S204,即开关闭合加热记忆合金弹簧900,第一镜头300、第二镜头210和图像传感器220采集人脸图像,实现人脸解锁。在步骤S206之后,即执行人脸解锁之后,电子设备中处理器可以执行步骤S207和S208(图11中未示出)。
S207、使能开关断开,记忆合金弹簧900可以带动活动支架400将第一镜头300从能够参与图像采集的位置移开,恢复到摄像头的初始状态。
S208、在电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,如果摄像头处于初始状态,则无需调整摄像头,直接利用第二镜头210和图像传感器220采集指纹图像,进行屏幕指纹解锁。
上述设置摄像头初始状态,可以在屏幕指纹解锁场景下无需调整摄像头,从而缩短解锁时间,提高电子设备的解锁效率。
在图6-11示出的实施例中,摄像头包含第一状态和第二状态。在第一状态下,第一镜头、第二镜头和图像传感器参与图像采集,即第一镜头位于能够采集图像的位置。在第二状态下,第二镜头和图像传感器参与图像采集,即第一镜头从能够采集图像的位置移开。
在图6-11示出的实施例中,摄像头的指纹识别状态用于采集指纹图像,来进行指纹识别。摄像头的人脸识别状态用于采集人脸图像,来进行人脸识别。在图6示出的实施例中,摄像头的指纹识别状态下,第一镜头、第二镜头和图像传感器采集指纹图像,即第一镜头位于能够采集图像的位置。在摄像头的人脸识别状态下,第二镜头和图像传感器采集人脸图像,即第一镜头从能够采集图像的位置移开。在图11示出的实施例中,摄像头的指纹识别状态下,第二镜头和图像传感器采集指纹图像,即第一镜头从能够采集图像的位置移开。在摄像头的人脸识别状态下,第一镜头、第二镜头和图像传感器采集人脸图像,即第一镜头位于能够采集图像的位置。
在图6-11示出的实施例中,记忆合金弹簧包含第三状态和第四状态。在记忆合金弹簧变为第三状态时,第一镜头被活动支架上记忆合金弹簧带动到能够参与图像采集的位置,使得摄像头处于第一状态。在记忆合金弹簧变为第四状态时,第一镜头还被活动支架上记忆合金弹簧带动从能够参与图像采集的位置移开,使得摄像头处于第二状态。可选的,如图7和图8所示,在电子设备处理器控制开关闭合后,记忆合金弹簧变为第三状态。在电子设备处理器控制开关断开后,记忆合金弹簧变为第四状态。
在图6-11示出的实施例中,电机带动活动支架移动到第一位置时,固定在活动支架上的第一镜头被带动到能够参与图像采集的位置,使得摄像头处于所述第一状态。电机带动活动支架移动到第二位置时,固定在所述活动支架上的第一镜头被带动从能够参与图像采集的位置移开,使得摄像头处于所述第二状态。可选的,如图9所示,活动支架400移动到了第一位置。如图10所示,活动支架400移动到了第二位置。
在使用电机和导轨带动活动支架和固定在活动支架上的第一镜头来切换解锁方式的场景下,具体如图9和图10所示出的切换解锁方式的场景下,可以将人脸解锁和屏幕指纹解锁中任一种解锁方式对应的摄像头状态设置为初始状态。
例如,结合图6所示出的实施例,如图9和图10所示,在第二镜头210和图像传感器220的组合对应人脸解锁,第一镜头300、第二镜头210和图像传感器220的组合对应屏幕指纹解锁的场景下,可以将人脸解锁所使用的摄像头状态作为初始状态。在电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,执行步骤S101,即电子设备中处理器驱动电机1100带动导轨1000旋转,将固定在螺母上的活动支架400和固定在活动支架400上的第一镜头300沿导轨方向移动,使得第一镜头300移动到能够参与图像采集的位置。将第一镜头300移至能够参与图像采集的位置参与指纹的图像采集。在步骤S103之后,即执行屏幕指纹解锁之后,电子设备中处理器可以执行以下操作:使能控制电机1100带动导轨1000旋转,将固定在螺母上的活动支架400和固定在活动支架400上的第一镜头300沿导轨方向移动,使得第一镜头300从能够参与图像采集的位置移开,恢复到摄像头的初始状态。
在人脸解锁场景下,如果摄像头处于初始状态,则无需调整摄像头,直接利用第二镜 头210和图像传感器220采集人脸图像,进行人脸解锁。上述设置摄像头初始状态,可以在人脸解锁场景下无需调整摄像头,从而缩短解锁时间,提高电子设备的解锁效率。
可选的,摄像头状态的初始状态还可以是对用户解锁数据进行统计学习得到的。例如,统计得到用户使用屏幕指纹解锁的次数远多于使用人脸解锁的次数,则电子设备可以将指纹解锁对应的摄像头状态设置为初始状态。通过机器学习来设置摄像头的初始状态,可以减少调整摄像头焦距的次数,从而提升解锁效率。
可选的,在电子设备中的加速度传感器检测到满足电子设备突然被拿起的数据时,显示屏上指纹解锁区域可以闪烁,用来提示指纹解锁区域。
②无需设置初始状态
可选的,摄像头状态也可以没有初始状态。在摄像头进行被摄物体的图像采集,以实现屏幕指纹解锁和人脸解锁中任一种解锁方式之后,摄像头无需恢复。在利用摄像头实现屏幕指纹解锁和人脸解锁中任一种解锁方式之后,电子设备中处理器可以记录该解锁方式。在下一次检测到需要解锁电子设备时,电子设备中处理器检测本次需要解锁的解锁方式与上次记录的解锁方式是否相同。若是,则无需改变摄像头的状态即可以采集被摄物体的图像,以实现解锁。若否,则需要改变摄像头的状态来采集被摄物体的图像,以实现解锁。
结合图6所示出的实施例,如图9和图10所示,在第二镜头210和图像传感器220的组合对应人脸解锁,第一镜头300、第二镜头210和图像传感器220的组合对应屏幕指纹解锁的场景下,摄像头在进行被摄物体的图像采集,以实现屏幕指纹解锁和人脸解锁中任一种解锁方式之后,无需恢复到某一个状态。
在电子设备第n(n为大于等于1的正整数)次执行人脸解锁之后,第一镜头300仍然可以处在偏离能够参与图像采集的位置。电子设备的处理器可以执行以下步骤:
Step1:记录该第n次解锁所使用的解锁方式为人脸解锁。
Step2:下一次解锁中,在第n+1次解锁时电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围,电子设备中处理器检测到第n+1次解锁的方式与第n次解锁的方式不同。
Step3:电子设备中处理器驱动电机1100带动导轨1000旋转,将固定在螺母上的活动支架400和固定在活动支架400上的第一镜头300沿导轨方向移动,使得第一镜头300移动到能够参与图像采集的位置。将第一镜头300移动到能够参与图像采集的位置参与指纹的图像采集。在执行屏幕指纹解锁之后,第一镜头300仍然可以处在能够参与图像采集的位置。
在step1之后,如果电子设备中传感器检测的参数满足人脸识别对应的参数范围,则无需调整摄像头,直接利用第二镜头210和图像传感器220采集人脸图像,进行人脸解锁。可以在人脸解锁场景下无需调整摄像头,从而缩短解锁时间,提高电子设备的解锁效率。
下面分别说明在图6和图11示出的解锁方法中电子设备识别屏幕指纹解锁的场景和人脸解锁的场景的实现方式。屏幕指纹解锁的场景由电子设备中传感器检测到的参数满足屏幕指纹识别对应的参数范围确定。人脸解锁的场景由电子设备中传感器检测的参数满足人脸识别对应的参数范围确定。
(1)识别屏幕指纹解锁的场景
电子设备处于锁定状态下,在检测到指纹靠近显示屏上特定区域时,电子设备中处理器可以确定为屏幕指纹解锁场景。显示屏上特定区域可以是显示屏下摄像头所在的位置。电子设备中处理器检测指纹靠近显示屏上特定区域可以利用以下中的一种或多种方式:
a.检测触摸屏上特定区域上的触摸操作
由于人体的电流感应,当手指接触触摸屏时,人体电场使得手指和触摸屏之间形成以一个耦合电容。对于高频电流来说,电容是导体。手指从触摸屏的接触点吸走一个小电流。这个电流分别从触摸屏的四角上的电极中流出,且流经这四个电极的电流与接触点到四角的距离成正比。通过对这四个电流比例,可以计算出触摸点的位置。电子设备在锁定状态下当该触摸点在特定区域时,电子设备中处理器可以确定为屏幕指纹解锁场景。
b.利用红外发射器发射的红外线检测指纹靠近
红外发射器和摄像头可以设置在显示屏特定区域之下的位置。该红外发射器可以周期性的发射红外线,当手指靠近时,红外检测器可以接收到手指反射的红外线。该红外检测器可以是光电二极管,用于检测来自附近物体的红外反射光。当检测到充分的反射光时,可以确定显示屏的特定区域附近有物体。当检测到不充分的反射光时,电子设备可以确定显示屏的特定区域附近没有物体。红外检测器还可以与环境光传感器配合,检测电子设备是否在口袋里,以防误触。
电子设备在锁定状态下当位于显示屏特定区域之下的红外检测器检测到充分的红外反射光时,电子设备中处理器可以确定为屏幕指纹解锁场景。其中,充分的红外反射光可以是反射光的强度大于或等于第一阈值。
其中,摄像头可以是红外摄像头,则可以无需额外安装红外检测器,利用红外摄像头来实现红外检测器的功能。
c.利用显示屏上压力传感器检测特定区域的压力强度或者压力强度的变化量
显示屏中可以设置压力传感器,压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器,电极之间的电容改变。电子设备可以根据电容的变化确定压力的强度或者压力的强度变化量。因此,当检测到显示屏特定区域的压力强度或者压力强度的变化量达到一定数值,例如压力强度或者压力强度的变化量大于或等于第二阈值,可以确定在显示屏特定区域有触摸操作。电子设备在锁定状态下当确定在显示屏特定区域有触摸操作时,电子设备中处理器可以确定为屏幕指纹解锁场景。
d.利用距离传感器检测距离或者距离的变化量
距离传感器可以检测距离和距离的变化量,显示屏中可以设置距离传感器。当检测到距离足够小或者距离变化量足够大时,例如,距离小于或等于第三阈值或者距离的变化量大于或等于第四阈值时,电子设备中处理器可以确定在显示屏特定区域有触摸操作。电子设备在锁定状态下当确定在显示屏特定区域有触摸操作时,电子设备中处理器可以确定为屏幕指纹解锁场景。
e.利用摄像头采集的图像中的指纹特征
指纹特征和人脸特征区别很大。例如指纹图像包含纹路,而人脸图像包含眼睛、鼻子、眉毛和嘴巴。电子设备中处理器可以保存一个分类器算法,该分类器算法可以分类人脸图 像和指纹图像。该分类器算法可以通过机器学习获得。在电子设备锁定状态下,可以利用摄像头周期性的采集图像,电子设备中处理器对采集的图像利用分离器进行分类。当分类得到图像为指纹图像时,电子设备中处理器可以确定为屏幕指纹解锁场景。
可以理解的,利用分类器确定摄像头采集的图像是指纹图像的方法仅用于解释本申请实施例。还可以使用其他的方法来分类指纹图像或人脸图像,本申请实施例对此不作限定。
可以理解的,上述对处理器检测指纹靠近显示屏上特定区域的方式举例仅用于解释本申请实施例,不应构成限定。检测指纹靠近显示屏上特定区域还可以包含其他方法。
(2)识别人脸解锁的场景
电子设备处于锁定状态下,在检测到人脸靠近显示屏时,电子设备中处理器可以确定为人脸解锁场景。电子设备中处理器检测人脸靠近显示屏可以利用以下中的一种或多种方式:
a.利用陀螺仪传感器检测到抬腕操作
电子设备处于锁定状态下,可以利用陀螺仪传感器检测电子设备的运动姿态。在电子设备处于锁定状态下,当陀螺仪传感器检测到的电子设备的运动参数满足抬腕操作的参数要求时,例如,陀螺仪传感器检测到电子设备的运动参数大于或等于第五阈值时,电子设备中处理器可以确定为人脸解锁场景。
可选的,陀螺仪传感器还可以与加速度传感器、重力传感器和光线传感器中的一个或多个配合,更加准确的确定人脸解锁场景,以防误操作。
b.利用距离传感器检测距离或者距离的变化量
距离传感器可以检测距离和距离的变化量,显示屏中可以设置距离传感器。当检测到距离满足人脸解锁对应的距离范围或者距离变化量足够大时,例如,距离大于或等于第六阈值电子设备中处理器可以确定为人脸解锁场景。
c.利用摄像头采集的图像中的人脸图像特征
与前述指纹特征类似,人脸特征和指纹特征区别很大。例如人脸图像包含眼睛、鼻子、眉毛和嘴巴,而指纹图像包含纹路。电子设备中处理器可以利用存储的分类器算法分类人脸图像和指纹图像。在电子设备锁定状态下,可以利用摄像头周期性的采集图像,电子设备中处理器对采集的图像利用分离器进行分类。在电子设备锁定状态下,当分类得到图像为人脸图像时,电子设备中处理器可以确定为人脸解锁场景。其中的分类器算法可以通过机器学习获得。
可以理解的,上述对处理器检测指纹靠近显示屏上特定区域的方式、检测人脸靠近显示屏的方式举例仅用于解释本申请实施例,不应构成限定。检测指纹靠近显示屏上特定区域还可以包含其他方法。检测人脸靠近显示屏也可以包含其他方法。
可以理解的,上述人脸解锁对应的摄像头状态和指纹解锁对应的摄像头状态之间的切换还可以用于除了解锁以外其他需要验证身份的场景,例如支付场景、身份验签和解锁应用场景等。
例如,在支付场景下,当需要验证指纹时,可以将摄像头调整为指纹识别对应的状态。指纹识别对应的摄像头状态例如图6示出的实施例中第一镜头移至能够参与图像采集的位置的摄像头状态。该摄像头可以通过第一镜头、第二镜头采集到来自显示屏表面的清晰的 指纹图像。该清晰的指纹图像可以提供足够的指纹特征来进行指纹验证。再例如,在需要对用户进行人脸验证时,可以将摄像头调整为人脸识别对应的状态。人脸识别对应的摄像头状态例如图6示出的实施例中第一镜头从能够参与图像采集的位置移开的摄像头状态。又例如,在解锁应用时,如果需要验证用户的指纹,可以将摄像头调整为指纹识别对应的状态。指纹识别对应的摄像头状态例如图6示出的实施例中第一镜头移至能够参与图像采集的位置的摄像头状态。如果需要验证用户的人脸,可以将摄像头调整为人脸识别对应的状态。人脸识别对应的摄像头状态例如图6示出的实施例中第一镜头从能够参与图像采集的位置移开的摄像头状态。
本申请实施例中,人脸识别对应的摄像头状态即图6和图11示出的人脸解锁对应的摄像头状态,即前后文中的摄像头的人脸识别状态。指纹识别对应的摄像头状态即图6和图11示出的指纹解锁对应的摄像头状态,即前后文中的摄像头的指纹识别状态。
可选的,电子设备中还可以包含红外发射器,摄像头可以是红外摄像头。红外发射器可以发射红外光,红外摄像头中图像传感器可以接收人脸或者指纹反射的光线,来采集人脸图像或者指纹图像。利用红外发射器和红外摄像头进行人脸图像的采集,可以在可见光不足例如夜间时仍然能够实现人脸解锁。利用红外发射器和红外摄像头进行指纹图像的采集,无需点亮显示屏即可以采集指纹图像,进而实现指纹解锁。可以节省解锁的步骤,提高电子设备解锁的便利性。
显示屏0.05~0.2秒刷新一次显示,在刷新的间隔,显示屏不显示。可选的,为了减少红外线对显示屏显示效果的影响,红外发射器可以在显示屏刷新不显示时(即灭屏)发射红外光线。请参阅图12,图12是本申请实施例提供的一种红外发射器发射红外光线的时间示意图。如图12所示,显示屏在0-t0、t1-t2时间段内点亮,在t0-t1、t2-t3时间段内熄灭。则红外发射器发射红外光线的时间可以在灭屏时间段内,如在t0-t1、t2-t3时间段内。
在显示屏不显示的间隔发射红外线,可以减少红外线对显示屏显示效果的影响,例如对显示色度的影响。另外,利用红外光和红外摄像头进行人脸图像和指纹图像的采集,可以在可见光不足例如夜间时仍然能够实现人脸解锁,可以提高人脸解锁的便利性。还无需点亮显示屏即可以采集指纹图像,进而实现指纹解锁。可以节省指纹解锁的步骤,提高电子设备指纹解锁的便利性。
在另一种可能的实施例中,电子设备可以在摄像头中使用液体镜头来代替第一镜头和第二镜头,实现焦距和摄距可调。请参阅图13,图13是本申请实施例提供的另一种摄像头的结构示意图。如图13所示,摄像头200包含液体镜头230和图像传感器220。电子设备既可以在图像传感器220上采集到清晰的人脸图像,又可以在图像传感器220上采集到清晰的指纹图像。具体的,液体镜头230通过改变液体的压力来调整焦距。液体镜头230中可以包含两种不同且不能相融合的液体,这两种液体的折射率不同。改变液体的压力可以改变两种液体交接处月牙形表面的形状,从而改变液体镜头230的焦距。其中,改变液体的压力可以通过弹簧对液体镜头加压实现。另外也可以利用压电材料制作液体镜头的外壁。电子设备的处理器可以通过调节液体镜头230两端的电压,利用逆压电效应来改变液 体的压力。
液体镜头230可以实现两种焦距,即人脸对应的焦距和指纹对应的焦距。在人脸对应的焦距下,显示屏以外的人脸可以通过液体镜头在图像传感器上形成清晰的人脸图像。该清晰的人脸图像可以提供足够的人脸图像特征来完成人脸识别。在指纹对应的焦距下,显示屏以外的指纹可以通过液体镜头在图像传感器上形成清晰的指纹图像。该清晰的指纹图像可以提供足够的指纹特征来完成指纹识别。
其中,指纹对应的焦距即为第一焦距,人脸对应的焦距即为第二焦距。
在电子设备的处理器检测到屏幕指纹解锁的场景时,电子设备的处理器调节液体镜头230的焦距为指纹对应的焦距。利用包含液体镜头的摄像头采集显示屏表面指纹的指纹图像,来实现指纹验证。在电子设备的处理器检测到人脸解锁的场景时,电子设备的处理器调节液体镜头的焦距为人脸对应的焦距。利用包含液体镜头230的摄像头采集显示屏以外人脸的人脸图像,来实现人脸验证。
可选的,在电子设备锁定状态下,可以为液体镜头230提供周期性变化的压力。在该周期性变化的压力的作用下,液体镜头230的焦距在人脸对应的焦距和指纹对应的焦距之间周期性的变化。电子设备无需判断解锁场景为人脸解锁场景或者指纹解锁场景。人脸解锁场景下,电子设备在人脸对应的焦距维持的时间内通过液体镜头230采集来自显示屏以外的人脸的图像。屏幕指纹解锁场景下,电子设备在指纹对应的焦距维持的时间内通过液体镜头230采集来自显示屏表面的指纹的图像。
可选的,在液体焦距的变化周期内,人脸对应的焦距维持的时间内,人脸可以通过液体镜头在图像传感器上形成清晰的人脸图像。在液体焦距的变化周期内,指纹对应的焦距维持的时间内,指纹可以通过液体镜头在图像传感器上形成清晰的指纹图像。
其中,关于电子设备100、显示屏500、结构件600、红外发射器700和主板800的描述可以参考图5所描述实施例,这里不再赘述。
本申请实施例中,摄像头是设置在显示屏以下的屏下摄像头。显示屏可以是有机发光二极管(organic light-emitting diode,OLED)显示屏。显示屏还可以是液晶显示屏(liquid crystal display,LCD)。在显示屏为LCD的情况下,在显示屏上与摄像头对应的位置上,LCD背光模组中的反射膜和扩散膜需要开孔,来使屏下摄像头接收到足够的光线。其中,背光模组中反射膜用于改变背光发出的光线的发射方向,为LCD提供背光。扩散膜用于使背光亮度均匀。另外,在摄像头为红外摄像头时,也可以使用可透过红外光的反射膜,则无需对反射膜进行开孔。
请参阅图14,图14是本申请实施例提供的一种电子设备中显示屏和摄像头的位置示意图。如图14所示,在电子设备中,摄像头20设置在显示屏500显示平面的下方。显示屏500上包含与摄像头20对应的区域510。摄像头20可以利用透过显示屏500上区域510的光线来采集指纹图像或者人脸图像。其中,摄像头20的焦距可以调节,使得摄像头20可以采集清晰的指纹图像,也可以采集清晰的人脸图像。摄像头20可以是图7-10和图13中任一个图中示出的摄像头。电子设备可以用于执行图6或图9示出的解锁方法。
为提高显示屏500上区域510上的透光率,可以对区域510降低像素密度,来提高透 光率,从而使摄像头20可以接收到更多人脸和指纹反射的光线。
其中,如图14所示,区域510可以设置在显示屏500的靠近显示平面下边缘的位置,为用户进行人脸验证和指纹验证提供便利性。可以理解的,图14中区域510在显示屏500上的位置举例仅用于解释本申请实施例,不应构成限定,区域510还可以设置在显示屏500的其他位置。
可以理解的,上述以摄像头20位于显示屏500的显示平面以下举例介绍,不应构成限定,摄像头20还可以是在电子设备的前壳的其他部位。例如,摄像头还可以是位于显示屏挖槽得到的挖槽区域内。
本申请实施例还提供一种电子设备,该电子设备包括用于实现图6或图11描述的方法的模块或单元。该电子设备可以包括图7-10任一项所描述的摄像头。
本申请实施例还提供一种芯片系统,该芯片系统包括至少一个处理器,存储器和接口电路,该存储器、该接口电路和该至少一个处理器连接,该至少一个存储器中存储有程序指令;该程序指令被该处理器执行时,可以实现图6或图11描述的方法。
本申请实施例还提供一种计算机可读存储介质,该计算机可读存储介质中存储有程序指令,当该程序指令由处理器运行时,实现图6或图11描述的方法。
在上述实施例中,全部或部分功能可以通过软件、硬件、或者软件加硬件的组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如,固态硬盘(solid state disk,SSD))等。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。

Claims (22)

  1. 一种摄像头,其特征在于,所述摄像头用于电子设备进行人脸识别和指纹识别;所述摄像头包含第一镜头、第二镜头和图像传感器;其中:
    所述摄像头包含第一状态和第二状态,在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器参与图像采集;在所述第二状态下,所述第二镜头和所述图像传感器参与图像采集;
    所述摄像头在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器用于采集指纹图像,来进行指纹识别;所述摄像头在所述第二状态下,所述第二镜头和所述图像传感器用于采集人脸图像,来进行人脸识别;
    或者
    所述摄像头在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器采集人脸图像,来进行人脸识别;所述摄像头在所述第二状态下,所述第二镜头和所述图像传感器采集指纹图像,来进行指纹识别。
  2. 根据权利要求1所述的摄像头,其特征在于,所述第一镜头固定在活动支架上,被所述活动支架带动,其中:
    所述第一镜头,用于被所述活动支架带动到能够参与图像采集的位置,使得所述摄像头处于所述第一状态;
    所述第一镜头,还用于被所述活动支架带动从所述能够参与图像采集的位置移开,使得所述摄像头处于所述第二状态。
  3. 根据权利要求2所述的摄像头,其特征在于,所述活动支架上固定有记忆合金弹簧,所述记忆合金弹簧包含第三状态和第四状态;
    在所述记忆合金弹簧变为所述第三状态时,所述第一镜头被所述活动支架上所述记忆合金弹簧带动到所述能够参与图像采集的位置,使得所述摄像头处于所述第一状态;
    在所述记忆合金弹簧变为所述第四状态时,所述第一镜头还被所述活动支架上所述记忆合金弹簧带动从所述能够参与图像采集的位置移开,使得所述摄像头处于所述第二状态。
  4. 根据权利要求3所述的摄像头,其特征在于,所述记忆合金弹簧变为所述第三状态,包括:
    所述记忆合金弹簧被加热产生形变,所述第一镜头被所述活动支架上所述记忆合金弹簧带动到所述能够参与图像采集的位置,使得所述摄像头处于所述第一状态;
    所述记忆合金弹簧变为所述第四状态,包括:
    所述记忆合金弹簧断开加热恢复形状,所述第一镜头被所述活动支架上所述记忆合金弹簧带动从所述能够参与图像采集的位置移开,使得所述摄像头处于所述第二状态。
  5. 根据权利要求2所述的摄像头,其特征在于,所述活动支架被电机带动,所述电机带动所述活动支架移动到第一位置时,固定在所述活动支架上的所述第一镜头被带动到所 述能够参与图像采集的位置,使得所述摄像头处于所述第一状态;
    所述电机带动所述活动支架移动到第二位置时,固定在所述活动支架上的所述第一镜头被带动从所述能够参与图像采集的位置移开,使得所述摄像头处于所述第二状态。
  6. 根据权利要求5所述的摄像头,其特征在于,所述活动支架通过导轨旋转被所述电机带动,所述电机带动所述活动支架移动到第一位置,包括:
    所述电机带动所述导轨旋转,所述导轨带动所述活动支架移动到所述第一位置;
    所述电机带动所述活动支架移动到第二位置,包括:
    所述电机带动所述导轨旋转,所述导轨带动所述活动支架移动到所述第二位置。
  7. 根据权利要求1至6任一项所述的摄像头,其特征在于,在以下情况下,所述第一镜头为凸透镜:所述摄像头在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器采集指纹图像,来进行指纹识别;所述摄像头在所述第二状态下,所述第二镜头和所述图像传感器采集人脸图像,来进行人脸识别;
    在以下情况下,所述第一镜头为凹透镜:所述摄像头在所述第一状态下,所述第一镜头、所述第二镜头和所述图像传感器采集人脸图像,来进行人脸识别;所述摄像头在所述第二状态下,所述第二镜头和所述图像传感器采集指纹图像,来进行指纹识别。
  8. 根据权利要求1至7任一项所述的摄像头,其特征在于,所述摄像头为红外摄像头,所述摄像头用于接收所述指纹反射的红外线来采集指纹图像,所述摄像头还用于接收所述人脸反射的红外线来采集人脸图像。
  9. 根据权利要求8所述的摄像头,其特征在于,所述摄像头位于所述电子设备的显示屏的显示平面以下,所述指纹反射的红外线和所述人脸反射的红外线是所述电子设备中红外发射器在所述显示屏刷新的间隔发射的。
  10. 根据权利要求1至9任一项所述的摄像头,其特征在于,所述摄像头还用于在完成人脸识别或者完成指纹识别之后,恢复到初始状态,所述初始状态为所述第一状态和所述第二状态中的任一个状态。
  11. 一种摄像头,其特征在于,所述摄像头用于电子设备进行人脸识别和指纹识别;所述摄像头包含液体镜头和图像传感器,所述液体镜头的焦距可调,所述图像传感器用于采集图像;其中:
    所述液体镜头的焦距为第一焦距时,所述摄像头用于采集指纹图像,来进行指纹识别;所述液体镜头为第二焦距时,所述摄像头用于采集人脸图像,来进行人脸识别。
  12. 根据权利要求11所述的摄像头,其特征在于,所述液体镜头的焦距在所述第一焦距和所述第二焦距之间周期性变化。
  13. 一种电子设备中身份验证方法,其特征在于,所述方法包括:
    当电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围时,电子设备的处理器使用摄像头的指纹识别状态采集指纹图像,来进行指纹识别;
    当电子设备中传感器检测的参数满足人脸识别对应的参数范围时,电子设备的处理器使用所述摄像头的人脸识别状态采集人脸图像,来进行人脸识别;
    其中,所述摄像头包含第一镜头、第二镜头和图像传感器;在所述摄像头的指纹识别状态下,所述第一镜头、所述第二镜头和所述图像传感器采集指纹图像;在所述摄像头的人脸识别状态下,所述第二镜头和所述图像传感器采集人脸图像;
    或者
    在所述摄像头的指纹识别状态下,所述第二镜头和所述图像传感器采集指纹图像;在所述摄像头的人脸识别状态下,所述第一镜头、所述第二镜头和所述图像传感器采集人脸图像。
  14. 根据权利要求13所述的方法,其特征在于,所述电子设备的处理器使用摄像头的指纹识别状态采集指纹图像,来进行指纹识别之后,或者所述电子设备的处理器使用摄像头的人脸识别状态采集人脸图像,来进行人脸识别之后,所述方法还包括:
    所述电子设备的处理器将所述摄像头恢复到初始状态,所述初始状态为所述指纹识别状态和所述人脸识别状态中的任一个状态。
  15. 根据权利要求13或14所述的方法,其特征在于,所述电子设备中传感器检测的参数满足屏幕指纹识别对应的参数范围,包括以下一项或多项:
    触摸屏上摄像头对应的区域上检测到触摸操作;
    红外检测器检测到来自所述触摸屏上摄像头对应的区域以外的反射光的强度大于或等于第一阈值;
    压力传感器检测到所述触摸屏上摄像头对应的区域上的压力强度或者压力强度的变化量大于或等于第二阈值;
    距离传感器检测到被摄物体与所述触摸屏上摄像头对应的区域的距离小于或等于第三阈值或者距离的变化量大于或等于第四阈值;
    所述摄像头采集到的图像被分类为指纹图像。
  16. 根据权利要求13至15任一项所述的方法,其特征在于,所述电子设备中传感器检测的参数满足人脸识别对应的参数范围,包括以下一项或多项:
    陀螺仪传感器检测到所述电子设备的运动参数大于或等于第五阈值;
    距离传感器检测到所述被摄物体与所述触摸屏上所述摄像头对应的区域的距离大于或等于第六阈值;
    所述摄像头采集到的图像被分类为人脸图像。
  17. 根据权利要求13至16任一项所述的方法,其特征在于,在以下情况下:在摄像头的所述指纹识别状态,所述第一镜头、所述第二镜头和所述图像传感器采集指纹图像;在摄像头的所述人脸识别状态,所述第二镜头和所述图像传感器采集人脸图像,所述电子设备的处理器使用摄像头的指纹识别状态采集指纹图像,来进行指纹识别之前,所述方法还包括:
    所述电子设备的处理器控制用于对记忆合金弹簧加热的开关闭合,所述第一镜头被所述记忆合金弹簧带动到所述能够参与图像采集的位置;或者,所述电子设备的处理器控制电机带动所述第一镜头到所述能够参与图像采集的位置;
    所述电子设备的处理器使用摄像头的人脸识别状态采集人脸图像,来进行人脸识别之前,所述方法还包括:
    所述电子设备的处理器控制用于对所述记忆合金弹簧加热的开关断开,所述第一镜头被所述记忆合金弹簧带动从所述能够参与图像采集的位置移开;或者,所述电子设备的处理器控制所述电机带动所述第一镜头从所述能够参与图像采集的位置移开。
  18. 根据权利要求13至16任一项所述的方法,其特征在于,在以下情况下:在摄像头的所述指纹识别状态,所述第二镜头和所述图像传感器采集指纹图像;在摄像头的所述人脸识别状态,所述第一镜头、所述第二镜头和所述图像传感器采集人脸图像,所述电子设备的处理器使用摄像头的指纹识别状态采集指纹图像,来进行指纹识别之前,所述方法还包括:
    所述电子设备的处理器控制用于对记忆合金弹簧加热的开关断开,所述第一镜头被所述记忆合金弹簧带动从所述能够参与图像采集的位置移开;或者,所述电子设备的处理器控制所述电机带动所述第一镜头从所述能够参与图像采集的位置移开;
    所述电子设备的处理器使用摄像头的人脸识别状态采集人脸图像,来进行人脸识别之前,所述方法还包括:
    所述电子设备的处理器控制用于对所述记忆合金弹簧加热的开关闭合,所述第一镜头被所述记忆合金弹簧带动到所述能够参与图像采集的位置;或者,所述电子设备的处理器控制所述电机带动所述第一镜头到所述能够参与图像采集的位置。
  19. 根据权利要求13至18任一项所述的方法,其特征在于,所述摄像头为红外摄像头,所述摄像头用于接收所述指纹反射的红外线来采集指纹图像,所述摄像头还用于接收所述人脸反射的红外线来采集人脸图像;所述摄像头位于所述电子设备的显示屏的显示平面以下,所述方法还包括:
    电子设备的处理器控制红外发射器在所述显示屏刷新的间隔发射红外线。
  20. 一种电子设备,其特征在于,所述电子设备包括处理器和摄像头,所述摄像头位于所述电子设备的前壳,其中:
    所述摄像头是如权利要求1至10任一项所描述的摄像头;
    所述处理器,用于控制用于对所述记忆合金弹簧加热的开关闭合或断开,或者控制所 述电机带动所述第一镜头移动。
  21. 一种电子设备,其特征在于,所述电子设备包括处理器和摄像头,所述摄像头位于所述电子设备的前壳,其中:
    所述摄像头是如权利要求11或12所描述的摄像头;
    所述处理器,用于控制所述液体镜头的焦距在所述第一焦距和所述第二焦距之间切换。
  22. 一种电子设备,其特征在于,所述电子设备用于执行权利要求13至19任一项所描述的电子设备中身份验证方法。
PCT/CN2019/107832 2018-10-26 2019-09-25 摄像头、电子设备和身份验证方法 WO2020082968A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811261698.7 2018-10-26
CN201811261698.7A CN111103922B (zh) 2018-10-26 2018-10-26 摄像头、电子设备和身份验证方法

Publications (1)

Publication Number Publication Date
WO2020082968A1 true WO2020082968A1 (zh) 2020-04-30

Family

ID=70330886

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/107832 WO2020082968A1 (zh) 2018-10-26 2019-09-25 摄像头、电子设备和身份验证方法

Country Status (2)

Country Link
CN (1) CN111103922B (zh)
WO (1) WO2020082968A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114554072A (zh) * 2020-11-26 2022-05-27 华为技术有限公司 马达控制方法和电子设备
CN114598821A (zh) * 2022-03-08 2022-06-07 联想(北京)有限公司 控制方法、电子装置以及电子设备

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022010873A1 (en) * 2020-07-06 2022-01-13 Saphlux, Inc. Computing devices with under-display sensors
CN115278003B (zh) * 2020-09-08 2023-07-25 杭州海康威视数字技术股份有限公司 拍摄设备
CN113691714B (zh) * 2021-08-24 2023-07-25 维沃移动通信(杭州)有限公司 电子设备
CN115938018B (zh) * 2022-09-28 2024-06-14 杭州指安科技股份有限公司 一种生物识别集成设备及方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1932840A (zh) * 2005-09-16 2007-03-21 中国科学技术大学 基于虹膜和人脸的多模态生物特征身份识别系统
CN104349031A (zh) * 2013-07-31 2015-02-11 华为技术有限公司 一种调整摄像装置的取景范围方法及摄像系统、操作装置
CN105320943A (zh) * 2015-10-22 2016-02-10 北京天诚盛业科技有限公司 生物识别装置及其进行生物识别的方法
CN108594942A (zh) * 2018-04-25 2018-09-28 维沃移动通信有限公司 一种身份识别方法及移动终端

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101639891B (zh) * 2008-07-28 2012-05-02 汉王科技股份有限公司 一种双摄像头人脸识别装置和方法
TW201104589A (en) * 2009-07-28 2011-02-01 Hanwang Technology Co Ltd A human face identification device with two image-capturing camera heads, and method thereof
CN201522710U (zh) * 2009-10-19 2010-07-07 深圳市中控生物识别技术有限公司 人脸及指纹识别设备
CN103383216B (zh) * 2012-12-31 2015-08-19 于净 一种子弹柜及其使用者身份识别方法
CN105339840B (zh) * 2013-12-06 2019-06-14 华为终端有限公司 双镜头设备的拍照方法及双镜头设备
CN105187726B (zh) * 2015-06-17 2021-05-18 巽腾(广东)科技有限公司 一种多功能移动图像处理装置、处理方法
CN204791017U (zh) * 2015-07-06 2015-11-18 北京中科虹霸科技有限公司 基于多生物特征模态的移动终端用户身份认证装置
KR20180031239A (ko) * 2016-09-19 2018-03-28 엘지전자 주식회사 이동 단말기 및 그 제어방법
CN107872613A (zh) * 2016-09-23 2018-04-03 中兴通讯股份有限公司 一种利用双摄像头进行人脸识别的方法、装置及移动终端
CN107463883A (zh) * 2017-07-18 2017-12-12 广东欧珀移动通信有限公司 生物识别方法及相关产品
CN107451449B (zh) * 2017-07-21 2020-03-17 Oppo广东移动通信有限公司 生物识别解锁方法及相关产品
CN107820007A (zh) * 2017-11-09 2018-03-20 维沃移动通信有限公司 一种摄像头的画面处理方法及移动终端
CN108062530B (zh) * 2017-12-25 2022-03-04 北京诺君安信息技术股份有限公司 一种身份验证方法及系统
CN207867529U (zh) * 2018-02-07 2018-09-14 广东万峯信息科技有限公司 多摄像头的人证核验机

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1932840A (zh) * 2005-09-16 2007-03-21 中国科学技术大学 基于虹膜和人脸的多模态生物特征身份识别系统
CN104349031A (zh) * 2013-07-31 2015-02-11 华为技术有限公司 一种调整摄像装置的取景范围方法及摄像系统、操作装置
CN105320943A (zh) * 2015-10-22 2016-02-10 北京天诚盛业科技有限公司 生物识别装置及其进行生物识别的方法
CN108594942A (zh) * 2018-04-25 2018-09-28 维沃移动通信有限公司 一种身份识别方法及移动终端

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114554072A (zh) * 2020-11-26 2022-05-27 华为技术有限公司 马达控制方法和电子设备
CN114554072B (zh) * 2020-11-26 2023-05-05 华为技术有限公司 马达控制方法和电子设备
CN114598821A (zh) * 2022-03-08 2022-06-07 联想(北京)有限公司 控制方法、电子装置以及电子设备
CN114598821B (zh) * 2022-03-08 2023-06-23 联想(北京)有限公司 控制方法、电子装置以及电子设备

Also Published As

Publication number Publication date
CN111103922B (zh) 2023-08-25
CN111103922A (zh) 2020-05-05

Similar Documents

Publication Publication Date Title
WO2020168956A1 (zh) 一种拍摄月亮的方法和电子设备
WO2020259452A1 (zh) 一种移动终端的全屏显示方法及设备
WO2021052232A1 (zh) 一种延时摄影的拍摄方法及设备
US20220337742A1 (en) Camera switching method for terminal, and terminal
US20220253144A1 (en) Shortcut Function Enabling Method and Electronic Device
WO2021169337A1 (zh) 屏下指纹显示方法及电子设备
WO2020082968A1 (zh) 摄像头、电子设备和身份验证方法
WO2020029306A1 (zh) 一种图像拍摄方法及电子设备
WO2022127787A1 (zh) 一种图像显示的方法及电子设备
WO2020088633A1 (zh) 支付方法、装置和用户设备
CN112887583A (zh) 一种拍摄方法及电子设备
WO2021082564A1 (zh) 一种操作提示的方法和电子设备
WO2021082815A1 (zh) 一种显示要素的显示方法和电子设备
WO2022037726A1 (zh) 分屏显示方法和电子设备
CN113542580B (zh) 去除眼镜光斑的方法、装置及电子设备
CN113891009B (zh) 曝光调整方法及相关设备
CN110138999B (zh) 一种用于移动终端的证件扫描方法及装置
CN114095599B (zh) 消息显示方法和电子设备
WO2023056795A1 (zh) 快速拍照方法、电子设备及计算机可读存储介质
WO2021057626A1 (zh) 图像处理方法、装置、设备及计算机存储介质
WO2021238370A1 (zh) 显示控制方法、电子设备和计算机可读存储介质
CN114615423A (zh) 一种回调流的处理方法及设备
CN113170037A (zh) 一种拍摄长曝光图像的方法和电子设备
CN112150499A (zh) 图像处理方法及相关装置
WO2021082620A1 (zh) 一种图像识别方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19876986

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19876986

Country of ref document: EP

Kind code of ref document: A1