CN110134459B - Application starting method and related product - Google Patents

Application starting method and related product Download PDF

Info

Publication number
CN110134459B
CN110134459B CN201910408192.2A CN201910408192A CN110134459B CN 110134459 B CN110134459 B CN 110134459B CN 201910408192 A CN201910408192 A CN 201910408192A CN 110134459 B CN110134459 B CN 110134459B
Authority
CN
China
Prior art keywords
camera
target
image
face
fingerprint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910408192.2A
Other languages
Chinese (zh)
Other versions
CN110134459A (en
Inventor
张海平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910408192.2A priority Critical patent/CN110134459B/en
Publication of CN110134459A publication Critical patent/CN110134459A/en
Application granted granted Critical
Publication of CN110134459B publication Critical patent/CN110134459B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/445—Program loading or initiating
    • G06F9/44505—Configuring for program initiating, e.g. using registry, configuration files
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1347—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification

Abstract

The application discloses application starting method and related products are applied to electronic equipment, the electronic equipment comprises a display screen, a camera slide rail and a camera, the camera slide rail and the camera are arranged below the display screen, the camera further comprises a fingerprint identification module, the fingerprint identification module is integrated with the camera, and the application starting method comprises the following steps: when a desktop icon is displayed on a display screen, a starting instruction for a target application is received, the target application is an application corresponding to a target icon in the icon displayed by the electronic equipment, a camera is controlled to move towards the position opposite to the target icon along a camera sliding rail, a face image is collected through the camera, when the camera is opposite to the target icon, a fingerprint image is collected through a fingerprint identification module, the face image and the fingerprint image are verified, and when the face image and the fingerprint image are successfully verified, the target application is started, so that a target application program can be quickly started.

Description

Application starting method and related product
Technical Field
The application relates to the technical field of electronics, in particular to an application starting method and a related product.
Background
With the popularization of electronic devices, people increasingly rely on application programs in the electronic devices for information management, game entertainment, information storage and the like, in order to protect the security of personal information, the electronic devices generally provide a user with a right to lock some application programs with high privacy, when the user needs to access the application program, the user needs to unlock the application program, but in a screen-off state, when the user needs to directly enter a certain application program, the user needs to pass authentication and select an icon of the application program, and then the application program can be opened through authentication again, so that the application program cannot be started quickly.
Disclosure of Invention
The embodiment of the application provides an application starting method and a related product, and the application can be quickly started.
In a first aspect, an embodiment of the present application provides an application starting method, which is applied to an electronic device, where the electronic device includes a display screen, and a camera slide rail and a camera that are disposed below the display screen, the camera slide rail is used for the camera to move, the camera further includes a fingerprint identification module that is integrally disposed with the camera, and the method includes:
when the display screen displays the desktop icon, receiving a starting instruction for a target application, wherein the target application is an application corresponding to a target icon in icons displayed by the electronic equipment, and the camera is not over against the target icon;
in the process of controlling the camera to move to the position opposite to the target icon along the camera sliding rail, acquiring a face image through the camera, and acquiring a fingerprint image through the fingerprint identification module when the camera is opposite to the target icon;
verifying the face image and the fingerprint image;
and starting the target application when the verification of the face image and the fingerprint image is successful.
In a second aspect, an embodiment of the present application provides an application starting apparatus, which is applied to an electronic device, and the apparatus includes: a receiving unit, a collecting unit, a verifying unit and a starting unit, wherein,
the receiving unit is used for receiving a starting instruction aiming at a target application when the display screen displays a desktop icon, wherein the target application is an application corresponding to a target icon in icons displayed by the electronic equipment, and the camera is not over against the desktop icon;
the acquisition unit is used for acquiring a face image through the camera in the process of controlling the camera to move to the position opposite to the target icon along the camera slide rail, and acquiring a fingerprint image through the fingerprint identification module when the camera is opposite to the target icon;
the verification unit is used for verifying the face image and the fingerprint image;
and the starting unit is used for starting the target application when the verification of the face image and the fingerprint image is successful.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the first aspect of the embodiment of the present application.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program enables a computer to perform some or all of the steps described in the first aspect of the embodiment of the present application.
In a fifth aspect, embodiments of the present application provide a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, where the computer program is operable to cause a computer to perform some or all of the steps as described in the first aspect of the embodiments of the present application. The computer program product may be a software installation package.
It can be seen that the application starting method and related product described in the embodiments of the present application are applied to an electronic device, the electronic device includes a display screen, a camera slide rail and a camera which are disposed below the display screen, the camera slide rail is used for moving the camera, the camera further includes a fingerprint identification module which is integrally disposed with the camera, the electronic device receives a starting instruction for a target application when the display screen displays a desktop icon, the target application is an application corresponding to a target icon in the icon displayed by the electronic device, the camera is controlled to move along the camera slide rail to a position opposite to the target icon, a face image is collected by the camera, when the camera is aligned with the target icon, the fingerprint image is collected by the fingerprint identification module, the face image and the fingerprint image are verified, and when the face image and the fingerprint image are successfully verified, the start target uses so, can directly realize fingerprint identification and face identification's combination through the camera that has the fingerprint identification module, can realize quick start application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1A is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 1B is a schematic flowchart of an application starting method according to an embodiment of the present application;
fig. 1C is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another application starting method provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of another electronic device provided in an embodiment of the present application;
fig. 4A is a schematic structural diagram of an application starting apparatus according to an embodiment of the present application;
fig. 4B is a modified structure of the application starting device shown in fig. 4A according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The electronic device according to the embodiment of the present application may include various handheld devices, vehicle-mounted devices, wireless headsets, computing devices or other processing devices connected to a wireless modem, and various forms of User Equipment (UE), Mobile Stations (MS), terminal devices (terminal device), and the like, which have a wireless communication function, and the electronic device may be, for example, a smart phone, a tablet computer, a headset box, and the like. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices.
Referring to fig. 1A, fig. 1A is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure, where the electronic device includes a control circuit and an input-output circuit, and the input-output circuit is connected to the control circuit.
The control circuitry may include, among other things, storage and processing circuitry. The storage circuit in the storage and processing circuit may be a memory, such as a hard disk drive memory, a non-volatile memory (e.g., a flash memory or other electronically programmable read only memory used to form a solid state drive, etc.), a volatile memory (e.g., a static or dynamic random access memory, etc.), etc., and the embodiments of the present application are not limited thereto. Processing circuitry in the storage and processing circuitry may be used to control the operation of the electronic device. The processing circuitry may be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application specific integrated circuits, display driver integrated circuits, and the like.
The storage and processing circuitry may be used to run software in the electronic device, such as play incoming call alert ringing application, play short message alert ringing application, play alarm alert ringing application, play media file application, Voice Over Internet Protocol (VOIP) phone call application, operating system functions, and so forth. The software may be used to perform some control operations, such as playing an incoming alert ring, playing a short message alert ring, playing an alarm alert ring, playing a media file, making a voice phone call, and performing other functions in the electronic device, and the embodiments of the present application are not limited.
The input-output circuit can be used for enabling the electronic device to input and output data, namely allowing the electronic device to receive data from the external device and allowing the electronic device to output data from the electronic device to the external device.
The input-output circuit may further include a sensor. The sensors may include ambient light sensors, optical and capacitive based infrared proximity sensors, ultrasonic sensors, touch sensors (e.g., optical based touch sensors and/or capacitive touch sensors, where the touch sensors may be part of a touch display screen or may be used independently as a touch sensor structure), acceleration sensors, gravity sensors, and other sensors, etc. The input-output circuit may further include audio components that may be used to provide audio input and output functionality for the electronic device. The audio components may also include a tone generator and other components for generating and detecting sound.
The input-output circuitry may also include one or more display screens. The display screen can comprise one or a combination of a liquid crystal display screen, an organic light emitting diode display screen, an electronic ink display screen, a plasma display screen and a display screen using other display technologies. The display screen may include an array of touch sensors (i.e., the display screen may be a touch display screen). The touch sensor may be a capacitive touch sensor formed by a transparent touch sensor electrode (e.g., an Indium Tin Oxide (ITO) electrode) array, or may be a touch sensor formed using other touch technologies, such as acoustic wave touch, pressure sensitive touch, resistive touch, optical touch, and the like, and the embodiments of the present application are not limited thereto.
The input-output circuitry may further include communications circuitry that may be used to provide the electronic device with the ability to communicate with external devices. The communication circuitry may include analog and digital input-output interface circuitry, and wireless communication circuitry based on radio frequency signals and/or optical signals. The wireless communication circuitry in the communication circuitry may include radio frequency transceiver circuitry, power amplifier circuitry, low noise amplifiers, switches, filters, and antennas. For example, the wireless communication circuitry in the communication circuitry may include circuitry to support Near Field Communication (NFC) by transmitting and receiving near field coupled electromagnetic signals. For example, the communication circuit may include a near field communication antenna and a near field communication transceiver. The communications circuitry may also include cellular telephone transceiver and antennas, wireless local area network transceiver circuitry and antennas, and so forth.
The input-output circuit may further include other input-output units. Input-output units may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, and the like.
The electronic device may further include a battery (not shown) for supplying power to the electronic device.
The following describes embodiments of the present application in detail.
Referring to fig. 1B, fig. 1B is a schematic flowchart of an application starting method disclosed in an embodiment of the present application, and is applied to the electronic device described in fig. 1A, where the electronic device includes a display screen, and a camera slide rail and a camera which are disposed below the display screen, the camera slide rail is used for the camera to move, the camera further includes a fingerprint identification module integrated with the camera, and the application starting method includes the following steps:
101. when the display screen displays the desktop icon, a starting instruction for a target application is received, the target application is an application corresponding to a target icon in the icons displayed by the electronic equipment, and the camera is not over against the target icon.
Wherein, in this application embodiment, electronic equipment can include the display screen, this display screen can be rearmounted display screen or leading display screen, this electronic equipment is still including setting up in camera and the camera slide rail of display screen below, the camera slide rail can supply the camera motion, the accessible slides, remove, mode such as upset moves, concrete motion mode can be set up by oneself by the user or the system is acquiescent, do not do the restriction here, can include the fingerprint identification module with the integrated setting of camera in this camera, above-mentioned camera can pierce through the display screen when shooing, thereby, avoid the sheltering from of display screen to the camera, realize shooing. As shown in fig. 1C, a schematic structural diagram of an electronic device is shown, which includes: camera, camera slide rail, display screen, application icon etc. under the screen, this display screen can be leading display screen or rearmounted display screen, does not do the restriction here, and fingerprint identification module can with the integrated setting of camera under the screen, can set up a plurality of application's icon in the display frame of display screen, and the camera of display screen below can be one or a plurality of, does not do the restriction here.
In a specific implementation, the electronic device may receive a start instruction for a target application, where the target application may be an application corresponding to a target icon in icons displayed by the electronic device, an application program in the electronic device may be set by a user or default by a system, and the application program may include at least one of the following: maps, calendars, WeChats, QQQQs, browsers, mailboxes, photo albums, videos, and the like, without limitation.
102. And controlling the camera to move along the camera slide rail to the position right opposite to the target icon, acquiring a face image through the camera, and acquiring a fingerprint image through the fingerprint identification module when the camera and the target icon are aligned.
The camera can move along the camera slide rail according to preset movement parameters, the preset movement parameters can be set by default of a system or by a user, and are not limited, and the preset movement parameters can comprise at least one of the following: the motion speed, the motion direction, the motion route and the like are not limited, the camera can continuously collect the face images in the designated area in the motion process, the designated area can be set by system defaults or a user, and when the camera moves along the camera slide rail to be aligned with the target icon, at least one fingerprint image generated when the user presses or touches the display screen can be collected through the fingerprint recognition module.
Optionally, before the step 102, the following steps may be further included:
a1, if the pressing operation aiming at the target application is detected, acquiring a pressing position and a pressing duration corresponding to the pressing operation, and taking the pressing position as the end position of the camera movement;
a2, if the pressing duration is in a preset time period, acquiring a pressing pressure value corresponding to the pressing operation;
a3, if the pressing pressure value exceeds a preset minimum pressing pressure value, determining a movement rate corresponding to the pressing pressure value according to a mapping relation between a preset pressing pressure interval and a preset movement rate of the camera during movement;
a4, acquiring the initial position of the camera;
a5, determining the movement route of the camera according to the initial position and the end position;
and A6, controlling the camera to move towards the position opposite to the target icon along the camera slide rail according to the movement route and the movement speed.
In specific implementation, if the electronic device detects a pressing operation for the target application, a pressing position and a pressing duration corresponding to the pressing operation can be obtained, where the pressing position is an end position of the camera moving along the camera slide rail, and the pressing duration can be used to determine whether the target application needs to be opened by a user, for example, if the preset time period is 2s-3s, the electronic device can obtain the pressing duration for the user to press the target application, and if the pressing duration is between 2s-3s, the user can be considered to need to open the target application, so that the user can be prevented from touching the display screen by mistake to open the target application.
Further, the electronic device may include a pressure sensor, if the pressing duration is within a preset time period, a pressing pressure value corresponding to the pressing operation may be obtained through the pressure sensor, where the pressing pressure value may be a maximum pressing pressure value, a minimum pressing pressure value, or an average pressing pressure value within the preset time period, the preset minimum pressing pressure value may be default for a system or set by a user, the preset minimum pressing pressure value may be a minimum pressing pressure value for pressing the display screen to trigger waking up or starting the target application operation, and if the pressing pressure value exceeds the preset minimum pressing pressure value, it may be considered that the user needs to wake up or start the target application, so that false touch prevention may also be implemented, and a mapping relationship between a pressing pressure interval and a preset movement rate of the camera during movement may be preset by the electronic device, for example, different preset movement rates corresponding to different preset pressing pressure intervals can be preset, if the preset pressing pressure interval is [0.5N,1.5N ], the corresponding preset movement rate can be 3cm/ms, if the preset pressing pressure interval is (1.5N,2N ], the corresponding preset movement rate can be 5cm/ms, the setting mode of the specific mapping relation is not limited herein, the preset pressing pressure interval corresponding to the pressing pressure value can be determined according to the mapping relation between the preset pressing pressure interval and the preset movement rate of the camera during movement, the movement rate corresponding to the preset pressing pressure interval can be determined according to the preset pressing pressure interval, and further, since the pressing pressure may be changed, the corresponding preset movement rates can be respectively determined according to the pressing pressure values of the previous and subsequent times, and then the two preset movement rates are averaged, the movement rate of the camera movement is obtained, a motor can be installed in the electronic equipment to control the camera movement, the movement rate of the camera movement can be determined according to factory setting, and therefore the movement rate of the camera movement corresponding to the pressing pressure value can be determined according to the pressing pressure value, a user can trigger the operation of the camera movement along the camera slide rail only by pressing the target application for a long time, and the target application can be started.
In addition, after the movement rate of the camera along the camera slide rail is determined, the initial position of the camera can be obtained, the initial position can also be understood as the position where the camera currently stays in the camera slide rail, the movement route of the camera can be determined according to the initial position and the end position, and the electronic equipment can control the camera to move to the position right opposite to the icon of the target application along the camera slide rail according to the movement route and the movement rate.
Optionally, in step 102, when the camera is aligned with the target icon, acquiring a fingerprint image through the fingerprint identification module may include the following steps:
b1, detecting the distance between the pressing position and the camera at preset time intervals;
b2, if the distance is in a preset interval, controlling the fingerprint identification module to collect at least one fingerprint image.
The preset time interval can be set by default of a system or by a user, and is not limited herein, and the preset interval can be set by default of the system or by the user, and is not limited herein; electronic equipment can include distance sensor, can detect the above-mentioned distance between pressing position and the camera through distance sensor at every preset time interval, if this distance is in predetermineeing the interval, the camera can be at the in-process of its motion fingerprint image of user of every preset time interval control fingerprint identification module collection, can obtain at least one fingerprint image, so, carries out fingerprint identification to at least one fingerprint image who gathers, can improve fingerprint identification's reliability.
Optionally, in step 102, the acquiring, by the camera, a face image may include the following steps:
c1, controlling the camera to carry out continuous image acquisition in the moving process of the camera to obtain a plurality of shot images;
c2, carrying out face detection on each shot image in the multiple shot images;
and C3, under the condition that at least one of the plurality of shot images contains a human face, carrying out human face segmentation on the plurality of shot images to obtain at least one human face image.
Wherein, the electronic equipment can control the camera to focus at a plurality of positions and acquire images to obtain a plurality of shot images in the process that the camera moves along the camera slide rail, since images containing a plurality of faces may be taken during the movement of the camera, that is, images including other persons than the user himself or herself within the photographing range may be photographed, and therefore, the face detection may be performed for each of the plurality of photographed images, since at least one face image may be included in the same image, in the case where at least one of the plurality of photographed images includes a face, can carry out face segmentation on a plurality of shot images to obtain at least one face image, each face image can contain a face, so that the face images can be accurately collected.
Optionally, the face detection algorithm may include at least one of the following: an object detection (SSD) algorithm, a Scale-invariant Face detection (S3 FD) algorithm, an algorithm based on a Multi-task Convolutional Neural Network (MTCNN), and the like, which are not limited herein.
103. And verifying the face image and the fingerprint image.
The electronic equipment can verify the face image and the fingerprint image, in specific implementation, the fingerprint image can be firstly verified, when the fingerprint image is successfully verified, the face image is verified, or the face image is verified when the camera moves, and after the face image is successfully verified, the fingerprint image is verified, so that the authenticity of the face image and the fingerprint image can be determined, the face identification and the fingerprint identification are combined, and the application and use safety is improved.
Optionally, in step 103, the verifying the face image and the fingerprint image may include the following steps:
and verifying the fingerprint image, and verifying the face image when the fingerprint image is successfully verified.
The electronic equipment can firstly verify the fingerprint image, can continuously verify the face image when the fingerprint image is successfully verified, and the specific sequence of the verification of the face image and the fingerprint image is not limited, so that the safety of application opening can be improved by simultaneously adopting face identification and fingerprint identification.
Optionally, the step of verifying the fingerprint image may include the steps of:
d111, evaluating the image quality of the at least one fingerprint image to obtain at least one evaluation value;
d112, selecting an evaluation value larger than a preset evaluation value from the at least one evaluation value to obtain at least one target evaluation value;
d113, acquiring a fingerprint image corresponding to the at least one target evaluation value as a target fingerprint image to obtain at least one target fingerprint image;
d114, performing feature extraction on the at least one target fingerprint image to obtain at least one feature point set, wherein each target fingerprint image corresponds to one feature point set;
d115, matching each feature point set in the at least one feature point set with a feature point set of a preset fingerprint template to obtain at least one matching value;
and D116, confirming that the fingerprint image is successfully verified when the maximum value of the at least one matching value is larger than a preset threshold value.
The preset evaluation value may be a default of the system or a self-set by the user, and the preset threshold may be a default of the system or a self-set by the user, which is not limited herein; the electronic device may perform image quality evaluation on at least one fingerprint image, and in a specific implementation, the image quality evaluation index may be used to perform image quality evaluation on each fingerprint image in the at least one fingerprint image to obtain at least one image quality evaluation value, where the image quality evaluation index may include at least one of the following: the average gray, mean square error, entropy, edge preservation, signal-to-noise ratio, etc. may be defined as the larger the image quality evaluation value, the better the image quality.
Further, the preset fingerprint template may be set by the user or default to the system, and may be finger fingerprint images of different areas of different fingers of the user collected by the electronic device, an evaluation value greater than the preset evaluation value may be selected from the at least one evaluation value to obtain at least one target evaluation value, and a fingerprint image corresponding to the at least one target evaluation value may be obtained as the target fingerprint image, so that at least one high-quality target fingerprint image may be obtained, and feature extraction may be performed on the at least one target fingerprint image, where the feature may include information of ridges and valleys on a surface of a finger, and so on, without limitation, so that at least one feature point set may be obtained, where each target fingerprint image corresponds to one feature point set, and each feature point set in the at least one feature point set is matched with a feature point set of the preset fingerprint template, and finally, when the maximum value in the at least one matching value is larger than a preset threshold value, the fingerprint image can be confirmed to be successfully verified, and thus, the verification of the fingerprint image is completed.
The feature extraction method may include at least one of the following: speeded Up Robust Feature (SURF), Scale Invariant Feature Transform (SIFT), Speeded Up From Accessed Segment Test (FAST), Harris corner method, etc., without limitation.
Optionally, the verifying the face image may include:
d121, acquiring at least one target environment parameter corresponding to each face image in the at least one face image;
d122, determining at least one target face recognition threshold corresponding to the at least one target environment parameter according to a mapping relation between preset environment parameters and the face recognition threshold, wherein each target environment parameter corresponds to one target face recognition threshold;
d123, dividing each face image in the at least one face image into a plurality of face regions according to a preset mode, wherein the area size of each face region in each face image is equal;
d124, evaluating the image quality of the face areas to obtain a plurality of image quality evaluation values;
d125, selecting an image quality evaluation value larger than a preset quality evaluation value from the plurality of image quality evaluation values to obtain at least one target image quality evaluation value;
d126, acquiring at least one first target face area corresponding to the at least one target image quality evaluation value from the plurality of face areas;
d127, acquiring at least one second target face area corresponding to the at least one first target face area from a preset face template;
d128, matching the at least one first target face area with the at least one second target face area to obtain at least one matching value;
d129, confirming that the face image is verified successfully when each matching value in the at least one matching value is larger than the target face recognition threshold value.
Wherein, the environmental parameter may include at least one of the following: in this embodiment, the electronic device may include an environment sensor, and the at least one target environment parameter corresponding to each of the at least one face image in the at least one face image may be obtained based on the environment sensor, where the environment sensor may include at least one of: a positioning sensor, a color temperature sensor, an ambient light sensor, a humidity sensor, a temperature sensor, an image sensor, and the like, which are not limited herein; the mapping relation between the preset environmental parameters and the face recognition threshold value can be prestored in the electronic equipment. The preset quality evaluation value may be set by default in a system or by a user, and may be stored in the electronic device in advance, in a specific implementation, the image quality evaluation may be performed on the at least one face region by using at least one image quality evaluation criterion, and the image quality evaluation index may be: mean square deviation, information entropy, number of feature points, definition, gray value and the like, which are not limited herein, so that high-quality images can be screened out.
In addition, when the camera shoots an image, because of different shooting environments, the quality of image imaging is also affected, and therefore, at least one target face recognition threshold corresponding to at least one target environment parameter can be determined according to a mapping relationship between preset environment parameters and face recognition thresholds pre-stored in the electronic device, wherein each target environment parameter corresponds to one target face recognition threshold, then, each face image in the at least one face image can be divided into a plurality of face regions according to a preset mode, the area of each face region in each face image is equal in size, and the preset mode can include at least one of the following modes: nine-grid, six-grid, four-grid, sixteen-grid, etc., without limitation. Since the shooting conditions of each face region are different, and therefore the image quality of each face region is different, image quality evaluation may be performed on the plurality of face regions, so as to obtain a plurality of image quality evaluation values, an image quality evaluation value larger than a preset quality evaluation value may be selected from the plurality of image quality evaluation values, so as to obtain at least one target image quality evaluation value, at least one first target face region corresponding to the at least one target image quality evaluation value is obtained from the plurality of face regions, so as to obtain at least one face region with good image quality, or a preset face template may be divided based on a preset manner, that is, the face image and the preset face template are divided based on the same manner, specifically, for example, the face image and the preset face template are aligned, such as: the alignment may be performed with a center of gravity (centroid or geometric center), and in addition, at least one second target face region corresponding to at least one first target face region may be obtained from a preset face template, where each first target face region may correspond to a unique second target face region.
In addition, after obtaining at least one first target face area and at least one second target face area, the electronic device may match the at least one first target face area with the at least one second target face area to obtain at least one matching value, that is, match each first target face area with a corresponding second face area, and when each matching value in the at least one matching value is greater than a target face recognition threshold, it may be determined that the face image is successfully verified, and the matching of the face image is completed, so that the face image may be processed according to environmental factors to achieve dynamic adjustment of the face recognition threshold, and meanwhile, a plurality of areas of the face are selected for face recognition, which is helpful to recognize that two human parts are very long or are well-rounded to cause false recognition, the face recognition accuracy is improved.
104. And starting the target application when the verification of the face image and the fingerprint image is successful.
The target application can be started when the face image and the fingerprint image are successfully verified, in the concrete implementation, the fingerprint image can be firstly verified, when the fingerprint image is successfully verified, the face image is verified, and if the face image and the fingerprint image are successfully verified, the target application can be started.
Optionally, when the camera moves, the camera may first collect a face image and verify the face image, if the face image verification fails, the camera may be controlled to stop moving and return to a preset initial position, the preset initial position may be set by a user or default of a system, if the verification succeeds, the collection and verification of the fingerprint image may be performed, and if the fingerprint image verification succeeds, the target application may be started; if the target application starting operation is realized only by the successful verification of the face image, the misoperation of application starting may occur, and the safety is not high.
It can be seen that the application starting method described in the embodiment of the present application is applied to an electronic device, the electronic device includes a display screen, and a camera slide rail and a camera which are disposed below the display screen, the camera slide rail is used for moving the camera, the camera further includes a fingerprint identification module which is integrally disposed with the camera, when the display screen displays a desktop icon, the electronic device receives a starting instruction for a target application, the target application is an application corresponding to a target icon in the icon displayed by the electronic device, the camera is not aligned with the target icon, during a process of controlling the camera to move to a position aligned with the target icon along the camera slide rail, a face image is collected by the camera, when the camera is aligned with the target icon, a fingerprint image is collected by the fingerprint identification module, the face image and the fingerprint image are verified, and when the face image and the fingerprint image are successfully verified, start the target application, so, can directly carry out fingerprint identification and face identification through the camera that has the fingerprint identification module, realize once getting into target application program, and need not be when using the start-up, authentication once more.
Consistent with the above, fig. 2 is a schematic flowchart of an application starting method disclosed in an embodiment of the present application. The application starting method is applied to the electronic equipment shown in the figure 1A, the electronic equipment comprises a display screen, a camera slide rail and a camera, the camera slide rail and the camera are arranged below the display screen, the camera slide rail is used for the camera to move, the camera further comprises a fingerprint identification module integrated with the camera, and the application starting method comprises the following steps:
201. when the display screen displays the desktop icon, a starting instruction for a target application is received, the target application is an application corresponding to a target icon in the icons displayed by the electronic equipment, and the camera is not over against the target icon.
202. And if the pressing operation aiming at the target application is detected, acquiring a pressing position and a pressing duration corresponding to the pressing operation, and taking the pressing position as an end position of the camera movement.
203. And if the pressing duration is in a preset time period, acquiring a pressing pressure value corresponding to the pressing operation.
204. And if the pressing pressure value exceeds a preset minimum pressing pressure value, determining the movement rate corresponding to the pressing pressure value according to the mapping relation between a preset pressing pressure interval and the preset movement rate of the camera during movement.
205. And acquiring the initial position of the camera.
206. And determining the movement route of the camera according to the initial position and the end position.
207. And controlling the camera to move towards the position right opposite to the target icon along the camera sliding rail according to the movement route and the movement rate.
208. And controlling the camera to move along the camera slide rail to the position right opposite to the target icon, acquiring a face image through the camera, and acquiring a fingerprint image through the fingerprint identification module when the camera and the target icon are aligned.
209. And verifying the face image and the fingerprint image.
210. And starting the target application when the verification of the face image and the fingerprint image is successful.
The detailed description of the steps 201 to 210 may refer to the corresponding description of the application starting method described in fig. 1B, and is not repeated herein.
It can be seen that the application starting method described in the embodiment of the present application is applied to an electronic device, the electronic device includes a display screen, and a camera slide rail and a camera which are disposed below the display screen, the camera slide rail is used for moving the camera, the camera further includes a fingerprint identification module which is integrally disposed with the camera, when the display screen displays a desktop icon, a starting instruction for a target application is received, the target application is an application corresponding to a target icon in the icon displayed by the electronic device, the camera is directly opposite to the target icon, if a pressing operation for the target application is detected, a pressing position and a pressing duration corresponding to the pressing operation are obtained, the pressing position is used as an ending position of the camera movement, if the pressing duration is within a preset time period, a pressing pressure value corresponding to the pressing operation is obtained, if the pressing pressure value exceeds a preset minimum pressing pressure value, determining the movement rate corresponding to the pressing pressure value according to the mapping relation between the preset pressing pressure interval and the preset movement rate of the camera during movement, acquiring the initial position of the camera, determining the movement route of the camera according to the initial position and the end position, moving the camera to the position under the icon of the target application along the camera slide rail according to the movement route and the movement rate, acquiring a face image during the movement, controlling the fingerprint identification module to acquire a fingerprint when the camera reaches the target icon, verifying the face image and the fingerprint image, starting the target application when the face image and the fingerprint image are verified successfully, and thus, controlling the camera to move to the position under the target icon by detecting the pressing operation aiming at the target application and determining the movement rate and the movement rate corresponding to the pressing operation according to the pressing operation, and collecting the face image in the moving process until the fingerprint image is collected under the icon, and verifying the identity of the user according to the face identification and the fingerprint identification so as to realize the starting of the application, wherein the user can directly realize the starting of the application by pressing the target application for a long time.
Referring to fig. 3, fig. 3 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present application, and as shown in the drawing, the electronic device includes a processor, a memory, a communication interface, a display screen, a camera slide rail, and a camera, where the camera slide rail is used to move the camera, the camera further includes a fingerprint identification module integrated with the camera, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for performing the following steps:
when the display screen displays the desktop icon, receiving a starting instruction for a target application, wherein the target application is an application corresponding to a target icon in icons displayed by the electronic equipment, and the camera is not over against the target icon;
in the process of controlling the camera to move to the position opposite to the target icon along the camera sliding rail, acquiring a face image through the camera, and acquiring a fingerprint image through the fingerprint identification module when the camera is opposite to the target icon;
verifying the face image and the fingerprint image;
and starting the target application when the verification of the face image and the fingerprint image is successful.
In one possible example, the program further includes instructions for performing the steps of:
if the pressing operation aiming at the target application is detected, obtaining a pressing position and a pressing duration corresponding to the pressing operation, and taking the pressing position as an end position of the camera movement;
if the pressing duration is in a preset time period, acquiring a pressing pressure value corresponding to the pressing operation;
if the pressing pressure value exceeds a preset minimum pressing pressure value, determining a movement rate corresponding to the pressing pressure value according to a mapping relation between a preset pressing pressure interval and a preset movement rate of the camera during movement;
acquiring an initial position of the camera;
determining a movement route of the camera according to the initial position and the end position;
and controlling the camera to move towards the position right opposite to the target icon along the camera sliding rail according to the movement route and the movement rate.
In one possible example, in capturing a fingerprint image by the fingerprint recognition module while the camera is aligned with the target icon, the program includes instructions for:
detecting the distance between the pressing position and the camera at preset time intervals;
and if the distance is within a preset interval, controlling the fingerprint identification module to collect at least one fingerprint image.
In one possible example, in verifying the face image and the fingerprint image, the program is for executing the instructions of:
and verifying the fingerprint image, and verifying the face image when the fingerprint image is successfully verified.
In one possible example, in verifying the fingerprint image, the program is for instructions to:
performing image quality evaluation on the at least one fingerprint image to obtain at least one evaluation value;
selecting an evaluation value larger than a preset evaluation value from the at least one evaluation value to obtain at least one target evaluation value;
acquiring a fingerprint image corresponding to the at least one target evaluation value as a target fingerprint image to obtain at least one target fingerprint image;
performing feature extraction on the at least one target fingerprint image to obtain at least one feature point set, wherein each target fingerprint image corresponds to one feature point set;
matching each feature point set in the at least one feature point set with a feature point set of a preset fingerprint template to obtain at least one matching value;
confirming that the fingerprint image is successfully verified when a maximum value of the at least one matching value is greater than a preset threshold value.
In one possible example, in connection with the capturing of the image of the human face by the camera, the program includes instructions for performing the steps of:
in the process of the movement of the camera, controlling the camera to carry out continuous image acquisition to obtain a plurality of shot images;
performing face detection on each shot image in the multiple shot images;
and under the condition that at least one of the shot images contains a human face, carrying out human face segmentation on the shot images to obtain at least one human face image.
In one possible example, in the verifying the face image, the program includes instructions for:
acquiring at least one target environment parameter corresponding to each face image in the at least one face image;
determining at least one target face recognition threshold corresponding to the at least one target environment parameter according to a mapping relation between preset environment parameters and face recognition thresholds, wherein each target environment parameter corresponds to one target face recognition threshold;
dividing each face image in the at least one face image into a plurality of face regions according to a preset mode, wherein the area of each face region in each face image is equal;
performing image quality evaluation on the plurality of face regions to obtain a plurality of image quality evaluation values;
selecting an image quality evaluation value larger than a preset quality evaluation value from the plurality of image quality evaluation values to obtain at least one target image quality evaluation value;
acquiring at least one first target face area corresponding to the at least one target image quality evaluation value from the plurality of face areas;
acquiring at least one second target face area corresponding to the at least one first target face area from a preset face template;
matching the at least one first target face area with the at least one second target face area to obtain at least one matching value;
confirming that the face image is successfully verified when each of the at least one matching value is greater than the target face recognition threshold.
The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
Referring to fig. 4A, fig. 4A is a schematic structural diagram of an application starting device disclosed in an embodiment of the present application, and is applied to an electronic device shown in fig. 1A, where the electronic device includes a display screen, a camera slide rail and a camera which are disposed below the display screen, the camera slide rail is used for the camera to move, the camera further includes a fingerprint identification module integrated with the camera, the application starting device includes a receiving unit 401, an acquisition unit 402, a verification unit 403, and a starting unit 404,
the receiving unit 401 is configured to receive a start instruction for a target application when the display screen displays a desktop icon, where the target application is an application corresponding to a target icon in icons displayed by the electronic device;
the acquisition unit 402 is configured to acquire a face image through the camera in a process of controlling the camera to move along the camera slide rail to a position opposite to the target icon, and acquire a fingerprint image through the fingerprint identification module when the camera and the target icon are opposite;
the verification unit 403 is configured to verify the face image and the fingerprint image;
the starting unit 404 is configured to start the target application when the verification of the face image and the fingerprint image is successful.
Optionally, when the camera is aligned with the target icon, in the aspect of collecting a fingerprint image by the fingerprint identification module, the collecting unit 402 is specifically configured to:
detecting the distance between the pressing position and the camera at preset time intervals;
and if the distance is within a preset interval, controlling the fingerprint identification module to collect at least one fingerprint image.
Optionally, in terms of verifying the face image and the fingerprint image, the verification unit 403 is specifically configured to:
and verifying the fingerprint image, and verifying the face image when the fingerprint image is successfully verified.
Optionally, in terms of verifying the fingerprint image, the verification unit 403 is specifically configured to:
performing image quality evaluation on the at least one fingerprint image to obtain at least one evaluation value;
selecting an evaluation value larger than a preset evaluation value from the at least one evaluation value to obtain at least one target evaluation value;
acquiring a fingerprint image corresponding to the at least one target evaluation value as a target fingerprint image to obtain at least one target fingerprint image;
performing feature extraction on the at least one target fingerprint image to obtain at least one feature point set, wherein each target fingerprint image corresponds to one feature point set;
matching each feature point set in the at least one feature point set with a feature point set of a preset fingerprint template to obtain at least one matching value;
confirming that the fingerprint image is successfully verified when a maximum value of the at least one matching value is greater than a preset threshold value.
Optionally, in the aspect of verifying the face image, the verification unit 403 is further specifically configured to:
acquiring at least one target environment parameter corresponding to each face image in the at least one face image;
determining at least one target face recognition threshold corresponding to the at least one target environment parameter according to a mapping relation between preset environment parameters and face recognition thresholds, wherein each target environment parameter corresponds to one target face recognition threshold;
dividing each face image in the at least one face image into a plurality of face regions according to a preset mode, wherein the area of each face region in each face image is equal;
performing image quality evaluation on the plurality of face regions to obtain a plurality of image quality evaluation values;
selecting an image quality evaluation value larger than a preset quality evaluation value from the plurality of image quality evaluation values to obtain at least one target image quality evaluation value;
acquiring at least one first target face area corresponding to the at least one target image quality evaluation value from the plurality of face areas;
acquiring at least one second target face area corresponding to the at least one first target face area from a preset face template;
matching the at least one first target face area with the at least one second target face area to obtain at least one matching value;
confirming that the face image is successfully verified when each of the at least one matching value is greater than the target face recognition threshold.
It can be seen that the application starting device described in the embodiment of the present application is applied to an electronic device, the electronic device includes a display screen, and a camera slide rail and a camera which are disposed below the display screen, the camera slide rail is used for moving the camera, the camera further includes a fingerprint identification module which is integrally disposed with the camera, when the display screen displays a desktop icon, the electronic device receives a starting instruction for a target application, the target application is an application corresponding to a target icon in the icon displayed by the electronic device, the camera is controlled to move to a position right opposite to the target icon along the camera slide rail, a face image is collected by the camera, when the camera is right opposite to the target icon, the fingerprint image is collected by the fingerprint identification module, the face image and the fingerprint image are verified, and when the face image and the fingerprint image are successfully verified, the target application is started, so, can directly carry out fingerprint identification and face identification through the camera that has the fingerprint identification module, realize opening fast and use, and need not after the electronic equipment unblock, authentication once more when using the start.
Referring to fig. 4B, fig. 4B is a modified structure of the application starting device shown in fig. 4A provided in the embodiment of the present application, and is applied to the electronic device shown in fig. 1A, where the electronic device includes a display screen, and a camera slide rail and a camera which are disposed below the display screen, the camera slide rail is used for the camera to move, the camera further includes a fingerprint identification module integrated with the camera, the application starting device further includes a detection unit 405, an acquisition unit 406, a determination unit 407, and a control unit 408, where,
the detection unit is used for acquiring a pressing position and a pressing duration corresponding to the pressing operation if the pressing operation aiming at the target application is detected, and taking the pressing position as an end position of the camera movement;
the obtaining unit is used for obtaining a pressing pressure value corresponding to the pressing operation if the pressing duration exceeds a preset time period;
the determining unit is configured to determine, if the pressing pressure value exceeds a preset minimum pressing pressure value, a motion rate corresponding to the pressing pressure value according to a mapping relationship between a preset pressing pressure interval and a preset motion rate of the camera during motion;
the acquisition unit is further used for acquiring the initial position of the camera;
the determining unit is further configured to determine a movement route of the camera according to the initial position and the end position;
and the control unit is used for controlling the camera to move towards the position opposite to the target icon along the camera slide rail according to the movement route and the movement rate.
It should be noted that the electronic device described in the embodiments of the present application is presented in the form of a functional unit. The term "unit" as used herein is to be understood in its broadest possible sense, and objects used to implement the functions described by the respective "unit" may be, for example, an integrated circuit ASIC, a single circuit, a processor (shared, dedicated, or chipset) and memory that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
The receiving unit 401, the acquiring unit 402, the verifying unit 403, the starting unit 404, the detecting unit 405, the obtaining unit 406, the determining unit 407, and the controlling unit 408 may be a control circuit or a processor.
Embodiments of the present application also provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the application starting methods described in the above method embodiments.
Embodiments of the present application also provide a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any one of the application starting methods as described in the above method embodiments.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may be implemented in the form of a software program module.
The integrated units, if implemented in the form of software program modules and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a read-only memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and the like.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash disk, ROM, RAM, magnetic or optical disk, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (10)

1. The utility model provides an application starting method, its characterized in that is applied to electronic equipment, electronic equipment includes the display screen to and set up in camera slide rail and the camera of display screen below, the camera slide rail is for the camera motion, the camera still include with the integrated fingerprint identification module that sets up of camera, include:
when the display screen displays the desktop icon, receiving a starting instruction for a target application, wherein the target application is an application corresponding to a target icon in icons displayed by the electronic equipment, and the camera is not over against the target icon;
in the process of controlling the camera to move to the position opposite to the target icon along the camera sliding rail, acquiring a face image through the camera, and acquiring a fingerprint image through the fingerprint identification module when the camera is opposite to the target icon;
verifying the face image and the fingerprint image;
and starting the target application when the verification of the face image and the fingerprint image is successful.
2. The method of claim 1, further comprising:
if the pressing operation aiming at the target application is detected, obtaining a pressing position and a pressing duration corresponding to the pressing operation, and taking the pressing position as an end position of the camera movement;
if the pressing duration is in a preset time period, acquiring a pressing pressure value corresponding to the pressing operation;
if the pressing pressure value exceeds a preset minimum pressing pressure value, determining a movement rate corresponding to the pressing pressure value according to a mapping relation between a preset pressing pressure interval and a preset movement rate of the camera during movement;
acquiring an initial position of the camera;
determining a movement route of the camera according to the initial position and the end position;
and controlling the camera to move towards the position right opposite to the target icon along the camera sliding rail according to the movement route and the movement rate.
3. The method of claim 2, wherein capturing a fingerprint image by the fingerprint recognition module while the camera is aligned with the target icon comprises:
detecting the distance between the pressing position and the camera at preset time intervals;
and if the distance is within a preset interval, controlling the fingerprint identification module to collect at least one fingerprint image.
4. The method of claim 3, wherein the verifying the face image and the fingerprint image comprises:
verifying the fingerprint image, and verifying the face image when the fingerprint image is successfully verified;
the verifying the fingerprint image comprises:
performing image quality evaluation on the at least one fingerprint image to obtain at least one evaluation value;
selecting an evaluation value larger than a preset evaluation value from the at least one evaluation value to obtain at least one target evaluation value;
acquiring a fingerprint image corresponding to the at least one target evaluation value as a target fingerprint image to obtain at least one target fingerprint image;
performing feature extraction on the at least one target fingerprint image to obtain at least one feature point set, wherein each target fingerprint image corresponds to one feature point set;
matching each feature point set in the at least one feature point set with a feature point set of a preset fingerprint template to obtain at least one matching value;
confirming that the fingerprint image is successfully verified when a maximum value of the at least one matching value is greater than a preset threshold value.
5. The method of claim 4, wherein the acquiring, by the camera, a facial image comprises:
in the process of the movement of the camera, controlling the camera to carry out continuous image acquisition to obtain a plurality of shot images;
performing face detection on each shot image in the multiple shot images;
under the condition that at least one of the shot images contains a human face, carrying out human face segmentation on the shot images to obtain at least one human face image;
the verifying the face image comprises:
acquiring at least one target environment parameter corresponding to each face image in the at least one face image;
determining at least one target face recognition threshold corresponding to the at least one target environment parameter according to a mapping relation between preset environment parameters and face recognition thresholds, wherein each target environment parameter corresponds to one target face recognition threshold;
dividing each face image in the at least one face image into a plurality of face regions according to a preset mode, wherein the area of each face region in each face image is equal;
performing image quality evaluation on the plurality of face regions to obtain a plurality of image quality evaluation values;
selecting an image quality evaluation value larger than a preset quality evaluation value from the plurality of image quality evaluation values to obtain at least one target image quality evaluation value;
acquiring at least one first target face area corresponding to the at least one target image quality evaluation value from the plurality of face areas;
acquiring at least one second target face area corresponding to the at least one first target face area from a preset face template;
matching the at least one first target face area with the at least one second target face area to obtain at least one matching value;
confirming that the face image is successfully verified when each of the at least one matching value is greater than the target face recognition threshold.
6. The utility model provides an use starting drive, its characterized in that is applied to electronic equipment, electronic equipment include the display screen, and set up in camera slide rail and the camera of display screen below, the camera slide rail is for the camera motion, the camera still include with the integrated fingerprint identification module that sets up of camera, the device includes: a receiving unit, a collecting unit, a verifying unit and a starting unit, wherein,
the receiving unit is used for receiving a starting instruction aiming at a target application when the display screen displays a desktop icon, wherein the target application is an application corresponding to a target icon in icons displayed by the electronic equipment, and the camera is not over against the target icon;
the acquisition unit is used for acquiring a face image through the camera in the process of controlling the camera to move to the position opposite to the target icon along the camera slide rail, and acquiring a fingerprint image through the fingerprint identification module when the camera is opposite to the target icon;
the verification unit is used for verifying the face image and the fingerprint image;
and the starting unit is used for starting the target application when the verification of the face image and the fingerprint image is successful.
7. The apparatus of claim 6, further comprising:
the detection unit is used for acquiring a pressing position and a pressing duration corresponding to the pressing operation if the pressing operation aiming at the target application is detected, and taking the pressing position as an end position of the camera movement;
the obtaining unit is used for obtaining a pressing pressure value corresponding to the pressing operation if the pressing duration exceeds a preset time period;
the determining unit is used for determining the movement rate corresponding to the pressing pressure value according to the mapping relation between a preset pressing pressure interval and the preset movement rate of the camera during movement if the pressing pressure value exceeds the preset minimum pressing pressure value;
the acquisition unit is further used for acquiring the initial position of the camera;
the determining unit is further configured to determine a movement route of the camera according to the initial position and the end position;
and the control unit is used for controlling the camera to move towards the position opposite to the target icon along the camera slide rail according to the movement route and the movement rate.
8. The apparatus of claim 7, wherein when the camera is aligned with the target icon, the fingerprint acquisition unit is specifically configured to, in acquiring a fingerprint image by the fingerprint recognition module:
detecting the distance between the pressing position and the camera at preset time intervals;
and if the distance is within a preset interval, controlling the fingerprint identification module to collect at least one fingerprint image.
9. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-5.
10. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-5.
CN201910408192.2A 2019-05-15 2019-05-15 Application starting method and related product Active CN110134459B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910408192.2A CN110134459B (en) 2019-05-15 2019-05-15 Application starting method and related product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910408192.2A CN110134459B (en) 2019-05-15 2019-05-15 Application starting method and related product

Publications (2)

Publication Number Publication Date
CN110134459A CN110134459A (en) 2019-08-16
CN110134459B true CN110134459B (en) 2022-03-15

Family

ID=67574622

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910408192.2A Active CN110134459B (en) 2019-05-15 2019-05-15 Application starting method and related product

Country Status (1)

Country Link
CN (1) CN110134459B (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110619460A (en) * 2019-09-05 2019-12-27 北京邮电大学 Classroom quality assessment system and method based on deep learning target detection
CN110730298A (en) * 2019-09-23 2020-01-24 维沃移动通信有限公司 Display control method and electronic equipment
CN110661974B (en) * 2019-09-30 2020-12-18 联想(北京)有限公司 Image acquisition method and device and electronic equipment
CN110619700B (en) * 2019-10-08 2021-06-15 珠海格力电器股份有限公司 Method for controlling intelligent door lock, control device, intelligent door lock and equipment
CN111027374B (en) * 2019-10-28 2023-06-30 华为终端有限公司 Image recognition method and electronic equipment
CN110941473B (en) * 2019-11-27 2023-10-24 维沃移动通信有限公司 Preloading method, preloading device, electronic equipment and medium
CN110868546B (en) * 2019-11-29 2021-07-02 维沃移动通信有限公司 Shooting method and electronic equipment
CN111314610B (en) * 2020-02-26 2022-03-11 维沃移动通信有限公司 Control method and electronic equipment
CN113497885B (en) * 2020-04-03 2024-02-02 中兴通讯股份有限公司 Camera opening method, electronic equipment and storage medium
CN112422743A (en) * 2020-09-28 2021-02-26 深圳市修远文化创意有限公司 Method for starting fingerprint module under mobile phone screen and mobile phone
CN115202091B (en) * 2022-07-22 2023-10-31 武汉华星光电技术有限公司 display device
CN117499526A (en) * 2023-12-25 2024-02-02 荣耀终端有限公司 Shooting method, electronic device, chip system and computer readable storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108769478B (en) * 2018-06-08 2021-01-15 Oppo广东移动通信有限公司 Control method of sliding assembly, control assembly and electronic equipment
CN108924345A (en) * 2018-06-20 2018-11-30 Oppo广东移动通信有限公司 Photographic method, camera arrangement and mobile terminal
CN109756594B (en) * 2018-12-26 2020-08-18 维沃移动通信有限公司 Method, terminal and storage medium for controlling screen

Also Published As

Publication number Publication date
CN110134459A (en) 2019-08-16

Similar Documents

Publication Publication Date Title
CN110134459B (en) Application starting method and related product
CN105488464B (en) Fingerprint identification method and device
CN104537365B (en) Touch key-press and fingerprint recognition implementation method, device and terminal device
EP3232299B1 (en) Physical key component, terminal, and touch response method and device
CN106951884B (en) Fingerprint acquisition method and device and electronic equipment
CN104866750B (en) Using startup method and apparatus
CN106815546B (en) Fingerprint identification method and device
CN109583356B (en) Fingerprint identification method and related product
US20150294516A1 (en) Electronic device with security module
CN110020622B (en) Fingerprint identification method and related product
CN106951767B (en) Unlocking control method and related product
CN104850827B (en) Fingerprint identification method and device
CN108038393B (en) Application privacy protection method and mobile terminal
CN108388786A (en) Unlocked by fingerprint method and device
CN110099219B (en) Panoramic shooting method and related product
EP3100194A1 (en) Dynamic keyboard and touchscreen biometrics
CN109117619B (en) Fingerprint unlocking method and related product
CN104391712B (en) Closedown method and device
EP3208742B1 (en) Method and apparatus for detecting pressure
CN109376702B (en) Fingerprint identification method and related product
CN108475306B (en) User interface for mobile device
CN108491713B (en) Safety reminding method and electronic equipment
EP3428780B1 (en) Method for enabling biometric recognition pattern and related products
CN108133180A (en) Fingerprint identification method, device and terminal
CN110245483B (en) Biometric identification method and related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant