WO2021151341A1 - 一种基于扭曲指纹的触控方法与电子设备 - Google Patents

一种基于扭曲指纹的触控方法与电子设备 Download PDF

Info

Publication number
WO2021151341A1
WO2021151341A1 PCT/CN2020/131280 CN2020131280W WO2021151341A1 WO 2021151341 A1 WO2021151341 A1 WO 2021151341A1 CN 2020131280 W CN2020131280 W CN 2020131280W WO 2021151341 A1 WO2021151341 A1 WO 2021151341A1
Authority
WO
WIPO (PCT)
Prior art keywords
fingerprint
electronic device
twisting direction
twisted
fingerprint image
Prior art date
Application number
PCT/CN2020/131280
Other languages
English (en)
French (fr)
Inventor
王屹青
苗磊
路宇龙
韩志强
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2021151341A1 publication Critical patent/WO2021151341A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/38—Payment protocols; Details thereof
    • G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/38—Payment protocols; Details thereof
    • G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G06Q20/401—Transaction verification
    • G06Q20/4014—Identity check for transactions
    • G06Q20/40145—Biometric identity checks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1347—Preprocessing; Feature extraction
    • G06V40/1359—Extracting features related to ridge properties; Determining the fingerprint type, e.g. whorl or loop
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1365—Matching; Classification

Definitions

  • This application relates to the field of terminal technology, and in particular to a touch method and electronic device based on twisted fingerprints.
  • the touch screen can be used to detect touch operations, such as sliding, clicking, or double-clicking.
  • the electronic device generates a corresponding response according to the touch operation and provides visual output.
  • the user's finger touch operation on the touch screen has certain limitations, especially for large-screen electronic devices. For example, when a user holds an electronic device with one hand with his right hand, the area that the right thumb can touch on the touch screen is limited. If the user wants to touch the area far away from the right thumb, the user needs to adjust the grip posture to touch it, and the operation is not convenient enough; Moreover, in the process of adjusting the holding posture, the electronic device is unstable to hold and may fall, which affects the user experience. In short, relying solely on the touch detection of the touch screen to realize the touch of an electronic device has certain limitations.
  • the purpose of this application is to provide a touch method and an electronic device based on twisted fingerprints, so as to improve the convenience of a user in operating the electronic device.
  • a touch method based on twisted fingerprints is provided.
  • the method can be applied to electronic devices with fingerprint sensors, such as mobile phones, tablet computers, and the like.
  • the electronic device detects the first fingerprint image, determines the first twist direction indicated by the first twist fingerprint on the first fingerprint image; and then operates the electronic device based on the first twist direction.
  • the electronic device can no longer rely solely on the touch screen to achieve corresponding operations, but can identify the first twisting direction indicated by the twisted fingerprint through the twisted fingerprint on the user's fingerprint image detected by the fingerprint sensor, and the first twisting direction can reflect the user's intention. That is, in which direction the user's finger intends to twist, therefore, the electronic device can operate the electronic device based on the first twisting direction to meet the user's intention, facilitate operation, and have a high user experience.
  • the electronic device may include fingerprint authentication scenarios and non-fingerprint authentication scenarios.
  • the fingerprint authentication scenario can be understood as a scenario that requires fingerprint authentication.
  • Non-fingerprint authentication scenarios can be understood as scenarios that do not require fingerprint authentication.
  • fingerprint authentication scenarios may include fingerprint unlocking scenarios, fingerprint payment scenarios, and so on. Except for the fingerprint authentication scene, other scenes are non-fingerprint authentication scenes.
  • the electronic device may also determine whether the current use scene of the electronic device is a non-fingerprint authentication scene that does not require fingerprint authentication;
  • the usage scenario of is a non-fingerprint authentication scenario, and it is described that it is intended to operate an electronic device through a twisted fingerprint, then the first twisting direction indicated by the first twisted fingerprint is determined, and the electronic device is operated based on the first twisting direction.
  • the current use scene is a fingerprint authentication scene that requires fingerprint authentication
  • match the first fingerprint image with a pre-stored fingerprint image that is, perform fingerprint authentication (namely identity authentication) on the first fingerprint image.
  • fingerprint authentication namely identity authentication
  • the electronic device may also wait for a preset period of time before detecting the second fingerprint image; if the second fingerprint image is It includes a second twisted fingerprint, and the second twisting direction indicated by the second twisted fingerprint is consistent with the first twisting direction. Operating the electronic device based on the first twisting direction helps prevent the user from accidentally touching the fingerprint sensor. Lead to control electronics.
  • the electronic device may also determine that the user's finger is in continuous contact with the fingerprint sensor before the preset time period is reached.
  • the touch screen detects that the user's finger is continuously touching the touch screen, that is, it is determined that the user's finger is continuously in contact with the fingerprint sensor. That is to say, when the user’s finger continues to touch the fingerprint sensor, the first fingerprint image collected by the fingerprint sensor and the second fingerprint image indicate the same twisting direction, and the electronic device is operated based on the twisting direction, which helps to avoid the user’s finger Touching the fingerprint sensor by mistake leads to the control of the electronic device.
  • Example 2 The electronic device determines that before the preset time period is reached, the user's finger is in continuous contact with the fingerprint sensor, and the contact position remains unchanged. In other words, when the user's finger continues to touch the fingerprint sensor, there is no need to move the position of the finger or to move the position of the finger by a large amount, and only need to rub the finger in a small amount to operate the electronic device. For example, when the user's finger is swiped to the left in a small amount, the electronic device detects a twisted fingerprint, and recognizes that the twisted fingerprint indicates that the first twisting direction is to the left. Then the electronic device operates the electronic device based on the first twisted fingerprint. Operation of large-screen electronic equipment.
  • Scenario 1 When the electronic device determines that a cursor is included in the current display interface, the position of the cursor is adjusted according to the first twisting direction.
  • Scenario 2 When the electronic device determines that the current display interface is a game interface, it adjusts the position of the game character in the game interface according to the first twisting direction.
  • Scenario 3 When the electronic device determines that the current display interface includes a 3D image, it adjusts the rotation direction of the 3D model in the 3D image according to the first twisting direction.
  • Scenario 4 Based on the first twisting direction, the electronic device controls scrolling of the display interface, fast-forwarding or fast-rewinding of the movie, changes in the brightness of the display screen, or changes in the volume.
  • the electronic device determines that the user's finger is lifted and does not touch the fingerprint sensor, it can stop operating the electronic device.
  • the electronic device determines that the user's finger is lifted and does not touch the fingerprint sensor, so the electronic device stops operating the electronic device based on the first twisted fingerprint.
  • the fingerprint sensor While the user's finger is continuously in contact with the fingerprint sensor, the fingerprint sensor periodically collects fingerprint images, and at some point after the first fingerprint image, a third fingerprint image containing a normal fingerprint is collected and the electronic device stops operating.
  • the fingerprint sensor collects a distorted fingerprint
  • the fingerprint image containing the distorted fingerprint is collected, and the electronic device is operated. The user does not lift the finger, but the finger returns to the normal pressing state (The fingerprint sensor collects a normal fingerprint), stop operating the electronic device.
  • the twisted fingerprint-based touch method provided in the embodiment of the present application , No need for the user to move the finger to operate the electronic device, the operation is convenient, the user experience is high, especially for the operation of the large-screen electronic device.
  • the electronic device determines the first twisting direction indicated by the first twisted fingerprint, including but not limited to the following ways:
  • Method 1 Generally, because the shape of the twisted fingerprint changes, the first feature point on the twisted fingerprint is offset relative to the second feature point on the normal fingerprint image. Therefore, the second feature point is relative to the first feature point.
  • the direction of a characteristic point is used to indicate the first twisting direction. Therefore, the electronic device can determine the first feature point on the first twisted fingerprint, and determine the second feature point corresponding to the first feature point on the normal fingerprint matching the first twisted fingerprint;
  • the first twisted fingerprint and the normal fingerprint are in the same coordinate system; the direction of the second characteristic point relative to the first characteristic point is used to indicate the first twisting direction.
  • Method 2 when the user's finger is tilted to press the fingerprint sensor, the user's finger is stronger in the oblique direction, the texture is stretched and the interval between the textures is increased, and the texture in the direction opposite to the oblique direction is squeezed to cause the texture The gap between them is reduced. Therefore, the electronic device can determine that the texture interval on the first distorted fingerprint is greater than the preset interval in the first area, and the texture interval is less than the preset interval in the second area, and the second area is the same as the first area in the first area.
  • the texture is parallel; the first normal direction of the texture in the second area is the first twisting direction, and the first normal direction points to the first area.
  • Method 3 when the user presses the fingerprint sensor with the finger tilted, the texture of the fingerprint image collected by the fingerprint sensor is incomplete.
  • the left area of the finger for example, the left area of the center of the fingerprint vortex
  • the right area for example, the right area of the center of the fingerprint vortex
  • the area is small; therefore, the fingerprint image on the fingerprint image collected by the fingerprint sensor is incomplete, for example, it does not include the texture of the area to the right of the center of the finger vortex or the number of textures in the area to the right of the center of the finger vortex is small.
  • the electronic device can determine the first area and the second area on the first twisted fingerprint, where the first area is relative to the first orientation of the vortex on the first twisted fingerprint and the second area is relative to the The second orientation of the vortex is opposite; if the number of fingerprints in the first area is greater than the number of fingerprints in the second area, the first orientation is determined to be the first twisting direction.
  • the above three methods are only examples and not limitations, and other methods for determining the first twist direction indicated by the twist fingerprint are also feasible.
  • the electronic device determines the first twisting direction indicated by the twisted fingerprint
  • the electronic device is operated based on the first twisting direction, which facilitates user operations and improves user experience.
  • an electronic device including: one or more processors; a memory; a plurality of application programs; and one or more computer programs, wherein the one or more computer programs are stored in the memory
  • the one or more computer programs include instructions, and when the instructions are executed by the electronic device, the system side in the electronic device executes the following steps:
  • Detecting a first fingerprint image where the first fingerprint image includes a first distorted fingerprint whose fingerprint shape is distorted;
  • the first twisting direction is used to indicate the twisting direction of the user's finger when it contacts the fingerprint sensor;
  • the electronic device Based on the first twisting direction, the electronic device is operated.
  • the system side in the electronic device further executes the following steps:
  • the first twisting direction indicated by the first twisted fingerprint is determined.
  • the system side in the electronic device further executes the following steps:
  • the current use scene is a fingerprint authentication scene requiring fingerprint authentication, matching the first fingerprint image with a pre-stored fingerprint image;
  • the system side in the electronic device further executes the following steps:
  • the second fingerprint image After waiting for the preset time, the second fingerprint image is detected
  • the electronic device is operated based on the first twisting direction.
  • the system side in the electronic device further executes the following steps: before the preset time period is reached, determine the user's finger and the fingerprint The sensor keeps touching.
  • the system side in the electronic device further executes the following steps: before the preset time period is reached, it is determined that the user's finger and the fingerprint sensor continue Contact, and the contact position does not change.
  • the system side in the electronic device further executes the following steps:
  • the electronic device determines that the current display interface is a game interface, adjust the position of the game character in the game interface according to the first twisting direction; or,
  • the electronic device When determining that the current display interface includes a 3D image, the electronic device adjusts the rotation direction of the 3D model in the 3D image according to the first twisting direction.
  • the system side in the electronic device when the instruction is executed by the electronic device, the system side in the electronic device further executes the following steps: controlling the flipping of the display interface and the fast-forwarding of the movie based on the first twisting direction Or rewind, display brightness change or volume change.
  • the system side in the electronic device when the instruction is executed by the electronic device, the system side in the electronic device further executes the following steps: determining that the user's finger stops contacting the fingerprint sensor, or determining that the user's finger continues The fingerprint sensor is contacted, a third fingerprint image is detected, and the third fingerprint image includes a normal fingerprint whose fingerprint shape is not distorted, and the operation of the electronic device is stopped.
  • the system side in the electronic device when the instruction is executed by the electronic device, the system side in the electronic device further executes the following steps: determine the first feature point on the first twisted fingerprint, and determine A second feature point corresponding to the first feature point on a normal fingerprint matching the first twisted fingerprint; the first twisted fingerprint and the normal fingerprint are in the same coordinate system; the second feature point The direction relative to the first feature point is used to indicate the first twisting direction.
  • the system side in the electronic device further executes the following steps:
  • a texture interval on the first distorted fingerprint is greater than a first area with a preset interval, and a second area with a texture interval less than the preset interval, and the second area is parallel to the texture in the first area;
  • the first normal direction of the texture in the second region is the first twisting direction, and the first normal direction points to the first region.
  • the system side in the electronic device further executes the following steps:
  • the first orientation is determined to be the first twisting direction.
  • an electronic device including: modules/units that implement the first aspect or any one of the possible design methods of the first aspect; these modules/units can be implemented by hardware or implemented by hardware The corresponding software implementation.
  • a chip is also provided, the chip is coupled with a memory in an electronic device, so that the chip invokes program instructions stored in the memory during operation to implement the method provided in the above first aspect.
  • a computer-readable storage medium includes a computer program.
  • the computer program runs on an electronic device, the electronic device executes the method provided in the above-mentioned first aspect.
  • a computer program product including instructions, which when run on a computer, cause the computer to execute the method provided in the above-mentioned first aspect.
  • FIG. 1 is a schematic diagram of a normal fingerprint and a twisted fingerprint provided by an embodiment of this application;
  • 2A is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of this application.
  • 2B is a schematic diagram of the software structure of an electronic device provided by an embodiment of this application.
  • FIG. 3 is a schematic flowchart of a touch method based on twisted fingerprints according to an embodiment of the application
  • FIG. 4 is a schematic diagram of the location of the fingerprint sensor on the electronic device provided by an embodiment of the application.
  • FIG. 5 is a schematic diagram of a normal fingerprint shape and a twisted fingerprint shape provided by an embodiment of this application;
  • FIG. 6 is a schematic diagram of feature points on a fingerprint image provided by an embodiment of the application.
  • FIG. 7 is a schematic diagram of an indication direction of a second feature point to a first feature point according to an embodiment of the application.
  • FIG. 8 is a schematic diagram of a first grid corresponding to a normal fingerprint and a second grid corresponding to a distorted fingerprint according to an embodiment of the application;
  • FIG. 9 is a schematic diagram of grids corresponding to different distorted fingerprints provided by an embodiment of the application.
  • FIG. 10 is a schematic diagram of a twisting direction indicated by a twisted fingerprint according to an embodiment of the application.
  • FIG. 11 is a schematic diagram of a capacitance signal detected by TP according to an embodiment of the application.
  • 12-15 are schematic diagrams of a display interface of an electronic device provided by an embodiment of this application.
  • FIG. 16 is a schematic diagram of the structure of an electronic device provided by an embodiment of the application.
  • a normal fingerprint can be understood as a fingerprint whose shape is not distorted.
  • the fingerprint image collected by the fingerprint sensor includes normal fingerprints.
  • the texture distribution on a normal fingerprint is relatively uniform. For example, referring to (a) in Figure 1, the fingerprint vortex is at a relatively centered position in the texture.
  • Distorted fingerprints can be understood as fingerprints whose shape is distorted.
  • the fingerprint image collected by the fingerprint sensor includes a twisted fingerprint.
  • the texture distribution on the distorted fingerprint is uneven.
  • the fingerprint vortex is not in the middle of the texture.
  • the fingerprint vortex is in the lower right corner of the fingerprint image.
  • At least one of the embodiments of the present application includes one or more; wherein, multiple refers to greater than or equal to two.
  • words such as “first” and “second” are only used for the purpose of distinguishing description, and cannot be understood as indicating or implying relative importance, nor can it be understood as indicating Or imply the order.
  • the twisted fingerprint-based touch method provided by the embodiments of this application can be applied to any electronic device with a fingerprint sensor, such as mobile phones, tablets, laptops, wearable devices (such as bracelets, watches, helmets, earphones, etc.), and vehicle-mounted devices , Smart home equipment, etc.
  • a fingerprint sensor can be set on the touchpad.
  • the fingerprint sensor can be set at any position on the mobile phone, such as on the side of the mobile phone opposite to the plane where the display screen is located (ie the back), or set in the display screen (referred to as under-screen fingerprint sensor); or The side of the phone and so on.
  • the mobile phone may be a full-screen mobile phone, a curved-screen mobile phone, a folding mobile phone, etc., which are not limited in the embodiment of the present application.
  • FIG. 2A shows a schematic structural diagram of the electronic device 100.
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, and a battery 142 , Antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 , Display screen 194, subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait.
  • the different processing units may be independent devices or integrated in one or more processors.
  • the controller may be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.
  • a memory may also be provided in the processor 110 to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
  • the USB interface 130 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on.
  • the USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices.
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
  • the wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100.
  • the mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like.
  • the mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110.
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites. System (global navigation satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 may also receive a signal to be sent from the processor 110, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna 2.
  • the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation systems
  • the display screen 194 is used to display the display interface of the application, such as the viewfinder interface of the camera application.
  • the display screen 194 includes a display panel.
  • the display panel can use liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • AMOLED flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
  • the electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
  • the ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing and is converted into an image visible to the naked eye.
  • ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193.
  • the camera 193 is used to capture still images or videos.
  • the object generates an optical image through the lens and is projected to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal.
  • ISP outputs digital image signals to DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device 100 may include one or N cameras 193, and N is a positive integer greater than one.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts group
  • MPEG2 MPEG2, MPEG3, MPEG4, and so on.
  • NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • applications such as intelligent cognition of the electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, and so on.
  • the internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, and software codes of at least one application program (for example, an iQiyi application, a WeChat application, etc.).
  • the storage data area can store data generated during the use of the electronic device 100 (for example, captured images, recorded videos, etc.) and the like.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • UFS universal flash storage
  • the external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save pictures, videos and other files in an external memory card.
  • the electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and the environment Light sensor 180L, bone conduction sensor 180M, etc.
  • the pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal.
  • the pressure sensor 180A may be provided on the display screen 194.
  • the gyro sensor 180B may be used to determine the movement posture of the electronic device 100.
  • the angular velocity of the electronic device 100 around three axes ie, x, y, and z axes
  • the gyro sensor 180B can be used for image stabilization.
  • the air pressure sensor 180C is used to measure air pressure.
  • the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
  • the magnetic sensor 180D includes a Hall sensor.
  • the electronic device 100 may use the magnetic sensor 180D to detect the opening and closing of the flip holster.
  • the electronic device 100 when the electronic device 100 is a flip machine, the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, features such as automatic unlocking of the flip cover are set.
  • the acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device 100, applied to applications such as horizontal and vertical screen switching, and pedometer.
  • the electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F to measure the distance to achieve fast focusing.
  • the proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode.
  • the light emitting diode may be an infrared light emitting diode.
  • the electronic device 100 emits infrared light to the outside through the light emitting diode.
  • the electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100.
  • the electronic device 100 can determine that there is no object near the electronic device 100.
  • the electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power.
  • the proximity light sensor 180G can also be used in leather case mode, and the pocket mode will automatically unlock and lock the screen.
  • the ambient light sensor 180L is used to sense the brightness of the ambient light.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light.
  • the ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket to prevent accidental touch.
  • the fingerprint sensor 180H is used to collect fingerprint images.
  • the electronic device 100 can use the collected fingerprint image to implement functions such as fingerprint unlocking, access to the application lock, fingerprint photography, fingerprint answering calls, and the like.
  • the fingerprint sensor 180H collects a fingerprint image
  • it sends the fingerprint image to the processor 110 for processing.
  • the processor 110 reads a pre-stored fingerprint image from the internal memory 121, and then compares the fingerprint image collected by the fingerprint sensor 180H with the pre-stored fingerprint image. If they are consistent, the fingerprint authentication is passed; if they are inconsistent, the fingerprint authentication is performed. Fail.
  • the fingerprint sensor 180H collects the first fingerprint image, and sends the first fingerprint image to the processing 110.
  • the processor 110 may identify the first twisting direction indicated by the twisted fingerprint in the first fingerprint image, and operate the electronic device 100 based on the first twisting direction. For example, the processor 110 implements control of the cursor in the display screen (for example, position movement), page turning of an e-book, fast forward/rewind of a movie, etc. in response to the first twisting direction.
  • the temperature sensor 180J is used to detect temperature.
  • the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection.
  • the electronic device 100 when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature.
  • the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”.
  • the touch sensor 180K is used to detect touch operations acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the visual output related to the touch operation can be provided through the display screen 194.
  • the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.
  • the bone conduction sensor 180M can acquire vibration signals.
  • the bone conduction sensor 180M can obtain the vibration signal of the vibrating bone mass of the human voice.
  • the bone conduction sensor 180M can also contact the human pulse and receive the blood pressure pulse signal.
  • the button 190 includes a power-on button, a volume button, and so on.
  • the button 190 may be a mechanical button. It can also be a touch button.
  • the electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the electronic device 100.
  • the motor 191 can generate vibration prompts.
  • the motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as photographing, audio playback, etc.) can correspond to different vibration feedback effects.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.
  • the SIM card interface 195 is used to connect to the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
  • FIG. 2A do not constitute a specific limitation on the electronic device 100.
  • the electronic device 100 may also include more or less components than those shown in the figure, or combine certain components, or disassemble certain components. Components, or different component arrangements.
  • the combination/connection relationship between the components in FIG. 2A can also be adjusted and modified.
  • Fig. 2B shows a software structure block diagram of an electronic device provided by an embodiment of the present application.
  • the software structure of the electronic device can be a layered architecture, for example, the software can be divided into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface.
  • the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer (framework, FWK), the Android runtime (Android runtime) and system libraries, and the kernel layer.
  • the application layer can include a series of application packages. As shown in FIG. 2B, the application layer may include cameras, settings, skin modules, user interfaces (UI), third-party applications, and so on. Among them, three-party applications can include WeChat, QQ, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
  • UI user interfaces
  • three-party applications can include WeChat, QQ, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer can include some predefined functions.
  • the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and so on.
  • the window manager is used to manage window programs.
  • the window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, take a screenshot, etc.
  • the content provider is used to store and retrieve data and make these data accessible to applications.
  • the data may include videos, images, audios, phone calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls that display text, controls that display pictures, and so on.
  • the view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.
  • the phone manager is used to provide the communication function of the electronic device. For example, the management of the call status (including connecting, hanging up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, and so on.
  • the notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or a scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, prompt sounds, electronic devices vibrate, and indicator lights flash.
  • Android runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of Android.
  • the application layer and application framework layer run in a virtual machine.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • the system library can include multiple functional modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
  • surface manager surface manager
  • media library media libraries
  • 3D graphics processing library for example: OpenGL ES
  • 2D graphics engine for example: SGL
  • the surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing.
  • the 2D graphics engine is a drawing engine for 2D drawing.
  • system library may also include an image processing library, which is used to process images to achieve the shooting effects of panning, shifting, ascending, and descending.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
  • the hardware layer may include various types of sensors, such as acceleration sensors, gyroscope sensors, touch sensors, etc. involved in the embodiments of the present application.
  • the fingerprint sensor 180H collects the first fingerprint image and generates a corresponding hardware interrupt.
  • the hardware interrupt is sent to the kernel layer and sent to the system library via the kernel layer.
  • the system library recognizes the first twisting direction indicated by the twisted fingerprint in the first fingerprint image, and sends the recognized first twisting direction to the currently running application in the application layer.
  • the currently running application is, for example, an application being displayed on a display screen of an electronic device (referred to as a foreground application). Assuming that the currently running application is a word application, a display interface of the word application is displayed on the display screen, and the display interface includes a cursor. Assuming that the first twisting direction is leftward, the currently running application moves the cursor to the left in response to the first twisting direction, and so on.
  • FIG. 3 shows a schematic flowchart of a touch method based on twisted fingerprints according to an embodiment of the present application. As shown in Figure 3, the process of the method includes:
  • the electronic device detects a first fingerprint image.
  • the electronic device includes a fingerprint sensor for detecting fingerprint images.
  • the location of the fingerprint sensor on the electronic device is not limited in this embodiment of the application.
  • the fingerprint sensor is set at the location of the home button.
  • the fingerprint sensor is arranged in all or part of the area in the display screen (ie, the fingerprint sensor under the screen).
  • the fingerprint sensor is arranged on the side of the electronic device.
  • the fingerprint sensor is arranged on the back of the electronic device (the side opposite to the display screen), and so on.
  • the electronic device determines whether the current scene is a fingerprint authentication scene or a non-fingerprint authentication scene. If the current scene is a non-fingerprint verification scene, go to 303; if the current scene is in a fingerprint verification scene, perform fingerprint verification on the first fingerprint image.
  • the fingerprint authentication scenario mentioned here can be understood as a scenario that requires fingerprint authentication.
  • Non-fingerprint authentication scenarios can be understood as scenarios that do not require fingerprint authentication.
  • fingerprint authentication scenarios may include fingerprint unlocking scenarios, fingerprint payment scenarios, and so on. Except for the fingerprint authentication scene, other scenes are non-fingerprint authentication scenes.
  • the electronic device can determine whether the current scene is a fingerprint authentication scene or a non-fingerprint authentication scene through the current state (for example, whether the screen is locked), the display interface, and the like. For example, if the electronic device determines that the screen is currently locked, it determines that the current scene is a fingerprint authentication scene. For another example, the electronic device determines that the current display interface includes prompt information, and the prompt information is used to prompt the user to input a fingerprint for unlocking, payment, etc., and determine that the current scene is a fingerprint authentication scene. When the electronic device determines that the current scene does not belong to the fingerprint authentication scene, it determines that it belongs to the non-fingerprint authentication scene.
  • the electronic device after the electronic device detects the first fingerprint image, if it is determined that the current scene is a non-fingerprint authentication scene, it performs subsequent processing. If it is determined that the current scene is a fingerprint authentication scene, fingerprint authentication (ie, identity authentication) is performed on the first fingerprint image. Wherein, the process of performing fingerprint authentication on the first fingerprint image includes matching the first fingerprint image with a pre-stored fingerprint image. If the matching is successful, it is determined that the authentication is passed, and if the matching fails, it is determined that the authentication is not passed.
  • fingerprint authentication ie, identity authentication
  • the electronic device determines whether the fingerprint in the first fingerprint image is a twisted fingerprint or a normal fingerprint.
  • the twisted fingerprint may be understood as a fingerprint with a twisted fingerprint shape; the normal fingerprint may be understood as a fingerprint with no twisted fingerprint shape; For the introduction of twisted fingerprints and normal fingerprints, please refer to the preceding text, and I will not repeat them here.
  • If the first fingerprint image includes a distorted fingerprint go to 304. If the first fingerprint image includes a normal fingerprint, there is no need to respond. It is understandable that when the current scene is a non-fingerprint authentication scene, if the first fingerprint image includes a normal fingerprint, it may be that the user accidentally touched the fingerprint sensor, so there is no need to respond. If the first fingerprint image includes a twisted fingerprint, it may be that the user desires to touch the electronic device through the twisted fingerprint, so the electronic device continues to execute 304.
  • the electronic device may determine whether the fingerprint shape in the first fingerprint image includes a normal fingerprint or a distorted fingerprint on the first fingerprint image.
  • the fingerprint shape can be understood as the shape of the area enclosed by the edge contour of the fingerprint on the fingerprint image.
  • the normal fingerprint shape that can be stored in the electronic device, compare the shape enclosed by the edge contour of the fingerprint on the first fingerprint image with the stored normal fingerprint shape. If they are consistent, it is determined that the fingerprint on the first fingerprint image is a normal fingerprint. Otherwise, it is a twisted fingerprint.
  • the normal fingerprint in FIG. 1 please refer to the shape enclosed by the dashed line in (a) in FIG. 5 for the corresponding normal fingerprint shape.
  • the corresponding fingerprint shape can be seen in the shape enclosed by the dashed line in Figure 5 (b).
  • the electronic device determines the shape enclosed by the edge contour of the fingerprint on the first fingerprint image, compares the shape with the stored normal fingerprint shape, and if it is inconsistent, determines that the first fingerprint image includes a twisted fingerprint.
  • the shape of the fingerprint may also include the distribution of texture on the fingerprint, such as the position of a vortex.
  • the vortex on a normal fingerprint is located in the middle of the texture. Therefore, the electronic device can also determine whether the fingerprint vortex on the first fingerprint image is in the middle of the texture, if it is, it is determined that the first fingerprint image includes a normal fingerprint, and if not, it is determined that the first fingerprint image includes a twisted fingerprint. Assuming that the first fingerprint image is the fingerprint image shown in (b) of FIG. 1, the electronic device determines that the fingerprint vortex is at the lower right corner of the texture, and determines that the first fingerprint image includes a twisted fingerprint.
  • the electronic device judges whether the first fingerprint image is a normal fingerprint or a twisted fingerprint based on the shape of the fingerprint.
  • Other methods are also feasible, and the embodiments of the present application will not list them one by one.
  • the process of determining whether the first fingerprint image includes a normal fingerprint or a distorted fingerprint by the above-mentioned electronic device based on the shape of the fingerprint can be implemented by a machine learning algorithm, such as a classification algorithm, and the classification algorithm such as a support vector machine ( support vector machine, SVM) classifier.
  • the classification algorithm can be trained to determine normal fingerprints that meet the conditions (for example, fingerprints with the same shape as the normal fingerprints), then the output classification result is a normal fingerprint; it can determine the distorted fingerprints that do not meet the conditions (for example, If the fingerprint shape is inconsistent with the normal fingerprint shape), the output result is a distorted fingerprint.
  • other machine learning algorithms such as convolutional neural network algorithms can also be used to distinguish, which is not limited in the embodiment of the present application.
  • the first twisting direction is used to indicate the twisting (or rubbing) direction when the user's finger touches the fingerprint sensor.
  • the fingerprint sensor collects a twisted fingerprint. Therefore, the electronic device recognizes the user's intention, that is, the twisting direction in which the user's finger intends to twist, by identifying the first twisting direction indicated by the twisted fingerprint, and then operates the electronic device according to the twisting direction.
  • One or more normal fingerprint images are stored in the electronic device.
  • the electronic device may determine whether there is a normal fingerprint image that matches the first fingerprint image among the stored one or more normal fingerprint images. If it exists, the first twisting direction indicated by the twisted fingerprint in the first fingerprint image may be determined according to the first fingerprint image and the normal fingerprint image matching the first fingerprint image.
  • the above-mentioned process of the electronic device determining the normal fingerprint image matching the first fingerprint image in the stored normal fingerprint image can also be understood as a fingerprint authentication process for the first fingerprint image. If there is a normal fingerprint image that matches the first fingerprint image, that is, the authentication is passed. According to the first fingerprint image and the normal fingerprint image that matches the first fingerprint image, it is determined that the distortion fingerprint in the first fingerprint image is indicated. The first twist direction.
  • the first twisting direction indicated by the twisted fingerprint cannot be determined. That is to say, in method 1, only users who have passed fingerprint authentication can operate the electronic device through the touch method based on the twisted fingerprint provided in the embodiment of the present application, which helps to improve the security of the electronic device to a certain extent.
  • the following embodiment introduces a process in which the electronic device determines the first twisting direction indicated by the twisted fingerprint in the first fingerprint image according to the first fingerprint image and the normal fingerprint image matching the first fingerprint image.
  • the electronic device may first unify the coordinate system of the first fingerprint image and the matching normal fingerprint image, so that the first fingerprint image and the normal fingerprint image are in the same coordinate system. Then, the electronic device determines the first feature point on the twisted fingerprint on the first fingerprint image, and determines the second feature point on the normal fingerprint image corresponding to the first feature point.
  • the feature points mentioned here can also be called minutiae points.
  • fingerprints can be used as user identity due to their uniqueness. The uniqueness can be understood as the feature points on the fingerprints of different fingers are different, that is, the feature points on the fingerprint can be used to uniquely identify the user, and can be understood as a specific attribute of the user. In other words, two fingerprint images produced by the same finger have the same feature points, and two different fingers each produce a fingerprint image, and the two fingerprint images usually do not have the same feature points.
  • the characteristic points may be, for example, peripheral points, bifurcation points, burrs, scars, sweat holes, etc. on the fingerprint, which are not limited in the embodiment of the present application.
  • FIG. 6 is a schematic diagram of each feature point provided in the embodiment of this application.
  • the tip point can be understood as the end point of the texture.
  • the bifurcation point can be understood as the bifurcation point where one texture bifurcates into two textures.
  • Sweat holes can be understood as a break point on a texture or a blank point on a texture. Scars are the more obvious discontinuities in the texture of the fingerprint image.
  • the first feature point on the twisted fingerprint is shifted relative to the second feature point on the normal fingerprint image.
  • the electronic device determines the direction of the first feature point relative to the second feature point, or it can also be understood as the direction vector of the second feature point pointing to the first feature point, and this direction is the first twisting direction.
  • Figure 7 (a) and (b) are schematic diagrams of the first feature point on the twisted fingerprint image and the second feature point on the normal fingerprint image, where the first feature point corresponds to the second feature point.
  • the direction vector of the second feature point pointing to the first feature point is shown in (c) of FIG. 7, and this direction vector is the first twisting direction.
  • first feature point may be one feature point or multiple feature points. If there are multiple feature points, there can be multiple corresponding second feature points, that is, there may be multiple directions of the first feature point relative to the second feature point, and the sum of the multiple directions can be taken as the first feature point.
  • a twisting direction It can be understood that when the first feature points are multiple feature points, it helps to improve the accuracy of the determined first twist direction.
  • the electronic device may determine the distortion field of the first fingerprint image according to the normal fingerprint image, and the distortion field is used to indicate the first distortion direction.
  • the following embodiment describes the process of determining the distortion field of the distorted fingerprint by the electronic device.
  • the first grid is a square grid established by the electronic device to cover all the feature points on the normal fingerprint image without distortion.
  • the first grid can be established in the first coordinate system x-o-y, and the first coordinate system can be any coordinate system.
  • the number and size of the grids in the first grid are not limited in this embodiment of the application.
  • the electronic device recognizes one or more feature points (referred to as the second feature point) on the normal fingerprint image, and determines the first position of the one or more feature points in the first grid and marks it, for example, the feature point In the grid of the first row and column in the first grid.
  • the electronic device recognizes 5 feature points and the position of each feature point in the first grid.
  • the feature point 1 is in the grid of the fifth row and the fifth column in the first grid.
  • the electronic device performs coordinate conversion of the first fingerprint image into the above-mentioned first coordinate system x-o-y.
  • the electronic device recognizes the first feature point in the first fingerprint image that corresponds to the second feature point on the normal fingerprint image.
  • the electronic device draws a second grid corresponding to the first grid for covering all the feature points on the first fingerprint image.
  • the second square of the second feature point in the second grid on the first fingerprint image corresponds to the first square of the first feature point in the first grid.
  • FIG. 8 shows a schematic diagram of the second grid corresponding to the first fingerprint image, and the second grid is the distortion field corresponding to the first fingerprint image.
  • the electronic device can determine the first twisting direction indicated by the twisting place, or it can be understood as the twisting direction of the second grid relative to the first grid. For example, the electronic device may determine the direction in which each square in the first grid points to the square corresponding to each square in the second grid, for example, the square in the first row and first column of the first grid.
  • the grid points to the square in the first row and first column in the second grid, and the square in the first row and second column in the first grid points to the square in the second row and second column in the second grid. And so on. Therefore, the electronic device can obtain multiple directions, and then take the sum of the multiple directions as the first twisting direction.
  • FIG. 9 shows a schematic diagram of a fingerprint image and a corresponding distortion field generated when the user's finger is twisted to the left or to the right.
  • the user's finger touches the fingerprint sensor (the fingernail of the user's finger in FIG. 9 faces outward).
  • the fingerprint sensor collects the normal fingerprint image, and the electronic device determines the first grid corresponding to the normal fingerprint image.
  • the electronic device collects the first fingerprint image, and the first fingerprint image includes the twisted fingerprint.
  • the electronic device recognizes the second grid corresponding to the first fingerprint image.
  • the electronic device determines that the twisting direction of the second grid relative to the first grid is twisted to the left. Therefore, the electronic device can determine that the user's finger is twisted to the right.
  • the electronic device collects another fingerprint image, which includes the twisted fingerprint.
  • the electronic device recognizes the third grid corresponding to the another fingerprint image.
  • the electronic device determines that the twisting direction of the third grid relative to the first grid is twisted to the right. Therefore, the electronic device can determine that the user's finger is twisted to the left.
  • the electronic device can determine the first twisting direction indicated by the twisted fingerprint based on the interval between the textures of the twisted fingerprint on the first fingerprint image.
  • the electronic device determines that the texture interval on the distorted fingerprint is greater than the first area with a preset interval, and the second area with the texture interval less than the preset interval, the second area and the texture in the first area Parallel; the specific value of the preset interval may be preset, or may be the average interval on the first fingerprint image, which is not limited in the embodiment of the present application.
  • the texture in the first region is parallel to the texture in the second region, and the so-called parallel here may be approximately parallel (or referred to as incomplete parallel).
  • the texture interval in the first area is larger (for example, greater than the aforementioned preset interval), and the texture interval in the second area is smaller (for example, less than the aforementioned preset interval).
  • the electronic device determines that the first normal direction (the arrow direction in FIG. 7) of the texture in the second area facing the first area is the first twisting direction.
  • the texture of the fingerprint image collected by the fingerprint sensor is incomplete.
  • the left area of the finger for example, the left area of the center of the fingerprint vortex
  • the right area for example, the right area of the center of the fingerprint vortex
  • the area is small; therefore, the fingerprint image on the fingerprint image collected by the fingerprint sensor is incomplete, for example, it does not include the texture of the area to the right of the center of the finger vortex or the number of textures in the area to the right of the center of the finger vortex is small.
  • the electronic device can determine the first twisting direction indicated by the twisted fingerprint based on the number of textures (or the number of textures) in different regions on the twisted fingerprint. Specifically, the electronic device determines the first area and the second area on the twisted fingerprint that are opposite to the center of the fingerprint vortex; if the number of fingerprints in the first area is greater than the number of fingerprints in the second area, determine The first orientation is the first twisting direction.
  • the twisted fingerprint has more textures in the upper left area relative to the center of the vortex, and less textures in the lower right area, so the first twist direction is determined to be the upper left.
  • the electronic device in the methods 2 and 3 does not need to store the normal fingerprint image of the user in advance, and can also determine the first twist direction indicated by the twisted fingerprint in the first fingerprint image.
  • the foregoing is only illustrative of three examples of determining the twisting direction indicated by the twisted fingerprint, and other methods are also feasible, which are not limited in the embodiment of the present application.
  • the electronic device is equipped with a touch screen (touch pad, TP), taking a capacitive touch screen as an example.
  • a touch screen touch pad, TP
  • the touch screen When the user touches the touch screen, the touch screen generates a first capacitance signal.
  • the first capacitance signal includes the capacitance signal of the contact point between the user's finger and the touch screen.
  • TP When the user's finger is not lifted and twisted, TP generates a second capacitance signal.
  • the second capacitance signal includes the capacitance signal of the contact point with the touch screen after the user's finger is twisted.
  • the electronic device compares the first capacitance signal and the second capacitance signal to determine the change of the user's contact point, and then determines the user's intention, that is, the direction of the user's finger twisting.
  • FIG. 11 shows a schematic diagram of the first capacitance signal.
  • the first capacitance signal includes a 4*6 matrix with a capacitance signal of 1, which represents the contact point between the user's finger and the touch screen in the matrix.
  • (B) in FIG. 11 shows a schematic diagram of the second capacitance signal.
  • the second capacitance signal includes a 4*4 matrix with a capacitance signal of 1. That is to say, the contact point between the user’s finger and the touch screen is changed from a 4*6 matrix to a 4*4 matrix.
  • the second capacitance signal lacks the lower two rows of capacitance signals relative to the first capacitance signal. Therefore, the electronic device Make sure that the user's finger is twisted upward.
  • the touch screen on the electronic device can determine the twisting direction of the user's finger without a fingerprint sensor.
  • the electronic device can use any one of Mode 1 to Mode 3 and Mode 4 in combination.
  • the under-screen fingerprint sensor as an example, when a user's finger touches the touch screen, the under-screen fingerprint sensor is used to detect the fingerprint image, and the touch screen is used to detect the capacitance signal.
  • the electronic device obtains one twisting direction through the fingerprint image, and the other twisting direction through the capacitive signal. If the twisting direction obtained through the fingerprint image is consistent with the twisting direction obtained through the capacitance signal, operating the electronic device based on the twisting direction helps to improve the accuracy of the touch operation of the electronic device.
  • the electronic device defaults to the above-mentioned method 2 or method 3 to determine the first twisting direction.
  • method 1 is used, that is, fingerprint authentication is performed first, and the first twisting direction is determined after the authentication is passed.
  • the "enable the safe operation function” may be that the electronic device judges whether the control for indicating the safe operation function is activated, if so, it is determined that the safe operation function has been started, if not, it is determined that the safe operation function is not started.
  • the control may be provided in a setting application in the electronic device, or provided in other shortcuts, which is not limited in the embodiment of the present application.
  • the electronic device operates the electronic device based on the first twisting direction.
  • the electronic device may be executed immediately.
  • the electronic device waits for a preset time after determining the first twisting direction. After the preset time is reached, collects a second fingerprint image again. If the second fingerprint image also includes distortion Fingerprint, and the second twisting direction indicated by the twisted fingerprint is consistent with the first twisting direction, and the electronic device is operated based on the first twisting direction.
  • the preset duration may be set in advance and stored in the electronic device, which is not limited in the embodiment of the present application.
  • the electronic device may also determine that the user's finger is continuously in contact with the fingerprint sensor.
  • the touch screen detects that the user's finger is continuously touching the touch screen, that is, it is determined that the user's finger is continuously in contact with the fingerprint sensor. That is to say, when the user’s finger continues to touch the fingerprint sensor, the first fingerprint image collected by the fingerprint sensor and the second fingerprint image indicate the same twisting direction, and the electronic device is operated based on the twisting direction, which helps to avoid the user’s finger Touching the fingerprint sensor by mistake leads to the control of the electronic device.
  • the electronic device may also determine that the user's finger is in continuous contact with the fingerprint sensor, and the contact position remains unchanged.
  • the touch screen can detect the contact position of the user's finger with the touch screen. If the contact position does not change within a preset period of time, it is determined that the contact position of the user's finger with the fingerprint sensor does not change.
  • the constant contact position mentioned here can be understood as the overlap of the contact area detected by the touch screen each time. For example, the touch screen detects the contact area S1 at the first moment, and the contact area S2 is detected at the second moment. Partial areas of S1 and S2 overlap, that is, it is determined that the contact position remains unchanged.
  • the electronic device is based on the twisting direction indicated by the twisted fingerprint. The operation of electronic equipment is convenient, especially for large-screen electronic equipment.
  • the electronic device can determine the current scene, in which the electronic device is operated using an operation mode suitable for the current scene based on the first twisting direction.
  • the following embodiments give several examples of the scenarios.
  • Example 1 The display screen of an electronic device includes a cursor.
  • the electronic device can move the position of the cursor according to the first twisting direction. For example, if the first twisting direction is to the left, move the cursor to the left.
  • the cursor may move a preset distance each time, and the preset distance may be preset and stored in the electronic device.
  • FIG. 12 shows a schematic diagram of a GUI of the electronic device.
  • the GUI can be understood as the main interface, which includes a cursor (arrow in the figure).
  • the user's finger touches the fingerprint sensor (for example, an under-screen fingerprint sensor), and the fingerprint sensor collects a first fingerprint image.
  • the first fingerprint image is the fingerprint in Figure 12 (a).
  • the electronic device determines the first twisting direction indicated by the first fingerprint image, and controls the cursor movement position based on the first twisting direction.
  • FIG. 12 shows a schematic diagram of a GUI of the electronic device.
  • the GUI can be understood as a document editing interface in an electronic device, such as word, memo, etc.
  • the GUI includes a cursor (the vertical line between the text "instructions" in the figure).
  • the user's finger touches the fingerprint sensor (for example, an under-screen fingerprint sensor), and the fingerprint sensor collects a first fingerprint image, such as the fingerprint in (b) in FIG. 12.
  • the electronic device determines that the first fingerprint image includes the first twisted fingerprint, determines the first twisted direction indicated by the first twisted fingerprint, and controls the cursor movement position based on the first twisted direction. Assuming that the first twisting direction is twisting to the left, the cursor is moved to the left, for example, from the position of the dotted line to the position of the solid line.
  • the electronic device can set a cursor touch mode and a cursorless touch mode. Taking (a) in FIG. 12 as an example, if in the cursor touch mode, the display screen of the electronic device includes a cursor. In non-cursor touch mode, the display does not include the cursor.
  • the electronic device may provide an entry for setting a cursor touch mode or a cursorless touch mode, for example, provided in a setting application.
  • the displayed interface includes a cursor (that is, the arrow in (a) in FIG. 12).
  • Example 2 The electronic device runs a game application, and a game interface of the game application is displayed on the display screen, and the game interface includes game characters.
  • the electronic device can move the position of the game character according to the first twisting direction. For example, if the first twisting direction is to the left, the game character is moved to the left.
  • the game character may move a preset distance each time, and the preset distance may be preset and stored in the electronic device.
  • Example 3 A 3D image is displayed on the display screen of an electronic device.
  • the 3D image includes a rotatable 3D model (or called a 3D object).
  • the first twisting direction includes but is not limited to upward, downward, left, right, upper left, upper right, lower left, lower right, and so on.
  • the electronic device rotates the 3D model according to the first twisting direction. For example, referring to (a) in FIG. 13, assuming that the first twisting direction is to the left, the 3D model is rotated clockwise with the dashed axis in the figure as the central axis, and the rotation angle may be a preset angle. That is, the angle set in advance.
  • the dashed axis may be the central axis of the 3D model.
  • the 3D model is rotated clockwise by a preset angle with the dashed axis in the figure as the central axis. Therefore, in the embodiments of the present application, the user's finger rubs the finger after touching the fingerprint sensor, and the distortion occurs.
  • the electronic device rotates the 3D model based on the twisted fingerprint, which is convenient for the user to view the front view, top view, bottom view, etc. of the 3D model, and the operation is convenient.
  • the 3D model when a 3D image is displayed on the display screen of the electronic device, if the electronic device detects that the user's fingertip touches the display screen, and the user's fingertip rotates on the display screen, the 3D model can be placed on the display screen.
  • the vertical line of the plane is the preset angle of axis rotation.
  • the user's fingertip is in contact with the display screen. Assuming that the user's fingertip rotates counterclockwise on the display screen, the 3D image is displayed on the display screen.
  • the vertical line of the plane (the dashed line in the figure) is the preset angle of counterclockwise axis rotation.
  • the way the electronic device detects that the user's fingertip is in contact with the display screen may be that the fingerprint sensor detects a fingerprint image, and the fingerprint image in the fingerprint image has a fingerprint texture number less than a threshold, and/or TP detection
  • the preset area here may be a value set in advance.
  • the way for the electronic device to determine that the user's fingertip rotates on the display screen may include: the electronic device determines the change of the contact surface between the user's finger and the touch screen, if the contact surface detected by the electronic device at the next time is relative to the contact surface detected at the previous time Rotate clockwise to rotate the 3D image clockwise by a preset angle with the vertical line of the plane where the display screen is located as the axis. If the contact surface detected at the next time of the electronic device rotates counterclockwise relative to the contact surface detected at the previous time, the 3D image is rotated counterclockwise by a preset angle with the vertical line of the plane where the display screen is located as an axis.
  • the twisted fingerprint-based touch method provided in the embodiments of the present application can also be applied to other scenarios.
  • the electronic device controls the scrolling of the display interface based on the first twisting direction indicated by the twisted fingerprint; for example, as shown in Figure 15 (a), the electronic device implements scrolling from the main interface to the negative screen based on the fingerprint detected by the fingerprint sensor , Or flipping through adjacent page numbers of e-books, or flipping through different images in the photo album application, etc.
  • the electronic device controls the movie to fast forward or rewind based on the first distortion method indicated by the distortion fingerprint.
  • the display interface of the electronic device displays the movie playback interface, if the first distortion direction To the left, control the movie to rewind, and the first twist direction is to the right, to control the movie to fast forward.
  • the electronic device controls the brightness or volume of the display screen based on the first twisting direction indicated by the twisted fingerprint; if the first twisting direction is upward, increase the brightness or volume of the display screen, if The first twisting direction is downward, reducing the brightness or volume of the display screen, and so on.
  • the fingerprint sensor can collect fingerprint images in real time and continuously. That is, after the first fingerprint image in the embodiment shown in FIG. 3, the fingerprint sensor continues to collect the second fingerprint image. Among them, the process shown in FIG. 3 can be executed once for each image fingerprint collected. Or, after the electronic device collects the first fingerprint image, if it is determined that the user's finger continues to touch the fingerprint sensor, other fingerprint images collected before detecting that the user's finger is lifted need not go through the judgment process of a fingerprint authentication scene or a non-fingerprint authentication scene. The electronic device may continue to operate the electronic device based on the second twisting direction indicated by the twisted fingerprint included in the second fingerprint image.
  • the finger when the user touches the fingerprint sensor, the finger is rubbed in different directions in a small amount, resulting in fingerprint images with different twisting directions detected by the fingerprint sensor, and the electronic device is operated based on the twisting direction. That is to say, the user can control the electronic device without moving the finger greatly, and the operation is convenient, especially for the large-screen electronic device.
  • the electronic device determines that the user's finger is lifted and does not touch the fingerprint sensor, it can stop operating the electronic device. For example, a fingerprint sensor continuously collects fingerprint images in a certain period. When a certain period arrives but no fingerprint image is collected, it is determined that the user's finger is lifted and does not touch the fingerprint sensor. For another example, taking the under-screen fingerprint sensor as an example, when the TP detects that the user's finger is lifted and does not touch the touch screen, it is determined that the user's finger is lifted and does not touch the fingerprint sensor.
  • the fingerprint sensor when the user's finger is continuously in contact with the fingerprint sensor, the fingerprint sensor periodically collects fingerprint images, and at a certain time after the first fingerprint image, a third fingerprint image containing a normal fingerprint is collected (or, it continues to collect within a certain period of time). To the fingerprint image containing the normal fingerprint), then stop operating the electronic device.
  • the fingerprint sensor collects a distorted fingerprint
  • the fingerprint image containing the distorted fingerprint is collected, and the electronic device is operated. The user does not lift the finger, but the finger returns to the normal pressing state (The fingerprint sensor collects a normal fingerprint), stop operating the electronic device.
  • the method provided by the embodiments of the present application is introduced from the perspective of an electronic device (such as a mobile phone) as the execution subject.
  • the electronic device may include a hardware structure and/or a software module, and realize the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a certain function among the above-mentioned functions is executed by a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraint conditions of the technical solution.
  • the electronic device may include a touch screen 1601, wherein the touch screen 1601 includes a touch-sensitive surface 16906 and a display Screen 1607; one or more processors 1602; multiple application programs 1608; fingerprint sensor 1609; the above-mentioned devices can be connected through one or more communication buses 1605.
  • the display screen 1607 may be used to display a main interface, or a display interface of a certain application of a plurality of applications 1608, such as a camera interface (ie, a viewfinder interface), and may also be used to display an image taken by an electronic device.
  • the fingerprint sensor 1609 is used to collect fingerprint images.
  • the one or more computer programs 1604 are stored in the aforementioned memory 1603 and configured to be executed by the one or more processors 1602, and the one or more computer programs 1604 include instructions, and the aforementioned instructions can be used for execution.
  • the touch screen 1601 may be the aforementioned display screen 194; the processor 1602 may be the processor 110; the fingerprint sensor 1609 may be the fingerprint sensor 180H; and the memory 1603 may be Internal memory 121.
  • the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
  • the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the first acquiring unit and the second acquiring unit may be the same unit or different units.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • references described in this specification to "one embodiment” or “some embodiments”, etc. mean that one or more embodiments of the present application include a specific feature, structure, or characteristic described in combination with the embodiment. Therefore, the sentences “in one embodiment”, “in some embodiments”, “in some other embodiments”, “in some other embodiments”, etc. appearing in different places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless it is specifically emphasized otherwise.
  • the terms “including”, “including”, “having” and their variations all mean “including but not limited to”, unless otherwise specifically emphasized.
  • the computer program product includes one or more computer instructions.
  • the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
  • the computer instructions may be transmitted from a website, computer, server, or data center.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center integrated with one or more available media.
  • the usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • General Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Input (AREA)

Abstract

本申请实施例提供一种基于扭曲指纹的触控方法与电子设备。其中，电子设备中的指纹传感器采集到第一指纹图像，电子设备识别第一指纹图像上的第一扭曲指纹所指示的第一扭曲方向，基于该第一扭曲方向操作电子设备。因此，用户可以不再单纯通过触摸屏操作电子设备，还可以通过指纹传感器采集的扭曲指纹操作电子设备，方便用户操作，尤其对大屏电子设备的操作。

Description

一种基于扭曲指纹的触控方法与电子设备
相关申请的交叉引用
本申请要求在2020年01月31日提交中国专利局、申请号为202010077752.3、申请名称为“一种基于扭曲指纹的触控方法与电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域，尤其涉及一种基于扭曲指纹的触控方法与电子设备。
背景技术
目前，用户对电子设备的控制主要依赖触摸屏。触摸屏可用于检测触摸操作，比如滑动、单击或双击等操作，电子设备根据触摸操作产生相应的响应，并提供视觉输出。
用户手指在触摸屏上的触摸操作有一定的局限性，尤其是大屏幕电子设备。比如，用户右手单手握持电子设备时，右手大拇指在触摸屏上能够触摸到的区域有限，假如用户想要触摸远离右手大拇指的区域时，需要调整握姿才能触摸到，操作不够便捷；而且调整握姿的过程中，电子设备握持不稳定，还有可能掉落，影响用户体验。总之，单纯依赖于触摸屏的触摸检测实现对电子设备的触控，有一定局限性。
发明内容
本申请的目的在于提供了一种基于扭曲指纹的触控方法与电子设备，用以提升用户操作电子设备的便捷性。
上述目标和其他目标将通过独立权利要求中的特征来达成。进一步的实现方式在从属权利要求、说明书和附图中体现。
第一方面，提供一种基于扭曲指纹的触控方法，该方法可以应用于具有指纹传感器的电子设备，例如，手机、平板电脑等。电子设备检测第一指纹图像，确定第一指纹图像上第一扭曲指纹所指示的第一扭曲方向；然后基于该第一扭曲方向，操作所述电子设备。
因此，电子设备可以不再单纯依赖触摸屏实现相应的操作，而是通过指纹传感器检测到的用户指纹图像上的扭曲指纹识别扭曲指纹指示的第一扭曲方向，该第一扭曲方向可以体现用户意图，即用户手指意图向哪个方向扭曲，因此，电子设备可以基于第一扭曲方向操作电子设备，以满足用户意图，方便操作，用户体验度较高。
电子设备可以包括指纹认证场景和非指纹认证场景。其中，指纹认证场景可以理解为需要指纹认证的场景。非指纹认证场景可以理解为不需要进行指纹认证的场景。例如，指纹认证场景可以包括指纹解锁场景、指纹支付场景等等。除去指纹认证场景之外的其它场景即非指纹认证场景。
示例性的，电子设备在确定所述第一扭曲指纹指示第一扭曲方向之前，还可以判断所述电子设备当前的使用场景是否为无需使用指纹进行认证的非指纹认证场景；若确定所述当前的使用场景为非指纹认证场景，说明用于意图通过扭曲指纹操作电子设备，则确定所 述第一扭曲指纹所指示的第一扭曲方向，基于该第一扭曲方向操作电子设备。若所述当前的使用场景为需要进行指纹认证的指纹认证场景，将所述第一指纹图像与预存的指纹图像进行匹配，即对第一指纹图像进行指纹认证(即身份认证)即可，可以无需确定第一扭曲指纹的扭曲方向，提升效率。
在一种可能的设计中，电子设备在所述基于所述第一扭曲方向，操作所述电子设备之前，还可以等待预设时长之后，检测到第二指纹图像；若所述第二指纹图像内包括第二扭曲指纹，且所述第二扭曲指纹指示的第二扭曲方向与所述第一扭曲方向一致，基于所述第一扭曲方向操作电子设备，有助于避免用户误触指纹传感器而导致控制电子设备。
示例1，电子设备还可以在所述预设时长达到之前，确定用户手指与所述指纹传感器持续接触。以屏下指纹传感器为例，触摸屏检测到用户手指持续接触触摸屏，即确定用户手指与指纹传感器持续接触。也就是说，用户手指持续接触指纹传感器的过程中，指纹传感器采集的第一指纹图像和第二指纹图像所指示的扭曲方向一致，则基于所述扭曲方向操作电子设备，有助于避免用户手指误触指纹传感器而导致对电子设备的控制。
示例2，电子设备确定在所述预设时长达到之前，用户手指与指纹传感器持续接触，且接触位置不变。也就是说，用户手指持续接触指纹传感器的过程中，无需挪动手指位置或者说无需大幅度挪动手指位置，只需小幅度搓动手指，就可以操作电子设备。例如，用户手指小幅度向左搓动时，电子设备检测到扭曲指纹，识别该扭曲指纹指示第一扭曲方向为向左，则电子设备基于第一扭曲指纹操作电子设备，操作便捷，尤其便于对大屏电子设备的操作。
在一些可能的设计中，电子设备基于所述第一扭曲方向操作电子设备的场景有多种，包括但不限定于如下场景：
场景1：电子设备确定当前显示界面内包括光标时，按照所述第一扭曲方向调整所述光标的位置。
场景2：电子设备确定当前显示界面为游戏界面时，按照所述第一扭曲方向调整所述游戏界面中的游戏人物的位置。
场景3：电子设备确定当前显示界面内包括3D图像时，按照所述第一扭曲方向调整所述3D图像内3D模型的旋转方向。
场景4：电子设备基于第一扭曲方向，控制显示界面的翻阅、电影快进或快退、显示屏亮度变化或音量变化。
可以理解的是，当电子设备确定用户手指抬起不接触指纹传感器时，可以停止操作电子设备。以屏下指纹传感器为例，TP检测到用户手指抬起不接触触摸屏时，确定用户手指抬起不接触指纹传感器，所以电子设备停止基于第一扭曲指纹操作电子设备。
或者，用户手指持续接触指纹传感器的过程中，指纹传感器周期性的不断采集指纹图像，在第一指纹图像之后的某个时刻采集到包含正常指纹的第三指纹图像则停止操作电子设备。也就是说，用户手指向某个方向倾斜着按压指纹传感器(指纹传感器采集到扭曲指纹)时，采集到包含扭曲指纹的指纹图像，操作电子设备，用户手指不抬起，但手指恢复正常按压状态(指纹传感器采集到正常指纹)时，停止操作电子设备。通常，用户手指接触指纹传感器的过程中，用户手指在同一接触位置向不同方向扭曲(例如，小幅度搓动)即可产生扭曲指纹，所以本申请实施例提供的基于扭曲指纹的触控方法中，无需用户大幅度移动手指即可操作电子设备，操作便捷，用户体验高，尤其对大屏电子设备的操作。
在一种可能的设计中，电子设备确定所述第一扭曲指纹指示的第一扭曲方向的方式有多种，包括但不限定于如下方式：
方式1，通常，由于扭曲指纹的形状发生扭曲变化，所以扭曲指纹上的第一特征点相对于正常指纹图像上第二特征点发生偏移，所以，所述第二特征点相对于所述第一特征点的方向用于指示所述第一扭曲方向。因此，电子设备可以确定所述第一扭曲指纹上的第一特征点，并确定与所述第一扭曲指纹相匹配的正常指纹上与所述第一特征点对应的第二特征点；所述第一扭曲指纹和所述正常指纹在同一坐标系中；则所述第二特征点相对于所述第一特征点的方向用于指示所述第一扭曲方向。
方式2，通常，用户手指倾斜着按压指纹传感器时，倾斜方向上用户手指力度较大，纹理被拉伸导致纹理之间的间隔增大，与倾斜方向相对的方向上的纹理被挤压导致纹理之间的间隔缩小。因此，电子设备可以确定所述第一扭曲指纹上纹理间隔大于预设间隔第一区域，以及纹理间隔小于所述预设间隔的第二区域，所述第二区域与所述第一区域内的纹理平行；则所述第二区域内纹理的第一法线方向为所述第一扭曲方向，所述第一法线方向指向所述第一区域。
方式3，通常，用户手指倾斜着按压指纹传感器时，指纹传感器采集的指纹图像上纹理不完整。例如，假设用户手指向左倾斜按压指纹传感器，手指左侧区域(例如指纹漩涡中心的左侧区域)接触指纹传感器，右侧区域(例如指纹漩涡中心的右侧区域)可能不接触指纹传感器或接触区域较少；因此指纹传感器采集的指纹图像上指纹不完整，例如不包含手指漩涡中心右侧区域的纹理或者手指漩涡中心右侧区域的纹理数量较少。因此，电子设备可以确定所述第一扭曲指纹上的第一区域和第二区域，所述第一区域相对于所述第一扭曲指纹上漩涡的第一方位与所述第二区域相对于所述漩涡的第二方位相反；若所述第一区域中的指纹条数大于所述第二区域内的指纹条数，确定所述第一方位为所述第一扭曲方向。
上述三种方式仅是举例，而非限定，其它的用于确定扭曲指纹所指示的第一扭曲方向的方式也是可行的。无论何种方式，电子设备确定出扭曲指纹指示的第一扭曲方向之后，基于第一扭曲方向操作电子设备，方便用户操作，提升用户体验。
第二方面，还提供一种电子设备，包括：一个或多个处理器；存储器；多个应用程序；以及一个或多个计算机程序，其中所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧执行如下步骤：
检测第一指纹图像，所述第一指纹图像上包含指纹形状发生扭曲的第一扭曲指纹；
确定所述第一扭曲指纹所指示的第一扭曲方向；所述第一扭曲方向用于指示用户手指接触所述指纹传感器时的扭动方向；
基于所述第一扭曲方向，操作所述电子设备。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：
判断所述电子设备当前的使用场景是否为无需使用指纹进行认证的非指纹认证场景；
若确定所述当前的使用场景为非指纹认证场景，确定所述第一扭曲指纹所指示的第一扭曲方向。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系 统侧还执行如下步骤：
若确定所述当前的使用场景为需要进行指纹认证的指纹认证场景，将所述第一指纹图像与预存的指纹图像进行匹配；
若所述第一指纹图像与预存的指纹图像进行匹配成功，确定认证通过；
若所述第一指纹图像与预存的指纹图像进行匹配失败，确定认证不通过。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：
等待预设时长之后，检测到第二指纹图像；
若所述第二指纹图像内包括第二扭曲指纹，且所述第二扭曲指纹所指示的第二扭曲方向与所述第一扭曲方向一致，基于所述第一扭曲方向操作电子设备。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：在所述预设时长达到之前，确定用户手指与所述指纹传感器持续接触。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：在所述预设时长达到之前，确定用户手指与指纹传感器持续接触，且接触位置不变。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：
所述电子设备确定当前显示界面内包括光标时，按照所述第一扭曲方向调整所述光标的位置；或者，
所述电子设备确定当前显示界面为游戏界面时，按照所述第一扭曲方向调整所述游戏界面中的游戏人物的位置；或者，
所述电子设备确定当前显示界面内包括3D图像时，按照所述第一扭曲方向调整所述3D图像内3D模型的旋转方向。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：基于所述第一扭曲方向控制显示界面的翻阅、电影快进或快退、显示屏亮度变化或音量变化。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：确定用户手指停止接触所述指纹传感器，或者，确定用户手指持续接触所述指纹传感器，并检测到第三指纹图像，且所述第三指纹图像中包括指纹形状未发生扭曲的正常指纹，停止操作电子设备。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：确定所述第一扭曲指纹上的第一特征点，并确定与所述第一扭曲指纹相匹配的正常指纹上与所述第一特征点对应的第二特征点；所述第一扭曲指纹和所述正常指纹在同一坐标系中；所述第二特征点相对于所述第一特征点的方向用于指示所述第一扭曲方向。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：
确定所述第一扭曲指纹上纹理间隔大于预设间隔第一区域，以及纹理间隔小于所述预设间隔的第二区域，所述第二区域与所述第一区域内的纹理平行；
所述第二区域内纹理的第一法线方向为所述第一扭曲方向，所述第一法线方向指向所述第一区域。
在一种可能的设计中，当所述指令被所述电子设备执行时，使得所述电子设备中的系统侧还执行如下步骤：
确定所述第一扭曲指纹上的第一区域和第二区域，所述第一区域相对于所述第一扭曲指纹上漩涡的第一方位与所述第二区域相对于所述漩涡的第二方位相反；
若所述第一区域中的指纹条数大于所述第二区域内的指纹条数，确定所述第一方位为所述第一扭曲方向。
第三方面，还提供一种电子设备，包括：执行上述第一方面或第一方面的任意一种可能的设计的方法的模块/单元；这些模块/单元可以通过硬件实现，也可以通过硬件执行相应的软件实现。
第四方面，还提供一种芯片，所述芯片与电子设备中的存储器耦合，使得所述芯片在运行时调用所述存储器中存储的程序指令，实现如上述第一方面提供的方法。
第五方面，还提供一种计算机可读存储介质，所述计算机可读存储介质包括计算机程序，当计算机程序在电子设备上运行时，使得所述电子设备执行如上述第一方面提供的方法。
第六方面，还提供一种计算机程序产品，包括指令，当所述指令在计算机上运行时，使得所述计算机及执行如上述第一方面提供的方法。
以上第二方面到第六方面的有益效果，请参考第一方面的有益效果，不再赘述。
附图说明
图1为本申请一实施例提供的正常指纹与扭曲指纹的示意图；
图2A为本申请一实施例提供的电子设备的硬件结构示意图；
图2B为本申请一实施例提供的电子设备的软件结构示意图；
图3为本申请一实施例提供的基于扭曲指纹的触控方法的流程示意图；
图4为本申请一实施例提供的电子设备上指纹传感器设置位置的示意图；
图5为本申请一实施例提供的正常指纹形状与扭曲指纹形状的示意图；
图6为本申请一实施例提供的指纹图像上特征点的示意图；
图7为本申请一实施例提供的第二特征点向第一特征点的指示方向的示意图；
图8为本申请一实施例提供的正常指纹对应的第一网格、扭曲指纹对应的第二网格的示意图；
图9为本申请一实施例提供的不同扭曲指纹对应的网格的示意图；
图10为本申请一实施例提供的扭曲指纹所指示的扭曲方向的示意图；
图11为本申请一实施例提供的TP检测的电容信号的示意图；
图12-图15为本申请一实施例提供的电子设备的显示界面的示意图；
图16为本申请一实施例提供的电子设备的结构的示意图。
具体实施方式
下面将结合本申请以下实施例中的附图，对本申请实施例中的技术方案进行详尽描述。
以下，先对本申请实施例中涉及的部分用语进行解释说明，以便于本领域技术人员容易理解。
1)、正常指纹，可以理解为指纹形状未发生扭曲的指纹。参见图1中的(a)所示，通常用户手指正对指纹传感器按压时，指纹传感器采集到的指纹图像上包括正常指纹。通常，正常指纹上纹理分布较为均匀，比如，参见图1中的(a)，指纹漩涡处于纹理中相对居中的位置。
2)、扭曲指纹，可以理解为指纹形状发生扭曲的指纹。参见图1中的(b)所示，用户手指倾斜着按压指纹传感器或者在用户手指在指纹传感器上向某个方向搓动时，指纹传感器采集的指纹图像上包括扭曲指纹。通常，扭曲指纹上纹理分布不均匀，比如，指纹漩涡处于不在纹理中间位置，例如图1中的(b)中，指纹漩涡在指纹图像右下角。
本申请实施例涉及的至少一个，包括一个或者多个；其中，多个是指大于或者等于两个。另外，需要理解的是，在本申请的描述中，“第一”、“第二”等词汇，仅用于区分描述的目的，而不能理解为指示或暗示相对重要性，也不能理解为指示或暗示顺序。
本申请实施例提供的基于扭曲指纹的触控方法可以适用于任何具有指纹传感器的电子设备，诸如手机、平板电脑、笔记本电脑、穿戴设备(例如手环、手表、头盔、耳机等)、车载设备、智能家居设备等。以笔记本电脑为例，指纹传感器可以设置于触摸板。以手机为例，指纹传感器可以设置在手机上的任意位置，例如手机上与显示屏所在平面相对的一面(即背面)，或者设置在显示屏中(简称，屏下指纹传感器)；或者设置在手机侧面等等。手机可以是全面屏手机、曲面屏手机、折叠手机等等，本申请实施例不作限定。
示例性的，图2A示出了电子设备100的结构示意图。如图2A所示，电子设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。其中，控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。
USB接口130是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口130可以用于连接充电器为电子设备100充电，也可以用于电子设备100与外围设备之间传输数据。充电管理模块140用于从充电器接收充电输入。电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理 模块141接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，外部存储器，显示屏194，摄像头193，和无线通信模块160等供电。
电子设备100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块150可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中，移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。
在一些实施例中，电子设备100的天线1和移动通信模块150耦合，天线2和无线通信模块160耦合，使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system，GPS)，全球导航卫星系统(global navigation satellite system，GLONASS)，北斗卫星导航系统(beidou navigation satellite system，BDS)，准天顶卫星系统(quasi-zenith satellite system，QZSS)和/或星基增强系统(satellite based augmentation systems，SBAS)。
显示屏194用于显示应用的显示界面，例如相机应用的取景界面等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，电子设备100可以包括1个或N个 显示屏194，N为大于1的正整数。
电子设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，电子设备100可以包括1个或N个摄像头193，N为大于1的正整数。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当电子设备100在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样，电子设备100可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，从而执行电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，以及至少一个应用程序(例如爱奇艺应用，微信应用等)的软件代码等。存储数据区可存储电子设备100使用过程中所产生的数据(例如拍摄的图像、录制的视频等)等。此外，内部存储器121可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备的存储能力。外部存储卡通过外部存储器接口120与处理器110通信，实现数据存储功能。例如将图片，视频等文件保存在外部存储卡中。
电子设备100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
其中，传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。
压力传感器180A用于感受压力信号，可以将压力信号转换成电信号。在一些实施例中，压力传感器180A可以设置于显示屏194。陀螺仪传感器180B可以用于确定电子设备100的运动姿态。在一些实施例中，可以通过陀螺仪传感器180B确定电子设备100围绕三个轴(即，x，y和z轴)的角速度。
陀螺仪传感器180B可以用于拍摄防抖。气压传感器180C用于测量气压。在一些实施例中，电子设备100通过气压传感器180C测得的气压值计算海拔高度，辅助定位和导航。磁传感器180D包括霍尔传感器。电子设备100可以利用磁传感器180D检测翻盖皮套的开合。在一些实施例中，当电子设备100是翻盖机时，电子设备100可以根据磁传感器180D检测翻盖的开合。进而根据检测到的皮套的开合状态或翻盖的开合状态，设置翻盖自动解锁等特性。加速度传感器180E可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。还可以用于识别电子设备100姿态，应用于横竖屏切换，计步器等应用。
距离传感器180F，用于测量距离。电子设备100可以通过红外或激光测量距离。在一些实施例中，拍摄场景，电子设备100可以利用距离传感器180F测距以实现快速对焦。接近光传感器180G可以包括例如发光二极管(LED)和光检测器，例如光电二极管。发光二极管可以是红外发光二极管。电子设备100通过发光二极管向外发射红外光。电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时，可以确定电子设备100附近有物体。当检测到不充分的反射光时，电子设备100可以确定电子设备100附近没有物体。电子设备100可以利用接近光传感器180G检测用户手持电子设备100贴近耳朵通话，以便自动熄灭屏幕达到省电的目的。接近光传感器180G也可用于皮套模式，口袋模式自动解锁与锁屏。
环境光传感器180L用于感知环境光亮度。电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合，检测电子设备100是否在口袋里，以防误触。
指纹传感器180H用于采集指纹图像。电子设备100可以利用采集的指纹图像实现指纹解锁，访问应用锁，指纹拍照，指纹接听来电等功能。例如，指纹传感器180H采集到指纹图像之后，将所述指纹图像发送给处理器110进行处理。例如，处理器110从内部存储器121中读取预存的指纹图像，然后将指纹传感器180H采集的指纹图像与所述预存的指纹图像比对，若一致，则指纹认证通过，若不一致，则指纹认证不通过。
在一些实施例中，指纹传感器180H采集到第一指纹图像，并将第一指纹图像发送给处理110。处理器110可以识别第一指纹图像中扭曲指纹所指示的第一扭曲方向，基于该第一扭曲方向操作电子设备100。例如，处理器110响应于所述第一扭曲方向实现对显示屏中光标的控制(例如位置移动)、电子书翻页、电影快进/快退等。
温度传感器180J用于检测温度。在一些实施例中，电子设备100利用温度传感器180J检测的温度，执行温度处理策略。例如，当温度传感器180J上报的温度超过阈值，电子设备100执行降低位于温度传感器180J附近的处理器的性能，以便降低功耗实施热保护。在另一些实施例中，当温度低于另一阈值时，电子设备100对电池142加热，以避免低温导致电子设备100异常关机。在其他一些实施例中，当温度低于又一阈值时，电子设备100对电池142的输出电压执行升压，以避免低温导致的异常关机。
触摸传感器180K，也称“触控面板”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器180K也可以设置于电子设备100的表面，与显示屏194所处的位置不同。
骨传导传感器180M可以获取振动信号。在一些实施例中，骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏，接收血压跳动信号。
按键190包括开机键，音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入，产生与电子设备100的用户设置以及功能控制有关的键信号输入。马达191可以产生振动提示。马达191可以用于来电振动提示，也可以用于触摸振动反馈。例如，作用于不同应用(例如拍照，音频播放等)的触摸操作，可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。指示器192可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195，或从SIM卡接口195拔出，实现与电子设备100的接触和分离。
可以理解的是，图2A所示的部件并不构成对电子设备100的具体限定，电子设备100还可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。此外，图2A中的部件之间的组合/连接关系也是可以调整修改的。
图2B示出了本申请一实施例提供的电子设备的软件结构框图。如图2B所示，电子设备的软件结构可以是分层架构，例如可以将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android系统分为四层，从上至下分别为应用程序层，应用程序框架层(framework，FWK)，安卓运行时(Android runtime)和系统库，以及内核层。
应用程序层可以包括一系列应用程序包。如图2B所示，应用程序层可以包括相机、设置、皮肤模块、用户界面(user interface，UI)、三方应用程序等。其中，三方应用程序可以包括微信、QQ、图库，日历，通话，地图，导航，WLAN，蓝牙，音乐，视频，短信息等。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层可以包括一些预先定义的函数。如图2B所示，应用程序框架层可以包括窗口管理器，内容提供器，视图系统，电话管理器，资源管理器，通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供电子设备的通信功能。例如通话状态的管理(包括接通，挂断等)。
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，电子设备振动，指示灯闪烁等。
Android runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是安卓的核心库。应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(media libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。
表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。
三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
此外，系统库还可以包括图像处理库，用于对图像进行处理，以实现摇、移、升、降的拍摄效果。
内核层是硬件和软件之间的层。内核层至少包含显示驱动，摄像头驱动，音频驱动，传感器驱动。
硬件层可以包括各类传感器，例如本申请实施例中涉及的加速度传感器、陀螺仪传感器、触摸传感器等。
下面结合本申请实施例的，示例性说明电子设备的软件以及硬件的工作流程。
指纹传感器180H采集到第一指纹图像，产生相应的硬件中断，该硬件中断被发给内核层，经由内核层发送给系统库。系统库识别第一指纹图像中扭曲指纹所指示的第一扭曲方向，将识别出的第一扭曲方向发送给应用程序层中当前运行的应用。所述当前运行的应用例如为电子设备显示屏中正在显示的应用(简称前台应用)。假设当前运行应用为word应用，显示屏上显示word应用的显示界面，该显示界面中包括光标。再假设第一扭曲方向为向左，所述当前运行的应用响应于所述第一扭曲方向，将光标向左移动等等。
图3示出了本申请一实施例提供的基于扭曲指纹的触控方法的流程示意图。如图3所示，该方法的流程包括：
301，电子设备检测到第一指纹图像。
电子设备中包括指纹传感器，用于检测指纹图像。指纹传感器在电子设备上的位置本申请实施例不作限定。例如，参见图4中的(a)，指纹传感器设置于home按键所在位置。或者，参见图4中的(b)，指纹传感器设置于显示屏内的全部或部分区域(即屏下指纹传感器)。或者，参见图4中的(c)，指纹传感器设置在电子设备侧边上。或者，参见图4 中的(d)，指纹传感器设置在电子设备背面(与显示屏相对的一面)，等等。用户手指接触指纹传感器时，指纹传感器检测到第一指纹图像。
302，电子设备判断当前场景是指纹认证场景还是非指纹认证场景。若当前场景属于非指纹验证场景，执行303；若当前场景处于指纹认证场景，对所述第一指纹图像进行指纹认证。这里提到的指纹认证场景可以理解为需要指纹认证的场景。非指纹认证场景可以理解为不需要进行指纹认证的场景。例如，指纹认证场景可以包括指纹解锁场景、指纹支付场景等等。除去指纹认证场景之外的其它场景即非指纹认证场景。
电子设备可以通过当前的状态(例如是否锁屏状态)、显示界面等判断当前场景属于指纹认证场景还是非指纹认证场景。例如，电子设备确定当前处于锁屏状态，则确定当前场景为指纹认证场景。再例如，电子设备确定当前显示界面中包括提示信息，该提示信息用于提示用户输入指纹进行解锁、支付等，确定当前场景为指纹认证场景。当电子设备确定当前场景不属于指纹认证场景时，确定属于非指纹认证场景。
也就是说，在本申请实施例中，电子设备检测到第一指纹图像之后，若确定当前场景是非指纹认证场景，则进行执行后续处理。若确定当前场景是指纹认证场景，则对第一指纹图像进行指纹认证(即身份认证)。其中，对第一指纹图像进行指纹认证的过程包括将第一指纹图像和预存的指纹图像进行匹配，若匹配成功，确定认证通过，若匹配失败，确定认证不通过。
303，电子设备判断所述第一指纹图像中的指纹是扭曲指纹还是正常指纹，所述扭曲指纹可以理解为指纹形状发生扭曲的指纹；所述正常指纹可以理解为指纹形状未发生扭曲的指纹；关于扭曲指纹和正常指纹的介绍参见前文，在此不重复赘述。若第一指纹图像中包括扭曲指纹，执行304，若第一指纹图像中包括正常指纹，可以不作响应。可以理解的是，当前场景是非指纹认证场景的情况下，若第一指纹图像中包括正常指纹，可能是用户误触指纹传感器，所以可以不作响应。若第一指纹图中包括扭曲指纹，可能是用户期望通过扭曲指纹触控电子设备，所以电子设备继续执行304。
示例性的，电子设备可以通过第一指纹图像中的指纹形状是第一指纹图像上包括正常指纹还是扭曲指纹。
作为一种示例，指纹形状可以理解为指纹图像上指纹的边缘轮廓所围成的区域的形状。电子设备中可以存储的正常指纹形状，将第一指纹图像上的指纹的边缘轮廓所围成的形状与存储的正常指纹形状比较，若一致，则确定第一指纹图像上的指纹是正常指纹，否则为扭曲指纹。以图1中的正常指纹为例，其对应的正常指纹形状请参见图5中的(a)中虚线所围成的形状。以图1中扭曲指纹为例，其对应的指纹形状请参见图5中的(b)中虚线所围成的形状。电子设备确定第一指纹图像上指纹的边缘轮廓所围成的形状，将该形状与存储的正常指纹形状比较，若不一致，则确定第一指纹图像上包括扭曲指纹。
作为另一些示例，指纹形状还可以包括指纹上纹理的分布情况，例如漩涡位置。如前文所述，正常指纹上漩涡位于纹理中间位置。因此，电子设备还可以判断第一指纹图像上的指纹漩涡是否处于纹理中间位置，若是在，则确定第一指纹图像上包括正常指纹，若否，则判断第一指纹图像上包括扭曲指纹。假设第一指纹图像是图1中的(b)所示的指纹图像，电子设备确定指纹漩涡处于纹理右下角位置，确定第一指纹图像上包括扭曲指纹。
以上是电子设备通过指纹形状判断第一指纹图像上是正常指纹还是扭曲指纹的两种示例，其它的方式也是可行的，本申请实施例不再一一列举。
可以理解的是，上述电子设备通过指纹形状判断第一指纹图像上包括正常指纹还是扭曲指纹的过程可以由机器学习算法实现，所述机器学习算法例如分类算法，所述分类算法例如支持向量机(support vector machine，SVM)分类器。所述分类算法是可以经过训练的，能够确定出满足条件的正常指纹(例如指纹形状与正常指纹形状一致的指纹)，则输出分类结果为正常指纹；能够确定出不满足条件的扭曲指纹(例如指纹形状与正常指纹形状不一致的指纹)，则输出结果为扭曲指纹。当然，除去所述分类器之外，还可以使用其它机器学习算法例如卷积神经网络算法来区分，本申请实施例不作限定。
304，确定所述扭曲指纹所指示的第一扭曲方向。所述第一扭曲方向用于指示用户手指接触指纹传感器时的扭动(或称为搓动)方向。如前文关于图1的描述，用户手指在指纹传感器上向某个方向搓动时，指纹传感器采集到扭曲指纹。因此，电子设备通过识别扭曲指纹所指示的第一扭曲方向，识别用户意图即用户手指意图扭动的扭动方向，进而根据该扭动方向操作电子设备。
其中，电子设备确定所述扭曲指纹所指示的第一扭曲方向的方式有多种，包括但不限定于如下方式1-方式4。
方式1：
电子设备中存储有一个或多个正常指纹图像。电子设备可以判断存储的一个或多个正常指纹图像中是否存在与所述第一指纹图像相匹配的正常指纹图像。若存在，可以根据所述第一指纹图像以及与所述第一指纹图像相匹配的正常指纹图像确定第一指纹图像中的扭曲指纹所指示的第一扭曲方向。上述的电子设备在存储的正常指纹图像中确定与第一指纹图像相匹配的正常指纹图像的过程，也可以理解为对第一指纹图像的指纹认证过程。若存在与第一指纹图像相匹配的正常指纹图像，即认证通过，根据所述第一指纹图像以及与所述第一指纹图像相匹配的正常指纹图像确定第一指纹图像中的扭曲指纹所指示的第一扭曲方向。若不存在与第一指纹图像相匹配的正常指纹图像，即认证不通过，无法确定扭曲指纹所指示的第一扭曲方向。也就是说，方式1中，只有指纹认证通过的用户可以通过基于本申请实施例提供的扭曲指纹的触控方式来操作电子设备，一定程度上有助于提升电子设备的安全性。
以下实施例介绍电子设备根据所述第一指纹图像以及与所述第一指纹图像相匹配的正常指纹图像确定第一指纹图像中的扭曲指纹所指示的第一扭曲方向的过程。
具体而言，电子设备可以先统一所述第一指纹图像以及相匹配的正常指纹图像的坐标系，使得第一指纹图像和所述正常指纹图像在同一坐标系中。然后，电子设备确定所述第一指纹图像上的扭曲指纹上的第一特征点，并确定正常指纹图像上与所述第一特征点对应的第二特征点。这里提到的特征点也可以称为细节点。通常，指纹由于其唯一性可用作用户身份。所述唯一性可以理解为不同手指的指纹上的特征点不同，即指纹上的特征点可用于唯一标识用户，可以理解为用户的特定属性。换句话说，同一手指产生的两张指纹图像上存在相同的特征点，两个不同手指各自产生一张指纹图像，这两张指纹图像上通常不存在相同的特征点。
示例性的，特征点例如可以是指纹上的末梢点、分叉点、毛刺、疤痕、汗孔等等，本申请实施例不作限定。参见图6所示，为本申请实施例提供的各个特征点的示意图。如图6所示，末梢点可以理解为纹理的端点。分叉点可以理解为一条纹理分叉成两条纹理的分叉点。汗孔可以理解为一条纹理上的中断点或者说一条纹理上的空白点。疤痕是指纹图像 上较为明显的纹理中断部分。
由于扭曲指纹的形状发生扭曲变化，所以扭曲指纹上的第一特征点相对于正常指纹图像上第二特征点发生偏移。电子设备确定第一特征点相对于所述第二特征点的方向，或者也可以理解为，第二特征点指向第一特征点的方向向量，该方向即所述第一扭曲方向。参见图7中的(a)和(b)所示，为扭曲指纹图像上第一特征点与正常指纹图像上第二特征点的示意图，其中，第一特征点与第二特征点对应。当扭曲指纹图像和正常指纹图像位于同一坐标系时，第二特征点指向第一特征点的方向向量如图7中的(c)所示，该方向向量为第一扭曲方向。
应当理解的是，上述第一特征点可以是一个特征点，也可以是多个特征点。若是多个特征点，那么对应的第二特征点也可以是多个，即第一特征点相对于第二特征点的方向可能有多个，可以取所述多个方向之和为所述第一扭曲方向。可以理解的是，当第一特征点是多个特征点时，有助于提升确定的第一扭曲方向的准确性。
在另一些实施例中，电子设备可以根据正常指纹图像确定第一指纹图像的扭曲场，该扭曲场用于指示的所述第一扭曲方向。以下实施例介绍电子设备确定扭曲指纹的扭曲场的过程。
图8中的(a)示出了正常指纹图像对应的第一网格。第一网格是电子设备建立的覆盖正常指纹图像上所有特征点，且未发生扭曲的正方形网格。其中，第一网格可以在第一坐标系x-o-y中建立，第一坐标系可以是任意的坐标系。第一网格中的网格数量、网格大小本申请实施例不作限定。电子设备识别正常指纹图像上的一个或多个特征点(简称第二特征点)，并确定所述一个或多个特征点在第一网格中的第一位置并进行标记，例如，特征点在第一网格中的第几行第几列的方格中。以图8中的(a)为例，电子设备识别出5个特征点，以及每个特征点在第一网格中的位置。例如，特征点1在第一网格中的第5行第5列的方格中。
电子设备将第一指纹图像进行坐标转换为上述第一坐标系x-o-y中。电子设备识别第一指纹图像中与正常指纹图像上的第二特征点对应的第一特征点。电子设备绘制用于覆盖第一指纹图像上所有特征点的、与所述第一网格对应的第二网格。其中，第一指纹图像上第二特征点在第二网格中的第二方格与第一特征点在第一网格中的第一方格对应。图8中的(b)示出第一指纹图像对应的第二网格的示意图，该第二网格即第一指纹图像对应的扭曲场。
继续以图8中的(a)为例，假设正常指纹图像上的第二特征点是图中的特征点1。正常指纹图像上特征点1在第一网格中的第5行第5列的方格中。参见图8中的(b)所示，第一指纹图像上与特征点1对应的特征点2仍然位于第二网格中的第5行第5列的方格中，但是由于第一指纹图像上特征点2相对于特征点1位置发生偏移，第二网格中的第5行第5列的方格相对于第一网格中的第5行第5列的方格的位置发生偏移。因此，对比图8中的(a)和图8中的(b)可知，第二网格发生扭曲。第二网格即第一指纹图像对应的扭曲场。电子设备可以确定扭曲场所指示的第一扭曲方向，也可以理解为第二网格相对于第一网格的扭曲方向。例如，电子设备可以确定第一网格中每个方格指向第二网格中与所述每个方格对应的方格的方向，例如，第一网格中第一行第一列的方格指向第二网格中第一行第一列的方格，第一网格中第一行第二列的方格指向第二网格中第二行第二列的方格的方向，以此类推。因此，电子设备可以得到多个方向，然后取多个方向之和为所述第一扭曲 方向。
为了方便理解，图9示出了用户手指向左扭曲或向右扭曲时产生的指纹图像以及对应的扭曲场的示意图。图9中的(a)中，用户手指接触指纹传感器(图9中用户手指的指甲盖朝向外)。指纹传感器采集到正常指纹图像，电子设备确定正常指纹图像对应的第一网格。图9中的(b)中，用户手指向右扭曲(也可以称为搓动或扭动等)时，电子设备采集到第一指纹图像，第一指纹图像中包括扭曲指纹。电子设备识别该第一指纹图像对应的第二网格。电子设备确定第二网格相对于第一网格的扭曲方向为向左扭曲。因此，电子设备可以判断出用户手指向右扭动。图9中的(c)中，用户手指向左扭曲时，电子设备采集到另一个指纹图像，其中包括扭曲指纹。电子设备识别所述另一个指纹图像对应的第三网格。电子设备确定第三网格相对于第一网格的扭曲方向为向右扭曲。因此，电子设备可以判断出用户手指向左扭动。
方式2
通常，用户手指倾斜着按压指纹传感器时，倾斜方向上用户手指力度较大，纹理被拉伸导致纹理之间的间隔增大，与倾斜方向相对的方向上的纹理被挤压导致纹理之间的间隔缩小。因此，电子设备可以通过第一指纹图像上扭曲指纹的纹理之间的间隔确定扭曲指纹所指示的第一扭曲方向。具体而言，电子设备确定所述扭曲指纹上纹理间隔大于预设间隔第一区域，以及纹理间隔小于所述预设间隔的第二区域，所述第二区域与所述第一区域内的纹理平行；所述预设间隔的具体取值可以是预先设置的，也可以是第一指纹图像上的平均间隔，本申请实施例不作限定。示例性的，参见图10所示，第一区域内的纹理与第二区域内的纹理平行，这里所谓的平行可以是近似平行(或者称为不完全平行)。第一区域内的纹理间隔较大(例如大于前述预设间隔)，第二区域内的纹理间隔较小(例如小于前述预设间隔)。电子设备确定第二区域内的纹理的、朝向第一区域的第一法线方向(图7中箭头方向)为所述第一扭曲方向。
方式3
通常，用户手指倾斜着按压指纹传感器时，指纹传感器采集的指纹图像上纹理不完整。例如，假设用户手指向左倾斜按压指纹传感器，手指左侧区域(例如指纹漩涡中心的左侧区域)接触指纹传感器，右侧区域(例如指纹漩涡中心的右侧区域)可能不接触指纹传感器或接触区域较少；因此指纹传感器采集的指纹图像上指纹不完整，例如不包含手指漩涡中心右侧区域的纹理或者手指漩涡中心右侧区域的纹理数量较少。因此，电子设备可以通过扭曲指纹上不同区域的纹理数量(或称纹理条数)判断扭曲指纹所指示的第一扭曲方向。具体而言，电子设备确定所述扭曲指纹上相对于指纹漩涡中心方位相反的第一区域和第二区域；若所述第一区域中的指纹数量大于所述第二区域内的指纹数量，确定所述第一方位为所述第一扭曲方向。继续以图1中的(b)为例，扭曲指纹上相对于漩涡中心的左上方区域内的纹理较多，右下方区域内的纹理较少，则确定第一扭曲方向为向左上。
可以理解的是，不同于上述方式1的是，方式2和方式3中电子设备无需事先存储用户的正常指纹图像，也可以确定第一指纹图像中的扭曲指纹所指示的第一扭曲方向。以上仅是示例性的列举三种确定扭曲指纹指示的扭曲方向的示例，其它的方式也是可行的，本申请实施例不作限定。
方式4
电子设备具备触摸屏(touch pad，TP)，以电容式触摸屏为例。用户接触触摸屏时， 触摸屏产生第一电容信号。第一电容信号中包括用户手指与触摸屏接触点的电容信号。在用户手指未抬起，且发生扭动的情况下，TP产生第二电容信号。第二电容信号包括用户手指扭动之后，与触摸屏接触点的电容信号。电子设备通过比较第一电容信号和第二电容信号，判断用户接触点的变化情况，进而判断用户意图即用户手指扭动方向。示例性的，图11中的(a)示出第一电容信号的示意图。第一电容信号包括电容信号为1的4*6的矩阵，表征该矩阵内是用户手指与触摸屏的接触点。图11中的(b)示出第二电容信号的示意图。第二电容信号包括电容信号为1的4*4矩阵。也就是说，用户手指与触摸屏的接触点由4*6的矩阵变为4*4矩阵的矩阵，其中第二电容信号相对于第一电容信号缺少靠下两行的电容信号，所以，电子设备确定用户手指向上扭动。
上述方式4中，电子设备上触摸屏可以判断用户手指的扭动方向，无需指纹传感器。在一些实施例中，电子设备可以将方式1-方式3中的任一种方式与方式4结合使用。以屏下指纹传感器为例，用户手指接触触摸屏时，屏下指纹传感器用于检测到指纹图像，触摸屏用于检测电容信号。电子设备通过指纹图像得到一个扭曲方向，通过电容信号得到另一个扭曲方向。若通过指纹图像得到的扭曲方向与通过电容信号得到的扭曲方向一致，基于所述扭曲方向操作电子设备，有助于以提升对电子设备触控操作的准确性。
在一些实施例中，电子设备默认采用上述方式2或方式3确定第一扭曲方向。当电子设备确定已启动安全操作功能之后，使用方式1，即先进行指纹认证，认证通过之后再确定第一扭曲方向。其中，所述“启动安全操作功能”可以是电子设备判断用于指示安全操作功能的控件是否被激活，若是，则确定已启动安全操作功能，若否，则确定未启动安全操作功能。所述控件可以在电子设备中设置应用中提供，或者其它快捷方式提供，本申请实施例不作限定。
305，电子设备基于所述第一扭曲方向，操作电子设备。
在一些实施例中，电子设备确定第一扭曲方向之后，可以立即执行305。在另一些实施例中，为了防止误触，电子设备确定第一扭曲方向之后，等待预设时长，预设时长达到之后，再次采集第二指纹图像，若所述第二指纹图像内也包括扭曲指纹，且所述扭曲指纹所指示的第二扭曲方向与所述第一扭曲方向一致，基于所述第一扭曲方向操作电子设备。所述预设时长可以是事先设置好，并存储在电子设备中的，本申请实施例不作限定。
可选的，所述预设时长到达之前，电子设备还可以确定用户手指与所述指纹传感器持续接触。以屏下指纹传感器为例，触摸屏检测到用户手指持续接触触摸屏，即确定用户手指与指纹传感器持续接触。也就是说，用户手指持续接触指纹传感器的过程中，指纹传感器采集的第一指纹图像和第二指纹图像所指示的扭曲方向一致，则基于所述扭曲方向操作电子设备，有助于避免用户手指误触指纹传感器而导致对电子设备的控制。
或者，所述预设时长到达之前，电子设备还可以确定用户手指与指纹传感器持续接触，且接触位置不变。以屏下指纹传感器为例，触摸屏可以检测用户手指与触摸屏的接触位置，若预设时长内所述接触位置不变，则确定用户手指与指纹传感器接触位置不变。这里提到的接触位置不变可以理解为触摸屏每次检测到的接触区域有重叠即可。例如，在第一时刻触摸屏检测到接触区域S1，在第二时刻检测到接触面积S2，S1和S2有部分区域重叠即确定接触位置不变。也就是说，用户手指持续接触指纹传感器的过程中，无需挪动手指位置或者说无需大幅度挪动手指位置，只需小幅度搓动手指，即可产生扭曲指纹，电子设备基于扭曲指纹指示的扭曲方向操作电子设备，操作便捷，尤其便于对大屏电子设备的操作。
电子设备处于不同的场景时，基于第一扭曲方向操作电子设备的方式可以不同。因此，电子设备可以确定当前的场景，在该场景下，基于第一扭曲方向使用适合当前场景的操作方式操作电子设备。以下实施例给出所述场景的几种示例。
示例1：电子设备的显示屏上包括光标。电子设备可以按照第一扭曲方向移动所述光标的位置。例如，第一扭曲方向为向左，则向左移动光标。具体而言，光标可以每次移动预设距离，该预设距离可以是事先设置好存储在电子设备中的。
上述电子设备的显示屏上包括光标的情况可以有多种。图12中的(a)示出电子设备的一种GUI的示意图。所述GUI可以理解为主界面，其中包括光标(图中的箭头)。用户手指接触指纹传感器(例如屏下指纹传感器)，指纹传感器采集第一指纹图像，第一指纹图像如图12中的(a)中的指纹。电子设备判断第一指纹图像所指示的第一扭曲方向，基于该第一扭曲方向控制所述光标移动位置。
图12中的(b)示出电子设备的一种GUI的示意图。所述GUI可以理解为电子设备中文档编辑界面，例如word、备忘录等。GUI中包括光标(图中的“说明书”文字间的竖线)。用户手指接触指纹传感器(例如屏下指纹传感器)，指纹传感器采集第一指纹图像，第一指纹图像例如图12中的(b)中的指纹。电子设备判断第一指纹图像中包括第一扭曲指纹，并判断该第一扭曲指纹指示的第一扭曲方向，基于该第一扭曲方向控制所述光标移动位置。假设第一扭曲方向为向左扭曲，则将光标向左移动，例如从虚线位置移动到实线位置。
在一些实施例中，电子设备可以设置光标触摸模式和无光标触控模式。以图12中的(a)为例，若在光标触摸模式下，电子设备的显示屏中包括光标。若在无光标触摸模式下，显示屏中不包括光标。示例性的，电子设备可以提供用于设置光标触摸模式或无光标触控模式的入口，例如，在设置应用中提供。当电子设备进入光标触摸模式时，显示的界面中包括光标(即图12中的(a)中的箭头)。
示例2：电子设备运行游戏应用，显示屏上显示游戏应用的游戏界面，所述游戏界面中包括游戏人物。电子设备可以按照第一扭曲方向移动游戏人物的位置。例如，第一扭曲方向为向左，则向左移动游戏人物。具体而言，游戏人物可以每次移动预设距离，该预设距离可以是事先设置好存储在电子设备中的。
示例3：电子设备的显示屏上显示3D图像。3D图像中包括可旋转的3D模型(或者称为3D物体)。在一些实施例中，第一扭曲方向包括但不限定于向上，下，左，右，左上，右上，左下，右下等。电子设备按照所述第一扭曲方向旋转所述3D模型。举例来说，参见图13中的(a)所示，假设所述第一扭曲方向为向左，则将3D模型以图中虚线轴为中心轴顺时针旋转，旋转角度可以是预设角度，即事先设置好的角度。所述虚线轴可以是3D模型的中心轴。参见图13中的(b)所示，假设所述第一扭曲方向为向上，则将3D模型以图中虚线轴为中心轴顺时针旋转预设角度。因此，本申请实施例中，用户手指接触指纹传感器后搓动手指，扭曲发生扭曲，电子设备基于扭曲指纹旋转3D模型，方便用户查看3D模型的正视图、俯视图、仰视图等等，操作便捷。
在另一些实施例中，电子设备的显示屏上显示3D图像时，若电子设备检测用户手指指尖接触显示屏，且用户指尖在显示屏上旋转时，可以将3D模型以显示屏所在的平面的中垂线为轴旋转预设角度。示例性的，参见图14中的(a)和图14中的(b)所示，用户指尖与显示屏接触，假设用户指尖在显示屏上逆时针旋转时，将3D图像以显示屏所在的平面的中垂线(图中虚线)为轴逆时针轴旋转预设角度。其中，以屏下指纹传感器为例， 电子设备检测用户指尖与显示屏接触的方式可以是，指纹传感器检测到指纹图像，所述指纹图像中指纹的纹理数小于阈值，和/或，TP检测到用户手指与显示屏的接触面积小于预设面积，这里的预设面积可以是事先设置好的取值。电子设备判断用户指尖在显示屏上旋转的方式可以包括：电子设备判断用户手指与触摸屏的接触面的变化情况，若电子设备下一时刻检测到的接触面相对于上一时刻检测到的接触面顺时针旋转，则将3D图像以与显示屏所在的平面的中垂线为轴顺时针旋转预设角度。若电子设备下一时刻检测到的接触面相对于上一时刻检测到的接触面逆时针旋转，则将3D图像以与显示屏所在的平面的中垂线为轴逆时针旋转预设角度。
应理解，除去上述示例1-示例3所示的场景之外，本申请实施例提供的基于扭曲指纹的触控方法还可以适用于其它场景。例如，电子设备基于扭曲指纹指示的第一扭曲方向控制显示界面的翻阅；例如，参见图15中的(a)所示，电子设备根据指纹传感器检测到的指纹实现主界面到负一屏的翻阅，或者电子书相邻页码的翻阅，或者，相册应用中不同图像的翻阅，等等。
再例如，参见图15中的(b)所示，电子设备基于扭曲指纹指示的第一扭曲方法控制电影快进或快退，例如，电子设备的显示界面显示电影播放界面，若第一扭曲方向为向左，则控制电影快退，第一扭曲方向为向右，控制电影快进。
再例如，参见图15中的(c)所示，电子设备基于扭曲指纹指示的第一扭曲方向控制显示屏亮度或音量的变化；若第一扭曲方向为向上，增加显示屏亮度或音量，若第一扭曲方向为向下，降低显示屏亮度或音量，等等。
可以理解的是，指纹传感器可以实时的、不断地采集指纹图像。也就是说，在图3所示的实施例中的第一指纹图像之后，指纹传感器继续采集到第二指纹图像。其中，针对每次采集的图像指纹可以执行一次图3所示的流程。或者，电子设备采集到第一指纹图像之后，若确定用户手指持续接触指纹传感器，则在检测到用户手指抬起之前采集的其它指纹图像无需再经过指纹认证场景或非指纹认证场景的判断过程。电子设备可以继续基于第二指纹图像中包括的扭曲指纹所指示的第二扭曲方向操作电子设备。因此，本申请实施例中，用户接触指纹传感器的过程中，手指向不同方向小幅度搓动，导致指纹传感器检测到的包含不同扭曲方向的指纹图像，基于所述扭曲方向操作电子设备。也就是说，用户手指无需大幅度移动也可操控电子设备，操作便捷，尤其是针对大屏电子设备。
当电子设备确定用户手指抬起不接触指纹传感器时，可以停止操作电子设备。例如，指纹传感器以一定的周期不断地采集的指纹图像，当某个周期到达但未采集到指纹图像时，确定用户手指抬起不接触指纹传感器。再例如，以屏下指纹传感器为例，TP检测到用户手指抬起不接触触摸屏时，确定用户手指抬起不接触指纹传感器。
或者，用户手指持续接触指纹传感器的过程中，指纹传感器周期性的不断采集指纹图像，在第一指纹图像之后的某个时刻采集到包含正常指纹的第三指纹图像(或者，持续一定时长内采集到包含正常指纹的指纹图像)，则停止操作电子设备。也就是说，用户手指向某个方向倾斜着按压指纹传感器(指纹传感器采集到扭曲指纹)时，采集到包含扭曲指纹的指纹图像，操作电子设备，用户手指不抬起，但手指恢复正常按压状态(指纹传感器采集到正常指纹)时，停止操作电子设备。
本申请的各个实施方式可以任意进行组合，以实现不同的技术效果。
上述本申请提供的实施例中，从电子设备(比如手机)作为执行主体的角度对本申请 实施例提供的方法进行了介绍。为了实现上述本申请实施例提供的方法中的各功能，电子设备可以包括硬件结构和/或软件模块，以硬件结构、软件模块、或硬件结构加软件模块的形式来实现上述各功能。上述各功能中的某个功能以硬件结构、软件模块、还是硬件结构加软件模块的方式来执行，取决于技术方案的特定应用和设计约束条件。
如图16所示，本申请另外一些实施例公开了一种电子设备，该电子设备比如为手机、ipad等该电子设备可以包括：触摸屏1601，其中，所述触摸屏1601包括触敏表面16906和显示屏1607；一个或多个处理器1602；多个应用程序1608；指纹传感器1609；上述各器件可以通过一个或多个通信总线1605连接。所述显示屏1607可以用于显示主界面，或者多个应用程序1608中的某个应用程序的显示界面比如相机的界面(即取景界面)，还可以用于显示电子设备拍摄的图像等。所述指纹传感器1609用于采集指纹图像。
其中，所述一个或多个计算机程序1604被存储在上述存储器1603中并被配置为被该一个或多个处理器1602执行，该一个或多个计算机程序1604包括指令，上述指令可以用于执行如图3及相应实施例中的各个步骤。
当图16所示的电子设备是图2A所示的电子设备100时，触摸屏1601可以是上述显示屏194；处理器1602可以是处理器110；指纹传感器1609可以是指纹传感器180H；存储器1603可以是内部存储器121。
需要说明的是，本申请实施例中对单元的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。本发明实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。例如，上述实施例中，第一获取单元和第二获取单元可以是同一个单元，也不同的单元。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
以上实施例中所使用的术语只是为了描述特定实施例的目的，而并非旨在作为对本申请的限制。如在本申请的说明书和所附权利要求书中所使用的那样，单数表达形式“一个”、“一种”、“所述”、“上述”、“该”和“这一”旨在也包括例如“一个或多个”这种表达形式，除非其上下文中明确地有相反指示。还应当理解，在本申请实施例中，“一个或多个”是指一个、两个或两个以上；“和/或”，描述关联对象的关联关系，表示可以存在三种关系；例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B的情况，其中A、B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。
在本说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此，在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例，而是意味着“一个或多个但不是所有的实施例”，除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”，除非是以其他方式另外特别强调。
以上实施例中所用，根据上下文，术语“当…时”或“当…后”可以被解释为意思是“如果…”或“在…后”或“响应于确定…”或“响应于检测到…”。类似地，根据上下文，短语“在确定…时”或“如果检测到(所陈述的条件或事件)”可以被解释为意思是“如果确定…”或“响应于确定…”或“在检测到(所陈述的条件或事件)时”或“响应于检测到(所陈述的条件或事件)”。另外，在上述实施例中，使用诸如第一、第二之类的关系术语来区份一个实体和另一个实体，而并不限制这些实体之间的任何实际的关系和顺序。
在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本发明实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。
需要指出的是，本专利申请文件的一部分包含受著作权保护的内容。除了对专利局的专利文件或记录的专利文档内容制作副本以外，著作权人保留著作权。

Claims (21)

  1. 一种基于扭曲指纹的触控方法，其特征在于，应用于电子设备，所述方法包括：
    所述电子设备检测第一指纹图像，所述第一指纹图像上包含指纹形状发生扭曲的第一扭曲指纹；
    确定所述第一扭曲指纹指示第一扭曲方向；所述第一扭曲方向用于指示用户手指接触所述指纹传感器时的扭动方向；
    基于所述第一扭曲方向，操作所述电子设备。
  2. 如权利要求1所述的方法，其特征在于，在所述确定所述第一扭曲指纹指示第一扭曲方向之前，还包括：
    判断所述电子设备当前的使用场景是否为无需使用指纹认证的非指纹认证场景；
    确定所述第一扭曲指纹指示第一扭曲方向，包括：
    若确定所述当前的使用场景为非指纹认证场景，确定所述第一扭曲指纹指示第一扭曲方向。
  3. 如权利要求2所述的方法，其特征在于，所述方法还包括：
    若确定所述当前的使用场景为需要指纹认证的指纹认证场景，将所述第一指纹图像与预存的指纹图像进行匹配；
    若所述第一指纹图像与预存的指纹图像进行匹配成功，确定认证通过；
    若所述第一指纹图像与预存的指纹图像进行匹配失败，确定认证不通过。
  4. 如权利要求1-3任一所述的方法，其特征在于，在所述基于所述第一扭曲方向，操作所述电子设备之前，还包括：
    所述电子设备等待预设时长之后，检测到第二指纹图像；
    所述基于所述第一扭曲方向，操作所述电子设备，包括：
    若所述第二指纹图像内包括第二扭曲指纹，且所述第二扭曲指纹指示第二扭曲方向与所述第一扭曲方向一致，所述电子设备基于所述第一扭曲方向操作所述电子设备。
  5. 如权利要求1-4任一所述的方法，其特征在于，所述基于所述第一扭曲方向，操作所述电子设备，包括：
    所述电子设备确定当前显示界面内包括光标时，按照所述第一扭曲方向调整所述光标的位置；或者，
    所述电子设备确定当前显示界面为游戏界面时，按照所述第一扭曲方向调整所述游戏界面中的游戏人物的位置；或者，
    所述电子设备确定当前显示界面内包括3D图像时，按照所述第一扭曲方向调整所述3D图像内3D模型的旋转方向。
  6. 如权利要求1-5任一所述的方法，其特征在于，所述基于所述第一扭曲方向，操作所述电子设备，包括：基于所述第一扭曲方向，对所述电子设备进行如下至少一种操作：
    控制显示界面的翻阅、电影快进或快退、显示屏亮度变化或音量变化。
  7. 如权利要求1-6任一所述的方法，其特征在于，所述方法还包括：
    所述电子设备确定用户手指停止接触所述指纹传感器，或者，确定用户手指持续接触所述指纹传感器，并检测到第三指纹图像，且所述第三指纹图像中包括指纹形状未发生扭曲的正常指纹，停止对所述电子设备的操作。
  8. 如权利要求1-7任一所述的方法，其特征在于，所述确定所述第一扭曲指纹指示第一扭曲方向，包括：
    确定所述第一扭曲指纹上的第一特征点，并确定与所述第一扭曲指纹相匹配的正常指纹上与所述第一特征点对应的第二特征点；所述第一扭曲指纹和所述正常指纹在同一坐标系中；
    确定所述第二特征点相对于所述第一特征点的方向为所述第一扭曲方向。
  9. 如权利要求1-7任一所述的方法，其特征在于，所述确定所述第一扭曲指纹指示第一扭曲方向，包括：
    确定所述第一扭曲指纹上纹理间隔大于预设间隔第一区域，以及纹理间隔小于所述预设间隔的第二区域，所述第二区域与所述第一区域内的纹理平行；
    确定所述第二区域内纹理的第一法线方向为所述第一扭曲方向，所述第一法线方向指向所述第一区域。
  10. 如权利要求1-7任一所述的方法，其特征在于，所述确定所述第一扭曲指纹指示第一扭曲方向，包括：
    确定所述第一扭曲指纹上的第一区域和第二区域，所述第一区域相对于所述第一扭曲指纹上漩涡的第一方位与所述第二区域相对于所述漩涡的第二方位相反；
    若所述第一区域中的指纹条数大于所述第二区域内的指纹条数，确定所述第一方位为所述第一扭曲方向。
  11. 一种电子设备，其特征在于，包括：
    一个或多个处理器；
    存储器；
    多个应用程序；
    以及一个或多个计算机程序，其中所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述电子设备执行时，使得所述电子设备执行如下步骤：
    检测第一指纹图像，所述第一指纹图像上包含指纹形状发生扭曲的第一扭曲指纹；
    确定所述第一扭曲指纹指示第一扭曲方向；所述第一扭曲方向用于指示用户手指接触所述指纹传感器时的扭动方向；
    基于所述第一扭曲方向，操作所述电子设备。
  12. 如权利要求11所述的电子设备，其特征在于，当所述指令被所述电子设备执行时，使得所述电子设备具体执行如下步骤：
    判断所述电子设备当前的使用场景是否为无需使用指纹认证的非指纹认证场景；
    若确定所述当前的使用场景为非指纹认证场景，确定所述第一扭曲指纹指示第一扭曲方向。
  13. 如权利要求12所述的电子设备，其特征在于，当所述指令被所述电子设备执行时，使得所述电子设备还执行如下步骤：
    若确定所述当前的使用场景为需要指纹认证的指纹认证场景，将所述第一指纹图像与预存的指纹图像进行匹配；
    若所述第一指纹图像与预存的指纹图像进行匹配成功，确定认证通过；
    若所述第一指纹图像与预存的指纹图像进行匹配失败，确定认证不通过。
  14. 如权利要求11-13任一所述的电子设备，其特征在于，当所述指令被所述电子设备执行时，使得所述电子设备具体执行如下步骤：
    等待预设时长之后，检测到第二指纹图像；
    若所述第二指纹图像内包括第二扭曲指纹，且所述第二扭曲指纹指示第二扭曲方向与所述第一扭曲方向一致，所述电子设备基于所述第一扭曲方向操作所述电子设备。
  15. 如权利要求11-14任一所述的电子设备，其特征在于，当所述指令被所述电子设备执行时，使得所述电子设备执行如下步骤：
    确定当前显示界面内包括光标时，按照所述第一扭曲方向调整所述光标的位置；或者，
    确定当前显示界面为游戏界面时，按照所述第一扭曲方向调整所述游戏界面中的游戏人物的位置；或者，
    确定当前显示界面内包括3D图像时，按照所述第一扭曲方向调整所述3D图像内3D模型的旋转方向。
  16. 如权利要求11-15任一所述的电子设备，其特征在于，当所述指令被所述电子设备执行时，使得所述电子设备执行如下步骤：
    基于所述第一扭曲方向，对所述电子设备进行如下至少一种操作：
    控制显示界面的翻阅、电影快进或快退、显示屏亮度变化或音量变化。
  17. 如权利要求11-16任一所述的电子设备，其特征在于，当所述指令被所述电子设备执行时，使得所述电子设备执行如下步骤：
    确定用户手指停止接触所述指纹传感器，或者，确定用户手指持续接触所述指纹传感器，并检测到第三指纹图像，且所述第三指纹图像中包括指纹形状未发生扭曲的正常指纹，停止对所述电子设备的操作。
  18. 如权利要求11-17任一所述的电子设备，其特征在于，当所述指令被所述电子设备执行时，使得所述电子设备执行如下步骤：
    确定所述第一扭曲指纹上的第一特征点，并确定与所述第一扭曲指纹相匹配的正常指纹上与所述第一特征点对应的第二特征点；所述第一扭曲指纹和所述正常指纹在同一坐标系中；
    确定所述第二特征点相对于所述第一特征点的方向为所述第一扭曲方向。
  19. 如权利要求11-17任一所述的电子设备，其特征在于，当所述指令被所述电子设备执行时，使得所述电子设备执行如下步骤：
    确定所述第一扭曲指纹上纹理间隔大于预设间隔第一区域，以及纹理间隔小于所述预设间隔的第二区域，所述第二区域与所述第一区域内的纹理平行；
    确定所述第二区域内纹理的第一法线方向为所述第一扭曲方向，所述第一法线方向指向所述第一区域。
  20. 如权利要求11-17任一所述的电子设备，其特征在于，当所述指令被所述电子设备执行时，使得所述电子设备执行如下步骤：
    确定所述第一扭曲指纹上的第一区域和第二区域，所述第一区域相对于所述第一扭曲指纹上漩涡的第一方位与所述第二区域相对于所述漩涡的第二方位相反；
    若所述第一区域中的指纹条数大于所述第二区域内的指纹条数，确定所述第一方位为所述第一扭曲方向。
  21. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质包括计算机程 序，当计算机程序在电子设备上运行时，使得所述电子设备执行如权利要求1-10任一所述的方法。
PCT/CN2020/131280 2020-01-31 2020-11-25 一种基于扭曲指纹的触控方法与电子设备 WO2021151341A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010077752.3A CN113204308B (zh) 2020-01-31 2020-01-31 一种基于扭曲指纹的触控方法与电子设备
CN202010077752.3 2020-01-31

Publications (1)

Publication Number Publication Date
WO2021151341A1 true WO2021151341A1 (zh) 2021-08-05

Family

ID=77024903

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/131280 WO2021151341A1 (zh) 2020-01-31 2020-11-25 一种基于扭曲指纹的触控方法与电子设备

Country Status (2)

Country Link
CN (1) CN113204308B (zh)
WO (1) WO2021151341A1 (zh)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130133033A1 (en) * 2011-11-23 2013-05-23 Marc E. Davis Behavioral fingerprint controlled automatic task determination
CN105718778A (zh) * 2016-01-20 2016-06-29 深圳市金立通信设备有限公司 一种终端界面的控制方法及终端
CN106022065A (zh) * 2016-05-30 2016-10-12 维沃移动通信有限公司 一种移动终端及其控制方法
CN106095295A (zh) * 2016-06-15 2016-11-09 维沃移动通信有限公司 一种基于指纹识别的处理方法和移动终端
CN106774859A (zh) * 2016-11-29 2017-05-31 努比亚技术有限公司 移动终端及其控制方法
CN107734150A (zh) * 2017-09-25 2018-02-23 珠海市魅族科技有限公司 一种终端控制方法、装置、终端及介质
CN111404565A (zh) * 2020-03-12 2020-07-10 西安极蜂天下信息科技有限公司 对讲机控制方法及装置
CN111752452A (zh) * 2020-06-22 2020-10-09 北京小米移动软件有限公司 一种模式切换控制装置、方法及终端设备

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103020610A (zh) * 2012-12-31 2013-04-03 清华大学 扭曲指纹的自动检测方法
CN105224139A (zh) * 2015-10-30 2016-01-06 深圳市汇顶科技股份有限公司 触控设备和在触控设备上进行指纹检测的方法
CN105791696B (zh) * 2016-04-05 2019-03-01 Oppo广东移动通信有限公司 一种移动终端的指纹拍照方法、装置及移动终端
KR102698759B1 (ko) * 2016-09-02 2024-08-26 삼성디스플레이 주식회사 터치 패널 및 이를 포함하는 표시 장치

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130133033A1 (en) * 2011-11-23 2013-05-23 Marc E. Davis Behavioral fingerprint controlled automatic task determination
CN105718778A (zh) * 2016-01-20 2016-06-29 深圳市金立通信设备有限公司 一种终端界面的控制方法及终端
CN106022065A (zh) * 2016-05-30 2016-10-12 维沃移动通信有限公司 一种移动终端及其控制方法
CN106095295A (zh) * 2016-06-15 2016-11-09 维沃移动通信有限公司 一种基于指纹识别的处理方法和移动终端
CN106774859A (zh) * 2016-11-29 2017-05-31 努比亚技术有限公司 移动终端及其控制方法
CN107734150A (zh) * 2017-09-25 2018-02-23 珠海市魅族科技有限公司 一种终端控制方法、装置、终端及介质
CN111404565A (zh) * 2020-03-12 2020-07-10 西安极蜂天下信息科技有限公司 对讲机控制方法及装置
CN111752452A (zh) * 2020-06-22 2020-10-09 北京小米移动软件有限公司 一种模式切换控制装置、方法及终端设备

Also Published As

Publication number Publication date
CN113204308A (zh) 2021-08-03
CN113204308B (zh) 2022-10-18

Similar Documents

Publication Publication Date Title
WO2021129326A1 (zh) 一种屏幕显示方法及电子设备
WO2021013158A1 (zh) 显示方法及相关装置
JP7391102B2 (ja) ジェスチャ処理方法およびデバイス
WO2020182065A1 (zh) 快捷功能启动的方法及电子设备
EP3848786B1 (en) Display control method for system navigation bar, graphical user interface, and electronic device
WO2021000881A1 (zh) 一种分屏方法及电子设备
WO2021213164A1 (zh) 应用界面交互方法、电子设备和计算机可读存储介质
WO2020134869A1 (zh) 电子设备的操作方法和电子设备
WO2021063098A1 (zh) 一种触摸屏的响应方法及电子设备
WO2021017901A1 (zh) 一种屏幕显示方法及电子设备
WO2021082564A1 (zh) 一种操作提示的方法和电子设备
WO2021037223A1 (zh) 一种触控方法与电子设备
EP3982239A1 (en) Input method and electronic device
AU2018456082B2 (en) Stylus detection method, system, and related device
WO2021078032A1 (zh) 用户界面的显示方法及电子设备
EP3958106B1 (en) Interface display method and electronic device
US20230195309A1 (en) Method and apparatus for adjusting memory configuration parameter
WO2021190524A1 (zh) 截屏处理的方法、图形用户接口及终端
WO2021238370A1 (zh) 显示控制方法、电子设备和计算机可读存储介质
WO2021082815A1 (zh) 一种显示要素的显示方法和电子设备
WO2022037726A1 (zh) 分屏显示方法和电子设备
WO2021000943A1 (zh) 一种指纹开关的管理方法及装置
WO2021057699A1 (zh) 具有柔性屏幕的电子设备的控制方法及电子设备
EP4024839A1 (en) Operation method and electronic device
CN111381996A (zh) 内存异常处理方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20916286

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20916286

Country of ref document: EP

Kind code of ref document: A1