CN109669651B - Display method of user interface and electronic device - Google Patents

Display method of user interface and electronic device Download PDF

Info

Publication number
CN109669651B
CN109669651B CN201810349409.2A CN201810349409A CN109669651B CN 109669651 B CN109669651 B CN 109669651B CN 201810349409 A CN201810349409 A CN 201810349409A CN 109669651 B CN109669651 B CN 109669651B
Authority
CN
China
Prior art keywords
image
swipe
processor
feature points
fingerprint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810349409.2A
Other languages
Chinese (zh)
Other versions
CN109669651A (en
Inventor
江元麟
吕俊超
许献仁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Egis Technology Inc
Original Assignee
Egis Technology Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Egis Technology Inc filed Critical Egis Technology Inc
Priority to US16/105,987 priority Critical patent/US10713463B2/en
Priority to PCT/CN2018/110264 priority patent/WO2019076272A1/en
Priority to GB1914055.7A priority patent/GB2574973B/en
Priority to JP2019551393A priority patent/JP6836662B2/en
Priority to GB2117618.5A priority patent/GB2599288B/en
Priority to US16/360,017 priority patent/US10755068B2/en
Publication of CN109669651A publication Critical patent/CN109669651A/en
Application granted granted Critical
Publication of CN109669651B publication Critical patent/CN109669651B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1335Combining adjacent partial images (e.g. slices) to create a composite input or reference pattern; Tracking a sweeping finger movement
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1347Preprocessing; Feature extraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/50Maintenance of biometric data or enrolment thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/60Static or dynamic means for assisting the user to position a body part for biometric acquisition
    • G06V40/67Static or dynamic means for assisting the user to position a body part for biometric acquisition by interactive indications to the user

Abstract

The invention provides a display method of a user interface and an electronic device. The display method of the user interface is suitable for fingerprint registration. The display method comprises the following steps: sensing an object by a fingerprint sensor to obtain a swipe image of the object; analyzing the sliding brush image to obtain a plurality of characteristic points of the sliding brush image; generating a pre-registration data set according to the swipe image; analyzing the pre-registered data set to obtain image adjustment parameters; and displaying the user interface, and adjusting a range of a completion area of the reference image in the user interface according to the image adjustment parameter. Therefore, the display method of the user interface and the electronic device of the invention can enable the user to know the corresponding fingerprint registration progress through the display of the electronic device in the process of fingerprint registration in a sliding brush mode.

Description

Display method of user interface and electronic device
Technical Field
The present invention relates to an interface display technology, and more particularly, to a display method of a user interface suitable for fingerprint registration and an electronic device using the same.
Background
In recent years, fingerprint identification technology is widely applied to various electronic devices to provide various identity registration or identity verification functions. However, the general fingerprint recognition technology registers a fingerprint by pressing a finger against a fingerprint sensor with one-time pressing or multiple pressing, and provides a corresponding user interface to inform the user of the progress of fingerprint registration. For example, if a fingerprint is registered in a multi-press manner, each time the user presses one time, the corresponding fingerprint image displayed on the user interface is increased until the entire or sufficiently large range of fingerprints is displayed, indicating that the fingerprint registration is completed.
However, if the user registers the fingerprint by swiping the finger, the conventional fingerprint identification related art cannot correspondingly display the fingerprint image on the user interface according to the swiping progress of the finger of the user to inform the user of the fingerprint registration progress. That is, during the process of swiping a finger to perform fingerprint registration, the user cannot know the progress of fingerprint registration in real time.
Disclosure of Invention
The invention provides a display method of a user interface and an electronic device, which can enable a user to know the corresponding fingerprint registration progress through a display of the electronic device in the process of fingerprint registration in a sliding brush mode.
The display method of the user interface is suitable for fingerprint registration. The display method comprises the following steps: acquiring a sliding brush image through a fingerprint sensor; analyzing the sliding brush image to obtain a plurality of characteristic points of the sliding brush image; judging whether the slide brush image is the first slide brush image; if the swipe image is the first swipe image, generating a pre-registration data set according to the plurality of feature points of the swipe image, and analyzing the pre-registration data set to obtain a basic image parameter; and displaying the completion area on a reference image in the user interface according to the basic image parameter.
The display method of the user interface is suitable for fingerprint registration. The display method comprises the following steps: acquiring a sliding brush image through a fingerprint sensor; analyzing the sliding brush image to obtain a plurality of characteristic points of the sliding brush image and coordinate parameters of the characteristic points positioned at the leftmost upper corner of the sliding brush image; judging whether the slide brush image is the first slide brush image; if the swipe image is the first swipe image, generating a pre-registration data set according to the plurality of feature points of the swipe image; and displaying the finished area on a reference image in the user interface according to the coordinate parameter and the area of the swipe image.
An electronic device of the present invention includes a fingerprint sensor, a processor, and a display. The fingerprint sensor is used for acquiring a sliding brush image. The processor is coupled to the fingerprint sensor. The processor is used for analyzing the sliding brush image to obtain a plurality of characteristic points of the sliding brush image and judging whether the sliding brush image is the first sliding brush image. A display is coupled to the processor. If the processor judges that the swipe image is the first swipe image, the processor generates a pre-registration data set according to the feature points of the swipe image, and analyzes the pre-registration data set to obtain the basic image parameters. The processor displays the completion area on a reference image in the user interface through the display according to the base image parameter.
An electronic device of the present invention includes a fingerprint sensor, a processor, and a display. The fingerprint sensor is used for acquiring a sliding brush image. The processor is coupled to the fingerprint sensor. The processor is used for analyzing the sliding brush image and obtaining the coordinate parameters of the feature points positioned at the leftmost upper corner of the sliding brush image. The processor is further configured to determine whether the swipe image is a first swipe image. A display is coupled to the processor. And if the processor judges that the slide-brushing image is the first slide-brushing image, generating a pre-registration data set according to the characteristic points of the slide-brushing image. The processor displays the completion area on a reference image in the user interface according to the coordinate parameter and the area of the swipe image.
Based on the above, the method for displaying the user interface and the electronic device of the present invention can obtain the corresponding image adjustment parameters by analyzing the plurality of swipe images obtained during the fingerprint registration process, and can present the range change of the completion area of the reference image in the user interface according to the image adjustment parameters to provide the real-time information of the fingerprint registration progress of the user.
In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanied with figures are described in detail below.
Drawings
FIG. 1 is a schematic diagram of an electronic device according to an embodiment of the invention;
FIG. 2 is a flow diagram of a method of fingerprint enrollment in accordance with an embodiment of the present invention;
FIG. 3 is a flow chart of a fingerprint enrollment method according to a first embodiment of the present invention;
FIG. 4 is a schematic diagram of a pre-registration data set in accordance with a first embodiment of the present invention;
FIGS. 5A-5E are schematic diagrams of finger actions and corresponding user interface displays according to a first embodiment of the present invention;
FIG. 6 is a flow chart of a fingerprint enrollment method according to a second embodiment of the present invention;
FIG. 7 is a schematic diagram of a pre-registration data set in accordance with a second embodiment of the present invention;
FIGS. 8A-8G are schematic diagrams of finger movements and corresponding user interface displays according to a second embodiment of the present invention;
FIG. 9 is a flowchart of a fingerprint registration method according to a third embodiment of the present invention;
FIG. 10 is a schematic diagram of a pre-registration data set in accordance with a third embodiment of the present invention;
11A-11I are schematic diagrams of finger actions and corresponding user interface displays according to a third embodiment of the invention.
The reference numbers illustrate:
100: an electronic device;
110: a processor;
120: a fingerprint sensor;
130: a memory;
140: a display;
410. 420, 400, 710, 720, 730, 1010, 1020, 1030: an image;
411. 711, 1011: feature points;
500. 800 and 1100: a user interface;
510. 810 and 1110: a reference image;
511. 811, 811b, 1111: a completion area;
DW1, DW 2: a width;
f: a finger;
h. h, W: image parameters;
step: adjusting parameters of the image;
S210、S220、S225、S230、S232、S235、S240、S245、S250、
s310, S320, S331, S332, S333, S334, S340, S341, S350, S380, S610, S620, S631, S633, S632, S634, S640, S641, S650, S680, S910, S920, S922, S924, S925, S926, S940, S980: a step of;
(X1, Y1), (X2, Y2), (Xn, Yn): coordinate parameters;
(Δ x, Δ y): and (4) displacement parameters.
Detailed Description
In order that the present disclosure may be more readily understood, the following specific examples are given as illustrative of the invention which may be practiced in various ways. Further, wherever possible, the same reference numbers will be used throughout the drawings and the description to refer to the same or like parts.
Fig. 1 is a schematic diagram of an electronic device according to an embodiment of the invention. Referring to fig. 1, the electronic device 100 includes a processor 110, a fingerprint sensor 120, a memory 130, and a display 140. The processor 110 is coupled to the fingerprint sensor 120, the memory 130, and the display 140. The electronic device 100 may be an electronic product such as a smart phone (smart phone), a Notebook (NB), a tablet PC (tablet PC), and the like. In the present embodiment, the electronic device 100 performs a fingerprint sensing operation through the fingerprint sensor 120 to acquire a fingerprint image (image) of a user. In the present embodiment, when a user puts a finger on the fingerprint sensor 120 to perform a swiping (swiping) operation, the fingerprint sensor 120 performs fingerprint sensing. The fingerprint sensor 120 continuously acquires a plurality of swipe images and provides the images to the processor 110. The processor 110 analyzes the swipe images to extract a plurality of feature points (feature points) from each swipe image, wherein the feature points are fingerprint feature points of the finger. The processor 110 then generates fingerprint registration data based on the feature point data.
In the embodiment, the fingerprint sensor 120 obtains the swipe images one by one, and during the process of analyzing the swipe images one by the processor 110, the processor 110 correspondingly changes a finishing area of the fingerprint reference image included in a User Interface (UI) displayed on the display 140 according to an analysis result of the swipe images obtained one by one. In this embodiment, the reference image in the user interface includes a completion area. The finishing area of the reference image is used to represent the coverage of the acquired fingerprint information, and the range change of the finishing area of the reference image is gradually increased and changed corresponding to the current progress of the user's swipe (i.e. the progress of acquiring the fingerprint information). Therefore, the fingerprint registration function of the electronic device 100 of the present invention provides a good interaction effect, so that the user can know the current registration progress.
In the embodiment, the Processor 110 is, for example, a Central Processing Unit (CPU), a System On Chip (SOC), or other Programmable general purpose or special purpose microprocessor (microprocessor), a Digital Signal Processor (DSP), a Programmable controller, an Application Specific Integrated Circuit (ASIC), a Programmable Logic Device (PLD), other similar Processing devices, or a combination thereof.
In the present embodiment, the fingerprint sensor 120 is, for example, a capacitive fingerprint sensor or an optical fingerprint sensor, and the present invention is not limited to the type of the fingerprint sensor 120. In the present embodiment, the fingerprint sensing mechanism of the fingerprint sensor 120 may be sliding (swiping) sensing or pressing (pressing) sensing. It is noted that the fingerprint registration according to the embodiments of the present invention is performed by sliding type sensing. That is, during the fingerprint registration process, the user slides the finger on the sensing surface of the fingerprint sensor 120, and the fingerprint sensor 120 senses and obtains the fingerprint information of the user through the sensing surface. For example, the electronic device 100 may be designed such that the user performs fingerprint registration by sliding a finger, that is, the fingerprint sensor 120 performs fingerprint sensing by sliding sensing, and when performing fingerprint authentication, the user performs fingerprint authentication by pressing a finger, that is, the fingerprint sensor 120 performs fingerprint sensing by pressing sensing.
In the present embodiment, the memory 130 is used to store the fingerprint data according to the embodiments of the present invention, and store the related application program for the processor 110 to read and execute.
In the present embodiment, the Display 140 is, for example, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) Display, a Micro LED (Micro LED) Display, an Organic LED (Organic LED) Display, or the like, and the type of the Display 140 is not limited in the present invention. In the present embodiment, when a user performs fingerprint registration, the display 140 displays a corresponding user interface, and a reference image simulating a fingerprint is included in the user interface. During the process of sliding the finger on the fingerprint sensor 120, the range of the finished area of the reference image displayed on the display 140 changes and increases correspondingly as the fingerprint data sensed by the fingerprint sensor 120 increases.
Fig. 2 is a flowchart of a fingerprint registration method according to an embodiment of the present invention. Referring to fig. 1 and fig. 2, the fingerprint registration method of the present embodiment can be applied to the electronic device 100 of the embodiment of fig. 1. When the user registers a fingerprint, the electronic device 100 performs a swipe fingerprint sensing operation through the fingerprint sensor 120 to obtain swipe images of objects (i.e., the user's fingers) one by one. In step S210, the fingerprint sensor 120 acquires a swipe image. In step S220, the processor 110 analyzes the swipe image to obtain a plurality of feature points of the swipe image. In step S225, the processor 110 determines whether the swipe image is the first swipe image. If yes, go to step S230. In step S230, the processor 110 generates a pre-registration data set according to the feature points of the swipe image, and analyzes and obtains the basic image parameters (h) of the pre-registration data set. In step S232, the processor 110 displays the completed region of the reference image on the user interface according to the basic image parameter (h). If not, go to step S235. In step S235, the processor 110 merges the feature points of the swipe image into the pre-registration data set to generate a merged pre-registration data set. In Step S240, the processor 110 analyzes the merged pre-registered data set to obtain a merged image parameter (H), and obtains an image adjustment parameter (Step ═ H-H) according to the merged image parameter (H) and the base image parameter (H), wherein the image adjustment parameter (Step) is equal to the merged image parameter (H) minus the base image parameter (H). In step S245, the processor 110 uses the merged image parameter (H) as a new basic image parameter (H). In Step S250, the processor 110 increases the range of the completion area of the reference image in the ui according to the image adjustment parameter (Step), i.e. increases the length of the completion area. In order to further understand the display manner of the user interface and the technical details of fingerprint registration, a plurality of embodiments are provided below for detailed description.
Fig. 3 is a flowchart of a fingerprint registration method according to a first embodiment of the present invention. Referring to fig. 1 and fig. 3, the fingerprint registration method of the present embodiment can be applied to the electronic device 100 of the embodiment of fig. 1. When the user performs fingerprint registration, in step S310, the electronic device 100 senses an object (i.e., the finger of the user) through the fingerprint sensor 120 to obtain a swipe image. In step S320, the processor 110 analyzes the swipe image to obtain a plurality of feature points of the swipe image. In step S331, the processor 110 determines whether the swipe image is the first swipe image. If yes, the processor 110 executes step S332. In step S332, the processor 110 generates a pre-registration data set based on the feature points of the swipe image, and obtains the base image parameters (h) of the pre-registration data set. In step S333, the processor 110 displays the completed region of the reference image according to the base image parameter (h). If not, the processor 110 executes step S334. In step S334, the processor 110 merges the feature points of the swipe image into the pre-registration data set to generate a merged pre-registration data set.
In Step S340, the processor 110 analyzes the merged pre-registered data set to obtain a merged image parameter (H), and obtains an image adjustment parameter (Step ═ H-H) according to the merged image parameter (H) and the base image parameter (H), wherein the image adjustment parameter (Step) is equal to the merged image parameter (H) minus the base image parameter (H). In step S341, the processor 110 uses the merged image parameter (H) as a new basic image parameter (H). In Step S350, the processor 110 increases the range of the completion area of the reference image, i.e. increases the length of the completion area, according to the image adjustment parameter (Step). In step S380, the processor 110 determines whether the merged image parameter (H) is greater than a preset threshold. If so, it indicates that sufficient fingerprint registration data has been obtained, the processor 110 terminates the fingerprint sensing operation of the fingerprint sensor 120 and stores the pre-registration data set in the memory 130 as a fingerprint registration data set to complete the fingerprint registration process. If not, the processor 110 executes step S310 to obtain the next swipe image.
Fig. 4 is a schematic diagram of a pre-registration data set according to a first embodiment of the invention. FIGS. 5A-5E are schematic diagrams of finger swipe motions and corresponding user interface displays, in accordance with a first embodiment of the present invention. Referring to fig. 1, fig. 4 and fig. 5A to fig. 5E, the flow of fig. 3 may also be applied to the present embodiment. In the embodiment, after the fingerprint sensor 120 obtains the first swipe image 410 of the finger F, the processor 110 analyzes the swipe image 410 to obtain a plurality of feature points 411 and a basic image parameter h of the swipe image 410. It is noted that the area of the swipe image 410 may be equal to the area of the sensing surface of the fingerprint sensor 120. In the present embodiment, the initial value of the base image parameter h may be the distance between two feature points 411 of the first swipe image 410 that are farthest away in the length direction, but the present invention is not limited thereto. In another embodiment, the initial value of the basic image parameter h may also be the length of the swipe image 410, i.e. the length of the sensing surface of the fingerprint sensor 120. The processor 110 generates a pre-registration data set according to the feature points 411 of the swipe image 410. Then, the processor 110 continues to obtain the next swipe image 420 and obtains the feature points of the swipe image 420. In the present embodiment, the processor 110 merges the feature points of the swipe image 420 into the pre-registration data set (i.e., merges the feature points of the swipe images 410 and 420) to generate a new pre-registration data set 400. The processor 110 calculates the merged image parameters H of the merged pre-registered dataset 400. Similarly, the merged image parameter H may be the distance between two feature points that are farthest away in the length direction after merging the swipe images 410 and 420, or may be the length of the overlapping portion of the swipe images 410 and 420 subtracted from the sum of the lengths of the two swipe images (i.e. twice the length of the sensing surface of the fingerprint sensor 120) after merging the swipe images 410 and 420. Next, the processor 110 subtracts the base image parameter H from the merged image parameter H to obtain an image adjustment parameter Step (═ H-H).
That is, each time the processor 110 incorporates a feature point of a swipe image, the processor 110 calculates the new length of the merged pre-registration data set 400 to adjust the length of the completion area 511 of the reference image 510 in the user interface 500. It is noted that the width DW of the completion area 511 of the reference image 510 is preset and fixed. And each time the feature point data of the swipe image is added, the processor 110 correspondingly increases the length of the completion area 511. In addition, the processor 110 determines whether the merged image parameter H is greater than a predetermined threshold. If yes, it indicates that enough fingerprint registration data has been obtained. For example, when the merged image parameter H is greater than the preset threshold, it indicates that a sufficient number of fingerprint feature points have been acquired. It may also indicate that a sufficient number of swipe images have been taken. Therefore, the processor 110 stores the pre-registration data set in the memory 130 as a fingerprint registration data set to complete the fingerprint registration process.
For example, fig. 5A to 5E are taken as examples. As shown in fig. 5A, when the user places a finger F on the fingerprint sensor 120 of the electronic device 100 and performs a swipe action, the electronic device 100 displays a reference image 510 on the user interface 500 and acquires swipe images one by one. When the first swipe image is obtained, the electronic device 100 displays a corresponding completion area 511 in the reference image 510, wherein the length of the completion area 511 corresponds to the basic image parameter h of the first swipe image. Further, as described above, the width of the finalization area 511 is preset and fixed, and as shown in the drawing, the width of the finalization area 511 may be equal to or greater than the width of the reference image 510. As shown in fig. 5B, when the second swipe image is obtained, the electronic device 100 increases the length of the completing region 511 of the reference image 510 according to the image adjustment parameter Step. As shown, the width of the completion area 511 is fixed. As shown in FIG. 5C, when the user's finger F leaves the fingerprint sensor 120, the length of the area 511 of the reference image 510 stops increasing. However, since sufficient fingerprint information is not obtained yet, i.e. the merged image parameter H is not greater than the predetermined threshold, the fingerprint registration procedure is not completed yet, so the user interface 500 still continues to display the completed area 511 of the reference image 510 and prompts the user to swipe the finger again. Next, as shown in fig. 5D, the finger F of the user is placed on the fingerprint sensor 120 of the electronic device 100 again and performs a swiping motion. The electronic device 100 obtains a new swipe image and continues to increase the length of the completion area 511 of the reference image 510 according to the new swipe image (i.e. the new fingerprint feature point data). Finally, as shown in fig. 5E, when the merged image parameter H is greater than the predetermined threshold, the processor 110 completely covers the reference image 510 with the completion area 511, that is, the length of the completion area 511 is greater than or equal to the length of the reference image 510. Thus, the fingerprint registration process is completed, and the processor 110 stops the fingerprint sensing operation of the fingerprint sensor 120 and generates a fingerprint registration data set from the pre-registration data set to complete the fingerprint registration process.
Fig. 6 is a flowchart of a fingerprint registration method according to a second embodiment of the present invention. Referring to fig. 1 and fig. 6, the fingerprint registration method of the present embodiment can be applied to the electronic device 100 of the embodiment of fig. 1. When the user performs fingerprint registration, in step S610, the electronic device 100 senses an object (i.e., the finger of the user) through the fingerprint sensor 120 to obtain a swipe image. In step S620, the processor 110 analyzes the swipe image to obtain a plurality of feature points of the swipe image. In step S631, the processor 110 determines whether the swipe image is the first swipe image. If yes, the processor 110 executes step S632. In step S632, the processor 110 obtains the coordinate parameters (X, Y) of the feature point located at the top left corner of the swipe image, generates the pre-registration data set according to the feature point of the swipe image, and obtains the base image parameter (h) of the pre-registration data set. In step S633, the processor 110 displays the finished area of the reference image on the display 140 according to the base image parameter (h) and the coordinate parameter (X, Y). If not, the processor 110 executes step S634. In step S634, the processor 110 merges the feature points of the swipe image into the pre-registration data set to generate a merged pre-registration data set.
In Step S640, the processor 110 analyzes the pre-registration data set to obtain a first merged image parameter (H) and a second merged image parameter (W), and obtains an image adjustment parameter (Step H-H) according to the first merged image parameter (H) and the base image parameter (H). The first merged image parameter (H) may be a distance between two feature points that are farthest apart in the longitudinal direction from the feature points merged in the pre-registration data set, or may be a length obtained by subtracting the length of the overlapping portion of the plurality of brush images from the total length of the plurality of brush images. The second merged image parameter (W) is the distance between two feature points that are farthest away in the width direction from the merged feature point. In step S641, the processor 110 uses the first merged image parameter (H) as a new base image parameter (H). In Step S650, the processor 110 increases the range of the finished area of the reference image according to the image adjustment parameter (Step). In step S680, the processor 110 determines whether the first merged image parameter (H) is greater than a first preset threshold, and determines whether the second merged image parameter (W) is greater than a second preset threshold. If so, the processor 110 ends the fingerprint sensing operation of the fingerprint sensor 120 and generates fingerprint registration data according to the merged pre-registration data set to complete the fingerprint registration procedure. If not, the processor 110 executes step S610 to obtain the next swipe image.
Fig. 7 is a schematic diagram of a pre-registration data set according to a second embodiment of the invention. Fig. 8A-8G are schematic diagrams of finger actions and corresponding user interface displays according to a second embodiment of the present invention. Referring to fig. 1, fig. 7, and fig. 8A to fig. 8G, the flow of fig. 6 may also be applied to the present embodiment. In this embodiment, after the fingerprint sensor 120 obtains the first swipe image 710 of the finger F, the processor 110 analyzes the swipe image 710 to obtain a plurality of feature points 711 of the swipe image 710, and obtains the base image parameter h and the coordinate parameters of the feature point located at the top-left corner of the swipe image 710 (X1, Y1). The processor 110 displays the finished area 811 of the reference image 810 according to the coordinate parameters (X1, Y1) and the base image parameter h. It is noted that the area of the swipe image 710 will be equal to the area of the sensing surface of the fingerprint sensor 120. In the present embodiment, the base image parameter h may refer to a distance of two feature points farthest in the length direction among the feature points 711 of the swipe image 710, but the present invention is not limited thereto. In another embodiment, the base image parameter h may also refer to the length of the swipe image 710, i.e., the length of the sensing surface of the fingerprint sensor 120. The processor 110 generates a pre-registration data set according to the feature points 711 of the swipe image 710. Then, the processor 110 continues to obtain the next swipe image 720, and obtains the feature points of the swipe image 720. In the present embodiment, the processor 110 merges the feature points of the swipe image 720 into the pre-registration data set (i.e., merges the feature points of the swipe images 710 and 720) to generate the merged pre-registration data set 700. The processor 110 calculates a first merged image parameter H (i.e. maximum image length) and a second merged image parameter W (i.e. maximum image width) of the merged pre-registered data set 700. The processor 110 subtracts the base image parameter H from the first merged image parameter H to obtain an image adjustment parameter Step. Then, the processor 110 increases the length of the finished area 811 of the reference image 810 according to the image adjustment parameter Step.
That is, after the processor 110 incorporates the feature points of a swipe image, the processor 110 calculates the new length of the merged pre-registration data set 700 to adjust the length of the completion area 811 of the reference image 810 in the user interface 800. It is noted that the width of the finished area 811 of the reference image 810 is preset and fixed for each finger swipe motion. That is, the width of the finished area 811 of the reference image 810 is increased only once per finger swipe. During each finger swiping motion, the processor 110 correspondingly increases the length of the completion area 811 every time the feature point data of the swipe image is added. In addition, the processor 110 merges the plurality of swipe images into the pre-registration data set 700, and the processor 110 determines whether the first merged image parameter H and the second merged image parameter W are greater than the first and second predetermined thresholds, respectively. If yes, it indicates that enough fingerprint registration data has been obtained. For example, when the first merged image parameter H is greater than the first preset threshold and the second merged image parameter W is greater than the second preset threshold, it indicates that a sufficient number of fingerprint feature points have been obtained. It may also indicate that a sufficient number of swipe images have been taken. Therefore, the processor 110 stores the pre-registration data set in the memory 130 as a fingerprint registration data set to complete the fingerprint registration process. If not, the processor 110 may display a prompt on the user interface via the display 140 to ask the user to swipe the finger again. During the second swipe, the processor 110 obtains the first swipe image 730 of the second swipe through the fingerprint sensor 120, and the processor 110 extracts the feature points 711 of the swipe image 730 and incorporates them into the pre-registration data set 700. The processor 110 obtains the displacement parameter (Δ X, Δ Y) according to the coordinate parameters (X1, Y1) of the feature point located at the top left corner of the swipe image 710 (i.e., the first swipe image obtained at the first swipe) and the coordinate parameters (X2, Y2) of the feature point located at the top left corner of the first swipe image 730 obtained at the second swipe (X2-X1 ═ Δ X, Y2-Y1 ═ Δ Y)). The processor 110 determines the width range and the position of the finished area 811 of the reference image 810 of the user interface 800 corresponding to the increased width of the second swiping motion according to the displacement parameters (Δ x, Δ y).
In other words, during the second swipe, the user's finger F is shifted to the right or left, and the processor 110 determines the variation of the width range of the completed region 811 corresponding to the second swipe through the coordinate parameters (X2, Y2) of the feature point at the leftmost position in the first swipe image 730 obtained during the second swipe, i.e., the displacement parameters (Δ X, Δ Y), and determines the length of the completed region 811 corresponding to the new portion 811b of the second swipe according to the basic image parameter h of the first swipe image 730. The processor 110 displays the start position of the portion 811b of the completed area 811 corresponding to the second swipe according to the coordinate parameters (X2, Y2). That is, at the time of the second swipe, the range of the completion area 811 in the width direction increases according to the degree of displacement of the user's finger F. Then, the processor 110 increases the length of the portion 811b of the finished area 811 corresponding to the second swipe according to the later obtained swipe image and the corresponding image adjustment parameter Step. When a swipe image is obtained, the processor 110 determines whether the first merged image parameter H and the second merged image parameter W are greater than the first and second predetermined thresholds, respectively, to determine whether to end the fingerprint registration process.
For example, fig. 8A to 8G are taken as examples. As shown in fig. 8A, when the user presses the finger F on the fingerprint sensor 120 of the electronic device 100 and performs a first swipe action, a corresponding completion area 811 is displayed on the reference image 810 of the user interface 800 to correspond to the first swipe image taken by the fingerprint sensor 120. As shown in fig. 8B and 8C, during the first swiping of the finger F, the length range of the finished area 811 of the reference image 810 is correspondingly adjusted. In addition, during the first swiping of the finger F, the processor 110 increases the length range of the finished area 811 of the reference image 810 according to the image adjustment parameter Step in a manner of fixing the image width. That is, during the first swiping motion of the finger F, the width DW1 of the finished area 811 of the reference image 810 is fixed, and the length thereof is increased after the new swiping image is obtained. As shown in fig. 8D, when the user's finger F leaves the fingerprint sensor 120, the range of the finished area 811 of the reference image 810 will stop increasing. However, since the fingerprint registration is still incomplete, the user interface 800 stays in the reference image 810 and the existing completed area 811, and prompts and requests the user to swipe the finger again. Therefore, as shown in fig. 8E and 8F, the finger of the user presses the fingerprint sensor 120 of the electronic device 100 again and performs the second swipe motion. Compared with the finger placement position during the first sliding, the position of the finger of the user is shifted to the upper right by a distance during the second sliding. After the first image of the second swipe motion is acquired, the processor 110 calculates the coordinate parameters (X2, Y2) of the feature point at the leftmost position, subtracts (X2, Y2) from the coordinate parameters (X1, Y1) of the feature point at the leftmost position in the first image of the swipe obtained at the first swipe motion to obtain the displacement parameters (Δ X, Δ Y) (X2-X1 ═ Δ X, Y2-Y1 ═ Δ Y), and determines the display position of the first image of the second swipe, that is, the start position of the new portion b corresponding to the second swipe in the completion area 811, based on (Δ X, Δ Y). As shown, during the second swiping of the finger, the range of the complete area 811 of the reference image 810 continues to increase (i.e., 811b), wherein the processor 110 determines the start position of the newly increased portion 811b of the complete area 811 according to the displacement parameters (Δ x, Δ y), and increases the length range of the complete area 811 of the reference image 810 corresponding to the second swiping of the portion 811b according to the image adjustment parameter Step in a manner of fixing the image width. That is, during the second swiping motion of the finger F, the width DW2 of the newly added portion 811b of the completed region 811 of the reference image 810 is fixed, and the length thereof is increased after the new swiping image is obtained. Finally, as shown in fig. 8G, when the first merged image parameter H and the second merged image parameter W of the enrollment data set 700 are respectively greater than the first and second predetermined thresholds, the range of the completion area 811 of the reference image 810 is increased to a sufficient length and width, so that the processor 110 stops the fingerprint sensing operation of the fingerprint sensor 120 to complete the fingerprint enrollment process.
Fig. 9 is a flowchart of a fingerprint registration method according to a third embodiment of the present invention. Referring to fig. 1 and fig. 9, the fingerprint registration method of the present embodiment can be applied to the electronic device 100 of the embodiment of fig. 1. When the user performs fingerprint registration, in step S910, the electronic device 100 senses an object (i.e. the finger of the user) by the fingerprint sensor 120 to obtain a swipe image. In step S920, the processor 110 analyzes the swipe image to obtain a plurality of feature points of the swipe image, and obtains coordinate parameters (X, Y) of the feature point located at the uppermost left corner of the swipe image. In step S922, the processor 110 determines whether the swipe image is the first swipe image. If yes, go to step S924. In step S924, the processor 110 generates a pre-registration data set according to the feature points of the swipe image. Next, in step S925, the processor 110 displays a corresponding finished area on the reference image of the ui according to the coordinate parameters (X, Y) and the area of the swipe image. Notably, the area of the swipe image is equivalent to the area of the sensing surface of the fingerprint sensor 120. If not, go to step S926. In step S926, the processor 110 incorporates the feature points of the swipe image into the pre-registration data set. In step S940, the processor 110 increases the range of the completion area according to the coordinate parameters (X, Y) and the area of the swipe image. In step S980, the processor 110 determines whether the total area of the pre-registration data set is greater than a preset threshold. The total area of the pre-registration data set may represent the sum of the areas of all the swipe images minus the area in which the swipe images overlap, or may represent the number of feature points included in the pre-registration data set. In other words, in the embodiment, in step S980, the processor 110 determines whether the number of feature points included in the pre-registration data set is greater than a preset threshold. If so, the processor 110 ends the fingerprint sensing operation of the fingerprint sensor 120 and generates fingerprint registration data according to the merged pre-registration data set to complete the fingerprint registration procedure. If not, the processor 110 executes step S910 to sense and obtain the next swipe image.
Fig. 10 is a diagram illustrating pre-registration data according to a third embodiment of the present invention. FIGS. 11A-11I are schematic diagrams of a finger swipe action and corresponding user interface display according to a third embodiment of the present invention. Please refer to fig. 1, fig. 10, and fig. 11A to fig. 11I in combination. In addition, the flow of fig. 9 may also be applied to this embodiment. In this embodiment, after the fingerprint sensor 120 obtains the first swipe image 1010 of the finger F, the processor 110 analyzes the swipe image 1010 to obtain a plurality of feature points 1011 of the swipe image 1010, and obtains the coordinate parameters (X1, Y1) of the feature points 1011 located at the top-left corner of the swipe image 1010. As shown in fig. 11A, the processor 110 displays a finishing region 1111 of the reference image 1110 in the user interface 1100 according to the coordinate parameters (X1, Y1) and the area of the swipe image 1010 (i.e., the area of the sensing surface of the fingerprint sensor 120). In addition, the processor 110 generates pre-registration data according to the feature points of the swipe image 1010.
Next, the processor 110 obtains and analyzes the next swipe image 1020, and obtains a plurality of feature points 1011 of the swipe image 1020. In the present embodiment, the processor 110 compares the feature points of the sliding brush images 1010 and 1020, finds the feature points included in both the sliding brush images 1010 and 1020 to obtain the relative position relationship between the sliding brush images 1010 and 1020, and obtains the coordinate parameters (X2, Y2) of the feature point located at the leftmost upper corner of the sliding brush image 1020. As shown in FIG. 11B, the processor 110 increases the display range of the finished region 1111 of the reference image 1110 according to the coordinate parameters (X2, Y2) and the area of the slid image 1020. In addition, the processor 110 incorporates the feature points of the swipe image 1020 into the pre-registration data to generate the merged pre-registration data.
That is, each time the processor 110 obtains a swipe image, its feature points are incorporated into the pre-registration data. In addition, the processor 110 obtains the coordinate parameters of the feature point located at the top left corner of the sliding image for determining the increased range and position of the completion area 1111 of the reference image 1110 of the user interface 1100. It is noted that the processor 110 determines whether to terminate fingerprint registration by determining whether the total area of the pre-registration data is larger than a predetermined threshold. If the total area of the pre-registered data is not greater than the predetermined threshold, the processor 110 will sense and obtain the next swipe image. As shown in fig. 10 and 11E to 11F, during the fingerprint registration process, after the user slides the finger for the first time, the finger leaves the fingerprint sensor 120. If sufficient fingerprint data is not obtained, i.e. the total area of the pre-registered data is not greater than the predetermined threshold, the processor 110 displays a prompt on the user interface via the display 140 to ask the user to swipe the finger again. During the second swipe, the processor 110 obtains the first swipe image 1030 of the second swipe, and the processor 110 takes the feature points of the swipe image 1030 and incorporates them into the pre-registered data set, finds the coordinate parameters (Xn, Yn) of the feature point located at the uppermost left corner of the swipe image 1030, and increases the range of the completion area 1111 of the reference image 1110 of the user interface 1100 according to the coordinate parameters (Xn, Yn) and the area of the swipe image 1030.
Specifically, by comparing and analyzing the pre-registered data and the feature points of the swipe image 1030 (i.e. finding the feature points that appear repeatedly), the processor 110 can calculate the relative position relationship between the swipe image 1030 and the previously obtained swipe image, and accordingly obtain the coordinate parameters (Xn, Yn). In other words, the processor 110 corresponds to the display completion area 1111 in the reference image 1110 according to the relative position relationship between the swipe image 1030 and the previously obtained swipe image. Furthermore, the processor 110 determines whether the total area of the new pre-registration data is larger than a predetermined threshold to determine whether to end the fingerprint registration.
For example, fig. 11A to 11I are taken as examples. As shown in FIG. 11A, when the user places a finger F on the fingerprint sensor 120 of the electronic device 100 and performs a swipe action, a finishing area 1111 is displayed on the reference image 1110 of the user interface 1100 to correspond to the swipe image taken via the fingerprint sensor 120. As shown in fig. 11B to 11D, during the process of swiping the finger F, the range of the completion area 1111 of the reference image 1110 is adjusted accordingly. As shown in FIG. 11E, when the user's finger F leaves the fingerprint sensor 120, the extent of the finished area 1111 of the reference image 1110 will stop increasing. However, since fingerprint registration is still incomplete, the user interface 1100 stays in the previous completed area 1111 of the reference image 1110, and prompts and asks the user to swipe the finger again. As shown in fig. 11F to 11H, the finger F of the user is again placed on the fingerprint sensor 120 of the electronic device 100 and performs a swiping motion. The range of the finishing region 1111 of the reference image 1110 is increased continuously according to the user's swiping motion. As shown in fig. 11I, when the total area of the pre-registered data is larger than the predetermined threshold, the processor 110 determines that sufficient fingerprint data has been acquired, and the range of the completion area 1111 of the reference image 1110 is increased to a sufficient area to cover the sufficient range of the reference image 1110. Therefore, the processor 110 stops the fingerprint sensing operation of the fingerprint sensor 120 and generates fingerprint registration data according to the pre-registration data, thereby completing the fingerprint registration process.
In summary, the user interface display method and the electronic device of the present invention can collect a plurality of swipe images obtained by one or more swipe motions of a finger of a user on a fingerprint sensor, and combine feature point data of the swipe images to generate fingerprint registration data. When merging the feature point data of the sliding brush images, the electronic device further analyzes the repeatability and the position relation among the feature points of the sliding brush images to obtain corresponding image parameters and/or coordinate parameters. Therefore, the method for displaying the user interface and the electronic device of the invention can correspondingly display the user interface with the reference image and the completion area thereof on the display according to the image parameter and/or the coordinate parameter, so as to dynamically adjust the range of the completion area of the reference image in the user interface. That is, in the process of swiping a finger for fingerprint registration, the user can know the progress of fingerprint registration through the range change of the completion area of the reference image in the user interface displayed on the display of the electronic device. Therefore, in the process of fingerprint registration by sliding the finger of the user, the display method of the user interface and the electronic device can provide real-time related information of the fingerprint registration progress to the user, thereby providing a more humanized and more convenient fingerprint registration program.
Although the present invention has been described with reference to the above embodiments, it should be understood that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (12)

1. A display method of a user interface, which is suitable for fingerprint registration, is characterized in that the display method comprises the following steps:
acquiring a plurality of swipe images through a fingerprint sensor;
analyzing the plurality of swipe images by a processor to obtain a plurality of feature points of the plurality of swipe images, wherein the feature points correspond to a plurality of fingerprint feature points of a finger;
merging, by the processor, the plurality of feature points of the plurality of swipe images into a pre-registered dataset;
displaying, by the processor, a finished area on a reference image in a user interface of a display according to the plurality of swipe images, wherein the reference image in the user interface includes the finished area, and the finished area of the reference image is used to represent a coverage of the acquired fingerprint information; and
analyzing, by the processor, the pre-enrollment data set to determine whether to end the fingerprint enrollment;
performing, by the processor, for each of the plurality of swipe images:
judging whether the slide brush image is a first slide brush image or not;
if the swipe image is the first swipe image:
generating the pre-registration data set according to the feature points of the swipe image, and analyzing the pre-registration data set to obtain basic image parameters; and
displaying the completion area on the reference image in the user interface of the display in accordance with the base image parameter; and
if the swipe image is not the first swipe image:
merging the feature points of the swipe image into the pre-registered dataset to produce a merged pre-registered dataset;
analyzing the merged pre-registered data set to obtain merged image parameters, and obtaining image adjustment parameters according to the merged image parameters and the basic image parameters, and using the merged image parameters as new basic image parameters; and
increasing the range of the completion area of the reference image in accordance with the image adjustment parameter.
2. The method of claim 1, further comprising performing, by the processor, for each of the plurality of swipe images:
and judging whether the merged image parameter is larger than a preset threshold value or not so as to determine whether the fingerprint registration is finished or not.
3. A display method of a user interface, which is suitable for fingerprint registration, is characterized in that the display method comprises the following steps:
acquiring a plurality of swipe images through a fingerprint sensor;
analyzing the plurality of swipe images by a processor to obtain a plurality of feature points of the plurality of swipe images, wherein the feature points correspond to a plurality of fingerprint feature points of a finger;
merging, by the processor, the plurality of feature points of the plurality of swipe images into a pre-registered dataset;
displaying, by the processor, a finished area on a reference image in a user interface of a display according to the plurality of swipe images, wherein the reference image in the user interface includes the finished area, and the finished area of the reference image is used to represent a coverage of the acquired fingerprint information; and
analyzing, by the processor, the pre-enrollment data set to determine whether to end the fingerprint enrollment,
performing, by the processor, for each of the plurality of swipe images:
judging whether the slide brush image is a first slide brush image or not;
if the swipe image is the first swipe image:
analyzing the sliding brush image to obtain the coordinate parameters of the feature points positioned at the leftmost upper corner of the sliding brush image; and
determining the position of the completion area of the reference image according to the coordinate parameters of the feature points positioned at the uppermost left corner of the sliding brush image; and
if the swipe image is not the first swipe image:
merging the feature points of the swipe image into the pre-registered dataset to produce a merged pre-registered dataset;
generating the pre-registration data set according to the feature points of the swipe image, and analyzing the pre-registration data set to obtain basic image parameters; and the number of the first and second groups,
analyzing the merged pre-registration data set to obtain a first merged image parameter and a second merged image parameter, and obtaining an image adjustment parameter according to the first merged image parameter and a base image parameter, wherein the first merged image parameter represents a coverage of the merged pre-registration data set in a vertical direction, and the second merged image parameter represents a coverage of the merged pre-registration data set in a horizontal direction; taking the first merged image parameter as a new base image parameter; and
increasing an extent of the finished area of the reference image in the vertical direction in dependence on the image adjustment parameter.
4. The method of claim 3, further comprising performing, by the processor, for each of the plurality of swipe images:
and judging whether the first merged image parameter is larger than a first preset threshold value or not, and judging whether the second merged image parameter is larger than a second preset threshold value or not so as to determine whether the fingerprint registration is finished or not.
5. A display method of a user interface, which is suitable for fingerprint registration, is characterized in that the display method comprises the following steps:
acquiring a plurality of swipe images through a fingerprint sensor;
analyzing the plurality of swipe images by a processor to obtain a plurality of feature points of the plurality of swipe images, wherein the feature points correspond to a plurality of fingerprint feature points of a finger;
merging, by the processor, the plurality of feature points of the plurality of swipe images into a pre-registered dataset;
displaying, by the processor, a finished area on a reference image in a user interface of a display according to the plurality of swipe images, wherein the reference image in the user interface includes the finished area, and the finished area of the reference image is used to represent a coverage of the acquired fingerprint information; and
analyzing, by the processor, the pre-enrollment data set to determine whether to end the fingerprint enrollment;
performing, by the processor, for each of the plurality of swipe images:
obtaining a coordinate parameter positioned at the leftmost upper corner of the sliding brush image;
judging whether the slide brush image is a first slide brush image or not;
if the swipe image is the first swipe image:
generating the pre-registration data set from the feature points of the swipe image; and
displaying the completion area on the reference image of the user interface according to the coordinate parameter and the area of the swipe image; and
if the swipe image is not the first swipe image:
merging the feature points of the swipe image into the pre-registered dataset to produce a merged pre-registered dataset; and
increasing the range of the completion area of the reference image according to the coordinate parameter and the area of the swipe image.
6. The method of claim 5, further comprising performing, by the processor, for each of the plurality of swipe images:
and judging whether the total area of the combined pre-registered data set is larger than a preset threshold value or not so as to determine whether the fingerprint registration is finished or not.
7. An electronic device adapted for fingerprint registration, comprising:
a fingerprint sensor for acquiring a plurality of swipe images;
a processor coupled to the fingerprint sensor to analyze the plurality of swipe images to obtain a plurality of feature points of the plurality of swipe images, wherein the feature points correspond to a plurality of fingerprint feature points of a finger, and to merge the plurality of feature points of the plurality of swipe images into a pre-registered dataset; and
a display coupled to the processor,
wherein the processor displays a completion area on a reference image in a user interface via the display according to a plurality of swipe images, wherein the reference image in the user interface includes the completion area, and the completion area of the reference image is used to represent a coverage of fingerprint information that has been obtained, and the processor analyzes the pre-enrollment data set to determine whether to end the fingerprint enrollment,
wherein the processor performs the following for each of the plurality of swipe images:
the processor judges whether the swipe image is a first swipe image;
if the swipe image is the first swipe image:
the processor generating the pre-registered data set according to the feature points of the swipe image and analyzing the pre-registered data set to obtain basic image parameters; and
displaying, by the processor, the completion region on the reference image in the user interface of the display in accordance with the base image parameter; and
if the swipe image is not the first swipe image:
the processor incorporating the feature points of the swipe image into the pre-registered dataset to produce a merged pre-registered dataset;
the processor analyzes the merged pre-registered data set to obtain merged image parameters, obtains image adjustment parameters according to the merged image parameters and the basic image parameters, and takes the merged image parameters as new basic image parameters; and
the processor increases the extent of the completion region of the reference image in accordance with the image adjustment parameter.
8. The electronic device of claim 7, wherein the processor further performs the following for each of the plurality of swipe images:
and the processor judges whether the merged image parameter is larger than a preset threshold value or not so as to determine whether the fingerprint registration is finished or not.
9. An electronic device adapted for fingerprint registration, comprising:
a fingerprint sensor for acquiring a plurality of swipe images;
a processor coupled to the fingerprint sensor to analyze the plurality of swipe images to obtain a plurality of feature points of the plurality of swipe images, wherein the feature points correspond to a plurality of fingerprint feature points of a finger, and to merge the plurality of feature points of the plurality of swipe images into a pre-registered dataset; and
a display coupled to the processor,
wherein the processor displays a completion area on a reference image in a user interface via the display according to a plurality of swipe images, wherein the reference image in the user interface includes the completion area, and the completion area of the reference image is used to represent a coverage of fingerprint information that has been obtained, and the processor analyzes the pre-enrollment data set to determine whether to end the fingerprint enrollment,
wherein the processor performs the following for each of the plurality of swipe images:
the processor judges whether the swipe image is a first swipe image;
if the swipe image is the first swipe image:
the processor analyzes the sliding brush image to obtain the coordinate parameters of the feature points positioned at the leftmost upper corner of the sliding brush image; and
the processor determines the position of the completion area of the reference image according to the coordinate parameters of the feature points positioned at the uppermost left corner of the sliding brush image; and
if the swipe image is not the first swipe image:
the processor incorporating the feature points of the swipe image into the pre-registered dataset to produce a merged pre-registered dataset;
the processor analyzing the merged pre-registration data set to obtain a first merged image parameter and a second merged image parameter, and obtaining an image adjustment parameter according to the first merged image parameter and a base image parameter, wherein the first merged image parameter represents a coverage of the merged pre-registration data set in a vertical direction, and the second merged image parameter represents a coverage of the merged pre-registration data set in a horizontal direction;
the processor takes the first merged image parameter as a new base image parameter; and
the processor increases an extent of the finished area of the reference image in the vertical direction in accordance with the image adjustment parameter.
10. The electronic device of claim 9, wherein the processor further performs the following for each of the plurality of swipe images:
the processor judges whether the first merged image parameter is larger than a first preset threshold value or not and judges whether the second merged image parameter is larger than a second preset threshold value or not so as to determine whether the fingerprint registration is finished or not.
11. An electronic device adapted for fingerprint registration, comprising:
a fingerprint sensor for acquiring a plurality of swipe images;
a processor coupled to the fingerprint sensor to analyze the plurality of swipe images to obtain a plurality of feature points of the plurality of swipe images, wherein the feature points correspond to a plurality of fingerprint feature points of a finger, and to merge the plurality of feature points of the plurality of swipe images into a pre-registered dataset; and
a display coupled to the processor,
wherein the processor displays a completion area on a reference image in a user interface via the display according to a plurality of swipe images, wherein the reference image in the user interface includes the completion area, and the completion area of the reference image is used to represent a coverage of fingerprint information that has been obtained, and the processor analyzes the pre-enrollment data set to determine whether to end the fingerprint enrollment,
wherein the processor performs the following for each of the plurality of swipe images:
the processor obtains a coordinate parameter positioned at the leftmost upper corner of the sliding brush image;
the processor judges whether the swipe image is a first swipe image;
if the swipe image is the first swipe image:
the processor generating the pre-registration dataset from the feature points of the swipe image; and
the processor displays the completion area on the reference image of the user interface according to the coordinate parameter and the area of the swipe image; and
if the swipe image is not the first swipe image:
the processor incorporating the feature points of the swipe image into the pre-registered dataset to produce a merged pre-registered dataset; and
the processor increases the range of the completion area of the reference image according to the coordinate parameter and the area of the swipe image.
12. The electronic device of claim 11, wherein the processor further performs the following for each of the plurality of swipe images:
and the processor judges whether the total area of the combined pre-registered data set is larger than a preset threshold value or not so as to determine whether the fingerprint registration is finished or not.
CN201810349409.2A 2017-10-16 2018-04-18 Display method of user interface and electronic device Active CN109669651B (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US16/105,987 US10713463B2 (en) 2017-10-16 2018-08-21 Display method of user interface and electronic apparatus thereof
PCT/CN2018/110264 WO2019076272A1 (en) 2017-10-16 2018-10-15 User interface display method and electronic device
GB1914055.7A GB2574973B (en) 2017-10-16 2018-10-15 User interface display method and electronic device
JP2019551393A JP6836662B2 (en) 2017-10-16 2018-10-15 User interface display method and electronic device
GB2117618.5A GB2599288B (en) 2017-10-16 2018-10-15 User interface display method and electronic device
US16/360,017 US10755068B2 (en) 2017-10-16 2019-03-21 Fingerprint registration method and electronic device using the same

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201762573140P 2017-10-16 2017-10-16
US62/573140 2017-10-16
US201762598480P 2017-12-14 2017-12-14
US62/598480 2017-12-14

Publications (2)

Publication Number Publication Date
CN109669651A CN109669651A (en) 2019-04-23
CN109669651B true CN109669651B (en) 2021-02-02

Family

ID=66141976

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810349409.2A Active CN109669651B (en) 2017-10-16 2018-04-18 Display method of user interface and electronic device

Country Status (4)

Country Link
JP (1) JP6836662B2 (en)
CN (1) CN109669651B (en)
GB (2) GB2574973B (en)
WO (1) WO2019076272A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI735821B (en) * 2018-04-12 2021-08-11 神盾股份有限公司 Fingerprint registration method and electronic device using the same

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3663075B2 (en) * 1999-04-05 2005-06-22 シャープ株式会社 Information processing device
JP3780830B2 (en) * 2000-07-28 2006-05-31 日本電気株式会社 Fingerprint identification method and apparatus
WO2004026139A1 (en) * 2002-09-17 2004-04-01 Fujitsu Limited Biological information acquiring apparatus and authentication apparatus using biological information
CN1924889A (en) * 2005-08-30 2007-03-07 知网生物识别科技股份有限公司 Apparatus and method of fingerprint register
CN102446271B (en) * 2010-10-08 2014-08-27 金佶科技股份有限公司 Sectional type image identification method and regional type identification device thereof
TWI562077B (en) * 2012-01-04 2016-12-11 Gingy Technology Inc Method for fingerprint recognition using dual camera and device thereof
KR101419784B1 (en) * 2013-06-19 2014-07-21 크루셜텍 (주) Method and apparatus for recognizing and verifying fingerprint
US9898642B2 (en) * 2013-09-09 2018-02-20 Apple Inc. Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs
KR102126568B1 (en) * 2013-10-31 2020-06-24 삼성전자주식회사 Method for processing data and an electronic device thereof
KR102217858B1 (en) * 2013-11-13 2021-02-19 삼성전자주식회사 Method for fingerprint authentication, fingerprint authentication device, and mobile terminal performing thereof
CN105989349B (en) * 2014-10-24 2019-11-01 神盾股份有限公司 The log-on data production method and electronic device of fingerprint
US9613428B2 (en) * 2014-11-07 2017-04-04 Fingerprint Cards Ab Fingerprint authentication using stitch and cut
US10032062B2 (en) * 2015-04-15 2018-07-24 Samsung Electronics Co., Ltd. Method and apparatus for recognizing fingerprint
KR102396514B1 (en) * 2015-04-29 2022-05-11 삼성전자주식회사 Fingerprint information processing method and electronic device supporting the same
KR101639986B1 (en) * 2015-10-07 2016-07-15 크루셜텍 (주) Fingerprint information processing method and apparatus for speed improvement of fingerprint registration and authentification
CN105373786A (en) * 2015-11-30 2016-03-02 东莞酷派软件技术有限公司 Fingerprint acquisition method, fingerprint acquisition device and electronic device
WO2017156752A1 (en) * 2016-03-17 2017-09-21 深圳信炜科技有限公司 Fingerprint registration method, fingerprint identification system, and electronic equipment
WO2018161312A1 (en) * 2017-03-09 2018-09-13 深圳市汇顶科技股份有限公司 Fingerprint identification method and apparatus

Also Published As

Publication number Publication date
JP2020515955A (en) 2020-05-28
GB2574973A (en) 2019-12-25
JP6836662B2 (en) 2021-03-03
GB2599288A (en) 2022-03-30
GB201914055D0 (en) 2019-11-13
GB2574973B (en) 2022-04-13
GB2599288B (en) 2022-11-23
CN109669651A (en) 2019-04-23
WO2019076272A1 (en) 2019-04-25
GB202117618D0 (en) 2022-01-19

Similar Documents

Publication Publication Date Title
US9514352B2 (en) Fingerprint enrollment using touch sensor data
US9646193B2 (en) Fingerprint authentication using touch sensor data
WO2018077104A1 (en) Fingerprint acquisition method, fingerprint acquisition device, and storage medium
US9400880B2 (en) Method and apparatus for biometric-based security using capacitive profiles
US9280695B2 (en) Apparatus and method for determining sequencing of fingers in images to a two-finger scanner of fingerprint images
EP3076334A1 (en) Image analyzing apparatus and image analyzing method
WO2003077199A1 (en) Fingerprint matching device, fingerprint matching method, and program
TWI767792B (en) Method for determining imaging ratio of curved screen, storage medium, and electronic device
US9690430B2 (en) Touch detection apparatus, touch detection method and recording medium
US20170091521A1 (en) Secure visual feedback for fingerprint sensing
CN109669651B (en) Display method of user interface and electronic device
JP2013149228A (en) Position detector and position detection program
US10713463B2 (en) Display method of user interface and electronic apparatus thereof
KR101542671B1 (en) Method and apparatus for space touch
JP2018049498A (en) Image processor, operation detection method, computer program, and storage medium
KR101216537B1 (en) Contactless Sign Pad
JP2009151516A (en) Information processor and operator designating point computing program for information processor
CN110543864A (en) Sensor and fake finger identification method
JP5299632B2 (en) Personal authentication device, program and recording medium
US10990787B2 (en) Enrolment of a fingerprint template
TWI676937B (en) Fingerprint enrollment method and electronic device for the same
TW201909021A (en) Electronic device and method for fingerprint identification

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant