WO2019076272A1

WO2019076272A1 - User interface display method and electronic device

Info

Publication number: WO2019076272A1
Application number: PCT/CN2018/110264
Authority: WO
Inventors: 江元麟; 吕俊超; 许献仁
Original assignee: 神盾股份有限公司
Priority date: 2017-10-16
Filing date: 2018-10-15
Publication date: 2019-04-25
Also published as: GB201914055D0; GB2574973B; JP2020515955A; GB2599288A; CN109669651A; GB202117618D0; GB2599288B; GB2574973A; JP6836662B2; CN109669651B

Abstract

The present invention provides a user interface display method and an electronic device. The user interface display method is applicable to fingerprint registration. Said display method comprises the following steps: sensing an object by means of a fingerprint sensor, so as to obtain a swipe image of the object; analyzing the swipe image, so as to obtain a plurality of feature points of the swipe image; generating a pre-registered data set according to the swipe image; analyzing the pre-registered data set, so as to obtain an image adjustment parameter; and displaying the user interface, and adjusting, according to the image adjustment parameter, the range of the completion region of a reference image in the user interface. Therefore, the user interface display method and the electronic device of the present invention can inform, in the process of fingerprint registration in a swiping manner, a user of the corresponding fingerprint registration progress by means of a display of the electronic device.

Description

User interface display method and electronic device

Technical field

The present invention relates to an interface display technology, and in particular to a display method for a user interface suitable for fingerprint registration and an electronic device to which the display method is applied.

Background technique

In recent years, fingerprint recognition technology has been widely used in various electronic devices to provide various identity registration or identity verification functions. However, the general fingerprint identification technology is that the user presses a finger on the fingerprint sensor to register the fingerprint in a one-time or multiple-press manner, and provides a corresponding user interface to inform the user of the progress of the fingerprint registration. For example, if the fingerprint is registered by multiple presses, each time the user presses once, the corresponding fingerprint image displayed on the user interface will increase until the entire or a large enough range of fingerprints is displayed, that is, the fingerprint is completed. registered.

However, if the user registers the fingerprint by sliding the finger, the currently known fingerprint recognition related technology cannot correspondingly display the fingerprint image on the user interface according to the sliding progress of the user's finger to inform the user of the fingerprint. The progress of the registration. That is to say, in the process of sliding the finger for fingerprint registration, the user cannot know the progress of the fingerprint registration in real time.

Summary of the invention

The present invention provides a display method of a user interface and an electronic device, which allows a user to know the progress of registration of a corresponding fingerprint through a display of the electronic device during fingerprint registration by a sliding brush.

A display method of a user interface of the present invention is suitable for fingerprint registration. The display method comprises the steps of: obtaining a brush image by a fingerprint sensor; analyzing the brush image to obtain a plurality of feature points of the brush image; determining whether the brush image is the first brush image; and if the brush image is a first brush image, generating a pre-registration data set according to the plurality of feature points of the brush image, and analyzing the pre-registration data set to obtain a basic image parameter; and displaying the completion area to the user according to the basic image parameter On the reference image in the interface.

A display method of a user interface of the present invention is suitable for fingerprint registration. The display method includes the steps of: obtaining a brush image by using a fingerprint sensor; analyzing the brush image to obtain a plurality of feature points of the brush image, and obtaining coordinate parameters of the feature points located at a leftmost upper corner position of the brush image; Determining whether the brush image is the first brush image; if the brush image is the first brush image, generating a pre-registration data set according to the plurality of feature points of the brush image; and sliding according to the coordinate parameter The area of the image is swiped to display the completion area on the reference image in the user interface.

An electronic device of the present invention includes a fingerprint sensor, a processor, and a display. The fingerprint sensor is used to obtain a brush image. The processor couples the fingerprint sensor. The processor is configured to analyze the brush image to obtain a plurality of feature points of the brush image, and determine whether the brush image is the first brush image. The display couples the processor. If the processor determines that the brush image is the first brush image, the processor generates a pre-registration data set according to the plurality of feature points of the brush image, and analyzes the pre-registration data set to obtain the base image parameter. The processor displays the completion area on the reference image in the user interface through the display according to the basic image parameters.

An electronic device of the present invention includes a fingerprint sensor, a processor, and a display. The fingerprint sensor is used to obtain a brush image. The processor couples the fingerprint sensor. The processor is configured to analyze the brush image and obtain coordinate parameters of the feature points located at the uppermost left corner position of the brush image. The processor is further configured to determine whether the brush image is the first brush image. The display couples the processor. If the processor determines that the brush image is the first brush image, the pre-registration data set is generated according to the plurality of feature points of the brush image. The processor displays the completion area on the reference image in the user interface according to the coordinate parameter and the area of the brush image.

Based on the above, the display method and the electronic device of the user interface of the present invention can obtain corresponding image adjustment parameters by analyzing a plurality of brush images acquired in the fingerprint registration process, and can be presented in the user interface according to the image adjustment parameters. The range of the completion area of the reference image in the change is to provide information on the user's real-time fingerprint registration progress.

The above described features and advantages of the invention will be apparent from the following description.

DRAWINGS

1 is a schematic diagram of an electronic device in accordance with an embodiment of the present invention;

2 is a flowchart of a fingerprint registration method according to an embodiment of the present invention;

3 is a flow chart of a fingerprint registration method in accordance with a first embodiment of the present invention;

4 is a schematic diagram of a pre-registration data set in accordance with a first embodiment of the present invention;

5A to 5E are schematic diagrams of finger actions and corresponding user interface displays in accordance with a first embodiment of the present invention;

6 is a flowchart of a fingerprint registration method in accordance with a second embodiment of the present invention;

Figure 7 is a schematic illustration of a pre-registration data set in accordance with a second embodiment of the present invention;

8A-8G are schematic diagrams of finger actions and corresponding user interface displays in accordance with a second embodiment of the present invention;

Figure 9 is a flowchart of a fingerprint registration method in accordance with a third embodiment of the present invention;

Figure 10 is a schematic illustration of a pre-registration data set in accordance with a third embodiment of the present invention;

11A through 11I are schematic diagrams of finger actions and corresponding user interface displays in accordance with a third embodiment of the present invention.

Description of the reference numerals:

100: an electronic device;

110: a processor;

120: a fingerprint sensor;

130: memory;

140: display;

410, 420, 400, 710, 720, 730, 1010, 1020, 1030: image;

411, 711, 1011: feature points;

500, 800, 1100: user interface;

510, 810, 1110: reference image;

511, 811, 811b, 1111: completion area;

DW1, DW2: width;

F: finger;

h, H, W: image parameters;

Step: image adjustment parameters;

S210, S220, S225, S230, S232, S235, S240, S245, S250,

S310, S320, S331, S332, S333, S334, S340, S341, S350, S380, S610, S620, S631, S633, S632, S634, S640, S641, S650, S680, S910, S920, S922, S924, S925, S926, S940, S980: steps;

(X1, Y1), (X2, Y2), (Xn, Yn): coordinate parameters;

(Δx, Δy): displacement parameter.

Detailed ways

In order to make the content of the present invention easier to understand, the following specific embodiments are examples of the invention that can be implemented. In addition, wherever possible, the same reference numerals in the drawings and the

1 is a schematic diagram of an electronic device in accordance with an embodiment of the present invention. Referring to FIG. 1, the electronic device 100 includes a processor 110, a fingerprint sensor 120, a memory 130, and a display 140. The processor 110 couples the fingerprint sensor 120, the memory 130, and the display 140. The electronic device 100 can be, for example, an electronic product such as a smart phone, a notebook (NB), or a tablet PC. In the embodiment, the electronic device 100 performs a fingerprint sensing operation through the fingerprint sensor 120 to collect a fingerprint image of the user. In this embodiment, when the user places a finger on the fingerprint sensor 120 to perform a swiping operation, the fingerprint sensor 120 performs fingerprint sensing. The fingerprint sensor 120 continuously takes a plurality of brush images and provides them to the processor 110. The processor 110 analyzes the brush images to extract a plurality of feature points from each of the brush images, wherein the feature points refer to fingerprint feature points of the finger. Thereafter, the processor 110 generates fingerprint registration data based on the feature point data.

In the embodiment, the fingerprint sensor 120 obtains the slide image images one by one, and in the process of the processor 110 performing the analysis one by one, the processor 110 correspondingly changes the display on the display 140 according to the analysis result of the slide brush images obtained one by one. The completion area of the fingerprint reference image contained in the user interface (UI). In this embodiment, the reference image in the user interface includes a completion area. The completion area of the reference image is used to indicate the coverage of the fingerprint information that has been obtained, and the range change of the completion area of the reference image is gradually increased and changed corresponding to the progress of the current user's slide brush (ie, the progress of the fingerprint information). . Therefore, the fingerprint registration function of the electronic device 100 of the present invention can provide a good interaction effect, and let the user know the current registration progress.

In this embodiment, the processor 110 is, for example, a central processing unit (CPU), a system on chip (SOC), or other programmable general purpose or special purpose microprocessor. , Digital Signal Processor (DSP), programmable controller, Application Specific Integrated Circuits (ASIC), Programmable Logic Device (PLD), other similar processing devices or these devices combination.

In the present embodiment, the fingerprint sensor 120 is, for example, a capacitive fingerprint sensor or an optical fingerprint sensor, and the present invention does not limit the type of the fingerprint sensor 120. In this embodiment, the fingerprint sensing mechanism of the fingerprint sensor 120 may be a swiping sensing or a pressing sensing. It should be noted that the fingerprint registration of the embodiments of the present invention is fingerprint registration by sliding sensing. That is to say, in the process of fingerprint registration, the user puts a finger on the sensing surface of the fingerprint sensor 120 to perform a sliding brush, and the fingerprint sensor 120 senses and acquires fingerprint information of the user via the sensing surface. For example, the electronic device 100 can be designed to allow the user to perform fingerprint registration by sliding the finger, that is, the fingerprint sensor 120 performs fingerprint sensing in a sliding sensing manner, and when performing fingerprint authentication, Then, the user performs fingerprint authentication by pressing a finger, that is, the fingerprint sensor 120 performs fingerprint sensing in a push-sensing manner.

In this embodiment, the memory 130 is configured to store fingerprint data according to various embodiments of the present invention, and store related applications for the processor 110 to read and execute.

In this embodiment, the display 140 is, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, a micro light emitting diode (Micro LED) display, or an organic light emitting diode (Organic LED) display. The display of the present invention does not limit the type of display 140. In the present embodiment, when the user performs fingerprint registration, the display 140 displays a corresponding user interface, and includes a reference image simulating a fingerprint in the user interface. During the process of the user swiping the finger on the fingerprint sensor 120, the range of the completed area of the reference image displayed by the display 140 may correspondingly change and increase as the fingerprint data sensed by the fingerprint sensor 120 increases.

2 is a flow chart of a fingerprint registration method in accordance with an embodiment of the present invention. Referring to FIG. 1 and FIG. 2, the fingerprint registration method of the present embodiment can be applied to the electronic device 100 of the embodiment of FIG. 1. When the user performs fingerprint registration, the electronic device 100 performs a sliding brush sensing operation through the fingerprint sensor 120 to obtain a sliding brush image of the object (ie, the user's finger) one by one. In step S210, the fingerprint sensor 120 takes a slide image. In step S220, the processor 110 analyzes the brush image to obtain a plurality of feature points of the brush image. In step S225, the processor 110 determines whether the brush image is the first brush image. If yes, step S230 is performed. In step S230, the processor 110 generates a pre-registration data set according to the feature points of the brush image, and analyzes and obtains the base image parameter (h) of the pre-registration data set. In step S232, the processor 110 displays the completion area of the reference image on the user interface according to the base image parameter (h). If no, step S235 is performed. In step S235, the processor 110 merges the feature points of the brush image into the pre-registration data set to generate a merged pre-registration data set. In step S240, the processor 110 analyzes the merged pre-registration data set to obtain the merged image parameter (H), and obtains the image adjustment parameter according to the merged image parameter (H) and the base image parameter (h) (Step=Hh) ), wherein the image adjustment parameter (Step) is equal to the merged image parameter (H) minus the base image parameter (h). In step S245, the processor 110 will take the merged image parameter (H) as the new base image parameter (h). In step S250, the processor 110 increases the range of the completed region of the reference image in the user interface according to the image adjustment parameter (Step), that is, increases the length of the completed region. In order to enable those skilled in the art to further understand the display manner of the user interface of the present invention and the technical details of fingerprint registration, various embodiments are described below in detail.

3 is a flow chart of a fingerprint registration method in accordance with a first embodiment of the present invention. Referring to FIG. 1 and FIG. 3, the fingerprint registration method of the present embodiment can be applied to the electronic device 100 of the embodiment of FIG. 1. When the user performs fingerprint registration, in step S310, the electronic device 100 senses the object (ie, the user's finger) through the fingerprint sensor 120 to obtain a brush image. In step S320, the processor 110 analyzes the brush image to obtain a plurality of feature points of the brush image. In step S331, the processor 110 determines whether the brush image is the first brush image. If so, the processor 110 performs step S332. In step S332, the processor 110 generates a pre-registration data set based on the feature points of the brush image, and obtains a base image parameter (h) of the pre-registration data set. In step S333, the processor 110 displays the completed area of the reference image in accordance with the base image parameter (h). If not, the processor 110 performs step S334. In step S334, the processor 110 merges the feature points of the brush image into the pre-registration data set to generate a merged pre-registration data set.

In step S340, the processor 110 analyzes the merged pre-registration data set to obtain the merged image parameter (H), and obtains the image adjustment parameter according to the merged image parameter (H) and the base image parameter (h) (Step=Hh) ), wherein the image adjustment parameter (Step) is equal to the merged image parameter (H) minus the base image parameter (h). In step S341, the processor 110 takes the merged image parameter (H) as a new base image parameter (h). In step S350, the processor 110 increases the range of the completed region of the reference image according to the image adjustment parameter (Step), that is, increases the length of the completed region. In step S380, the processor 110 determines whether the merged image parameter (H) is greater than a preset threshold. If yes, it indicates that sufficient fingerprint registration data has been obtained, the processor 110 ends the fingerprint sensing operation of the fingerprint sensor 120, and stores the pre-registration data set into the memory 130 as a fingerprint registration data set to complete the fingerprint registration process. If not, the processor 110 performs step S310 to obtain the next slider image.

4 is a schematic diagram of a pre-registration data set in accordance with a first embodiment of the present invention. 5A through 5E are schematic diagrams of a finger swipe action and a corresponding user interface display in accordance with a first embodiment of the present invention. Referring to FIG. 1 , FIG. 4 and FIG. 5A to FIG. 5E , the flow of FIG. 3 described above can also be applied to the embodiment. In this embodiment, after the fingerprint sensor 120 obtains the first brush image 410 of the finger F, the processor 110 analyzes the brush image 410 to obtain a plurality of feature points 411 of the brush image 410 and a base image parameter h. . It should be noted that the area of the brush image 410 may be equal to the area of the sensing surface of the fingerprint sensor 120. In this embodiment, the initial value of the base image parameter h may be the distance between the two feature points of the feature points 411 of the first brush image 410 that are the farthest in the length direction, but the present invention is not limited thereto. . In another embodiment, the initial value of the base image parameter h may also be the length of the brush image 410, that is, the length of the sensing surface of the fingerprint sensor 120. The processor 110 generates a pre-registration data set based on the feature points 411 of the wiper image 410. Next, the processor 110 continues to acquire the next slider image 420 and obtains the feature points of the brush image 420. In the present embodiment, processor 110 incorporates the feature points of the wiper image 420 into the pre-registration data set (ie, the feature points of the merged wiper images 410 and 420) to generate a new pre-registration data set 400. The processor 110 calculates a merged image parameter H of the merged pre-registration data set 400. Similarly, the merged image parameter H may be the distance between the two feature points of the merged feature points that are farthest apart in the length direction after combining the

brush images

410 and 420, or may be the merged

brush images

410 and 420. Thereafter, the sum of the lengths of the two brush images (i.e., twice the length of the sensing surface of the fingerprint sensor 120) subtracts the length of the overlapping portion of the

brush images

410 and 420. Next, the processor 110 subtracts the base image parameter h from the merged image parameter H to obtain an image adjustment parameter Step (=H-h).

That is, each time the processor 110 incorporates a feature point of the wiper image, the processor 110 calculates the newly added length of the merged pre-registration data set 400 to adjust the reference image 510 of the user interface 500 accordingly. The length of the area 511 is completed. It is to be noted that the width DW of the completion area 511 of the reference image 510 is preset and fixed. For each new feature point data of the slider image, the processor 110 correspondingly increases the length of the completion area 511. In addition, the processor 110 determines whether the merged image parameter H is greater than a preset threshold. If yes, it means that enough fingerprint registration data has been obtained. For example, when the merged image parameter H is greater than a preset threshold, it means that a sufficient number of fingerprint feature points have been obtained. It can also mean that a sufficient number of slider images have been obtained. Therefore, the processor 110 stores the pre-registered data set into the memory 130 as a fingerprint registration data set to complete the fingerprint registration process.

For example, FIG. 5A to FIG. 5E are taken as an example. As shown in FIG. 5A, when the user places the finger F on the fingerprint sensor 120 of the electronic device 100 and performs a brushing action, the electronic device 100 displays the reference image 510 on the user interface 500 and acquires the brush image one by one. When the first brush image is obtained, the electronic device 100 displays the corresponding completion area 511 in the reference image 510, wherein the length of the completion area 511 is the base image parameter h corresponding to the first brush image. Further, as described above, the width of the completion region 511 is preset and fixed, and as shown, the width of the completion region 511 may be equal to or larger than the width of the reference image 510. As shown in FIG. 5B, when the second brush image is acquired, the electronic device 100 increases the length of the completed region 511 of the reference image 510 according to the image adjustment parameter Step. As shown, the width of the finished area 511 is fixed. As shown in FIG. 5C, when the user's finger F leaves the fingerprint sensor 120, the length of the completion area 511 of the reference image 510 stops increasing. However, since sufficient fingerprint information has not been obtained, that is, the merged image parameter H has not been greater than the preset threshold, the fingerprint registration procedure is still not completed, so the user interface 500 continues to display the completed area 511 of the reference image 510 and prompts the user to slide again. Brush your fingers. Next, as shown in FIG. 5D, the user's finger F is placed again on the fingerprint sensor 120 of the electronic device 100 and the brushing action is performed. The electronic device 100 will acquire a new brush image and continue to increase the length of the completed region 511 of the reference image 510 based on the newly added brush image (ie, the newly added fingerprint feature point data). Finally, as shown in FIG. 5E, when the merged image parameter H is greater than the preset threshold, the processor 110 will completely cover the reference image 510, that is, the length of the completed region 511 may be greater than or equal to the reference image 510. length. Therefore, the fingerprint registration process has been completed, the processor 110 stops the fingerprint sensing operation of the fingerprint sensor 120, and generates a fingerprint registration data set according to the pre-registration data set to complete the fingerprint registration process.

Figure 6 is a flow chart of a fingerprint registration method in accordance with a second embodiment of the present invention. Referring to FIG. 1 and FIG. 6, the fingerprint registration method of the present embodiment can be applied to the electronic device 100 of the embodiment of FIG. 1. When the user performs fingerprint registration, in step S610, the electronic device 100 senses the object (ie, the user's finger) through the fingerprint sensor 120 to obtain a brush image. In step S620, the processor 110 analyzes the brush image to obtain a plurality of feature points of the brush image. In step S631, the processor 110 determines whether the brush image is the first brush image. If so, the processor 110 performs step S632. In step S632, the processor 110 obtains the coordinate parameter (X, Y) of the feature point located at the upper left corner position of the brush image, generates a pre-registration data set according to the feature point of the brush image, and obtains the pre-registration data set. Base image parameters (h). In step S633, the processor 110 displays the completed area of the reference image on the display 140 in accordance with the base image parameter (h) and the coordinate parameter (X, Y). If not, the processor 110 executes step S634. In step S634, the processor 110 merges the feature points of the brush image into the pre-registration data set to generate a merged pre-registration data set.

In step S640, the processor 110 analyzes the pre-registration data set to obtain the first merged image parameter (H) and the second merged image parameter (W), and according to the first merged image parameter (H) and the base image parameter (h) ) to get the image adjustment parameters (Step = Hh). The first merged image parameter (H) may be the distance between the two feature points of the merged feature points that are farthest apart in the length direction in the pre-registration data set, or may be the sum of the lengths of the multiple brush images minus more The length of the overlapping portion of the brush image. The second merged image parameter (W) is the distance of the two feature points whose merged feature points are farthest apart in the width direction. In step S641, the processor 110 takes the first merged image parameter (H) as a new base image parameter (h). In step S650, the processor 110 increases the range of the completed region of the reference image according to the image adjustment parameter (Step). In step S680, the processor 110 determines whether the first merged image parameter (H) is greater than the first preset threshold, and determines whether the second merged image parameter (W) is greater than the second preset threshold. If yes, the processor 110 ends the fingerprint sensing operation of the fingerprint sensor 120, and generates fingerprint registration data according to the combined pre-registration data set to complete the fingerprint registration process. If not, the processor 110 performs step S610 to obtain the next slider image.

Figure 7 is a schematic illustration of a pre-registration data set in accordance with a second embodiment of the present invention. 8A through 8G are schematic diagrams of finger actions and corresponding user interface displays in accordance with a second embodiment of the present invention. Referring to FIG. 1 , FIG. 7 and FIG. 8A to FIG. 8G , the flow of FIG. 6 described above can also be applied to the embodiment. In this embodiment, after the fingerprint sensor 120 obtains the first brush image 710 of the finger F, the processor 110 analyzes the brush image 710 to obtain a plurality of feature points 711 of the brush image 710, and obtains a base image. The parameter h and the coordinate parameter (X1, Y1) of the feature point located at the most upper left corner position in the brush image 710. The processor 110 displays the completion area 811 of the reference image 810 in accordance with the coordinate parameters (X1, Y1) and the base image parameter h. It should be noted that the area of the brush image 710 may be equal to the area of the sensing surface of the fingerprint sensor 120. In the present embodiment, the base image parameter h may refer to the distances of the two feature points farthest from each other in the longitudinal direction among the feature points 711 of the brush image 710, but the present invention is not limited thereto. In another embodiment, the base image parameter h may also refer to the length of the brush image 710, that is, the length of the sensing surface of the fingerprint sensor 120. The processor 110 generates a pre-registration data set based on the feature points 711 of the wiper image 710. Next, the processor 110 continues to take the next slider image 720 and acquires the feature points of the brush image 720. In the present embodiment, the processor 110 incorporates the feature points of the wiper image 720 into the pre-registration data set (ie, the feature points of the merged wiper images 710 and 720) to produce a merged pre-registration data set 700. The processor 110 calculates a first merged image parameter H (ie, a maximum image length) and a second merged image parameter W (ie, a maximum image width) of the merged pre-registered data set 700. The processor 110 subtracts the first merged image parameter H from the base image parameter h to obtain an image adjustment parameter Step. Next, the processor 110 increases the length of the completed region 811 of the reference image 810 according to the image adjustment parameter Step.

That is, after each feature point of the processor 110 is merged, the processor 110 calculates the newly added length of the merged pre-registration data set 700 to adjust the reference image in the user interface 800 accordingly. The length of the completion area 811 of 810. It is to be noted that the width of the completed area 811 of the reference image 810 is preset and fixed corresponding to each finger swipe action. That is to say, the width of the completed area 811 of the reference image 810 is increased only every time the finger swipe action is added. In each process of the finger sliding action, the processor 110 increases the length of the completed area 811 for each new feature point data of the sliding brush image. In addition, the processor 110 merges the plurality of brush images into the pre-registration data set 700, and the processor 110 determines whether the first merged image parameter H and the second merged image parameter W are greater than the first and second preset thresholds, respectively. If yes, it means that enough fingerprint registration data has been obtained. For example, when the first merged image parameter H is greater than the first preset threshold and the second merged image parameter W is greater than the second preset threshold, it indicates that a sufficient number of fingerprint feature points have been obtained. It can also mean that a sufficient number of slider images have been obtained. Therefore, the processor 110 stores the pre-registered data set into the memory 130 as a fingerprint registration data set to complete the fingerprint registration process. If not, the processor 110 will display a prompt to the user interface through the display 140 to ask the user to swipe the finger again. During the second sliding brush, the processor 110 obtains the first sliding brush image 730 of the second sliding brush through the fingerprint sensor 120, and the processor 110 takes out the feature point 711 of the sliding brush image 730 and The pre-registration data set 700 is incorporated. The processor 110 according to the coordinate parameter (X1, Y1) of the feature point located at the top left position of the brush image 710 (ie, the first brush image obtained when the first brush is swiped) and the second time slip The coordinate parameter (X2, Y2) of the feature point of the top left corner position in the first brush image 730 obtained at the time of brushing to obtain the displacement parameter (Δx, Δy) (X2-X1=Δx, Y2-Y1= Δy)). The processor 110 determines, according to the displacement parameter (Δx, Δy), the completed region 811 of the reference image 810 of the user interface 800 corresponding to the increased width range and position of the second brushing action.

In other words, when the second brushing action is performed, the user's finger F will shift to the right or left, and the processor 110 will pass the first brush image 730 obtained when the second brush is swiped. The coordinate parameter (X2, Y2) of the feature point of the top leftmost position in the middle, that is, the displacement parameter (Δx, Δy), determines the change in the width range corresponding to the completed region 811 of the second brush, and The base image parameter h of the first slider image 730 determines the length of the new portion 811b of the completion region 811 corresponding to the second slider. The processor 110 displays the start position of the portion 811b of the completion region 811 corresponding to the second brush according to the coordinate parameter (X2, Y2). That is, at the time of the second sliding brush, the range of the completion region 811 in the width direction is increased in accordance with the degree of shift of the user's finger F. Thereafter, the processor 110 increases the length of the portion 811b of the completion region 811 corresponding to the second brush according to the brush image obtained afterwards and its corresponding image adjustment parameter Step. Each time a wiper image is obtained, the processor 110 determines again whether the first merged image parameter H and the second merged image parameter W are greater than the first and second preset thresholds, respectively, to determine whether to end the fingerprint registration process.

For example, FIG. 8A to FIG. 8G are taken as an example. As shown in FIG. 8A, when the user presses the finger F on the fingerprint sensor 120 of the electronic device 100 and performs the first brushing action, the corresponding completion area 811 will be displayed on the reference image 810 of the user interface 800. To correspond to the first brush image obtained by the fingerprint sensor 120. As shown in FIG. 8B and FIG. 8C, during the first sliding of the finger F, the length range of the completion region 811 of the reference image 810 will be adjusted accordingly. Moreover, during the first sliding of the finger F, the processor 110 increases the length range of the completed region 811 of the reference image 810 according to the image adjustment parameter Step in a manner of fixing the image width. That is to say, in the process of the first brushing action of the finger F, the width DW1 of the completion area 811 of the reference image 810 is fixed, and the length thereof is increased after the new brush image is acquired. As shown in FIG. 8D, when the user's finger F leaves the fingerprint sensor 120, the range of the completion area 811 of the reference image 810 will stop increasing. However, since fingerprint registration is still not completed, the user interface 800 remains in this reference image 810 and its existing completion area 811 and will prompt the user to be swiped again. Therefore, as shown in FIG. 8E and FIG. 8F, the user's finger is pressed again on the fingerprint sensor 120 of the electronic device 100 and the second brushing operation is performed. Compared with the finger placement position at the time of the first sliding brush, the user's finger is displaced to the upper right by a distance during the second sliding brush. After obtaining the first brush image of the second brushing action, the processor 110 calculates the coordinate parameter (X2, Y2) of the feature point of the top leftmost position thereof, and sets (X2, Y2) with the first time. The coordinate parameter (X1, Y1) of the feature point of the top leftmost position in the first brush image obtained by the brush is subtracted to obtain the displacement parameter (Δx, Δy) (X2-X1=Δx, Y2-Y1) = Δy), and the display position of the first brush image corresponding to the second brush is determined according to (Δx, Δy), that is, the completion region 811 corresponds to the new portion 811b of the second brush Starting position. As shown, during the second swipe of the finger, the range of the completed region 811 of the reference image 810 continues to increase (ie, 811b), wherein the processor 110 determines the completion region based on the displacement parameters (Δx, Δy). 811 newly increases the starting position of the portion 811b, and increases the length range of the completed region 811 of the reference image 810 corresponding to the portion 811b of the second sliding brush in accordance with the image adjustment parameter Step in a manner of fixing the image width. That is to say, in the process of the second brushing action of the finger F, the width DW2 of the new portion 811b of the completion region 811 of the reference image 810 is fixed, and the length thereof is obtained after the new brush image is acquired. Increased. Finally, as shown in FIG. 8G, when the first merged image parameter H and the second merged image parameter W of the registration data set 700 are greater than the first and second preset thresholds, respectively, the range of the completed region 811 of the reference image 810 is also Increasing to a sufficient length and width, the processor 110 will stop the fingerprint sensing operation of the fingerprint sensor 120 to complete the fingerprint registration process.

Figure 9 is a flow chart of a fingerprint registration method in accordance with a third embodiment of the present invention. Referring to FIG. 1 and FIG. 9, the fingerprint registration method of the present embodiment can be applied to the electronic device 100 of the embodiment of FIG. 1. When the user performs fingerprint registration, in step S910, the electronic device 100 senses the object (ie, the user's finger) through the fingerprint sensor 120 to obtain a brush image. In step S920, the processor 110 analyzes the brush image to obtain a plurality of feature points of the brush image, and obtains coordinate parameters (X, Y) of the feature points located at the uppermost left corner position of the brush image. In step S922, the processor 110 determines whether the brush image is the first brush image. If yes, step S924 is performed. In step S924, the processor 110 generates a pre-registration data set according to the feature points of the brush image. Next, in step S925, the processor 110 displays the corresponding completion area on the reference image of the user interface according to the coordinate parameter (X, Y) and the area of the brush image. It is worth noting that the area of the brush image is equivalent to the area of the sensing surface of the fingerprint sensor 120. If no, step S926 is performed. In step S926, the processor 110 merges the feature points of the brush image into the pre-registration data set. In step S940, the processor 110 increases the range of the completed area based on the coordinate parameters (X, Y) and the area of the brush image. In step S980, the processor 110 determines whether the total area of the pre-registered data set is greater than a preset threshold. The total area of the pre-registration data set can indicate that the sum of the area of all the brush images minus the area where the brush image overlaps, and also the number of feature points included in the pre-registered data set. In other words, in an embodiment, in step S980, the processor 110 determines whether the number of feature points included in the pre-registration data set is greater than a preset threshold. If so, the processor 110 ends the fingerprint sensing operation of the fingerprint sensor 120 and generates fingerprint registration data based on the merged pre-registration data set to complete the fingerprint registration process. If not, the processor 110 performs step S910 to sense and obtain the next slider image.

Figure 10 is a schematic illustration of pre-registration data in accordance with a third embodiment of the present invention. 11A through 11I are schematic diagrams of a finger swipe action and a corresponding user interface display in accordance with a third embodiment of the present invention. Please refer to FIG. 1, FIG. 10, and FIG. 11A to FIG. 11I for the following description. In addition, the embodiment of the present invention can also be applied to the flow of FIG. 9 described above. In this embodiment, after the fingerprint sensor 120 acquires the first brush image 1010 of the finger F, the processor 110 analyzes the brush image 1010 to obtain a plurality of feature points 1011 of the brush image 1010, and obtains the slider. The coordinate parameter (X1, Y1) of the feature point 1011 of the top left corner position of the image 1010. As shown in FIG. 11A, the processor 110 displays the completed area 1111 of the reference image 1110 on the user interface according to the coordinate parameters (X1, Y1) and the area of the brush image 1010 (ie, the area of the sensing surface of the fingerprint sensor 120). 1100. In addition, the processor 110 generates pre-registration data according to the feature points of the brush image 1010.

Next, the processor 110 acquires and analyzes the next slider image 1020 and acquires a plurality of feature points 1011 of the brush image 1020. In this embodiment, the processor 110 compares the feature points of the brush images 1010 and 1020 to find feature points included in the brush images 1010 and 1020 to obtain the relative positional relationship between the brush images 1010 and 1020. And the coordinate parameter (X2, Y2) of the feature point located at the uppermost left corner position of the brush image 1020 is obtained. As shown in FIG. 11B, the processor 110 increases the display range of the completed area 1111 of the reference image 1110 according to the coordinate parameters (X2, Y2) and the area of the wiper image 1020. In addition, processor 110 will incorporate feature points of brush image 1020 into pre-registration data to produce merged pre-registration data.

That is, each time the processor 110 takes a swipe image, its feature points are incorporated into the pre-registration data. In addition, the processor 110 obtains the coordinate parameters of the feature points located at the uppermost left corner of the brush image for determining the range and position to be added to the completed region 1111 of the reference image 1110 of the user interface 1100. It should be noted that the processor 110 determines whether to end the fingerprint registration by determining whether the total area of the pre-registration data is greater than a preset threshold. If the total area of the pre-registration data is not greater than the preset threshold, the processor 110 senses and obtains the next slider image. As shown in FIG. 10 and FIG. 11E to FIG. 11F, in the process of fingerprint registration, the finger will leave the fingerprint sensor 120 after the user swipes the finger for the first time. If sufficient fingerprint data has not been obtained, that is, the total area of the pre-registration data has not been greater than the preset threshold, the processor 110 displays a prompt to the user interface through the display 140 to request the user to swipe the finger again. During the second sliding brush, the processor 110 obtains the first sliding brush image 1030 of the second sliding brush, and the processor 110 takes out the feature points of the sliding brush image 1030 and incorporates the pre-registration data. Set and find the coordinate parameters (Xn, Yn) of the feature points located at the top leftmost position in the brush image 1030, and increase the reference of the user interface 1100 according to the coordinate parameters (Xn, Yn) and the area of the brush image 1030. The range of the completed area 1111 of the image 1110.

It should be particularly noted that by comparing and analyzing the pre-registration data and the feature points of the brush image 1030 (ie, finding the feature points that appear repeatedly), the processor 110 can calculate the brush image 1030 and the previously obtained brush image. The relative positional relationship between them, and the coordinate parameters (Xn, Yn) are obtained accordingly. In other words, the processor 110 is based on the relative positional relationship between the brush image 1030 and the previously obtained brush image, and the corresponding display completion area 1111 is in the reference image 1110. Moreover, the processor 110 determines whether the total area of the new pre-registration data is greater than a preset threshold to determine whether to end the fingerprint registration.

For example, FIG. 11A to FIG. 11I are taken as an example. As shown in FIG. 11A, when the user places the finger F on the fingerprint sensor 120 of the electronic device 100 and performs a swipe action, the completion area 1111 will be displayed on the reference image 1110 of the user interface 1100 to correspond to the fingerprint via The brush image obtained by the sensor 120. As shown in FIGS. 11B to 11D, in the process of the finger F slider, the range of the completion area 1111 of the reference image 1110 will be adjusted correspondingly. As shown in FIG. 11E, when the user's finger F leaves the fingerprint sensor 120, the range of the completion area 1111 of the reference image 1110 will stop increasing. However, since the fingerprint registration is still not completed, the user interface 1100 still stays in the previous completion area 1111 of this reference image 1110, and prompts the user to ask the user to swipe the finger again. As shown in Figs. 11F to 11H, the user's finger F is again placed on the fingerprint sensor 120 of the electronic device 100 and the brushing action is performed. The range of the completion area 1111 of the reference image 1110 continues to increase in response to the user's swipe action. As shown in FIG. 11I, when the total area of the pre-registration data is greater than a preset threshold, the processor 110 determines that sufficient fingerprint data has been obtained, and the range of the completed area 1111 of the reference image 1110 is also increased to a sufficient area, covering enough Reference image 1110 of the range. Therefore, the processor 110 stops the fingerprint sensing operation of the fingerprint sensor 120, and generates fingerprint registration data based on the pre-registration data to complete the fingerprint registration process.

In summary, the display method of the user interface and the electronic device of the present invention can collect a plurality of brush images obtained by the user's finger on the fingerprint sensor by one or more sliding actions, and combine the sliders. The feature point data of the image is used to generate fingerprint registration data. When combining the feature point data of the brush images, the electronic device of the present invention further analyzes the repeatability and positional relationship between the feature points of the brush images to obtain corresponding image parameters and/or coordinate parameters. Therefore, the display method of the user interface and the electronic device of the present invention can correspondingly display a user interface having a reference image and its completion area on the display according to image parameters and/or coordinate parameters to dynamically adjust the reference image in the user interface. The scope of the completed area. That is to say, in the process of swiping the finger for fingerprint registration, the user can know the progress of the fingerprint registration by the range change of the completion area of the reference image in the user interface displayed on the display of the electronic device. According to this, in the process of the user swiping the finger to perform fingerprint registration, the display method and the electronic device of the user interface of the present invention can provide real-time fingerprint registration progress information to the user, thereby providing more humanized and convenient. Fingerprint registration procedure.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and those skilled in the art can make some modifications and refinements without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the claims.

Claims

A display method of a user interface, which is suitable for fingerprint registration, wherein the display method comprises:

Acquiring multiple brush images through the fingerprint sensor;

And analyzing, by the processor, the plurality of brush images to obtain a plurality of feature points of the plurality of brush images;

Merging the plurality of feature points of the plurality of brush images into a pre-registration data set by the processor;

Displaying, by the processor, the completion region on the reference image in the user interface of the display according to the plurality of wiper images;

The pre-registration data set is analyzed by the processor to determine whether to end the fingerprint registration.
The display method of the user interface according to claim 1, further comprising: performing, by the processor, each of the plurality of brush images:

Analyzing the pre-registration data set to obtain image adjustment parameters;

Determining a range of the completed region of the reference image according to the image adjustment parameter.
The display method of the user interface according to claim 2, further comprising: performing, by the processor, each of the plurality of brush images:

Determining whether the brush image is the first brush image, and if the brush image is the first brush image, generating the pre-registration data according to the feature points of the brush image Aggregating and analyzing the pre-registration data set to obtain base image parameters;

Displaying the completion region on the reference image in the user interface of the display in accordance with the base image parameter.
The display method of the user interface according to claim 3, further comprising: performing, by the processor, each of the plurality of brush images:

If the brush image is not the first brush image, the feature points of the brush image are incorporated into the pre-registration data set to generate a combined pre-registration data set;

And analyzing the merged pre-registration data set to obtain a merged image parameter, and obtaining the image adjustment parameter according to the merged image parameter and the base image parameter;

Using the merged image parameter as a new base image parameter;

A range of the completed region of the reference image is increased in accordance with the image adjustment parameter.
The display method of the user interface according to claim 4, further comprising: performing, by the processor, each of the plurality of brush images:

Determining whether the merged image parameter is greater than a preset threshold to determine whether to end the fingerprint registration.
The display method of the user interface according to claim 3, further comprising: performing, by the processor, each of the plurality of brush images:

Determining whether the brush image is the first brush image, and if the brush image is the first brush image, analyzing the brush image to obtain the top left of the brush image The coordinate parameter of the feature point of the angular position;

Determining a position of the completed region of the reference image according to the coordinate parameter of the feature point located at the uppermost left corner position of the brush image.
The display method of the user interface according to claim 6, further comprising: performing, by the processor, each of the plurality of brush images:

If the brush image is not the first brush image, the feature points of the brush image are incorporated into the pre-registration data set to generate a combined pre-registration data set;

And analyzing the merged pre-registration data set to obtain a first merged image parameter and a second merged image parameter, and obtaining the image adjustment parameter according to the first merged image parameter and the base image parameter, where The first merged image parameter is indicative of the coverage of the merged pre-registration data set in the vertical direction, and the second merged image parameter is indicative of the coverage of the merged pre-registration data set in the horizontal direction. range;

Using the first merged image parameter as a new base image parameter;

And increasing a range of the completed region of the reference image in the vertical direction according to the image adjustment parameter.
The display method of the user interface according to claim 7, further comprising: performing, by the processor, each of the plurality of brush images:

Determining whether the first merged image parameter is greater than a first preset threshold, and determining whether the second merged image parameter is greater than a second preset threshold to determine whether to end the fingerprint registration.
The display method of the user interface according to claim 1, further comprising: performing, by the processor, each of the plurality of brush images:

Analyzing the pre-registration data set to obtain coordinate parameters;

Determining a range of the completed region of the reference image according to the coordinate parameter.
The display method of the user interface according to claim 9, further comprising: performing, by the processor, each of the plurality of brush images:

Determining whether the brush image is the first brush image, and if the brush image is the first brush image, generating the pre-registration data according to the feature points of the brush image Set;

If the brush image is not the first brush image, the feature points of the brush image are incorporated into the pre-registration data set to generate a combined pre-registration data set.
The display method of the user interface according to claim 10, further comprising: performing, by the processor, each of the plurality of brush images:

Determining whether the total area of the merged pre-registration data set is greater than a preset threshold to determine whether to end the fingerprint registration.
An electronic device, comprising:

a fingerprint sensor for acquiring a plurality of brush images;

a processor, coupled to the fingerprint sensor, for analyzing the plurality of brush images to obtain a plurality of feature points of the plurality of brush images, and the plurality of features of the plurality of brush images Point merge into a pre-registration data set; and

a display coupled to the processor,

The processor displays a completion area on a reference image in the user interface through the display according to the plurality of wiper images, and the processor analyzes the pre-registration data set to determine whether to end the fingerprint registration.
The electronic device according to claim 12, wherein said processor performs the following for each of said plurality of brush images:

The processor analyzes the pre-registration data set to obtain image adjustment parameters, and

The processor determines a range of the completed region of the reference image according to the image adjustment parameter.
The electronic device according to claim 13, wherein said processor further performs the following for each of said plurality of brush images:

The processor determines whether the brush image is the first brush image, and if the processor determines that the brush image is the first brush image, the processor is configured according to the brush The feature points of the image to generate the pre-registration data set, and analyzing the pre-registration data set to obtain base image parameters, and

The processor displays the completion area on the reference image in the user interface of the display according to the base image parameter.
The electronic device according to claim 14, wherein said processor further performs the following for each of said plurality of brush images:

If the processor determines that the brush image is not the first brush image, incorporating the feature points of the brush image into the pre-registration data set to generate a combined pre-registration data set,

The processor analyzes the merged pre-registration data set to obtain a merged image parameter, and the processor obtains an image adjustment parameter according to the merged image parameter and the base image parameter,

Wherein the processor uses the merged image parameter as a new base image parameter, and the processor increases a range of the completed region of the reference image according to the image adjustment parameter.
The electronic device according to claim 15, wherein said processor further performs the following for each of said plurality of brush images:

The processor determines whether the merged image parameter is greater than a preset threshold to determine whether to end the fingerprint registration.
The electronic device according to claim 14, wherein said processor further performs the following for each of said plurality of brush images:

The processor determines whether the brush image is the first brush image, and if the processor determines that the brush image is the first brush image, the processor analyzes the brush An image to obtain a coordinate parameter located at a top leftmost position of the brush image, and

The processor determines a position of the completed region of the reference image according to the coordinate parameter of the feature point located at the uppermost left corner position of the brush image.
The electronic device according to claim 17, wherein said processor further performs the following for each of said plurality of brush images:

If the brush image is not the first brush image, the processor merges the feature points of the brush image into the pre-registration data set to generate merged pre-registration data set,

Wherein the processor analyzes the merged pre-registration data set to obtain a first merged image parameter and a second merged image parameter, and the processor is configured according to the first merged image parameter and the base image parameter Obtaining the image adjustment parameter, wherein the first merged image parameter is indicative of a coverage of the merged pre-registration data set in a vertical direction, and the second merged image parameter is indicative of the merged pre- The coverage of the registration dataset in the horizontal direction,

Wherein the processor uses the first merged image parameter as a new base image parameter, and the processor increases the vertical direction of the completed region of the reference image according to the image adjustment parameter range.
The electronic device according to claim 18, wherein said processor further performs the following for each of said plurality of brush images:

The processor determines whether the first merged image parameter is greater than a first preset threshold, and determines whether the second merged image parameter is greater than a second preset threshold to determine whether to end the fingerprint registration.
The electronic device according to claim 12, wherein said processor performs the following for each of said plurality of brush images:

The processor analyzes the pre-registration data set to obtain coordinate parameters, and

The processor determines a range of the completed region of the reference image according to the coordinate parameter.
The electronic device according to claim 20, wherein said processor further performs the following for each of said plurality of brush images:

The processor determines whether the brush image is the first brush image, and if the processor determines that the brush image is the first brush image, the processor is configured according to the brush The feature points of the image to generate the pre-registration data set,

If the processor determines that the brush image is not the first brush image, incorporating the feature points of the brush image into the pre-registration data set to generate a combined pre-registration data set.
The electronic device according to claim 21, wherein said processor further performs the following for each of said plurality of brush images:

The processor determines whether the total area of the merged pre-registration data set is greater than a preset threshold to determine whether to end the fingerprint registration.