KR20200136504A - Implementation of biometric authentication - Google Patents

Abstract

The present invention generally provides user interfaces to biometric registration process instructions, aligning biometric features for registration, registering biometric features, providing hints during the biometric registration process, and applications Biometric authentication based, automatically filling biometric security fields, unlocking the device using biometric authentication, retrying biometric authentication, managing transmissions using biometric authentication, biometrics Insertable user interface during measurement authentication, preventing retry of biometric authentication, cached biometric authentication, automatically filling fillable fields based on visibility criteria, automatic login using biometric authentication, credential input Retrying biometric authentication in the user interface, providing indications of error conditions during biometric authentication, providing indications regarding the biometric sensor during biometric authentication, and configuring the device to register the biometric feature. It relates to implementing biometric authentication, including orienting.

Description

Implementation of biometric authentication {IMPLEMENTATION OF BIOMETRIC AUTHENTICATION}

Cross-reference to related applications

This application is filed September 9, 2017 in US Provisional Patent Application No. 62/556,413, "FACE ENROLLMENT AND AUTHENTICATION"; And No. 62/557,130, “IMPLEMENTATION OF BIOMETRIC AUTHENTICATION”, filed Sep. 11, 2017; Danish Patent Application PA 2017 70712, filed September 22, 2017, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; PA 2017 70713, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed September 22, 2017; PA 2017 70714, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed September 22, 2017; And PA 2017 70715, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed September 22, 2017; US Provisional Patent Application No. 62/581,025, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed November 2, 2017; International Application PCT/US2018/015603, filed January 26, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; US Patent Application No. 15/894,221, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed on February 12, 2018; US Patent Application No. 15/903,456, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed February 23, 2018; US Provisional Patent Application No. 62/679,955, filed June 3, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; Danish patent application PA 2018 70370, filed on June 12, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; And Danish Patent Application PA 2018 70371, filed on June 12, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION". All of these applications are incorporated herein by reference in their entirety.

Technical field

The present invention relates generally to biometric authentication, and more particularly, to interfaces and techniques for registration and authentication of biometric features.

Biometric authentication of, for example, a face, iris, or fingerprint using electronic devices is a convenient and efficient method of authenticating users of electronic devices. Biometric authentication allows the device to quickly and easily verify the identities of any number of users.

However, some techniques for implementing biometric authentication using electronic devices are generally cumbersome. For example, some existing techniques, such as those relating to facial recognition, require the user to almost completely align the biometric features in the same manner during both the registration of authentication and each iteration. Deviation from alignment of biometric features often leads to false negative results. As a result, the user is optionally required to perform multiple iterations of biometric authentication unnecessarily, or alternatively, is frustrated with using biometric authentication as a whole. As another example, some existing techniques rely solely on a two-dimensional representation of biometric features. As a result, the user's authentication is optionally limited by failing to analyze one or more three-dimensional characteristics of the biometric feature, and also optionally requires the user to unnecessarily perform additional iterations of the biometric authentication. Considering the aforementioned drawbacks, existing techniques require more time than necessary, wasting both user time and device energy. This latter consideration is particularly important in the operation of battery-operated devices.

Thus, the present technique provides electronic devices with faster and more efficient methods and interfaces for implementing biometric authentication. These methods and interfaces, optionally, complement or replace other methods for implementing biometric authentication. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. In the case of battery-operated computing devices, such methods and interfaces save power and increase the time between battery charges. Such methods and interfaces also reduce the number of unnecessary, irrelevant, or repetitive input required in computing devices, such as smartphones and smartwatches.

According to some examples, a method is described, the method comprising: at an electronic device having one or more input devices, one or more biometric sensors, and a display: displaying a first user interface on a display; During the step of displaying the first user interface, detecting the occurrence of a condition corresponding to the introduction of a biometric registration process for registering the biometric features; In response to the step of detecting the occurrence of a condition corresponding to the introduction of the biometric registration process, displaying the biometric registration introduction interface-displaying the biometric registration introduction interface comprises: a representation of a simulation of the biometric features, and Simultaneously displaying the simulated progress indicator; During the step of displaying the biometric registration introduction interface, displaying an educational animation comprising displaying movement of the representation of the simulation of the biometric feature and the incremental advancement of the simulated progress indicator; After displaying at least a portion of the educational animation, detecting occurrence of a condition corresponding to initiation of the biometric registration process; And in response to detecting the occurrence of a condition corresponding to initiation of the biometric registration process: displaying a progress indicator corresponding to the simulated progress indicator; And displaying a representation of the user's biometric features as determined by one or more biometric sensors of the device at a location previously occupied by the representation of the simulation of the biometric feature in the biometric registration introduction interface. do.

According to some examples, a non-transitory computer-readable medium is described, wherein the non-transitory computer-readable storage medium is provided by one or more input devices, one or more biometric sensors, and one or more processors of an electronic device having a display. One or more programs configured to be executed, the one or more programs for displaying a first user interface on a display; While displaying the first user interface, for detecting occurrence of a condition corresponding to the introduction of a biometric registration process for registering the biometric features; In response to detecting the occurrence of a condition corresponding to the introduction of the biometric registration process, for displaying the biometric registration introduction interface-displaying the biometric registration introduction interface is a representation of the simulation of the biometric features, and the simulated Including simultaneously displaying progress indicators; While displaying the biometric registration introduction interface, for displaying an educational animation comprising displaying a movement of the representation of the simulation of the biometric feature and an incremental advancement of the simulated progress indicator; After displaying at least a portion of the educational animation, detecting occurrence of a condition corresponding to initiation of the biometric registration process; And in response to detecting the occurrence of a condition corresponding to the initiation of the biometric registration process: for displaying a progress indicator corresponding to the simulated progress indicator; And instructions for displaying a representation of the user's biometric features as determined by one or more biometric sensors of the device at a location previously occupied by the simulation representation of the biometric feature in the biometric registration introduction interface. Include.

According to some examples, a transitory computer-readable medium is described, wherein the transitory computer-readable storage medium is executed by one or more input devices, one or more biometric sensors, and one or more processors of an electronic device having a display. Comprising one or more programs configured, the one or more programs for displaying a first user interface on a display; While displaying the first user interface, for detecting occurrence of a condition corresponding to the introduction of a biometric registration process for registering the biometric features; In response to detecting the occurrence of a condition corresponding to the introduction of the biometric registration process, for displaying the biometric registration introduction interface-displaying the biometric registration introduction interface is a representation of the simulation of the biometric features, and the simulated Including simultaneously displaying progress indicators; While displaying the biometric registration introduction interface, for displaying an educational animation comprising displaying a movement of the representation of the simulation of the biometric feature and an incremental advancement of the simulated progress indicator; After displaying at least a portion of the educational animation, detecting occurrence of a condition corresponding to initiation of the biometric registration process; And in response to detecting the occurrence of a condition corresponding to the initiation of the biometric registration process: for displaying a progress indicator corresponding to the simulated progress indicator; And instructions for displaying a representation of the user's biometric features as determined by one or more biometric sensors of the device at a location previously occupied by the simulation representation of the biometric feature in the biometric registration introduction interface. Include.

According to some examples, an electronic device is described, the electronic device comprising: one or more input devices; One or more biometric sensors; display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs for displaying a first user interface on a display; While displaying the first user interface, for detecting occurrence of a condition corresponding to the introduction of a biometric registration process for registering the biometric features; In response to detecting the occurrence of a condition corresponding to the introduction of the biometric registration process, for displaying the biometric registration introduction interface-displaying the biometric registration introduction interface is a representation of the simulation of the biometric features, and the simulated Including simultaneously displaying progress indicators; While displaying the biometric registration introduction interface, for displaying an educational animation comprising displaying a movement of the representation of the simulation of the biometric feature and an incremental advancement of the simulated progress indicator; After displaying at least a portion of the educational animation, detecting occurrence of a condition corresponding to initiation of the biometric registration process; And in response to detecting the occurrence of a condition corresponding to the initiation of the biometric registration process: for displaying a progress indicator corresponding to the simulated progress indicator; And instructions for displaying a representation of the user's biometric features as determined by one or more biometric sensors of the device at a location previously occupied by the simulation representation of the biometric feature in the biometric registration introduction interface. Include.

According to some examples, an electronic device is described, the electronic device comprising: one or more input devices; One or more biometric sensors; display; Means for displaying the first user interface on the display; Means for detecting, while displaying the first user interface, an occurrence of a condition corresponding to the introduction of a biometric registration process for registering the biometric features; Means for displaying the biometric registration introduction interface in response to detecting the occurrence of a condition corresponding to the introduction of the biometric registration process-displaying the biometric registration introduction interface is a representation of a simulation of the biometric features, and a simulation Including simultaneously displaying the progress indicators; Means for displaying an educational animation comprising, while displaying the biometric registration introduction interface, displaying a movement of the representation of the simulation of the biometric feature and an incremental advance of the simulated progress indicator; Means for detecting occurrence of a condition corresponding to the initiation of the biometric registration process after displaying at least a portion of the educational animation; And in response to detecting the occurrence of a condition corresponding to the initiation of the biometric registration process: means for displaying a progress indicator corresponding to the simulated progress indicator; And means for displaying a representation of the user's biometric features as determined by one or more biometric sensors of the device at a location previously occupied by the representation of the simulation of the biometric feature in the biometric registration introduction interface. Include.

According to some examples, a method is described, the method comprising: in an electronic device having one or more cameras and a display: displaying a first user interface on a display; During displaying the first user interface, detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; In response to detecting the occurrence of a condition corresponding to initiating the biometric registration process, displaying, on a display, a digital viewfinder including a preview of image data captured by the one or more cameras; And after initiating the biometric registration process: according to a determination that a biometric feature of each type meeting the alignment criteria was detected in the field of view of the one or more cameras: Highlighting the first portion of the field of view; And not highlighting the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras, depending on the determination that each type of biometric feature meeting alignment criteria was not detected in the field of view of the one or more cameras Without maintaining the display of the digital viewfinder.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras and a display, and The one or more programs for displaying a first user interface on a display; While displaying the first user interface, for detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; In response to detecting the occurrence of a condition corresponding to initiating the biometric registration process, for displaying, on the display, a digital viewfinder comprising a preview of image data captured by the one or more cameras; And after initiating the biometric registration process: according to the determination that each type of biometric feature meeting the alignment criteria was detected in the field of view of the one or more cameras, the one or more cameras compared to the second portion of the field of view of the one or more cameras. For highlighting the first portion of the field of view; And according to the determination that each type of biometric feature meeting the alignment criteria was not detected in the field of view of the one or more cameras, it does not highlight the first portion of the field of view of the one or more cameras compared to the second portion of the field of view of the one or more cameras. Contains instructions for maintaining the display of the digital viewfinder without.

According to some examples, a temporary computer-readable medium is described, the temporary computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras and a display, and one or more The above programs are for displaying a first user interface on a display; While displaying the first user interface, for detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; In response to detecting the occurrence of a condition corresponding to initiating the biometric registration process, for displaying, on the display, a digital viewfinder comprising a preview of image data captured by the one or more cameras; And after initiating the biometric registration process: according to the determination that each type of biometric feature meeting the alignment criteria was detected in the field of view of the one or more cameras, the one or more cameras compared to the second portion of the field of view of the one or more cameras. For highlighting the first portion of the field of view; And according to the determination that each type of biometric feature meeting the alignment criteria was not detected in the field of view of the one or more cameras, it does not highlight the first portion of the field of view of the one or more cameras compared to the second portion of the field of view of the one or more cameras. Contains instructions for maintaining the display of the digital viewfinder without.

According to some examples, an electronic device is described, the electronic device comprising: one or more cameras; display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs for displaying a first user interface on a display; While displaying the first user interface, for detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; In response to detecting the occurrence of a condition corresponding to initiating the biometric registration process, for displaying, on the display, a digital viewfinder comprising a preview of image data captured by the one or more cameras; And after initiating the biometric registration process: according to the determination that each type of biometric feature meeting the alignment criteria was detected in the field of view of the one or more cameras, the one or more cameras compared to the second portion of the field of view of the one or more cameras. For highlighting the first portion of the field of view; And according to the determination that each type of biometric feature meeting the alignment criteria was not detected in the field of view of the one or more cameras, it does not highlight the first portion of the field of view of the one or more cameras compared to the second portion of the field of view of the one or more cameras. Contains instructions for maintaining the display of the digital viewfinder without.

According to some examples, an electronic device is described, the electronic device comprising: one or more cameras; display; One or more processors; Means for displaying the first user interface on the display; Means for detecting, while displaying the first user interface, an occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; Means for displaying, on the display, a digital viewfinder comprising a preview of image data captured by one or more cameras in response to detecting the occurrence of a condition corresponding to initiating the biometric registration process; And after initiating the biometric registration process: according to the determination that each type of biometric feature meeting the alignment criteria was detected in the field of view of the one or more cameras, the one or more cameras compared to the second portion of the field of view of the one or more cameras. Means for highlighting the first portion of the field of view; And not highlighting the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras, depending on the determination that each type of biometric feature meeting the alignment criteria was not detected in the field of view of the one or more cameras. And means for maintaining the display of the digital viewfinder without.

According to some examples, a method is described, the method comprising: in an electronic device having one or more biometric sensors and a display: simultaneously displaying a biometric registration interface on a display-displaying the biometric registration interface , A representation of the biometric feature with an orientation determined based on alignment of the biometric feature with respect to one or more biometric sensors of the device, and a first progress indicator at a first location on the display for the representation of the biometric feature. Simultaneously displaying a progress indicator comprising a portion and a second progress indicator portion at a second location on the display for the representation of the biometric feature, wherein the representation of the biometric feature is the first location and the second location on the display. Displayed between positions -; Detecting a change in orientation of the biometric feature with respect to the one or more biometric sensors, while simultaneously displaying the representation and progress indicator of the biometric feature; And in response to detecting a change in orientation of the biometric feature relative to the one or more biometric sensors: the change in orientation of the biometric feature is relative to the first portion of the biometric feature corresponding to the first progress indicator portion. Updating one or more visual characteristics of the first progress indicator portion according to a determination that registration criteria are met; And updating one or more visual characteristics of the second progress indicator portion according to a determination that the change in orientation of the biometric feature satisfies registration criteria for the second portion of the biometric feature corresponding to the second progress indicator portion. Includes steps.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. Wherein the one or more programs for simultaneously displaying the biometric registration interface on the display-displaying the biometric registration interface is determined based on the alignment of the biometric features relative to one or more biometric sensors of the device. A representation of the biometric feature with orientation, and a first progress indicator portion at a first location on the display for the representation of the biometric feature, and a second progress indicator at a second location on the display for the representation of the biometric feature Simultaneously displaying a progress indicator comprising a portion, wherein the representation of the biometric feature is displayed between the first and second locations on the display; While simultaneously displaying a representation of the biometric feature and a progress indicator, detecting a change in orientation of the biometric feature relative to the one or more biometric sensors; And in response to detecting a change in orientation of the biometric feature for one or more biometric sensors: registration of a first portion of the biometric feature corresponding to the first progress indicator portion in which the change in orientation of the biometric feature corresponds to the first progress indicator portion. In accordance with the determination that the criteria are met, updating one or more visual characteristics of the first progress indicator portion; And updating one or more visual characteristics of the second progress indicator portion according to the determination that the change in orientation of the biometric feature satisfies the registration criteria for the second portion of the biometric feature corresponding to the second progress indicator portion. Contains instructions for

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , One or more programs for simultaneously displaying the biometric registration interface on the display-displaying the biometric registration interface determines an orientation determined based on the alignment of the biometric features relative to one or more biometric sensors of the device. A representation of the biometric feature having, and a first progress indicator portion at a first location on the display for the representation of the biometric feature, and a second progress indicator portion at a second location on the display for the representation of the biometric feature. Simultaneously displaying a progress indicator comprising, wherein the representation of the biometric feature is displayed between the first and second locations on the display; While simultaneously displaying a representation of the biometric feature and a progress indicator, detecting a change in orientation of the biometric feature relative to the one or more biometric sensors; And in response to detecting a change in orientation of the biometric feature for one or more biometric sensors: registration of a first portion of the biometric feature corresponding to the first progress indicator portion in which the change in orientation of the biometric feature corresponds to the first progress indicator portion. In accordance with the determination that the criteria are met, updating one or more visual characteristics of the first progress indicator portion; And updating one or more visual characteristics of the second progress indicator portion according to the determination that the change in orientation of the biometric feature satisfies the registration criteria for the second portion of the biometric feature corresponding to the second progress indicator portion. Contains instructions for

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; One or more processors; And a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs are: for simultaneously displaying a biometric registration interface on a display-displaying the biometric registration interface comprises: A representation of the biometric feature with an orientation determined based on the alignment of the biometric feature with respect to one or more biometric sensors, and a first progress indicator portion and a living body at a first location on the display for the representation of the biometric feature. And simultaneously displaying a progress indicator including a second progress indicator portion at a second location on the display for the representation of the measurement feature, wherein the representation of the biometric feature is displayed between the first and second locations on the display. Become -; While simultaneously displaying a representation of the biometric feature and a progress indicator, detecting a change in orientation of the biometric feature relative to the one or more biometric sensors; And in response to detecting a change in orientation of the biometric feature for one or more biometric sensors: registration of a first portion of the biometric feature corresponding to the first progress indicator portion in which the change in orientation of the biometric feature corresponds to the first progress indicator portion. In accordance with the determination that the criteria are met, updating one or more visual characteristics of the first progress indicator portion; And updating one or more visual characteristics of the second progress indicator portion according to the determination that the change in orientation of the biometric feature satisfies the registration criteria for the second portion of the biometric feature corresponding to the second progress indicator portion. Contains instructions for

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; Means for simultaneously displaying the biometric registration interface on a display, wherein displaying the biometric registration interface comprises a biometric feature having an orientation determined based on the alignment of the biometric feature relative to one or more biometric sensors of the device. A progress indicator comprising a representation and a first progress indicator portion at a first location on the display for the representation of the biometric feature and a second progress indicator portion at a second location on the display for the representation of the biometric feature Simultaneously displaying, wherein the representation of the biometric feature is displayed between the first location and the second location on the display; Means for detecting a change in orientation of the biometric feature relative to one or more biometric sensors while simultaneously displaying the representation and progress indicator of the biometric feature; And in response to detecting a change in orientation of the biometric feature with respect to one or more biometric sensors: registration of a first portion of the biometric feature in which the change in orientation of the biometric feature corresponds to the first progress indicator portion. Means for updating one or more visual characteristics of the first progress indicator portion according to a determination that the criteria are met; And updating one or more visual characteristics of the second progress indicator portion according to the determination that the change in orientation of the biometric feature satisfies registration criteria for the second portion of the biometric feature corresponding to the second progress indicator portion. Includes means for.

According to some examples, a method is described, the method comprising, in an electronic device having one or more biometric sensors and a display: displaying, on a display, a biometric registration user interface for registering a biometric feature-a biometric Displaying the measurement registration user interface includes displaying a representation of the biometric feature, wherein an appearance of the representation of the biometric feature changes as the orientation of the biometric feature with respect to the one or more biometric sensors changes; During displaying the biometric registration user interface, detecting that registration prompt criteria have been met with respect to one or more portions of the biometric feature; And in response to detecting that registration prompt criteria have been met with respect to one or more portions of the biometric feature, outputting a respective prompt to move the biometric feature in a respective manner, each The prompt is selected based on the registration status of one or more portions of the biometric feature, and outputting each prompt is associated with a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner. And outputting a prompt to move the biometric feature in a first method, and moving the biometric feature in a second method different from the first method according to a determination that the registration prompt criteria are satisfied. In response to a determination that registration prompt criteria have been met with respect to the second portion of the measurement feature, outputting a prompt to move the biometric feature in a second manner.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. The one or more programs for displaying, on a display, a biometric registration user interface for registering a biometric feature, wherein displaying the biometric registration user interface comprises displaying a representation of the biometric feature, The appearance of the representation of the biometric feature changes as the orientation of the biometric feature with respect to one or more biometric sensors changes; While displaying the biometric registration user interface, for detecting that registration prompt criteria have been met with respect to one or more portions of the biometric feature; And in response to detecting that the registration prompt criteria have been met with respect to one or more portions of the biometric feature, including instructions for outputting a respective prompt to move the biometric feature in a respective manner, each The prompt is selected based on the registration status of one or more portions of the biometric feature, and outputting each prompt is associated with a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner. Biometrics that can be registered by outputting a prompt to move the biometric feature in a first manner, and moving the biometric feature in a second manner different from the first method, upon determination that the registration prompt criteria have been met And in response to determining that registration prompt criteria have been met with respect to the second portion of the feature, outputting a prompt to move the biometric feature in a second manner.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , One or more programs for displaying, on a display, a biometric registration user interface for registering a biometric feature, displaying the biometric registration user interface comprises displaying a representation of the biometric feature, and The appearance of the representation of the feature changes as the orientation of the biometric feature with respect to one or more biometric sensors changes; While displaying the biometric registration user interface, for detecting that registration prompt criteria have been met with respect to one or more portions of the biometric feature; And in response to detecting that the registration prompt criteria have been met with respect to one or more portions of the biometric feature, including instructions for outputting a respective prompt to move the biometric feature in a respective manner, each The prompt is selected based on the registration status of one or more portions of the biometric feature, and outputting each prompt is associated with a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner. Biometrics that can be registered by outputting a prompt to move the biometric feature in a first manner, and moving the biometric feature in a second manner different from the first method, upon determination that the registration prompt criteria have been met And in response to determining that registration prompt criteria have been met with respect to the second portion of the feature, outputting a prompt to move the biometric feature in a second manner.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; One or more processors; And a memory for storing one or more programs configured to be executed by one or more processors, the one or more programs for displaying, on a display, a biometric registration user interface for registering a biometric feature-biometric registration Displaying the user interface includes displaying a representation of the biometric feature, wherein the appearance of the representation of the biometric feature changes as the orientation of the biometric feature with respect to the one or more biometric sensors changes; While displaying the biometric registration user interface, for detecting that registration prompt criteria have been met with respect to one or more portions of the biometric feature; And in response to detecting that the registration prompt criteria have been met with respect to one or more portions of the biometric feature, including instructions for outputting a respective prompt to move the biometric feature in a respective manner, each The prompt is selected based on the registration status of one or more portions of the biometric feature, and outputting each prompt is associated with a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner. Biometrics that can be registered by outputting a prompt to move the biometric feature in a first manner, and moving the biometric feature in a second manner different from the first method, upon determination that the registration prompt criteria have been met And in response to determining that registration prompt criteria have been met with respect to the second portion of the feature, outputting a prompt to move the biometric feature in a second manner.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; Means for displaying, on a display, a biometric registration user interface for registering a biometric feature-displaying the biometric registration user interface comprises displaying a representation of the biometric feature, the appearance of the representation of the biometric feature Changes as the orientation of the biometric feature with respect to one or more biometric sensors changes; Means for detecting, while displaying the biometric registration user interface, that registration prompt criteria have been met with respect to one or more portions of the biometric feature; And, in response to detecting that registration prompt criteria have been met with respect to one or more portions of the biometric feature, means for outputting a respective prompt to move the biometric feature in a respective manner, each The prompt is selected based on the registration status of one or more portions of the biometric feature, and the means for outputting each prompt comprises a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner and In accordance with a determination that the registration prompt criteria have been met in relation to, means for outputting a prompt to move the biometric feature in a first manner, and by moving the biometric feature in a second manner different from the first manner. And means for outputting a prompt to move the biometric feature in a second manner upon determining that registration prompt criteria have been met with respect to the second portion of the biometric feature being present.

According to some examples, a method is described, wherein in an electronic device having one or more biometric sensors and a display: on a display: an application interface corresponding to the application, and a biometric controlled by the operating system of the electronic device. Simultaneously displaying the measurement authentication interface, the biometric authentication interface being displayed over a portion of the application interface; While displaying the biometric authentication interface, obtaining, from one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature; And based on the biometric data, according to a determination that at least a portion of the biometric feature satisfies the biometric authentication criteria: application of authentication information indicating that the biometric authentication criteria were satisfied with respect to one or more portions of the biometric feature. Providing to; And after providing the authentication information to the application, maintaining the display of the biometric authentication interface for a predetermined time.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. And one or more programs for simultaneously displaying on a display: an application interface corresponding to the application, and a biometric authentication interface controlled by the operating system of the electronic device, wherein the biometric authentication interface is displayed over a portion of the application interface. Become -; While displaying the biometric authentication interface, for obtaining, from the one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature; And based on the biometric data, upon determining that at least a portion of the biometric feature satisfies the biometric authentication criteria: application of authentication information indicating that the biometric authentication criteria were satisfied in relation to one or more portions of the biometric feature. For providing to; And instructions for maintaining the display of the biometric authentication interface for a predetermined period of time after providing the authentication information to the application.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , One or more programs, on the display: for simultaneously displaying an application interface corresponding to the application, and a biometric authentication interface controlled by the operating system of the electronic device, the biometric authentication interface displayed over a portion of the application interface. ; While displaying the biometric authentication interface, for obtaining, from the one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature; And based on the biometric data, upon determining that at least a portion of the biometric feature satisfies the biometric authentication criteria: application of authentication information indicating that the biometric authentication criteria were satisfied in relation to one or more portions of the biometric feature. For providing to; And instructions for maintaining the display of the biometric authentication interface for a predetermined period of time after providing the authentication information to the application.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs comprising: on a display: an application interface corresponding to the application, and biometric authentication controlled by the operating system of the electronic device. For simultaneously displaying the interface-the biometric authentication interface is displayed over a portion of the application interface -; While displaying the biometric authentication interface, for obtaining, from the one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature; And based on the biometric data, upon determining that at least a portion of the biometric feature satisfies the biometric authentication criteria: application of authentication information indicating that the biometric authentication criteria were satisfied in relation to one or more portions of the biometric feature. For providing to; And instructions for maintaining the display of the biometric authentication interface for a predetermined period of time after providing the authentication information to the application.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; On the display: means for simultaneously displaying an application interface corresponding to the application, and a biometric authentication interface controlled by the operating system of the electronic device, the biometric authentication interface displayed over a portion of the application interface; Means for obtaining, from one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature, while displaying the biometric authentication interface; And based on the biometric data, according to a determination that at least a portion of the biometric feature satisfies the biometric authentication criteria: application of authentication information indicating that the biometric authentication criteria were satisfied with respect to one or more portions of the biometric feature. Means for providing to; And means for maintaining the display of the biometric authentication interface for a predetermined period of time after providing the authentication information to the application.

According to some examples, a method is described, the method comprising: in an electronic device having one or more biometric sensors and a display: displaying, on a display, an application interface comprising a fillable field; During the step of displaying the application interface, receiving a request to automatically fill in a fillable field of the application interface; And in response to receiving a request to automatically fill in the fillable field of the application interface: according to a determination that the fillable field of the application interface is associated with the first type of data, the fillable field with data of the first type. Automatic filling step; And at least a portion of the biometric feature, wherein the fillable field of the application is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature. And automatically filling the fillable field with data of the second type, upon a determination that they are satisfied.

According to some examples, a non-transitory computer-readable medium is described, wherein the non-transitory computer-readable storage medium contains one or more biometric sensors and one or more programs for execution by one or more processors of an electronic device having a display. And one or more programs for displaying, on a display, an application interface including a fillable field; While displaying the application interface, receiving a request to automatically fill in a fillable field of the application interface; And in response to receiving a request to automatically fill in the fillable field of the application interface: upon determining that the fillable field of the application interface is associated with data of the first type, automatically populate the fillable field with data of the first type. For filling with; And at least a portion of the biometric feature, wherein the fillable field of the application is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature, is a biometric authentication criterion. And instructions for automatically filling the fillable field with data of the second type, upon determination that they are satisfied.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more biometric sensors and one or more programs for execution by one or more processors of an electronic device having a display, The one or more programs for displaying, on a display, an application interface comprising a fillable field; While displaying the application interface, receiving a request to automatically fill in a fillable field of the application interface; And in response to receiving a request to automatically fill in the fillable field of the application interface: upon determining that the fillable field of the application interface is associated with data of the first type, automatically populate the fillable field with data of the first type. For filling with; And at least a portion of the biometric feature, wherein the fillable field of the application is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature, is a biometric authentication criterion. And instructions for automatically filling the fillable field with data of the second type, upon determination that they are satisfied.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs comprising: for displaying, on a display, an application interface comprising a fillable field; While displaying the application interface, receiving a request to automatically fill in a fillable field of the application interface; And in response to receiving a request to automatically fill in the fillable field of the application interface: upon determining that the fillable field of the application interface is associated with data of the first type, automatically populate the fillable field with data of the first type. For filling with; And at least a portion of the biometric feature, wherein the fillable field of the application is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature, is a biometric authentication criterion. And instructions for automatically filling the fillable field with data of the second type, upon determination that they are satisfied.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; Means for displaying, on the display, an application interface comprising a fillable field; Means for receiving a request to automatically fill in a fillable field of the application interface while displaying the application interface; And in response to receiving a request to automatically fill in the fillable field of the application interface: upon determining that the fillable field of the application interface is associated with data of the first type, automatically populate the fillable field with data of the first type. Means for filling with; And at least a portion of the biometric feature, wherein the fillable field of the application is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature. And means for automatically filling the fillable field with data of the second type upon the determination that they are satisfied.

According to some examples, a method is described, the method comprising: at an electronic device having one or more biometric sensors and a display: detecting that device wake criteria have been met; In response to detecting that device wake criteria have been met, transitioning the electronic device from the first visual state to the second visual state; And after transitioning the device to the second visual state: according to a determination that the biometric authentication criteria have been met based on the biometric data provided by the one or more biometric sensors, removing the electronic device from the second visual state. 3 transitioning to a visual state, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; And maintaining the electronic device in a second visual state according to a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors.

According to some examples, a non-transitory computer readable medium is described, wherein the non-transitory computer readable storage medium comprises one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. And the one or more programs for detecting that device wake criteria have been met; In response to detecting that the device wake criteria have been met, for transitioning the electronic device from the first visual state to the second visual state; And after transitioning the device to the second visual state: upon determining that the biometric authentication criteria have been met based on the biometric data provided by the one or more biometric sensors, the electronic device is moved from the second visual state to the third visual state For transitioning to a state-the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; And instructions for maintaining the electronic device in a second visual state according to a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, , One or more programs for detecting that device wake criteria have been met; In response to detecting that the device wake criteria have been met, for transitioning the electronic device from the first visual state to the second visual state; And after transitioning the device to the second visual state: upon determining that the biometric authentication criteria have been met based on the biometric data provided by the one or more biometric sensors, the electronic device is moved from the second visual state to the third visual state For transitioning to a state-the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; And instructions for maintaining the electronic device in a second visual state according to a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; One or more processors; And a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs for: detecting that device wake criteria have been met; In response to detecting that the device wake criteria have been met, for transitioning the electronic device from the first visual state to the second visual state; And after transitioning the device to the second visual state: upon determining that the biometric authentication criteria have been met based on the biometric data provided by the one or more biometric sensors, the electronic device is moved from the second visual state to the third visual state For transitioning to a state-the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; And instructions for maintaining the electronic device in a second visual state according to a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; Means for detecting that device wake criteria have been met; Means for transitioning the electronic device from a first visual state to a second visual state in response to detecting that the device wake criteria have been met; And after transitioning the device to the second visual state: upon determining that the biometric authentication criteria have been met based on the biometric data provided by the one or more biometric sensors, the electronic device is moved from the second visual state to the third visual state. Means for transitioning to a state, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; And means for maintaining the electronic device in a second visual state upon determining that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors.

According to some examples, a method is described, wherein in an electronic device having one or more biometric sensors and a display: while the electronic device is in a locked state, without explicit input from a user requesting biometric authentication. Detecting a condition associated with performing biometric authentication verification using a biometric sensor; And in response to detecting the condition, performing a first biometric authentication verification-performing the first biometric authentication verification comprises: capturing first biometric data using one or more biometric sensors. ; After the step of capturing the first biometric data: transitioning the device from the locked state to the unlocked state according to a determination that the first biometric data satisfies the biometric authentication criteria; And in accordance with the determination that the first biometric data does not satisfy the biometric authentication criteria, maintaining the device in a locked state; After performing the first biometric authentication verification, detecting, through the device, a request to perform each operation without receiving additional authentication information from a user; And in response to detecting a request to perform each operation: performing each operation according to a determination that each operation does not require authentication; Performing each operation according to a determination that each operation requires authentication and the device is in an unlocked state; And upon determination that each operation requires authentication and the device is locked: capturing second biometric data using one or more biometric sensors without explicit input from the user requesting the second biometric authentication confirmation. Step to do; And after the step of capturing the second biometric data, performing a second biometric authentication verification, wherein the step of performing the second biometric authentication verification includes the second biometric data based on the biometric authentication criteria. Performing each operation according to the determination that it is satisfied; And suspending the execution of each operation according to the determination that the second biometric data does not satisfy the biometric authentication criteria.

According to some examples, a non-transitory computer readable medium is described, wherein the non-transitory computer readable storage medium comprises one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. Wherein the one or more programs are configured to detect conditions associated with performing a biometric authentication verification using a biometric sensor without explicit input from a user requesting biometric authentication while the electronic device is in a locked state. for; And in response to detecting the condition, for performing a first biometric authentication verification-performing the first biometric authentication verification comprising: capturing the first biometric data using one or more biometric sensors; After capturing the first biometric data: transitioning the device from the locked state to the unlocked state according to a determination that the first biometric data satisfies the biometric authentication criteria; And in accordance with the determination that the first biometric data does not satisfy the biometric authentication criteria, maintaining the device in a locked state; After performing the first biometric authentication verification, for detecting, through the device, a request to perform each operation without receiving additional authentication information from a user; And in response to detecting a request to perform each operation: to perform each operation, in accordance with a determination that each operation does not require authentication; For performing each operation, in accordance with a determination that each operation requires authentication and the device is in an unlocked state; And upon determination that each action requires authentication and the device is locked: captures second biometric data using one or more biometric sensors without explicit input from the user requesting the second biometric authentication verification. To do; And after capturing the second biometric data, including instructions for performing the second biometric authentication verification, and performing the second biometric authentication verification, the second biometric data satisfies the biometric authentication criteria. Depending on the decision, performing each action; And suspending the execution of each operation according to the determination that the second biometric data does not satisfy the biometric authentication criteria.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , One or more programs for detecting a condition associated with performing biometric authentication verification using a biometric sensor without explicit input from a user requesting biometric authentication while the electronic device is in a locked state; And in response to detecting the condition, for performing a first biometric authentication verification-performing the first biometric authentication verification comprising: capturing the first biometric data using one or more biometric sensors; After capturing the first biometric data: transitioning the device from the locked state to the unlocked state according to a determination that the first biometric data satisfies the biometric authentication criteria; And in accordance with the determination that the first biometric data does not satisfy the biometric authentication criteria, maintaining the device in a locked state; After performing the first biometric authentication verification, for detecting, through the device, a request to perform each operation without receiving additional authentication information from a user; And in response to detecting a request to perform each operation: to perform each operation, in accordance with a determination that each operation does not require authentication; For performing each operation, in accordance with a determination that each operation requires authentication and the device is in an unlocked state; And upon determination that each action requires authentication and the device is locked: captures second biometric data using one or more biometric sensors without explicit input from the user requesting the second biometric authentication verification. To do; And after capturing the second biometric data, including instructions for performing the second biometric authentication verification, and performing the second biometric authentication verification, the second biometric data satisfies the biometric authentication criteria. Depending on the decision, performing each action; And suspending the execution of each operation according to the determination that the second biometric data does not satisfy the biometric authentication criteria.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, wherein the one or more programs are: biometrics without explicit input from a user requesting biometric authentication while the electronic device is in a locked state. For detecting a condition associated with performing biometric authentication verification using the sensor; And in response to detecting the condition, for performing a first biometric authentication verification-performing the first biometric authentication verification comprising: capturing the first biometric data using one or more biometric sensors; After capturing the first biometric data: transitioning the device from the locked state to the unlocked state according to a determination that the first biometric data satisfies the biometric authentication criteria; And in accordance with the determination that the first biometric data does not satisfy the biometric authentication criteria, maintaining the device in a locked state; After performing the first biometric authentication verification, for detecting, through the device, a request to perform each operation without receiving additional authentication information from a user; And in response to detecting a request to perform each operation: to perform each operation, in accordance with a determination that each operation does not require authentication; For performing each operation, in accordance with a determination that each operation requires authentication and the device is in an unlocked state; And upon determination that each action requires authentication and the device is locked: captures second biometric data using one or more biometric sensors without explicit input from the user requesting the second biometric authentication verification. To do; And after capturing the second biometric data, including instructions for performing the second biometric authentication verification, and performing the second biometric authentication verification, the second biometric data satisfies the biometric authentication criteria. Depending on the decision, performing each action; And suspending the execution of each operation according to the determination that the second biometric data does not satisfy the biometric authentication criteria.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; Means for detecting a condition associated with performing biometric authentication verification using a biometric sensor without explicit input from a user requesting biometric authentication while the electronic device is in a locked state; And, in response to detecting the condition, means for performing a first biometric authentication verification, the means for performing a first biometric authentication verification comprising: capturing the first biometric data using one or more biometric sensors. Means for; After capturing the first biometric data: means for transitioning the device from a locked state to an unlocked state in response to a determination that the first biometric data satisfies the biometric authentication criteria; And means for holding the device in a locked state upon determining that the first biometric data does not satisfy the biometric authentication criteria; Means for detecting, through the device, a request to perform each operation without receiving additional authentication information from a user after performing the first biometric authentication verification; And in response to detecting a request to perform each operation: means for performing each operation, in accordance with a determination that each operation does not require authentication; Means for performing each operation in response to a determination that each operation requires authentication and the device is in an unlocked state; And upon determination that each operation requires authentication and the device is locked: capturing second biometric data using one or more biometric sensors without explicit input from the user requesting the second biometric authentication confirmation. Means for doing; And means for performing a second biometric authentication verification after capturing the second biometric data, wherein the means for performing the second biometric authentication verification comprises: Means for performing each action upon determination of satisfaction; And means for suspending the execution of each operation according to the determination that the second biometric data does not satisfy the biometric authentication criteria.

According to some examples, a method is described, the method comprising: in an electronic device having a display, a button, and one or more biometric sensors separate from the button: the electronic device is a first, wherein each function of the device is disabled. While in the state, detecting one or more activations of the button; And in response to detecting one or more activations of the button: capturing biometric data with one or more biometric sensors separate from the button; Upon determining that the biometric data satisfies the biometric authentication criteria, transitioning the electronic device to a second state in which each function of the device is enabled; And upon determining that the biometric data does not satisfy the biometric authentication criteria, maintaining the electronic device in a first state and displaying an indication on the display that the biometric authentication has failed.

According to some examples, a non-transitory computer readable medium is described, wherein the non-transitory computer readable storage medium is provided by one or more processors of an electronic device having a display, a button, and one or more biometric sensors separate from the button. One or more programs configured to be executed, the one or more programs for detecting one or more activations of the button while the electronic device is in a first state in which each function of the device is disabled; And in response to detecting one or more activations of the button: for capturing biometric data with one or more biometric sensors separate from the button; In response to a determination that the biometric data satisfies the biometric authentication criteria, transitioning the electronic device to a second state in which each function of the device is enabled; And instructions for maintaining the electronic device in a first state and displaying an indication that the biometric authentication has failed on the display according to the determination that the biometric data does not satisfy the biometric authentication criteria.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium being executed by one or more processors of an electronic device having a display, a button, and one or more biometric sensors separate from the button. Configured one or more programs, the one or more programs for detecting one or more activations of the button while the electronic device is in a first state in which each function of the device is disabled; And in response to detecting one or more activations of the button: for capturing biometric data with one or more biometric sensors separate from the button; In response to a determination that the biometric data satisfies the biometric authentication criteria, transitioning the electronic device to a second state in which each function of the device is enabled; And instructions for maintaining the electronic device in a first state and displaying an indication that the biometric authentication has failed on the display according to the determination that the biometric data does not satisfy the biometric authentication criteria.

According to some examples, an electronic device is described, the electronic device comprising: a display; button; One or more biometric sensors separate from the button; One or more processors; And a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: one or more of the buttons while the electronic device is in a first state in which each function of the device is disabled. For detecting activations; And in response to detecting one or more activations of the button: for capturing biometric data with one or more biometric sensors separate from the button; In response to a determination that the biometric data satisfies the biometric authentication criteria, transitioning the electronic device to a second state in which each function of the device is enabled; And instructions for maintaining the electronic device in a first state and displaying an indication that the biometric authentication has failed on the display according to the determination that the biometric data does not satisfy the biometric authentication criteria.

According to some examples, an electronic device is described, the electronic device comprising: a display; button; One or more biometric sensors separate from the button; Means for detecting one or more activations of the button while the electronic device is in a first state in which each function of the device is disabled; And in response to detecting one or more activations of the button: means for capturing biometric data with one or more biometric sensors separate from the button; Means for transitioning the electronic device to a second state in which respective functions of the device are enabled in response to a determination that the biometric data satisfies the biometric authentication criteria; And means for maintaining the electronic device in a first state and displaying an indication on the display that the biometric authentication has failed, upon determining that the biometric data does not satisfy the biometric authentication criteria.

According to some examples, a method is described, the method comprising: at an electronic device having one or more biometric sensors and a display: detecting a request to perform each operation requiring authentication; And in response to detecting a request to perform each operation requiring authentication: performing each operation according to a determination that the device is unlocked; And upon determination that the device is locked and that a first form of authentication is available for use-the first form of authentication is a form of biometric authentication based on data obtained by one or more biometric sensors-on the display At, displaying an authentication indicator for the first form of authentication without displaying one or more affordances for using the second form of authentication.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. And one or more programs for detecting a request to perform each operation requiring authentication; And in response to detecting a request to perform each operation requiring authentication: to perform each operation, in accordance with a determination that the device is unlocked; And upon determination that the device is locked and that the first form of authentication is available for use-the first form of authentication is a form of biometric authentication based on data acquired by one or more biometric sensors-on the display E, instructions for displaying an authentication indicator for the first form of authentication without displaying one or more affordances for using the second form of authentication.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, , One or more programs for detecting a request to perform each operation requiring authentication; And in response to detecting a request to perform each operation requiring authentication: to perform each operation, in accordance with a determination that the device is unlocked; And upon determination that the device is locked and that the first form of authentication is available for use-the first form of authentication is a form of biometric authentication based on data acquired by one or more biometric sensors-on the display E, instructions for displaying an authentication indicator for the first form of authentication without displaying one or more affordances for using the second form of authentication.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs comprising: for detecting a request to perform each operation requiring authentication; And in response to detecting a request to perform each operation requiring authentication: to perform each operation, in accordance with a determination that the device is unlocked; And upon determination that the device is locked and that the first form of authentication is available for use-the first form of authentication is a form of biometric authentication based on data acquired by one or more biometric sensors-on the display E, instructions for displaying an authentication indicator for the first form of authentication without displaying one or more affordances for using the second form of authentication.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; Means for detecting a request to perform each operation requiring authentication; And in response to detecting a request to perform each operation requiring authentication: means for performing each operation in response to a determination that the device is unlocked; And upon determination that the device is locked and that a first form of authentication is available for use-the first form of authentication is a form of biometric authentication based on data obtained by one or more biometric sensors-on the display At, means for displaying an authentication indicator for the first type of authentication without displaying one or more affordances for using the second type of authentication.

According to some examples, a method is described, the method comprising: at an electronic device having one or more biometric sensors: receiving a first request to perform each operation requiring authentication; In response to receiving the first request to perform each action: determining whether the biometric authentication criteria are met using one or more biometric sensors-the biometric authentication criteria to perform each action Including the requirement that each type of biometric feature being applied is detected by the biometric sensors; Performing each operation according to a determination that the biometric authentication criteria are satisfied; And suspending performing each operation according to the determination that the biometric authentication criteria are not met. Subsequent to determining that the biometric authentication criteria have not been met in response to receiving the first request, receiving a second request to perform each operation; And in response to receiving a second request to perform each operation: biometric authentication criteria in response to the first request because one or more biometric sensors fail to detect the presence of each type of biometric feature. In response to a determination that it has not been met, determining whether biometric authentication criteria are met using the one or more biometric sensors in response to the second request; And a second request according to a determination that the biometric authentication criteria have not been met in response to the first request due to the one or more biometric sensors detecting each type of biometric feature that does not correspond to the applied biometric feature. In response to withholding determining whether the biometric authentication criteria are met using the one or more biometric sensors.

According to some examples, a non-transitory computer-readable medium is described, wherein the non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, and The one or more programs for receiving a first request to perform a respective operation requiring authentication; In response to receiving the first request to perform each action: to determine whether the biometric authentication criteria are met using one or more biometric sensors-the biometric authentication criteria are authorized to perform each action Including the requirement that each type of biometric feature being detected by the biometric sensors; In accordance with the determination that the biometric authentication criteria are met, for performing each operation; And in accordance with the determination that the biometric authentication criteria are not met, for withholding performing each operation; Subsequent to determining that the biometric authentication criteria have not been met in response to receiving the first request, receiving a second request to perform each operation; And in response to receiving a second request to perform each action: biometric authentication criteria are met in response to the first request because one or more biometric sensors fail to detect the presence of each type of biometric feature. In response to a second request, determining whether biometric authentication criteria are met using one or more biometric sensors; And according to a determination that the biometric authentication criteria have not been satisfied in response to the first request due to the one or more biometric sensors detecting each type of biometric feature that does not correspond to the applied biometric feature, the second request In response to using one or more biometric sensors to withhold determining whether the biometric authentication criteria are met.

According to some examples, a transitory computer-readable medium is described, wherein the transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, and Programs for receiving a first request to perform each operation requiring authentication; In response to receiving the first request to perform each action: to determine whether the biometric authentication criteria are met using one or more biometric sensors-the biometric authentication criteria are authorized to perform each action Including the requirement that each type of biometric feature being detected by the biometric sensors; In accordance with the determination that the biometric authentication criteria are met, for performing each operation; And in accordance with the determination that the biometric authentication criteria are not met, for withholding performing each operation; Subsequent to determining that the biometric authentication criteria have not been met in response to receiving the first request, receiving a second request to perform each operation; And in response to receiving a second request to perform each action: biometric authentication criteria are met in response to the first request because one or more biometric sensors fail to detect the presence of each type of biometric feature. In response to a second request, determining whether biometric authentication criteria are met using one or more biometric sensors; And according to a determination that the biometric authentication criteria have not been satisfied in response to the first request due to the one or more biometric sensors detecting each type of biometric feature that does not correspond to the applied biometric feature, the second request In response to using one or more biometric sensors to withhold determining whether the biometric authentication criteria are met.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs comprising: for receiving a first request to perform each operation requiring authentication; In response to receiving the first request to perform each action: to determine whether the biometric authentication criteria are met using one or more biometric sensors-the biometric authentication criteria are authorized to perform each action Including the requirement that each type of biometric feature being detected by the biometric sensors; In accordance with the determination that the biometric authentication criteria are met, for performing each operation; And in accordance with the determination that the biometric authentication criteria are not met, for withholding performing each operation; Subsequent to determining that the biometric authentication criteria have not been met in response to receiving the first request, receiving a second request to perform each operation; And in response to receiving a second request to perform each action: biometric authentication criteria are met in response to the first request because one or more biometric sensors fail to detect the presence of each type of biometric feature. In response to a second request, determining whether biometric authentication criteria are met using one or more biometric sensors; And according to a determination that the biometric authentication criteria have not been satisfied in response to the first request due to the one or more biometric sensors detecting each type of biometric feature that does not correspond to the applied biometric feature, the second request In response to using one or more biometric sensors to withhold determining whether the biometric authentication criteria are met.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; Means for receiving a first request to perform each operation requiring authentication; In response to receiving the first request to perform each action: to determine whether the biometric authentication criteria are met using one or more biometric sensors-the biometric authentication criteria are authorized to perform each action Including the requirement that each type of biometric feature being detected by the biometric sensors; In accordance with the determination that the biometric authentication criteria are met, for performing each operation; And, according to a determination that the biometric authentication criteria are not met, means for withholding performing each operation; Means for receiving a second request to perform each action following a determination that the biometric authentication criteria have not been met in response to receiving the first request; And in response to receiving the second request to perform each action: biometric authentication criteria are met in response to the first request due to one or more biometric sensors failing to detect the presence of each type of biometric feature. In response to a second request, determining whether biometric authentication criteria are met using one or more biometric sensors; And according to a determination that the biometric authentication criteria have not been satisfied in response to the first request due to the one or more biometric sensors detecting each type of biometric feature that does not correspond to the applied biometric feature, the second request In response to using one or more biometric sensors to withhold determining whether the biometric authentication criteria are met.

According to some examples, a method is described, the method comprising: at an electronic device having one or more biometric sensors: receiving a first request to perform a first operation requiring authentication; In response to receiving a first request to perform a first action: determining whether the first biometric authentication criteria are met using one or more biometric sensors-the first biometric authentication criteria are: Including the requirement that each type of biometric feature that is authorized to perform an action is detected by the biometric sensors; Performing a first operation according to a determination that the first biometric authentication criteria are satisfied; And suspending performing the first operation according to the determination that the biometric authentication criteria are not met. After performing the first operation, receiving a second request to perform a second operation requesting authentication; And in response to receiving the second request: according to a determination that the re-authentication criteria have been met, determining whether the second biometric authentication criteria are met using one or more biometric sensors-the second biometric authentication The criteria include the requirement that each type of biometric feature that is applied to perform the second operation is detected by the biometric sensors; And performing a second operation without performing biometric authentication, and determining whether the second biometric authentication criteria are met using one or more biometric sensors, according to a determination that the re-authentication criteria have not been met. It includes the step of.

According to some examples, a non-transitory computer-readable medium is described, wherein the non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, and The one or more programs are configured to receive a first request to perform a first operation requiring authentication; In response to receiving a first request to perform a first action: for determining whether the first biometric authentication criteria are met using one or more biometric sensors-the first biometric authentication criteria are: Including the requirement that each type of biometric feature that is applied to perform the operation is detected by the biometric sensors; In accordance with a determination that the first biometric authentication criteria are met, performing a first operation; And in accordance with the determination that the biometric authentication criteria are not satisfied, for withholding performing the first operation; After performing the first operation, receiving a second request to perform a second operation requesting authentication; And in response to receiving the second request: for determining whether the second biometric authentication criteria are met using one or more biometric sensors, in accordance with a determination that the re-authentication criteria have been met-a second biometric authentication criterion. Include the requirement that each type of biometric feature that is applied to perform the second operation is detected by the biometric sensors; And according to the determination that the re-authentication criteria have not been met, performing the second operation without performing biometric authentication, and withholding the determination of whether the second biometric authentication criteria are met using one or more biometric sensors. Contains instructions for

According to some examples, a transitory computer-readable medium is described, wherein the transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, and Programs for receiving a first request to perform a first operation requiring authentication; In response to receiving a first request to perform a first action: for determining whether the first biometric authentication criteria are met using one or more biometric sensors-the first biometric authentication criteria are: Including the requirement that each type of biometric feature that is applied to perform the operation is detected by the biometric sensors; In accordance with a determination that the first biometric authentication criteria are met, performing a first operation; And in accordance with the determination that the biometric authentication criteria are not satisfied, for withholding performing the first operation; After performing the first operation, receiving a second request to perform a second operation requesting authentication; And in response to receiving the second request: for determining whether the second biometric authentication criteria are met using one or more biometric sensors, in accordance with a determination that the re-authentication criteria have been met-a second biometric authentication criterion. Include the requirement that each type of biometric feature that is applied to perform the second operation is detected by the biometric sensors; And according to the determination that the re-authentication criteria have not been met, performing the second operation without performing biometric authentication, and withholding the determination of whether the second biometric authentication criteria are met using one or more biometric sensors. Contains instructions for

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs comprising: for receiving a first request to perform a first operation requiring authentication; In response to receiving a first request to perform a first action: for determining whether the first biometric authentication criteria are met using one or more biometric sensors-the first biometric authentication criteria are: Including the requirement that each type of biometric feature that is applied to perform the operation is detected by the biometric sensors; In accordance with a determination that the first biometric authentication criteria are met, performing a first operation; And in accordance with the determination that the biometric authentication criteria are not satisfied, for withholding performing the first operation; After performing the first operation, receiving a second request to perform a second operation requesting authentication; And in response to receiving the second request: for determining whether the second biometric authentication criteria are met using one or more biometric sensors, in accordance with a determination that the re-authentication criteria have been met-a second biometric authentication criterion. Include the requirement that each type of biometric feature that is applied to perform the second operation is detected by the biometric sensors; And according to the determination that the re-authentication criteria have not been met, performing the second operation without performing biometric authentication, and withholding the determination of whether the second biometric authentication criteria are met using one or more biometric sensors. Contains instructions for

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; Means for receiving a first request to perform a first operation requiring authentication; In response to receiving a first request to perform a first action: for determining whether the first biometric authentication criteria are met using one or more biometric sensors-the first biometric authentication criteria are: Including the requirement that each type of biometric feature that is applied to perform the operation is detected by the biometric sensors; In accordance with a determination that the first biometric authentication criteria are met, performing a first operation; And, according to a determination that the biometric authentication criteria are not met, means for withholding performing the first operation; Means for receiving, after performing the first operation, a second request to perform a second operation requiring authentication; And in response to receiving the second request: according to a determination that the re-authentication criteria have been met, for determining whether the second biometric authentication criteria are met using one or more biometric sensors-a second biometric authentication criterion. Include the requirement that each type of biometric feature that is applied to perform the second operation is detected by the biometric sensors; And according to the determination that the re-authentication criteria have not been met, performing the second operation without performing biometric authentication, and withholding the determination of whether the second biometric authentication criteria are met using one or more biometric sensors. Includes means for.

According to some examples, a method is described, the method comprising: at an electronic device having a display: receiving a request to display a first portion of each content; And in response to a request to display a first portion of each content: displaying at least a first portion of each content on a display, each content including an element associated with an authentication operation; Initiating biometric authentication according to a determination that an element associated with the authentication operation meets the visibility criteria; And in accordance with the determination that the element associated with the authentication operation does not meet the visibility criteria, withholding the step of initiating biometric authentication.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display, the one or more programs , For receiving a request to display a first portion of each content; And in response to a request to display a first portion of each content: for displaying at least a first portion of each content on a display, each content including an element associated with an authentication operation; In accordance with a determination that an element associated with the authentication operation meets the visibility criteria, initiating biometric authentication; And instructions for withholding initiating biometric authentication according to the determination that the element associated with the authentication operation does not meet the visibility criteria.

According to some examples, a temporary computer-readable medium is described, the temporary computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display, the one or more programs, each For receiving a request to display a first portion of the content of the; And in response to a request to display a first portion of each content: for displaying at least a first portion of each content on a display, each content including an element associated with an authentication operation; In accordance with a determination that an element associated with the authentication operation meets the visibility criteria, initiating biometric authentication; And instructions for withholding initiating biometric authentication according to the determination that the element associated with the authentication operation does not meet the visibility criteria.

According to some examples, an electronic device is described, the electronic device comprising: a display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs for: receiving a request to display a first portion of each content; And in response to a request to display a first portion of each content: for displaying at least a first portion of each content on a display, each content including an element associated with an authentication operation; In accordance with a determination that an element associated with the authentication operation meets the visibility criteria, initiating biometric authentication; And instructions for withholding initiating biometric authentication according to the determination that the element associated with the authentication operation does not meet the visibility criteria.

According to some examples, an electronic device is described, the electronic device comprising: a display; Means for receiving a request to display a first portion of each content; And in response to a request to display a first portion of each content: for displaying at least a first portion of each content on a display, each content including an element associated with an authentication operation; In accordance with a determination that an element associated with the authentication operation meets the visibility criteria, initiating biometric authentication; And means for withholding initiating biometric authentication upon determination that the element associated with the authentication operation does not meet the visibility criteria.

According to some examples, a method is described, the method comprising, in an electronic device having a display and one or more biometric sensors: detecting a predefined action corresponding to a credential submitting user interface having a credential submitting user interface element. step; And in response to detecting the predefined action: biometric features that meet the biometric authentication criteria on the display according to a determination that biometric authentication via the one or more biometric sensors is available. Presenting to the sensors includes displaying a credential submission user interface with a visual indication that the credentials will be submitted via the credential submission user interface element.

According to some examples, a non-transitory computer readable medium is described, wherein the non-transitory computer readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. And the one or more programs for detecting a predefined action corresponding to a credential submission user interface having a credential submission user interface element; And in response to detecting the predefined action: upon determining that biometric authentication through the one or more biometric sensors is available, a biometric feature that meets the biometric authentication criteria is placed on the display. Include instructions for displaying a credential submission user interface with a visual indication that presenting to the field will cause the credentials to be submitted via the credential submission user interface element.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, and The one or more programs for detecting a predefined action corresponding to a credential submitting user interface having a credential submitting user interface element; And in response to detecting the predefined action: upon determining that biometric authentication through the one or more biometric sensors is available, a biometric feature that meets the biometric authentication criteria is placed on the display. Include instructions for displaying a credential submission user interface with a visual indication that presenting to the field will cause the credentials to be submitted via the credential submission user interface element.

According to some examples, an electronic device is described, the electronic device comprising: a display; One or more biometric sensors; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs for detecting a predefined action corresponding to a credential submitting user interface having a credential submitting user interface element. ; And in response to detecting the predefined action: upon determining that biometric authentication through the one or more biometric sensors is available, a biometric feature that meets the biometric authentication criteria is placed on the display. Include instructions for displaying a credential submission user interface with a visual indication that presenting to the field will cause the credentials to be submitted via the credential submission user interface element.

According to some examples, an electronic device is described, the electronic device comprising: a display; One or more biometric sensors; Means for detecting a predefined action corresponding to a credential submitting user interface having a credential submitting user interface element; And in response to detecting the predefined action: upon determining that biometric authentication through the one or more biometric sensors is available, the one or more biometric sensors with biometric features that meet the biometric authentication criteria on the display. The presentation to the field includes means for displaying a credential submission user interface with a visual indication that the credential will be submitted via the credential submission user interface element.

According to some examples, a method is described, the method comprising, in an electronic device having a touch-sensitive display and one or more biometric sensors: on a touch-sensitive display, a credential input user interface having a plurality of character input keys. Displaying; Receiving, via the touch-sensitive display, a touch gesture input including movement of a contact on the touch-sensitive display during displaying the credential input user interface; And in response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display: according to a determination that one or more criteria of the first set are met-the one or more criteria of the first set are Including the requirement to be currently enabled on the electronic device-attempting to biometrically authenticate a user of the electronic device based on the biometric information captured using one or more biometric sensors.

According to some examples, a non-transitory computer-readable medium is described, wherein the non-transitory computer-readable storage medium comprises one or more processors configured to be executed by one or more processors of an electronic device having a touch-sensitive display and one or more biometric sensors. Programs, the one or more programs for displaying, on a touch-sensitive display, a credential input user interface having a plurality of character input keys; While displaying the credential input user interface, for receiving, via the touch-sensitive display, a touch gesture input including movement of a contact on the touch-sensitive display; And in response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display: according to a determination that one or more criteria of the first set are met-the one or more criteria of the first set are Includes the requirement to be currently enabled on the device—instructions to attempt to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a touch-sensitive display and one or more biometric sensors. And the one or more programs for displaying, on a touch-sensitive display, a credential input user interface having a plurality of character input keys; While displaying the credential input user interface, for receiving, via the touch-sensitive display, a touch gesture input including movement of a contact on the touch-sensitive display; And in response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display: according to a determination that one or more criteria of the first set are met-the one or more criteria of the first set are Includes the requirement to be currently enabled on the device—instructions to attempt to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; Touch-sensitive display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs for: displaying, on a touch-sensitive display, a credential input user interface having a plurality of character input keys; While displaying the credential input user interface, for receiving, via the touch-sensitive display, a touch gesture input including movement of a contact on the touch-sensitive display; And in response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display: according to a determination that one or more criteria of the first set are met-the one or more criteria of the first set are Includes the requirement to be currently enabled on the device—instructions to attempt to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; Touch-sensitive display; Means for displaying, on the touch-sensitive display, a credential input user interface having a plurality of character input keys; Means for receiving, through the touch-sensitive display, a touch gesture input comprising movement of a contact on the touch-sensitive display while displaying the credential input user interface; And in response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display: according to a determination that one or more criteria of the first set are met-the one or more criteria of the first set are And a requirement to be currently enabled on the device—means for attempting to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors.

In accordance with some embodiments, a method is described, the method comprising: at an electronic device having a display and one or more input devices: receiving, via one or more input devices, a request to perform an operation requiring authentication; And in response to a request to perform an operation requiring authentication: performing an operation according to a determination that authentication is successful. And according to a determination that the authentication is not successful and the set of error condition criteria is satisfied: displaying an indication of the error condition on a display, the indication comprising information about the cause of the error condition; And suspending the step of performing the operation.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, and The one or more programs for receiving, via one or more input devices, a request to perform an operation requiring authentication; And in response to a request to perform an operation requiring authentication: in accordance with a determination that authentication is successful, to perform an operation; And in accordance with the determination that the authentication is not successful and the set of error condition criteria is met: for displaying an indication of the error condition on the display, the indication containing information about the cause of the error condition; And instructions for suspending performing the operation.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, and The above programs include, through one or more input devices, for receiving a request to perform an operation requiring authentication; And in response to a request to perform an operation requiring authentication: in accordance with a determination that authentication is successful, to perform an operation; And in accordance with the determination that the authentication is not successful and the set of error condition criteria is met: for displaying an indication of the error condition on the display, the indication containing information about the cause of the error condition; And instructions for suspending performing the operation.

According to some examples, an electronic device is described, the electronic device comprising: one or more input devices; display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs for: receiving, via one or more input devices, a request to perform an operation requiring authentication; And in response to a request to perform an operation requiring authentication: in accordance with a determination that authentication is successful, to perform an operation; And in accordance with the determination that the authentication is not successful and the set of error condition criteria is met: for displaying an indication of the error condition on the display, the indication containing information about the cause of the error condition; And instructions for suspending performing the operation.

According to some examples, an electronic device is described, the electronic device comprising: one or more input devices; display; Means for receiving, via one or more input devices, a request to perform an operation requiring authentication; And in response to a request to perform an operation requiring authentication: to perform an operation according to a determination that authentication is successful; And in accordance with the determination that the authentication is not successful and the set of error condition criteria is met: for displaying an indication of the error condition on the display, the indication containing information about the cause of the error condition; And means for withholding performing the operation.

According to some examples, a method is described, the method comprising: in an electronic device having a biometric sensor and a display in a first part of the electronic device: preventing the biometric sensor from acquiring biometric information about a user of the device Detecting the presence of an error condition to be determined; And in response to detecting the presence of the error condition, displaying an error indication on the display, the error indication being displayed at a location proximate the first portion of the electronic device, and displaying the error indication, In response to a determination that the user interface of the electronic device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; And upon determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying an error indication at a second location in the user interface proximate the first portion of the electronic device, the first orientation. Is different from the second orientation.

According to some examples, a non-transitory computer-readable medium is described, wherein the non-transitory computer-readable storage medium is executed by one or more processors of an electronic device having a biometric sensor and a display in a first portion of the electronic device. Configured to include one or more programs, the one or more programs for detecting the presence of an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; And in response to detecting the presence of an error condition, including instructions for displaying an error indication on the display, the error indication being displayed at a location proximate to the first part of the electronic device, and displaying the error indication is electronic In response to determining that the user interface of the device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; And upon determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying an error indication at a second location in the user interface proximate the first portion of the electronic device, wherein the first orientation is It is different from the second orientation.

According to some examples, a transitory computer-readable medium is described, wherein the transitory computer-readable storage medium is one configured to be executed by one or more processors of an electronic device having a biometric sensor and a display in a first portion of the electronic device. The one or more programs comprising: for detecting the presence of an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; And in response to detecting the presence of an error condition, including instructions for displaying an error indication on the display, the error indication being displayed at a location proximate to the first part of the electronic device, and displaying the error indication is electronic In response to determining that the user interface of the device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; And upon determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying an error indication at a second location in the user interface proximate the first portion of the electronic device, wherein the first orientation is It is different from the second orientation.

According to some examples, an electronic device is described, the electronic device comprising: a biometric sensor in a first portion of the electronic device; display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs: detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device. To do; And in response to detecting the presence of an error condition, including instructions for displaying an error indication on the display, the error indication being displayed at a location proximate to the first part of the electronic device, and displaying the error indication is electronic In response to determining that the user interface of the device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; And upon determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying an error indication at a second location in the user interface proximate the first portion of the electronic device, wherein the first orientation is It is different from the second orientation.

According to some examples, an electronic device is described, the electronic device comprising: a biometric sensor in a first portion of the electronic device; display; Means for detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; And, in response to detecting the presence of an error condition, means for displaying an error indication on the display, wherein the error indication is displayed at a location proximate to the first portion of the electronic device, and displaying the error indication comprises: In response to determining that the user interface of the device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; And upon determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying an error indication at a second location in the user interface proximate the first portion of the electronic device, wherein the first orientation is It is different from the second orientation.

According to some examples, a method is described, the method comprising, in an electronic device having a display and one or more biometric sensors: on the display, a biometric registration user interface for initiating biometric registration with one or more biometric sensors Displaying a; During displaying the biometric registration user interface, receiving an input corresponding to the request to initiate biometric registration; And in response to receiving the input: initiating a process for registering the biometric feature with one or more biometric sensors in response to a determination that the orientation of the electronic device satisfies the set of registration criteria; And in response to determining that the orientation of the electronic device does not satisfy the set of registration criteria, outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of registration criteria.

According to some examples, a non-transitory computer readable medium is described, wherein the non-transitory computer readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. And the one or more programs for displaying, on a display, a biometric registration user interface for initiating biometric registration with one or more biometric sensors; While displaying the biometric registration user interface, receiving an input corresponding to a request to initiate biometric registration; And in response to receiving the input: in response to a determination that the orientation of the electronic device satisfies the set of registration criteria, initiating a process for registering the biometric feature with one or more biometric sensors; And in accordance with the determination that the orientation of the electronic device does not satisfy the set of registration criteria, instructions for outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of registration criteria.

According to some examples, a transitory computer-readable medium is described, the transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, The one or more programs for displaying, on a display, a biometric registration user interface for initiating biometric registration with one or more biometric sensors; While displaying the biometric registration user interface, receiving an input corresponding to a request to initiate biometric registration; And in response to receiving the input: in response to a determination that the orientation of the electronic device satisfies the set of registration criteria, initiating a process for registering the biometric feature with one or more biometric sensors; And in accordance with the determination that the orientation of the electronic device does not satisfy the set of registration criteria, instructions for outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of registration criteria.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; One or more processors; And a memory storing one or more programs configured to be executed by one or more processors, the one or more programs comprising: on a display, a biometric registration user interface for initiating biometric registration with one or more biometric sensors. For display; While displaying the biometric registration user interface, receiving an input corresponding to a request to initiate biometric registration; And in response to receiving the input: in response to a determination that the orientation of the electronic device satisfies the set of registration criteria, initiating a process for registering the biometric feature with one or more biometric sensors; And in accordance with the determination that the orientation of the electronic device does not satisfy the set of registration criteria, instructions for outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of registration criteria.

According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; display; Means for displaying, on the display, a biometric registration user interface for initiating biometric registration with one or more biometric sensors; Means for receiving an input corresponding to a request to initiate biometric registration while displaying the biometric registration user interface; And in response to receiving the input: initiating a process for registering the biometric feature with one or more biometric sensors, in response to determining that the orientation of the electronic device satisfies the set of registration criteria; And, in accordance with the determination that the orientation of the electronic device does not satisfy the set of registration criteria, means for outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of registration criteria.

Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are, optionally, included in a temporary computer readable storage medium or other computer program product configured for execution by one or more processors.

Thus, devices are provided with faster and more efficient methods and interfaces for implementing biometric authentication, thereby increasing the effectiveness, efficiency and user satisfaction of such devices. These methods and interfaces, optionally, complement or replace other methods for implementing biometric authentication.

For a better understanding of the various examples described, reference should be made to the details for carrying out the invention below in connection with the drawings below in which like reference numerals indicate corresponding parts throughout the drawings.
1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display, in accordance with some embodiments.
1B is a block diagram illustrating example components for event processing, in accordance with some embodiments.
1C is a block diagram illustrating example components for generating a tactile output, in accordance with some embodiments.
2 illustrates a portable multifunction device with a touch screen, in accordance with some embodiments.
3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface, in accordance with some embodiments.
4A illustrates an exemplary user interface for a menu of applications on a portable multifunction device, in accordance with some embodiments.
4B illustrates an exemplary user interface for a multifunction device having a touch-sensitive surface separate from the display, in accordance with some embodiments.
4C-4H illustrate example tactile output patterns with specific waveforms, according to some embodiments.
5A illustrates a personal electronic device in accordance with some embodiments.
5B is a block diagram illustrating a personal electronic device in accordance with some embodiments.
5C and 5D illustrate example components of a personal electronic device with a touch-sensitive display and intensity sensors, in accordance with some embodiments.
5E-5H illustrate example components and user interfaces of a personal electronic device, in accordance with some embodiments.
6 illustrates example devices connected through one or more communication channels, in accordance with some embodiments.
7A-7S illustrate exemplary user interfaces for biometric registration process instructions, in accordance with some examples.
8A-8C are flow charts illustrating methods of a biometric registration process guide.
9A-9A illustrate example user interfaces for aligning biometric features for registration.
10A-10F are flow diagrams illustrating methods of aligning biometric features for registration.
11A-11O illustrate example user interfaces for registering a biometric feature.
12A and 12B are flow charts illustrating methods of registering a biometric feature.
13A-13R illustrate example user interfaces for providing hints during the biometric registration process.
14A-14C are flow charts illustrating methods of providing hints during a biometric registration process.
15A-15T illustrate exemplary user interfaces for application-based biometric authentication.
16A to 16E are flowcharts illustrating methods of application-based biometric authentication.
17A-17Ai illustrate exemplary user interfaces for automatically filling biometric security fields.
18A-18D are flow charts illustrating methods of automatically filling biometric security fields.
19A-19A illustrate example user interfaces for unlocking a device using biometric authentication.
20A-20F are flow charts illustrating methods of unlocking a device using biometric authentication.
21A through 21Aq illustrate exemplary user interfaces for retrying biometric authentication.
22A-22F are flowcharts illustrating methods of retrying biometric authentication.
23A-23Q illustrate example user interfaces for managing transmissions using biometric authentication.
24A-24BC illustrate example user interfaces for managing transmissions using biometric authentication.
25A-25C are flow charts illustrating methods of managing transmissions using biometric authentication.
26A-26A illustrate exemplary user interfaces for providing interstitial user interfaces during biometric authentication.
27A-27E are flow charts illustrating methods of providing embedded user interfaces during biometric authentication.
28A-28AA illustrate exemplary user interfaces for preventing retrying of biometric authentication.
29A and 29B are flowcharts illustrating methods of preventing retrying of biometric authentication.
30A-30A illustrate example user interfaces for cached biometric authentication.
31A and 31B are flowcharts illustrating methods of cached biometric authentication.
32A-32W illustrate example user interfaces for automatically filling fillable fields based on visibility criteria.
33 is a flow diagram illustrating methods of automatically filling fillable fields based on visibility criteria.
34A-34N illustrate exemplary user interfaces for automatic login using biometric authentication.
35 is a flow chart illustrating methods of automatic login using biometric authentication.
36A-36L illustrate example user interfaces for retrying biometric authentication in a credential input user interface, in accordance with some examples.
37A and 37B are flow charts illustrating a method for retrying biometric authentication in a credential input user interface using an electronic device, in accordance with some examples.
38A-38A illustrate example user interfaces for providing indications of error conditions during biometric authentication, according to some examples.
39A and 39B are flow charts illustrating a method for providing indications of error conditions during biometric authentication, in accordance with some examples.
40A-40U illustrate example user interfaces for providing indications regarding a biometric sensor during biometric authentication, in accordance with some examples.
41A-41C are flow charts illustrating a method for providing indications regarding a biometric sensor during biometric authentication, in accordance with some examples.
42A-42P illustrate example user interfaces for orienting a device to register a biometric feature, in accordance with some examples.
43A-43C are flow charts illustrating a method for orienting a device to register a biometric feature, in accordance with some examples.

The following description sets forth exemplary methods, parameters, and the like. However, it should be appreciated that this description is not intended as a limitation on the scope of the present disclosure, but instead is provided as a description of exemplary embodiments.

There is a need for electronic devices that provide efficient methods and interfaces for implementing biometric authentication of biometric features. For example, there is a need for electronic devices that provide a convenient and efficient method for registering one or more portions of a biometric feature. For another example, there is a need for electronic devices that provide a quick and intuitive technique for selectively accessing secure data according to biometric authentication. For another example, there is a need for electronic devices that provide a quick and intuitive technique for enabling the function of a device according to biometric authentication. Such techniques can reduce the cognitive burden of a user registering biometric features and/or authenticating biometrically using the device, thereby improving overall productivity. Additionally, such techniques can reduce processor and battery power otherwise wasted with extra user inputs.

In the following, FIGS. 1A-1C, 2, 3, 4A, 4B, and 5A-5H provide a description of exemplary devices for performing techniques for implementing biometric authentication. 6 illustrates example devices connected through one or more communication channels, in accordance with some embodiments. 7A-7S illustrate example user interfaces for biometric registration process instructions, in accordance with some embodiments. 8A-8C are flow charts illustrating methods of a biometric registration process guide. The user interfaces of FIGS. 7A-7S are used to illustrate the processes described below, including those of FIGS. 8A-8C. 9A-9A illustrate example user interfaces for aligning biometric features for registration. 10A-10F are flow diagrams illustrating methods of aligning biometric features for registration. The user interfaces of FIGS. 9A-9A are used to illustrate the processes described below, including those of FIGS. 10A-10F. 11A-11O illustrate example user interfaces for registering a biometric feature. 12A and 12B are flow charts illustrating methods of registering a biometric feature. The user interfaces of FIGS. 11A-11O are used to illustrate the processes described below, including those of FIGS. 12A and 12B. 13A-13R illustrate example user interfaces for providing hints during the biometric registration process. 14A-14C are flow charts illustrating methods of providing hints during a biometric registration process. The user interfaces of FIGS. 13A-13R are used to illustrate the processes described below, including those of FIGS. 14A-14C. 15A-15T illustrate exemplary user interfaces for application-based biometric authentication. 16A to 16E are flowcharts illustrating methods of application-based biometric authentication. The user interfaces of FIGS. 15A-15T are used to illustrate the processes described below, including those of FIGS. 16A-16E. 17A-17Ai illustrate exemplary user interfaces for automatically filling biometric security fields. 18A-18D are flow charts illustrating methods of automatically filling biometric security fields. The user interfaces of FIGS. 17A-17Ai are used to illustrate the processes described below, including the processes of FIGS. 18A-18D. 19A-19A illustrate example user interfaces for unlocking a device using biometric authentication. 20A-20F are flow charts illustrating methods of unlocking a device using biometric authentication. The user interfaces of FIGS. 19A-19A are used to illustrate the processes described below, including those of FIGS. 20A-20F. 21A through 21Aq illustrate exemplary user interfaces for retrying biometric authentication. 22A-22F are flowcharts illustrating methods of retrying biometric authentication. The user interfaces of Figs. 21A-21aq are used to illustrate the processes described below, including the processes of Figs. 22A-22F. 23A-23Q illustrate example user interfaces for managing transmissions using biometric authentication. 24A-24BC illustrate example user interfaces for managing transmissions using biometric authentication. 25A-25C are flow charts illustrating methods of managing transmissions using biometric authentication. The user interfaces of FIGS. 23A-23Q and 24A-24BC are used to illustrate the processes described below, including the processes of FIGS. 25A-25C. 26A-26A illustrate exemplary user interfaces for providing implantable user interfaces during biometric authentication. 27A-27E are flow charts illustrating methods of providing embedded user interfaces during biometric authentication. The user interfaces of FIGS. 26A-26A are used to illustrate the processes described below, including the processes of FIGS. 27A-27E. 28A-28AA illustrate exemplary user interfaces for preventing retrying of biometric authentication. 29A and 29B are flowcharts illustrating methods of preventing retrying of biometric authentication. The user interfaces of FIGS. 28A-28A are used to illustrate the processes described below, including those of FIGS. 29A and 29B. 30A-30A illustrate example user interfaces for cached biometric authentication. 31A and 31B are flow charts illustrating methods of cached biometric authentication. The user interfaces of FIGS. 30A-30A are used to illustrate the processes described below, including those of FIGS. 31A and 31B. 32A-32W illustrate example user interfaces for automatically filling fillable fields based on visibility criteria. 33 is a flow diagram illustrating methods of automatically filling fillable fields based on visibility criteria. The user interfaces of FIGS. 32A-32W are used to illustrate the processes described below, including the processes of FIG. 33. 34A-34N illustrate exemplary user interfaces for automatic login using biometric authentication. 35 is a flow chart illustrating methods of automatic login using biometric authentication. The user interfaces of FIGS. 34A-34N are used to illustrate the processes described below, including the processes of FIG. 35. 36A-36L illustrate exemplary user interfaces for retrying biometric authentication in a credential input user interface. 37A and 37B are flowcharts illustrating a method for retrying biometric authentication in a credential input user interface. The user interfaces of FIGS. 36A-36L are used to illustrate the processes described below, including those of FIGS. 37A and 37B. 38A-38A illustrate example user interfaces for providing indications of error conditions during biometric authentication. 39A and 39B are flow charts illustrating a method for providing indications of error conditions during biometric authentication. The user interfaces of FIGS. 38A-38A are used to illustrate the processes described below, including those of FIGS. 39A and 39B. 40A-40U illustrate example user interfaces for providing indications regarding a biometric sensor during biometric authentication. 41A-41C are flow charts illustrating a method for providing indications regarding a biometric sensor during biometric authentication. The user interfaces of FIGS. 40A-40U are used to illustrate the processes described below, including those of FIGS. 41A-41C. 42A-42P illustrate example user interfaces for orienting a device to register a biometric feature. 43A-43C are flow charts illustrating a method for orienting a device to register a biometric feature. The user interfaces of FIGS. 42A-42P are used to illustrate the processes described below, including the processes of FIGS. 43A-43C.

Although the following description uses terms such as “first”, “second”, etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch may be referred to as a second touch, and similarly, a second touch may be referred to as a first touch without departing from the scope of the various embodiments described. The first touch and the second touch are both touches, but they are not the same touch.

The terms used in the description of the various embodiments described herein are for the purpose of describing specific embodiments only, and are not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms ("a", "an", and "the") are intended to include the plural as well, unless the context clearly indicates otherwise. Is intended. Further, it will be understood that the term “and/or” as used herein represents and encompasses any and all possible combinations of one or more of the associated items listed. The terms “include”, “including”, “comprise”, and/or “comprising”, as used herein, refer to the recited features, integers Specifies the presence of elements, steps, actions, elements, and/or components, but the presence of one or more other features, integers, steps, actions, elements, components, and/or groups thereof It will be further understood that it does not exclude additions or additions.

The term "if", optionally, depending on the context, "when" or "upon" or "in response to determining" or " Is interpreted to mean "in response to detecting". Similarly, the phrase “when determined” or “when [the stated condition or event] is detected” is, optionally, “on decision” or “in response to determining” or “[status or event mentioned], depending on the context. ] On detection" or "in response to detecting [the stated condition or event]"

Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions such as PDA and/or music player functions. Exemplary embodiments of portable multifunction devices limit iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, CA, USA Include without. Other portable electronic devices such as laptop or tablet computers with touch-sensitive surfaces (eg, touch screen displays and/or touchpads) are optionally used. It should also be understood that in some embodiments, the device is not a portable communication device but a desktop computer having a touch-sensitive surface (eg, a touch screen display and/or a touchpad).

In the discussion that follows, an electronic device is described that includes a display and a touch-sensitive surface. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices such as a physical keyboard, mouse and/or joystick.

Devices typically support a variety of applications such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, gaming applications, telephony applications, video conferencing applications, and email. Applications, instant messaging applications, exercise support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and/or digital video player applications.

Various applications running on the device, optionally, use at least one universal physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface as well as the corresponding information displayed on the device are, optionally, adjusted and/or changed from one application to the next and/or within the individual application. In this way, the universal physical architecture of the device (such as a touch-sensitive surface) supports a variety of applications, optionally using user interfaces that are intuitive and transparent to the user.

Attention is now directed to embodiments of portable devices with touch-sensitive displays. 1A is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 in accordance with some embodiments. The touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes known or referred to as a "touch-sensitive display system". Device 100 includes memory 102 (optionally including one or more computer readable storage media), memory controller 122, one or more processing units (CPUs) 120, peripherals interface 118, RF Circuitry 108, audio circuitry 110, speaker 111, microphone 113, input/output (I/O) subsystem 106, other input control devices 116, and external ports 124 Includes. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors for detecting the intensity of contacts on device 100 (e.g., a touch-sensitive surface such as touch-sensitive display system 112 of device 100). 165). The device 100 optionally includes a touch pad 355 of the device 300 or a touch-sensitive display system 112 of the device 100 for generating tactile outputs on the device 100. And one or more tactile output generators 167 (for generating tactile outputs on the same touch-sensitive surface). These components optionally communicate via one or more communication buses or signal lines 103.

As used in the specification and claims, the term "strength" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (eg, finger contact) on a touch-sensitive surface, or touch-sensitive Refers to a substitute (proxy) for the force or pressure of contact on a surface. The intensity of the contact has a range of values that includes at least 4 distinct values and more typically includes several hundred (eg, at least 256) distinct values. The strength of the contact is selectively determined (or measured) using various approaches, and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (eg, weighted average) to determine an estimated force of the contact. Similarly, the pressure sensitive tip of the stylus is optionally used to determine the pressure of the stylus on the touch sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and/or changes thereto, the capacitance of the touch-sensitive surface near the contact and/or changes thereto, and/or the touch-sensitive near the contact. The resistance of the surface and/or changes thereto are optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some implementations, alternate measurements for contact force or pressure are used directly to determine whether an intensity threshold has been exceeded (eg, the intensity threshold is described in units corresponding to the alternate measurements). In some implementations, alternative measurements for contact force or pressure are converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is It is the pressure threshold measured in units of pressure). By using the intensity of the contact as an attribute of the user input, the user can, in some situations, otherwise display affordances (e.g., on a touch-sensitive display) and/or (e.g., touch-sensitive display, touch-sensitive display). In order to receive user input (through a surface, or a physical/mechanical control such as a knob or button), additional device functions may be accessed that are not accessible by the user on a reduced device with a limited footprint. .

As used in the specification and claims, the term “tactile output” refers to the physical displacement of the device relative to its previous position, a component of the device (eg, a touch-sensitive surface) relative to another component of the device (eg, a housing). ), or the displacement of the component with respect to the center of mass of the device to be detected by the user using the user's tactile sense. For example, in a situation in which a device or a component of a device is in contact with a touch-sensitive user's surface (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement is caused by the user It will be interpreted as a tactile sensation corresponding to a perceived change in the physical properties of a component of the device. For example, movement of a touch-sensitive surface (eg, a touch-sensitive display or track pad) is, optionally, interpreted by the user as a “down click” or “up click” of a physical actuator button. In some cases, the user will feel a tactile sensation such as a "down click" or "up click" even when there is no movement of a physical actuator button associated with a touch-sensitive surface that is physically depressed (e.g., displaced) by the user's movement. . As another example, movement of the touch-sensitive surface is, optionally, interpreted or sensed by the user as the "roughness" of the touch-sensitive surface, even when there is no change in the flatness of the touch-sensitive surface. While these interpretations of touch by the user will be susceptible to the user's individualized sensory perception, there are many touch sensory perceptions that are common to the majority of users. Thus, when a tactile output is described as corresponding to a user's specific sensory perception (e.g., "click up", "click down", "roughness"), unless otherwise stated, the generated tactile output is typical (or It corresponds to the physical displacement of the device or its component that will produce the described sensory perception for the user (average). Providing haptic feedback to the user using tactile outputs improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device) and It makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some embodiments, the tactile output pattern determines the characteristics of the tactile output, such as the amplitude of the tactile output, the shape of the moving waveform of the tactile output, the frequency of the tactile output, and/or the duration of the tactile output. To be specified.

When tactile outputs with different tactile output patterns are generated by the device (e.g., via one or more tactile output generators that generate tactile outputs by moving a movable mass), the tactile outputs are When holding or touching, it can evoke different haptic sensations. The user's sense is based on user perception of the tactile output, but most users will be able to discern changes in the waveform, frequency, and amplitude of the tactile outputs generated by the device. Thus, the waveform, frequency and amplitude can be adjusted to indicate to the user that different operations have been performed. As such, a given environment (e.g., a user interface including graphical features and objects, a simulated physical environment with virtual boundaries and virtual objects, a real physical environment with physical boundaries and physical objects, and/or any of the above) Properties of objects (eg size, material, weight, stiffness, smoothness, etc.) in a combination of Behaviors (eg, oscillation, displacement, acceleration, rotation, expansion, etc.); And/or tactile outputs with tactile output patterns designed and/or selected and/or engineered to simulate interactions (e.g., collision, adhesion, repulsion, attraction, friction, etc.), in some situations. , It will provide useful feedback to users that reduces input errors and increases the efficiency of user operation of the device. Additionally, tactile outputs are optionally generated to correspond to simulated physical properties, such as input threshold or feedback that is not related to the selection of the object. Such tactile outputs will, in some situations, provide useful feedback to users that reduce input errors and increase the efficiency of user operation of the device.

In some embodiments, a tactile output with a suitable tactile output pattern serves as a cue for the occurrence of an event of interest in the user interface or behind a scene within the device. Examples of events of interest include activation of an affordance (e.g., a real or virtual button, or toggle switch) provided on a device or in a user interface, success or failure of a requested operation, reaching or crossing a boundary in the user interface. , Entering a new state, switching input focus between objects, activating a new mode, reaching or traversing an input threshold, detecting or recognizing a type of input or gesture, and the like. In some embodiments, tactile outputs are provided to serve as a warning or alert for an impending event or outcome that will occur if a redirection or interruption input is not detected in a timely manner. Tactile outputs also enrich the user experience, in other contexts, and/or improve the accessibility of the device to users with visual impairment or motor neurological impairment or other accessibility needs, and/or user interface and/or Or it is used to improve the efficiency and function of the device. The tactile outputs optionally involve audio outputs and/or visible user interface changes, which further enhances the user's experience when the user interacts with the user interface and/or device, and enhances the user interface and/or Or to facilitate better transfer of information about the state of the device, reduce input errors and increase the efficiency of user operation of the device.

4C-4E illustrate one or more of one or more haptic feedbacks suitable for various purposes and in various scenarios, such as those described above and those described in connection with the user interfaces and methods discussed herein. It provides a set of sample tactile output patterns that can be used as is, individually or in combination, through transformations (eg, modulation, amplification, truncation, etc.). This example of a palette of tactile outputs shows how a set of three waveforms and eight frequencies can be used to create an array of tactile output patterns. In addition to the tactile output patterns shown in this figure, each of these tactile output patterns is optionally, for example, Fig. 4f, shown in variants with gains of 1.0, 0.75, 0.5, and 0.25, respectively. As shown for the pull tap 80 Hz, the pull tap 200 Hz, the minitap 80 Hz, the mini tap 200 Hz, the micro tap 80 Hz, and the micro tap 200 Hz in FIG. 4h, tactile output The amplitude is adjusted by changing the gain value for the pattern. As shown in FIGS. 4F to 4H, changing the gain of the tactile output pattern changes the amplitude of the pattern without changing the frequency of the pattern or changing the shape of the waveform. In some embodiments, changing the frequency of the tactile output pattern also results in a lower amplitude, which some tactile output generators are limited by how much force can be applied to the movable mass, and thus the waveform This is because the higher frequency movements of the mass are constrained to lower amplitudes (e.g., 230 Hz, 270 Hz, to ensure that the acceleration required to generate the haptic output does not require a force outside the operating force range of the tactile output generator. And the peak amplitudes of the pull tap at 300 Hz are lower than the amplitudes of the pull tap at 80 Hz, 100 Hz, 125 Hz, and 200 Hz).

4C to 4H show tactile output patterns having a specific waveform. The waveform of the tactile output pattern represents the pattern of physical displacements with respect to a neutral position (eg x _zero ) versus time that the movable mass goes through to generate a tactile output with that tactile output pattern. For example, a first set of tactile output patterns (eg, tactile output patterns of “pull tap”) shown in FIG. 4C is an oscillation with two complete cycles each (eg, starting and ending in a neutral position and being neutral). Oscillations traversing the location three times). The second set of tactile output patterns (e.g., "minitap" tactile output patterns) shown in FIG. 4D are oscillations each containing one complete cycle (e.g., starting and ending in a neutral position and having a neutral position of 1). Oscillations). The third set of tactile output patterns (e.g., "microtap" tactile output patterns) shown in FIG. 4E are oscillations (e.g., starting and ending in a neutral position and ending in a neutral position, each containing half of a full cycle). Oscillations that do not cross the location). The waveform of the tactile output pattern also includes a start buffer and an end buffer representing the gradual acceleration and deceleration of the movable mass at the beginning and end of the tactile output. The exemplary waveforms shown in FIGS. 4C-4H include x _min and x _max values representing the maximum and minimum limits of the movement of the movable mass. In the case of larger electronic devices with larger movable masses, there may be larger or smaller minimum and maximum limits of movement of the mass. The examples shown in FIGS. 4C-4H describe the movement of a mass in one dimension, but similar principles will also apply to the movement of a movable mass in two or three dimensions.

4C-4E, each tactile output pattern also has a corresponding characteristic frequency that affects the "pitch" of the haptic sensation, which haptic sensation is the user from the tactile output with that characteristic frequency. Felt by In the case of a continuous tactile output, the characteristic frequency represents the number of cycles (eg, cycles per second) completed within a given period by the movable mass of the tactile output generator. In the case of an individual tactile output, a separate output signal (e.g., having 0.5, 1, or 2 cycles) is generated and the characteristic frequency value is how much the movable mass is to produce a tactile output with that characteristic frequency. Specify whether you need to move quickly. 4C-4H, for each type of tactile output (e.g., as defined by the individual waveform, such as pull tap, minitap, or microtap), higher frequency values shift The faster movement(s) by the possible mass, and thus, in general, a shorter time to complete the tactile output (e.g., the time to complete the required number of cycle(s) for an individual tactile output + Corresponding to the start and end buffer times). For example, a pull tap with a characteristic frequency of 80 Hz takes longer to complete than a pull tap with a characteristic frequency of 100 Hz (e.g., 28.3 ms compared to 35.4 ms in FIG. 4C). Also, for given frequencies, a tactile output with more cycles of its waveform at an individual frequency takes longer to complete than a tactile output with fewer cycles of its waveform at the same individual frequency. For example, a pull tap at 150 Hz takes longer to complete than a minitap at 150 Hz (e.g., 12.8 ms versus 19.4 ms), and a minitap at 150 Hz takes longer to complete than a microtap at 150 Hz. It takes (e.g. 9.4ms versus 12.8ms). However, for tactile output patterns with different frequencies, this rule may not apply (e.g., tactile outputs with more cycles but higher frequency have fewer cycles but tactile output patterns with lower frequency). It may take less time to complete than outputs and vice versa). For example, at 300 Hz, a pull tap takes as long as a mini tap (eg, 9.9 ms).

As shown in Figs. 4C to 4E, the tactile output pattern also has a characteristic amplitude that affects the amount of energy contained in the tactile signal or the "intensity" of the haptic sensation, which haptic sensation has its characteristic amplitude Can be felt by the user through the tactile output with. In some embodiments, the characteristic amplitude of a tactile output pattern refers to an absolute or normalized value representing the maximum displacement of a movable mass from a neutral position when generating a tactile output. In some embodiments, the characteristic amplitude of the tactile output pattern is determined by various conditions (e.g., customized based on user interface situations and behaviors) and/or preconfigured metrics (e.g., input-based metrics, and /Or user interface based metrics), eg, by a fixed or dynamically determined gain factor (eg, a value of 0 to 1). In some embodiments, an input-based metric (e.g., an intensity change metric or an input-velocity metric) is a characteristic of the input (e.g., the rate of change of the characteristic intensity of the touch at the pressing input or the touch The speed of movement of the contact across the sensitive surface is measured. In some embodiments, a user interface based metric (e.g., a speed across a boundary metric) is a characteristic of a user interface element (e.g., a hidden or visible boundary in the user interface) during a user interface change that triggers the generation of a tactile output. The speed of movement of the element across it is measured. In some embodiments, the characteristic amplitude of the tactile output pattern may be modulated by a “envelope”, and the peaks of adjacent cycles may have different amplitudes, wherein one of the previously shown waveforms is As the output is being generated, it is further modified by multiplication by the envelope parameter (eg, 0 to 1) that changes over time to gradually adjust the amplitude of portions of the tactile output over time.

Specific frequencies, amplitudes and waveforms are shown in the sample tactile output patterns in FIGS. 4C-4E for illustrative purposes, but tactile output patterns with different frequencies, amplitudes and waveforms will be used for similar purposes. I can. For example, waveforms with 0.5 to 4 cycles can be used. Other frequencies in the range of 60 Hz to 400 Hz may also be used. Table 1 provides examples of specific haptic feedback behaviors, configurations, and examples of their use.

Device 100 is only an example of a portable multifunction device, and device 100 is, optionally, having more or fewer components than shown, optionally, combining two or more components, or optionally component It should be understood that they have different configurations or arrangements. The various components shown in FIG. 1A are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and/or application-specific integrated circuits (ASICs).

The memory 102 optionally includes a high-speed random access memory, and optionally, one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. And non-volatile memory such as. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

Peripheral interface 118 may be used to couple input and output peripherals of the device to CPU 120 and memory 102. One or more processors 120 drive or execute various software programs and/or sets of instructions stored in memory 102 to perform various functions for device 100 and to process data. In some embodiments, peripherals interface 118, CPU 120, and memory controller 122 are, optionally, implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

The radio frequency (RF) circuit unit 108 receives and transmits RF signals, also referred to as electromagnetic signals. The RF circuitry 108 converts electrical signals to/from electromagnetic signals, and communicates with communication networks and other communication devices via the electromagnetic signals. The RF circuit unit 108, optionally, includes, but is not limited to, an antenna system, an RF transceiver, one or more amplifiers, tuners, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, a memory, and the like. It includes well-known circuitry for performing these functions. The RF circuitry 108 is, optionally, networks such as the Internet, intranet, and/or wireless network, also referred to as the World Wide Web (WWW), such as a cellular telephone network, a wireless local area network (LAN) and/or a MAN (metropolitan area network), and communicates with other devices by wireless communication. The RF circuitry 108 optionally comprises well-known circuitry for detecting near field communication (NFC) fields, for example by a short-range communication radio. Wireless communication, optionally, GSM (Global System for Mobile Communications), EDGE (Enhanced Data GSM Environment), HSDPA (high-speed downlink packet access), HSUPA (high-speed uplink packet access), EV-DO (Evolution, Data-Only), HSPA, HSPA+, DC-HSPDA (Dual-Cell HSPA), LTE (long term evolution), NFC (near field communication), W-CDMA (wideband code division multiple access), CDMA (code division multiple access) ), TDMA (time division multiple access), Bluetooth (Bluetooth), BTLE (Bluetooth Low Energy), Wi-Fi (Wireless Fidelity) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n and/or IEEE 802.11ac), voice over Internet Protocol (VoIP), Wi-MAX, protocol for e-mail (e.g., Internet message access protocol (IMAP) and/or post office protocol (POP)), instant messaging (e.g., extensible messaging (XMPP)) and presence protocol), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and/or Short Message Service (SMS), or communications not yet developed at the filing date of this document. Protocols, including any other suitable Use any of a number of communication standards, protocols, and technologies, including but not limited to communication protocols.

The audio circuit unit 110, the speaker 111, and the microphone 113 provide an audio interface between the user and the device 100. The audio circuit unit 110 receives audio data from the peripheral device interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal into sound waves that can be heard by humans. The audio circuit unit 110 also receives an electrical signal converted from sound waves by the microphone 113. The audio circuit unit 110 converts the electrical signal into audio data, and transmits the audio data to the peripheral device interface 118 for processing. Audio data is, optionally, fetched from and/or transmitted to memory 102 and/or RF circuitry 108 by peripherals interface 118 from memory 102 and/or RF circuitry 108. In some embodiments, the audio circuitry 110 also includes a headset jack (eg, 212 in FIG. 2 ). The headset jack is between the audio circuitry 110 and removable audio input/output peripherals, such as output-only headphones, or a headset having both an output (eg, one or both ear headphones) and an input (eg, a microphone). Provides an interface.

The I/O subsystem 106 couples input/output peripherals on the device 100, such as the touch screen 112 and other input control devices 116, to the peripherals interface 118. I/O subsystem 106 optionally includes display controller 156, light sensor controller 158, intensity sensor controller 159, haptic feedback controller 161, depth camera controller 169, and other inputs or controls. It includes one or more input controllers 160 for devices. One or more input controllers 160 receive/transmit electrical signals to/from other input control devices 116. Other input control devices 116 optionally include physical buttons (eg, push button, rocker button, etc.), dial, slider switch, joystick, click wheel, and the like. In some alternative embodiments, the input controller(s) 160 is optionally coupled (or not coupled to any) to any of a pointer device such as a keyboard, infrared port, USB port, and mouse. One or more buttons (eg, 208 in FIG. 2) optionally include an up/down button for volume control of the speaker 111 and/or microphone 113. The one or more buttons optionally include a push button (eg, 206 in FIG. 2 ).

A quick press of a push button selectively unlocks the touch screen 112, or initiates processes that optionally use gestures on the touch screen to unlock the device, which is 23 December 2005. As described in US Patent Application No. 11/322,549, filed dated “Unlocking a Device by Performing Gestures on an Unlock Image” (US Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. do. A longer press of the push button (eg, 206) selectively powers the device 100 on or off. The functionality of one or more buttons is, optionally, customizable. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. Display controller 156 receives and/or transmits electrical signals from/to touch screen 112. The touch screen 112 displays a visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output selectively corresponds to user interface objects.

The touch screen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and/or tactile contact. The touch screen 112 and the display controller 156 (along with any associated modules and/or sets of instructions in the memory 102) contact on the touch screen 112 (and any movement or break of the contact) And converts the detected contact into interactions with user interface objects (eg, one or more soft keys, icons, web pages or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

The touch screen 112 selectively uses liquid crystal display (LCD) technology, light emitting polymer display (LPD) technology, or light emitting diode (LED) technology, but other display technologies are used in other embodiments. The touch screen 112 and display controller 156 may optionally provide capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays, or one or more points of contact with the touch screen 112. Detect contact and any movement or interruption thereof using any of a plurality of touch sensing techniques currently known or later developed, including but not limited to other factors for determining. In an exemplary embodiment, a projected mutual capacitance sensing technology such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, CA is used.

The touch-sensitive display in some embodiments of the touch screen 112 is, optionally, the following US Patents 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and/or 6,677,932 (Westerman). , And/or similar to the multi-touch sensitive touchpads described in US 2002/0015024A1, each of which is incorporated herein by reference in its entirety. However, the touch screen 112 displays visual output from the device 100, while touch-sensitive touchpads do not provide visual output.

The touch-sensitive display in some embodiments of the touch screen 112 is described in the following applications: (1) US Patent Application No. 11/381,313, filed May 2, 2006, "Multipoint Touch Surface. Controller"; (2) US patent application Ser. No. 10/840,862, "Multipoint Touchscreen", filed May 6, 2004; (3) US patent application Ser. No. 10/903,964, filed July 30, 2004, "Gestures For Touch Sensitive Input Devices"; (4) US patent application Ser. No. 11/048,264, filed Jan. 31, 2005, "Gestures For Touch Sensitive Input Devices"; (5) US Patent Application No. 11/038,590, filed Jan. 18, 2005, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices"; (6) US Patent Application No. 11/228,758, filed September 16, 2005, "Virtual Input Device Placement On A Touch Screen User Interface"; (7) US patent application Ser. No. 11/228,700, filed Sep. 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) US Patent Application No. 11/228,737, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard", filed September 16, 2005; And (9) U.S. Patent Application No. 11/367,749, "Multi-Functional Hand-Held Device", filed on March 3, 2006. All of these applications are incorporated herein by reference in their entirety.

The touch screen 112 optionally has a video resolution in excess of 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi. The user, optionally, contacts the touch screen 112 using any suitable object or accessory such as a stylus, finger, or the like. In some embodiments, the user interface is primarily designed to operate using finger-based contacts and gestures, which may be less precise than stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the device converts the coarse finger-based input into a precise pointer/cursor position or command to perform the user's desired actions.

In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad (not shown) to activate or deactivate certain functions. In some embodiments, the touch pad, unlike a touch screen, is a touch-sensitive area of the device that does not display a visual output. The touch pad is, optionally, a touch-sensitive surface separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

Device 100 also includes a power system 162 for supplying power to various components. The power system 162 may optionally be a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator ( For example, light emitting diodes (LEDs)), and any other components associated with the generation, management and distribution of power within portable devices.

Device 100 also optionally includes one or more optical sensors 164. 1A shows a light sensor coupled to the light sensor controller 158 in the I/O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or complementary metal-oxide semiconductor (CMOS) phototransistors. The optical sensor 164 receives light from the surrounding environment, projected through one or more lenses, and converts the light into data representing an image. In conjunction with the imaging module 143 (also referred to as a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the back of the device 100 opposite the touch screen display 112 on the front of the device, so that the touch screen display can be used as a viewfinder for acquiring still and/or video images. To be. In some embodiments, the light sensor is located on the front of the device, such that while the user is viewing other video conference participants on the touch screen display, optionally, an image of the user is obtained for the video conference. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating a lens and sensor within the device housing), such that a single optical sensor 164 can be used for video conferencing with a touch screen display. It is used for both still and/or video image acquisition.

Device 100 also optionally includes one or more contact intensity sensors 165. 1A shows a contact intensity sensor coupled to intensity sensor controller 159 in I/O subsystem 106. Contact intensity sensor 165 may optionally be one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., Sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface). The contact intensity sensor 165 receives contact intensity information (eg, pressure information or a substitute for pressure information) from the surrounding environment. In some embodiments, at least one contact intensity sensor is collocated with or in proximity to a touch-sensitive surface (eg, touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the back of the device 100 opposite the touch screen display 112 located on the front of the device 100.

Device 100 also optionally includes one or more proximity sensors 166. 1A shows the proximity sensor 166 coupled to the peripherals interface 118. Alternatively, proximity sensor 166 is, optionally, coupled to input controller 160 in I/O subsystem 106. Proximity sensor 166 may optionally be provided in US patent application Ser. No. 11/241,839, “Proximity Detector In Handheld Device”; 11/240,788, "Proximity Detector In Handheld Device"; No. 11/620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11/586,862, "Automated Response To And Sensing Of User Activity In Portable Devices"; And 11/638,251, "Methods And Systems For Automatic Configuration Of Peripherals", which are incorporated herein by reference in their entirety. In some embodiments, the proximity sensor turns off and disables the touch screen 112 when the multifunction device is positioned near the user's ear (eg, when the user is on a phone call).

Device 100 also optionally includes one or more tactile output generators 167. 1A shows a tactile output generator coupled to a haptic feedback controller 161 in I/O subsystem 106. The tactile output generator 167 may optionally generate one or more electroacoustic devices such as speakers or other audio components and/or a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output. It includes electromechanical devices that convert energy into linear motion, such as a component (eg, a component that converts electrical signals into tactile outputs on the device). The contact intensity sensor 165 receives tactile feedback generation instructions from the haptic feedback module 133 to generate tactile outputs on the device 100 that can be sensed by the user of the device 100. In some embodiments, the at least one tactile output generator is located with or proximate the touch-sensitive surface (e.g., touch-sensitive display system 112), and optionally, vertically (e.g., , Generating a tactile output by moving in/out of the surface of the device 100) or laterally (eg, back and forth in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.

Device 100 also optionally includes one or more accelerometers 168. 1A shows an accelerometer 168 coupled to the peripherals interface 118. Alternatively, accelerometer 168 is optionally coupled to input controller 160 in I/O subsystem 106. The accelerometer 168 is optionally, U.S. Patent Publication No.20050190059, "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication No.20060017692, "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer. ", both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on analysis of data received from one or more accelerometers. The device 100 optionally includes a magnetometer (not shown), in addition to the accelerometer(s) 168, and a GPS for acquiring information about the position and orientation (e.g., vertical or horizontal) of the device 100 Or a GLONASS or other global navigation system) receiver (not shown).

In some embodiments, device 100 also includes (or communicates with) one or more fingerprint sensors. One or more fingerprint sensors are coupled to the peripherals interface 118. Alternatively, one or more fingerprint sensors are optionally coupled to input controller 160 in I/O subsystem 106. However, in one general embodiment, fingerprint identification operations are security-only computing hardware (e.g., one or more processors, memory and memory) with additional security features to improve the security of fingerprint information determined by one or more fingerprint sensors. /Or communication buses). As used herein, a fingerprint sensor is capable of distinguishing between fingerprint features of the ridge and valley of the skin (sometimes referred to as “detail features”) such as those found on human fingers and toes. It is a sensor. The fingerprint sensor can differentiate fingerprint features using any of a variety of techniques including, but not limited to, optical fingerprint imaging, ultrasonic fingerprint imaging, active capacitive fingerprint imaging, and passive capacitive fingerprint imaging. In addition to distinguishing fingerprint features in a fingerprint, in some embodiments, one or more fingerprint sensors may track the movement of fingerprint features over time, whereby over time on one or more fingerprint sensors. It is possible to determine/characterize the movement of the fingerprint accordingly. The one or more fingerprint sensors may be separate from the touch-sensitive surface (e.g., touch-sensitive display system 112), but in some implementations, the touch-sensitive surface (e.g., touch-sensitive display system ( 112)) has a sufficiently high spatial resolution to detect fingerprint features formed by individual fingerprint ridges, and is used as a fingerprint sensor instead of or in addition to one or more fingerprint sensors. In some embodiments, device 100 includes one or more orientation sensors used to determine the orientation of a finger or hand on or in proximity to the device (e.g., orientation of a finger over one or more fingerprint sensors). Includes a set. Additionally, in some embodiments, a set of one or more orientation sensors are used in addition to or instead of fingerprint sensors to detect the rotation of a contact interacting with the device (e.g., described below. In one or more methods of being used, instead of using a fingerprint sensor to detect the rotation of the fingerprint/contact, a set of one or more orientation sensors detects or does not detect features of the fingerprint, and the rotation of the contact containing the fingerprint is performed. Used to detect).

In some embodiments, features of fingerprints, and a comparison between features of detected fingerprints and features of stored fingerprints, to improve the security of fingerprint data generated, stored and processed by one or more fingerprint sensors. Is performed by secure dedicated computing hardware (eg, one or more processors, memory and/or communication buses) separate from the processor(s) 120. In some embodiments, the characteristics of the fingerprints and a comparison between the characteristics of the detected fingerprints and the characteristics of the enrolled fingerprints are performed by the processor(s) 120 using a fingerprint analysis module.

In some embodiments, during the enrollment process, the device (e.g., a fingerprint analysis module in communication with one or more fingerprint sensors or a separate security module) collects biometric information about one or more fingerprints of the user (e.g., the user To identify the relative positions of the plurality of detailed feature points in the fingerprint of). After the enrollment process is complete, the biometric information is stored in the device (eg, in a secure fingerprint module) for later use in authenticating the detected fingerprints. In some embodiments, biometric information stored on the device excludes images of fingerprints, and also allows images of fingerprints to be restored so that images of fingerprints are not inadvertently made available in case the security of the device is compromised. Exclude information. In some embodiments, during the authentication process, the device (e.g., a fingerprint analysis module in communication with one or more fingerprint sensors or a separate security module) collects biometric information about a fingerprint detected on one or more fingerprint sensors ( For example, by identifying relative positions of a plurality of detailed feature points in a fingerprint detected on one or more fingerprint sensors) and comparing biometric information corresponding to the detected fingerprint with biometric information corresponding to the registered fingerprint(s). It is determined whether the finger input detected by the above fingerprint sensors includes a fingerprint matching the pre-registered fingerprint. In some embodiments, comparing biometric information corresponding to the detected fingerprint with biometric information corresponding to the registered fingerprint(s) determines the type and location of detailed feature points in the biometric information corresponding to the detected fingerprint. And comparing the types and locations of detailed feature points in biometric information corresponding to the enrolled fingerprints. However, the determination as to whether the finger input includes a fingerprint matching a pre-enrolled fingerprint enrolled in the device is, optionally, a number of well-known fingerprint authentication techniques for determining whether a detected fingerprint matches an enrolled fingerprint. It is performed using any of.

Device 100 also optionally includes one or more depth camera sensors 175. 1A shows a depth camera sensor coupled to the depth camera controller 169 in the I/O subsystem 106. Depth camera sensor 175 receives data from the environment, projected through the sensor. Along with imaging module 143 (also referred to as camera module), depth camera sensor 175 is optionally used to determine a depth map of different portions of the image captured by imaging module 143. In some embodiments, a depth camera sensor is located on the front of the device 100 so that an image of the user with depth information is available for use by different functions of the device, such as video conferencing, so that the depth map It captures selfies with data and allows users to authenticate the device. In some embodiments, the position of the depth camera sensors 175 can be changed by the user (e.g., by rotating the lens and sensor within the device housing) so that the depth camera sensors 175 can be combined with the touch screen display It may be used for both video conferencing and still and/or video image acquisition.

In some embodiments, software components stored in memory 102 include operating system 126, communication module (or set of instructions) 128, contact/motion module (or set of instructions) 130, graphics module ( Or a set of instructions) 132, a text input module (or set of instructions) 134, a GPS module (or set of instructions) 135, and applications (or sets of instructions) 136. . Moreover, in some embodiments, the memory (102 in FIG. 1A or 370 in FIG. 3) stores the device/global internal state 157 as shown in FIGS. 1A and 3. The device/global internal state 157, if present, may be an active application state indicating which applications are currently active; A display state indicating which applications, views or other information occupy various areas of the touch screen display 112; Sensor status, including information obtained from the various sensors of the device and input control devices 116; And one or more of location information regarding a location and/or posture of the device.

Operating system 126 (e.g., an embedded operating system such as Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or VxWorks) includes general system tasks (e.g., memory management, storage device control, power management, etc.) It includes various software components and/or drivers for controlling and managing the system, and facilitates communication between various hardware and software components.

The communication module 128 enables communication with other devices via one or more external ports 124, and also provides a variety of data for processing data received by the RE circuit unit 108 and/or the external port 124. Contains software components. The external port 124 (eg, Universal Serial Bus (USB), FIREWIRE, etc.) is configured to couple directly to other devices or indirectly through a network (eg, Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (eg, 30-pin) connector that is the same or similar and/or compatible with the 30-pin connector used in iPod® (trademark of Apple Inc.) devices.

The contact/motion module 130, optionally, detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch sensitive devices (e.g., a touch pad or a physical click wheel). . The contact/motion module 130 determines whether a contact has occurred (e.g., detecting a finger-down event), the strength of the contact (e.g., force or pressure of the contact, or (E.g., one or more finger-dragging events) to determine whether there is a movement of the contact or not to track movement across the touch-sensitive surface. Detecting), and determining whether the contact has ceased (e.g., detecting a finger-up event or contact interruption), for performing various operations related to the detection of a contact. It contains various software components. The contact/motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point represented by a series of contact data, optionally, determines the speed (magnitude), velocity (magnitude and direction), and/or acceleration (change in magnitude and/or direction) of the contact point. Includes doing. These actions, optionally, apply to single contacts (eg, one finger contacts) or to multiple simultaneous contacts (eg “multi-touch”/multiple finger contacts). In some embodiments, contact/motion module 130 and display controller 156 detect a contact on a touch pad.

In some embodiments, the contact/motion module 130 is a set of one or more intensity thresholds to determine whether an action has been performed by a user (eg, to determine whether the user has “clicked” on an icon). Use In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of specific physical actuators, it is possible to change the physical hardware of the device 100). Can be adjusted without). For example, the mouse “click” threshold of a trackpad or touch screen display can be set to any of a wide range of predefined thresholds without changing the trackpad or touch screen display hardware. Additionally, in some implementations, the user of the device may have one or more of a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and/or by adjusting multiple intensity thresholds at once with a system-level click “intensity” parameter). You are provided with software settings to adjust the

The contact/motion module 130 optionally detects a gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns (eg, different motions, timings, and/or intensities of detected contacts). Thus, the gesture is, optionally, detected by detecting a specific contact pattern. For example, detecting a finger tap gesture can detect a finger-down event and then finger-down at the same location (or substantially the same location) as the finger-down event (e.g., at the location of the icon). It involves detecting an up (liftoff) event. As another example, detecting a finger swipe gesture on a touch-sensitive surface detects a finger-down event followed by one or more finger-dragging events, followed by a finger-up (liftoff). ) Including detecting the event.

The graphics module 132 includes components for changing the visual effect (e.g., brightness, transparency, saturation, contrast, or other visual property) of the displayed graphic, rendering and It includes various known software components for display. As used herein, the term “graphic” includes, without limitation, text, web pages, icons (eg, user interface objects including soft keys), digital images, videos, animations, etc. , Includes any object that can be displayed to the user.

In some embodiments, graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphic module 132 receives one or more codes specifying a graphic to be displayed together with coordinate data and other graphic property data, if necessary, from applications, etc., and then generates screen image data and outputs it to the display controller 156 do.

The haptic feedback module 133 is used by the tactile output generator(s) 167 to generate tactile outputs at one or more locations on the device 100 in response to user interactions with the device 100. It contains various software components for generating instructions.

Optionally, the text input module 134, which is a component of the graphics module 132, may include various applications (e.g., contacts 137, email 140, IM 141), browser 147, and text input. Soft keyboards for entering text in any other application).

The GPS module 135 determines the location of the device and uses this information for use in various applications (e.g., to phone 138 for use in location-based dialing; camera 143 as photo/video metadata). And to applications that provide location-based services such as weather widgets, local yellow page widgets and map/navigation widgets).

Applications 136, optionally, include the following modules (or sets of instructions), or a subset or superset thereof:

연락처 모듈(137)(때때로 주소록 또는 연락처 목록으로 지칭됨);

Contacts module 137 (sometimes referred to as an address book or contact list);

전화 모듈(138);

Telephone module 138;

화상 회의 모듈(139);

Video conferencing module 139;

이메일 클라이언트 모듈(140);

Email client module 140;

인스턴트 메시징(IM) 모듈(141);

Instant messaging (IM) module 141;

운동 지원 모듈(142);

Exercise support module 142;

정지 및/또는 비디오 이미지들을 위한 카메라 모듈(143);

A camera module 143 for still and/or video images;

이미지 관리 모듈(144);

Image management module 144;

비디오 재생기 모듈;

Video player module;

음악 재생기 모듈;

Music player module;

브라우저 모듈(147);

Browser module 147;

캘린더 모듈(148);

A calendar module 148;

날씨 위젯(149-1), 주식 위젯(149-2), 계산기 위젯(149-3), 알람 시계 위젯(149-4), 사전 위젯(149-5), 및 사용자에 의해 얻어지는 다른 위젯들뿐 아니라 사용자-생성 위젯들(149-6) 중 하나 이상을 선택적으로 포함하는 위젯 모듈들(149);

Weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets obtained by the user. As well as widget modules 149 that selectively include one or more of user-generated widgets 149-6;

사용자-생성 위젯들(149-6)을 만들기 위한 위젯 생성기 모듈(150);

A widget generator module 150 for making user-generated widgets 149-6;

검색 모듈(151);

Search module 151;

비디오 재생기 모듈 및 음악 재생기 모듈을 통합하는 비디오 및 음악 재생기 모듈(152);

A video and music player module 152 incorporating a video player module and a music player module;

메모 모듈(153);

Memo module 153;

지도 모듈(154); 및/또는

Map module 154; And/or

온라인 비디오 모듈(155).

Online video module 155.

선택적으로 메모리(102) 내에 저장되는 다른 애플리케이션들(136)의 예들은 다른 워드 프로세싱 애플리케이션들, 다른 이미지 편집 애플리케이션들, 드로잉 애플리케이션들, 프레젠테이션 애플리케이션들, JAVA-인에이블형 애플리케이션들, 암호화, 디지털 저작권 관리, 음성 인식 및 음성 복제를 포함한다.

Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital copyright. Includes management, speech recognition and speech replication.

Along with the touch screen 112, the display controller 156, the contact/motion module 130, the graphics module 132 and the text input module 134, the contacts module 137 is, optionally, an address book or contact list ( For example, it is used to manage the application internal state 192 of the contacts module 137 in the memory 102 or in the memory 370): this includes: adding the name(s) to the address book. that; Deleting name(s) from the address book; Associating phone number(s), email address(s), physical address(s), or other information with a name; Associating an image with a name; Sorting and sorting names; Providing phone numbers or email addresses to initiate and/or facilitate communication by phone 138, video conferencing module 139, email 140 or IM 141, and the like.

RF circuit unit 108, audio circuit unit 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact/motion module 130, graphic module 132, and text Along with the input module 134, the phone module 138, optionally, inputs a sequence of characters corresponding to the phone number, accesses one or more phone numbers in the contact module 137, and modifies the input phone number. It is used to dial an individual phone number, have a conversation, and disconnect or hang up when the conversation is complete. As noted above, wireless communication optionally uses any of a plurality of communication standards, protocols and technologies.

RF circuit unit 108, audio circuit unit 110, speaker 111, microphone 113, touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact/motion Along with the module 130, the graphics module 132, the text input module 134, the contact module 137 and the phone module 138, the video conference module 139 is Contains executable instructions for initiating, conducting and ending a video conference between participants.

Along with the RF circuit unit 108, the touch screen 112, the display controller 156, the contact/motion module 130, the graphic module 132 and the text input module 134, the email client module 140 is user-directed It contains executable instructions for creating, sending, receiving, and managing emails in response to emails. Together with the image management module 144, the email client module 140 makes it very easy to create and send an email with still or video images taken with the camera module 143.

Together with the RF circuitry 108, the touch screen 112, the display controller 156, the contact/motion module 130, the graphics module 132 and the text input module 134, the instant messaging module 141 Enter a sequence of characters corresponding to the message, modify previously entered characters (for example, Short Message Service (SMS) or Multimedia Message Service for phone-based instant messages) , MMS) protocol, or using XMPP, SIMPLE or IMPS for Internet-based instant messages), includes executable instructions to send individual instant messages, receive instant messages, and view received instant messages. . In some embodiments, the sent and/or received instant messages optionally include graphics, photos, audio files, video files and/or other attachments as supported by MMS and/or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to phone-based messages (eg, messages sent using SMS or MMS) and Internet-based messages (eg, messages sent using XMPP, SIMPLE or IMPS). S) refers to both.

RF circuit unit 108, touch screen 112, display controller 156, contact/motion module 130, graphic module 132, text input module 134, GPS module 135, map module 154 , And the music player module, the exercise support module 142 designs exercises (eg, with time, distance, and/or calorie expenditure goals); Communicates with athletic sensors (sports devices); Receive motion sensor data; Calibrate sensors used to monitor exercise; Select and play music for exercise; Includes executable instructions to display, store and transmit athletic data.

With touch screen 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact/motion module 130, graphics module 132 and image management module 144 , The camera module 143 captures still images or video (including a video stream) and stores them in the memory 102, modifies the properties of the still image or video, or the still image or video from the memory 102 Contains executable instructions that cause the video to be deleted.

With the touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134 and camera module 143, the image management module 144 is /Or include executable instructions to arrange, modify (e.g., edit) video images, or otherwise manipulate, label, delete, present (e.g., in a digital slide show or album), and store .

Along with the RF circuit unit 108, the touch screen 112, the display controller 156, the contact/motion module 130, the graphic module 132, and the text input module 134, the browser module 147, a web page Executable instructions to browse the Internet according to user instructions, including retrieving, linking to, receiving, and displaying attachments and other files linked to web pages, as well as files or portions thereof. Includes them.

RF circuit unit 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, email client module 140, and browser module ( In conjunction with 147), the calendar module 148 is an executable to create, display, modify, and store calendars and data associated with calendars (e.g., calendar entries, to-do lists, etc.) according to user instructions. Contains instructions.

Together with the RF circuit unit 108, the touch screen 112, the display controller 156, the contact/motion module 130, the graphic module 132, the text input module 134 and the browser module 147, widget modules 149 is optionally downloaded and used by the user (e.g., weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4) and dictionary. Widgets 149-5), or mini-applications created by the user (eg, user-generated widgets 149-6). In some embodiments, the widget includes a Hypertext Markup Language (HTML) file, Cascading Style Sheets (CSS) file, and a JavaScript file. In some embodiments, the widget includes an Extensible Markup Language (XML) file and a JavaScript file (eg, Yahoo! widgets).

Along with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134 and browser module 147, a widget generator module 150 is optionally used to generate widgets by a user (eg, to change a user specific part of a web page into a widget).

Along with the touch screen 112, the display controller 156, the contact/motion module 130, the graphics module 132, and the text input module 134, the search module 151 provides one or more search criteria according to user instructions. Contains executable instructions to search for text, music, sound, image, video, and/or other files in memory 102 that match those (eg, one or more user-specific search terms).

With touch screen 112, display controller 156, contact/motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108 and browser module 147 , Video and music player module 152, executable instructions that allow a user to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, and videos ( For example, it includes executable instructions to display, screen, or otherwise play on the touch screen 112 or on an externally connected display (via an external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

Along with the touch screen 112, the display controller 156, the contact/motion module 130, the graphic module 132, and the text input module 134, the memo module 153 can take notes and do notes according to user instructions. Contains executable instructions that allow you to create and manage to-do lists and the like.

RF circuit unit 108, touch screen 112, display controller 156, contact/motion module 130, graphic module 132, text input module 134, GPS module 135, and browser module 147 ), the map module 154 optionally includes maps and data associated with the maps according to user instructions (eg, driving directions; data relating to stores and other points of interest at or near a particular location; And other location-based data), display, modify, and store.

Touch screen 112, display controller 156, contact/motion module 130, graphic module 132, audio circuit unit 110, speaker 111, RF circuit unit 108, text input module 134, Together with email client module 140 and browser module 147, online video module 155 allows a user to access online videos in one or more file formats such as H.264, browse them, (e.g., stream and / Or download), play (e.g., on a touch screen or on an externally connected display via external port 124), send an email with a link to a specific online video, otherwise manage Contains commands to In some embodiments, the instant messaging module 141 rather than the email client module 140 is used to send a link to a specific online video. For further description of online video applications, see US Provisional Patent Application No. 60/936,562, filed June 20, 2007, "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos" and December 31, 2007. It can be found in US Patent Application No. 11/968,067 filed on date, "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos", the contents of which are hereby incorporated by reference in their entirety. .

Each of the modules and applications identified above is an executable instruction for performing one or more functions described above and methods described herein (e.g., computer implemented methods and other information processing methods described herein). Corresponds to a set of things. These modules (e.g., sets of instructions) need not be implemented as separate software programs, procedures or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. . For example, the video player module is optionally combined in a single module (eg, video and music player module 152 in FIG. 1A) with a music player module. In some embodiments, memory 102 optionally stores a subset of the modules and data structures identified above. In addition, memory 102 optionally stores additional modules and data structures not described above.

In some embodiments, device 100 is a device in which operation of a predefined set of functions on the device is performed exclusively through a touch screen and/or a touchpad. By using the touch screen and/or touchpad as the primary input control device for operation of the device 100, the number of physical input control devices (such as push buttons, dials, etc.) on the device 100 is selectively reduced.

The predefined set of functions performed entirely through the touch screen and/or the touch pad, optionally, includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 to a main, home or root menu from any user interface displayed on the device 100. In these embodiments, a "menu button" is implemented using a touch pad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touch pad.

1B is a block diagram illustrating example components for event processing, in accordance with some embodiments. In some embodiments, the memory (102 in FIG. 1A or 370 in FIG. 3) is an event classifier 170 (e.g., in operating system 126) and an individual application 136-1 (e.g., application described above). And any of 137-151, 155, 380-390).

The event classifier 170 receives event information and determines an application 136-1 to which the event information is to be transmitted, and an application view 191 of the application 136-1. The event classifier 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, the application 136-1 includes an application internal state 192 that indicates the current application view(s) displayed on the touch-sensitive display 112 when the application is active or running. In some embodiments, the device/global internal state 157 is used by the event classifier 170 to determine which application(s) are currently active, and the application internal state 192 is applied to the event classifier 170. It is used to determine application views 191 to deliver event information by.

In some embodiments, the application internal state 192 is a user representing resume information to be used when application 136-1 resumes execution, information being displayed by application 136-1 or ready to be displayed. Among the interface state information, a state queue to enable the user to return to the previous state or view of the application 136-1, and a redo/undo queue of previous actions taken by the user. Include additional information, such as one or more.

The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information about a sub-event (eg, a user touch on the touch-sensitive display 112 as part of a multi-touch gesture). Peripheral interface 118 is from the I/O subsystem 106 or a sensor, e.g., proximity sensor 166, accelerometer(s) 168, and/or microphone 113 (via audio circuitry 110). Send the information it receives. The information that the peripherals interface 118 receives from the I/O subsystem 106 includes information from the touch-sensitive display 112 or touch-sensitive surface.

In some embodiments, event monitor 171 sends requests to peripherals interface 118 at predetermined intervals. In response to this, the peripheral device interface 118 transmits event information. In other embodiments, the peripherals interface 118 transmits event information only when there is a significant event (e.g., receiving an input exceeding a predetermined noise threshold and/or receiving an input over a predetermined duration). .

In some embodiments, event classifier 170 also includes a hit view determination module 172 and/or an active event recognizer determination module 173.

The hit view determination module 172 provides software procedures to determine where a subevent has occurred within one or more views when the touch-sensitive display 112 displays more than one view. Views are made up of controls and other elements that the user can see on the display.

Another aspect of a user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, where information is displayed and touch-based gestures occur. The application views (of the individual application) for which a touch is detected optionally correspond to a program of the application or program levels within the view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as appropriate inputs is determined based at least in part on the hit view of the initial touch, optionally initiating a touch-based gesture. do.

The hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized in a hierarchy, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchy that should handle subevents. In most situations, the hit view is the lowest level view in which the subevent being initiated (eg, the first subevent in the sequence of subevents forming the event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all subevents related to the same touch or input source that caused it to be identified as a hit view.

The active event recognizer determination module 173 determines which views or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of subevents. In other embodiments, the active event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively involved views, so that all actively involved views are specific to the sub-events. It decides that the sequence should be received. In other embodiments, even if touch sub-events were entirely confined to an area associated with one particular view, higher views in the hierarchy would still remain as actively engaged views.

The event dispatcher module 174 dispatches event information to an event recognizer (eg, event recognizer 180). In embodiments including the active event recognizer determination module 173, the event dispatcher module 174 communicates the event information to the event recognizer determined by the active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores event information in an event queue, which event information is retrieved by individual event receivers 182.

In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In still other embodiments, event classifier 170 is a standalone module, or part of another module that is stored in memory 102 such as contact/motion module 130.

In some embodiments, the application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which is a touch event occurring within a respective view of the application's user interface. Contains instructions for processing them. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, each application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of the event recognizers 180 may be a separate user interface kit (not shown) or a higher level object, such as a higher level object that the application 136-1 inherits methods and other properties. It is part of the module. In some embodiments, each event handler 190 is one of the data updater 176, the object updater 177, the GUI updater 178, and/or the event data 179 received from the event classifier 170. It includes the above. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176, the object updater 177, or the GUI updater 178. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Further, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included within the respective application view 191.

Each event recognizer 180 receives event information (eg, event data 179) from event classifier 170 and identifies an event from the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event recognizer 180 also includes at least a subset of metadata 183 and event delivery instructions 188 (optionally including sub-event delivery instructions).

The event receiver 182 receives event information from the event classifier 170. The event information includes information about a sub-event, for example, a touch or a touch movement. Depending on the sub-event, the event information also includes additional information such as the location of the sub-event. If the sub-event is related to the motion of the touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, events include rotation of the device from one orientation to another (e.g., from portrait to landscape orientation, or vice versa), and the event information is the current orientation of the device (also referred to as device orientation). Contains the corresponding information about

The event comparator 184 compares the event information with predefined event or sub-event definitions, and based on the comparison, determines an event or sub-event, or determines or updates the state of the event or sub-event. In embodiments, event comparator 184 includes event definitions 186. Event definitions 186 include definitions of events (eg, predefined sequences of sub-events), eg, event 1 (187-1), event 2 (187-2), and the like. In some embodiments, sub-events within event 187 include, for example, touch start, touch end, touch move, touch cancel, and multiple touches. In one example, the definition for event 1 187-1 is a double tap on the displayed object. The double tap is, for example, a first touch on a displayed object during a predetermined phase (touch start), a first liftoff during a predetermined phase (touch end), the displayed object during a predetermined phase. A second touch on the image (touch start), and a second liftoff during a predetermined phase (touch end). In another example, the definition for event 2 187-2 is dragging on the displayed object. Dragging includes, for example, a touch (or touch) on a displayed object during a predetermined phase, movement of the touch across the touch-sensitive display 112, and lift-off of the touch (touch termination). In some embodiments, the event also includes information about one or more associated event handlers 190.

In some embodiments, event definition 187 includes a definition of an event for a respective user interface object. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, in the application view in which three user interface objects are displayed on the touch-sensitive display 112, when a touch is detected on the touch-sensitive display 112, the event comparator 184 is A hit test is performed to determine which of them is associated with the touch (sub-event). When each displayed object is associated with a respective event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, the event comparator 184 selects the object triggering the hit test and the event handler associated with the sub-event.

In some embodiments, the definition for each event 187 also includes delayed actions that delay delivery of event information until after it is determined whether the sequence of subevents corresponds to or does not correspond to the event type of the event recognizer. .

If the individual event recognizer 180 determines that the series of sub-events do not match any of the events in the event definitions 186, the individual event recognizer 180 is the event impossible, event failure, or event termination. Upon entering the state, each event recognizer then ignores subsequent sub-events of the touch-based gesture. In this situation, other event recognizers that remain active for the hit view, if any, continue to track and process sub-events of the ongoing touch-based gesture.

In some embodiments, the individual event recognizer 180 contains configurable attributes, flags, and/or lists that indicate how the event delivery system should perform sub-event delivery to actively engaged event recognizers. It includes metadata 183 to have. In some embodiments, metadata 183 includes configurable attributes, flags, and/or lists that indicate how event recognizers interact with, or may interact with, each other. In some embodiments, metadata 183 includes configurable attributes, flags, and/or lists that indicate whether sub-events are delivered to various levels in the view or program hierarchy.

In some embodiments, each event recognizer 180 activates an event handler 190 associated with the event when one or more specific sub-events of the event are recognized. In some embodiments, each event recognizer 180 communicates event information associated with the event to the event handler 190. Activating the event handler 190 is separate from sending (and delaying sending) sub-events to individual hit views. In some embodiments, event recognizer 180 sends a flag associated with the recognized event, and event handler 190 associated with the flag catches the flag and performs a predefined process.

In some embodiments, the event delivery instructions 188 include subevent delivery instructions that deliver event information about the subevent without activating the event handler. Instead, subevent delivery instructions deliver event information to event handlers associated with a series of subevents or to actively participating views. Event handlers associated with a series of sub-events or actively participating views receive event information and perform a predetermined process.

In some embodiments, data updater 176 creates and updates data used by application 136-1. For example, the data updater 176 updates a phone number used in the contact module 137 or stores a video file used in the video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, the object updater 177 creates a new user interface object or updates the location of the user interface object. The GUI updater 178 updates the GUI. For example, the GUI updater 178 prepares display information for display on a touch-sensitive display and transmits it to the graphics module 132.

In some embodiments, event handler(s) 190 includes or accesses data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are contained within a single module of individual application 136-1 or application view 191. In other embodiments, they are contained within two or more software modules.

1C is a block diagram illustrating a tactile output module according to some embodiments. In some embodiments, the I/O subsystem 106 (e.g., haptic feedback controller 161 (FIG. 1A) and/or other input controller(s) 160 (FIG. 1A)) is shown in FIG. Includes at least some of the example components. In some embodiments, peripherals interface 118 includes at least some of the exemplary components shown in FIG. 1C.

In some embodiments, the tactile output module includes a haptic feedback module 133. In some embodiments, the haptic feedback module 133 provides user interface feedback from software applications on the electronic device (e.g., alerts and other notifications indicating the occurrence of events or performance of actions in user interfaces of the electronic device) and Tactile outputs for (feedback responsive to user inputs corresponding to the displayed user interfaces) are collected and combined. The haptic feedback module 133 includes a waveform module 123 (for providing waveforms used to generate tactile outputs), a mixer 125 (for mixing waveforms such as waveforms in different channels), A compressor 127 (for reducing or compressing the dynamic range of the waveforms), a low pass filter 129 (for filtering high-frequency signal components in the waveforms), and for adjusting the waveforms according to thermal conditions. ) Including one or more of the thermal controller 131. In some embodiments, the haptic feedback module 133 is included within the haptic feedback controller 161 (FIG. 1A ). In some embodiments, a separate unit of the haptic feedback module 133 (or a separate implementation of the haptic feedback module 133) is also included in the audio controller (e.g., audio circuitry 110, FIG. It is used to generate audio signals. In some embodiments, a single haptic feedback module 133 is used to generate waveforms for tactile outputs and generate audio signals.

In some embodiments, the haptic feedback module 133 also includes a trigger module 121 (e.g., a software application that initiates a process for determining a generated tactile output and generating a corresponding tactile output, an operating system, Or other software modules). In some embodiments, trigger module 121 generates trigger signals to initiate generation of waveforms (eg, by waveform module 123 ). For example, the trigger module 121 generates trigger signals based on preset timing criteria. In some embodiments, trigger module 121 receives trigger signals from outside of haptic feedback module 133 (e.g., in some embodiments, haptic feedback module 133 is outside of haptic feedback module 133 ). Receive trigger signals from a hardware input processing module 146 located at), trigger signals into a user interface element (e.g., an affordance in an application or an application icon) or a hardware input device (e.g., an intensity-sensitive touch screen such as an intensity-sensitive touch screen) Software applications that trigger actions (e.g., using trigger module 121) based on activation of an input surface or home button) or other components within haptic feedback module 133 (e.g., waveform module 123) To relay. In some embodiments, trigger module 121 also receives tactile feedback generating instructions (eg, from haptic feedback module 133 of FIGS. 1A and 3 ). In some embodiments, the trigger module 121 is a haptic feedback module 133 (or a trigger module 121 in the haptic feedback module 133) (e.g., from the haptic feedback module 133 of FIGS. 1A and 3 ). In response to receiving these tactile feedback instructions, trigger signals are generated.

Waveform module 123 receives trigger signals as input (e.g., from trigger module 121), and in response to receiving the trigger signals, waveforms (e.g., FIGS. 4C and 4C) for generation of one or more tactile outputs 4D, waveforms selected from a predefined set of waveforms designated for use by waveform module 123, such as the waveforms described in more detail below, are provided.

Mixer 125 receives waveforms as input (eg, from waveform module 123) and mixes the waveforms together. For example, when the mixer 125 receives two or more waveforms (e.g., a first waveform in a first channel, and a second waveform at least partially overlapping with the first waveform in the second channel), The mixer 125 outputs a combined waveform corresponding to the summation of two or more waveforms. In some embodiments, mixer 125 may also (e.g., increase the scale of the particular waveform(s) and/or decrease the scale of the remainder of the waveforms) to convert the particular waveform(s) among two or more Modify one or more of the two or more waveforms to emphasize the rest. In some situations, mixer 125 selects one or more waveforms to remove from the combined waveform (e.g., waveforms from more than three sources that were requested to be output simultaneously by tactile output generator 167 When present, the waveform from the oldest source is dropped).

Compressor 127 receives waveforms (eg, the combined waveform from mixer 125) as input and modifies the waveforms. In some embodiments, compressor 127 reduces the waveforms (e.g., according to the physical specifications of the tactile output generators (167 in FIG. 1A or 357 in FIG. 3)) to reduce the tactile output corresponding to those waveforms. Let the outputs be reduced. In some embodiments, compressor 127 limits the waveforms, such as by forcing a predefined maximum amplitude for the waveforms. For example, compressor 127 reduces the amplitudes of the portions of the waveforms that exceed the predefined amplitude threshold while maintaining the amplitudes of the portions of the waveforms that do not exceed the predefined amplitude threshold. In some embodiments, compressor 127 reduces the dynamic range of the waveforms. In some embodiments, the compressor 127 dynamically reduces the dynamic range of the waveforms so that the combined waveforms can be applied to the performance specifications of the tactile output generator 167 (e.g., force and/or movable mass displacement limits). Keep within.

The low-pass filter 129 receives waveforms (e.g., compressed waveforms from the compressor 127) as input, and filters (e.g., smoothes) the waveforms (e.g., removing high-frequency signal components from the waveforms). Or decrease). For example, in some cases, the compressor 127 exceeds the performance specifications of the tactile output generator 167 and/or tactile when the tactile outputs are generated according to the compressed waveforms, with compressed waveforms. It contains unrelated signals (eg, high-frequency signal components) that interfere with the generation of outputs. The low pass filter 129 reduces or removes such irrelevant signals in the waveforms.

Thermal controller 131 receives waveforms (e.g., filtered waveforms from low pass filter 129) as input, and (e.g., internal temperatures detected within device 100, e.g., haptic feedback controller ( The waveforms are adjusted according to the thermal conditions of the device 100) based on the temperature of 161 and/or external temperatures detected by the device 100. For example, in some cases, the output of haptic feedback controller 161 changes with temperature (e.g., haptic feedback controller 161 is, in response to receiving the same waveforms, haptic feedback controller 161 first It generates a first tactile output when at temperature, and a second tactile output when haptic feedback controller 161 is at a second temperature that is separate from the first temperature). For example, the magnitude (or amplitude) of tactile outputs can vary with temperature. To reduce the effect of temperature changes, the waveforms are modified (eg, the amplitude of the waveforms increases or decreases based on temperature).

In some embodiments, the haptic feedback module 133 (eg, trigger module 121) is coupled to the hardware input processing module 146. In some embodiments, the other input controller(s) 160 in FIG. 1A includes a hardware input processing module 146. In some embodiments, the hardware input processing module 146 is a hardware input device 145 (e.g., other input or control devices 116 in FIG. 1A, e.g., an intensity sensitive input surface such as an intensity sensitive touch screen). Or the home button). In some embodiments, the hardware input device 145 is any input device described herein, such as a touch-sensitive display system 112 (Fig. 1A), a keyboard/mouse 350 (Fig. 3), a touch pad. 355 (Fig. 3), one of the other input or control devices 116 (Fig. 1A), or a strength-sensitive home button. In some embodiments, the hardware input device 145 is not a touch-sensitive display system 112 (FIG. 1A), a keyboard/mouse 350 (FIG. 3), or a touch pad 355 (FIG. 3). It consists of a strength-sensitive home button. In some embodiments, in response to inputs from the hardware input device 145 (e.g., intensity-sensitive home button or touch screen), the hardware input processing module 146 One or more trigger signals are provided to the haptic feedback module 133 to indicate that an input, such as an input corresponding to a “click” of the home button (eg, “down click” or “up click”), has been detected. In some embodiments, the haptic feedback module 133 simulates haptic feedback of pressing the physical home button by providing waveforms corresponding to the "click" of the home button in response to an input corresponding to the "click" of the home button. do.

In some embodiments, the tactile output module includes a haptic feedback controller 161 (eg, haptic feedback controller 161 in FIG. 1A), which controls the generation of tactile outputs. In some embodiments, the haptic feedback controller 161 is coupled to a plurality of tactile output generators and selects one or more tactile output generators of the plurality of tactile output generators to generate a waveform for generating tactile outputs. To the selected one or more tactile output generators. In some embodiments, the haptic feedback controller 161 includes tactile output requests corresponding to activation of the hardware input device 145 and tactile output requests corresponding to software events (e.g., a haptic feedback module ( 133) and prioritize tactile outputs corresponding to activation of hardware input device 145 over tactile outputs corresponding to software events (e.g., to prioritize tactile outputs corresponding to activation of hardware input device 145). , By increasing the scale of the particular waveform(s) and/or decreasing the scale of the rest of the waveforms) one or more of the two or more waveforms to emphasize the particular waveform(s) relative to the rest of the two or more waveforms. Modify the waveforms.

In some embodiments, as shown in FIG. 1C, the output of the haptic feedback controller 161 is coupled to the audio circuitry of the device 100 (e.g., the audio circuitry 110 of FIG. Provided in the audio circuit unit of (100). In some embodiments, the haptic feedback controller 161 provides both waveforms used to generate tactile outputs and audio signals used to provide audio outputs with the generation of tactile outputs. In some embodiments, the haptic feedback controller 161 modifies the audio signals and/or waveforms (used to generate tactile outputs), so that the audio signal (e.g., by delaying the audio signals and/or waveforms) Allow the outputs and tactile outputs to be synchronized. In some embodiments, haptic feedback controller 161 includes a digital-to-analog converter used to convert digital waveforms into analog signals, which analog signals are amplifier 163 and/or tactile output generator 167 Received by ).

In some embodiments, the tactile output module includes an amplifier 163. In some embodiments, amplifier 163 receives waveforms (e.g., from haptic feedback controller 161), amplifies the waveforms, and then outputs the amplified waveforms to tactile output generator 167 (e.g., tactile output). To the generators (any of 167 in Fig. 1A or 357 in Fig. 3). For example, the amplifier 163 converts the received waveforms into signal levels according to the physical specifications of the tactile output generator 167 (e.g., the signals transmitted to the tactile output generator 167 are converted to a haptic feedback controller ( 161), amplifying the amplified waveforms with a voltage and/or current required by the tactile output generator 167 to generate tactile outputs to generate tactile outputs corresponding to the waveforms received from To the output generator 167. In response, the tactile output generator 167 generates tactile outputs (eg, by shifting the movable mass back and forth in one or more dimensions relative to the neutral position of the movable mass).

In some embodiments, the tactile output module includes a sensor 169, which sensor is coupled to the tactile output generator 167. The sensor 169 may be of the tactile output generator 167 or one or more components of the tactile output generator 167 (e.g., one or more moving parts such as a membrane used to generate tactile outputs). Detect states or state changes (eg, mechanical position, physical displacement, and/or movement). In some embodiments, sensor 169 is a magnetic field sensor (eg, a Hall effect sensor) or other displacement and/or movement sensor. In some embodiments, the sensor 169 provides information (e.g., the location, displacement, and/or movement of one or more parts within the tactile output generator 167) to the haptic feedback controller 161 and provides a tactile output. Depending on the information provided by the sensor 169 about the state of the generator 167, the haptic feedback controller 161 can provide the haptic feedback controller 161 with waveforms output from the haptic feedback controller 161 (e.g. The waveforms transmitted to the red output generator 167) are adjusted.

The above discussion regarding event handling of user touches on a touch-sensitive display also applies to other types of user inputs for operating multifunction devices 100 with input devices, but all of which originate on touch screens. It should be understood that it is not. For example, mouse movements and mouse button presses selectively coordinated with single or multiple keyboard presses or hold; Contact movements such as tap, drag, scroll, etc. on the touch pad; Pen stylus inputs; Device movement; Verbal commands; Detected eye movements; Biometric inputs; And/or any combination thereof are optionally used as inputs corresponding to subevents defining the event to be recognized.

2 shows a portable multifunction device 100 with a touch screen 112 in accordance with some embodiments. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment, as well as other embodiments described below, the user may, for example, have one or more fingers 202 (not shown to scale in the figure) or one or more stylus 203 (scale in the figure). Not shown as shown) makes it possible to select one or more of the graphics by making a gesture on the graphic. In some embodiments, the selection of one or more graphics occurs when the user stops contacting the one or more graphics. In some embodiments, the gesture may optionally be one or more taps of a finger in contact with the device 100, one or more swipes (left to right, right to left, upward and/or downward). , And/or rolling (right to left, left to right, upward and/or downward). In some implementations or situations, if the graphic is inadvertently contacted, the graphic is not selected. For example, when the gesture corresponding to the selection is a tap, the swipe gesture for sweeping over the application icon selectively does not select the corresponding application.

Device 100 also optionally includes one or more physical buttons, such as a “home” or menu button 204. As described above, the menu button 204 is optionally used to navigate to any application 136 in the set of applications that are selectively running on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.

In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a push button 206 to power on/off the device and lock the device, a volume control button(s) 208 , A subscriber identification module (SIM) card slot 210, a headset jack 212, and a docking/charging external port 124. The push button 206 optionally powers on/off the device by pressing the button and holding the button pressed for a predefined time interval; Locking/locking the device by pressing the button and releasing the button before a predefined time interval elapses; It is used to unlock the device or initiate the unlock process. In an alternative embodiment, device 100 also accepts verbal input for activation or deactivation of some functions via microphone 113. The device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contacts on the touch screen 112 and/or for generating tactile outputs for the user of the device 100. One or more tactile output generators 167 are included.

3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface, in accordance with some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, an educational device (such as a children's learning toy), a gaming system, or a control device (e.g., home or industrial Controller). Device 300 typically includes one or more processing units (CPU) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses for interconnecting these components ( 320). Communication buses 320 optionally include circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between them. Device 300 includes an input/output (I/O) interface 330 that includes a display 340, which is typically a touch screen display. The I/O interface 330 also optionally includes a keyboard and/or mouse (or other pointing device) 350 and a touchpad 355, a tactile output for generating tactile outputs on the device 300. Generator 357 (e.g., similar to tactile output generator(s) 167 described above with reference to FIG. 1A), and sensors 359 (e.g., contact intensity sensor(s) described above with reference to FIG. ), a light sensor similar to 165, an acceleration sensor, a proximity sensor, a touch sensitive sensor, and/or a contact intensity sensor). Memory 370 includes high speed random access memory such as DRAM, SRAM, DDR RAM or other random access solid state memory devices; Optionally one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other nonvolatile solid state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU(s) 310. In some embodiments, memory 370 includes programs, modules, and data structures similar to programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1A). , Or a subset of them. In addition, memory 370 optionally stores additional programs, modules and data structures not present in memory 102 of portable multifunction device 100. For example, the memory 370 of the device 300 is, optionally, a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk authoring module 388 ), and/or the spreadsheet module 390, while the memory 102 of the portable multifunction device 100 (FIG. 1A), optionally, does not store these modules.

Each of the previously identified elements in FIG. 3 is, optionally, stored in one or more of the memory devices described above. Each of the previously identified modules corresponds to a set of instructions for performing the functions described above. The modules or programs (e.g., sets of instructions) identified above need not be implemented as separate software programs, procedures, or modules, so in various embodiments, various subsets of these modules are selectively combined. Or otherwise rearranged. In some embodiments, memory 370 optionally stores a subset of the modules and data structures identified above. Further, the memory 370 optionally stores additional modules and data structures not described above.

Attention is now directed to embodiments of user interfaces selectively implemented on, for example, portable multifunction device 100.

4A shows an exemplary user interface for a menu of applications on portable multifunction device 100, in accordance with some embodiments. Similar user interfaces are optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

셀룰러 및 Wi-Fi 신호들과 같은 무선 통신(들)을 위한 신호 세기 표시자(들)(402);

Signal strength indicator(s) 402 for wireless communication(s) such as cellular and Wi-Fi signals;

시간(404);

Time 404;

블루투스 표시자(405);

Bluetooth indicator 405;

배터리 상태 표시자(406);

Battery status indicator 406;

다음과 같은, 빈번하게 사용되는 애플리케이션들에 대한 아이콘들을 갖는 트레이(408):

Tray 408 with icons for frequently used applications, such as:

° An icon 416 for the phone module 138 labeled "Call", optionally including an indicator 414 of the number of missed calls or voicemail messages;

° An icon 418 for an email client module 140 labeled “mail” that optionally includes an indicator 410 of the number of unread emails;

° An icon 420 for the browser module 147 labeled “browser”; and

° An icon 422 for a video and music player module 152 labeled “iPod”, also referred to as an iPod (trademark of Apple Inc.) module 152; and

Icons for different applications, such as:

° An icon 424 for the IM module 141, labeled “Message”;

° An icon 426 for the calendar module 148, labeled “calendar”;

° An icon 428 for the image management module 144, labeled "Photo";

° Icon 430 for camera module 143, labeled "camera";

° Icon 432 for online video module 155, labeled “online video”;

° Icon 434 for stock widget 149-2, labeled "stock";

° An icon 436 for the map module 154, labeled "Map";

° Icon 438 for weather widget 149-1 labeled "Weather";

° Icon 440 for alarm clock widget 149-4, labeled "Clock";

° Icon 442 for exercise support module 142, labeled "Exercise Support";

° An icon 444 for the notes module 153, labeled “Notes”; and

° An icon 446 for a settings application or module, labeled "Settings," that provides access to settings for device 100 and its various applications 136.

It should be noted that the icon labels shown in FIG. 4A are merely exemplary. For example, icon 422 for video and music player module 152 is labeled “music” or “music player”. Other labels are optionally used for various application icons. In some embodiments, the label for an individual application icon includes the name of the application corresponding to the individual application icon. In some embodiments, the label for a specific application icon is separate from the name of the application corresponding to the specific application icon.

FIG. 4B shows a device (e.g., of FIG. 3) with a touch-sensitive surface 451 (e.g., tablet or touchpad 355 of FIG. An exemplary user interface on device 300 is shown. Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) and/or device 300 for detecting the intensity of contacts on touch-sensitive surface 451 And one or more tactile output generators 357 for generating tactile outputs for a user of.

While some of the following examples will be provided with reference to inputs on the touch screen display 112 (the touch-sensitive surface and display are combined), in some embodiments, the device is separate from the display as shown in FIG. Detect inputs on a personal touch-sensitive surface. In some embodiments, the touch-sensitive surface (eg, 451 in FIG. 4B) has a major axis (eg, 452 in FIG. 4B) that corresponds to a major axis (eg, 453 in FIG. 4B) on the display (eg, 450 ). According to these embodiments, the device is in contact with the touch-sensitive surface 451 at locations corresponding to individual locations on the display (e.g., in FIG. 4B, 460 corresponds to 468, and 462 corresponds to 470). Detect contacts (eg, 460 and 462 in FIG. 4B). In this way, user inputs (e.g., contacts 460, 462 and their movements) detected by the device on the touch-sensitive surface (e.g., 451 in FIG. 4B) are independent of the display. Is used by the device to manipulate the user interface on the display of the multifunction device (eg, 450 in FIG. 4B). It should be understood that similar methods are, optionally, used for other user interfaces described herein.

Additionally, while the following examples are given primarily with reference to finger inputs (e.g., finger contacts, finger tap gestures, finger swipe gestures), in some embodiments, one or more of the finger inputs is a different input device. It should be understood that input from (eg, mouse-based input or stylus input) is substituted. For example, a swipe gesture is optionally replaced with a mouse click (eg, instead of a contact) and subsequent movement of the cursor along the path of the swipe (eg, instead of a movement of the contact). As another example, the tap gesture is optionally replaced by a mouse click while the cursor is positioned over the location of the tap gesture (eg, instead of stopping detecting the contact following detection of the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are selectively used simultaneously, or mouse and finger contacts are selectively used simultaneously.

5A shows an exemplary personal electronic device 500. The device 500 includes a body 502. In some embodiments, device 500 may include some or all of the features described with respect to devices 100 and 300 (eg, FIGS. 1A-4B ). In some embodiments, device 500 has a touch-sensitive display screen 504 (hereinafter, touch screen 504). Alternatively or additionally to the touch screen 504, the device 500 has a display and a touch-sensitive surface. Like devices 100, 300, in some embodiments, touch screen 504 (or touch-sensitive surface) is, optionally, one for detecting the intensity of applied contacts (eg, touches). It includes more than one intensity sensor. One or more intensity sensors of the touch screen 504 (or touch-sensitive surface) may provide output data representing the intensity of the touches. The user interface of device 500 may respond to touches based on the intensity of the touches, meaning that different intensities of touches may invoke different user interface operations on device 500.

Exemplary techniques for detecting and processing touch intensity are, for example, related applications: filed May 8, 2013 and entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to" an Application" international patent application PCT/US2013/040061 (published as WIPO Publication No. WO/2013/169849), and filed on November 11, 2013, and the name of the invention is "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships", international patent application PCT/US2013/069483 (published as WIPO Publication No. WO/2014/105276), each of which is incorporated herein by reference in its entirety.

In some embodiments, device 500 has one or more input mechanisms 506, 508. The input mechanisms 506 and 508 (if included) may be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. These attachment mechanisms (if included) include, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, wristbands, chains, pants, belts, shoes, wallets , So that it can be attached to a backpack. These attachment mechanisms allow device 500 to be worn by a user.

5B shows an exemplary personal electronic device 500. In some embodiments, device 500 may include some or all of the components described with respect to FIGS. 1A, 1B, and 3. Device 500 has a bus 512 operatively coupling an I/O section 514 with one or more computer processors 516 and memory 518. The I/O section 514 may be connected to the display 504, which may have a touch-sensitive component 522, and optionally, an intensity sensor 524 (eg, a contact intensity sensor). In addition, the I/O section 514 includes a communication unit 530 to receive application and operating system data, using Wi-Fi, Bluetooth, Near Field Communication (NFC), cellular, and/or other wireless communication techniques. And can be connected. Device 500 may include input mechanisms 506 and/or 508. The input mechanism 506 is optionally a rotatable input device or, for example, a pushable and rotatable input device. In some examples, the input mechanism 508 is, optionally, a button.

In some examples, the input mechanism 508 is, optionally, a microphone. Personal electronic device 500, optionally, GPS sensor 532, accelerometer 534, direction sensor 540 (e.g., compass), gyroscope 536, motion sensor 538, and/or their It includes a variety of sensors, such as combinations, all of which can be operatively connected to the I/O section 514.

The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions, for example, in one or more computer processors 516. When executed by the computer processors, they cause the processes (800, 1000, 1200, 1400, 1600, 1800, 2000, 2200, 2500, 2700, 2900, 3100, 3300, 3500, 3700, 3900, 4100, 4300) (Fig. 8, Fig. 10, Fig. 12, Fig. 14, Fig. 16, Fig. 18, Fig. 20, Fig. 22, Fig. 25, Fig. 27, Fig. 29, Fig. 31, Fig. 33, Fig. 35, Fig. 37, Fig. 39, Fig. 41, It can be made to perform the techniques described below including Figure 43). A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transitory computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic, optical, and/or semiconductor storage. Examples of such storage include magnetic disks, optical disks based on CD, DVD, or Blu-ray technologies, as well as persistent solid state memory such as flash, solid state drives, and the like. The personal electronic device 500 is not limited to the components and configurations of FIG. 5B, and may include other or additional components in a number of configurations.

As used herein, the term “affordance” refers to user interactions that are selectively displayed on the display screen of devices 100, 300, and/or 500 (Figs. 1A, 3, and 5A and 5B). Refers to a user-interactive graphical user interface object. For example, images (eg, icons), buttons, and texts (eg, hyperlinks) each selectively constitute affordance.

As used herein, the term “focus selector” refers to an input element representing the current portion of the user interface that is interacting with the user. In some implementations that include a cursor or other location marker, a touch-sensitive surface (e.g., FIG. 3) while the cursor is over a specific user interface element (e.g., button, window, slider or other user interface element). When an input (e.g., a pressing input) is detected on the touchpad 355 of FIG. 4B or on the touch-sensitive surface 451 of FIG. 4B, the cursor is a “focus selector” so that a specific user interface element is adjusted according to the detected input. Functions as Some implementations including a touch screen display (e.g., touch-sensitive display system 112 of FIG. 1A or touch screen 112 of FIG. 4A) that enables direct interaction with user interface elements on the touch screen display. In the field, when an input (e.g., a pressing input by contact) is detected on a touch screen display at the location of a particular user interface element (e.g., button, window, slider or other user interface element), a particular user interface element is detected. The contact detected on the touch screen functions as a "focus selector" so that it is adjusted according to the entered input. In some implementations, the focus is one of the user interface without moving the corresponding cursor or moving the contact (e.g., by using a tab key or an arrow key to move the focus from one button to another). Is moved from one area to another area of the user interface; In such implementations, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the particular form the focus selector has, the focus selector is generally used to convey the user's intended interaction with the user interface (e.g., by indicating to the device an element of the user interface the user wishes to interact with). Is a user interface element (or touch on a touch screen display) controlled by. For example, the location of the focus selector (e.g., cursor, contact, or selection box) above each button while a press input is detected on a touch-sensitive surface (e.g., touch pad or touch screen) Unlike other user interface elements shown) it will indicate that the user is trying to activate each button.

As used in the specification and claims, the term “characteristic strength” of a contact refers to a property of a contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is, optionally, a predefined number of intensity samples, or (e.g., after detecting the contact, before detecting the lift off of the contact, before or after detecting the start of movement of the contact, Prior to detecting the end of the contact, before or after detecting an increase in the intensity of the contact, and/or before or after detecting a decrease in the intensity of the contact) a predetermined period (e.g.,) for a predefined event. 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) based on a set of intensity samples collected. The characteristic strength of the contact is, optionally, a maximum value of the contact intensities, a mean value of the contact intensities, an average value of the contact intensities, and a top 10 percentile value of the contact intensities. ), a value of half the maximum value of the intensities of the contact, a value of 90 percent of the maximum value of the intensities of the contact, and the like. In some embodiments, the duration of the contact is used to determine the feature strength (eg, when the feature strength is the average of the strength of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether the operation was performed by the user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, as a result of a contact having a characteristic strength not exceeding a first threshold, a first operation is performed, and a result of a contact having a characteristic strength that exceeds the first intensity threshold but not exceeding a second intensity threshold, a second The operation is performed, and as a result of the contact having a characteristic intensity exceeding the second threshold, a third operation is performed. In some embodiments, a comparison between a characteristic strength and one or more thresholds is not used to determine whether to perform a first operation or a second operation, but rather whether to perform one or more operations (e.g., performing individual operations). It is used to determine whether to do so or to withhold from performing individual actions).

5C shows the detection of a plurality of contacts 552A-552E on a touch-sensitive display screen 504 using a plurality of intensity sensors 524A-524D. 5C further includes intensity diagrams showing current intensity measurements of intensity sensors 524A through 524D for intensity units. In this example, the intensity measurements of the intensity sensors 524A and 524D are each 9 intensity units, and the intensity measurements of the intensity sensors 524B and 524C are each 7 intensity units. In some implementations, the total intensity is the sum of intensity measurements of the plurality of intensity sensors 524A-524D, which in this example are 32 intensity units. In some embodiments, each contact is assigned an individual intensity that is a fraction of the total intensity. 5D shows assigning the total strength to contacts 552A-552E based on their respective distances from the center of force 554. In this example, each of the contacts 552A, 552B, and 552E is assigned a contact intensity of 8 intensity units of the total intensity, and each of the contacts 552C, 552D is assigned a contact intensity of 4 intensity units of the total intensity. Is assigned. More generally, in some implementations, each contact j is assigned an individual intensity Ij that is part of the total intensity A according to a predefined mathematical function Ij = Ao(Dj/ΣDi) , Where Dj is the distance of the individual contact j to the center of the force, and ΣDi is the sum of the distances of all the individual contacts to the center of the force (eg i=1 to last). The operations described with reference to FIGS. 5C and 5D may be performed using an electronic device similar or identical to the device 100, 300, or 500. In some embodiments, the characteristic strength of the contact is based on one or more strengths of the contact. In some embodiments, intensity sensors are used to determine a single characteristic strength (eg, a single characteristic strength of a single contact). It should be noted that the intensity diagrams are not part of the displayed user interface and are included in FIGS. 5C and 5D to assist the reader.

In some embodiments, a portion of the gesture is identified to determine a characteristic strength. For example, the touch-sensitive surface optionally receives a continuous swipe contact that transitions from the start position and reaches the end position (the intensity of the contact increases at this point). In this example, the characteristic strength of the contact at the end position is optionally based on only a portion of the continuous swipe contact (eg, only the portion of the swipe contact at the end position), not the entire swipe contact. In some embodiments, a smoothing algorithm is optionally applied to the strengths of the swipe contact prior to determining the characteristic strength of the contact. For example, the smoothing algorithm may optionally be one of an unweighted sliding-average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and/or an exponential smoothing algorithm. Contains one or more. In some situations, these smoothing algorithms remove narrow spikes or dips in the strengths of the swipe contact to determine the feature strength.

The intensity of the contact on the touch-sensitive surface is optionally characterized for one or more intensity thresholds, such as a touch-detection intensity threshold, a light tap intensity threshold, a deep tap intensity threshold, and/or one or more other intensity thresholds. In some embodiments, the light tap intensity threshold corresponds to the intensity at which the device will perform actions typically associated with clicking a button or track pad of a physical mouse. In some embodiments, the deep click intensity threshold corresponds to the intensity at which the device will perform different actions than actions typically associated with clicking a button or trackpad of a physical mouse. In some embodiments, when a contact is detected with a characteristic strength below the lightly press strength threshold (e.g., and above the nominal contact detection strength threshold (less than the contact is no longer detected)), the device is It will move the focus selector in accordance with the movement of the contact on the touch-sensitive surface without performing an action associated with the threshold or deep press intensity threshold. In general, unless stated otherwise, these intensity thresholds are consistent among different sets of user interface drawings.

The increase in the characteristic strength of a contact from an intensity below the light tap intensity threshold to an intensity between the light tap intensity threshold and the deep tap intensity threshold is sometimes referred to as a "light tap" input. The increase in the characteristic strength of a contact from an intensity below the deep pressing intensity threshold to an intensity above the deep pressing intensity threshold is sometimes referred to as a "deep pressing" input. The increase in the characteristic strength of a contact from an intensity below the touch detection intensity threshold to an intensity between the touch detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting a contact on the touch surface. The reduction in the characteristic strength of a contact from an intensity above the touch detection intensity threshold to an intensity below the touch detection intensity threshold is sometimes referred to as detecting liftoff of the contact from the touch surface. In some embodiments, the touch detection intensity threshold is zero (0). In some embodiments, the contact detection intensity threshold is greater than zero.

In some embodiments described herein, one or more actions may be performed in response to detecting a gesture comprising an individual pressing input or detecting an individual pressing input performed with an individual contact (or a plurality of contacts). In response to, wherein the individual pressing input is detected based at least in part on detecting an increase in the intensity of a contact (or a plurality of contacts) above a pressing input intensity threshold. In some embodiments, the individual action is performed in response to detecting an increase in the intensity of the individual contact above the pressing input intensity threshold (eg, a “down stroke” of the individual pressing input). In some embodiments, the pressing input comprises an increase in the intensity of the individual contact above the pressing input intensity threshold and a subsequent decrease in the intensity of the contact below the pressing input intensity threshold, wherein each action is an individual below the pressing input intensity threshold. Is performed in response to detecting a subsequent decrease in the intensity of the contact (eg, the “up stroke” of the individual pressing input).

Figures 5E-5H illustrate the contact 562 from an intensity below the light tap intensity threshold (e.g., "IT _L ") of Figure 5E to an intensity above the deep tap intensity threshold (eg "IT _D ") of Figure 5H. It shows the detection of a gesture including a pressing input corresponding to an increase in intensity. On the displayed user interface 570 including the application icons 572A to 572D displayed in the predefined area 574, while the cursor 576 is displayed over the application icon 572B corresponding to App 2, A gesture performed using contact 562 is detected on touch-sensitive surface 560. In some embodiments, the gesture is detected on the touch-sensitive display 504. Intensity sensors detect the intensity of the contacts on the touch-sensitive surface 560. The device determines that the intensity of the contact 562 has reached its apex beyond the deep pressing intensity threshold (eg, "IT _D "). Contact 562 is maintained on touch-sensitive surface 560. Responsive to detection of the gesture, and according to a contact 562 having an intensity that exceeds a deep press intensity threshold (e.g., "IT _D ") during the gesture, reduced scale representations of recently opened documents for App 2 ( 578A-578C) (e.g., thumbnails) are displayed, as shown in FIGS. 5F-5H. In some embodiments, the intensity compared to one or more intensity thresholds is a characteristic intensity of the contact. It should be noted that the intensity diagram for contact 562 is not part of the displayed user interface and is included in FIGS. 5E-5H to aid the reader.

In some embodiments, the display of representations 578A-578C includes animation. For example, as shown in Fig. 5F, the representation 578A is initially displayed in proximity to the application icon 572B. As the animation progresses, as shown in Fig. 5G, the representation 578A moves up and the representation 578B is displayed close to the application icon 572B. Subsequently, as shown in Fig. 5H, the expression 578A moves upward, the expression 578B moves upward toward the expression 578A, and the expression 578C is displayed close to the application icon 572B. Representations 578A-578C form an array over icon 572B. In some embodiments, as shown in FIGS. 5F and 5G, the animation proceeds according to the strength of the contact 562, where the strength of the contact 562 sets a deep pressing strength threshold (eg, “IT _D ”). Representations 578A-578C appear and move upward as they increase toward. In some embodiments, the intensity on which the progress of the animation is based is the characteristic intensity of the contact. The operations described with reference to FIGS. 5E through 5H may be performed using an electronic device similar or identical to the device 100, 300, or 500.

In some embodiments, the device employs intensity hysteresis to avoid inadvertent inputs, sometimes referred to as “jitter,” where the device has a hysteresis intensity threshold having a predefined relationship to the tap input intensity threshold. For example, the hysteresis intensity threshold is an X intensity unit that is lower than the pressing input intensity threshold, or the hysteresis intensity threshold is 75%, 90% or any suitable ratio of the pressing input intensity threshold). As such, in some embodiments, the pressing input comprises an increase in the intensity of the individual contact above the pressing input intensity threshold and a subsequent decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the pressing input intensity threshold, the individual Is performed in response to detecting a subsequent decrease in the intensity of the individual contact below the hysteresis intensity threshold (eg, the “up stroke” of the individual pressing input). Similarly, in some embodiments, the pressing input is an increase in the intensity of the contact from an intensity below the hysteresis intensity threshold to an intensity above the pressing input intensity threshold, and optionally, to an intensity below the hysteresis intensity. It is detected only when detecting a subsequent decrease in the intensity of the contact, and the individual operation is performed in response to detecting a pressing input (eg, an increase in the intensity of the contact or a decrease in the intensity of the contact according to the surrounding environment).

For convenience of explanation, the description of operations performed in response to a pressing input associated with a pressing input intensity threshold or in response to a gesture including a pressing input may optionally include an increase in the intensity of the contact exceeding the pressing input intensity threshold, and a hysteresis intensity threshold. An increase in the intensity of the contact from an intensity less than to an intensity above the pressing input intensity threshold, a decrease in the intensity of the contact below the pressing input intensity threshold, and/or of the intensity of the contact below the hysteresis intensity threshold corresponding to the pressing input intensity threshold. Triggered in response to detecting either of the decreases. Further, in examples in which the operation is described as being performed in response to detecting a decrease in the intensity of the contact below the pressing input intensity threshold, the action is, optionally, less than a hysteresis intensity threshold corresponding to and lower than the pressing input intensity threshold. Is performed in response to detecting a decrease in the intensity of the contact.

As used herein, "installed application" refers to a software application downloaded on an electronic device (e.g., devices 100, 300, and/or 500), and to be launched (e.g., to be opened) on the device. ) Get ready. In some embodiments, the downloaded application becomes an application installed through an installation program that extracts program parts from the downloaded package and integrates the extracted parts with the operating system of the computer system.

As used herein, the terms “open application” or “running application” refer to the state held (eg, as part of the device/global internal state 157 and/or the application internal state 192). Refers to a software application with information. The open or running application is, optionally, any of the following application types:

An active application currently displayed on the display screen of the device in which the application is being used;

A background application (or background process) that is not currently displayed, but one or more processes for the application are being processed by one or more processors; And

A suspended or hibernated application that is not running but has state information that is stored in memory (volatile and nonvolatile, respectively) and can be used to resume execution of the application.

As used herein, the term “closed application” refers to software applications that do not have state information retained (eg, state information for closed applications is not stored in the device's memory). Thus, closing the application includes stopping and/or removing application processes for the application and removing state information for the application from the device's memory. In general, opening the second application while in the first application does not close the first application. When the second application is displayed and the first application stops being displayed, the first application becomes a background application.

Attention is now directed to embodiments of user interfaces (“UIs”) and associated processes implemented on an electronic device such as portable multifunction device 100, device 300, or device 500.

6 illustrates example devices connected through one or more communication channels to participate in a transaction, in accordance with some embodiments. One or more exemplary electronic devices (e.g., devices 100, 300, 500) selectively detect input (e.g., specific user input, NFC field) and selectively (e.g., NFC) Is configured to transmit payment information. The one or more electronic devices optionally include NFC hardware and are configured to be NFC-enabled.

Electronic devices (eg, devices 100, 300, 500) are optionally configured to store payment account information associated with each of the one or more payment accounts. Payment account information may include, for example, the name of the person or company, billing address, login, password, account number, expiration date, security code, phone number, bank associated with the payment account (e.g., issuing bank), and card network. Contains one or more of the identifiers. In some examples, the payment account information includes an image, such as a photo of a payment card (eg, taken by the device and/or received at the device). In some examples, electronic devices receive user input including at least some payment account information (eg, receiving a user-entered credit, debit, account, or gift card number and expiration date). In some examples, electronic devices detect at least some payment account information from an image (eg, of a payment card captured by the device's camera sensor). In some examples, electronic devices receive at least some payment account information from another device (eg, another user device or server). In some examples, the electronic device is from a server associated with the user or other service (e.g., an app that rents or sells audio and/or video files) that the account for the user device has previously purchased or has identified payment account data. Receive payment account information.

In some embodiments, a payment account is added to an electronic device (eg, devices 100, 300, 500) such that payment account information is securely stored on the electronic device. In some examples, after the user initiates such a process, the electronic device sends information about the payment account to the transaction-reconciliation server, which is then sent by the payment network for the account to ensure the validity of the information It communicates with an operating server (for example, a payment server). The electronic device is optionally configured to receive a script from the server that allows the electronic device to program payment information for the account onto the secure element.

In some embodiments, communication between electronic devices 100, 300, 500 facilitates transactions (eg, general or specific transactions). For example, the first electronic device (e.g., 100) may serve as a provisioning or management device, and notifications of new or updated payment account data (e.g., information on a new account, existing The updated information about the account, and/or an alert related to the existing account) may be transmitted to the second electronic device (eg, 500). In another example, a first electronic device (eg, 100) may transmit data to a second electronic device, where the data reflects information about payment transactions facilitated at the first electronic device. The information optionally includes one or more of a payment amount, an account used, a time of purchase, and whether the default account has changed. The second device (eg, 500) optionally uses such information to update the default payment account (eg, based on a learning algorithm or explicit user input).

Electronic devices (eg, 100, 300, 500) are configured to communicate with each other through any of a variety of networks. For example, devices communicate using a Bluetooth connection 608 (including, for example, a traditional Bluetooth connection or a Bluetooth Low Energy connection) or using a WiFi network 606. Communication between user devices is, optionally, coordinated to reduce the likelihood of improperly sharing information across devices. For example, communication related to payment information requires that the communicating devices be paired (eg, associated with each other through explicit user interaction) or associated with the same user account.

In some embodiments, an electronic device (e.g., 100, 300, 500) is used to communicate with a point-of-sale (POS) payment terminal 600, optionally NFC-enabled. . Communication optionally takes place using various communication channels and/or technologies. In some examples, an electronic device (eg, 100, 300, 500) communicates with payment terminal 600 using NFC channel 610. In some examples, payment terminal 600 communicates with an electronic device (eg, 100, 300, 500) using a peer-to-peer NFC mode. The electronic device (e.g., 100, 300, 500) optionally transmits a signal containing payment information for a payment account (e.g., a default account, or an account selected for a specific transaction) to the payment terminal 600 Is configured to send to.

In some embodiments, conducting the transaction includes transmitting a signal containing payment information for an account, such as a payment account. In some embodiments, proceeding the transaction reconfigures the electronic device (e.g., 100, 300, 500) to respond as a contactless payment card, such as an NFC-enabled contactless payment card, followed by payment via NFC, e.g. And transmitting the account's credentials to the terminal 600. In some embodiments, following sending the account's credentials via NFC, the electronic device reconfigures to not respond as a contactless payment card (e.g., prior to being reconfigured to respond as a contactless payment card via NFC). Required).

In some embodiments, the generation and/or transmission of a signal is controlled by a secure element within an electronic device (eg, 100, 300, 500). The secure element, optionally, requires specific user input prior to emitting payment information. For example, the secure element may optionally detect that the electronic device is worn, a button press, a passcode input, a touch detection, (e.g., received while interacting with an application). It requires detection of one or more option selections, detection of a fingerprint signature, detection of a voice or voice command, and/or detection of a gesture or movement (eg, rotation or acceleration). In some examples, if a communication channel (e.g., NFC communication channel) with another device (e.g., payment terminal 600) is established within a defined period from detection of the input, the secure element is the other device (e.g. For example, payment information to be transmitted to the payment terminal 600 is emitted. In some examples, the secure element is a hardware component that controls the release of secure information. In some examples, the secure element is a software component that controls the release of secure information.

In some embodiments, protocols related to transaction participation depend on device types, for example. For example, conditions for generating and/or transmitting payment information may be different for a wearable device (eg, device 500) and a phone (eg, device 100). For example, the creation and/or transmission condition for the wearable device includes detecting that the button has been pressed (e.g., after security verification), while the corresponding condition for the phone does not require a button press and is Instead, it requires the detection of specific interactions with the application. In some examples, the condition for sending and/or emitting payment information includes receiving a specific input on each of the plurality of devices. For example, the release of payment information may optionally include detection of a fingerprint and/or passcode in a device (e.g., device 100) and mechanical input on another device (e.g., device 500). Request detection of (eg, button press).

The payment terminal 600, optionally, uses the payment information to generate a signal to be transmitted to the payment server 604 to determine whether payment is authorized. Payment server 604 optionally includes any device or system configured to receive payment information associated with a payment account and determine whether a proposed purchase is authorized. In some examples, payment server 604 includes the issuing bank's server. The payment terminal 600 communicates directly with the payment server 604 or indirectly through one or more other devices or systems (eg, a server of an acquiring bank and/or a server of a card network).

Payment server 604 optionally uses at least a portion of the payment information to identify the user account in a database of user accounts (eg, 602). For example, each user account contains payment information. The account is, optionally, located by locating an account with specific payment information that matches that from the POS communication. In some examples, if the payment information provided does not match (e.g., the expiration date does not correspond to a credit, debit or gift card number) or if no account contains payment information that matches that from the POS communication. , Payment is rejected.

In some embodiments, the data for a user account may include one or more limits (eg, credit limits); Current or previous balance; The date, location and/or amount of the previous transaction; Further identifying account status (eg, active or frozen), and/or authorization instructions. In some examples, the payment server (eg, 604) uses such data to determine whether to authorize payment. For example, the payment server may exceed the account limit due to purchases added to the current balance, the account is frozen, the amount of previous transactions exceeds the threshold, or the number or frequency of previous transactions is If it exceeds, the payment is rejected.

In some embodiments, payment server 604 responds to POS payment terminal 600 with an indication as to whether the proposed purchase is authorized or rejected. In some examples, POS payment terminal 600 transmits a signal to an electronic device (eg, 100, 300, 500) to identify the result. For example, the POS payment terminal 600 is an electronic device (eg, 100, 300, 500) when a purchase is authorized (eg, through a transaction-adjustment server that manages a transaction app on a user device) Send the receipt to In some cases, the POS payment terminal 600 presents an output (eg, visual or audio output) indicating the results. The payment may be sent to the merchant as part of the authorization process, or may be sent later.

In some embodiments, an electronic device (eg, 100, 300, 500) participates in a transaction that is completed without involvement of the POS payment terminal 600. For example, upon detecting that a mechanical input has been received, a secure element in an electronic device (e.g., 100, 300, 500) emits payment information so that an application on the electronic device can access that information (e.g. And to send information to the server associated with the application).

In some embodiments, the electronic device (eg, 100, 300, 500) is in a locked or unlocked state. In the locked state, the electronic device is powered and operating, but is prevented from performing a predefined set of operations in response to user input. The predefined set of actions includes, optionally, navigation between user interfaces, activation or deactivation of the predefined set of functions, and activation or deactivation of specific applications. The locked state can be used to prevent unintended or unauthorized use of some functions of the electronic device or activation or deactivation of some functions on the electronic device. In the unlocked state, the electronic device 100 is powered and operating, and is not prevented from performing at least some of the predefined set of operations that cannot be performed while in the locked state.

When the device is in the locked state, the device is said to be locked. In some embodiments, the device in the locked state optionally responds to a limited set of user inputs, including an input corresponding to an attempt to transition the device to an unlocked state or an input corresponding to powering off the device. Answer.

In some examples, the secure element (e.g., 115) is a hardware component (e.g., a secure microcontroller chip) configured to securely store data or algorithms, such that securely stored data is accessible by the device without proper authentication information from the user of the device. Do not. Keeping data stored securely in a secure element separate from other storage on the device means that data stored securely even if other storage locations on the device are compromised (e.g., by malicious code or other attempts to corrupt information stored on the device). To prevent access. In some examples, the secure element provides (or emits) payment information (eg, account number and/or transaction-specific dynamic security code). In some examples, the secure element is, when the device is in a user authentication (e.g., fingerprint authentication; passcode authentication; the device is in an unlocked state, and optionally, after the device is unlocked by providing authentication credentials to the device). While the device is still on the user's wrist, detecting a double-press of a hardware button, where the continued presence of the device on the user's wrist indicates that the device is in contact with the user's skin. Provides (or emits) payment information in response to receiving authorization, such as (determined by periodically checking if there is). For example, the device detects a fingerprint at the device's fingerprint sensor (eg, a fingerprint sensor integrated into a button). The device determines whether the fingerprint matches the registered fingerprint. Upon determining that the fingerprint matches the registered fingerprint, the secure element provides (or emits) payment information. Upon determining that the fingerprint does not match the registered fingerprint, the secure element withholds providing (or emitting) payment information.

Attention is now directed to embodiments of user interfaces (“UIs”) and associated processes implemented on an electronic device such as portable multifunction device 100, device 300, or device 500.

7A-7S illustrate an exemplary user for providing training instructions for registering biometric features on an electronic device (e.g., device 100, device 300, or device 500), according to some examples. Interfaces are shown. The user interfaces in these figures are used to illustrate the processes described below, including those in FIG. 8.

7A illustrates an electronic device 700 (eg, portable multifunction device 100, device 300, or device 500). In the illustrative example illustrated in FIGS. 7A-7S, the electronic device 700 is a smartphone. In other examples, electronic device 1500 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 700 has a display 702, one or more input devices (eg, a touchscreen, a button, a microphone of the display 1502), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 703) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more of the biometric sensors may be used in U.S. Application No. 14/341,860, "Overlapping Pattern Projector", filed July 14, 2014, which is incorporated herein by reference in its entirety for any purpose. Biometric sensors (e.g., facial recognition sensors), such as those described in Publication No. 2016/0025993, and US Application No. 13/810,451, "Scanning Projects and Image Capture Modules For 3D Mapping", U.S. Patent No. 9,098,931 to be. In some examples, the electronic device includes a depth camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR flood light, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the object during capture of the image by a visible light camera and a depth camera (e.g., an IR camera), and information from the visible light camera and the depth camera is Used to determine the depth map. In some examples, the lighting effects described herein use parallax information from two cameras (e.g., two visible light cameras) for back face images and front face images (e.g., selfie images). ) Is displayed using depth information from the depth camera that is combined with the image data from the visible light camera. In some examples, when two visible light cameras are used to determine depth information and when the depth camera is used to determine depth information, the same user interface is used to determine the information used when creating lighting effects. Even when using different technologies, it provides users with a consistent experience. In some examples, while displaying the camera user interface with one of the applied lighting effects, the device detects the selection of the camera switching affordance, maintains a display of the user interface controls for applying the lighting effect, and a front-facing camera. Two visible light cameras spaced apart from each other from front facing cameras (e.g., depth camera and visible light camera), replacing the display of their field of view with the field of view of rear facing cameras (or vice versa) ) To (or vice versa).

As shown in FIG. 7A, device 700 displays a device setup user interface 702 on a display 701. In some examples, device setup user interface 702 is displayed when device 700 is first powered by a user (e.g., when a factory-sealed device is powered on for the first time). . In some examples, the device setup user interface 702 is displayed upon resetting the device 700 to factory settings. The phone setup user interface 702 includes one or more prompts 704. In the example of FIG. 7A, prompt 704 is plain text that prompts the user to proceed with initial device setup (eg, language selection, authentication actions, etc.). The device setup interface 702 includes one or more affordances, such as a continue affordance 706 and a skip affordance 708. In some examples, in response to detecting a user input corresponding to activation of the skip affordance 708, the device 700 may optionally, without setting up one or more features, a primary user interface, such as the user interface of FIG. 4A. Displays.

As illustrated in FIG. 7B, while displaying setup interface 702, electronic device 700 detects activation (eg, selection) of affordance 706 to continue. In some examples, the activation is a tap gesture 710 on the contact area 710 at the continue affordance 706. In some examples where the display 700 is a touch-sensitive display, the activation of the continuation affordance is a touch, swipe, or other gesture on the display surface in the contact area 710. In some examples where display 700 is not touch sensitive, the user input is keyboard input or activation of continue affordance 706 by a focus selector (eg, a mouse cursor).

In response to detecting the activation of continue affordance 706, the device displays a facial authentication guideline interface 712 as shown in FIG. 7C. In some examples, the facial authentication setup interface 712 is displayed in response to ending a previous stage of the device setup user interface process, or in response to selecting a facial authentication registration option in the setup user interface. The facial authentication setup interface 712 includes one or more prompts 714, a continue affordance 716 and a later affordance 718. In the example of FIG. 7C, prompt 714 is plain text indicating that the user has the option to set up facial authentication instead of a numeric passcode. The facial authentication setup interface 712 also includes a graphical representation of the face (eg, biometric authentication glyph 720) displayed within the framing element 722. In the example of FIG. 7C, the framing element 722 is of a rectangular shape surrounding the biometric authentication glyph 720 such that only rectangular corners are displayed. In some examples, the framing element is optionally a solid rectangle or any other shape (eg, circle or ellipse) surrounding glyph 720. In some examples, framing element 722 helps to indicate to the user how to properly position their faces relative to biometric sensor 703 in combination with additional features described below.

Referring to FIG. 7D, device 700 detects activation (eg, selection) of continue affordance 716. In some examples, the activation is a tap gesture 724 in affordance 716 to continue. In some examples where the display 701 is a touch-sensitive display, the activation of the continue affordance is a touch, swipe, or other gesture on the display surface in the contact area 724. In some examples where display 701 is not touch sensitive, the user input is keyboard input or activation of continue affordance 716 by a focus selector (eg, a mouse cursor).

In response to detecting the selection of affordance 716 to continue, device 700 displays prompt 726 (e.g., prompt 726 to display of prompt 714), as illustrated in FIG. 7E. Replaced with). Additionally, the device replaces the display of continuing affordance 716 with a starting affordance 728. Upon selection of continue affordance 716, device 700 maintains (eg, continues to display) glyph 720 and framing element 722.

Referring to FIG. 7F, the device 700 detects activation (eg, selection) of the start affordance 728. In some examples, the activation is a tap gesture 730 at start affordance 7728. Activation of initiation affordance 728 optionally represents a user request to initiate a facial authentication registration (eg, setup) process.

7H-7Q, device 700 displays a face authentication guideline interface 732 in response to detecting a selection of a starting affordance 728. At the same time, the device displays an educational animation (e.g., an instruction sheet), which indicates to the user how to properly position and move his or her face relative to the biometric sensor 703 so that the device 700 Will be able to collect sufficient biometric (eg, face imaging) data required for secure (eg, biometric) authentication. Details of the tutorial interface and educational animation are described below.

As illustrated in FIGS. 7G and 7H, device 700 changes the display of framing element 722 to be a single continuous framing element 723 surrounding glyph 720. As shown in FIG. 7G, device 700 optionally rounds each corner of framing element 722 into a portion of a circle, and merges and/or contracts the portions to surround the glyph 720. Form a circle (eg, framing element 723 as shown in FIG. 7H).

As shown in FIG. 7H, device 700 simultaneously displays an education progress meter 734 proximate and/or surrounding glyph 720. In the example of FIG. 7H, the education progress meter 734 is configured with a set of progression elements (eg, progression scales 734a, 734b, 734c) evenly distributed around the glyph 720. In the example of FIG. 7H, the progression scales 734a, 734b, 734c are equidistant from and extend radially outward from glyph 720, forming a circle around it, for example. In some examples, these proceeding elements are, optionally, dots, circles, line segments, or any other suitable discrete elements. In some examples, these progress elements are optionally arranged around glyph 720 in a square, rectangular, oval, or any other suitable pattern.

While displaying the facial authentication guideline interface 732 (e.g., the glyph surrounded by the framing element 723 and the training progress meter 734), the device 700 displays the user's facial data, as shown in FIG. It begins to display an educational animation that illustrates the registration process. As described in more detail below with reference to FIGS. 7I-7P, the device 700 displays a glyph 720 in a corresponding forward and circular motion of the training progress meter 734 to emulate a successful facial authentication. ) To display the movement.

At the beginning of the educational animation, device 700 overlays an orientation guide 736 on top of the display of glyph 720. In the example of FIG. 7I, orientation guide 736 is a pair of intersecting curves (e.g., crosshairs), which intersecting curves extend from framing element 723 and glyph 720 so that they are from the plane of the display. Make it look bulging outward (eg, in the simulated z-direction). In some examples, in combination with the circular framing element 723, the arcs of the orientation guide 736 are otherwise in a two-dimensional glyph 720, as if it were located on the surface of a sphere, the three-dimensional appearance. Is given. In general, the educational animation maintains the orientation guide 736 in a fixed position with respect to the center of the glyph 720 so that the orientation guide appears to be rotated or tilted with the facial expression (e.g., in the same direction). . In some examples, glyph 720 itself is a three-dimensional representation of a face, such as a three-dimensional line drawing with lines at a simulated z-height. In such examples, the orientation guide 736 is optionally omitted. In this case, when the facial expression is tilted in different directions, the lines at different z-heights appear to move relative to each other based on the simulated parallax effect, giving the appearance of a three-dimensional movement.

The device 700 displays the movement (e.g., rotation and/or tilt) of the glyph 720 and orientation guide 736 in a first direction (e.g., up, down, left, or right). Start educational animation on interface 732. In the example of FIG. 7I, glyph 720 and overlaid orientation guide 736 are inclined to the right with respect to a vertical axis extending from the plane of display 700. Tilting the glyph 720 in this way optionally reveals a portion of the simulated face (e.g., the left side of the face) and hides another portion of the simulated face (e.g., the right side of the face), tilting or rotating in a specific direction It gives an additional appearance of a three-dimensional head.

As illustrated in FIG. 7I, the device 700 changes their appearance as the glyph 720 (and/or orientation guide 736) is tilted towards a subset of the traveling elements. In particular, the progression elements within the meter portion 738 optionally stretch and/or change color from their initial state when the facial graphic is tilted towards them. These elongation and/or color changes are optionally more pronounced as the glyphs 720 are further tilted in their direction. In some examples, the progressing elements within meter portion 738 are optionally and otherwise changed in appearance. For example, additionally and/or alternatively, the line thickness, number, or pattern of the running elements is optionally varied. Changing the appearance of the progress elements in this manner indicates to the user that the biometric sensor 703 is configured to capture image data of a corresponding portion of the face when oriented in that direction. While displaying the educational animation, the device 700 maintains the display progress elements (eg, elements of the meter portion 740) in an initial state for which the facial graphic has not yet been tilted. In the example of FIG. 7I, the device 700 displays progress elements in an initial state as unfilled outlines.

In some examples, the device 700 then rotates the glyph 720 about a second axis parallel to the plane of the display, causing the simulated face to appear tilted upwards or downwards. In the example of Fig. 7J, the glyph 720 is tilted upward from its position in Fig. 7I, so that the simulated face appears to be pointing upward and to the right. While rotating the glyph 720 in this manner, the device 700 changes the appearance of the corresponding meter portion 740, which was previously in its initial state, as shown in FIG. 7I. The device changes the appearance of the meter portion 740 (eg, by stretching the progress elements within this portion of the training progress meter and/or changing its color) in the same manner as described above with respect to FIG. 7I. At the same time, the device 700 transitions the progressing elements in the meter portion 738, corresponding to the portion of the facial expression that was registered in FIG. 7I, to the second state. Progress elements in the success state (eg, progress elements in the meter portion 738) are different in shape, color, line width, and the like from the progress elements in the initial state. In the example of Figure 7i, the progress elements in the success state are displayed with the same size and width as the progress elements in the initial state (e.g., progress elements in the meter portion 742), but the facial expression is already oriented in that direction. It is darkened and/or filled to indicate that it is.

7K illustrates further tilting and/or rotation of glyph 720 and orientation guide 736 until the simulated face appears to be looking upward. As described above, device 700 changes their appearance (eg, stretches and/or changes color) as glyphs 720 are oriented in the direction of the progressing elements within meter portion 742. At the same time, device 700 transitions the progressing elements in meter portion 740 to a successful state since the simulated face had previously been, but is no longer oriented in their direction. Progress elements in meter portion 738 remain in a successful state. In general, the appearance of progress elements that have transitioned to the success state is not modified afterwards. In this manner, device 700 changes the appearance of elements within education progress meter 734 in response to displaying movement of glyph 720.

In some examples, during an educational animation, device 700 optionally displays a full circular (e.g., clockwise, counterclockwise) motion of the simulated face (e.g., glyph 720 is shown in FIG. 7I). Continue to display rotation and/or tilt of the glyph 720 until it returns to the illustrated right tilted orientation. Likewise, device 700 progressively transitions them to a success state as glyphs 720 rotate past elements of education progress meter 734, as described above. After displaying the full rotation of the simulated face, the device displays all progress elements of the education progress meter 734 in a successful state, as shown in FIG. 7L. In some examples, device 700 stops displaying orientation guide 736 after the full rotation has been displayed, and returns glyph 720 to its initial position.

After all the progress elements of the training progress meter 724 have transitioned to the success state, the device 700 places the progress meter 734 (e.g., the progress meter itself) into an authentication success state, such as a solid circle surrounding the glyph 720. Transfer to Displaying the progress meter 724 with an authentication successful status optionally indicates a successful facial authentication setup. 7L-7O, the device 700 shortens each progression scale and merges them together into a continuous solid circle surrounding the glyph 720 (e.g., success status meter 744) to measure the progress of education. Transition the display of the individual progress scales of 734 to the authentication success state. In the example of FIGS. 7O and 7P, the circle is the glyph 720 until the radius of the success state meter 744 is substantially equal to the radius of the framing element 723 (eg, as shown in FIG. 7P ). Contracts around the perimeter

As shown in FIGS. 7I-7Q, the face authentication guideline interface 732 also includes a starting affordance 746 that is selectively displayed throughout the face recognition guideline. In some examples, the start affordance 746 is enabled for activation after the training animation is complete (eg, after the device 700 displays the training progress meter 734 with the authentication success status of FIG. 7Q ). In other examples, the starting affordance 746 is enabled for activation at any time during the display of the facial authentication tutorial animation prior to completion of the training animation.

Referring now to FIG. 7Q, device 700 detects activation (eg, selection) of starting affordance 746. In some examples, activation is a user input corresponding to a request to initiate facial authentication setup. In response to detecting the activation of the starting affordance 746, the device 700 displays the display of the glyph 720, an image of the user's face captured by the biometric sensor 703 as shown in FIG. 750). In some examples, image 748 is a live preview of the field of view of biometric sensor 703. In other examples, image 750 is a wire-frame representation of the user's face based on movement of the user's face in the field of view of the optical sensors. Thus, image 750 changes (eg, continuously updated) as the location and orientation of the user's face relative to the biometric sensor changes.

As shown in FIG. 7R, device 700 also displays a positioning element 752 around user image 750. In some examples, positioning element 752 optionally has similar or identical visual characteristics to framing element 722 that was initially positioned surrounding glyph 720 in FIGS. 7C-7F. In some examples, the positioning element is displayed to highlight a predetermined portion of the display of the electronic device, indicating where the user should position his or her face relative to the biometric sensors for subsequent facial authentication setup. . In some examples, the positioning element has a shape (eg, a square) that at least partially partitions a predetermined portion of the display from other portions of the display. The device 700 also prompts 754, i.e., prompting the user to move his/or her face relative to the light sensors so that the user image 750 is visible inside the positioning element 750. Display text.

Referring now to FIG. 7S, in response to detecting that the user image 750 has been properly positioned within the positioning element 750 (e.g., the user's face is properly aligned with the biometric sensor 703), the device 700 displays a face authentication registration interface 756. In the example of FIG. 7S, facial authentication registration interface 756 includes a progress meter 758 and a user image 760. In some examples, registration interface 756 includes an orientation guide 762, that is, a set of curves (eg, crosshairs) that appear to extend out of the plane of the display. Progress meter 758 optionally has some or all of the features of training progress indicator 734 displayed during the facial authentication guide animation. In the example of FIG. 7S, the progress meter 758 also includes a set of progress elements (eg, progress scales 758a, 758b, 758c) distributed around the user 750. An additional description of the alignment of the user's face in relation to the optical sensors may be found below with reference to FIGS. 9A to 9A and 11A to 11O.

8A-8C are flow diagrams illustrating a method for providing training instructions for registering biometric features on an electronic device, in accordance with some examples. The method 800 includes a device having a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 700). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 800 provides an intuitive method for providing training instructions for registering biometric features on an electronic device. This method reduces the user's cognitive burden for registering biometric features on the device, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to register biometric features faster and more efficiently saves power and increases the time between battery charges.

The device displays 802 a first user interface (eg, facial authentication setup interface 712) on the display. While displaying the first user interface, the device detects (806) the occurrence of a condition corresponding to the introduction of a biometric registration process for registering biometric features (eg, face, finger, eye, voice, etc.). In some examples, the occurrence of the condition is an input corresponding to a request to initiate the biometric registration process, such as ending a previous stage of the device setup user interface process or selecting a biometric registration option in the setup user interface. In some examples, the biometric feature is used for authentication at the device.

In response to detecting the occurrence of a condition corresponding to the introduction of the biometric registration process, the device displays 808 a biometric registration introduction interface (eg, face authentication instruction interface 732). Displaying the biometric registration introduction interface includes a representation of the simulation of the biometric features (e.g. 720, video of the biometric features or animation of the biometric features such as animated face/head) and a simulated progress indicator (e. Simultaneously displaying (810) a training progress meter (734), a displayed element indicating progress of the registration. In some examples, the simulated progress indicator is positioned proximate the representation of the simulation of the biometric feature. In some examples, the simulated progress indicator is a plurality of progress elements (e.g., progress elements 734a, 734b, 734c) that are selectively distributed around the simulation of the biometric feature, e.g., outward from the simulation of the biometric feature. And a set of tick marks extending (eg, extending radially) and forming an elliptical shape such as a circle.

In some examples, the representation of the simulation of the biometric feature is a representation (eg, 720) of a simulation of at least a portion of the face (812). In some examples, the representation is a representation of a simulation of a portion of a face. In some examples, the expression is an expression of a simulation of the entire face. In some examples, the simulation of the biometric feature is a representation of a generic face, such as a line drawing including the eyes, nose, and mouth. In some examples, the representation of the simulation of the biometric feature is a three-dimensional representation (814). For example, the representation of a simulation of a biometric feature is a three-dimensional rendered object. Alternatively, the educational animation is optionally, instead, a 2D animation.

In some examples, the representation of the simulation of the biometric feature is a line drawing (eg, a 3D representation of 720) with lines at different simulated z-heights (816). For example, when a line drawing of a face is tilted in different directions, the lines at different simulated z-heights appear to move relative to each other based on the simulated parallax effect. In some examples, the biometric registration introduction interface is overlaid on the representation of the simulated biometric feature (e.g., 720) and tilts in different directions as the representation of the simulated biometric feature is tilted in different directions. An orientation guide (eg, orientation guide 736, a curve that curves backwards in the simulated z direction, as described in more detail below with reference to method 1200) (820).

While displaying the biometric registration introduction interface, the device may move (e.g., tilt and/or rotate) the representation of the simulation of the biometric features and incremental advancement of the progress indicator (e.g., the progress elements of the progress indicator are An educational animation (e.g., advancing and 720 of the educational progress indicator 734 shown in FIGS. 7H-7L) comprising displaying a display of movement of the representation of the negative simulation, changing color and/or shape. (Movement of) is displayed (824). Displaying the educational animation including the movement of the representation of the simulation of the biometric feature and the incremental advancement of the simulated progress indicator is, first, appropriate for the subsequent biometric registration process (e.g., method 1200 and/or 1400). Illustrating user inputs and thus helping the user intuitively recognize how to register their biometric features quickly and appropriately, the device needs to display biometric registration interfaces (e.g., 756) during this process. It reduces the duration of the presence and reduces the number of user inputs performed on those interfaces. Reducing the number and time of inputs required to perform a registration operation makes the device operability (e.g., by helping the user provide appropriate inputs and reducing user mistakes when operating and/or interacting with the device). It improves and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device displays (826) a movement that tilts the simulation of the biometric feature relative to the plane of the device's display. For example, the movement of the representation of the simulation includes rotation of the representation of the simulation along an axis perpendicular to the plane of the device's display. In some examples, the biometric sensor and/or the tilt of the sensor with respect to the field of view defines the plane of the display. In another example, the device rotates the representation of the simulation of the biometric feature about a first axis (e.g., an axis perpendicular to the display 700) and a second axis different from the first axis (e.g., display 700 ), a movement that rotates the representation of the simulation of the biometric feature about an axis in the plane of the (828). In some examples, the first axis is a vertical axis such that the movement of the representation is from left to right and/or from right to left. In some examples, the first axis is perpendicular to the second axis. For example, the second axis is optionally a horizontal axis such that the movement of the representation is made downward and/or upward. In some examples, the first axis is any axis other than an axis perpendicular to the display of the device (eg, the representation rotates in any direction), and the second axis is an axis perpendicular to the display of the device. In this example, the simulated head is optionally moved in a circular pattern around a second axis. Displaying a movement that tilts the simulation of the biometric feature relative to the plane of the display first illustrates the appropriate user inputs required for the subsequent biometric registration process (e.g., method 1200 and/or 1400), whereby the user Helps intuitively recognize how to register their biometric features quickly and appropriately, reducing the duration the device needs to display biometric registration interfaces (e.g., 756) during this process and such interfaces. Reduce the number of user inputs performed in Reducing the number and time of inputs required to perform a registration operation makes the device operability (e.g., by helping the user provide appropriate inputs and reducing user mistakes when operating and/or interacting with the device). It improves and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, when displaying the educational animation, the device optionally exposes a first portion of the representation (e.g., a first side of 720) and does not reveal a second portion of the representation (e.g., a second different side of 720). A simulation representation of the biometric feature is displayed at the first location (830). Subsequently, the device optionally displays a representation of the simulation of the biometric feature at a second location different from the first location so as to reveal a second portion of the representation and not reveal the first portion of the representation. In the example where the biometric feature is a face, the simulated face is optionally tilted in a first direction to reveal a first portion of the simulated face, and then tilted in a second direction to reveal a second portion of the simulated face. Lose. Displaying the simulated biometric features in a first orientation and subsequently displaying the simulated biometric features in a second different orientation is, first, necessary for a subsequent biometric registration process (e.g., method 1200 and/or 1400). Illustrating appropriate user inputs and thus helping the user intuitively recognize how to register their biometric features quickly and appropriately, the device will display biometric registration interfaces (e.g., 756) during this process. It reduces the required duration and reduces the number of user inputs performed on those interfaces. Reducing the number and time of inputs required to perform a registration operation makes the device operability (e.g., by helping the user provide appropriate inputs and reducing user mistakes when operating and/or interacting with the device). It improves and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device displays a simulated progress indicator (eg, 734) surrounding the representation of the simulation of the biometric feature (eg, 720). For example, the simulated progress indicator is displayed such that the simulated progress indicator surrounds (or substantially surrounds) some or all of the representation of the simulation of the biometric feature. In some examples, the simulated progress indicator centers the representation of the user's biometric feature. In some examples, displaying the simulated progress indicator includes a plurality of progress elements (e.g., dots, circles, or line segments, e.g., in proximity to the representation of the simulation of the biometric feature (e.g. (832) displaying progress scales 734a, 734b, 734c. In some examples, the progress elements are equidistant from the presentation and/or extend radially outward from the presentation. In some examples, the progress elements are arranged in a circular, square, rectangular, or elliptical pattern.

In some examples, when displaying the incremental advancement of the simulated progress indicator, the device transitions (834) one or more of the plurality of progressing elements from the first state to a second state different from the first state. For example, in a first state, the progressing elements are optionally of a first color and/or a first length, and in a second state, the progressing elements are optionally, a second color and/or different from the first color. It is of a second length different from the first length. In some examples, the progressing elements are optionally and also altered in appearance in other ways. For example, the progress elements are selectively changed in line thickness, number, and pattern. Changing the display of portions of the simulated progress indicator allows the user to recognize that changes in the orientation of the simulated biometric features illustrated in the educational animation are required to properly register his/or her biometric features. Let's do it. This, first, helps to illustrate the appropriate user inputs required for a subsequent biometric registration process (e.g., method 1200 and/or 1400), so that the device will display biometric registration interfaces (e.g., 756) during this process. It reduces the required duration and reduces the number of user inputs performed on those interfaces. Reducing the number and time of inputs required to perform a registration operation makes the device operability (e.g., by helping the user provide appropriate inputs and reducing user mistakes when operating and/or interacting with the device). It improves and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the representation of a simulation of a biometric feature is a line drawing that includes at least a portion (e.g., some or all) of a glyph (e.g., success status progress meter 744) used to indicate a successful biometric registration. It is (836). In some examples, one or more progress elements of the simulated progress indicator are all updated to a second state (eg, green and elongated, or the state of the meter portion 738 in FIG. 7J) and are not subsequently modified. In some examples, when each of the progress elements has been updated to the second state, the simulated progress indicator transitions to a success state (eg, success state progress meter 744). In some examples, transitioning the simulated progress indicator to a success state includes transitioning the simulated progress indicator to a solid circle surrounding the representation of the simulation of the biometric feature.

After displaying at least a portion of the educational animation, the device detects (838) the occurrence of a condition corresponding to the initiation of the biometric registration process. In some examples, the condition corresponding to initiation of the biometric registration process includes (840) selection of an affordance to initiate the biometric registration process. For example, the condition may be an input corresponding to a request to "start registration", such as a tap on a "start registration" or "next" affordance (eg, start affordance 746) (eg, in contact area 748). User input) and, optionally, a subsequent user's biometric feature with one or more biometric sensors. A more detailed description of the biometric registration process is described in more detail herein with reference to method 900. In some examples, the electronic device provides a tactile output and/or an audible output in response to the selection of affordance.

In response to detecting the occurrence of a condition corresponding to the initiation of the biometric registration process (842), the device responds to the representation of the simulation of the biometric features in the biometric registration introduction interface (e.g., face authentication instruction interface 732). At a location previously occupied by the user's biometric feature as determined by one or more biometric sensors of the device (e.g., user image 750, user's face, user's finger, user's eye, The user's hand) is displayed (844). In some examples, the device optionally displays a registration progress user interface (e.g., 756) after a representation of the user's biometric feature (e.g., 750, 760) is aligned with one or more biometric sensors (e.g., 703). do.

In some examples, the representation is a representation of a portion of the user's face (eg, portion of the user image 750) (846). In some examples, the expression is an expression of the entire user's face. In some examples, the representation of the user's biometric feature is the user's representation specific to the user. For example, the user's expression is a wire frame or images of the user's face matching the contours of the user's face.

In some examples, the biometric registration user interface includes 848 an orientation guide (e.g., orientation guide 736, orientation guide 762) overlaid on a representation of the biometric feature (e.g., user image 750). ). The orientation guide is optionally tilted as the biometric features are tilted in different directions. Displaying an orientation guide that moves with the user's biometric features provides feedback to the user about the orientation of his or her biometric features relative to the device's biometric sensors in a three-dimensional space, It allows a user to more quickly place his or her biometric features in appropriate orientations during a subsequent registration process (eg, method 1200 and/or method 1400). Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, a representation of the user's biometric feature (eg, 750) is based on image data captured by one or more cameras (eg, 703) of the electronic device (850). For example, the representation of the user's biometric features may optionally be based on successive images of the user captured by one or more cameras (e.g., 703), or movement of the user's features in the field of view of one or more cameras. It is a wire frame. In some examples, the representation of the biometric feature changes (852) as the orientation of the biometric feature with respect to one or more biometric sensors changes. Updating the orientation of the displayed representation of the biometric feature provides feedback to the user regarding the orientation of his or her biometric features relative to the device's biometric sensors, allowing the user to follow the registration process (e.g., method During 1200 and/or method 1400, it is possible to more quickly place his or her biometric features in appropriate orientations. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In response to detecting the occurrence of a condition corresponding to the initiation of the biometric enrollment process, the device may also be configured with a simulated progress indicator (e.g., a plurality of progress elements distributed around the representation of the user's biometric feature Display 854 a progress indicator (eg, 756) corresponding to a progress indicator having some or all of the features of the progress indicator displayed surrounding the simulation of the feature. In some examples, displaying the progress indicator includes maintaining a display of the simulated progress indicator (856). For example, the simulated progress indicator returns to its initial state (e.g., the state of the progress elements 734a, 734b, 734c in FIG. 7H) and is used to indicate incremental registration progress of the simulated biometric feature. It is used to indicate the user's incremental enrollment progress in the same or similar manner as the one that has been done. Displaying a registration progress indicator corresponding to (e.g., similar) the simulated progress indicator allows the user to change the orientation of the simulated biometric feature and the corresponding advance of the simulated progress indicator illustrated during the educational animation. Quickly associate with appropriate inputs required during a subsequent registration process (eg, method 1200 and/or 1400). This in turn allows the user to complete the registration process more quickly, reducing the duration the device needs to display biometric registration interfaces (e.g., 756) during this process and user input performed on those interfaces. Reduce the number of people. Reducing the number and time of inputs required to perform a registration operation makes the device operability (e.g., by helping the user provide appropriate inputs and reducing user mistakes when operating and/or interacting with the device). It improves and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device displays 858 a progress indicator (eg, 758) surrounding a representation (eg, 760) of the user's biometric feature. For example, the progress indicator optionally has some or all of the features of the progress indicator that are displayed surrounding the simulation of the biometric features. These features optionally include a plurality of progression elements (eg, 758a, 758b, 758c) distributed around the representation of the user's biometric feature. For example, the progress indicator is displayed such that the progress indicator surrounds (or substantially surrounds) some or all of the representation of the user's biometric features. In some examples, the progress indicator centers the representation of the user's biometric feature.

In some examples, in response to detecting the occurrence of a condition corresponding to the initiation of the biometric registration process, the device displays 860 a positioning element (e.g., positioning element 752) on the display of the electronic device. . In some examples, the positioning element is displayed to highlight a predetermined portion (eg, 756, 758) of the display of the electronic device. In some examples, the positioning element indicates where the user should position a representation of the user's biometric feature (eg, 750) for subsequent biometric feature registration. In some examples, the positioning element is an object that visually at least partially partitions the first and second portions of the display (eg, display portion 756 and display portion 758 ). The positioning element, in some examples, is shaped like a square and is optionally segmented. Displaying a positioning element framing a particular portion of the digital viewfinder allows the user to determine the position and/or orientation of his or her biometric features within the field of view of the biometric sensor followed by a biometric registration process (e. (1200 and/or 1400)) to quickly recognize whether it is optimal, allowing the user to more quickly place his or her biometric features in the proper orientation. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

It is noted that the details of the processes described above with respect to method 800 (eg, FIGS. 8A-8C) are also applicable in a similar manner to the methods described below. For example, method 800 optionally includes one or more of the features of various methods described below with reference to methods 1000, 1200, 1400, 1600, 1800, 2000, 2200, 2500, 2700. do. For another example, the orientation guide described in method 1200 may be applied in connection with an educational animation displayed on a face authentication guide interface (eg, 732). For another example, one or more aspects of biometric registration described in method 1200 may be applied in connection with a registration interface (eg, 756). For another example, one or more aspects of the hints described in method 1400 may be applied to the display of a facial authentication guide interface (eg, 732).

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 8A-8C are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, display operation 802, detection operation 806, display operation 810, display operation 824, detection operation 838, display operation 844, and display operation 854, optionally , Event classifier 170, event recognizer 180, and event handler 190. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

9A-9AE illustrate an educational guide for registering biometric features on an electronic device (e.g., device 100, device 300, device 500, or device 700), according to some examples. Illustrates exemplary user interfaces. The user interfaces in these figures are used to illustrate the processes described below, including those in FIG. 10.

9A illustrates an electronic device 900 (eg, portable multifunction device 100, device 300, device 500, or device 700). In the illustrative example illustrated in FIGS. 9A-9A, the electronic device 900 is a smartphone. In other examples, electronic device 900 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 900 has a display 901, one or more input devices (eg, a touchscreen, a button, a microphone of the display 901), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 903) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more biometric sensors 903 are one or more biometric sensors 703. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

As illustrated in FIG. 9A, the device 900 displays a face authentication introduction interface 905. In some examples, facial authentication introduction interface 905 is similar to facial authentication guidelines interface 732 described above with respect to FIG. 7S. By way of example, facial authentication introduction interface 905 includes facial graphics 902, which, optionally, is the same as or similar to glyph 720 described above with respect to facial authentication guideline interface 732. Additionally or alternatively, the device 900 also optionally displays a success status training progress meter 907, which optionally is the same as or similar to the success status training progress meter 744 in FIGS. 7P and 7Q. Do. Facial authentication introduction interface 905 also includes a start button 904 (eg, start affordance). 9A, device 900 detects activation (eg, selection) of starting affordance 904. For example, activation is optionally user input in contact area 906 on starting affordance 904. This user input will, in some situations, correspond to a request to initiate facial authentication setup (eg, initiate facial registration).

In some examples, in response to detecting a user selection of the start button 904, the device 900 displays a face alignment interface 908 as shown in FIG. 9B. The facial alignment interface 908 includes a positioning element 910, which, in some examples, is a framing circle or brackets representing an alignment boundary. In some examples, positioning element 910 identifies an inner display portion 912 and an outer display portion 912. In some examples, the electronic device determines that the user's biometric features are properly aligned when positioned substantially within the internal display portion 912 in a predetermined manner. In some examples, the positioning element 910 partitions the inner display portion 912 from the outer display portion 914. In general, when the user's face is positioned relative to the biometric sensor 903 so that a portion of the user's image is visible on the external display portion 914, the user's face is properly aligned with the cameras in some situations. Won't be. As such, the face alignment interface 908 also provides a text prompt 916 instructing the user to position his or her face inside the positioning element 910 (e.g., within the internal display portion 812). ).

Referring to FIG. 9C, in some examples, during the alignment process, the user positions the electronic device 900 substantially in front of the user's face 917. In some examples, the user maintains device 900 at approximately the same height as his or her face, such that the face is in the field of view of biometric sensor 903.

As illustrated in FIG. 9D, once the user has initiated the alignment process, the device displays the facial alignment interface 908 (remember that the user selectively initiates the registration process by activating affordance 904). . Face alignment interface 908 includes a digital viewfinder that represents a preview of image data captured by biometric sensor 903. In some examples, the preview of image data is continuously updated (e.g., when the device 900 is moved or when the user moves closer to/farther from the cameras) as the field of view of these cameras changes (e.g. , Is a live preview that changes over time). The digital viewfinder includes a user face image 918 as well as a positioning element 910 that is superimposed on the field of view of the cameras. As described above, the positioning element 910 partitions the inner display portion 912 from the surrounding outer display portion 914. To provide additional visual separation between the inner display portion 912 (where the user face image 918 will be positioned) and the outer display portion 914, the device 900 may be configured as shown in FIG. Visually obscure the external display portion 914 (eg, shade, darken, or blur).

In general, proper registration of the user's facial features for authentication requires that the user's face be positioned in a predetermined manner and/or within a predetermined range of distances from the cameras of the device 900. In some examples, alignment of the user's face with the cameras of device 900 requires that the user is neither too close to the device nor too far away from the device. Thus, if the electronic device 900 determines that the user's face is too close or too far, the electronic device will tell the user to locate their face at an acceptable distance (e.g., 20-40 mm) from the device 900. A text prompt 920 indicating that it is displayed in the face alignment interface 908. In the example of FIG. 9D, the device 900 indicates that the user's face is too far from the cameras on the device (e.g., the user face image 918 is within the positioning element 910, but the internal display portion 912). Does not substantially fill). In some examples, the electronic device prompts the user to move his or her face closer to the device. In some examples, the device may have one or more outputs, such as an audio output 922 (e.g., a series of beeps or other audio output) and a tactile output 924 (e.g., a series of vibrations or other tactile sensations). Enemy output) to notify the user of improper alignment. In some examples, audio output 922 and/or tactile output 924 have a varying size and repetition rate (eg, frequency) based on the distance between device 900 and the user's face. For example, the output frequency and/or size is optionally increased as the user's face moves closer to an acceptable range of distances from the device (eg, 20-40 mm). Conversely, the frequency and/or magnitude of the output optionally decreases as the user's face moves further away from the acceptable range of distances. In this case, the device 900 may determine the frequency and/or magnitude of the audio output 922 and/or tactile output 924 as it detects changes in the distance between the user's face and the biometric sensor 903. Continue to change (e.g. update). In some examples, device 900 provides these outputs as long as the user's face is outside an acceptable range of distances from the device. In some examples, audio output 922 and tactile output 924 accompany a corresponding visual output on display 700. These ongoing audio, tactile, and/or visual outputs optionally provide intuitive hints on how the user accurately aligns his or her face with the cameras, saving the time required to perform a successful face alignment. Decrease.

9E illustrates the face alignment interface 908 when the user's face is positioned closer to the device 900 (eg, a significant portion of the user's face image 918 is within the external display portion 914 ). In this case, the alignment interface 908 also includes a text prompt 920 instructing the user to position his or her face at an acceptable distance from the device 900. In some examples, the electronic device instructs the user to move his or her face closer to the device. As described above with respect to FIG. 9D, the device 900 optionally has an ongoing audio output 922 and/or a tactile output in response to detecting that the user's face is too close to the camera(s) 924). In particular, device 900 changes the frequency and/or magnitude of these outputs as it detects changes in the distance between the user's face and the cameras.

9F illustrates the face alignment interface 908 when the user's face is positioned at an acceptable distance from device 900 but is out of frame (eg, too far to the right or left). For example, face 918 is optionally positioned such that a significant portion of face 918 lies outside of positioning element 910 within external display portion 914. In this case, the device 900 optionally instructs the user to position his or her face within the positioning element 910 (e.g., such that the user image 918 is displayed within the internal display area 912). The text prompt 926 to be displayed on the alignment interface 908.

9G-9L, in some examples, electronic device 900 displays face alignment interface 908 in response to determining that the user's face is positioned outside a range of predetermined angles relative to the electronic device. . As shown in Figure 9G, the electronic device 900 is positioned at a low angle relative to the electronic device so that the electronic device cannot properly acquire (e.g., cannot capture biometric data). Is aligned with the user's chin). Referring to FIG. 9H, in response to determining that the electronic device 900 is outside a range of predetermined angles, the electronic device 900 may be configured with a facial alignment interface, such as the inner display portion 912 and the outer display portion 914 Blurs at least a portion of (908). In some examples, the electronic device instructs the user to position his or her face within the positioning element 910 (e.g., such that the user image 918 is displayed within the internal display area 912 and at an appropriate angle). An additional prompt 986 is output. In FIGS. 9I and 9K, the user raises the device 900 until the electronic device is within a predetermined range of angles. As the user raises the electronic device, referring to FIGS. 9J and 9K, the electronic device 900 gradually reduces the blur of the displayed elements. In this way, the electronic device indicates to the user that the angle of the electronic device relative to the user is approaching an acceptable range of angles. In some examples, the electronic device is too high for the user such that the electronic device is not within a predetermined range of angles. Similar to the described example, the electronic device optionally reduces or increases the blur of displayed objects as the electronic device is moved relative to the user.

In some examples, if the device detects that the alignment error persists for a predetermined amount of time, the device 900 optionally selects an accessibility option affordance 928 on the face alignment interface 908, as shown in FIG. 9G. ) Is displayed. For example, device 900 may optionally, at a predetermined time after it starts aligning (e.g., after start button 904 is selected), at an acceptable distance from the device and/or within the positioning element. If not detected, the accessibility option affordance 928 is displayed. In some examples, the predetermined time is optionally 10 seconds, 15 seconds, 30 seconds, or any other suitable time. Similarly, device 900 optionally displays an accessibility option affordance after a predetermined number of registration attempts have failed. As discussed in more detail below, device 900 optionally displays additional options or hints and/or initiates alternative facial registration processes in response to detecting the selection of accessibility option affordance 928. do. In some examples, activation of the accessibility option affordance 928 allows the user to proceed with biometric registration without first correcting for alignment errors.

In general, the quality of facial feature registration for the facial authentication methods described herein depends, at least in part, on the lighting conditions under which the user's facial data is captured. For example, strong backlighting or direct exposure to the user's face will, in some situations, adversely affect the quality of the registration. Referring now to FIG. 9H, in response to detecting adverse lighting conditions, the device 900 optionally displays on the alignment interface 908 a text prompt 930 indicating the lighting adverse to the user. Text prompt 930 optionally carries audio, visual and/or tactile output 932. Output 932 is optionally identical to output 922 and/or 924 described in connection with the alignment errors discussed above. In some examples, the outputs are error-specific; Accordingly, output 932 may optionally be an audio, visual, and/or tactile output different from outputs 922 and 924.

In general, the quality of facial feature registration also depends in part on the angle at which the user's face is oriented relative to one or more cameras of device 900 (eg, biometric sensor 903). In particular, one or more optical sensors of device 900 should be capable of capturing image data of a user's face at a specific angle or within a predetermined range of angles. Even if the user's face is within the allowable range of distances described above, facial authentication registration can be adversely affected if the device 900 is positioned high above or too far below the user's face. Thus, in some examples, device 900 requires that the user's face be positioned within a predetermined range of angles relative to one or more of its cameras when detecting successful alignment conditions.

In some examples, the device 900 responds to detecting that the user's face is outside of this predetermined range of angles relative to the biometric sensor 903, the image displayed in the digital viewfinder of the alignment interface 808. Blur the data. In some examples, the amount of blurriness optionally depends on the difference between the detected angle of elevation of the user's face relative to the camera and one or more critical angles bounding the predetermined angular range. For example, the device 900 blurs the preview image to a greater degree as the device 900 is positioned higher or lower with respect to the user's face. When the device 900 detects a change in elevation angle that brings its cameras to closer alignment with the user's face, it optionally reduces the amount of blurriness as the elevation angle changes (e.g., with a continuous gradient). . In some examples, the preview image is not blurred when the elevation angle between the device 900 and the user's face is actively changing (eg, the user is moving the device 900 relative to his or her face). The blurriness optionally indicates that the angle between the user's face and one or more of his cameras was outside a predetermined angle range for a set period (e.g., 1 second, 2 seconds, 5 seconds, or any suitable period). ) Is delayed until the decision. In some examples, only a portion of the preview image (eg, external display portion 914) is blurred, but in other examples the entire preview image is selectively blurred. Blurring the preview image in this manner optionally prompts the user to more quickly position the device 900 at the desired angle relative to his or her face, reducing the time spent during the alignment process. In some examples, device 900 optionally issues a tactile and/or output to inform the user that his or her face is positioned at an appropriate angle relative to biometric sensor 903.

In Figure 9N, the user's face is properly positioned relative to the biometric sensor 903. In this case, the face 918 is displayed substantially within the alignment element 910 and the inner display portion 912. As shown in FIG. 9N, face 918 also occupies a significant portion of internal display portion 912, indicating that the user's face is within a threshold range of distances from device 900. In response to detecting a face that meets the aforementioned alignment criteria, device 900 issues an audio output 934 and a tactile output 936 to indicate successful alignment of the user's face with the cameras. In general, outputs 934, 936 are different from outputs 922, 924, 932 that are issued in response to detecting alignment errors. In some examples, device 900 captures and stores one or more images of the user's face upon successful alignment with cameras.

In some examples, after detecting a successful alignment, device 900 visually highlights the inner display portion 912 on which face 918 is displayed. In the example of FIG. 9P, the device 900 continues to display a portion of the digital viewfinder preview on the internal display portion 914 (e.g., inside the positioning element 910) while the external portion of the digital viewfinder preview. The external display portion 914 is further obscured by further blurring or blackening the image in. In some examples, device 900 further visually emphasizes the content of internal display portion 912 by magnifying or zooming in an image within internal display portion 912.

In some examples, the device further emphasizes the internal display portion 912 by changing the appearance of the positioning element 910. In particular, the device 900 optionally faces 918 the corners of the alignment element 910 as shown in FIG. 9P and/or by “rounding” the corners of the alignment element as shown in FIG. 9Q. The appearance of the alignment element is changed by merging it into a circular positioning element 941 surrounding the.

Referring now to the example of FIG. 9R, in response to detecting that the user's face is oriented such that the above-described alignment criteria are met, the device 900 displays a face registration interface 938 (e.g., alignment interface 908 ) By replacing the display of the face registration interface 938). In some examples, facial registration interface 938 has similar or identical visual characteristics to facial authentication registration interface 756 described above with respect to FIG. 7S or registration interface 1104 described below with respect to FIG. 11A. In the example of FIG. 9R, the face registration interface 938 includes a user face image 939 displayed within the positioning element 941. In the example of FIG. 9R, user face image 939 is a live preview of image data captured by biometric sensor 903. The face registration interface 938 also optionally includes a registration progress meter 940 surrounding the user face image 939 and the positioning element 941. As described above in connection with FIGS. 7S and 11A-11H, the registration progress meter 940 extends radially outward from the user face image 939, and in some examples progress elements surrounding it in a circular pattern. (E.g., 940a, 940b, and 940c). The face registration interface 938 optionally includes an orientation guide 942. In some examples, the orientation guide includes a set of curves (eg, crosshairs) that appear to extend out of the plane of the display 901 with a virtual z-dimension, intersecting over the center of the user face image 939. In some examples, the orientation guide provides a sense of three-dimensional orientation of the user's face even if the face image 939 is two-dimensional. In this case, the orientation guide 942 assists the user in the face registration process by making the rotation and/or tilt of the user's head relative to the device 900 more visible. The face registration interface 938 also includes a text prompt 944 that selectively instructs the user to begin tilting their heads, for example in a circle, to perform registration.

In general, once the enrollment process is initiated, the quality of enrollment is reduced if the device 900 moves too much relative to the user's face (e.g., while the user moves slowly and rotates/tilts his or her face, the device Should remain stationary). In the example of FIG. 9S, device 900 detects excessive movement of its one or more cameras relative to the user's face. This over-movement is, optionally, a significant change in the position and/or orientation of the user's face relative to the device 900 consistent with the movement of the device itself, which prevents reliable alignment and/or registration. In response, the device 900 generates a visual prompt 946 instructing the user to reduce movement of the device (e.g., prompting the user to keep the device stationary during the registration process) to the registration interface 938. Is issued on the prize. Device 900 also optionally simultaneously generates visual and/or audible output 948. In some examples, the movement of the device itself is measured by accelerometer 168 rather than biometric sensor 903. The movement of the device is also optionally measured by a magnetometer, an inertial measurement unit, or the like of the device 900.

Successful registration typically requires that the alignment of the user's face with the cameras on device 900 is maintained throughout the registration process. Thus, in some examples, device 900 optionally terminates the face registration process if more than one alignment errors are detected during registration. In some examples, if, during the registration process, the device 900 detects one or more alignment errors, the electronic device terminates the registration process (e.g., stops displaying the face registration interface 938), and optionally the device Initiates (eg, transitions to) the alignment process displaying the alignment interface 908-2. In the examples of FIGS. 9T and 9U, alignment interface 908-2 and components thereof optionally have similar or identical visual characteristics to initial alignment interface 908 described above with respect to FIGS. 9B-9O. In the examples of Figures 9T and 9U, the device 900 has determined that the user's face is out of the frame, and as a result, the device 900 is out of position, compared to the successful alignment shown in Figure 9O. Display the user face image 918-2 in the display portion 912-2. In some examples, the device outputs an indication of an alignment error, such as a text prompt 950 indicating that the user face image 918-2 is not properly aligned within the positioning element 910. This example is only illustrative. In some examples, the alignment error is optionally a failure to meet any of the other alignment criteria discussed above (eg, distance from the device, angle of orientation, unfavorable lighting, etc.). In such a case, text prompt 950 instructs the user to move the device and/or their faces to an acceptable range of distances or to correct the orientation angle. In some other examples, the alignment error is optionally different from the criteria, such that a small change in alignment will not cause the device to terminate the face registration process. In response to detecting one or more alignment errors, the device exposes the portion of the image preview displayed on the external display portion 914-2 and displays the positioning element 910-2 as shown in FIG. The display portion 912-2 is visually de-emphasized. For example, device 900 brightens or does not blur the preview image on external display portion 914-2 to help users rearrange their faces relative to biometric sensor 903. In the example of FIG. 9U, dehighlighting the inner display portion 912-2 means that a significant portion of the user's face image 918-2 is a positioning element 910-2 within the outer display portion 914-2. It reveals that it is positioned on the outside of.

In some examples, device 900 again detects that the user's face is properly aligned with biometric sensor 903. In response, device 900 outputs audio output 934-2 and/or tactile output 936-2 indicating a successful alignment. In some examples, audio output 934-2 and tactile output 934-6 have similar properties as audio output 934 and tactile output 936, respectively, as described with reference to FIG. 9O. . In some examples, device 900 then resumes the registration process. For example, the device 900 may include an inner portion 912-2 and a facial image (in the manner previously discussed with respect to the inner display portion 912 and face image 918-2 in FIGS. 9P and 9O ). 918-2). In some examples, the device 900 resumes the registration process at the point at which the electronic device detected an alignment error (e.g., the face registration interface 938 has a registration progress meter that has advanced to the same state as when the alignment error was detected. 940) and displayed again).

In some examples, if the device fails to detect that the proper alignment has been established (e.g., re-established) within a predetermined period of time, the device 900 may perform an accessibility option affordance 928-2, as shown in Figure 9V. ) Is displayed. In some examples, the accessibility options provide an option to proceed with the registration process without all alignment conditions being met, as described below. In some examples, the accessibility options provide an option to set up biometric (eg, face) authentication with partial registration only (eg, scanning only a portion of the user's face).

In response to detecting the activation (e.g., selection) of the accessibility option button 928-2 (e.g., by tap gesture 952), the device may perform an accessibility registration interface 954, as illustrated in FIG. 9W. ) Is displayed. One or more features of the accessibility registration interface 954 have similar or identical visual characteristics to corresponding features of the registration interface 938. For example, in FIG. 9W, the face registration interface 954 includes a user face image 939-2 displayed within the positioning element 941-2. In some examples, user face image 939-2 is a live preview of image data captured by biometric sensor 903-2. The accessibility registration interface 954 also optionally includes a positioning element 941-2 and a registration progress meter 940-2 surrounding the user face image 939-2. As described above in connection with FIGS. 7S and 11A-11H, the registration progress meter 940-2 extends radially outward from the user face image 939-2, and in some examples surrounds it in a circular pattern. Consists of a set of progress elements (eg 940-2a, 940-2b, and 940-2c). The accessibility registration interface 954 optionally includes an orientation guide 942-2. In some examples, the orientation guide includes a set of curves (e.g., crosshairs) that appear to extend out of the plane of the display 901 in a virtual z-dimension, intersecting over the center of the user face image 939-2. do. Like facial registration interface 938, accessibility interface 954 optionally includes a text prompt (eg, prompt 956) that provides written instructions for successfully completing the registration process. In some examples, the accessibility registration interface 954 also includes a completion affordance 956, which activation causes the user to terminate the registration process and proceed to set up facial authentication using only partial scans of their facial features. do. In some examples, partial scandals are helpful to a user with a condition that, in some situations, prohibits the user from tilting his or her head in all directions other than the direction required for registration.

In response to activation (e.g., selection) of completion affordance 956 (e.g., by user input 958 shown in FIG. 9X), the device displays face registration verification interface 960, illustrated in FIG. 9Y. . The face registration confirmation interface includes a face image 939-3 having visual characteristics similar to the user face image 939-2, in the example of FIG. 9Y. The face image 939-3 is optionally surrounded by a registration progress meter 962 displayed in the successful authentication state described above with respect to FIGS. 7P and 7Q. The face registration confirmation interface also includes a partial scan registration affordance 964 that allows the user to register the collected facial data for use in device authentication. The facial registration confirmation interface 960 also includes a back affordance 966 that allows the user to navigate back to the accessibility registration interface 954.

As illustrated in FIG. 9Z, the device detects a user input 968 corresponding to activation (eg, selection) of affordance 966 back. In response to detecting the user input, device 900 displays accessibility registration interface 954 (eg, during a second time). While displaying the accessibility registration interface 954, the device 900 detects movement (eg, rotation and/or tilt) of the user's face relative to the biometric sensor 903. In the case of FIG. 9AA, the device 900 detects that the user's face is tilted in a specific direction (eg, downward toward the meter portion 970 and/or to the right). As described below in further detail with respect to FIGS. 11B to 11H, the device 900 updates the user face image 939-2 based on the detected movement, and the user's head is in a three-dimensional space. Update the position of orientation guide 942-2 to indicate that it has been tilted and/or rotated. In response to detecting the movement of the user's face, the device 900 captures image data of a portion of the user's face (e.g., the left side of the face), and a corresponding portion of the registration progress meter 940-2 (e.g. , The appearance of the meter part 970 is simultaneously changed. In some examples, the device 900 includes a meter portion (as described in more detail with respect to FIGS. 7I-7K and 11B-11H) to indicate that a portion of the user's face is currently being enrolled. 970) and/or change its color. In some examples, device 900 maintains a display of meter portion 972 (eg, does not change the appearance) because meter portion 972 corresponds to a facial orientation that has not yet been registered.

9Ab, in some examples, the device 900 detects a change in the orientation of the user's face relative to its one or more cameras (e.g., the user's face is tilted upward), and accordingly The face image 939-2 and orientation guide 942-2 are updated. As an example, since the image data in the facial orientation corresponding to the meter portion 972 has been successfully registered, the device 900 may be configured with the meter portion (as described in more detail below with respect to FIGS. 11B-11I ). 972) transitions the state of the progress elements to a "registered" state (eg, by changing or shading the line width and/or color of the progress elements). 9Ab, device 900 again detects activation (eg, selection) of completion affordance 956 (eg, by user input 958-2).

In response to detecting activation of completion affordance 956, device 900 returns to displaying face registration confirmation interface 960 as shown in FIG. 9Ac. Since a portion of the user's face has been successfully registered, the device 900 displays a registration success indicator 974, for example, in proximity to the user face image 939-3. In the example of FIG. 9Ac, registration success indicator 974 indicates orientations of the user's face that were successfully registered. In some examples, the registration success indicator 974 is a circular bar. Thus, in some examples, registration success indicator 974 indicates (eg, located at those locations) the locations at which the registration progress meter transitioned to a success state during registration.

In some examples, the partial scan registration affordance 964 is selectable because the accessibility registration interface 960 allows the user to set up facial authentication with only partial registration of their facial features. As shown in FIG. 9A, the device 900 detects activation (eg, selection) of the partial scan registration affordance 964 (eg, by user input 976). In response to detecting activation of partial scan registration affordance 964, device 900 displays registration complete interface 978, illustrated in FIG. 9AE. The registration complete interface 978 includes a text prompt 980, indicating to the user that the registration process is complete and facial authentication has been securely set up. The registration completion interface 978 optionally includes a generic facial graphic 982 at a location previously occupied by the user face image 939-3. In some examples, the registration completion interface 978 also includes a completion affordance, which activation causes the electronic device to terminate facial authentication setup.

10 is a flow diagram illustrating a method for aligning a biometric feature on a display of an electronic device, in accordance with some examples. Method 1000 includes a device having a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 900). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 1000 provides an intuitive method for aligning biometric features on a display of an electronic device. This method reduces the user's cognitive burden for registering biometric features on the device, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to register biometric features faster and more efficiently saves power and increases the time between battery charges.

The device displays 1002 a first user interface (eg, 905) on the display. For example, the first user interface is optionally a registration introduction user interface as described above with respect to method 700.

While displaying the first user interface, the device detects 1004 occurrence of a condition corresponding to initiating a biometric registration process to register each type of biometric feature (eg, 917). For example, the occurrence of the condition is optionally an input (eg, 906 on start affordance 904) corresponding to a request to “start registration”.

In response to detecting the occurrence of a condition corresponding to initiating the biometric registration process (e.g., a user input selecting initiation of registration), the device is captured by one or more cameras (e.g., 903) on a display. A digital viewfinder (e.g., display portions 912, 914) containing a preview of the image data (e.g., user face image 918) is displayed (1006). In some examples, the preview of the image data is a first portion of the field of view of one or more cameras (e.g., outer portion of field of view 914) and a second portion of the field of view of one or more cameras (e.g., inner portion of field of view 912) Encompasses. In some examples, the second portion of the field of view (eg, 914) is a portion of the field of view that surrounds (or partially surrounds) the first portion of the field of view (eg, 912) (1008). In some examples, the inner portion of the field of view is optionally divided from the outer portion by an alignment element (eg, positioning element 910 ). In some examples, the preview of image data optionally changes over time as the content in the field of view of one or more cameras (eg, 903) changes. Displaying a preview of the image captured by the biometric sensors provides feedback to the user regarding the position and orientation of his or her biometric features relative to the device's biometric sensors, so that the user It makes it possible to properly align the biometric features of the sensor with the sensors more quickly and efficiently. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device, along with a preview of the image data, indicates an alignment element (e.g., positioning) representing the portion of the preview (e.g., 912) where the user's face (e.g., 918) should be placed to proceed with biometric registration. The element 910) is simultaneously displayed (1010). For example, the alignment element may optionally include framing brackets displayed in the central portion of the preview image (e.g., 912) to prompt the user to move the device or their face toward alignment with the central portion of the preview image. It's Framing One. Displaying an alignment element framing a specific portion of the digital viewfinder provides feedback to the user regarding the location of his or her biometric features relative to a portion of the biometric sensor's field of view corresponding to the proper alignment of the biometric features. to provide. This in turn allows the user to properly position his or her biometric features relative to the sensors more quickly and efficiently. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, after initiating the biometric registration process (1012), the device detects each type of biometric feature (e.g., 917) that meets the alignment criteria in the field of view of one or more cameras (e.g., 903). It is determined whether or not (1014). Determining whether the user's biometric features are properly aligned with the biometric sensors is by ensuring that image data corresponding to specific portions and/or orientations of the biometric features are captured during registration (e.g., method (According to 1200 and/or 1400) improve the quality of subsequent biometric registrations. This in turn improves the device's ability to match the user's biometric features with data captured during biometric authentication at the device. Performing an optimized operation when a set of conditions is met without requiring additional user input (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) ) It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, in response to detecting (1016) each type of biometric feature (e.g., 917) that meets the alignment criteria, the device performs a first type of tactile output (e.g., 934, 936, 934- 2, 936-2, e.g., the tactile output is the output corresponding to a successful alignment) (1018). Issuing a tactile output upon detecting that the biometric feature is properly aligned with the biometric sensors is to allow the user to biometric throughout the subsequent biometric registration process (e.g., methods 1200 and/or 1400). Provides feedback to the user indicating a successful alignment, prompting to keep the features in that alignment. Providing improved tactile feedback to the user improves the operability of the device (e.g., by helping the user to provide appropriate inputs during biometric registration and reducing user mistakes when actuating/interacting with the device). And make the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, in response to detecting (1016) each type of biometric feature that meets the alignment criteria, the device stores (1020) image data corresponding to the biometric feature (eg, 917). In some examples, upon successful alignment, the device captures data associated with the biometric feature. Storing biometric (eg, image) data in response to detecting successful alignment of the biometric features allows the device to automatically capture referenced data during subsequent biometric application attempts. Performing an optimized operation when a set of conditions is met without requiring additional user input (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) ) It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the alignment criteria include the requirement that at least a portion of the biometric feature (e.g., 917) is within a first portion of the field of view of one or more cameras (e.g., internal display portions 912, 912-2). (1024). For example, in some examples, the electronic device determines whether the image data includes data corresponding to a biometric feature that satisfies the alignment criteria. In some examples, the alignment criteria include 1050 lighting condition criteria. In some examples, the alignment criteria include the requirement that the lighting conditions of the electronic device (e.g., by 903) at least a first threshold amount of light are detected and/or a second threshold amount of light or less is detected. It is required to be appropriate for capturing image data during registration.

In some examples, the alignment criteria include the requirement that a portion of the biometric feature (eg, a portion of 917) is oriented relative to the electronic device in a predetermined manner (1052). In examples where the biometric feature is the user's face, the alignment criteria optionally specify the requirement that the user's gaze is facing at least one of one or more cameras of the electronic device (e.g., 903) or a display of the electronic device (e.g., 901). Include. In some examples, the requirement that a portion of the biometric feature (e.g., a portion of the user's face image 918) is oriented relative to the electronic device in a predetermined manner is that the biometric feature (e.g., 917) is one or more biometric sensors. It is a requirement to be located within a critical angle (eg elevation angle) for s (eg 903). In some examples, the alignment criteria are that the biometric features (e.g., 917) are pre- It requires being positioned relative to the biometric sensors (eg, 903) in a determined manner. In some examples, the device may, for example, based on the degree to which the biometric feature (eg, 917) deviates from a predefined range of angles with respect to one or more biometric sensors (eg, 903), Blurs the display of the electronic device (eg, display portions 912 and/or 914).

In some examples, the alignment criteria are a requirement that the biometric feature (e.g., 917) is within a first threshold distance from one or more biometric sensors (e.g., 903) (e.g., the biometric feature is too far from the biometric sensors). Not far) 1042, and a requirement that the biometric feature is not within a second threshold distance from the one or more biometric sensors (e.g., the biometric feature is not too close to the biometric sensors) (1026). ).

In some examples, while the biometric feature (e.g., 917) is at a first distance from the electronic device that is not within a predetermined range of distances from the electronic device, the device is operated by one or more cameras (e.g., 903). , A change in distance of the biometric feature (eg, 917) from the first distance to a second distance from the electronic device that is not within a predetermined range of distances from the electronic device (1044). In response to detecting a change in distance, the device is configured to have an output (e.g., a value of an output characteristic (e.g., magnitude or amplitude, or frequency or repetition rate) that varies based on the distance of the biometric feature from a predetermined range of distances. , Audio, tactile and/or visual outputs 922, 924) (1046). In some examples, the electronic device has an on-going audio output with a frequency that increases as the distance between the biometric feature (e.g., 917) and the electronic device approaches a target distance (or range of distances) from the electronic device. For example, 924, e.g., a series of beeps) is issued. For example, the speed at which the beep sounds is selectively increased. Conversely, the frequency of the audio output (eg, 922) optionally decreases as the distance between the biometric feature and the electronic device moves further away from the target distance (or range of distances) from the electronic device. For example, the speed at which the beep sounds is selectively reduced. In some examples, similar feedback with tactile outputs (eg, output 924) or visual outputs is generated. Issuing a varying audio, tactile, and/or visual output based on the distance between the biometric feature and the device is a measure of his or her biometric over a range of distances from the biometric sensors corresponding to the proper alignment. Provides on-going feedback to the user regarding the location of the measurement features. This in turn reduces the time the alignment interfaces are displayed and reduces the number of user inputs required during the alignment process. Thus, providing improved audio, tactile, and/or visual feedback to the user is the result of (e.g., by helping the user to provide appropriate inputs when actuating and/or interacting with the device and reducing user mistakes) of the device. It improves operability and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

After initiating the biometric registration process, according to a determination that each type of biometric feature (e.g., 917) that meets the alignment criteria has been detected in the field of view of one or more cameras (e.g., 903), the device Is a first portion of the field of view of one or more cameras (e.g., inner display portion 912 in FIG. 9J) compared to a second portion of the field of view of one or more cameras (e.g., outer display portion 914 in FIG. 9J). Emphasize (e.g., darken and/or blur and/or blacken the second part of the field of view without darkening and/or blurring and/or blackening the first part of the field of view of one or more cameras) (1028) . For example, the alignment criteria include the requirement that the user's face (eg, 917) is aligned with the camera (eg, 903) in a predetermined alignment or the user's eye is aligned with the camera in a predetermined alignment. Providing a visual effect that highlights a portion of the display upon detecting the successful alignment of the user's biometric features with the biometric sensors allows the user to determine the current location of his or her biometric features (e.g. , Quickly recognize that it is optimal for the subsequent biometric registration process (according to methods 1200 and/or 1400). Providing improved visual feedback when a set of conditions is met without requiring additional user input (e.g., helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user mistakes) By improving the operability of the device and making the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device dims 1030 a portion of the digital viewfinder that corresponds to a second portion of the field of view (eg, 914 in FIG. 9J) of one or more cameras (eg, 903). Darkening in this manner includes dimming or dimming the portion of the digital viewfinder corresponding to the second portion of the field of view.

In some examples, the device stops displaying a portion of the digital viewfinder corresponding to a second portion of the field of view of one or more cameras (eg, second display portion 914) (1032 ). For example, stopping displaying the portion of the viewfinder corresponding to the second portion of the field of view may result in blackening the second portion of the field of view and/or replacing the display of the second portion of the field of view with a display of other content Includes doing.

In some examples, the device magnifies (1034) the display of a first portion of the field of view of one or more cameras on the display (eg, internal display portion 912). In some examples, magnifying the display of the first portion includes magnifying the display of some or all of the first portion of the field of view. In some examples, magnifying the display of the first portion of the field of view includes zooming in the first portion of the field of view. In some examples, highlighting the first portion of the field of view of one or more cameras (e.g., 912) relative to the second portion of the field of view of one or more cameras (e.g., 914) reduces or hides some or all of the first portion. Includes that. In some examples, the device shrinks the first portion before magnifying the display of the first portion (e.g., to provide a zoom in and zoom out effect) and/or zooms out the first portion after enlarging the display of the first portion. Let it.

In some examples, the device modifies 1036 an alignment element (eg, 910). For example, in some examples, modifying the alignment element includes removing the alignment element. In some examples, modifying the alignment element includes changing the shape and/or color of the alignment element (eg, from 910 to 910-2 in FIGS. 9J and 9K). For example, the device modifies the shape of the alignment element from a first shape to a second shape (1038). In some examples, the first shape is substantially rectangular and the second shape is substantially circular (1040). Alternatively, the first shape and/or the second shape is optionally any other shape or part of a predetermined shape. In some examples, the predetermined shape is optionally a segmented shape, such as a segmented rectangle (eg, a rectangle with missing portions of one or more sides).

In some examples, after highlighting the first portion of the field of view (e.g., 912) of the one or more cameras relative to the second portion of field of view (e.g., 914) of the one or more cameras (e.g., 903), the device meets the alignment criteria. It is detected that each type of biometric feature (eg, 917) is no longer detected in the field of view of one or more cameras (1054). In response to detecting that each type of biometric feature that meets the alignment criteria is no longer detected in the field of view of the one or more cameras, the device outputs an indication of an alignment error (eg, 950). For example, in case of correctable errors, the device identifies the error and prompts the user to correct the error. In case of uncorrectable errors, the device only identifies the error. Errors are identified by textual and tactile output (eg, 950, 924, 925). In some examples, errors are identified using audible outputs, such as those provided for accessibility purposes. In some examples, the criteria for detecting that the biometric feature is no longer detected in the field of view of one or more cameras are the same as the criteria for determining that the biometric feature meets the alignment criteria. In some examples, the alignment criteria are different from the criteria for detecting that the biometric feature is no longer detected in the field of view of one or more cameras (e.g., once the biometric feature is aligned with one or more cameras, the biometric feature is , The device may be moved slightly out of alignment without terminating the biometric registration process and outputting an indication of alignment error). Outputting an indication that the user's biometric feature is no longer aligned with the biometric sensor quickly indicates that the user's position and/or orientation of his or her biometric feature deviates from a previously established alignment. Provide awareness feedback. This feedback prompts the user to quickly reposition his or her biometric features to re-establish proper alignment with the biometric sensor, reducing the time the alignment user interfaces are displayed, and such alignment user interface. It reduces the number of inputs required in the field and improves the quality of biometric feature registration. Thus, providing improved audio, tactile, and/or visual feedback to the user is the result of (e.g., by helping the user to provide appropriate inputs when actuating and/or interacting with the device and reducing user mistakes) of the device. It improves operability and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, outputting an indication of an alignment error includes outputting a second type of tactile output (eg, 951) (1056). For example, the tactile output is the output corresponding to the loss of successful alignment. In some examples, the tactile outputs are error-specific, and in some examples an audible output is additionally or alternatively provided.

In some examples, outputting an indication of an alignment error de-emphasizes the first portion of the field of view of one or more cameras (e.g., 912-2) relative to the second portion of the field of view (e.g., 914-2) of one or more cameras. Including that (1058).

For example, the device optionally brightens and/or does not blur and/or reveals a second portion of the field of view compared to a first portion of the field of view of one or more cameras. In some examples, the electronic device brightens and does not blur the second portion of the field of view to de-emphasize the first portion relative to the second portion. In some examples, if the biometric feature (e.g., 917) is successfully aligned after receiving an alignment error, the device resumes the biometric registration process from where the registration process was before outputting an indication of the alignment error ( For example, registration progress up to the point when an alignment error is detected is preserved). In some examples, a progress indicator (e.g., 940) that indicated registration progress disappears when an indication of an alignment error is output, but is displayed again when the biometric feature is properly aligned with one or more biometric sensors (e.g., 940-2). In some cases, when the progress indicator is displayed again, it includes an indication of the progress made upon registering the biometric feature prior to outputting an indication of an alignment error. Providing a visual effect of de-highlighting a portion of the display upon detecting an alignment error allows the user to quickly determine that the location and/or orientation of his or her biometric features deviates from a previously established alignment. To be aware. This feedback prompts the user to quickly reposition his or her biometric features in order to re-establish proper alignment with the biometric sensor, which reduces the time the alignment user interfaces are displayed, and this alignment user Reduces the number of inputs required at the interfaces and improves the quality of subsequent biometric feature registration (eg, according to methods 1200 and/or 1400). Providing improved visual feedback when a set of conditions is met without requiring additional user input (e.g., helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user mistakes) By improving the operability of the device and making the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, upon determining that the alignment error is a first type of alignment error (e.g., the biometric feature is too far from or too close to the electronic device) (1062), the device is to correct for a first type of alignment error. A prompt (eg, 920) is output (eg, displayed) 1064 to move the biometric feature in order. For example, the device each prompts the user to move closer to or further away from the electronic device.

In some examples, upon determining that the alignment error is a second type of alignment error (e.g., the biometric feature is outside the first portion of the field of view) 1062, the device is biometric to correct for a second type of alignment error. A prompt (eg, 950) is output (eg, displayed) 1064 to move the feature. For example, the device prompts the user to move the biometric feature into the first portion of the field of view. In this case, the device withholds (1068) outputting a prompt (e.g., 926) to move the biometric feature to correct for a first type of alignment error. In some examples, the second portion of the field of view (eg, 914-2) is corrected (eg, blurred) in response to determining that the alignment error is a second type of alignment error.

For example, a first type of alignment error is that a portion of a biometric feature (e.g., a portion of 917 shown in 918-2, 939) is oriented outside a first portion of the field of view (e.g., 912, 912-2). Will (1074). In this case, the device outputs a prompt (eg, 950) to move the portion of the biometric feature into the first portion of the field of view to prompt the user to correct for a first type of alignment error (1076). Providing a prompt with instructions on how to correct for alignment errors allows the user to quickly recognize how to relocate his or her biometric features to reestablish proper alignment and proceed with the registration process. Provide feedback. This in turn reduces the time for the device to display the alignment interfaces, and reduces the number of user inputs required in such alignment interfaces. Providing improved visual feedback when a set of conditions is met improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device). And make the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In another example, the first type of alignment error is that the distance between a portion of the biometric feature (e.g., 917) and one or more biometric sensors (e.g., 903) is within a threshold distance (e.g., biometric feature Boo is too close to one or more biometric sensors) (1078). In this case, the device outputs a prompt (eg, 920) to move the biometric feature away from the electronic device to prompt the user to correct for a first type of alignment error.

In another example, the first type of alignment error is that the distance between a portion of the biometric feature (e.g., 917) and one or more biometric sensors (e.g., 903) exceeds a threshold distance (e.g., biometric Feature is too far from one or more biometric sensors) (1082). In this case, the device outputs a prompt (eg, 920) to move the biometric feature closer to the electronic device to prompt the user to correct for a first type of alignment error (1084).

In another example, the first type of alignment error is that the angle of the biometric feature (e.g., 917) relative to the one or more biometric sensors (e.g., 903) is within a predefined range for the one or more biometric sensors. It is outside the angles (eg elevation angles). For example, the biometric feature is too high in some situations. In another example, the one or more biometric sensors are too low, in some situations. In this case, the device outputs a prompt to move the biometric feature to adjust the angle (eg, elevation) of the biometric feature relative to the one or more biometric sensors.

In some examples, upon determining that the first type of error condition persists for a threshold period (1086), the device is an accessibility interface (e.g., 908) that enables the user to proceed with biometric registration without correcting the error condition. ) Is displayed (1088). For example, in some examples, the device does not move the biometric feature (e.g., 917) relative to the device such that the error condition is corrected, or without tilting the biometric feature to capture images of different sides of the biometric feature. Allows the user to proceed with biometric registration. In some examples, the device allows the user to proceed with biometric registration in this manner if the biometric feature is improperly aligned for a predetermined amount of time and/or in response to a predetermined number of failed requests.

In some examples, after outputting an alignment error, upon determining that each type of biometric feature (e.g., 917) meeting the alignment criteria was detected in the field of view of one or more cameras (e.g., 903), the device The first portion of the field of view of the one or more cameras (eg, 912-2) is again emphasized (1070) compared to the second portion of the field of view of the one or more cameras (eg, 914-2). For example, optimally, the device may have a second portion of the field of view of one or more cameras (e.g., 912-2) without darkening, blurring, and/or blackening a first portion of the field of view of one or more cameras (e.g., 912-2). For example, 914-2) darkens and/or dims and/or blackens.

In some examples, after outputting an alignment error, and upon a determination that each type of biometric feature (e.g., 917) that meets the alignment criteria was detected in the field of view of one or more cameras (e.g., 903), the device Outputs a first type of tactile output (eg, 936) (1072). However, in some examples, the device outputs a third type of tactile output different from the first type and the second type.

Depending on the determination that each type of biometric feature (e.g., 917) meeting the alignment criteria was not detected in the field of view of one or more cameras (e.g., the user's face or eye was not detected with a predetermined alignment), The device does not emphasize the first portion of the field of view of one or more cameras (e.g., 912, 912-2) compared to the second portion of the field of view (e.g., 914, 914-2) of one or more cameras Maintain the display of the digital viewfinder (1090).

In some examples, the device detects (1092) a change in orientation and/or position of a biometric feature (eg, 917) relative to one or more biometric sensors (eg, 903). For example, the device optionally detects a change in position, a change in orientation, or both a change in orientation and position.

In some examples, in response to detecting a change in orientation and/or position of a biometric feature (eg, 917) relative to one or more biometric sensors (eg, 903) (1094), and device movement criteria are met. (E.g., the device is physically moving beyond a threshold in a way that prevents reliable alignment/registration), the device prompts to reduce the movement of the electronic device (e.g., 946, 948, visual , A tactile or audible alarm) is output (1096). In some examples, the device detects the reduced movement of the device, and in response to detecting the reduced movement of the device, the device stops outputting the prompt. In some examples, movement of the device is determined based on one or more biometric sensors (eg, 903). For example, a change in the orientation and/or position of a biometric feature with respect to one or more biometric sensors may result from movement of the device around the biometric feature rather than movement of the biometric feature in consideration of one or more biometric sensors. Matches. In some examples, movement of the device is determined based on one or more orientation sensors of the device, such as an accelerometer (eg, 168), magnetometer, inertial measurement unit, etc., separate from one or more biometric sensors.

In some examples, while the biometric feature (e.g., 917) is within a first portion (e.g., 912) of the field of view of one or more biometric sensors (e.g., 903) and is within a threshold distance of one or more biometric sensors, And upon determination that the biometric feature is within a predefined range of angles (e.g., elevation angles for one or more biometric sensors), the device may (e.g., refer to method 1200 and FIGS. Display a registration progress indicator (eg, 940) for registration of the biometric feature (as described in more detail). Displaying the registration progress indicator optionally includes a first portion of the field of view of one or more cameras (e.g., 912, 912-) relative to a second portion of the field of view of one or more cameras (e.g., 914, 914-2) as described above. It includes emphasizing 2) first. Displaying a progress indicator during registration in this manner encourages the user to see the display of the electronic device during registration, improving the ability to detect when the gaze is facing the display and, accordingly, whether the user is paying attention to the device. Let it. Encouraging the user to see the display of the electronic device improves the operability of the device and improves the user- It makes the device interface more efficient, which, in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, upon determining that the biometric feature (e.g., 917) is outside a predefined range of angles (e.g., elevation angles for one or more biometric sensors 903), the device previews the image data. Blur (eg, blur, darken, or desaturate) at least a portion of (eg, display portions 912, 912-2, 914 and/or 914-2). In some examples, the device is configured such that a portion of the preview of the image data is unambiguous (e.g., the biometric feature is Delay obscuring a portion of the preview of image data) after detecting that it is within the first portion of the field of view and within a critical distance of one or more biometric sensors, for at least a predetermined period of time, such as 1 second, 2 seconds, or 5 seconds Let it. In some examples, obscuring is delayed as long as the angle of the biometric feature is changing. In some examples, the ambiguity is delayed until the angle of the biometric feature has been continuously outside of a predefined range of angles at least for a predetermined period of time. In some examples, only a portion of the preview (eg, 912 or 914, 912-2 or 914-2) becomes ambiguous. In some examples, the entire preview (eg, 912 and 914, 912-2 and 914-2) becomes ambiguous. Obscuring the digital viewfinder when the biometric sensors are positioned too high above or too low below the user's biometric features quickly reveals that his or her biometric features are out of alignment. Make them aware. This then prompts the user to change the elevation angle between the device and his or her biometric features until an appropriate alignment is established. Providing improved visual feedback when a set of conditions is met improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device). And make the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, while a portion of the preview of the image data (e.g., 912 or 914) becomes obscured, the device is able to measure the angle of the biometric feature (e.g., 917) relative to one or more biometric sensors (e.g., 903). Detect changes. In response to detecting a change in the angle of the biometric feature in relation to one or more biometric sensors, and the change in the angle does not move the biometric feature to a predefined range of angles, the biometric feature is a predefined range. Depending on the decision to move closer to the angles of the image data, the device continues to obscure the portion of the preview of the image data (e.g., 912 or 914, 912-2 or 914-2), while still obscuring the portion of the preview of the image data. Reduce the amount In some examples, the amount by which the ambiguity of the portion of the preview of the image data is reduced depends on the amount of change in the angle of the biometric feature relative to the one or more biometric sensors (e.g., the biometric feature is further towards the one or more biometric sensors. The more you move, the greater the decrease in the amount of ambiguity). Upon determining that the change in angle moves the biometric feature to a predefined range of angles, the device stops obscuring a portion of the preview of the image data. In some examples, when a change in the angle of the biometric feature moves the biometric feature to a predefined range of angles, the device notifies the user that the angle of the biometric feature is within the predefined range of angles. To produce tactile and/or audio outputs (eg, 934, 936). Reducing the ambiguity of the digital viewfinder as the user's biometric feature moves closer to the predefined angular range allows the user to quickly recognize the set of positions corresponding to the successful alignment of the biometric feature. This then prompts the user to change the elevation angle between the device and his or her biometric features until an appropriate alignment is established. Providing improved visual feedback when a set of conditions is met improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device). And make the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, in response to detecting a change in the angle of the biometric feature (e.g., 917) with respect to one or more biometric sensors (e.g., 903), and the change in the angle causes the biometric feature to become a predefined range. Depending on the decision to move further away from the angles of, the device increases the amount of ambiguity in the portion of the preview of the image data (eg, 912 or 914, 912-2 or 914-2). In some examples, the amount by which the ambiguity of the portion of the preview of the image data is increased depends on the amount of change in the angle of the biometric feature relative to the one or more biometric sensors (e.g., the biometric feature is further The further you move, the greater the increase in the amount of ambiguity).

In some examples, obscuring includes blurring the preview of the image data, and reducing the amount of ambiguity of a portion of the preview of the image data (e.g., by reducing a blur radius or other blur parameter) is a preview of the image data. It involves reducing the amount of haze. In some examples, increasing the amount of ambiguity of the portion of the preview of the image data includes increasing the blur radius or other blur parameter.

Note that the details of the processes described above with respect to method 1000 (eg, FIGS. 10A-10F) are also applicable in a similar manner to the methods described below. For example, method 1000 optionally includes one or more of the characteristics of various methods described below with reference to methods 800, 1200, 1400, 1600, 1800, 2000, 2200, 2400, 2700 do. For example, a registration process as described in method 1200 may be applied in connection with a face registration interface (eg, 954). For another example, hints as described in method 1400 may be applied in connection with a registration progress meter (eg, 940). For another example, accessibility features as described in method 1400 may be applied in place of or in combination with accessibility options (eg, 928-2). For brevity, these details are not repeated below.

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 9A-9I are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, the display operation 1002, the detection operation 1004, the display operation 1006, the highlight operation 1028, and the hold operation 1090, optionally, the event classifier 170, the event recognizer 180 , And the event handler 190. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

Now, an exemplary user interface for registering a biometric feature on an electronic device (e.g., device 100, device 300, device 500, device 700, or device 900), according to some examples. Attention is drawn to FIGS. 11A-11L, which illustrate them. The user interfaces in these figures are used to illustrate the processes described below, including those in FIG. 12.

11A illustrates an electronic device 1100 (eg, portable multifunction device 100, device 300, device 500, device 700, or device 900 ). In the illustrative example illustrated in FIGS. 11A-11L, the electronic device 1100 is a smartphone. In other examples, electronic device 1100 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 1100 has a display 1102, one or more input devices (eg, a touchscreen, a button, a microphone of the display 1102), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 1103) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more biometric sensors 1103 are one or more biometric sensors 703. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

As illustrated in FIG. 11A, device 1100 displays a face registration user interface 1104 on display 1102. In some examples, face registration user interface 1104 is displayed after device 1100 detects successful alignment of the user's face with respect to one or more cameras thereof, as described above with respect to FIGS. 9A-9A. . The face registration interface 1104 includes a user face image 1106. In some examples, the user face image 1106 is an image of the user captured by one or more cameras on the device 1100. For example, the user face image 1106 may optionally be a live image data (e.g., digital viewfinder) captured by one or more cameras that are continuously updated as the camera's field of view and/or the content of the field of view change. It's a preview. In some examples, the background content is removed so that only the user's face is visible in the facial image 1106. The face registration interface also optionally includes an orientation guide 1108 that is overlaid (eg, overlaid) on the user face image 1106. 7I-7K, the orientation guide 1108 optionally extends in a virtual z-dimension (e.g., along an axis perpendicular to the plane of the display) and above the center of the user face image 100. It is a set of intersecting curves. Accordingly, the curves of the orientation guide 1108 appear to be bulging outward with respect to the plane of the display 1102, allowing the user to feel the position of the user's head in a three-dimensional space.

The face registration user interface 1104 also includes a registration progress meter 1110. The registration progress meter 1110 includes a set of display elements (eg, progress elements 1110a, 1110b, 1110c) arranged around a user face image 1106 and orientation guide 1108. In the example of FIG. 11A, the progress elements are a set of lines extending radially outward from the user face image 1106 arranged in a circular pattern. In some examples, the progress elements 1110a, 1110b, 1110c, etc. indicate the orientation of the user's face needed to register the corresponding facial features. For example, the progression elements within the upper portion of the registration meter 1110 are optionally, when the user's head is tilted upward-this causes one or more cameras on the device 1100 to capture image data under the user's face. -Moves, fills, stretches and/or changes color. This process is described in more detail below. In the example of FIG. 9A, device 1110 displays progress elements in registration progress meter 1110 in an unregistered state (eg, the progress elements are grayed out).

Face registration interface 1104 also includes a text prompt 1112 instructing the user to move (eg, rotate and/or tilt) their heads in a circular motion during the registration process. In some examples, text prompt 1112 optionally involves a tactile and/or audible prompt depending on device settings and/or user selections. In some examples, the device 1112 displays a text prompt 1112 on the registration interface 1104 through the facial registration process.

As illustrated in FIG. 11B, the device 1100 detects movement of the user's face relative to its one or more cameras. The movement of the user's face is optionally a rotation and/or tilt motion with respect to the device 1100. In response, the device 1100 continuously updates the user face image 1106 (eg, displays its movement) to reflect the change in the orientation of the user's face. In some examples, the orientation guide 1108 tracks (eg, moves with) the movement of the user's face image 1106 to visually emphasize tilting and rotational movements of the user's face in three dimensions. For example, the center of the orientation guide 1108 (eg, the intersection point) is optionally positioned at a center point on the user's face image 1106 and moves with it. In some examples, device 1100 also adjusts the curvature of the lines including orientation guide 1108 to impart the appearance of a three-dimensional rotation (eg, with respect to an axis perpendicular to display 1100). In some examples, device 1100 emphasizes orientation guide 1108 while it is moving (eg, while the orientation of the user's face is changing). For example, the device 1100 optionally darkens the orientation guide 1108 while it is moving and/or displays a fading trail as it tracks the movement of the user's face. In this case, the device 1100 optionally reduces this emphasis on the orientation guide 1108 compared to the user face image 1106 when the user's face is not moving.

11B, in response to detecting that the user's face is oriented towards the progress meter portion 1114 (e.g., image data captured by the biometric sensor 1103 is an angular view of the user's face). (according to the determination to include an angular view), device 1110 updates the display of progress elements in meter portion 1114 to a “registering” state by changing the appearance of progress elements in meter portion 1114. For example, device 1100 optionally magnifies and/or changes color of progress elements within meter portion 1114 while the user's face is oriented towards meter portion 1114. In some examples, the device 1100 expands the progress scales and changes their color from gray to blue when updating the progress elements to a “registering” state. Changing the display of the progress elements in this way to the "registering" state means that the device 1100 is capturing (e.g., registering) facial imaging data for an angular view corresponding to the current orientation of the user's face. ). In the example of FIG. 11B, device 1100 keeps the progress elements in meter portion 1116 unregistered to indicate that the user has not yet orientated their faces toward meter portion 1116. In some examples, the display of the meter portion 1114 is updated in this manner only when the user's face is sufficiently rotated toward the meter portion 1114 (e.g., when the user's face is rotated at least a threshold amount or a threshold angle). do.

In some examples, the registration progress meter is configured with a set of progress meter portions, such as meter portions 1114 and 1116. In some examples, each progress meter portion includes a predetermined number of progress elements (eg, 3, 5, or 8 progress elements) associated with each portion.

In some examples, as illustrated in FIG. 11C, the device 1110 detects minor rotation and/or tilt of the user's face and updates the digital viewfinder including the user's face graphic 1106. For example, the user's face tilted downward and began to rotate to the right. However, in the example of FIG. 11C, the user's face is still oriented towards the progress meter portion 1114. As a result, the device 1100 continues to display the progressing elements of the meter portion 1114 in the registering state, even if the user starts to rotate and/or tilt their heads downward and to the right. In this case, the device 1100 also maintains a display of the progressing elements proximate the meter portion 1114 because the user's head has not been rotated enough to trigger registration of the corresponding orientations.

As illustrated in FIG. 11D, device 1110 detects that the user's face has been rotated and/or tilted toward meter portion 1118. In the example of FIG. 11D, the user's face continues the movement illustrated in FIG. 11C, tilting downward through its initial position in FIG. 11A and rotating to the right (e.g., the user's face is Move so that it is not oriented towards other parts). In response to detecting a change in facial orientation, the device 1100 moves the orientation guide 1108 to track the movement of the user's face image 1106 in the digital viewfinder. Upon determining that the user's face is oriented towards the meter portion 1118 (e.g., the image data captured by the biometric sensor 1103 includes a second angular view of the user's face), the device 1100 Update the progress elements in meter portion 1118 to the "registering" status described above. For example, device 1100 expands the progress scales within meter portion 1118 and changes their color. In some examples, the device 1100 may only display the meter portion if the corresponding portion of the user's face has not been previously registered (eg, if the progress elements in the meter portion 1118 are “unregistered”, in a grayed state). The display of 1118 is updated. In some examples, the device 1100 may measure the meter regardless of whether a corresponding portion of the user's face has previously been registered (e.g., to provide an additional indication of the orientation of the user's face relative to the biometric sensor 1103). The display of portion 1118 is updated.

In the example of FIG. 11D, the device 1100 also indicates that the user's face is no longer oriented towards the progress meter portion 1114 (since the user's face is currently oriented towards the meter portion 1118). To detect. In response to this, the device 1100 changes the appearance of the progressing elements in the meter portion 1114 again to a “registered” state. In the example of FIG. 11D, the device 1100 updates the display of the progress scales in the portion 1114 from the extended “registering” state by again shortening the progress scales and changing their color. For example, the progress elements in the "registered" state have the same length and/or size as the progress elements in the "unregistered" state, but as described above with respect to FIG. 11B, a corresponding part of the user's face (eg, FIG. The angle view captured in 11b) is displayed in green to indicate that it has been successfully registered.

In the example of FIG. 11D, device 1100 keeps the progress elements in meter portion 1116 unregistered to indicate that the user has not yet orientated their faces toward meter portion 1116.

11E-11H illustrate the face registration interface 1104 as a user rotates and/or tilts their faces in a counterclockwise motion through a series of orientations associated with the right side of the registration progress meter 1110. Starting from the progress meter portion 1118, the device 1100 rotates based on the user's face orientation (e.g., in response to detecting that the user's face is oriented towards the corresponding portion of the progress meter 1110). Progressive elements in the path are sequentially changed to the above-described "registering" state. Once the user's face has been rotated past these progression elements (e.g., in response to detecting that the user's face is no longer oriented towards corresponding portions of the progression meter 1110), the device 1100 The progress elements are updated to the "registered" state to indicate successful registration of the corresponding parts of the face of the. This process is described in more detail below. In some examples, the visual characteristics of the progress elements in the “enrolling” state are based on the speed at which the user's facial orientation changes. For example, when the user's face is rotating at a first speed, the device 1100 corrects the color of the progress elements in the "registering" state in a first manner, and the user's face is slower and/or faster. If it is rotating, the color of these elements is corrected in a second way.

As shown in Fig. 11E, the device 1100 indicates that the user's face has been rotated in a counterclockwise manner relative to the biometric sensor 1103 (e.g., the user's face is upwards relative to its position in Fig. 11D). Rotating and/or tilting to the left). As described above, the device 1100 continuously updates the user face image 1106 to reflect the change in orientation, and the orientation guide 1108 to track the movement of the user face image 1106 in the digital viewfinder. Move. As the user's face is rotated upwards, device 1100 may (e.g., stretch one or more progression elements as described above and/or change its color) one or more progression elements (e.g., by changing its color) within meter portion 1116. , 1116a) is updated to "Registering Status". As illustrated by the location of the user face image 1106 in FIG. 11E, the rotation moves the user's face past an orientation corresponding to one or more progression elements (e.g., 1118a) within the meter portion 1118 (e.g., Move away from him). In response to detecting that the user's face is no longer in this orientation, the device 1100 displays a display of one or more progress elements (including 1118a), described above, to indicate successful registration of these parts. Update to the status. In the example of FIG. 11E, device 1100 maintains one or more elements of progress meter portion 1118 (eg, 1118b) in a “registering” state, which means that the user's face has not yet been rotated out of the corresponding orientation. Because it didn't. Likewise, device 1100 also continues to display one or more progressing elements (eg, 1116b) within meter portion 1116 in an initial “unregistered” state, since the user's face has not yet been positioned in a corresponding orientation. Because.

11F illustrates the face registration interface 1104 as the counterclockwise rotation of the user's face relative to its position in FIG. 11E continues. Again, the device 1100 continuously updates the user face image 1106 to reflect the change in orientation, and moves the orientation guide 1108 to track the movement of the user face image 1106 in the digital viewfinder. As illustrated by the location of the user face image 1106 in FIG. 11F, the rotation moves the user's face in an orientation corresponding to the progress meter portion 1116. In response to detecting the user's face in this orientation, the device 1110 may (e.g., extend one or more progression elements as described above and/or change its color) one or more progression elements within the meter portion 1116. The display of the fields (eg, 1116b) is changed from the "unregistered" state to the "registering" state. As illustrated by the location of the user face image 1106 in FIG. 11F, the rotation also advances the user's face through an orientation corresponding to the remaining elements (e.g., 1118b) of the progress meter portion 1118 (e.g., Move away from him). In response to detecting that the user's face is no longer in this orientation, the device 1100 updates the display of these progress elements (including 1118b) to the “registered” state described above, so that the meter portion 1118b It indicates successful registration of the angular view of the user's face corresponding to. In the example of FIG. 11F, device 1100 also continues to display progress elements in meter portion 1120 in the initial “unregistered” state described above, since the user's face has not yet been positioned in the corresponding orientation. .

11G illustrates the face registration interface 1104 as the counterclockwise rotation of the user's face with respect to its position in FIG. 11F continues. Again, the device 1100 continuously updates the user face image 1106 to reflect the change in orientation, and moves the orientation guide 1108 to track the movement of the user face image 1106 in the digital viewfinder. As illustrated by the location of the user face image 1106 in FIG. 11G, rotation moves the user's face in an orientation corresponding to the progress meter portion 1120. In response to detecting the user's face in this orientation, the device 1110 displays the progression elements within the meter portion 1120 (e.g., by stretching one or more progression elements and/or changing their color as described above). Is changed from the "not registered" state to the "registered" state. As illustrated by the location of the user face image 1106 in FIG. 11G, the rotation also moves the user's face past (eg, away from) the orientation corresponding to the progress meter portion 1116. In response to detecting that the user's face is no longer in this orientation, device 1100 updates the display of the progress elements in meter portion 1116 to a “registered” state, corresponding to meter portion 1116. Represents successful registration of an angular view of the user's face. In the example of FIG. 11G, device 1100 continues to display progress elements in meter portion 1122 in an initial "unregistered" state because the user's face has not yet been positioned in a corresponding orientation.

11H illustrates the face registration interface 1104 when the counterclockwise rotation of the user's face relative to its position in FIG. 11G continues. Again, the device 1100 continuously updates the user face image 1106 to reflect the change in orientation, and moves the orientation guide 1108 to track the movement of the user face image 1106 in the digital viewfinder. As illustrated by the location of the user face image 1106 in FIG. 11H, the rotation moves the user's face in an orientation corresponding to the progress meter portion 1122. In response to detecting the user's face in this orientation, the device 1110 displays the progression elements within the meter portion 1122 (e.g., by stretching one or more progression elements and/or changing their color as described above). Is changed from the "not registered" state to the "registered" state. In some examples, even if the corresponding facial features have already been registered (e.g., to provide an additional indication of the orientation of the user's face relative to the biometric sensor 1703), this orientation causes the device 1100 to , To change the display of one or more progressing elements in the meter portion 1114 from the “registered” state shown in FIGS. 11D-11G back to the “registering” state based on the orientation of the user's face. In this case, the device 1100 returns these elements of the progress meter portion 1114 back to the "registered" state in response to detecting that the user's face is no longer oriented in that direction. As illustrated by the location of the user face image 1106 in FIG. 11H, the rotation also moves the user's face past (eg, away from) the orientation corresponding to the progress meter portion 1120. In response to detecting that the user's face is no longer in this orientation, device 1100 updates the display of the progress elements in meter portion 1120 to a “registered” state, corresponding to meter portion 1120. Represents the successful registration of the angle view of the user's face. In the example of FIG. 11G, the device 1100 initializes the remaining progress elements of the registered meter 1110 (eg, progress elements that are not within the meter portions 1114, 1116, 1118, 1120, or 1122). Continues to display in the "state, because the user's face has not yet been positioned in the corresponding orientation.

Registration and/or scanning of the user's facial features is performed until all elements of the registration progress meter 1110 have transitioned to the registered state (e.g., the image data of all corresponding angle views of the user's face are transferred to the biometric sensor ( 1103)) in this way. For example, registration proceeds until the user's face returns to the orientation corresponding to the meter portion 1118 via counterclockwise rotation.

Displaying and updating the progress indicator during registration in this manner encourages the user to see the display of the device 1100 during registration, detecting when the gaze is facing the display and thus whether the user is paying attention to the device. Improve the ability to do. Encouraging the user to view the display of the device 1100 improves the operability of the device (e.g., by ensuring that the user's gaze is facing the display and thereby ensuring that the user's biometric features are properly registered) and It makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

It should be understood that the examples of FIGS. 11D-11H are merely exemplary. In particular, registration of the user's facial features may begin at any portion of the progress meter 1110 (eg, meter portion 1114). Similarly, angular views of the user's face corresponding to each meter portion or progress element may be registered in any order (eg, via clockwise rotation).

11I illustrates the face registration interface 1104 after image data of all corresponding angle views of the user's face has been captured by the biometric sensor 1103. In the example of FIG. 11I, device 1100 has transitioned the display of all progress elements in registration meter 1110 to a "registered" state (eg, during the registration process described above with respect to FIGS. 11B-11H ). For example, the device 1100 changes the color of the progress element to green to indicate successful registration. In the example of FIG. 11I, device 1100 displays a text prompt 1124 indicating that the first scan of the user's facial features is complete. In some examples, device 1110 issues an audio and/or tactile notification 1126 to provide additional indication that the first scan is complete. In some examples, the audio and/or tactile output indicating successful registration of the user's facial features is the same as the audio and/or tactile output used to indicate successful facial authentication at device 1100. In the example of FIG. 11I, device 1100 continues to display user face image 1106. In some examples, the user face image 1106 is still part of the digital viewfinder's live preview. In other examples, device 1100 displays a single (eg, stationary) user image captured during the registration process. In the example of FIG. 11I, device 1100 stops displaying orientation guide 1108 once the scan is complete.

11J and 11K, in some examples, the device 1100 displays an animation that transitions the display of the registration progress meter 1110 to the success state meter 1128 shown in FIG. 11K. For example, the device 1100 reduces the length of each progress tick mark as illustrated in FIG. 11J and merges the display of previous individual progress elements into a continuous circle. In the example of FIG. 11K, after displaying the animation, the device 1100 displays the scan completion interface 1130. The scan completion interface 1130 includes a user face image 1132 and a success status meter 1128. In the example of FIG. 11K, user face image 1132 is blurred, faded, darkened, or otherwise obscured to indicate that additional image data is no longer being collected as part of the face scan. In some examples, the success status meter 1128 is a solid, continuous green circle surrounding the user face image 1132 that provides a visual indication that the first scan is complete. To provide additional visual notification, scan completion interface 1130 also includes a text prompt 1134 (eg, a completion message). The scan completion interface 1130 also includes a continuation affordance 1136. In some examples, while displaying registration complete interface 1130, device 1100 detects (eg, through user input 1137) activation (eg, selection) of continue affordance 1136. In some examples where the display is touch sensitive, the user input 1337 is substantially a tap, swipe or other gesture on the display surface for continuation affordance 1136. In other examples, activation of continue affordance 1136 is activation of affordance by a focus selector (eg, a mouse cursor) or keyboard input.

In some examples, after completion of the registration process described above with respect to FIGS. 11B-11G, a second iteration of face registration is performed. As shown in FIG. 11L, in response to detecting activation of continuation affordance 1136, device 1100 displays second face registration interface 1138. In the example of FIG. 11L, the second face registration indicator includes a second user face image 1140 and a second registration progress meter 1142. In some examples, second user face image 1140 is a representation of the field of view of biometric sensor 1103 with visual processing similar to user face image 1106 (e.g., second user face image 1140 is a digital view). It is a live preview of image data captured by biometric sensor 1103 displayed as a finder). In some examples, device 1100 displays a second orientation guide 1144 overlaid on (eg, overlaid on) the second user face image 1140. In the example of FIG. 11L, the second orientation guide 1144 has a visual treatment similar to that of the orientation guide 1108 (e.g., the second orientation guide 1144 extends out of the plane of the display 1102 in a virtual z dimension. Includes a number of visible curves). In some examples, the second registration progress meter 1142 is comprised of a set of progress elements (eg, 1142a, 1142b, 1142c) spaced around the second user face image 1140. In some examples, portions of the second enrollment progress meter 1142 (e.g., meter portions 1146, 1148) may optionally include specific orientations or portions of the user's face relative to the biometric sensor 1103. Corresponds to In some examples, some or all of the meter portions optionally include a greater number of progress elements than respective portions of the registration progress meter 1110. As an example, each portion of the second progress meter 1142 corresponds to a facial orientation or angular view of the user's face, which is the same as the corresponding portions of the progress meter 1140 (e.g., meter portion 1146 is It corresponds to the same facial orientation as the meter portion 1114 in FIGS. 11B-11H). In some examples, upon display of the second registration interface 1138, the device 1100 sets the visual state of the progress elements in the registration progress meter 1142 to the “unregistered” state described above (e.g., the first registration scan The registration progress from is reset). In the example of FIG. 11L, the second face registration interface also includes a text prompt 1150 instructing the user to move (eg, rotate and/or tilt) their heads in a circular motion during the second registration process. .

In some examples, as the second repetition of face registration is performed, the device 1110 is in response to a change in the orientation of the user's face with respect to the biometric sensor 1103, the second user face image 1140 and the second Updates the display of progress meter 1142 and orientation guide 1144. For example, the user repeats the motion of his or her face, the same (or similar) that was performed in the registration of the first iteration, and the device 1100 is in the manner described above with respect to FIGS. 11B-11H ( Or in a similar manner) to update the display of these elements of the second user interface 1138.

11M illustrates the second face registration interface 1128 after the registration of the second iteration is complete (e.g., after image data of various angle views of the user's face is captured by the biometric sensor 1103). . In the example of FIG. 11M, device 1100 has transitioned the display of all progress elements in second registration meter 1142 to the “registered” state described above. For example, the color of each progress element was changed to green to indicate successful registration. In the example of FIG. 11M, device 1100 displays a text prompt 1152 indicating that a second scan of the user's facial features is complete. In some examples, device 1110 issues audio and/or tactile notification 1154 to provide additional indication that the second scan is complete. In some examples, the audio and/or tactile notification 1154 is the same as the tactile notification 1126 issued to indicate the completion of the first scan. In some examples, the audio and/or tactile output indicating a successful second scan of the user's facial features is the same as the audio and/or tactile output used to indicate successful facial authentication at the device. In the example of FIG. 11M, the device 1100 continues to display the second user face image 1140. In some examples, the second user face image 1140 is part of a live preview of the digital viewfinder. In other examples, device 1100 displays a single (eg, stationary) user image captured during the registration process. In the example of FIG. 11M, the device 1100 stops displaying the second orientation guide 1144 once the scan is complete.

In the example of FIG. 11N, after issuing a notification indicating the completion of the second scan, the device 1100 displays the second scan completion interface 1156. The second scan completion interface 1156 includes a user face image 1158 and a second success status meter 1160. In the example of FIG. 11N, user face image 1158 is blurred, faded, darkened, or otherwise obscured to indicate that additional image data is no longer being collected as part of the second face scan. In some examples, the second success status meter 1160 is a solid line surrounding the user face image 1158 that provides a visual indication that the first scan is complete (e.g., similar to the success status meter 1128). , It is a continuous green circle. To provide additional visual notification, the second scan complete interface 1156 also includes a text prompt 1162 (eg, a second scan complete message). The second scan completion interface 1156 also includes a continuation affordance 1164. In some examples, while displaying the second scan complete interface 1156, the device 1100 detects (eg, through user input 1165) activation (eg, selection) of the continue affordance 1164. In some examples where display 1102 is touch-sensitive, the activation is substantially a tap, swipe, or other gesture on the display surface for continuation affordance 1164. In other examples, activation of continue affordance 1164 is activation of affordance by a focus selector (eg, a mouse cursor) or keyboard input. In the example of FIG. 11N, the user face image 1158 is blurred, faded, darkened or otherwise obscured to indicate that additional image data is no longer being collected during the second face scan.

In the example of FIG. 11O, in response to detecting activation of the affordance 1164 to continue, the device 1100 displays the registration complete interface 1166. As shown in FIG. 11O, the registration completion interface 1166 includes a biometric authentication glyph 1168. For example, the biometric authentication glyph is optionally a line drawing of all or part of a face (eg, a stylized face graphic). In the example of FIG. 11O, registration complete interface 1166 also includes a text prompt 1170 indicating that the registration process is complete and facial authentication at the device is set up and/or enabled. In some examples, the registration completion interface 1166 also includes a completion affordance 1172, which activation causes the device 1100 to terminate facial authentication setup. In some examples, the registration complete interface 1166 does not include a face image 1158.

12A and 12B are flow charts illustrating a method for registering biometric features of a user on an electronic device, in accordance with some examples. The method 1200 includes a device having a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 1100). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 1200 provides an intuitive method for registering biometric features of a user on an electronic device. This method reduces the user's cognitive burden for registering biometric features on the device, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to register biometric features faster and more efficiently saves power and increases the time between battery charges.

The device displays 1202 a biometric registration interface (eg, 1104) on the display. Displaying the biometric registration interface includes (1204) displaying a representation of the biometric feature (eg, 1106). For example, the representation of a biometric feature can optionally be used to distinguish one person in the field of view of one or more cameras of the device from another person, a face, fingerprint, iris, handprint, or other physical A representation of the biometric feature (eg, a representation of the user's head of the device). The representation of the biometric feature includes a user's head positioned in the field of view of one or more of the cameras based on the alignment of the biometric feature with respect to one or more biometric sensors (e.g., 1103) of the device. Has an orientation that is determined based on the camera data.

In some examples, the device displays 1206 a digital viewfinder (eg, a live preview of image data including 1106) that includes a representation of the field of view of one or more cameras (eg, 1103). For example, in some examples, the device displays a live preview of image data captured by one or more cameras. In some examples, the representation of the field of view of one or more cameras has background content removed. The background is optionally determined based on depth information captured by one or more cameras (e.g., removing background content optionally includes removing any background or simply vignetting) . In some examples, the device does not perform any background removal.

Displaying the biometric registration interface also includes a first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122, a first position on the display for a representation of the biometric feature (e.g., 1106)). A first set of objects (e.g., 1110a, 1110b and 1110c, or 1116a and 1116b, or 1118a and 1118b) spaced around the representation of the biometric feature, such as one set of tick marks, and a representation of the biometric feature. A second progress indicator portion at a second location on the display for (e.g., 1106) (e.g., 1114, 1116, 1118, 1120, or 1122, around the representation of the biometric feature, such as a second set of tick marks. And simultaneously displaying 1208 a progress indicator (e.g., 1110) comprising a second set of spaced apart objects (e.g., 1110a, 1110b and 1110c, or 1116a and 1116b, or 1118a and 1118b). . A representation of the biometric feature (eg, 1106) is displayed between the first and second locations on the display. Displaying a progress indicator during registration in this manner encourages the user to see the display of the electronic device during registration, improving the ability to detect when the gaze is facing the display and, accordingly, whether the user is paying attention to the device. Let it. Encouraging the user to see the display of the electronic device improves the operability of the device and improves the user- It makes the device interface more efficient, which, in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the progress indicator is a plurality of progress indicator portions (e.g., 1114, 1116, 1118, 1120, 1122, each progress indicator portion is one or more progress elements (e.g., 1110a, 1110b, 1110c, 1116a, 1116b, 1118a, and 1118b) (1210). In some examples, the plurality of progress indicator portions include a first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) and a second progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122), and the plurality of progress indicator portions surround at least a portion of the representation (eg, 1106) of the biometric feature. In some examples, one or more of the plurality of progress indicator portions includes a plurality of respective progress elements (eg, 1110a, 1110b, 1110c, 1118a, 1118b) (1212). In some examples, the progress indicator optionally includes a set of one or more display elements (e.g., 1110a, 1110b, 1110c, 1116a, 1116b, 1118a, 1118b) arranged around a representation (e.g., 1106) of the biometric feature. do. For example, these display elements are optionally a circle of radially extending lines ("scales") representing the progression of registration lines around the user's face. These lines optionally indicate a direction in which each change in orientation of the biometric feature is sufficient for registration of the biometric feature (eg, even though the bottom of the biometric feature is being scanned, it is directed upward to move the upper lines). In some examples, the first set of lines corresponds to a first progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122), and the second set of lines corresponds to a second progress indicator portion (eg, 1114 , 1116, 1118, 1120, or 1122). For example, a predetermined number (eg, 8) of tick marks are associated with each portion of the progress indicator.

In some examples, the first progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122) is such that the biometric feature (eg, the user's face) is the first progress indicator portion (eg, 1114, 1116). , 1118, 1120, or 1122) indicates the registration status of the first portion of the biometric feature detected (eg, visible to him) by one or more biometric sensors (eg, 1103) (1214). . For example, the upper right portion of the progress indicator (eg, 1120) changes appearance when the user's face is turned to the upper right portion of the device to register the lower left portion of the user's face. Likewise, in some examples, the second progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) is such that the biometric feature (e.g., the user's face) is the first progress indicator portion (e.g., 1114). , Different from the first portion of the biometric feature, detected (eg, visible to him) by one or more biometric sensors (eg, 1103) when turned towards 1116, 1118, 1120, or 1122. Indicate the registration status of the second part of the measurement feature. For example, the lower right portion of the progress indicator (eg, 1118) changes appearance when the user's face is rotated to the lower left portion of the device to register the upper right portion of the user's face.

In some examples, displaying 1202 the biometric registration interface (eg, 1104) further includes displaying a prompt (eg, 1112) to move the biometric feature. In some examples, the displayed prompt optionally involves a tactile and/or audible prompt. In some examples, types of responses are provided based on settings of the electronic device and/or controlled manually by the user. Providing a prompt with instructions on how to properly move the biometric features reduces the time required to complete the registration process by providing the user with feedback that allows them to quickly recognize and execute the required movements. . Thus, providing an improved visual prompt regarding the appropriate inputs required for biometric registration (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) ) It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device displays a prompt (eg, 1108) indicating the direction of movement. In some examples, the prompt is an orientation guide (eg, 1108) overlaid on a biometric registration interface (eg, 1104). In some examples, the prompt is overlaid on the representation of the biometric feature (eg, 1106). In some examples, the device overlays a three-dimensional object (eg, 1108) on a representation (eg, 1106) of the biometric feature. For example, the three-dimensional object is optionally an arc that moves as the user's head is rotated and extends to a virtual z-dimension. In some examples, the three-dimensional object (eg, 1108) includes a plurality of arcs (eg, two arcs intersecting each other at a point in front of the user's face) extending in a virtual z-dimension. In some examples, a three-dimensional object (e.g., 1108) is highlighted when the user is moving (e.g., the three-dimensional object darkens as it moves with movement of a biometric feature or displays a fading trail), which It emphasizes the 3D object when it is moving, and reduces the emphasis on the 3D object compared to the representation of the biometric feature when the biometric feature is not moving.

While simultaneously displaying a representation of the biometric feature (eg, 1106) and a progress indicator (eg, 1110), the device detects a change in the orientation of the biometric feature relative to one or more biometric sensors (eg, 1103). (1216).

In some examples, in response to detecting a change in the orientation of the biometric feature relative to the one or more biometric sensors (1218), the device Rotate the prompt (eg, 1108) according to the change. In some examples, rotating the prompt includes rotating the three-dimensional object (eg, 1108), at least in part, to the virtual z-dimension of the display. Rotating the orientation guide overlaid on the representation of the biometric feature provides feedback to the user regarding the orientation of his or her biometric features relative to the device's biometric sensors in a three-dimensional space, allowing the user to It makes it possible to more quickly place his or her biometric features through the required orientation range during the registration process. Hence, providing the user with improved visual feedback regarding the orientation of the biometric feature is the ability of the device (e.g., by helping the user to provide appropriate inputs when operating and/interacting with the device and reducing user errors) It improves operability and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, in response to detecting a change in the orientation of the biometric feature relative to the one or more biometric sensors, the device is based on a change in the orientation of the biometric feature relative to the one or more biometric sensors (e.g., 1103). The representation of the biometric feature (e.g., 1106) is updated (1220). For example, in some examples, the orientation of the representation of the biometric feature (eg, 1106) is changed irrespective of whether the registration criteria are met. In some examples, the orientation of the representation of the biometric feature (eg, 1106) is changed only if the registration criteria are met. Updating the orientation of the displayed representation of the biometric feature provides feedback to the user regarding the orientation of his or her biometric features relative to the device's biometric sensors, thereby providing the user with the desired orientation range during the registration process. Allows the biometric features to be moved more quickly Hence, providing the user with improved visual feedback regarding the orientation of the biometric feature is the ability of the device (e.g., by helping the user to provide appropriate inputs when operating and/interacting with the device and reducing user errors) It improves operability and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

Upon determination that the change in orientation of the biometric feature satisfies the registration criteria for the first portion of the biometric feature corresponding to the first progress indicator portion (e.g., 1114, 1116, 1118), the device indicates a first progression. One or more visual characteristics of the ruler part are updated (1222). For example, determining a change in the orientation of the biometric feature that meets the registration criteria can optionally cause the image data to be at a first perspective angle (e.g., when the user's face is tilted upwards). Based on determining to include data corresponding to the first angular view of the user's face from the bottom perspective. Updating the visual state of the portion of the progress meter corresponding to the current orientation of the biometric feature allows the user to recognize that the portion of the biometric feature is properly oriented for registration. This in turn indicates to the user how to change the orientation of the biometric feature to register different parts corresponding to the different respective parts of the progress meter, reducing the time required to complete the registration process. Thus, providing the user with improved visual feedback regarding the registration status of the biometric feature is a device (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors). It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the registration criteria for the first portion of the biometric feature corresponding to the first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) are determined by the first portion of the biometric feature being predetermined. And a requirement to be oriented relative to one or more biometric sensors (eg, 1103) in a manner (eg, the user's face is looking towards the first progress indicator portion).

In some examples, the registration criteria for the first portion of the biometric feature corresponding to the first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) are not registered with the first portion of the biometric feature. Includes the requirement that not.

In some examples, the registration criteria for the first portion of the biometric feature corresponding to the first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122), wherein the first portion of the biometric feature is one or more. Includes (1224) a requirement that the orientation is changed (eg, rotated) by at least a threshold amount for biometric sensors (eg, 1103). In some examples, registration of the first portion of the biometric feature causes the biometric feature to move (rotate) to a sufficient degree to allow the first portion to be properly captured by one or more biometric sensors (e.g., 1103). Demands.

In some examples, updating one or more visual characteristics of the first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) is in a first manner based on the registration state of the first portion of the biometric feature. Updating one or more visual characteristics of the (e.g., color) first progress indicator portion, and in a second manner based on alignment of the biometric features to one or more biometric sensors (e.g., 1103) of the device (e.g. , Updating the size or length of the progress elements) one or more visual characteristics of the first progress indicator portion. For example, when a portion of the biometric feature corresponding to the first progress indicator portion is registered, the first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) changes from black to green, and One or more lines corresponding to the first progress indicator portion (e.g., 1110a, 1110b, 1110c) when a portion of the biometric feature corresponding to the one progress indicator portion faces one or more biometric sensors (e.g., 1103). , 1116a, 1116b, 1118a, 1118b) are elongated. In some examples, updating one or more visual characteristics of the first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) in a second manner is performed by the one or more biometric sensors (e.g., 1103). The orientation of the biometric features for is based on the direction of change. In some examples, updating in the second manner is, additionally or alternatively, performed based on a rate of change in the orientation of the biometric feature relative to the one or more biometric sensors. Changing the portion of the progress meter corresponding to the current orientation of the biometric feature from the first visual state to the second visual state allows the user to quickly recognize that the portion of the biometric feature is properly oriented for registration. This can then indicate to the user how to change the orientation of the biometric features to register different parts corresponding to the different respective parts of the progress meter, which reduces the time required to complete the registration process. Thus, providing the user with improved visual feedback regarding the registration status of the biometric feature is a device (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors). It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device is based on the rate of change in the orientation of the biometric feature relative to one or more biometric sensors (e.g., 1103) of the first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122). Update one or more visual characteristics. In some examples, updating one or more visual characteristics in this manner includes modifying the color of the first progress indicator portion based on a rate of change in the orientation of the biometric feature.

In some examples, the first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) is a plurality of display elements (e.g., 1110a, 1110b, 1110c, 1114a, 1116a, 1116b, 1118a) in each order. , 1118b). Upon determining that the change in orientation of the biometric feature relative to one or more biometric sensors (e.g., 1103) is a change in a first direction (e.g., clockwise rotation), the device optionally selects the first end of each sequence. Starting from (e.g., starting at 1118a) changes the appearance of the display elements. For example, the device optionally starts stretching lines in the first progress indicator portion starting from the first side of each sequence and moving to the second side of each sequence (to 1114a). Upon determining that the change in orientation of the biometric feature relative to one or more biometric sensors is a change in a second direction (e.g., counterclockwise rotation), the device optionally is different from the first end of each sequence, Starting from the second end of each sequence (e.g., starting from 1114a) changes the appearance of the display elements (e.g., 1110a, 1110b, 1110c, 1114a, 1116a, 1116b, 1118a, 1118b). For example, the device selectively extends lines in the first progress indicator portion starting from the second side of each sequence and moving to the first side of each sequence (eg, to 1118a). In some examples, a similar approach is taken when changing the appearance of the second progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122) or other progress indicator portions.

In some examples, the device transmits one or more visual characteristics of the first progress indicator (eg, 1114, 1116, 1118, 1120, or 1122) from the first state (eg, “unregistered”), the first progress indicator portion It updates to a second status (eg, "Registering") indicating that registration criteria are met. For example, the device may include display elements within a portion of the progress indicator to which the biometric feature is currently oriented (e.g., 1114), e.g., the portion of the progress indicator that the user's face is facing (e.g., orientation of 1106 in FIG. Enlarge, grow, or change its color.

In some examples, after updating one or more visual characteristics of the first progress indicator portion, the device optionally includes a biometric feature in the first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122). A change in the orientation of the biometric feature with respect to the one or more biometric sensors is detected such that registration criteria for the first portion of the corresponding biometric feature are no longer met. In response to detecting a change in the orientation of the biometric feature with respect to the one or more biometric sensors, the device optionally sets one or more visual properties of the first progress indicator portion to a second state (eg, “registering”). From, update 1226 to a third state (eg, “registered”) indicating that the first portion of the biometric feature has been registered but no longer meets the registration criteria. For example, the device optionally changes the appearance (e.g., color or size) of the progress indicators again as the user's face moves away from them, and optionally, changes the first portion of the progress indicator (e.g., 1114a). , When the user orients the biometric feature away from that portion of the progress indicator (eg, orientation of 1106 in FIG. 11D) transitions from the “tilted” appearance to the registered appearance. One visual characteristic (e.g., color) of the progress indicator optionally indicates the status of registration (e.g., blue for "tilted", green for "registered", gray for "unregistered"), and Another visual characteristic (eg, the length of the lines) indicates the orientation direction of the biometric feature. Progress optionally advances around a progress indicator (eg, 1110) based on the speed and direction of the change in tilt. For example, progress indicator lines (e.g., 1110a, 1110b, 1110c, 1114a, 1116a, 1116b, 1118a, 1118b) are optionally bulging and/or bulging based on the speed and direction of movement of the biometric feature. Changes the color based on the speed and direction of movement of the measurement feature. Changing the portion of the progress meter corresponding to the current orientation of the biometric feature from the second visual state to a third visual state allows the user to quickly recognize that the portion of the biometric feature has been successfully registered. This also indicates to the user that they no longer need to move the biometric feature to its orientation during the registration process, which draws the user's attention to registering other parts of the biometric feature, which is necessary to complete the registration process. Reduce time. Thus, providing the user with improved visual feedback regarding the registration status of the biometric feature is a device (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors). It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

Depending on the determination that the change in orientation of the biometric feature satisfies the registration criteria for the second portion of the biometric feature corresponding to the second progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122), the device Updates one or more visual characteristics of the second progress indicator portion (1228). For example, determining a change in the orientation of the biometric feature that meets the registration criteria may optionally allow the image data to be converted to a second different perspective (e.g., when the user's face is tilted to the right). Based on determining to include data from the user's face corresponding to a second different angle view of the user's face from ). In some examples, updating the visual characteristics of the second progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) is optionally described above with respect to updating the visual characteristics of the first progress indicator portion. Includes some or all of the steps. Updating the visual state of the second portion of the progress meter corresponding to the current orientation of the biometric feature allows the user to recognize that the second portion of the biometric feature is properly oriented for registration. This in turn indicates to the user how to change the orientation of the biometric feature to register different parts corresponding to the different respective parts of the progress meter, reducing the time required to complete the registration process. Thus, providing the user with improved visual feedback regarding the registration status of the biometric feature is a device (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors). It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, upon determining that registration completion criteria are met (e.g., all portions of the biometric feature have been registered, 1110 in Figure 11E), the device indicates that registration of the biometric feature is complete (e.g., 1124, 1126). ) Is displayed.

For example, the device selectively updates one or more visual characteristics of the progress indicator (e.g., 1110) (e.g., a plurality of progress indicator display elements (e.g., 1110a, 1110b, 1110c, 1114a, 1116a, 1116b, 1118a, 1118b) merge into a continuous shape such as a circle). In some examples, prior to detecting a change in orientation of the biometric feature relative to one or more biometric sensors, a first progress indicator portion (e.g., 1114, 1116, 1118, 1120, or 1122) and a second progress indicator Portions (eg, 1114, 1116, 1118, 1120, or 1122) are visually distinct. In this case, updating the one or more visual characteristics of the progress indicator includes visually merging the first progress indicator portion and the second progress indicator portion.

In some examples, the device modifies the representation of the biometric feature (eg, 1106, 1132). In some examples, the representation of the biometric feature is blurred and/or faded and/or darkened to indicate that additional information about the biometric feature is no longer being collected as part of the registration process, Otherwise it becomes ambiguous.

In some examples, the device displays a confirmation affordance (eg, 1136, 1164), and selection of the confirmation affordance causes the electronic device to display a completion interface (eg, 1166). In some examples, the device displays a simulation (eg, 1168) of the representation of the biometric feature. In some examples, the simulation of the representation of the biometric feature is two-dimensional. In some examples, the simulation of the representation of the biometric feature is three-dimensional.

In some examples, the device outputs an indication (eg, 1126, 1154, 1122, 1162, 1170) (eg, a tactile output) that the registration procedure is complete. In some examples, the device outputs a tactile output (eg, 1126, 1154) indicating successful registration of the biometric feature. In some examples, the tactile output indicating successful registration of the biometric feature is the same as the tactile output used to indicate successful authentication by the biometric feature.

In some examples, after outputting an indication that registration of the biometric feature is complete, the device displays a second biometric registration interface (eg, 1138). In some examples, after completion of the first registration, a second iteration of registration is performed. Registration of this second iteration is optionally performed in response to selection of affordance (eg, 1136). Performing a second scan of the user's biometric features causes the device to capture additional biometric data corresponding to different orientations or locations of the biometric features that may not have been recorded during the registration of the first iteration. . Thus, performing a second scan of the user's biometric features allows for more efficient and/or secure biometric authentication at the device (e.g., when operating the device and/or interacting with the user). It improves the operability of the device and makes the user-device interface more efficient (by helping to provide inputs and reducing user mistakes), which in addition to the power of the device by enabling the user to use the device more quickly and efficiently. Reduces usage and improves battery life.

In the second biometric registration interface, the device displays a second representation 1140 of the biometric features. The second representation of the biometric feature optionally has an orientation determined based on the alignment of the biometric feature with respect to one or more biometric sensors (eg, 1103) of the device. In some examples, the second representation of the biometric feature is a representation of the field of view of one or more cameras with visual processing similar to the first representation of the biometric feature (eg, 1106).

In the second biometric registration interface, the device comprises a third progress indicator portion at a first location on the display (e.g., 1146) for a representation of the second biometric feature (e.g., 1140). A first set of objects spaced apart from each other), and a fourth progress indicator portion at a second location on the display (e.g., 1148) for a second representation of the biometric feature (e.g., 1140) A second progress indicator (eg, 1142) including a second set of objects spaced around it is simultaneously displayed. The second representation of the biometric feature is displayed between the third and fourth locations on the display. In some examples, the third progress indicator portion corresponds to a portion of the biometric feature, which is the same as the first progress indicator portion (eg, 1114). In some examples, the fourth progress indicator portion corresponds to a portion of the biometric feature, which is the same as the second progress indicator portion (eg, 1118).

In some examples, the registration status of the first progress indicator portion (eg, 1114, 1116, 1118, 1120 or 1122) does not correspond to the registration status of the third progress indicator portion (eg, 1146 or 1148).

In some examples, the first progress indicator portion of the progress indicator includes a first number of progress elements (e.g., 1114a), and the third progress indicator portion of the second progress indicator is different from the first number (eg , Greater than that) a second number of progress elements (eg, 1142a, 1142b, 1142c). In some examples, the plurality (or all) of the progress indicator portions (eg, 1146, 1148) in the second progress indicator (eg, 1142) is a corresponding progress indicator in the first progress indicator (eg, 1110). It contains more progress elements than portions (eg, 1114, 1118).

In some examples, while simultaneously displaying a second representation (e.g., 1140) and a second progress indicator (e.g., 1142) of the biometric feature, the device A second change in orientation of the feature is detected. In response to detecting a second change in orientation of the biometric feature with respect to one or more biometric sensors, and upon determining that the change in orientation of the biometric feature meets registration criteria for the first portion of the biometric feature. , The device updates one or more visual characteristics of the third progress indicator portion (eg, 1146 or 1148). Upon determining that the change in orientation of the biometric feature meets the registration criteria for the second portion of the biometric feature, the device updates one or more visual properties of the fourth progress indicator portion (eg, 1146 or 1148). For example, to advance through the second registration step of the registration process, the user may register changes in the orientation of the biometric features that were used to register the biometric features in the first registration step of the registration process. Repeat in step. Thus, updating the visual characteristics of the third and fourth progress indicator portions may optionally be those described above with respect to the first and second progress indicator portions (e.g., 1114, 1116, 1118, 1120 or 1122). And similar steps.

In some examples, after detecting a second change in orientation of the biometric feature with respect to one or more biometric sensors (e.g., 1103), and upon a determination that the second set of registration completion criteria are met (e.g., biometric All parts of the feature have been registered), and the device outputs a second indication (eg, 1162, 1163) that registration of the biometric feature is complete. In some examples, registration does not actually occur; Rather, the process is visually emulated. In some examples, the second indication is a visual, audible, and/or tactile output (eg, 1163) indicating that registration of the biometric feature is complete. In some examples, the second indication is the same as the indication (eg, 1126) provided in response to a determination that the first set of registration completion criteria are met.

It is noted that the details of the processes described above with respect to method 1200 (eg, FIGS. 12A and 12B) are also applicable in a similar manner to the methods described herein. For example, method 1200 optionally incorporates one or more of the characteristics of the various methods described herein with reference to methods 800, 1000, 1400, 1600, 1800, 2000, 2200, 2500, 2700. Include. For example, a face registration confirmation interface as described in method 1000 may be applied in connection with a face registration user interface (eg, 1104). For another example, hints as described in method 1400 may be applied in connection with a face registration user interface (eg, 1104). For another example, transitioning a progress meter as described in method 800 may be applied in connection with a registration progress meter (eg, 1110). For brevity, these details are not repeated below.

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 12A and 12B are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, display operation 1202, display operation 1208, detection operation 1216, update operation 1222, and update operation 1224, optionally, event classifier 170, event recognizer 180 , And the event handler 190. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

13A-13R are on an electronic device (e.g., device 100, device 300, device 500, device 700, device 900, or device 1100), according to some examples. Illustrates exemplary user interfaces for registering a biometric feature. The user interfaces in these figures are used to illustrate the processes described below, including those in FIG. 14.

13A illustrates an electronic device 1300 (eg, portable multifunction device 100, device 300, device 500, device 700, device 900, or device 1100 ). In the illustrative example illustrated in FIGS. 13A-13R, the electronic device 1300 is a smartphone. In other examples, electronic device 1300 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). Electronic device 1300 has a display 1302, one or more input devices (eg, a touchscreen, buttons, microphone of display 1302), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 903) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more biometric sensors 1303 are one or more biometric sensors 703. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

As illustrated in FIG. 13A, device 1300 displays a face registration user interface 1304 on display 1302. In some examples, face registration user interface 1304 is displayed after device 1300 detects successful alignment of the user's face with respect to one or more cameras thereof, as described above with respect to FIGS. 9A-9Y. . In some examples, face registration interface 1304 has visual characteristics similar to face registration interface 1104 described above with respect to FIG. 11A. The face registration interface 1304 includes a user face image 1306. In some examples, the user face image 1306 is an image of the user captured by one or more cameras on the device 1300 (eg, biometric sensor 1303 ). For example, user face image 1306 may optionally be a live image data (e.g., digital viewfinder) captured by one or more cameras that are continuously updated as the camera's field of view and/or the content of the field of view change. It's a preview. In some examples, the background content is removed so that only the user's face is visible in the facial image 1306. The face registration interface 1304 also includes an orientation guide 1308 that is overlaid (eg, overlaid) on the user face image 1106. 7I-7K, the orientation guide 1308 optionally extends in a virtual z-dimension (e.g., along an axis perpendicular to the plane of the display) and above the center of the user face image 1306. It is a set of intersecting curves (eg, crosshairs). Accordingly, the curves of the orientation guide 1308 optionally appear to be bulging outward with respect to the plane of the display 1302, allowing the user to feel the position of the user's head in the three-dimensional space.

The face registration user interface 1304 includes a registration progress meter 1310. The registration progress meter 1310 includes a set of display elements (eg, progress elements 1310a, 1310b, 1310c) arranged around a user face image 1306 and orientation guide 1308. In the example of FIG. 13A, the progress elements are a set of lines arranged in a circular pattern and extending radially outward from the user face image 1306. In some examples, the progress elements 1310a, 1310b, 1310c, etc. indicate the orientation of the user's face needed to register the corresponding facial features. For example, the progression elements in the upper portion of the registration meter 1310 are optionally, when the user's head is tilted upward-this causes one or more cameras on the device 1300 to capture image data under the user's face. Ham-move (eg, in the manner of FIGS. 11B-11H) and/or fill and/or stretch and/or change color. In the example of FIG. 13A, device 1310 displays progress elements in registration progress meter 1310 in an unregistered state (eg, the progress elements are grayed out).

In the example of FIG. 13A, the face registration interface 1304 instructs the device to begin moving their faces to the device to advance the registration progress meter 1310 (eg, to register their facial features). Includes a text prompt 1312. In some examples, device 1300 displays text prompt 1312 before any portion of the user's face is registered.

While displaying facial registration interface 1304, device 1300 detects criteria (eg, hints) for displaying registration prompts. In some examples, the registration prompt criteria include a requirement that the user's face has moved below a first threshold amount in a predetermined time period, as determined by biometric sensor 1303.

In some examples, in response to detecting that these registration hint criteria are met, device 1300 displays audio hint enabling interface 1314 as shown in FIGS. 13B and 13C. In the example of FIG. 13B, the hint enabling interface 1314 includes a text prompt 1316 that informs the user of an option to enable or disable audio hints. Thus, in some examples, the hint enabling interface 1314 includes a YES affordance 1318 and a NO affordance 1320. In some examples, in response to activation (e.g., selection) of the no affordance 1320, the device 1300 again displays the face registration interface 1304 so that the user is without prompts and/or hints described below. Proceed with registration of his or her facial features. However, in the example of FIG. 13C, device 1300 detects activation (eg, selection) of example affordance 1310. In some examples, the activation is a user input (eg, a tap or swipe gesture) at the contact area 1322.

In response to detecting activation of the example affordance 1320, the device 1300 displays a hint-enabled registration interface 1324, as illustrated in the example of FIG. 13D, for example. In some examples, hint-enabled registration interface 1324 or one or more of the prompts described below, whether the user has enabled audio hints or not (e.g., that the user's face has not moved sufficiently in a predetermined period In response to detecting it). In the example of FIG. 13D, the hint-enabled registration interface 1324 includes a user face image 1326 having similar or identical visual characteristics to the user face image 1306. For example, in some examples, user face image 1326 is an image of a user captured by one or more cameras on device 1300 (eg, biometric sensor 1303 ). For example, user face image 1326 is optionally image data captured by biometric sensor 1303 (e.g., digital viewfinder) that is continuously updated as the camera's field of view and/or content of the field of view changes. This is a live preview of In some examples, the hint-enabled registration interface 1324 includes a visual movement prompt 1328 that is selectively overlaid (eg, superimposed) on the user face image 1326. In the example of FIG. 13D, the visual movement prompt 1328 requires the user to move (e.g., rotate and/or tilt) his or her face to register a corresponding portion of the face (e.g., an angle view). It contains an arrow element indicating the requested direction. In some examples, the visual movement prompt 1328 is partially transparent so that the lower user face image 1326 is also visible. In the example of FIG. 13D, the arrow element of the visual movement prompt 1328 gives the user their faces to the right (e.g., towards the right portion of the registration progress meter 1330 to register an angular view of the left side of the user's face. ) To move (e.g., rotate, tilt or turn).

In some examples, the device 1300 displays a text prompt 1332 that provides the user with written instructions that match the visual navigation prompt 1328. In the example of FIG. 13D, text prompt 1332 provides a written instruction to the user to turn their heads to the right (eg, in the same direction indicated by the arrow elements in visual prompt 1328). In some examples, device 1300 also issues audio output 1334 corresponding to visual navigation prompt 1328 and/or text prompt 1328. For example, when the screen reader function is enabled, the audio output 1334 is a verbal description of the requested movement (eg, an audible mention of text prompt 1332). In some examples, the audio output 1334 is issued instead of or in addition to the visual movement prompt 1328 and/or text prompt 1332. In some examples, device 1300 also issues a tactile output 1336 (eg, vibration) (eg, instead of or in addition to audio output 1334 ). In some examples, audio output 1334 and/or tactile output 1336 coincide with movement (eg, animation) of visual movement prompt 1328, as described in more detail below.

In some examples, device 1300 displays an animation of visual movement prompt 1328 to provide an additional indication of the requested movement. In the example of FIGS. 13D and 13E, device 1300 transitions the display of the arrow elements of visual prompt 1328 in the requested direction of movement (eg, to the right). In some examples, visual prompt 1328 also includes one or more lines (eg, arcs) extending over a central portion of user face image 1326. In some examples, these lines appear to extend out of the plane of the display 1302 with a virtual z-dimension (eg, perpendicular to the display). In the examples of FIGS. 13D and 13E, the device 1300 rotates an arc in the requested direction of movement (e.g., to the right) to provide a visual proof of the requested movement in three dimensions accompanying movement of the arrow element. Let it. In some examples, while displaying the animation of visual movement prompt 1328, device 1300 continues to display text prompt 1332. In some examples, the device 1300 may provide audio output 1334 and/or tactile output 1336 while displaying an animation, such that these outputs correspond to movement of the arrow and/or arc element of the visual prompt 1328. Ham-is issued.

In some examples, while displaying the visual movement prompt 1328 and/or text prompt 1332, the device 1300 is configured to determine the orientation of the user's face relative to the biometric sensor 1303 (e.g., during a second time). It is detected that it has not changed during this predetermined time. In response, device 1300 issues a tactile output (eg, tactile output 1338 shown in FIG. 13E). In some examples, tactile output 1338 is generated as an error to indicate that face registration has stopped (eg, because the user has not moved his or her face for a predetermined amount of time).

In the example of FIG. 13F, in response to detecting that the orientation of the user's face has not changed for a predetermined period of time, the device 1300 prompts the user to move his or her face in a different direction. The registration hints of are displayed. In the example of FIG. 13F, the device 1300 displays a second visual movement prompt 1340. The second visual movement prompt 1340 has similar visual characteristics as the visual movement prompt 1328, but corresponds to a second requested movement direction different from the visual prompt 1328 (eg, upward instead of to the right). For example, the second visual movement prompt 1340 includes a second arrow element pointing in a different direction (eg, upward instead of to the right) than the arrow element of the visual movement prompt 1328. Additionally, in some examples, the second visual movement prompt 1340 includes an arc element similar to the arc element of the visual prompt 1328, which is the requested second as described below in connection with FIGS. 13F and 13G. It is used to provide a visual proof of the direction of travel.

In some examples, the second set of registration hints includes a text prompt 1342 that provides the user with written instructions that match the visual navigation prompt 1340. In the example of FIG. 13F, text prompt 1342 provides a written instruction to the user to tilt their heads upward (eg, in a second direction indicated by the arrow elements of second visual prompt 1340 ). In the example of FIG. 13F, device 1300 also issues audio output 1344 corresponding to second visual movement prompt 1340 and/or text prompt 1342. For example, when the screen reader function is enabled, the audio output 1344 is a verbal description of the requested movement (eg, an audible mention of text prompt 1342). In some examples, device 1300 issues a tactile output 1346 (eg, vibration) (eg, instead of or in addition to audio output 1334 ).

As illustrated in FIGS. 13F and 13G, in some examples, device 1300 displays an animation of visual movement prompt 1340 to provide an additional indication of the second requested movement direction. In the example of FIGS. 13F and 13G, the device 1300 transitions the display of the arrow elements of the second visual prompt 1340 in the second requested direction of movement (eg, upwards). In the examples of FIGS. 13F and 13G, the animation is also in a second requested direction of movement (e.g., upwardly into the plane of the display) to provide a visual proof of the requested movement in three dimensions involving movement of the arrow element. ) Rotate the arc element of the second visual prompt 1340. In some examples, while displaying an animation of visual movement prompt 1340, device 1300 continues to display text prompt 1340. In some examples, the device 1300 may provide audio output 1344 and/or tactile output 1346 while displaying an animation, such that these outputs correspond to movement of the arrow and/or arc element of the visual prompt 1340. Ham-is issued.

Referring now to FIG. 13H, the device 1300 changes the orientation of the user's face relative to the biometric sensor 1303 (e.g., the user moves his or her face upward, ie, in the second requested direction of movement. Is tilted or tilted). In response to detecting the change in orientation, the device displays (eg, during a second time), face registration interface 1304, described above with respect to FIG. 13A. In the example of FIG. 13H, the device 1300 updated the user face image 1306 to reflect the change in the orientation of the user's face (eg, displayed his movement). In some examples, orientation guide 1308 tracks (eg, moves with) the movement of user face image 1306 to visually emphasize tilt and rotation movements of the user's face in three dimensions. For example, the center of the orientation guide 1308 (eg, the intersection point) is optionally positioned at a center point on the user's face image 1306 and moves with it. In some examples, device 1300 also adjusts the curvature of the lines including orientation guide 1308 to give the appearance of a three-dimensional rotation (eg, upwardly into the plane of the display). In some examples, device 1100 emphasizes orientation guide 1108 while it is moving (eg, while the orientation of the user's face is changing). For example, device 1300 optionally darkens orientation guide 1308 while it is moving and/or displays fading traces as it tracks movement of the user's face. In this case, the device 1300 optionally reduces this emphasis on the orientation guide 1308 compared to the user face image 1306 when the user's face is not moving.

As shown in the example of FIG. 13G, in response to detecting that the user's face is oriented towards the progress meter portion 1348 (e.g., a set of one or more progression elements such as 1310a, 1310b, 1310c), the device ( 1300 updates the display of progress elements in meter portion 1348 to a "registering" state by changing the appearance of the progress elements in meter portion 1348. For example, device 1300 optionally magnifies and/or changes color of progress elements within meter portion 1348 while the user's face is oriented towards meter portion 1348. In some examples, the device 1300 expands the progress scales and changes their color from gray to blue when updating the progress elements to a “registering” state. In some examples, changing the display of the progress elements in this manner to a "registering" state means that the device 1300 is capturing facial imaging data for an angular view corresponding to the current orientation of the user's face (e.g. , You are registering). In the example of FIG. 13G, the device 1300 keeps the progress elements (e.g., progress elements that are not part of the meter portion 1348) in the progress meter 1310 in an unregistered state (e.g., grayed out). , Indicating that the device 1300 has not yet detected the user's face in orientations corresponding to such progress elements. In some examples, the display of the meter portion 1348 is updated in this manner only when the user's face is sufficiently rotated toward the meter portion 1348 (e.g., when the user's face is rotated at least a threshold amount or a threshold angle). do.

Referring now to the example of FIG. 13I, the device 1300 indicates that the user's face is no longer in an orientation corresponding to the meter portion 1348 (e.g., the user tilts their head back down to a neutral position. ) Is detected. In response, the device 1300 changes the appearance of the progress elements in the meter portion 1348 again to a "registered" state. In the example of FIG. 13I, the device 1300 updates the display of the progress scales in the portion 1348 from the extended “registering” state by again shortening the progress scales and changing their color. For example, the progress elements in the "registered" state have the same length and/or size as the progress elements in the "unregistered" state, but as described above with respect to FIG. 11J, a corresponding part of the user's face (eg, FIG. The angle view captured at 13j) is displayed in green to indicate that it has been successfully registered. In the example of FIG. 13J, device 1300 keeps other progress elements in registration progress meter 1310 unregistered, indicating that the device has not yet detected the user's face in an orientation corresponding to those progress elements. . In response to detecting a change in facial orientation, the device 1300 also moves the orientation guide 1308, causing it to track the movement of the user's face image 1306 in the digital viewfinder.

Referring now to the example of FIG. 13J, after detecting the change in orientation shown in FIG. 13I, the device is configured to determine the orientation of the user's face relative to the biometric sensor 1303 (e.g., for a second time) for a predetermined period of time. It detects that it has not changed during. In response, the device 1300 displays a hint-enabled registration interface 1350. In some examples, hint-enabled registration interface 1350 is automatically displayed. In some examples, hint-enabled registration interface 1350 is in response to detecting activation (e.g., selection) of an affordance (e.g., similar to example affordance 1318 on hint-enabled interface 1314). Is displayed. In some examples, hint-enabled registration interface 1350 and its components (e.g., user facial expression 1352, registration progress meter 1354, visual movement prompt 1356, and text prompt 1358) are It has the same visual characteristics as described above with respect to hint enabling interface 1324 in FIG. 13D. However, in the example of FIG. 13J, the device 1300 displays the progress elements in the meter portion 1360 of the registration progress meter 1354 in a “registered” state, which is a face corresponding to the same portion of the progress meter 1330. This is because the orientation has already been registered (eg, in the manner of Fig. 13H).

In the example of FIGS. 13J and 13K, device 1300 displays an animation of visual movement prompt 1356 that prompts the user to move his or her face to an orientation that has not yet been registered. For example, the animation of visual prompt 1356 prompts the user to move his or her face in the first requested direction (eg, to the right). The animation of the visual movement prompt 1356 has similar or identical characteristics to the animation of the visual movement prompt 1328 described above with respect to FIGS. 13D and 13E. For example, device 1300 transitions the display of the arrow elements of visual prompt 1356 in the requested direction of movement (eg, to the right) corresponding to a facial orientation that has not yet been registered. In the examples of FIGS. 13J and 13K, the animation is also a visual prompt 1356 in the requested direction of movement (e.g., to the right) to provide a visual proof of the requested movement in three dimensions involving movement of the arrow element. Rotate the arc element of. In some examples, while displaying the animation of visual movement prompt 1356, device 1300 continues to display text prompt 1358, which provides a written description of the requested movement. In some examples, device 1300 may be configured to provide audio output 1362 and/or tactile output 1364 while displaying animation, such that these outputs correspond to movement of an arrow and/or arc element of visual prompt 1340. Ham-is issued.

Referring to the example of FIG. 13L, the device 1300 has detected that the orientation of the user's face relative to the biometric sensor 1303 (eg, during a third time) has not changed for a predetermined time. In the example of FIG. 13L, in response to detecting little to no change in the user's facial orientation, device 1300 displays accessibility registration interface 1368. In some examples, the accessibility registration interface includes a user face image 1370, which optionally has similar or identical characteristics to the user face image 1308. In particular, the user face image 1370 is, optionally, a live preview of image data captured by the biometric sensor 1303. In the example of FIG. 13L, the accessibility registration interface 1368 includes a registration progress meter 1372, which is optionally displayed surrounding a user face image 1370. In some examples, the display of meter portion 1370 (e.g., while device 1300 is displaying registration interface 1304 or hint-enabled registration interfaces 1324 and/or 1350 during the previous stage of registration). It indicates the orientations and/or parts of the user's face that were previously registered. For example, device 1300 displays progress elements within portion 1374 of progress meter 1370 (which corresponds to meter portions 1348 and/or 1360). In the example of FIG. 13L, the accessibility registration interface 1368 also includes an accessibility option affordance 1378. In some examples, activation of the accessibility option affordance 1378 allows the user to set up biometric (e.g., face) authentication with only partial scans (e.g., after registering only a subset of facial orientations or parts registered during the full scan) Let's do it.

In the example of FIG. 13M, device 1300 detects activation (eg, selection) of accessibility option affordance 1378 (eg, by user input 1380 ). In response to detecting activation of accessibility option affordance 1378, device 1300 displays completion affordance 1382 on the accessibility registration interface as illustrated in FIG. 13N. In some examples, activation of completion affordance causes the device to proceed using only a partial scan of their facial features.

In the example of FIG. 13O, device 1300 detects activation (eg, selection) of completion affordance 1382 via user input 1384. In response to detecting the activation of the completion affordance, the device 1300 displays a partial scan acknowledgment interface 1386 as illustrated in FIG. 13P. The partial scan acknowledgment interface includes a user face image 1387, which optionally has some or all of the visual characteristics of the user face image 1370. Since a portion of the user's face has been successfully registered, the device 1300 also displays a registration success indicator 1388, for example in proximity and/or surrounding the user face image 1387. In the example of FIG. 13P, the partial scan acknowledgment interface 1386 includes a text prompt 1389 that provides a written indication that image data corresponding to at least a portion of the user's face has been successfully captured and registered. In the example of FIG. 13P, the device 1300 displays a registration completion affordance 1390.

In the example of FIG. 13Q, device 1300 detects activation (eg, selection) of registration completion affordance 1390 through user input 1392. In some examples, in response to detecting activation of the registration complete affordance, device 1300 registers image data of one or more angular views (eg, orientations) of the user's face captured during the registration process described above. Optionally, device 1300 issues a tactile output 1393 to acknowledge completion of the registration process. In some examples, the tactile output 1393 is the same tactile output that is issued in response to a successful biometric application at the device 1300. In the example of FIG. 13Q, the device 1300 replaces the display of the success indicator 1388 with a partial registration indicator 1391 proximate the face image 1387, which visually reflects the orientations of the successfully registered user's face. Represented by In some examples, the size (eg, arc length) and location of the partial registration indicator 1391 correspond to portions of the progress meter (eg, 1310, 1354, 1372) that have transitioned to a "registered" state during registration. In the example of FIG. 13Q, device 1300 displays a partial registration indicator 1391 at a location similar to meter portion 1374 to indicate that one or more facial orientations corresponding to meter portion 1374 have been successfully registered. do.

In the example of FIG. 13R, in response to detecting activation (e.g., selection) of the enrollment complete affordance 1390 (e.g., by user input 1392), the device 1300 displays the enrollment complete interface 1394. do. As shown in FIG. 13R, the registration completion interface 1394 includes a biometric authentication glyph 1395. For example, the biometric authentication glyph 1395 is optionally a line drawing of all or part of a face (eg, a stylized face graphic). In the example of FIG. 13R, registration complete interface 1394 also includes a text prompt 1396 indicating that the registration process is complete and facial authentication at the device is set up and/or enabled. In some examples, the registration completion interface 1394 also includes a completion affordance 1397, which activation causes the device 1300 to terminate facial authentication setup. In some examples, the registration complete interface 1394 does not include a face image 1387.

14 is a flow diagram illustrating a method for providing hints for effectively registering a biometric feature on an electronic device, in accordance with some examples. The method 1400 includes a device with a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 1300). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 1400 provides an intuitive method for providing hints for effectively registering biometric features on an electronic device. This method reduces the user's cognitive burden for registering biometric features on the device, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to register biometric features faster and more efficiently saves power and increases the time between battery charges.

The device, on the display, includes a biometric feature to register a biometric feature (e.g., a user's face, fingerprint, iris, palm print, or other physical biometric feature that can be used to distinguish one person from another person). The registration user interface (e.g., 1304, 1324) is displayed (1402). Displaying the biometric registration user interface includes displaying a representation of the biometric feature (eg, 1306, 1326, a representation of the user's head of the device). The appearance of the representation of the biometric feature changes 1404 as the orientation of the biometric feature with respect to one or more biometric sensors (eg, 1303) changes. For example, the orientation of the biometric features relative to the one or more biometric sensors can optionally be adjusted to the alignment of the user's face in the image data captured by the one or more Camera data including the head of the user being positioned). Displaying a preview of the image captured by the biometric sensors provides feedback to the user regarding the position and orientation of his or her biometric features relative to the device's biometric sensors, allowing the user to It makes it possible to more quickly and efficiently properly align his or her biometric features with the sensors to properly register the parts. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

While displaying the biometric registration user interface, the device detects (1406) that registration prompt criteria have been met with respect to one or more portions of the biometric feature.

In some examples, the registration prompt criteria include a requirement that the biometric feature moves below a first threshold amount for at least a first threshold period (as determined by one or more biometric sensors) (1408). Automatically enabling registration hints after detecting little to no movement of the user's biometric features reduces the time required to complete the registration process, which allows to quickly and automatically execute the required movements. This is because the struggling user receives instructions on how to proceed with the registration process. Performing an optimized set of actions when a set of conditions is met without requiring additional user input (e.g., helping the user to provide appropriate inputs when actuating/interacting with the device and avoiding user mistakes) Reduction) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. .

In response to detecting that the registration prompt criteria have been met with respect to one or more portions of the biometric feature, the device is prompted to move the biometric feature in a respective manner (e.g., 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346 (e.g., visual, auditory, and/or tactile prompts) are output (1410). Each prompt is selected based on the registration status of one or more portions of the biometric feature (eg, whether the first portion and/or the second portion of the biometric feature has been registered) (1412). In particular, upon determining that the registration prompt criteria have been met with respect to the first portion of the biometric feature that can be registered by moving the biometric feature in the first manner, the device prompts to move the biometric feature in the first manner. (For example, 1328, 1332, 1334, 1336) is output (1424). In accordance with the determination that the registration prompt criteria have been satisfied with respect to the second portion of the biometric feature that can be registered by moving the biometric feature in a second manner different from the first method, outputting each prompt is the second method. And outputting a prompt (eg, 1340, 1342, 1344, 1346) to move the biometric feature (1426). Providing visual and/or audible prompts to move the biometric feature in a specific direction allows a user to quickly and intuitively realize a way to position the biometric feature so that the corresponding part can be registered. These prompts allow the user to move the biometric features through the range of orientations required for the registration process more quickly and efficiently than they would otherwise. Thus, providing improved visual and/or audible feedback with instructions for appropriate movements of a biometric feature (e.g., helping the user to provide appropriate inputs when operating and/or interacting with the device) By reducing user mistakes) it improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and battery life by enabling users to use the device more quickly and efficiently. Improves

In some examples, upon determining that the audible prompt criteria are met (e.g., determining whether the device's screen reader function is enabled), the device (e.g., instead of or in addition to one or more visual prompts) Outputs an audible prompt (e.g., 1334) to move the biometric feature in one way. In some examples, upon determining that the audible prompt criteria are not met, the device provides the user with an option to enable audible prompts for biometric registration. For example, the device displays an affordance (e.g., 1318), which, when selected by the user, describes the steps to enable audible prompts or enable audible prompts for biometric registration. Provide an audio prompt (eg, 1334, 1344). Providing audible instructions to move the biometric feature in a specific direction allows a user to quickly and intuitively realize a way to position the biometric feature so that the corresponding part can be registered. These prompts allow the user to move the biometric features through the sequence of orientations required for the registration process more quickly and efficiently than they would otherwise. Thus, providing improved audible feedback with instructions for proper movements of the biometric feature (e.g., helps the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) By improving the operability of the device and making the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device may prompt each prompt (e.g., 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346, e.g., visual, audible, and/or A tactile prompt). For example, each prompt optionally indicates that the user should start tilting their heads to begin the registration process (1422).

In some examples, the device may perform each prompt (e.g., 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346, e.g., visual, audible, and/or tactile) after at least a portion of the biometric feature is registered. Enemy prompt). For example, the prompt optionally indicates that the user should continue to tilt their heads to continue the registration process. Automatically issuing prompts to move the biometric feature in the second direction after the user has moved the biometric feature in the first direction indicates how the user continues to move the biometric feature to proceed with the registration process. Make understanding quickly and intuitively. Helping the user understand how to perform the required movement of the biometric features in succession reduces the time required to complete registration of the biometric features. Thus, performing an optimized set of actions when a set of conditions is met without requiring additional user input (e.g., helping the user to provide appropriate inputs when actuating/interacting with the device and By reducing mistakes) it improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. Improve.

In some examples, the device outputs a tactile output (eg, 1336, 1346). In some examples, the tactile output involves an audible output (eg, 1334, 1344). In some examples, the tactile output and/or audio output are generated to match the movement of a visual prompt (eg, 1328, 1340). For example, the tactile outputs optionally correspond to movement of an arrow or arc (e.g., an arrow element and an arc element at 1328 and/or 1340) in the direction the user is being prompted to move the biometric feature. .

In some examples, each prompt includes a tactile output (eg, 1338, 1366) used to indicate a failed biometric authentication by the device. For example, a tactile output generated as an error when biometric registration is stopped due to a failure to change the orientation of a biometric feature for one or more biometric sensors is a tactile output used to indicate a failed biometric authentication. Same as the output.

In some examples, the device overlays a visual prompt (eg, 1328, 1340, 1356) on the representation of the biometric feature. For example, the visual prompt is optionally an arrow indicating each way (direction) of moving the biometric feature (such as up, down, left, right, at a diagonal angle between those directions). In some examples, the visual prompt is partially transparent. Displaying a visual prompt, such as an arrow element, in the requested direction of movement allows the user to quickly understand how to move the biometric feature so that the portion of the feature corresponding to the requested direction can be properly registered. This allows the user to perform the requested movement more quickly and efficiently, reducing the time required by the registration process. Thus, providing an improved visual prompt that illustrates the proper movements of the biometric feature is to reduce user errors (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device) It improves operability and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, the device has an animated prompt to move the biometric feature in a respective manner (e.g., 1328, 1340, or 1328 described in connection with FIGS. 13D and 13E, 13F and 13G, or 1356 animation) is displayed (1414). For example, the device optionally displays an animation (e.g., the animation of 1328 shown in FIGS. 13D and 13E) that prompts for a first manner of movement in relation to the first portion of the biometric feature, and Display an animation (eg, animation of 1340 in FIGS. 13F and 13G) prompting movement in a second manner in relation to the second portion of the negative. In some examples, displaying the animation prompt includes displaying 1416 an arrow element (eg, an arrow element of 1328, 1340, or 1356) indicating each manner of moving the biometric feature. Displaying an animation that intuitively illustrates the requested direction of movement allows the user to quickly understand how to move the biometric features so that a portion of the features corresponding to the requested direction can be properly registered. This allows the user to perform the requested movement more quickly and efficiently, reducing the time required by the registration process. Thus, providing improved visual feedback with intuitive examples of appropriate movements of a biometric feature (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) ) It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device outputs 1420 of at least one of a tactile output (eg, 1336, 1346, 1364) or an audible output (eg, 1334, 1344, or 1362) corresponding to the animation. For example, the animation selectively zooms in and out of biometric features. Alternatively and/or additionally, one or more elements of the registration user interface (eg, 1324, 1350) optionally temporarily change state. In general, the tactile output is synchronized with the animation. Providing tactile and/or audio outputs accompanying a visual example of the requested movement allows the user to quickly understand how to move the biometric feature so that the portion of the feature corresponding to the requested direction can be properly registered. do. This allows the user to perform the requested movement more quickly and efficiently, reducing the time required by the registration process. Thus, providing improved tactile and/or audible feedback accompanying animation is a device (e.g., by helping the user to provide appropriate inputs when operating and/or interacting with the device and reducing user errors). It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the first manner of movement includes rotation about an axis parallel to the display (e.g., in the plane of the display 1302), and the second manner of movement involves rotation about an axis parallel to the display. Include. In this case, the animation prompt (e.g., the animation of 1328, 1340, or 1356 described in connection with FIGS. 13D and 13E, 13F and 13G, or 13J and 13K) is Includes (1418) a simulated rotation of the user interface element (e.g., 1328, 1340, or 1356 arc element). For example, if the user is being prompted to rotate the biometric feature clockwise around an axis parallel to the display, the animation optionally includes movement of the user interface element clockwise around an axis parallel to the display. do. Similarly, if the user is being prompted to rotate the biometric feature in a counterclockwise direction about an axis parallel to the display, the animation optionally includes movement of the user interface element in a counterclockwise direction about an axis parallel to the display. do. Displaying the simulated rotation of the orientation element to illustrate the requested movement allows the user to quickly understand how to move the biometric feature so that the portion of the feature corresponding to the requested direction can be properly registered. This allows the user to perform the requested movement more quickly and efficiently, reducing the time required by the registration process. Thus, providing improved visual feedback with intuitive examples of appropriate movements of a biometric feature (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) ) It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the biometric registration user interface is overlaid on the representation of the biometric feature (e.g., 1306) (e.g., as described above with reference to method 1200) and the representation of the biometric feature is in different directions. It includes an orientation guide (eg, 1308) that tilts in different directions as it is tilted. In this example, an animation prompt (e.g., Figs. 13D and 13E or Figs. 13D and 13E or Figs. 13j and the animation of 1328 or 1356 described in connection with FIG. 13K) is the movement of a portion of the orientation guide (e.g., the vertical component of 1308) in the direction in which the orientation guide would have moved if the biometric feature was moved in a first manner. Includes. Displaying and/or rotating an orientation guide overlaid on the representation of the biometric feature provides the user with feedback regarding the orientation of his or her biometric features relative to the device's biometric sensors in a three-dimensional space. This allows the user to move the biometric features more quickly through the required orientation range during the registration process. Hence, providing the user with improved visual feedback regarding the orientation of the biometric feature is the ability of the device (e.g., by helping the user to provide appropriate inputs when operating and/interacting with the device and reducing user errors) It improves operability and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

Likewise, upon determination that registration prompt criteria have been met with respect to a second portion of the biometric feature that can be registered by moving the biometric feature in a second manner, an animation prompt (e.g., described in connection with FIGS. 13F and 13G) The animation of 1340) includes movement of a portion of the orientation guide in a direction in which the orientation guide would have moved if the biometric feature moved in the second manner. In some examples, the orientation guide includes a first portion (e.g., a horizontal component of 1308, e.g., a first arc) and a second portion (e.g., a horizontal component of 1308, e.g., a second arc intersecting the first arc). And, the animation prompt (e.g., the animation of 1340 shown in FIGS. 13F and 13G) is to move the first part of the orientation guide without moving the second part, or to move the second part without moving the first part. Includes moving. In some examples, when the first portion of the orientation guide is moving, the second portion stops being displayed. Similarly, if the second part is moving, the first part stops being displayed. In some examples, if registration is required for a portion of a biometric feature that is not visible when the feature is tilted up, down, left, or right, the animation moves in a diagonal direction, giving the user a diagonal direction. Prompt you to tilt it.

In some examples, after outputting a respective prompt (e.g., 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346) to move the biometric feature in a respective manner, and detecting movement of the biometric feature. In response to doing so, the device registers each portion of the biometric feature. Optionally, the device updates the progress indicator (eg, 1310, 1330) as described in method 1200. While registering each portion of the biometric feature, the device selectively stops providing prompts. Updating the progress indicator during registration in this manner encourages the user to see the display of the electronic device during registration, improving the ability to detect when the gaze is facing the display and, accordingly, whether the user is paying attention to the device. Let it. Encouraging the user to see the display of the electronic device improves the operability of the device and improves the user- It makes the device interface more efficient, which, in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, after registering each portion of the biometric feature, the device determines that registration prompt criteria have been met with respect to one or more portions of the biometric feature. In response to determining that enrollment prompt criteria have been met with respect to one or more portions of the biometric feature (e.g., the user stops responding during enrollment for a threshold period), the device performs the biometric feature for which enrollment prompt criteria have been met. Outputs a different respective prompt (eg, 1356, 1358, 1362, 1364) to move the biometric feature in a respective manner determined based on one or more portions of the negative. For example, the device starts prompting the user to change the orientation of the biometric feature with respect to one or more biometric sensors to register portions of the biometric feature that have not yet been registered. In some examples, prompts have properties similar to other prompts described above. In some examples, the prompts proceed in a manner similar to the prompts described above. In some examples, a first prompt (e.g., 1356, 1358, 1362, 1364) is provided in a first direction after a first period of little or no movement of the biometric feature relative to one or more biometric sensors, and A second prompt is provided in the second direction after a second period (longer than the first period) in which there is little or no movement of the biometric features for the above biometric sensors, and the biometric features for the biometric sensors An option (eg, 1382, 1390) is provided to complete the biometric registration without registering all portions of the biometric feature after a third period (longer than the first period) with little or no negative shift. Automatically providing prompts to move the biometric feature in a different direction after detecting little to no movement of the biometric feature is a first step by quickly and automatically providing instructions on how to proceed with the registration process. Helps the user who is struggling or unable to execute the movement in the direction. Performing an optimized set of actions when a set of conditions is met without requiring additional user input (e.g., helping the user to provide appropriate inputs when actuating/interacting with the device and avoiding user mistakes) Reduction) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. .

In some examples, after outputting each prompt (e.g., 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346, 1356, 1358, 1362, 1364) to move the biometric feature in a respective manner, Upon determining that the accessibility prompt criteria have been met, the device displays an option (e.g., 1378) to proceed with registration without further changes in the orientation of the biometric feature relative to one or more biometric sensors (e.g., 1303). Do (1428). The accessibility prompt criteria include a requirement that the orientation of the biometric feature relative to the one or more biometric sensors has changed 1430 by less than a predetermined amount during each period. For example, the user's biometric features were not detected as being moving for a critical period after providing a second prompt (eg, 1340, 1342, 1344, 1346). In this case, an accessibility affordance (eg, 1378) is displayed, and the user selectively selects an accessibility affordance (eg, 1380). In other words, the user may authorize the use of biometric feature authentication for views of biometric features from an orientation range that is smaller than the available orientation range. In some examples, each period is greater than the second period. For example, after a delay with little or no movement of the biometric feature relative to one or more biometric sensors (e.g., 1303), the device may first determine the movement of the biometric feature in a first direction (e.g., 1328, 1332, 1334, 1336) to prompt; Then, after a delay with little or no movement, the device prompts (eg, using 1340, 1342, 1344, 1346) for movement of the biometric feature in the second direction; Subsequently, after an additional delay with little or no movement, the device provides an option (eg, 1378) to proceed with registration without further movement of the biometric feature for one or more biometric sensors. In some examples, an accessibility prompt (e.g., 1378) is displayed after a sufficient amount of the biometric feature has been captured to ensure secure authentication by at least a portion of the biometric feature (e.g., one angle of the face is captured. Once registered and registered, a user with limited mobility can select an accessibility option to register the biometric feature using only the registered angles).

In some examples, the device detects (1432) a selection of an option to proceed with registration without further changes in the orientation of the biometric feature for one or more biometric sensors. For example, in some examples, the device receives user input (eg, 1382) indicating a selection (eg, 1380) of an affordance of an accessibility interface (eg, 1368) to confirm registration of biometric data. In response to detecting a selection of an option to proceed with registration (1434) without further changes in the orientation of the biometric feature relative to the one or more biometric sensors, the device suspends one or more steps in the biometric registration (e. , Skip) (1436). For example, the device may have a second biometric registration user interface to be displayed in a standard registration process in which the biometric features change orientation as prompted by the device (e.g., second registration interface 1138 in FIG. 11H). Skip the display of (eg, there is no second registration flow when the user registers through the accessibility interface, as described in connection with the method of 1200).

In some examples, in response to selection of an option to proceed with registration (1434) without further changes in the orientation of the biometric feature with respect to one or more biometric sensors, the device determines which portions of the biometric feature have been registered. An indication (e.g., 1391 and 1389) indicating that registration of the biometric feature including information has been completed is displayed (1438). In some examples, the device, when selected, displays an affordance (eg, 1390), confirming partial registration of the biometric feature.

In some examples, in response to detecting the selection of an option to proceed with registration without further changes in the orientation of the biometric feature with respect to one or more biometric sensors, the device will, once the biometric feature has been registered, the biometric feature Outputs a tactile output (eg, 1393) used to indicate successful biometric authentication by wealth. For example, the tactile output generated when biometric registration is complete is, optionally, the same tactile output used to indicate successful authentication by the biometric feature.

It is noted that the details of the processes described above with respect to method 1400 (eg, FIGS. 14A and 14B) are also applicable in a similar manner to the methods described herein. For example, method 1400 can optionally include one or more of the characteristics of the various methods described herein with reference to methods 800, 1000, 1200, 1600, 1800, 2000, 2200, 2500, 2700. Include. For example, the accessibility interface described in method 1000 may be applied in connection with an accessibility registration interface (eg, 1368). For another example, an orientation guide as described in method 1200 may be applied in connection with an orientation guide (eg, 1308). For brevity, these details are not repeated below.

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 14A and 14B are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, display operation 1402, detection operation 1406, output operation 1408, output operation 1412, and output operation 1414, optionally, event classifier 170, event recognizer 180 , And the event handler 190. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

15A-15T illustrate example user interfaces for biometric authentication, according to some examples. As described in more detail below, illustrative examples of user interfaces illustrated in FIGS. 15A-15T are used to illustrate the processes described below, including those of FIGS. 16A-16E.

15A illustrates an electronic device 1500 (eg, portable multifunction device 100, device 300, or device 500 ). In the illustrative example illustrated in FIGS. 15A-15T, the electronic device 1500 is a smartphone. In other examples, electronic device 1500 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 1500 has a display 1502, one or more input devices (eg, a touchscreen of the display 1502, a button 1504, a microphone (not shown)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 1503) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more biometric sensors 1503 are one or more biometric sensors 703. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 15A, the electronic device 1500 displays an application interface 1506 including a login affordance 1508 on a display 1502. In the example of FIG. 15A, the application is a browser that displays a website (eg, onlinestore.com) in the browser's interface. In FIG. 15B, while displaying application interface 1506, electronic device 1500 detects activation of login affordance 1508. As shown, activation is a tap gesture 1510 on login affordance 1508.

In FIG. 15C, in response to detecting activation of login affordance 1508, electronic device 1500 initiates biometric authentication. In some examples, initiating biometric authentication includes obtaining data corresponding to at least a portion of the user's biometric feature (eg, the user's face) (eg, capturing with one or more biometric sensors). Includes. In FIG. 15C, initiating biometric authentication further includes displaying biometric authentication interface 1512 having biometric authentication glyph 1514. In the example of FIG. 15C, biometric authentication glyph 1514 is a simulation of a representation of a biometric feature (eg, a face). As can be seen in FIG. 15C, biometric authentication interface 1512 is overlaid on at least a portion of application interface 1506. In some examples, the biometric authentication interface is an operating system level interface (e.g., an interface generated by the device's operating system), and the application interface 1506 is an application level interface (e.g., a third This is the user interface created by the application).

In some examples, the electronic device 1500 initiates biometric authentication in response to activation of the application's login affordance, but in other examples, the electronic device 1500 is responsive to loading the application and/or application interface 1506. To initiate biometric authentication (eg, start automatically). The application interface is displayed, for example, in response to loading the application (eg, by selecting an icon associated with the application on the home screen of electronic device 1500 ).

In some examples, including the example of FIG. 15C, the biometric authentication interface is partially translucent. In some examples, the display (eg, visual characteristic) of biometric authentication interface 1512 is based on application interface 1506. As an example, one or more colors of biometric authentication interface 1512 are based on one or more colors of application interface 1506. 15C, the electronic device 1500 displays an application interface 1506 having a first color scheme, and the biometric authentication interface 1512 is displayed based on the first color scheme (e.g., a first color scheme). It is displayed using colors that contrast with the formulation). Referring to FIG. 15D, the electronic device 1500 displays an application interface 1507 having a second color scheme different from the first color scheme, and the biometric authentication interface 1512 is displayed based on the color scheme. . Displaying the biometric authentication interface 1512 in this manner makes it easy to be recognized and viewed by the user when the biometric authentication interface 1512 is overlaid on the application interface.

In response to initiating biometric authentication, the electronic device 1500 captures and processes (e.g., analyzes) the biometric data so that, based on the biometric data, the biometric feature (or portion thereof) is biometric. Determine whether the authentication criteria are satisfied (eg, determine whether the biometric data matches the biometric template, within a threshold). In some examples, in response to obtaining the biometric data, the electronic device 1500 displays a biometric authentication animation, including, for example, changing the size of the biometric authentication glyph. In some examples, while the electronic device is processing biometric data, the electronic device displays one or more biometric authentication glyphs and/or biometric authentication animations to indicate that the biometric data is being processed (e.g., Replace the display of the biometric authentication glyph 1514 with them).

As an example, in FIG. 15E, the electronic device displays a biometric authentication glyph 1514 in response to initiating biometric authentication. 15F and 15G, once the electronic device 1500 has obtained biometric data (e.g., has obtained sufficient biometric data), the electronic device 1500 displays biometric authentication glyphs (1515 in Fig. 15F). , 1516 in FIG. 15G), which displays an animation in which the biometric authentication glyph 1514 is replaced by (e.g., transferred to) the biometric authentication glyph 1517 (FIG. 15H). Serves as a part of 15H, electronic device 1500 displays biometric authentication glyph 1517 to indicate that biometric data is being processed. In some examples, biometric authentication glyph 1517 includes a plurality of rings that rotate in a spherical shape, eg, while displayed.

In FIG. 15I, the electronic device 1500 determines that the biometric feature satisfies the biometric authentication criteria. In response, the electronic device displays a biometric authentication glyph 1518 in the biometric authentication interface 1512 indicating that the biometric authentication was successful (e.g., replacing the display of the biometric authentication glyph 1517 with it. do). Additionally or alternatively, the electronic device outputs a tactile output 1520 indicating that the biometric authentication was successful. After indicating that the biometric authentication is successful, the electronic device 1500 provides authentication information to the application indicating that the biometric feature satisfies the biometric authentication criteria and consequently the biometric authentication was successful.

15J, in response to the electronic device 1500 providing authentication information indicating that the biometric feature satisfies the biometric authentication criteria, the application displays the main interface 1522 (e.g., application Replaces the display of interface 1506 with it). Referring to FIG. 15K, after a predetermined time, the electronic device 1500 stops displaying the biometric authentication interface. Thereafter, the user optionally uses the application (eg, using the user name and password for an account associated with the application) as if the user was authenticated directly with the application. In some examples, the electronic device 1500 stops displaying the biometric authentication interface 1512 after a predetermined time after the biometric authentication is complete. In other examples, the electronic device 1500 stops displaying the biometric authentication interface 1512 after the application performs an operation, such as displaying an interface (e.g., main interface 1522) and after a predetermined time. .

Alternatively, in FIG. 15L, electronic device 1500 determines that the biometric feature does not satisfy the biometric authentication criteria (eg, after displaying the biometric authentication glyph 1517 in FIG. 15G ). In response, the electronic device displays a biometric authentication glyph, such as a biometric authentication glyph 1519, in the biometric authentication interface 1512 to indicate that the biometric authentication was unsuccessful (e.g., failed) ( For example, it replaces the display of the biometric authentication glyph 1517). In some examples, biometric authentication glyph 1519 is associated with a biometric authentication failure animation. 15L and 15M, in some examples, in response to the unsuccessful biometric authentication, the electronic device 1500 simulates a “head shake” effect and indicates that the biometric authentication did not succeed. To indicate, the biometric authentication glyph 1519 displays an animation of a biometric authentication failure moving side-to-side (eg, rotating). Optionally, the electronic device 1500 outputs a tactile output 1526 indicating that the biometric authentication was not successful. In some examples, tactile output 1526 is the same as tactile output 1520. In some examples, tactile output 1526 is different than tactile output 1520. In some examples, the tactile output 1526 is synchronized with the biometric authentication failure animation.

15N and 15O show that, in response to an unsuccessful biometric authentication (as determined with respect to FIG. 15E), the electronic device 1500 displays a biometric authentication glyph 1514 within the biometric authentication interface 1512. Illustrates an alternative biometric failure animation to display (eg, replacing the display of biometric authentication glyph 1517 (FIG. 15H) with it). In some examples, during display of the biometric authentication failure animation, the electronic device moves the biometric authentication interface 1512 on the display 1502. In some examples, the electronic device 1500 simulates a “shake” effect and moves the biometric authentication interface 1512 left and right to indicate that the biometric authentication was not successful. In some examples, the electronic device moves only the biometric authentication glyph 1514 and not the biometric authentication interface 1512. In other examples, additional or alternative glyphs are used in the biometric authentication failure animation.

As illustrated in FIG. 15P, in some examples, after displaying one or more biometric authentication failure animations, the electronic device displays a biometric authentication interface 1512 with a biometric authentication glyph 1514. In this way, the electronic device displays the initial biometric authentication glyph 1514 once more, indicating that the electronic device 1500 is enabled to perform further biometric authentication. In some examples, the electronic device performs a further iteration of biometric authentication, at least as described in connection with FIGS. 15E-15N.

15Q, in some examples, in response to unsuccessful biometric authentication, electronic device 1500 displays a failure interface 1540 (e.g., replacing the display of biometric authentication interface 1512 with it. do). In some examples, displaying the failure interface 1540 includes maintaining a display of the biometric authentication interface 1512. In some examples, the failure interface 1540 includes a biometric authentication glyph 1514, an alternative authentication affordance 1544, a retry affordance 1546, and a cancellation affordance 1548. In some examples, activation of cancellation affordance 1548 causes electronic device 1500 to stop displaying the failure interface 1540.

Referring to FIG. 15R, in some examples, in response to activation of retry affordance 1546, such as tap gesture 1550, electronic device 1500 performs another iteration of biometric authentication. In some examples, the electronic device 1500 may have one or more biometric authentication glyphs (e.g., 1515-1517) and/or a biometric authentication animation within the failure interface 1540 to indicate the progress and/or result of the biometric authentication. Display them. Referring to FIG. 15S, in some examples, the electronic device performs biometric authentication only when a threshold number (eg, five) of failed biometric authentication attempts have not been made. In some examples, if a threshold number of failed biometric authentication attempts has been reached, the electronic device 1500 displays an indication 1560 that the threshold number has been reached and consequently biometric authentication is not available (e.g., It replaces the display of the biometric authentication glyph 1514).

In some examples, in response to activation of an alternative authentication affordance 1544, such as a tap gesture 1552, the electronic device 1500 displays an alternative authentication interface 1562 (e.g., of the failure interface 1540). Replacing the display with it), whereby the user authenticates using an alternative form of authentication (eg, fingerprint authentication, password authentication) in addition to the authentication associated with the biometric feature. As illustrated in FIG. 15T, the user optionally authenticates by entering appropriate credentials in the username field 1564 and the password field 1566 respectively. In some examples, the failure interface 1540 is an operating system level interface that allows the user to authenticate with the operating system of the electronic device 1500, and the alternative authentication interface 1562 is an application level interface that allows the user to authenticate with an application.

16A-16E are flow diagrams illustrating a method for managing peer-to-peer transmissions using an electronic device, in accordance with some examples. The method 1600 includes a device having a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 1500). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric feature by one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 1600 provides an intuitive method for managing the authentication of biometric features. This method reduces the user's cognitive burden on managing the authentication of biometric features, thereby creating a more efficient human-machine interface and an intuitive user experience. In the case of battery-operated computing devices, enabling a user to manage the authentication of biometric features faster and more efficiently saves power and increases the time between battery charges.

Prior to displaying the application interface (e.g., 1506) and biometric authentication interface (e.g., 1512), the electronic device (e.g., 100, 300, 500, 1500) is Application) is loaded (1602). In some examples, the application interface (e.g., 1506) is not initially installed on the electronic device (e.g., 100, 300, 500, 1500) and/or the operation of the electronic device (e.g., 100, 300, 500, 1500) This is the interface of a third-party application not provided by the manufacturer of the system or the manufacturer of the device. In some examples, the biometric authentication interface (eg, 1512) is an operating system generated asset that is not under the control of an application that corresponds to (eg, creates) the application interface (eg, 1506).

The electronic device (e.g., 100, 300, 500, 1500), on the display (e.g., 1502), of the application interface (e.g., 1506) and the electronic device (e.g., 100, 300, 500, 1500) corresponding to the application The biometric authentication interface (eg, 1512) controlled by the operating system is simultaneously displayed (1604). Displaying the application interface and the biometric authentication interface at the same time allows the user to quickly recognize that the requested biometric authentication is related to the application corresponding to the application interface, and in addition, the user unintentionally uses the application. By helping to avoid performing the operation and at the same time making the user aware that authentication is required before the operation is performed, it gives the user more control of the device. Providing additional control of the device in this way without cluttering the UI with the additional displayed controls (e.g., helping the user to provide appropriate inputs when operating/interacting with the device and reducing user mistakes) By improving the operability of the device and making the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, a biometric authentication interface (eg, 1512) is displayed (1606) over a portion of the application interface (eg, 1506). In some examples, the biometric authentication interface (eg, 1512) is not displayed over the entire application interface (eg, 1506), and at least a portion of the application interface (eg, 1506) remains displayed without being overlaid. In some examples, the biometric authentication interface (eg, 1512) is at least partially translucent. In some examples, the biometric authentication interface (eg, 1512) is at least partially translucent (or transparent) such that the application interface (eg, 1506) is at least partially visible through the biometric authentication interface (eg, 1512). In some examples, the biometric authentication interface (e.g., 1512) blurs the underlying content so that the appearance of the biometric authentication interface (e.g., 1512) is based on the portion of the blurred content under the biometric authentication interface (e. Do it. In some examples, the biometric authentication interface (eg, 1512) is displayed (1608) in response to loading of the application. In some examples, the biometric authentication interface (e.g., 1512) allows the user to load (e.g., initiate or resume execution thereof) an application on an electronic device (e.g., 100, 300, 500, 1500) Is displayed in response to. In some examples, the biometric authentication interface (eg, 1512) is loaded after the application is displayed. In some examples, the biometric authentication interface (eg, 1512) and the application interface (eg, 1506) are displayed simultaneously. In some examples, the biometric authentication interface (eg, 1512) is displayed in response to detecting a user interaction with the application interface (eg, 1506) in response to a request to access content that requires authentication (1610). In some examples, the request for authentication is selection of an authentication affordance (eg, 1508) or performing a gesture. In some examples, the application interface (eg, 1506) includes an authentication affordance 1506 (eg, a login affordance).

While displaying the biometric authentication interface (e.g., 1512), before acquiring biometric data corresponding to at least a portion of the biometric feature, the electronic device (e.g., 100, 300, 500, 1500) Prepare to use the field (eg 1503). In some examples, in response to the display of the login affordance (eg, 1508), the electronic device (eg, 100, 300, 500, 1500) prepares (eg, prepares) one or more biometric sensors for use. In some examples, preparing to use one or more biometric sensors (e.g., 1503) moves the sensors (e.g., 1503) from a low power state (e.g., non-powered state or sleep state) to a low latency state (e.g. To a power state or a full power state, a pre-warmed state). In this way, the electronic device (eg 100, 300, 500, 1500) optionally reduces the time required to perform biometric authentication when displaying the biometric authentication interface (eg 1512). In some examples, when one or more biometric sensors (e.g., 1503) is in a low power state, it takes a first time to attempt biometric authentication using one or more biometric sensors, and one or more biometric sensors When (e.g., 1503) is in a low latency state, it takes a second time, less than the first, to attempt biometric authentication using one or more biometric sensors (e.g., 1503). While displaying the biometric authentication interface (e.g., 1512), the electronic device (e.g., 100, 300, 500, 1500) corresponds to at least a portion of the biometric feature, from one or more biometric sensors (e.g., 1503). The biometric data to be measured is acquired (1612). In some examples, the biometric feature is a face, and the biometric data is data corresponding to a portion of the face.

In response to obtaining, from one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature, the electronic device (e.g., 100, 300, 500, 1500), based on the biometric data, It is determined whether at least a portion of the measurement feature meets the biometric authentication criteria (1614). Based on the obtained biometric data, determining whether at least a portion of the biometric feature satisfies the biometric authentication criteria is a fast and efficient authentication process that allows the user to easily provide an authentication operation and proceed with it with minimal input. Makes it possible. Reducing the number of inputs required to perform an operation improves the operability of the device and improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). -Make the device interface more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (e.g., 100, 300, 500, 1500) has a face or fingerprint of the user being authorized for use in biometric authentication at the device (e.g., 100, 300, 500, 1500). S) and/or the stored information about the fingerprint(s). In some examples, based on the biometric data, determining whether at least a portion of the biometric feature satisfies the biometric authentication criteria includes displaying 1616 a biometric authentication analysis animation. In some examples, the biometric authentication animation includes displaying a sequence of interface objects (eg, 1514, 1515, 1516, 1517, 1518, 1519) (eg, glyphs). The first interface object (e.g., 1514) indicates that biometric authentication has been initiated, and the second interface object (e.g., 1517) indicates that the device (e.g., 100, 300, 500, 1500) is processing biometric data. , The third interface object (eg, 1518, 1519) indicates whether the biometric authentication succeeds or fails. In some examples, the first interface object (eg, 1514) is substantially square in shape, and the second interface object (eg, 1517) is substantially circular in shape. In some examples, displaying the biometric authentication analysis animation includes rotating one or more rings about an interface object (eg, 1517) (eg, a biometric authentication glyph) of the biometric authentication animation. In some examples, one or more rings are rotated while a device (eg, 100, 300, 500, 1500) is processing biometric data to determine whether the biometric data meets biometric authentication criteria. The rotation of the rings optionally simulates the rotation of the rings around a sphere. In some examples, once the device (eg, 100, 300, 500, 1500) has finished processing the biometric data, one or more rings are overlaid on each other to prove processing is complete. In some examples, displaying the biometric authentication analysis animation includes an animated object (e.g., 1514, 1515) on a platter (e.g., 1512) with an appearance based on the underlying content (e.g., 1506, 1507, 1522). , 1516, 1517, 1518, 1519). In some examples, as the appearance of the animated object changes, the appearance of the platter changes. In some examples, when the animated object gets darker, the platter gets darker, and when the applied object gets brighter, the platter gets brighter. In some examples, the appearance of the platter is an animated object (e.g., 1514, 1515, 1516, 1517, etc.) even when the underlying content (e.g., 1506, 1507, 1522) on which the appearance of the platter (e.g., 1512) is unchanged. 1518, 1519) changes as their appearance changes. In some examples, one or more colors of the biometric authentication analysis animation are based on one or more colors of an application interface (eg, 1506). In some examples, the colors of the animation are selected based on one or more colors of an application interface (eg, 1506, 1507, 1522) or another interface associated with the application. The colors are optionally derived, for example, based on the colors used for the controls and/or icons of the application. In this way, the animation is optionally visually coordinated with the application interface (eg, 1506, 1507, 1522) to provide a more robust user experience. In some examples, prior to displaying the biometric authentication analysis animation, the electronic device (e.g., 100, 300, 500, 1500) may perform a color scheme of the application interface (e.g., 1506) or data corresponding to the application interface (e.g., 1506). Determine one or more colors of the animation based on the analysis of. In some examples, further in response to obtaining, from one or more biometric sensors (eg, 1503), biometric data corresponding to at least a portion of the biometric feature, an electronic device (eg, 100, 300, 500, 1500) changes the size of the interface object (eg, 1514) (eg, biometric authentication glyph) of the biometric authentication interface (eg, 1512) from a first size to a second size, and the interface object (eg, 1514) The size of is changed from the second size to the first size. In some examples, once biometric data has been captured by one or more biometric sensors (e.g., 1503), the interface object (e.g., 1514) (e.g., biometric authentication glyph) is incremented from the initial size and subsequently the initial size. Return to and create a "bounce" effect.

Based on the biometric data, upon determining that at least a portion of the biometric feature satisfies the biometric authentication criteria (1636), the electronic device (e.g., 100, 300, 500, 1500) may determine one or more portions of the biometric feature. Authentication information indicating that biometric authentication criteria have been satisfied is provided to the application (1620). Providing the authentication information to the application upon determination that at least a portion of the biometric feature satisfies the biometric authentication criteria improves the security of the device and reduces the number of fraudulent transfers that may occur. Improving device security and reducing the number of fraudulent transmissions improves the operability of the device and makes the user-device interface more secure (eg, by reducing fraud when operating and/or interacting with the device).

In some examples, authentication information is provided by the operating system to an application that creates an application interface (eg, 1506). In some examples, further, based on the biometric data, according to a determination that at least a portion of the biometric feature satisfies the biometric authentication criteria, after providing the authentication information to the application, the electronic device (e.g., 100, 300, 500, 1500 maintains the display of the biometric authentication interface (eg, 1512) for a predetermined time (1624). In some examples, further, based on the biometric data, upon determining that at least a portion of the biometric feature satisfies the biometric authentication criteria, the electronic device (e.g., 100, 300, 500, 1500) Display 1622 a biometric authentication success animation that includes a first representation (eg, 1518) of a simulation of the biometric feature indicating that at least a portion of the portion satisfies the biometric authentication criteria.

In some examples, in response to a successful biometric authentication, the device (eg, 100, 300, 500, 1500) displays an animation including an interface object (eg, 1518) indicating that the biometric authentication was successful. In some examples, further, based on the biometric data, upon determining that at least a portion of the biometric feature satisfies the biometric authentication criteria, the electronic device (e.g., 100, 300, 500, 1500) Provides a success tactile output (eg, 1520) indicating that at least a portion of the negative satisfies the biometric authentication criteria. Displaying an animation indicating that the biometric authentication was successful can provide a user with visual feedback of an action being performed and allow the user to quickly recognize that the action was successful. Providing improved visual feedback to the user includes (e.g., by providing feedback indicative of input that will cause the device to produce the intended result when operating and/or interacting with the device, thereby helping the user achieve the intended result. It improves the operability of the device and makes the user-device interface more efficient (by helping and reducing user mistakes), which additionally reduces the device's power usage and reduces battery power consumption by enabling users to use the device more quickly and efficiently. Improves lifespan.

After maintaining the display of the biometric authentication interface (e.g., 1512) for a predetermined time, the electronic device (e.g., 100, 300, 500, 1500) stops displaying the biometric authentication interface (e.g., 1512) ( 1626). In some examples, the application receives an indication of authentication before the device (eg, 100, 300, 500, 1500) stops displaying the biometric authentication interface (eg, 1512); This allows the application to provide an interface of the application (eg, 1522), such as a “main application” interface or a post login interface, prior to transition from the biometric authentication interface (eg, 1512) (eg, display Do). In some examples, the biometric authentication interface (eg, 1512) ceases to be displayed after authenticating and a predetermined time. In some examples, the biometric authentication interface (e.g., 1512) stops displaying (e.g., an unlocked user interface (e.g., 1522)) after a predetermined time when the application performs an action according to the biometric authentication. Display).

Based on the biometric data, upon determining that at least a portion of the biometric feature does not satisfy the biometric authentication criteria (1628), the electronic device (e.g., 100, 300, 500, 1500) may cause at least a portion of the biometric feature to be A biometric authentication failure animation including a second representation (eg, 1519) of a simulation of the biometric feature indicating that the biometric authentication criteria are not satisfied is displayed (1630). Displaying the biometric authentication failure animation in response to a determination that at least a portion of the biometric features does not meet the biometric authentication criteria provides the user with a visual feedback of the failure or error in the operation being performed and the user's operation is successful. You can quickly recognize that you haven't done it Providing improved visual feedback to the user includes (e.g., by providing feedback indicative of input that will cause the device to produce the intended result when operating and/or interacting with the device, thereby helping the user achieve the intended result. It improves the operability of the device and makes the user-device interface more efficient (by helping and reducing user mistakes), which additionally reduces the device's power usage and reduces battery power consumption by enabling users to use the device more quickly and efficiently. Improves lifespan.

In some examples, in response to the unsuccessful biometric authentication, the device (e.g., 100, 300, 500, 1500) displays an animation including an interface object (e.g., 1519) indicating that the biometric authentication was unsuccessful. do. Displaying an animation including an interface object indicating that the biometric authentication was not successful in response to the unsuccessful biometric authentication provides the user with a visual feedback of the failure or error in the operation being performed, and the user can It can help you quickly recognize that you haven't been successful. Providing improved visual feedback to the user includes (e.g., by providing feedback indicative of input that will cause the device to produce the intended result when operating and/or interacting with the device, thereby helping the user achieve the intended result. It improves the operability of the device and makes the user-device interface more efficient (by helping and reducing user mistakes), which additionally reduces the device's power usage and reduces battery power consumption by enabling users to use the device more quickly and efficiently. Improves lifespan.

In some examples, during animation, an interface object (eg, 1519) moves (eg, tilts and/or shifts) in a predetermined manner (eg, side to side) to indicate a failure. In some examples, the device (e.g., 100, 300, 500, 1500) generates a tactile output (e.g., 1526) or a sequence of tactile outputs corresponding to the biometric authentication failure animation (e.g., the tactile outputs are A simulation of the measurement feature is created as it moves back and forth). Outputting a tactile output or a sequence of tactile outputs corresponding to the biometric authentication failure animation further informs the user that the authentication has not been successful, and prompts the user that authentication is still required to perform the operation. To be able to identify. Providing improved tactile feedback to the user improves the operability of the device and makes the user-device interface more efficient, which additionally allows the user to use the device more quickly and efficiently, thereby reducing the power of the device. Reduces usage and improves battery life.

In some examples, the second representation of the simulation of the biometric feature (eg, 1519) is a three-dimensional object. Displaying the three-dimensional object as a second representation of the simulation of the biometric feature provides the user with easily recognizable visual feedback regarding the state of the operation (e.g., whether the transmission was successful or unsuccessful), and the object is Being three-dimensional, in addition, it makes it easier for users to perceive objects. Providing improved visual feedback to the user (e.g., by improving the readability of user interface elements to the user while the device is in natural viewing angles, thereby providing the user with appropriate inputs when operating and/or interacting with the device. It improves the operability of the device and makes the user-device interface more efficient (by helping users to use the device and reducing user mistakes), which in addition reduces the power usage of the device by allowing the user to use the device more quickly and efficiently. And improve battery life.

In some examples, the second representation (eg, 1519) is a three-dimensional face performing a head shake. In some examples, displaying the biometric authentication failure animation includes rotation of the second expression (e.g., 1519) in the first direction about an axis parallel to the display and an axis parallel to the display (e.g., 1502). And alternating between rotations in the second direction about the center. In some examples, displaying the biometric authentication failure animation includes highlighting the boundaries of the biometric authentication interface (eg, 1512) relative to the application interface (eg, 1506). In some examples, the biometric authentication interface (eg, 1512), or its boundary, is reduced and/or collapsed to create a visual “bounce” effect. In some examples, further, based on the biometric data, upon a determination that at least a portion of the biometric feature does not meet the biometric authentication criteria, the electronic device (e.g., 100, 300, 500, 1500) Provides a failure tactile output (eg, 1526) different from the enemy output (eg, 1520). In some examples, further, based on the biometric data, upon determining that at least a portion of the biometric feature does not meet the biometric authentication criteria, the electronic device (e.g., 100, 300, 500, 1500) For example, 1540 is displayed (1632). In some examples, the failure interface (eg, 1540) includes a visual indication that the biometric authentication has failed. In some examples, when biometric authentication fails, the application interface (eg, 1506) is unchanged (eg, the application remains on the login interface (eg, 1506) or the authentication user interface). In some examples, when biometric authentication fails, the application user interface (eg, 1506) is changed to indicate the failure of biometric authentication. In some examples, the failure interface (eg, 1540) includes a retry affordance (eg, 1546) (1634). In some examples, the failure interface (eg, 1540) includes a cancellation affordance (eg, 1548) (1636). In some examples, the failure interface (eg, 1540) includes an alternative authentication affordance (eg, 1544) (1638).

The electronic device (eg, 100, 300, 500, 1500) receives an input (eg, 1550) corresponding to the selection of a retry affordance (eg, 1546) (1640). In response to receiving an input (e.g., 1550) corresponding to the selection of a retry affordance (e.g., 1546), the electronic device (e.g., 100, 300, 500, 1500) may perform one or more biometric sensors (e.g., From 1503), second biometric data corresponding to at least a portion of the second biometric feature is acquired (1642). In some examples, the second biometric feature (eg, face) is the same biometric feature as the biometric feature from which initial biometric data was obtained. In some examples where the second biometric feature is the same biometric feature, a portion of the second biometric feature is a different portion of the same biometric feature from which the initial biometric data was obtained. In some examples, a portion is a same portion of the same biometric feature. In some examples, the second biometric feature is a different biometric feature than the initial biometric feature.

After obtaining second biometric data corresponding to at least a portion of the second biometric feature, based on the second biometric data, a determination is made that at least a portion of the second biometric feature satisfies the second biometric authentication criteria. Accordingly, the electronic device (e.g., 100, 300, 500, 1500) provides the application with second authentication information indicating that the second biometric authentication criteria have been satisfied with respect to one or more portions of the second biometric feature. (1646). In some examples, the second biometric authentication criteria are the same as the initial biometric authentication criteria. In some examples, the second biometric authentication criteria are different from the initial biometric authentication criteria. In some examples, the second authentication information is the same as the authentication information. In some examples, the second authentication information is different from the authentication information. In some examples, authentication information is provided by the operating system to an application that creates an application interface (eg, 1506).

The electronic device (eg, 100, 300, 500, 1500) receives an input corresponding to the selection of the cancellation affordance (1646). In response to receiving an input corresponding to the selection of the cancellation affordance, the electronic device (eg, 100, 300, 500, 1500) stops displaying the biometric authentication interface (eg, 1512) (1648). In some examples, selection of the cancellation affordance releases the failing interface (eg, 1540) while maintaining the application interface (eg, 1506). In some examples, the selection of the cancellation affordance also causes the electronic device (e.g., 100, 300, 500, 1500) to provide information to the application indicating that the first and/or second biometric authentication criteria have not been met. .

The electronic device (eg, 100, 300, 500, 1500) receives (1650) an input (eg, 1548) corresponding to the selection of an alternative authentication affordance (eg, 1544). Providing an alternative authentication affordance (e.g., to provide an alternative method for providing authentication as an alternative or in addition to biometric authentication) means that the current authentication method is unsuccessful or continues to be unsuccessful. In case it makes it easier for the user to provide authentication for the operation using different authentication methods. Providing additional control options (e.g., to provide authentication) in this manner without cluttering the UI with additional displayed controls allows the user to make appropriate inputs (e.g., when operating/interacting with the device). It improves the operability of the device and makes the user-device interface more efficient (by helping to provide and reducing user mistakes), which additionally reduces the power usage of the device by enabling users to use the device more quickly and efficiently. Reduce and improve battery life.

In response to receiving an input (e.g., 1548) corresponding to the selection of an alternative authentication affordance (e.g., 1544), the electronic device (e.g., 100, 300, 500, 1500) may perform an alternative authentication interface (e.g., 1562). Is displayed (1652). In some examples, the alternative authentication interface (eg, 1562) is a non-biometric authentication interface (eg, 1512). In some examples, an alternative authentication interface (eg, 1562) allows a user to authenticate using a password and/or passcode. In some examples, the application determines what form of authentication is accepted by the alternative authentication interface (eg, 1562). In some examples, one or more preferences of the application determine what form of authentication is accepted by the application. In some examples, an alternative authentication affordance (e.g., 1562) may include successive failures of biometric authentication in excess of a predefined number (e.g., 2 failed authentication attempts, 3 failed authentication attempts, 4 failed authentication failures). S, etc.) in response to the failure interface (eg, 1540). In some examples, the alternative authentication interface (eg, 1562) is an application level authentication interface (1654). In some examples, in response to receiving an input corresponding to the selection of an alternative authentication affordance (e.g., 1544), the electronic device (e.g., 100, 300, 500, 1500) uses a biometric authentication interface (e.g., 1512). Stop displaying (1656). In some examples, selection of an alternative authentication affordance (eg, 1544) causes the device (eg, 100, 300, 500, 1500) to stop displaying the alternative authentication affordance (eg, 1544) and at the application level. Transition to an alternative authentication interface (eg, 1562) that works. Thus, the user is optionally authenticated with the application using the credentials associated with the application (eg, the user optionally logs in using the user name and password for the application). In some examples, the application level alternative authentication interface (eg, 1562) optionally includes an affordance to re-initiate biometric authentication. This will in turn cause the electronic device (eg 100, 300, 500, 1500) to display the biometric authentication interface (eg, 1512) again and authenticate at the system or operating system level.

It is noted that the details of the processes described above with respect to method 1600 (eg, FIGS. 16A-16E) are also applicable in a similar manner to the other methods described. For example, method 1600 optionally incorporates one or more of the characteristics of the various methods described herein with reference to methods 800, 1000, 1200, 1400, 1800, 2000, 2200, 2500, 2700. Include. For example, the registered biometric data described in method 1200 may be used to perform biometric authentication, such as biometric authentication described with reference to FIGS. 15E to 15I. For another example, a biometric authentication interface as described in method 1800 can be used to implement a biometric authentication interface (eg, 1512). For brevity, these details are not repeated below.

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 16A-16E are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, the providing operation 1620 and the maintaining operation 1624 are optionally implemented by the event classifier 170, the event recognizer 180 and the event handler 190. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

17A-17AJ illustrate example user interfaces for biometric authentication, according to some examples. As described in more detail below, illustrative examples of user interfaces illustrated in FIGS. 17A-17A are used to illustrate the processes described below, including those of FIGS. 18A-18D.

17A illustrates an electronic device 1700 (eg, portable multifunction device 100, device 300, or device 500). In the illustrative example illustrated in FIGS. 17A-17AJ, the electronic device 1700 is a smartphone. In other examples, electronic device 1700 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 1700 has a display 1702, one or more input devices (eg, a touchscreen of the display 1702, a button 1704, a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 1703) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more biometric sensors 1703 are one or more biometric sensors 703. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 17A, the electronic device 1700 displays, on a display 1702, the landing page interface of an application including a login affordance 1706. As can be seen in Fig. 17A, the application is a browser or a mobile application, and the interface corresponds to a website (onlinestore.com). While displaying the landing page interface, electronic device 1700 detects activation of login affordance 1706. As shown in FIG. 17A, activation is a tap gesture 1708 on login affordance 1706.

In FIG. 17B, in response to detecting the tap gesture 1708 on the login affordance 1706, the electronic device 1700 displays a non-secure data fillable field 1710 (labeled "user name"), secure data fill. Display the application's application interface, including the enable field 1712 (labeled "password"), and the submission affordance 1714 (eg, replace the display of the landing page interface with it). The electronic device further displays a biometric authentication glyph (eg, an icon) within the secure data fillable field 1712. As described in further detail, the biometric authentication glyph indicates that the secure data fillable field 1712 is associated with the secure data and/or biometric authentication is required to automatically fill the secure data fillable field 1712. Indicates that.

While displaying the application interface, the electronic device 1700 detects a request to automatically fill in the non-secure data fillable field 1710. For example, as shown in FIG. 17B, the request to automatically fill in the non-secure data fillable field 1710 is a tap gesture 1718 indicating selection of the non-secure data fillable field 1710.

In FIG. 17C, in response to detecting a request to automatically fill in the unsecured data fillable field 1710, the electronic device 1700 may use a keyboard, such as a software keyboard, and/or a keypad and auto fill affordance 1722. Display the containing input interface 1720 (eg, overlay on the application interface). While displaying input interface 1720, electronic device 1700 detects activation of auto-fill affordance 1722. For example, as shown in FIG. 17A, the activation is a tap gesture 1724 on auto-fill affordance 1722.

In FIG. 17D, in response to detecting the tap gesture 1724, the electronic device displays a plurality of candidate input affordances 1725 for automatically filling the non-secure data fillable field 1710 (e.g., auto-fill affordance (1722) and/or replacing one or more other affordances of the input interface 1720). In the illustrated example, the fillable field 1710 is associated with a user name. Thus, in some examples, each of the candidate input affordances 1725 serves as a reference for each candidate user name.

While displaying candidate input affordances 1725 of input interface 1720, the electronic device detects activation of one candidate input affordance 1725. For example, as shown in FIG. 17D, activation is a tap gesture 1726 on one candidate input affordance 1725. In FIG. 17E, in response to detecting the tap gesture 1726, the electronic device 1700 automatically populates the non-secure data fillable field with a candidate input 1728 corresponding to the activated candidate input affordance 1725.

As described, in response to detecting the tap gesture 1724, the electronic device provides (eg, displays) candidate input affordances corresponding to the respective candidate inputs. In some examples, in response to detecting the tap gesture 1724, the electronic device determines whether multiple candidate inputs are available. If so, electronic device 1700 provides candidate input affordances as described. Any number of candidate input affordances are optionally provided in this manner. If not (eg, if only a single candidate input is available), the electronic device optionally automatically populates the unsecured data fillable field 1710 without providing candidate inputs.

Referring to FIG. 17F, while displaying the application interface, the electronic device 1700 detects a request to automatically fill in the secure data fillable field 1712. For example, a request to automatically fill in the secure data fillable field 1712 is a tap gesture 1730 indicating selection of the secure data fillable field 1712.

In FIG. 17G, in response to detecting a request to automatically fill in the secure data fillable field 1712, the electronic device 1700 initiates biometric authentication. In some examples, initiating biometric authentication includes obtaining data corresponding to the user's biometric features (eg, capturing with one or more biometric sensors). In some examples, initiating biometric authentication further includes displaying biometric authentication interface 1732 with biometric authentication glyph 1734. Biometric authentication glyph 1734 is, in some examples, a simulation of a representation of a biometric feature. Biometric authentication interface 1732 is overlaid on at least a portion of the application interface in some examples.

Referring to FIG. 17H, in response to obtaining the data, the electronic device processes the biometric data to determine whether the biometric feature satisfies the biometric authentication criteria, for example, based on the biometric data. (For example, it is determined whether the biometric data matches the biometric template, within a threshold). While the electronic device is processing biometric data, the electronic device optionally displays a biometric authentication glyph 1738 in the biometric authentication interface 1732 indicating that the biometric data is being processed (e.g., biometric authentication. Replace the display of glyph 1734 with it).

In FIG. 17I, the electronic device 1700 determines that the biometric feature satisfies the biometric authentication criteria. In response, the electronic device displays a biometric authentication glyph 1740 in the biometric authentication interface 1732 indicating that the biometric authentication was successful (e.g., replacing the display of the biometric authentication glyph 1738 with it. do). Additionally or alternatively, the electronic device outputs a tactile output 1742 indicating that the biometric authentication was successful. After indicating that the biometric authentication is successful, the electronic device automatically fills in the secure data fillable field with the appropriate password 1743, as shown in Fig. 17J. In some examples, the electronic device further automatically populates a second fillable field (eg, with a user name 1728), such as an unsecured fillable field 1710, in response to a successful biometric authentication. It will be appreciated that any number and/or type of fillable fields are optionally automatically populated in response to successful biometric authentication.

While displaying the application interface with automatically filled fillable fields 1710 and 1720, the electronic device detects activation of the submission affordance 1714. As an example, as shown in FIG. 17J, the activation is a tap gesture 1744 on the submission affordance 1714. In response, the user is optionally authenticated with the application, and the electronic device optionally represents a home interface, such as home interface 1802 of FIG.

Alternatively, in FIG. 17K, the electronic device 1700 determines that the biometric feature does not meet the biometric authentication criteria. In response thereto, the electronic device displays a biometric authentication glyph 1746 indicating that the biometric authentication was unsuccessful (e.g., failed) in the biometric authentication interface 1732 (e.g., biometric authentication glyph 1738 ) To replace the display). Optionally, the electronic device outputs a tactile output 1750 indicating that the biometric authentication was not successful. In some examples, tactile output 1750 is the same as tactile output 1742. In some examples, tactile output 1750 is different than tactile output 1742. After indicating that the biometric authentication was not successful, the electronic device stops displaying the biometric authentication interface, as illustrated in Fig. 17L.

In some examples, biometric authentication interface 1732 includes an animation and/or one or more of the biometric authentication glyphs of biometric authentication interface 1732 are animated. As an example, biometric authentication glyph 1738 includes rings with spherical rotation and/or biometric authentication glyph 1746 moves left and right to simulate a "shake" movement.

Referring to FIG. 17M, in some examples, additionally, in response to unsuccessful biometric authentication, electronic device 1700 displays a failure interface, such as failure interface 1751. The failure interface includes a biometric authentication glyph 1754, an alternative authentication affordance 1756, a retry affordance 1758, and a cancellation affordance 1760. In some examples, activation of retry affordance 1758 causes the electronic device to re-initiate biometric authentication, as described above. In some examples, the electronic device performs biometric authentication only if a threshold number of failed biometric authentication attempts have not been made. In some examples, activation of the cancellation affordance causes the electronic device 1700 to stop displaying the failure interface 1752.

Referring to Figure 17N, in response to activation of an alternative authentication affordance 1756, such as a tap gesture 1762, the electronic device 1700 displays an alternative authentication interface 1766 (Figure 17O) (e.g., It replaces the display of the failure interface 1752), whereby the user can use an alternative form of authentication (e.g., fingerprint authentication, password authentication, passcode authentication, pattern authentication, pattern authentication) in addition to the authentication associated with the biometric feature. Authentication includes selection of a plurality of items in a predefined pattern or movement of a contact or other input in a predefined pattern). As shown in Fig. 17o, the user selectively touches the fingerprint sensor 1764 of the electronic device with a finger to authenticate.

17P illustrates another example failure interface 1766 including an alternative authentication affordance 1770. Referring to FIG. 17Q, while displaying the failure interface 1766, the electronic device 1766 detects activation of an alternative authentication affordance 1770. As an example, activation is a tap gesture 1776 on login affordance 1770. In response to detecting the tap gesture 1776, the electronic device 1700 displays an alternative authentication interface 1778. In some examples, alternative authentication interface 1778 is a password (or passcode) interface that allows a user to provide a password (or passcode) to authenticate.

In FIG. 17R, in response to authentication (e.g., alternative authentication), the secure data fillable field is automatically populated with a password 1743, and optionally, the non-secure data fillable field is automatically populated with the user name 1728. . In this way, the user can optionally build an auto-fill function despite unsuccessful biometric authentication. While displaying the application interface with automatically filled fillable fields 1710 and 1720, the electronic device detects activation of the submission affordance 1714. As an example, the activation is a tap gesture 1780 on submission affordance 1714. In response, the user is selectively authenticated with the application, and the electronic device optionally displays a home interface, such as home interface 1802 of FIG. 17S.

In FIG. 17T, electronic device 1700 displays, on display 1702, an application interface 1784 including secure data fillable field 1786. In response to a request to automatically populate secure data fillable field 1786 (e.g., selection of secure data fillable field 1786), electronic device 1700 may, as illustrated, provide auto fill affordance 1790. An input interface 1788 including a is displayed.

While displaying auto-fill affordance 1790 of input interface 1788, electronic device 1700 detects activation of auto-fill affordance 1790. For example, as shown in FIG. 17U, the activation is a tap gesture 1792 on auto fill affordance 1792.

17V to 17X, in response to detecting the tap gesture 1792, the electronic device 1700 initiates biometric authentication, which is determined based on the biometric data corresponding to the biometric feature. It is determined whether at least a portion of the same, biometric feature satisfies at least the biometric authentication criteria, described with reference to FIGS. 17G-17I.

In FIG. 17Z, in response to successful biometric authentication, the electronic device 1700 includes a candidate selection interface 1794 including a plurality of candidate input affordances 1792 for automatically filling the secure data fillable field 1786. (E.g., replacing the display of biometric authentication interface 1732 with it). In some examples, candidate selection interface 1794 is displayed without a keyboard. In the illustrated example, fillable field 1786 is associated with credit cards (eg, fillable field 1786 is flagged as associated with financial transactions). Thus, in some examples, each of the candidate input affordances 1792 serves as a reference to a respective credit card (eg, a credit card number and/or one or more other respective candidate values associated with the credit card).

While displaying candidate input affordances 1792, electronic device 1700 detects activation of one candidate input affordance 1792. For example, as shown in FIG. 17Z, the activation is a tap gesture 1795 on one candidate input affordance 1792. In FIG. 17Z, in response to detecting the tap gesture 1795, the electronic device 1700 automatically populates the secure data fillable field with a candidate input 1796 corresponding to the activated candidate input affordance 1792.

While displaying the application interface 1784 with the automatically filled fillable field 1788, the electronic device detects activation of the submission affordance 1798. As an example, the activation is a tap gesture 1702A on the submission affordance 1798. In response, an automatically filled credit card is optionally submitted using the application, for example for authentication or payment purposes.

In this specification, descriptions are made regarding performing biometric authentication prior to providing candidate input affordances when automatically filling secure data fillable fields, but in some examples, it is noted that candidate input affordances are provided prior to biometric authentication. Will make sense. Referring to FIG. 17AA, for example, in response to a request to automatically fill in the secure data fillable field 1786, the electronic device 1700 displays an input interface including a plurality of candidate input affordances 1704A. do. Each of the candidate inputs 1704A is a reference (eg, a representation thereof) to a candidate input value in some examples.

As illustrated in FIG. 17A, while displaying an input interface including a plurality of candidate input affordances 1704A, the electronic device detects activation of one candidate input affordance 1704A. As an example, activation is a tap gesture 1706A on one candidate input affordance 1704A. 17A through 17A, in response thereto, the electronic device performs biometric authentication as described. In FIG. 17Af, the electronic device 1700 has determined that the biometric authentication was successful, and automatically populates the secure data fillable field 1786 with the selected candidate input corresponding to the selected candidate input affordance 1704A.

In Fig. 17AG, the electronic device instead determines that the biometric authentication has not been successful. In response thereto, the electronic device 1700 stops displaying the biometric authentication interface, as illustrated in FIG. 17A.

As mentioned above, the illustrative examples of user interfaces illustrated in FIGS. 17A to 17A described above relate to the exemplary examples of user interfaces illustrated in FIGS. 18A to 18A described below. Accordingly, the processes described above in connection with the exemplary user interfaces illustrated in FIGS. 17A-17A and the processes described below in connection with the exemplary user interfaces illustrated in FIGS. , 100, 300, 500, 700) are very similar processes involving initiating and managing transmissions.

18A-18D are flow charts illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. The method 1800 includes a device with a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 1700). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric feature by one or more biometric sensors. Some operations of method 1800 are selectively combined, the order of some operations is selectively changed, and some operations are optionally omitted.

As described below, method 1800 provides an intuitive method for performing authentication of biometric features. This method reduces the user's cognitive burden for performing authentication of biometric features, thereby creating a more efficient human-machine interface and intuitive user experience. In the case of battery-operated computing devices, enabling a user to manage the authentication of biometric features faster and more efficiently saves power and increases the time between battery charges.

In some examples, the electronic device (eg, 100, 300, 500, 1700) detects a selection of a fillable field (eg, 1710, 1712, 1786) (1802). In some examples, in response to detecting the selection of a fillable field (e.g., 1710, 1712, 1786), the electronic device (e.g., 100, 300, 500, 1700) An input interface (eg, 1720, 1788) including a plurality of user interface objects (eg, 1725, 1793, 1704A) corresponding to candidate inputs for (1786) is displayed (1804).

In some examples, prior to receiving a request (e.g., 1718, 1724, 1726, 1730, 1792, 1795, 1706A) to automatically fill at least one fillable field (e.g., 1710, 1712, 1786), the electronic device ( For example, 100, 300, 500, 1700 receives a selection (eg, 1718, 1730) of a fillable field (eg, 1710, 1712, 1786). In some examples, selection of a fillable field (e.g., 1710, 1712, 1786) (e.g., 1718, 1730) is a fillable field (e.g., 1710, 1730) displayed within the application interface using an input device such as a mouse or button. 1712, 1786). In some examples, in response to selection of a fillable field (e.g., 1710, 1712, 1786), the electronic device (e.g., 100, 300, 500, 1700) displays an auto-fill affordance (e.g., 1722, 1790) ( 1806). In some examples, auto-fill affordances (eg, 1722, 1790) are displayed in combination with a keyboard (or keypad).

In some examples, the electronic device (eg, 100, 300, 500, 1700) displays (1808) an application interface including a fillable field (eg, 1710, 1712, 1786) on the display. Displaying the application interface including the fillable field provides visual feedback to the user indicating that input may be made to a specific area of the application interface. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, displaying, on a display (e.g., 1702), an application interface that includes a fillable field (e.g., 1710, 1712, 1786), means that the fillable field (e.g., 1712, 1786) is of the second type. As associated with the data, displaying (1810) a fillable field (eg, 1712, 1786) using a first visual processing. Displaying a fillable field using a specific visual processing (e.g., first visual processing) as the fillable field is associated with a specific type (e.g., a second type) of data means that the fillable field is associated with a specific data type. It provides visual feedback that allows the user to quickly and easily recognize that it is. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the second type of data includes data requiring authentication in order to be automatically populated, such as payment information, password, and/or username. In some examples, the first visual processing is a visual effect, such as a specific color scheme, highlighting, or animation. In some examples, the first visual processing includes a first color scheme, such as a pattern of one or more colors. In some examples, the first visual processing includes a biometric authentication interface object (eg, 1716) associated with (eg, within or adjacent to) a fillable field (eg, 1712, 1786).

In some examples, the electronic device (e.g., 100, 300, 500, 1700) displays a biometric authentication glyph (e.g., 1716) or icon in or near fields associated with the biometric authentication (e.g., 1712, 1786). Display, which is not displayed in or near fields that are not associated with biometric authentication (eg, 1710). Displaying a biometric authentication glyph or icon in or near fields associated with biometric authentication and not displaying a biometric glyph or icon in or near fields not associated with biometric authentication means that certain fields It provides easily recognizable visual feedback as to whether biometric authentication is associated with and requires it and which fields are neither associated with biometric authentication nor require it. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, displaying, on the display, an application interface including a fillable field, creates a fillable field (e.g., 1710), as the fillable field (e.g., 1710) is associated with the first type of data. Displaying 1812 using a second visual processing different from the one visual processing. In some examples, the first type of data includes data that does not require authentication in order to be automatically populated, such as contact information, including name, address, phone number, zip code, and the like. In some examples, the second visual processing is that there is no first visual processing. In some examples, the electronic device (e.g., 100, 300, 500, 1700) can fill in a fillable field (e.g., 1712, 1786), a different color, biometric authentication glyph (e.g., 1716), and/or a fillable field ( For example, 1712, 1786) are optionally highlighted with text indicating that they are automatically populated in response to a successful biometric authentication. In some examples, the second visual treatment includes a second color scheme different from the first color scheme. Thus, in some examples, the electronic device (e.g., 100, 300, 500, 1700) includes fields associated with biometric authentication (e.g., 1712, 1786), and fields not associated with biometric authentication (e.g., 1710). ) And display using a different color.

In some examples, displaying, on the display, an application interface comprising a fillable field (e.g., 1710, 1712, 1786), displays a webpage comprising a fillable field (e.g., 1710, 1712, 1786). It includes one (1814). In some examples, the application interface further includes a submission affordance (eg, 1714, 1798) associated with a fillable field (eg, 1710, 1712, 1786).

In some examples, while displaying the application interface, the electronic device (e.g., 100, 300, 500, 1700) requests to automatically fill in the fillable field (e.g., 1710, 1712, 1786) of the application interface (e.g., 1718, 1724, 1726, 1730, 1792, 1795, 1706A) is received (1816). In some examples, the request is a selection of an autofill affordance (e.g., 1722, 1790) (e.g., 1724, 1792), selection of a field (e.g., 1718, 1730), selection of candidate text input (e.g., 1726, 1795, 1706A). ), loading a webpage, or any combination thereof. In some examples, receiving a request to automatically fill in at least one fillable field (e.g., 1710, 1712, 1786) of an application interface includes a display (e.g., 100, 300, 500, 1700) of an electronic device (e.g. And receiving (1818) a selection of an auto fill affordance (eg, 1722, 1790) displayed on 1702. In some examples, in response to a selection of a field (e.g., 1710, 1712, 1786) (e.g., 1710, 1712, 1786), the electronic device (e.g., 100, 300, 500, 1700) is a fillable field (e.g., 1710). , 1712, 1786) and displays a keyboard (or keypad) that includes an affordance (eg, 1722, 1790) to automatically fill. In response to selection of affordance, the electronic device (eg, 100, 300, 500, 1700) initiates biometric authentication. In some examples, receiving a request to automatically fill in at least one fillable field (e.g., 1710, 1712, 1786) of the application interface includes selection of a fillable field (e.g., 1710, 1712, 1786) (e.g., 1718, 1730) and receiving 1820.

In some examples, in response to selection of a fillable field (e.g., 1710, 1712, 1786), the electronic device (e.g., 100, 300, 500, 1700) is Initiate measurement certification. Initiating biometric authentication without displaying an input interface in response to selection of a fillable field allows a user to quickly and efficiently initiate biometric authentication with minimal input. Reducing the number of inputs required to perform an operation improves the operability of the device and improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). -Make the device interface more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the input interface (e.g., 1720, 1788) is displayed in response to selection of fields of a first type (e.g., 1786) (e.g., a credit card field), and fields of a second type (e.g., 1712) ) Is not displayed in response to selection of (eg, password field). In some examples, receiving a request to automatically fill at least one fillable field (e.g., 1710, 1712, 1786) of the application interface includes a reference (e.g., 1725) corresponding to a candidate input associated with the second type of data. , 1793, 1704A) (e.g., 1726, 1795, 1706A). In some examples, the electronic device (e.g., 100, 300, 500, 1700) is one or more candidate inputs that can be used (e.g., upon selection) to automatically fill a fillable field (e.g., 1710, 1712, 1786). One or more references (e.g., 1725, 1793, 1704A) corresponding to these are provided. In some examples, the reference is, for example, a reference to a credit card (eg, “CC1”) or a reference to a password (“Facebook password”). In some examples, the reference is the candidate itself (eg, an email address such as “test@test.com”). In some examples, the selection of a reference (eg, 1725, 1793, 1704A) for the candidate input (eg, 1726, 1795, 1706A) is a selection of affordance of the software keyboard. In some examples, the keyboard is a keypad. In some examples, receiving the request to automatically fill in at least one fillable field of the application interface includes selection 1824 of a fillable field of the webpage. In some examples, receiving a request to automatically fill in a fillable field of an application interface includes a selection of a user interface object (e.g., 1725, 1793, 1704A) corresponding to each candidate input of a plurality of candidate inputs (e.g. , 1726, 1795, 1706A). In some examples, in response to selection of the fillable field, the electronic device (eg, 100, 300, 500, 1700) provides candidate inputs (eg, 1725, 1793, 1704A) for selection by the user. After that, the electronic device (eg, 100, 300, 500, 1700) performs biometric authentication. In some examples, the electronic device (e.g., 100, 300, 500, 1700) identifies all fillable fields (e.g., 1710, 1712, 1786) and/or fields (e.g., 1710) when the application interface is loaded. , 1712, 1786) of one or more fields are determined. In some examples, automatically filling in this manner reduces the number of inputs required to automatically populate a fillable field (eg, 1710, 1712, 1786). In some examples, the request to automatically fill in a fillable field (eg, 1710, 1712, 1786) is based on detection of loading a webpage that includes a fillable field (eg, 1710, 1712, 1786).

In some examples, in response to receiving a request to automatically populate a fillable field (e.g., 1710, 1712, 1786) of the application interface (1828), a fillable field of the application interface (e.g., 1710, 1712, 1786). Upon determining that is associated with the first type of data, the electronic device (e.g., 100, 300, 500, 1700) automatically populates the fillable field (e.g., 1710, 1712, 1786) with data of the first type ( 1830). Automatically filling a fillable field with a particular type of data (e.g., data of a first type) based on a determination that a fillable field of the application interface is associated with a particular type of data (e.g., data of a first type) Avoids having to manually enter data into fillable fields in the application interface. Reducing the number of inputs required to perform an operation improves the operability of the device and improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). -Make the device interface more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the first type of data includes unsecured or unsecured (eg, not biometrically secured) data. In some examples, the non-secure data is a given name, nickname, publicly available phone number of the user, or a preference associated with a particular field (eg, shoe size for a shoe size field). In some examples, automatically filling a fillable field (e.g., 1710, 1712, 1786) may further authenticate the field in response to a request (e.g., 1718, 1724, 1726, 1730, 1792, 1795, 1706A). Populating with data accessible to an electronic device (e.g., 100, 300, 500, 1700) or stored by an electronic device (e.g., 100, 300, 500, 1700) without requiring (e.g., additional biometric authentication) Includes (populating).

In some examples, additionally, in response to a request to automatically populate a fillable field (e.g., 1710, 1712, 1786) of the application interface, the fillable field (e.g., 1710, 1712, 1786) of the application is of a second type. Depending on the determination that it is associated with the data of (1832), from one or more biometric sensors (e.g., 1703), while obtaining data corresponding to the biometric feature (e.g., during at least part of the acquisition process), the electronic device (E.g., 100, 300, 500, 1700) displays a biometric authentication interface (e.g., 1732) (1834). Displaying the biometric authentication interface according to a determination that the fillable field of the application is associated with a particular type of data (e.g., a second type of data) means that the data is of a particular type (e.g., a second type of data). In this case, device security is improved by requiring security verification measures. Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life.

In some examples, the second type of data is secure data (eg, biometric secure data). In some examples, the secure data includes password information, credit card information, private user information such as an unlisted phone number, or medical information. In some examples, the electronic device (eg, 100, 300, 500, 1700) displays a biometric authentication interface (eg, 1732) while performing biometric authentication. In some examples, the biometric authentication interface is displayed over at least a portion of the application interface. In some examples, displaying the biometric authentication interface includes displaying a biometric authentication animation. In some examples, the biometric authentication animation is an initial animation (e.g., a display of a first biometric authentication glyph (e.g., 1734)), a processing animation (e.g., rotating rings indicating that biometric data is being processed), and success. Includes either animation or failure animation. In some examples, the failure animation is the same as the initial animation. These features are described in more detail above with reference to FIGS. 15A-15T. In some examples, the biometric authentication interface includes a representation of a simulation of the biometric feature (eg, 1734, 1738, 1740, 1746) (1836). In some examples, the biometric authentication interface includes a representation of a simulation of a biometric feature (eg, 1734, 1738, 1740, 1746) indicating a state of the biometric authentication sequence. In some examples, the biometric feature is a face, and the expression (eg, 1734, 1738, 1740, 1746) is a simulation of the face.

In some examples, additionally, in response to a request to automatically populate a fillable field and upon determining that the fillable field of the application is associated with a second type of data, the electronic device (e.g., 100, 300, 500, 1700 ) Determines whether multiple candidate inputs (eg, associated with the second type of data) are stored on the electronic device (eg, 100, 300, 500, 1700). Additionally, in some examples, depending on the determination that multiple candidate inputs (e.g., 1793, 1704A) associated with the second type of data are stored on the electronic device (e.g., 100, 300, 500, 1700), the electronic A device (eg, 100, 300, 500, 1700) displays multiple candidates. Additionally, in some examples, the electronic device (eg, 100, 300, 500, 1700) receives a selection of one of the displayed multiple candidate inputs. Additionally, in some examples, in response to receiving a selection of candidate input (e.g., 1704A), the electronic device (e.g., 100, 300, 500, 1700), from one or more biometric sensors (e.g., 1703) , Acquiring data corresponding to at least a portion of the biometric features. In some examples, automatically filling a fillable field (e.g., 1712, 1786) with a second type of data includes automatically filling a fillable field (e.g., 1712, 1786) with a selected candidate input (e.g., 1704A). Include. In some examples, the electronic device (e.g., 100, 300, 500, 1700) determines whether multiple candidate inputs are stored on the electronic device (e.g., 100, 300, 500, 1700) prior to performing biometric authentication. Decide. In some examples, once the user has selected a candidate input (eg, 1704A), the electronic device (eg, 100, 300, 500, 1700) performs biometric authentication.

In some examples, further, in response to a request to automatically fill a fillable field (e.g., 1710, 1712, 1786) and based on data obtained from one or more biometric sensors corresponding to the biometric feature. Upon determining that at least a portion of the biometric feature, which is, meets the biometric authentication criteria (1838), the electronic device (e.g., 100, 300, 500, 1700) fills the fillable field (e.g., 1710, 1712, 1786). It is automatically populated with data of the second type (1840). Automatically filling a fillable field with a particular type (e.g., a second type) of data upon determination that at least a portion of the biometric feature satisfies the biometric authentication criteria allows the user to manually enter data into the fillable field. Avoid what to do. Reducing the number of inputs required to perform an operation improves the operability of the device and improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). -Make the device interface more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, if biometric authentication is successful, the electronic device (eg, 100, 300, 500, 1700) automatically fills in a fillable field (eg, 1712, 1786) with information in response to the request. Automatically filling in the fillable field avoids having to manually enter data in the fillable field. Reducing the number of inputs required to perform an operation improves the operability of the device and improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). -Make the device interface more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, in response to receiving a request (e.g., 1718, 1724, 1726, 1730, 1795, 1706A) to automatically fill a fillable field (e.g., 1712, 1786) of the application interface, the electronic device (e.g., 100, 300, 500, 1700 obtains data corresponding to at least a portion of the biometric feature from one or more biometric sensors. In some examples, data obtained from one or more biometric sensors is obtained prior to receiving a request to automatically fill in a fillable field of an application interface. In some examples, data obtained from one or more biometric sensors is obtained in response to receiving a request to automatically fill a fillable field (eg, 1712, 1786) of an application interface. In some examples, data obtained from one or more biometric sensors (eg, 1703) is obtained in accordance with a determination that a fillable field of the application (eg, 1712, 1786) is associated with a second type of data. In some examples, the electronic device (e.g., 100, 300, 500, 1700), in response to a request to automatically fill in a fillable field, does not display an input interface (e.g., 1720) (e.g., a keyboard or keypad). Fillable fields (e.g., 1712, 1786) are automatically filled. In some examples, one or more biometric sensors (eg, 1703) includes a camera (eg, an IR camera or a thermographic camera). In some examples, data obtained from one or more biometric sensors (eg, 1703) corresponding to the biometric feature includes biometric data obtained using a camera. In some examples, the biometric feature is a face. In some examples, the data obtained from one or more biometric sensors (e.g., 1703) corresponding to the biometric feature includes biometric data associated with a portion of the face, and the biometric authentication criteria are biometric authentication criteria The biometric data associated with the face is matched to the biometric data associated with the applied face in order to be satisfied.

In some examples, upon a determination that the electronic device (e.g., 100, 300, 500, 1700) has accessed a single candidate value of the second type for filling in a fillable field (e.g., 1712, 1786), the electronic device (e.g., 100, 300, 500, 1700) automatically fills the fillable field (eg, 1712, 1786) with data of the second type. In some examples, upon a determination that the electronic device (eg, 100, 300, 500, 1700) has accessed a number of candidate values of the second type for automatically filling in a fillable field (eg, 1712, 1786), the electronic device (Eg, 100, 300, 500, 1700) displays representations of a plurality of multiple candidate values. In some examples, the candidate values are stored directly on the device and/or from another electronic device (e.g., 100, 300, 500, 1700) connected to the electronic device (e.g., 100, 300, 500, 1700). (E.g., 100, 300, 500, 1700) are accessible. In some examples, while displaying representations of a plurality of multiple candidate values (e.g., 1725, 1793, 1704A), the electronic device (e.g., 100, 300, 500, 1700) (E.g., 1726, 1795, 1706A) of the representation of (e.g., 1725, 1793, 1704A), and in some examples, automatically populates the fillable field (e.g., 1712, 1786) with each candidate value. In some examples, the electronic device (eg, 100, 300, 500, 1700) determines whether the electronic device (eg, 100, 300, 500, 1700) has accessed multiple instances of the second type of data. . In some examples, in response to a successful biometric authentication, the electronic device (e.g., 100, 300, 500, 1700), of the biometric security data, e.g., multiple candidate inputs (e.g., candidate credit cards) Determines whether this is stored on the device If so, the electronic device (eg, 100, 300, 500, 1700) presents (eg, displays) each of the candidates (eg, 1725, 1793, 1704A) to the user. In response to a user selection (e.g., 1726, 1795, 1706A) of one of the candidates (e.g., 1725, 1793, 1704A), the electronic device (e.g., 100, 300, 500, 1700) uses the selected candidate to field (E.g. 1712, 1786) is automatically filled.

In some examples, based on data obtained from one or more biometric sensors, in accordance with a determination that at least a portion of the biometric feature does not satisfy biometric authentication criteria, an electronic device (e.g., 100, 300, 500, 1700) Pending automatically filling the fillable fields (eg, 1712, 1786) with data of the second type (1842). Withholding the automatic filling of the field with the selected candidate upon determination that at least some of the biometric features do not meet the biometric authentication criteria provides visual feedback by making the user aware that authentication was unsuccessful and , In addition, provides improved device security by withholding automatic filling of fillable fields without successful authentication. Providing improved visual feedback to the user (e.g., by improving the readability of user interface elements to the user while the device is in natural viewing angles, thereby providing the user with appropriate inputs when operating and/or interacting with the device. It improves the operability of the device and makes the user-device interface more efficient (by helping users to use the device and reducing user mistakes), which in addition reduces the power usage of the device by allowing the user to use the device more quickly and efficiently. And improve battery life. In addition, improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the device's operability by enabling the user to use the device more efficiently. Reduces power usage and improves battery life.

In some examples, based on data obtained from one or more biometric sensors, in accordance with a determination that at least a portion of the biometric feature does not satisfy biometric authentication criteria, an electronic device (e.g., 100, 300, 500, 1700) Displays (1844) an indication that at least a portion of the biometric feature does not satisfy the biometric authentication criteria. Displaying an indication that at least a portion of the biometric feature has not satisfied the biometric authentication criteria provides visual feedback by allowing the user to quickly recognize that authentication has not been successful. Providing improved visual feedback to the user (e.g., by improving the readability of user interface elements to the user while the device is in natural viewing angles, thereby providing the user with appropriate inputs when operating and/or interacting with the device. It improves the operability of the device and makes the user-device interface more efficient (by helping users to use the device and reducing user mistakes), which in addition reduces the power usage of the device by allowing the user to use the device more quickly and efficiently. And improve battery life. In some examples, in response to the failed biometric authentication, the electronic device (eg, 100, 300, 500, 1700) provides an indication of failure. In some examples, the electronic device (eg, 100, 300, 500, 1700) indicates “biometric feature not recognized” or “biometric authentication disabled” when a threshold number of biometric attempts is reached. Display a message indicating In some examples, after the failure, the electronic device (e.g., 100, 300, 500, 1700) removes any biometric authentication interface displayed over the application interface and/or provides a biometric authentication retry affordance (e.g., 1758). Display (e.g., within a fillable field (e.g., 1712)), a selection of which retry biometric authentication. In some examples, in response to determining that at least a portion of the biometric feature does not meet the biometric authentication criteria, the device displays data (e.g., username, password, passcode, etc.) in a fillable field (e.g., 1712, 1786). Display a keypad or keyboard for entering contact information, credit card information, etc.).

In some examples, based on data obtained from one or more biometric sensors, according to a determination that at least a portion of the biometric feature does not satisfy biometric authentication criteria, an electronic device (e.g., 100, 300, 500, 1700) Stops displaying the biometric authentication interface. In some examples, after the failed biometric authentication, the electronic device (eg, 100, 300, 500, 1700) stops displaying the biometric authentication. As a result, the electronic device (eg, 100, 300, 500, 1700) resumes display of the application interface, such as the application's login interface (eg, 1714).

In some examples, based on data obtained from one or more biometric sensors, in accordance with a determination that at least a portion of the biometric feature does not satisfy biometric authentication criteria, an electronic device (e.g., 100, 300, 500, 1700) Displays an input interface (eg, 1720). In some examples, the input interface (eg, 1720) includes a keypad or keyboard that includes character entry keys for entering a password or passcode.

In some examples, upon determining that biometric authentication is not available, the electronic device (eg, 100, 300, 500, 1700) prompts the user for an alternative form of authentication. Prompting the user for an alternative form of authentication upon determining that biometric authentication is not available makes it easy for the user to provide authentication for the operation using a different authentication method. Providing additional control options (e.g., to provide authentication) in this manner without cluttering the UI with additional displayed controls allows the user to make appropriate inputs (e.g., when operating/interacting with the device). It improves the operability of the device and makes the user-device interface more efficient (by helping to provide and reducing user mistakes), which additionally reduces the power usage of the device by enabling users to use the device more quickly and efficiently. Reduce and improve battery life.

In some examples, because a threshold number of failed biometric authentication attempts have been reached since the last successful authentication by the device, or because the biometric sensor is hot, cold, lighting (e.g., because the device detects characteristics of the biometric feature). Biometric authentication fails because there is not enough light or too much light), or because it cannot be used due to other environmental conditions. In some examples, after prompting the user for an alternative form of authentication (e.g., a passcode, password, or other form of biometric authentication such as a fingerprint), the electronic device (e.g., 100, 300, 500, 1700) Receive an alternative form of authentication. In some examples, additionally, after prompting the user for an alternative form of authentication, in response to receiving the alternative form of authentication, authentication information (e.g., a previously stored fingerprint, Upon determining that it matches the password, or passcode, the electronic device (eg, 100, 300, 500, 1700) automatically fills in the fillable field (eg, 1712, 1786). In some examples, additionally, after prompting the user for an alternative form of authentication, and in addition, in response to receiving the alternative form of authentication, the alternative form of authentication does not match the authorized authentication information. In accordance with the determination, the electronic device (eg, 100, 300, 500, 1700) withholds automatically filling the fillable field (eg, 1712, 1786).

In some examples, after responding to the request to automatically fill in the fillable field of the application interface, the electronic device (eg, 100, 300, 500, 1700) receives a subsequent request to load a webpage. In some examples, additionally, after responding to a request to automatically fill in a fillable field (e.g., 1710, 1712, 1786) of the application interface, in response to a subsequent request to load the webpage, a subsequent request to load the webpage Upon determining that the request meets the authentication retry criteria, the electronic device (e.g., 100, 300, 500, 1700) will automatically fill in the fillable field (e.g., 1710, 1712, 1786) in the application interface. Try. In some examples, additionally, after responding to a request to automatically fill in a fillable field (e.g., 1710, 1712, 1786) of the application interface, and in addition, in response to a subsequent request to load the webpage, the webpage The electronic device (e.g., 100, 300, 500, 1700) automatically fills in a fillable field (e.g., 1710, 1712, 1786) in the application interface upon a determination that the subsequent request to load it does not meet the authentication retry criteria. Hold biometric authentication attempts to fill. In some examples, loading the webpage conditionally triggers automatic filling based on predetermined criteria. For example, loading a webpage is handled as a request to automatically fill in the fillable fields on the webpage when the webpage is first loaded, but the webpage is loaded within a predetermined time period (e.g., 5 minutes, 1 hour). , Or within 1 day) the second time it is loaded, the second time the webpage is loaded, it is not so processed. In some examples, the authentication retry criteria include at least one of a requirement that the webpage has not been loaded within a predetermined time or that the webpage has not loaded during the same session. In some examples, the requirement is that the loading is the first instance of loading within a predetermined time and/or the loading is the first instance of loading within the session.

In some examples, after automatically filling a fillable field (e.g., 1710, 1712, 1786) with a first type of data or a second type of data, the electronic device (e.g., 100, 300, 500, 1700) (E.g., 1714, 1798). In some examples, in response to receiving the selection of the submission affordance, the electronic device (eg, 100, 300, 500, 1700) stops displaying the application interface. In some examples, in addition, in response to receiving the selection of the submission affordance, the electronic device (eg, 100, 300, 500, 1700) displays a second interface (eg, 1782) generated by the application. In some examples, displaying the second interface includes replacing the application's login user interface with the application's user interface (eg, 1782) that includes the protected information.

It is noted that the details of the processes described above with respect to method 1200 (eg, FIGS. 18A-18D) are also applicable in a similar manner to the methods described herein. For example, method 1800 optionally includes one or more of the characteristics of the various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700. Include. For example, registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with FIGS. 17G-17K. For another example, one or more implantable interfaces as described in methods 2000 and 2700 are optionally displayed in response to receiving an input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 18A-18D are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, display operation 1808, receive operation 1816, and auto-fill operation 1830 are, optionally, implemented by event classifier 170, event recognizer 180 and event handler 190. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

19A-19A illustrate example user interfaces for biometric authentication, according to some examples. As described in more detail below, illustrative examples of user interfaces illustrated in FIGS. 19A-19A are used to illustrate the processes described below, including the processes of FIGS. 20A-20F.

19A illustrates an electronic device 1900 (eg, portable multifunction device 100, device 300, or device 500). In the illustrative example illustrated in FIGS. 19A-19A, the electronic device 1900 is a smartphone. In other examples, electronic device 1900 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 1900 has a display 1902, one or more input devices (eg, a touchscreen of the display 1902, a button 1904, a microphone (not displayed)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 1902) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more biometric sensors 1902 are one or more biometric sensors 703. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In Figure 19A, the electronic device wakes up from a low power (eg, display-off) state. As illustrated, in some examples, the electronic device 1900 wakes in response to a lift gesture 1906 performed by the user. 19B-19D, in response to a lift gesture 1906, the electronic device 1900 transitions from a low power state to a moderate power state (eg, display-dimmed). For example, in FIG. 19B, the display 1902 of the electronic device 1900 is disabled, and in response to the lift gesture 1906, the electronic device 1900 may have a predetermined value as shown in FIGS. 19C and 19D. The brightness of the display 1902 is gradually increased over the period. In some examples, the brightness of the display 1902 is increased according to a function such as a linear function. In some examples, when biometric authentication (e.g., face recognition authentication) is enabled, the device is immediately locked when a hardware button (e.g., sleep/wake button) is pressed, and in some examples, the device enters the sleep mode. Locked every time you transition.

19C and 19D, in some examples, the electronic device is locked while transitioning to and/or operating in a medium power state (e.g., the display is on, but not at full operating brightness) Display interface 1910. The locked interface includes, for example, a locked status indicator 1912, and, optionally, one or more notifications 1914. As shown, notification 1914 is a message notification associated with a messaging application indicating that the electronic device has received a new message from a contact stored on the electronic device (“John Appleseed”). In some examples, the medium power state is a locked state. Thus, while operating in a medium power state, the electronic device 1900 operates in a secure manner. As an example, while operating in a medium power state, the electronic device does not display the content of the message associated with notification 1914. In some examples, the locked state further corresponds to restrictions on access to other data (including other applications) and/or restrictions on allowed inputs.

In some examples, the electronic device 1900 further displays a flashlight affordance 1907 and a camera affordance 1908. In some examples, activation of flashlight affordance 1907 causes the electronic device to load a flashlight application. In some examples, activation of camera affordance 1908 causes electronic device 1900 to load a camera application.

In some examples, after transitioning to the medium power state (eg, in response to), the electronic device 1900 initiates biometric authentication (eg, facial recognition authentication). In some examples, initiating biometric authentication includes acquiring data corresponding to at least a portion of the user's biometric feature (eg, capturing with one or more biometric sensors). In some examples, when a (user's) face is detected, biometric authentication confirms the (user's) attention and intention to unlock by detecting that the user is open and facing the device.

19E-19G, when the electronic device 1900 determines that the biometric authentication is successful, the electronic device transitions from a medium power state to a high power state (eg, the display is not dimmed). For example, in FIG. 19D, the display of the electronic device 1900 is in a medium power state, and in response to successful biometric authentication, the electronic device 1900 is The brightness of the display 1902 is gradually increased over the determined period. In some examples, the brightness of the display 1902 is increased according to a function such as a linear function.

In some examples, during transition from a medium power state to a high power state, the electronic device 1900 displays the unlocked interface 1920. In some examples, while displaying the unlocked interface 1920, the electronic device displays an animation indicating that the electronic device is transitioning to a high power state. As illustrated in FIGS. 19E-19G, during transition, the electronic device displays an animation in which the locked state indicator 1912 transitions to the unlocked state indicator 1922 (FIG. 19G ). In some examples, displaying the animation includes displacing and/or increasing the size of the locked status indicator 1912 to display the unlocked status indicator 1913 (FIG. 19E), and unlocking. And raising and rotating the latch of the unlocked status indicator to display the status indicators (1921 in FIG. 19F and 1922 in FIG. 19G) respectively. In some examples, the degree of blurring of one or more objects of the locked state interface 1910 and/or the unlocked state interface 1920 changes during animation. In some examples, the electronic device 1900 further outputs a tactile output 1926 during or in response to a transition to a high power state (FIG. 19G ).

In some examples, the high power state is an unlocked state. Thus, while operating in a high power state, the electronic device 1900 operates in an unsecured manner (eg, secure data is accessible to an authenticated user). As an example, while operating in a high power state, as illustrated in FIG. 19G, the electronic device displays the content of the message associated with the notification 1914.

In some examples, biometric authentication (eg, facial recognition authentication) augments its stored mathematical expression over time in order to improve the unlocking performance and keep up with natural changes in the user's face and appearance. In some examples, upon successful unlocking, biometric authentication optionally uses a newly computed mathematical expression—if its quality is sufficient—for a finite number of additional unlocks before the data is discarded. In some examples, biometric authentication fails to recognize the user, but the matching quality is higher than a certain threshold and the user immediately fails (e.g., by entering an alternative authentication (e.g., passcode, password, pattern, fingerprint)). When following (within a predefined threshold time), the device takes another capture of the biometric data (e.g., via one or more cameras or other biometric sensors capturing facial recognition data) and into a newly calculated mathematical expression. Enhances his registered biometric authentication (eg, face recognition authentication) data. In some examples, this new biometric authentication (eg, facial recognition authentication) data is optionally discarded after a finite number of unlocks and when the user stops matching against it. These augmentation processes allow biometric authentication (eg, facial recognition authentication) to follow dramatic changes in the user's facial hair or makeup use, while minimizing false acceptance.

19E to 19G, when the electronic device 1900 determines that the biometric authentication has not been successful, the electronic device 1900 does not transition to a high power state, and in some examples, remains in a medium power state. do. In some examples, the electronic device 1900 remains locked while the electronic device 1900 remains in a medium power state. To indicate that the biometric authentication has failed, the electronic device 1900 displays the locked state, for example, by alternating the position of the locked state indicator 1912 between the two positions on the locked state interface 1910. The shake of the ruler 1912 is simulated. In some examples, the electronic device 1900 further outputs a tactile output 1918 to indicate that the biometric authentication was unsuccessful.

As described, while in the medium power state, the electronic device 1900 is in a locked state, and as a result, security data on the electronic device is not accessible while the electronic device is in the medium power state. As an example, in FIG. 19I, the electronic device detects a user input 1930 near the edge of the display 1902. As illustrated in FIGS. 19I-19K, user input 1930 is a swipe gesture that is, in some examples, a request to access the home screen interface of electronic device 1900. However, since the electronic device 1900 is in a modest power and locked state, in response to the swipe gesture, the electronic device 1900 slides the locked state interface 1910 upwards to allow the alternative authentication interface 1932 ) To display (eg, reveal), whereby the user is authenticated using an alternative form of authentication (eg, password authentication) other than the authentication associated with the biometric feature. An alternative authentication interface 1932 includes a locked status indicator 1934 and a prompt 1936, which prompts the user to enter a valid passcode when the electronic device 1900 is unlocked (and optionally , Transitioning to a high-power state).

In some examples, an alternative form of authentication (eg, passcode, password, or pattern) is required to unlock the device in certain situations. In some examples, an alternative form of authentication is required if the device has just been turned on or has been restarted. In some examples, an alternative form of authentication is required if the device has not been unlocked for more than a predetermined amount of time (eg, 48 hours). In some examples, an alternative form of authentication is required if the alternative form of authentication has not been used to unlock the device within a predetermined amount of time (eg, 156 hours). In some examples, the alternative form of authentication is a predetermined time that the alternative form of authentication has not been used to unlock the device for a predetermined time (e.g., 6.5 days) and biometric authentication (e.g., face recognition authentication) has passed. Required if it has not been used to unlock the device within the time (eg, the last 4 hours). In some examples, an alternative form of authentication is required when the device receives a remote lock command. In some examples, an alternative form of authentication is required after 5 unsuccessful attempts to match a face (via face recognition authentication) on the device. In some examples, an alternative form of authentication is required after initiating a power off/emergency SOS on the device and then canceling the power off/emergency SOS.

Referring to FIGS. 19L and 19M, in response to, at least in part, a tap gesture 1938 (FIG. 19L ), and, optionally, one or more other inputs representing additional alphanumeric digits of a valid passcode, the electronic device 1900. A valid passcode (or password) is received by As shown in Fig. 19N, once a valid passcode has been received, the electronic device is unlocked and displays a home screen interface 1933 (eg, replacing the display of an alternative authentication interface with it).

19O-19R, the device is operating in a high power (eg, unlocked) state and receives an input that is a request to access secure data on electronic device 1900. As an example, as shown in FIG. 19O, the electronic device 1900 is operating in a high power state, and as illustrated in FIG. 19P, a swipe gesture that is a request to access the home screen interface of the electronic device 1900 ( 1944). As further illustrated in FIGS. 19P-19R, in response to the swipe gesture 1944, the electronic device 1900 slides the unlocked state interface 1920 upward to open the home screen interface 1946. Display (eg, reveal).

19S-19U illustrate various ways in which an electronic device transitions from a high power (eg, an unlocked state) to a locked state, such as a medium power state or a low power state. In FIG. 19S, while displaying the unlocked status interface 1920 (as described at least in connection with FIG. 19G ), the electronic device 1900 receives activation of the unlocked status indicator 1922. Activation of the unlocked screen indicator 1922 is a tap gesture 1948 in some examples. 19V, in response to activation of the unlocked status indicator 1922, the electronic device transitions to a medium power state, and optionally, displays a locked status indicator 1912 and/or Provides tactile output 1952. In some examples, during transition to a medium power state, the electronic device displays an animation indicating that the electronic device 1900 is transitioning to a medium power state (or a low power state).

In FIG. 19T, while displaying home screen interface 1946 and while in the high power unlocked state, electronic device 1900 receives activation of button 1904. Activation of button 1904 is, in some examples, pressing and/or pressing of button 1904. In response to activation of button 1904, the electronic device transitions to a low power state (eg, as described at least with reference to FIG. 19B). In FIG. 19U, while displaying the home screen interface 1946, the electronic device 1900 receives activation of the unlocked screen indicator 1950 of the home screen interface 1946. Activation of the unlocked screen indicator 1922 is a tap gesture 1950 in some examples. In response to activation of the unlocked status indicator 1922, the electronic device transitions to a medium power state and, optionally, displays a locked status indicator 1910 (FIG. 19V).

In FIG. 19W, the electronic device 1900 displays a device setting interface 1954. The device settings interface includes a gaze enable setting 1955, which, when enabled, requires the user to be looking at the device for successful biometric authentication. When the setting is disabled, biometric authentication may be successful even if the authorized user is not looking at the device. The device settings interface 1954 further includes a biometric authentication enable setting 1956, which, when enabled, enables biometric authentication on the electronic device 1900. When the biometric authentication enable setting 1956 is disabled, biometric authentication is not available on the electronic device 1900.

For example, in FIG. 19W, electronic device 1900 receives activation of biometric authentication enable setting 1956. Activation of biometric authentication enable setting 1956 is a tap gesture 1958 in some examples. Since the biometric authentication enable setting 1956 is enabled as shown in FIG. 19W, the biometric authentication enable setting 1956 is performed in response to the tap gesture 1958, as shown in FIG. 19X. Disabled. In some examples, as a result, any request to access secure data on electronic device 1900 requires the user to authenticate using an alternative form of authentication. As an example, referring to FIGS. 19Y and 19Z, the electronic device 1900 detects a user input 1930 near the edge of the display 1902. As illustrated in FIGS. 19I-19K, user input 1930 is a swipe gesture that is, in some examples, a request to access the home screen interface of electronic device 1900. Referring to FIG. 19AA, since the biometric authentication enable setting 1956 is disabled, the electronic device 1900 slides the locked interface 1910 upward in response to a swipe gesture 1930. To display (eg, reveal) an alternative authentication interface 1932, whereby the user can provide a passcode to unlock the electronic device 1900.

In some examples, one or more elements displayed by electronic device 1900 are context-based. As illustrated in FIG. 19Ab, for example, the locked status indicator displayed by the electronic device is, in some cases, based on the location and/or type of the electronic device 1900.

20A-20F are flow charts illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. The method 2000 includes a device with a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 1900). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric feature by one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 2000 provides an intuitive method for performing authentication of biometric features. This method reduces the user's cognitive burden for performing authentication of biometric features, thereby creating a more efficient human-machine interface and intuitive user experience. In the case of battery-operated computing devices, enabling a user to manage the authentication of biometric features faster and more efficiently saves power and increases the time between battery charges.

In some examples, prior to detecting that the device wake criteria have been met, the electronic device performs a biometric registration process. In some examples, during biometric registration, the device requested that the face being registered include facial features indicative of the face looking at the electronic device during registration of the face in order to proceed with the biometric registration of the face. In some examples, the device outputs tactile, audio, and/or visual alerts during registration if the face is not looking at the electronic device during registration.

In some examples, the electronic device (eg, 100, 300, 500, 1900) detects that device wake criteria have been met (2002). In some examples, in response to detecting that the device wake criteria have been met, the electronic device transitions the electronic device from a first visual state (eg, a low power state) to a second visual state (eg, a moderate power state). Make it (2004). Transitioning from a first visual state (e.g., a low power state) to a second visual state (e.g., a medium power state) in response to detecting that the device wake criteria have been met, allows the user to manually provide one or more inputs. Thereby avoiding providing one or more inputs to transition the device from the first state to the second state. Performing an action (automatically) when a set of conditions is met without requiring additional user input (e.g., when operating the device and/or interacting with it, helps the user to provide appropriate inputs and avoids user mistakes). By reducing) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. .

In some examples, upon pressing of a button (eg, 1904), and/or displaying a notification (eg, 1914), wake criteria are met when the electronic device is lifted. In some examples, the first visual state is a display-off state, or a state in which the display of the electronic device is at 10% of the maximum brightness state. In some examples, the second visual state is a higher display brightness state than the first visual state (e.g., 10% if the display is off in the first state; 20% if the display is at 10% in the first state) . In some examples, the second visual state includes a first introductory screen (eg, 1910) displayed at a first brightness (2006). In some examples, while in the second visual state, the electronic device displays (2010) a fourth user interface object (eg, 1912) representing the visual state of the electronic device. In some examples, while in the second visual state, the electronic device displays (2012) a fifth user interface object (eg, 1912) representing the visual state of the electronic device. In some examples, one or more features of the electronic device (e.g., display (e.g., 1902), one or more biometric sensors (e.g., 1903), access to sensitive data such as the content of a microphone, applications and messages, The ability to perform destructive actions, such as deleting communications or photos, and the ability to perform communication operations, such as sending a new message and sharing content stored on the device), is the first visual state of the electronic device. Disabled (eg, powered off or operated with reduced functionality) while at (eg, while the device is in a locked state) (2008). In some examples, transitioning to the second visual state includes enabling one or more disabled functions of the electronic device. In some examples, transitioning to the second visual state includes bringing the device into a state in which one or more disabled components of the electronic device are enabled. In some examples, enabling one or more disabled functions includes enabling a display of the electronic device (eg, 1902), one or more biometric sensors (eg, 1903), and/or a microphone.

In some examples, after transitioning the device to a second visual state (2014), upon determining whether the biometric authentication criteria have been met, upon determining that a selectable option of the electronic device (e.g., 1955) is enabled, the electronic The device uses the first set of criteria as biometric authentication criteria. When determining whether the biometric authentication criteria have been met, using the first set of criteria as biometric authentication criteria according to the determination that the device's selectable option (e.g., 1955) is enabled, allows the user to use minimal input. Makes it easy to provide authentication information to the device. Performing an action (automatically) when a set of conditions is met without requiring additional user input (e.g., when operating the device and/or interacting with it, helps the user to provide appropriate inputs and avoids user mistakes). By reducing) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. .

In some examples, the first set of criteria is the requirement that the user's face was looking at the display of the electronic device (e.g., when determining whether to unlock the device and/or transition from a second visual state to a third visual state). Includes. In some examples, further, after transitioning the device to the second visual state, upon determining whether the biometric authentication criteria have been met, upon determining that the selectable option of the electronic device is not enabled, the electronic device The set of criteria is used as biometric authentication criteria. In some examples, the second set of criteria is the requirement that the user's face was looking at the display of the electronic device (e.g., when determining whether to unlock the device and/or transition from the second visual state to the third visual state). Does not include In some situations, the user may, for example, use an accessibility option to allow the user to see the device during biometric authentication, in order to have the user's face recognized by the device, by the device, a required gaze detection requirement ( For example, 1955) is enabled.

In some examples, after transitioning to the second state, the electronic device determines, by one or more biometric sensors, whether biometric capture criteria are met (2016). In some examples, the electronic device determines whether a biometric feature is present, for example, in the field of view of one or more biometric sensors. In some examples, determining whether the biometric capture criteria are met includes transitioning to a second visual state and determining whether the biometric capture criteria are satisfied after a first predetermined time (2018). In some examples, the electronic device detects the biometric feature immediately after transitioning to the second state. In some examples, the electronic device transitions to the second state and detects the biometric feature after a period of time. In some examples, upon determining that the biometric capture criteria are met, the electronic device provides, by one or more biometric sensors, biometric data associated with the biometric feature (2020). In some examples, once the electronic device has transitioned to a second visual state (recall that one or more biometric sensors are enabled before or during this transition), the electronic device uses one or more biometric sensors enabled. To capture biometric data.

In some examples, upon determining that biometric authentication criteria have been met based on biometric data provided by one or more biometric sensors (e.g., a biometric feature such as a face is authenticated by the device), the electronic device , Transitions the electronic device from the second visual state to a third visual state (eg, a high power state) (2022). Based on the biometric data provided by one or more biometric sensors, the device is brought from a second visual state (e.g., a medium power state) to a third visual state (e.g., high power state) upon determination that the biometric authentication criteria have been met. Transitioning to a state) avoids providing one or more inputs to transition the device from a second state to a third state by manually providing the one or more inputs. Performing an action (automatically) when a set of conditions is met without requiring additional user input (e.g., when operating the device and/or interacting with it, helps the user to provide appropriate inputs and avoids user mistakes). By reducing) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. .

In some examples, while the electronic device is in the third visual state, the display of the electronic device is lit at a second relatively high brightness. In some examples, the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state (2024). In some examples, during transitions from a first visual state to a second visual state, and from a second visual state to a third visual state, the display is high, from off state to low brightness, and finally, in response to authentication. Brightens continuously with brightness. In some examples, the transition to the second visual state transitions to a specific brightness, and the transition from the second visual state to the third visual state transitions starting from the specific brightness. In some examples, each increase is made according to the same function. In some examples, the transition to the second visual state includes enlarging at least each user interface element (e.g., 1912) displayed in the first visual state, and the transition to the third visual state comprises: Includes further magnifying elements (eg, 1912, 1913, 1921). In some examples, the second visual state indicates that the device is in a locked state, and the third visual state indicates that the device is in an unlocked state.

In some examples, further, upon determining that biometric authentication criteria have been met based on biometric data provided by one or more biometric sensors, the electronic device includes a fifth user interface object (e.g., 1912). The unlock animation is displayed (2026). Displaying an unlock animation including a user interface object (e.g., a fifth user interface object 1912) in response to a determination that biometric authentication criteria have been met based on biometric data provided by one or more biometric sensors. It provides visual feedback by allowing the user to quickly recognize that authentication was successful and the device was unlocked accordingly. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the fifth user interface object is a lock. In some examples, the unlock animation is based on the context of the electronic device, such as location or type. In some examples, the fifth user interface object (e.g., 1912, 1922) has a first (e.g., locked) state when the electronic device is in a second visual state, and a second state when the electronic device is in a third visual state. It has a (e.g., unlocked) state (2028). In some examples, the visual state element transitions from a first state to a second state (2030) during an unlock animation (an animation including 1912, 1913, 1921, 1922). In some examples, to prove that the biometric authentication was successful, the electronic device displays an animation (an animation including 1912, 1913, 1921, 1922) in which the lock is unlocked.

In some examples, the third visual state includes a second introductory screen at a second brightness higher than the first brightness (2032). In some examples, the first introductory screen (eg, 1910) and the second introductory screen (eg, 1920) are the same screen except for the degree of brightness of each screen.

In some examples, transitioning from the second visual state to the third visual state includes resizing (e.g., increasing) the first user interface object (e.g., 1912) displayed on the display of the electronic device. Do (2034). In some examples, the electronic device resizes all of the displayed user interface objects. In some examples, the electronic device scales fewer user interface elements than all of the displayed user interface elements. In some examples, the first user interface object (eg, 1912) is a lock icon, and resizing the first user interface object includes increasing the size of the first user interface object (2036). . In some examples, transitioning from the second visual state to the third visual state includes changing the degree of blurring of the second user interface object displayed on the display of the electronic device. In some examples, one or more blur parameters, such as a blur radius and/or blur size, of one or more displayed user interface objects (eg, the desktop) are increased and/or decreased. In some examples, blur parameters of all of the user interface objects are changed. In some examples, blur parameters of fewer than all of the user interface objects are changed. In some examples, the first user interface object and the second user interface object are the same element. In some examples, transitioning from the second visual state to the third visual state translates the position of the third user interface object displayed on the display of the electronic device from the first position to the second position (e.g., shifting the position. To shift the position without rotating it). In some examples, the lock icon is moved closer to the edge of the display of electronic devices prior to or during the unlock animation. In some examples, transitioning the device from the second visual state to a third visual state includes outputting a tactile output (eg, 1926). In some examples, the electronic device outputs a tactile output indicating that the biometric authentication criteria have been met while displaying the unlock animation.

In some examples, the third visual state corresponds to the unlocked state (2038). In some examples, while in the third visual state (eg, while the device is unlocked), the electronic device receives a lock input (eg, 1948, press of button 1904, 1952) (2040). In some examples, the lock input is a press of a button, such as a hardware button (eg, 1904), or a selection of affordances (eg, 1922, 1950) indicating an intention to lock the electronic device. Additionally, while in the third visual state, in response to receiving the lock input, the electronic device transitions from the third visual state to the locked state (2042). In some examples, the device is locked in response to one or more specific inputs.

In some examples, while in the locked state, the device performs one or more actions available in the unlocked state (e.g., displaying a home screen, displaying the content of notifications, launching applications). , Sending communications) is prevented. While in the locked state, preventing the device from performing one or more operations available in the unlocked state is that certain functions or operations are not on the device when the device is in the locked state as opposed to being in the unlocked state. It improves device security by prohibiting it from being performed. Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life.

In some examples, the electronic device displays 2044 a lock animation that includes a sixth user interface object (eg, 1912, 1922) representing the visual state of the electronic device. Displaying a lock animation comprising a specific user interface object (eg, sixth user interface object, 1912, 1922) provides visual feedback by allowing the user to quickly recognize that the device is in a locked state. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, the sixth user interface object is a lock. In some examples, the sixth user interface object has a first appearance (eg, an open lock) when the electronic device is in a third visual state and a second appearance (eg, a closed lock) when the electronic device is in a locked state. Have (2046). In some examples, the sixth user interface object transitions 2048 from the first appearance to the second appearance during the lock animation. In some examples, to prove that the electronic device is locked, the electronic device displays an animation of the lock being locked. In some examples, transitioning the device from the third visual state to the locked state includes outputting 2050 a tactile output (eg, 1952). In some examples, the tactile output includes a single tap. In some examples, the tactile output includes multiple taps. In some examples, the tactile output is timed to synchronize with an animation of a sixth user interface object moving back and forth (eg, a lock shaking back and forth). In some examples, displaying the lock animation includes displaying the current time. In some examples, the electronic device displays the time when transitioning to the locked state.

In some examples, the biometric authentication criteria include a requirement that the user was viewing the display of the electronic device with a face that matches one or more authorized faces. Including the requirement that the user was viewing the display of the electronic device with a face matching one or more authorized faces for biometric authentication criteria allows authentication to be successful only by authorized users of the device This improves device security. Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life. In some examples, unlocking the electronic device requires the user to be looking at the electronic device.

In some examples, upon determining that the biometric authentication criteria have not been met (2052) based on the biometric data provided by the one or more biometric sensors, the electronic device maintains (2054) the electronic device in a second visual state. ). Maintaining the device in a second visual state upon determination that biometric authentication criteria have not been met based on biometric data provided by one or more biometric sensors requires authentication without the device meeting appropriate authentication criteria. Device security is improved by prohibiting the transition to a state that is Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life.

In some examples, if the biometric feature is not authenticated, the device's display is not further brightened as it responds to the authentication of the biometric feature. In some examples, an explicit request by the device to unlock the device (e.g., 1930) (e.g., a swipe gesture from a lower portion of the device, pressing the home button, or content not available when the device is locked If the biometric authentication criteria are not met prior to receiving other inputs indicating that the user wants to see and/or wants to interact with the user), the device will perform biometric authentication, passcode authentication, password authentication, pattern authentication, etc. Display an unlock interface (eg, 1932) while attempting to authenticate the user through the same one or more forms of authentication. Examples of authenticating a user in response to a request to unlock the device through different types of authentication are described in more detail with reference to FIGS. 26A to 26A. In some examples, further, upon determining that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors, the electronic device determines the location of the fourth user interface object (e.g., 1912). Alternating between the first and second positions (2056). In some examples, to prove that the biometric authentication has failed, the electronic device shakes the lock icon displayed on the introductory interface. In some examples, a tactile output (eg, 1918) is provided in combination with a shaking lock icon. In some examples, no tactile output is provided.

In some examples, while the device is in the unlocked state, the electronic device detects that the lock condition has been met. In some examples, in response to detecting that the lock condition has been met, the lock condition is an explicit lock input (e.g., 1922, pressing of button 1904, 1952) (e.g., pressing the power button, tapping the lock icon). To do so), the electronic device transitions the device from the unlocked state to the locked state and outputs a respective lock indication (eg, 1912). In some examples, each lock indication includes a visual, audio, and/or tactile output indicating that the device has transitioned from an unlocked state to a locked state. In some examples, further, in response to detecting that the lock condition has been met, according to a determination that the lock condition is an implicit lock condition (e.g., covering of a proximity sensor, a long period of not receiving input, etc.), the electronic device Transitions the device from the unlocked state to the locked state without outputting each lock indication.

In some examples, after detecting that the device wake criteria have been met, the electronic device detects a request to display the biometric authentication setup interface. In some examples, the request to display the biometric authentication settings interface is a switch from the edge of the display to display a control panel user interface including a plurality of controls, including a control associated with enabling or disabling biometric authentication. Wipe, a long press of one or more hardware buttons that cause the device to display a configuration user interface including one or more controls, including controls associated with enabling or disabling biometric authentication, or enabling or disabling biometric authentication. And navigation through one or more menus in the setting app to a set of controls associated with biometric authentication, including one or more controllers including one or more controllers associated with enabling. In some examples, in response to a request to display a biometric authentication setting interface, the electronic device displays a biometric authentication setting interface (eg, 1954). In some examples, while displaying the biometric authentication setup interface, the electronic device receives a first user input (eg, 1958) corresponding to a request to disable biometric authentication. In some examples, in response to receiving the first user input, the electronic device disables biometric authentication. In some examples, while biometric authentication is disabled and while the device is in a locked state, the electronic device receives a request to unlock the device. In some examples, in response to receiving a request to unlock the device, the electronic device prompts for authentication using a different form of authentication than biometric authentication (eg, “pass to unlock” as shown in FIG. Enter the code (ENTER PASSCODE TO UNLOCK)"). In some examples, a different form of authentication is a passcode, password, fingerprint, or the like.

In some examples, upon transitioning to the second visual state and determining that the biometric capture criteria are not met after the first predetermined time, the electronic device biometrics after the first predetermined time has elapsed and the second predetermined time has passed. Determine whether the capture criteria are met. In some examples, the delays between attempts to detect a biometric feature become increasingly longer. In some examples, once the biometric authentication attempt threshold has been reached, biometric authentication is disabled.

It is noted that the details of the processes described above with respect to method 1200 (eg, FIGS. 20A-20F) are also applicable in a similar manner to the methods described herein. For example, method 2000 can optionally include one or more of the characteristics of the various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 1800, 2200, 2500, 2700. Include. For example, the registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with FIGS. 19A-19H. For another example, one or more implantable interfaces described in methods 2700 are optionally displayed in response to receiving input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 20A-20F are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, detection operation 2002, transition operation 2004, and transition operation 2022 are optionally implemented by event classifier 170, event recognizer 180 and event handler 190. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

21A-21aq illustrate example user interfaces for biometric authentication, according to some examples. As described in more detail below, an illustrative example of user interfaces illustrated in FIGS. 21A-21AQ is used to illustrate the processes described below, including the processes of FIGS. 22A-22F.

21A illustrates an electronic device 2100 (eg, portable multifunction device 100, device 300, or device 500). In the illustrative example illustrated in FIGS. 21A-21A, the electronic device 2100 is a smartphone. In other examples, electronic device 1500 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 2100 has a display 2102, one or more input devices (eg, a touchscreen of the display 2102, a button 2104, a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 2103) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more biometric sensors 2103 are one or more biometric sensors 703. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

21A to 21C, the electronic device 2100 performs biometric authentication with a user of the electronic device 2100. Referring to FIG. 21A, the electronic device 2100 is in a locked state. As illustrated, in some examples, while in the locked state, display 2102 of electronic device 2100 is disabled. In other examples, while in the locked state, the display 2102 of the electronic device 2100 is enabled, and the electronic device 2100 has a locked state interface indicating that the electronic device 2100 is in a locked state (e.g., The locked state interface 2110 of FIG. 21C is displayed. While device 2100 is in the locked state, the electronic device initiates biometric authentication. In FIG. 21B, electronic device 2100 initiates biometric authentication in response to detecting a wake condition (eg, a user moves the device in a predetermined manner). The electronic device performs biometric authentication in response to any number of wake conditions, including, but not limited to, movement of the device (eg, lifting), pressing of a button on the device, or touching the display 2102 It will be understood that initiating.

In some examples, initiating biometric authentication includes obtaining data corresponding to at least a portion of the user's biometric feature (eg, capturing with one or more biometric sensors 2103 ). In response to initiating biometric authentication, electronic device 1500 may, for example, obtain (eg, capture) and process (eg, analyze) biometric data, based on the biometric data, Determine whether the measurement feature (or portion thereof) satisfies the biometric authentication criteria (eg, whether the biometric data matches the biometric template, within a threshold). In some examples, biometric authentication requires the user to be looking at the device during biometric authentication. Thus, as illustrated in FIG. 21B, the user's gaze 2106 is facing the electronic device when the user lifts the device 2100.

In FIG. 21C, the electronic device 2100 displays a locked status interface 2110 including a locked status indicator 2112 in response to a wake condition. In some examples, while displaying the locked state interface 2110, the electronic device 2100 further displays a flashlight affordance 2107 and a camera affordance 2108. In some examples, activation of the flashlight affordance 2107 causes the electronic device to load the flashlight application. In some examples, activation of camera affordance 2108 causes electronic device 2100 to load a camera application.

In FIG. 21D, the electronic device 2100 determines that the biometric authentication was successful, and in response, displays the unlocked status interface 2120. In some examples, the display of the unlocked status interface 2120 includes a display of an unlock animation, as described with reference to FIGS. 19D-19G. While displaying the unlocked status interface 2120, the electronic device 2100 further displays a flashlight affordance 2107 and a camera affordance 2108 (eg, maintains its display). In some examples, electronic device 2100 outputs a tactile output 2126 in response to determining that the biometric authentication is successful.

In FIG. 21E, electronic device 2100 determines that biometric authentication was not successful. In response, the electronic device 2100 maintains the display of the locked interface 2110. In some examples, the electronic device displays a shake animation in which the locked status indicator 2112 is moved left and right to simulate a "shake" effect to indicate that the biometric authentication was unsuccessful. The electronic device 2100 further outputs a tactile output 2118 to indicate that the biometric authentication was not successful.

In some examples, one or more operations accessible during display of the locked state interface 2110 do not require authentication, so that one or more operations may be performed while the electronic device is in a locked state. As an example, loading the flashlight application in response to activation of the flashlight affordance 2107 does not require authentication. As another example, referring to FIG. 21F, in some examples, electronic device 2100 detects activation of camera affordance 2108 while in a locked state. As shown, activation of camera affordance 2108 is a tap gesture 2130 on camera affordance 2108. In FIG. 21G, in response to detecting activation of camera affordance 2108, electronic device 2100 displays, on display 2102, a camera application interface 2132 associated with the camera application (e.g., in a locked state. Replaces the display of interface 2110).

Referring to FIG. 21H, in some examples, while displaying the unlocked status interface 2120, the electronic device 2100 may perform an input (e.g., a swipe gesture) of a predetermined type when the device is unlocked and/or. Displays a prompt 2124 indicating that providing a will allow the user to access secure content such as a home screen interface (eg, home screen interface 2129 in FIG. For example, as illustrated, electronic device 2100 detects user input 2128 near the edge of display 2102, for example. User input 2128 is, in some examples, a swipe gesture, which is a request to access the home screen interface of electronic device 2100, and in response to the swipe input 2128, the electronic device displays the home screen interface of FIG. 2129) (e.g., replacing the display of the unlocked interface 2120 with it). In some examples, displaying the home screen interface 2129 may be performed by sliding the unlocked state interface 2120 upwardly, as described similarly with reference to FIGS. 19P-19R. To display (eg, reveal).

In FIG. 21J, the electronic device is in a locked state, for example in response to a failed biometric authentication (as described with reference to FIGS. 21A-C and 21E), and a locked state interface while in the locked state. Display (2110). While displaying the locked state interface 2110, the electronic device 2100 allows the user to authenticate with the electronic device 2100 when the device is locked and/or providing a predetermined type of input (e.g., a swipe gesture). Display a prompt 2133 indicating that it will (and have him unlocked). For example, as illustrated, electronic device 2100 detects user input 2134, for example, near the edge of display 2102. User input 2134 is, in some examples, a swipe gesture that is a request to access the home screen interface of electronic device 2100. Since the device is in a locked state (e.g., the user is not authenticated with the electronic device 2100), the electronic device opens an alternative authentication interface 2140 in response to a swipe input 2128, shown in FIG. 21K. Display (e.g., replace the display of locked interface 2120 with it). In some examples, the alternative authentication interface 2140 includes a locked status indicator 2142 indicating that the electronic device 2100 is in a locked state.

In FIGS. 21K-21M, electronic device 2100 performs biometric authentication while displaying alternative authentication interface 2140. In particular, while displaying the alternative authentication interface 2140, the electronic device 2100 detects and/or acquires biometric data of the face. Then, the electronic device 2100 processes the biometric data to determine whether the biometric data satisfies the biometric authentication criteria. 21L, the electronic device 2100 displays a biometric authentication processing glyph 2144 to indicate that the electronic device is processing biometric data (e.g., of the locked state indicator 2142). Replace the display with it). In FIG. 21M, electronic device 2100 determines that the biometric authentication performed during display of alternative authentication interface 2140 is successful. Consequently, the electronic device 2100 displays a biometric authentication success glyph 2146 to indicate that the biometric authentication was successful (e.g., replacing the display of the biometric authentication processing glyph 2144 with it). . In some examples, electronic device 2100 further completes the progress of the passcode progress indicator and optionally provides a tactile output 2141 to indicate a successful biometric authentication.

Alternatively, referring to FIGS. 21N to 21P, the user authenticates with the electronic device 2100 by entering a passcode during display of the alternative authentication interface 2140. As shown in FIGS. 21, the electronic device 2100 displays an alternative authentication interface 2140 and, as shown in FIG. 21O, at least in part in response to the tap gesture 2148, a passcode, and Optionally, receive one or more other inputs representing additional alphanumeric digits of the passcode. In FIG. 21P, the electronic device 2100 determines that the passcode is valid, and in response, displays a notification 2150 indicating that the passcode is valid and that the user is authenticated with the electronic device 2100.

In some examples, in response to inputting a valid passcode, electronic device 2100 selectively stores and/or updates biometric data. For example, in response to an input of a valid passcode, the electronic device 2100 acquires biometric data (eg, facial biometric data) and compares the biometric data with biometric data stored in the electronic device. In some examples, if the obtained biometric data is sufficiently similar to the stored biometric data, the electronic device stores the obtained biometric data and/or updates the previously stored biometric data to improve biometric authentication. In Fig. 21P, the electronic device determines that the biometric data obtained in response to the input of the valid passcode is sufficiently similar to the stored biometric data. In response, the electronic device stores the acquired biometric data and/or updates the stored biometric data, and displays an indication 2152 that the biometric data has been updated. In this way, the electronic device 2100 provides adaptive biometric authentication.

As described with reference to FIGS. 21A-C, in some examples, the electronic device 2100 performs biometric authentication in response to a wake condition. In some examples, the electronic device receives a request to access secure content (e.g., content that requires authentication to access), such as a swipe gesture requesting access to the home screen, before biometric authentication is complete. do. Accordingly, referring to FIGS. 21Q-21S, in response to receiving a request to access secure content, the electronic device 2100 displays interstitial interfaces to indicate that the electronic device has not yet completed biometric authentication. . In FIG. 21Q, the electronic device displays an implantable interface 2154 comprising a biometric authentication glyph 2160 indicating the initiation of biometric authentication and an alternative authentication affordance 2156. Activation of the alternative authentication affordance 2156 causes the electronic device to display an alternative authentication interface (e.g., alternative authentication interface 2140 in Figure 21K) (e.g., replacing the display of the embedded interface 2154 with it. Do). Biometric authentication glyph 2160 is, in some examples, a simulation of a representation of a biometric feature.

Once the electronic device 2100 has obtained the biometric data in response to initiating biometric authentication, the electronic device processes the biometric data, as described. In some examples, while the electronic device is processing biometric data, the electronic device displays a biometric authentication glyph 2162 (e.g., biometric authentication glyph 2160) to indicate that the biometric data is being processed. Replace the display of it with it). In some examples, biometric authentication glyph 2162 includes a plurality of rings that rotate in a spherical shape, eg, while displayed.

In FIG. 21S, the electronic device 2100 determines that the biometric data satisfies the biometric authentication criteria. In response, the electronic device 2100 displays a biometric authentication glyph 2163 indicating that the biometric authentication was successful (e.g., displaying the biometric authentication glyph 2162 with it). Replace). In some examples, the electronic device stops displaying the alternative authentication affordance 2156. Additionally or alternatively, the electronic device displays the unlocked status indicator 2122 (e.g., replacing the display of the locked status indicator 2161 with it) and/or indicating that the biometric authentication was successful. A tactile output 2164 is output.

As described, in some cases, the electronic device receives a request to access secure content before biometric authentication is complete. In some examples, the electronic device receives the request after the electronic device starts processing biometric data but before completing biometric authentication. In such a case, the electronic device optionally displays the implantable interface 2154 with the biometric authentication glyph 2162 and omits first displaying the biometric authentication glyph 2160.

In some examples, one or more functions of the electronic device are optionally enabled based on whether the user is looking at the electronic device 2100. 21T-21Y, in some examples, some functions are disabled when the user is not looking at the electronic device 2100 and enabled when the user is looking at the electronic device 2100. In FIG. 21T, the user's gaze 2165 is not facing the electronic device 2100. In response to determining that the line of sight 2165 is not facing the electronic device 2100, the electronic device 2100 performs each function associated with the flashlight affordance 2107 and the camera affordance 2108, as shown in FIG. Disable them. While the functions associated with flashlight affordance 2107 and camera affordance 2108 are disabled (e.g., while the user is not looking at device 2100), the electronic device receives activation of camera affordance 2108. As shown, activation is a tap gesture 2166 on camera affordance 2108. Because the function associated with the affordance is disabled, the electronic device holds back responding to the tap gesture 2166 (eg, holds loading the camera application).

In Fig. 21V, the user's gaze 2168 is pointing at the electronic device. In response to determining that the line of sight 2168 is facing the electronic device 2100, the electronic device 2100 performs respective functions associated with the flashlight affordance 2107 and the camera affordance 2108, as shown in FIG. 21W. Enable. In FIG. 21X, electronic device 2100 detects activation of camera affordance 2108. As shown, activation is a tap gesture 2170 on camera affordance 2108. In response to activation of the camera affordance 2108, the electronic device displays, on the display 2102, a camera application interface 2132 associated with the camera application (FIG. 21Y) (e.g., display of the locked state interface 2110). Replace).

Referring to FIG. 21Z, in some examples, the electronic device 2100, while in the locked state, displays a locked state interface 2110 that includes a notification affordance 2174. As described, in response to the wake condition, the electronic device initiates biometric authentication. While displaying the locked state interface 2110 and prior to completing biometric authentication, the electronic device 2100 receives a request to access secure content. As an example, in FIG. 21AA, electronic device 2100 detects activation of notification affordance 2174. As shown, activation of notification affordance 2174 is a tap gesture 2176.

Referring to FIG. 21A, in response to activation of the notification affordance 2174, the electronic device 2100 includes an embedded biometric authentication interface 2178 having a biometric authentication progress indicator 2182 and an alternative authentication affordance 2180. ) (E.g., replacing the display of the locked interface 2110 with it). In some examples, biometric authentication progress indicator 2182 includes a biometric authentication glyph, such as biometric authentication glyph 2183, indicating progress of biometric authentication. In some examples, the biometric authentication progress indicator further identifies secure content associated with a request to access secure content (eg, “messages”). Activation of the alternative authentication affordance 2180 causes the electronic device to display an alternative authentication interface, examples of which are further described below.

While displaying the implantable biometric authentication interface 2178, the electronic device 2178 continues to perform biometric authentication initiated in response to the wake condition. In some examples, initiating biometric authentication includes obtaining data corresponding to the user's biometric features (eg, capturing with one or more biometric sensors). Referring to FIG. 21AC, in response to obtaining data, the electronic device processes the biometric data to determine whether the biometric feature satisfies the biometric authentication criteria, for example, based on the biometric data. (For example, it is determined whether the biometric data matches the biometric template, within a threshold). While electronic device 2100 is processing biometric data, electronic device 2100 optionally displays a biometric authentication glyph 2184 indicating that biometric data is being processed in the embedded biometric authentication interface 2178. (E.g., replacing the display of biometric authentication glyph 2183 with it).

In FIG. 21A, the electronic device 2100 determines that the biometric feature satisfies the biometric authentication criteria. In response, the electronic device displays a biometric authentication glyph 2185 indicating that the biometric authentication was successful in the embedded biometric authentication interface 2178 (e.g., display of the biometric authentication glyph 2184 with it Replace). Additionally or alternatively, the electronic device displays the unlocked status indicator 2122 (e.g., replacing the display of the locked status indicator 2112 with it) and/or indicating that the biometric authentication was successful. A tactile output 2164 is output.

21A and 21A, in response to determining that the biometric authentication is successful, the electronic device 2100 displays a messaging application interface 2194 (e.g., of the embedded biometric authentication interface 2178). Replace the display with it). In some examples, displaying the messaging application interface 2194 includes sliding the biometric authentication interface 2178 upwardly to open the messaging application interface 2194, as similarly described with reference to FIGS. 19P-19R. Includes displaying (eg, revealing).

21AG through 21AI describe an alternative manner of display in which biometric authentication progress is displayed. As described with reference to FIG. 21AA (and as shown in FIG. 21AG), the electronic device 2100 prompts, while displaying the locked state interface 2110, to access secure content prior to completing biometric authentication. Receive the request. The request is activation 2176 of notification affordance 2174 in some examples. In response to activation 2176 of notification affordance 2174, the electronic device maintains a display of locked state interface 2110. Additionally, as shown in Figure 21A, the electronic device 2100 displays a biometric authentication glyph 2184 to indicate that the biometric data is being processed (e.g., the display of the locked status indicator 2110). Replace it with it). In FIG. 21AI, the electronic device determines that the biometric authentication was successful, and in response, displays an unlocked status indicator 2122 (e.g., replacing the display of the biometric authentication glyph 2184 with it). . Optionally, the electronic device 2100 further outputs a tactile output 2193 indicating that the biometric authentication is successful. In some examples, because the electronic device transitions to an unlocked state in response to determining that the biometric authentication is successful, the electronic device 2100 displays a notification affordance 2175 (e.g., a notification affordance 2174). Replace the display of it with it). In some examples, notification affordance 2174 identifies secure content (eg, “John Appleseed… meeting where…”).

21AJ, in response to processing the biometric data (as described with reference to FIG. 21AC), the electronic device determines that the biometric authentication is not successful. In response, the electronic device 2100 displays a biometric authentication glyph 2191 indicating that the biometric authentication was not successful in the biometric authentication interface 2178 (e.g., display of the biometric authentication glyph 2184). With that). Additionally or alternatively, the electronic device alternates the position of the locked status indicator 2112 to simulate a “shake effect” to indicate that the biometric authentication was unsuccessful, and/or the biometric authentication was unsuccessful. Outputs a tactile output 2193 indicating.

While displaying the implantable biometric authentication interface 2178, the electronic device detects activation of an alternative authentication affordance 2180. Activation of the alternative authentication affordance 2108 is a tap gesture 2192 in some examples. Referring to FIG. 21Ak, in response to activation of the alternative authentication affordance 2180, the electronic device displays the alternative authentication affordance 2198. In some examples, the alternative authentication affordance 2198 includes an indicator 2199 that identifies secure content associated with a request to access secure content (eg, “messages”).

21A and 21A, in response to, at least in part, a tap gesture 2102A (FIG. 21L ), and, optionally, one or more other inputs indicating additional alphanumeric digits of the valid passcode, the electronic device 2100 A valid passcode (or password) is received by. 21N and 21O, once a valid passcode has been received, the electronic device is unlocked and displays the messaging application interface 2194 (e.g., the display of the alternative authentication interface 2198 with it. Replace). In some examples, displaying the messaging application interface 2194 opens the messaging application interface 2194 by sliding the alternative authentication interface 2198 upward, as similarly described with reference to FIGS. 19P-19R. Includes displaying (eg, revealing).

In some examples, in response to determining that the biometric authentication was not successful, the electronic device further determines that a threshold number of biometric authentication attempts has been reached. Thus, as shown in Fig. 21Ap, the electronic device 2100 indicates that the threshold has been reached ("face authentication is temporarily disabled") using the biometric authentication progress indicator 2182. 21A, while displaying the implantable biometric authentication interface 2178, the electronic device detects activation of an alternative authentication affordance 2180, and in response to activation of the alternate authentication affordance 2180, An alternative authentication affordance 2198 is displayed. As shown in Fig. 21aq, when the electronic device determines that a threshold number of biometric authentication attempts has been reached, the indicator 2197 indicates that biometric authentication is re-enabled in response to input of a valid passcode Identify ("ENTER PASSCODE TO RE-ENABLE FACE AUTHENTICATION").

22A-22F are flow charts illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. The method 2200 includes a device with a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 2100). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric feature by one or more biometric sensors. Some operations of method 2200 are selectively combined, orders of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 2200 provides an intuitive method for performing authentication of biometric features. This method reduces the user's cognitive burden for performing authentication of biometric features, thereby creating a more efficient human-machine interface and intuitive user experience. In the case of battery-operated computing devices, enabling a user to manage the authentication of biometric features faster and more efficiently saves power and increases the time between battery charges.

In some examples, while the device is in a locked state, the electronic device (eg, 2100) receives a request to perform an operation that does not require authentication (2202). In some examples, in response to a request to perform an operation that does not require authentication, the electronic device performs the operation without waiting for authentication. Performing an operation that does not require authentication without waiting for authentication allows faster access to the operation without the need for the user to provide additional input (eg, input instructing the device to proceed). Performing an action (automatically) when a set of conditions is met without requiring additional user input (e.g., when operating the device and/or interacting with it, helps the user to provide appropriate inputs and avoids user mistakes). By reducing) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. .

In some examples, the request to perform an operation that does not require authentication is a request to enable a camera of the electronic device (e.g., 2130) and/or a camera user interface (e.g., a camera user interface for capturing images and/or videos to the device). , 2132). In some examples, an operation that does not require authentication is one or more restricted features (e.g., sharing captured photos or video, captured during previous use of the camera application while the device was unlocked) without successful authentication. Viewing photos or videos that have been performed), the device attempting biometric authentication while displaying the application user interface. Displaying an application user interface that includes one or more restricted features that are restricted without successful authentication provides visual feedback by allowing the user to quickly see which features are currently restricted on the application without proper authentication. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. If biometric authentication is successful while displaying the application user interface, limited features are enabled, and if biometric authentication is not successful, the restricted features remain disabled (e.g., the user Sharing photos or videos, preventing viewing of photos or videos that were captured during previous use of the camera application while the device was unlocked and, optionally, authenticating in response to an attempt to use any of the restricted features You are prompted to provide).

In some examples, while the electronic device is in a locked state, the electronic device includes, on a touch-sensitive display (eg, 2102), one or more affordances (eg, 2107, 2108) for performing operations for which authentication is not required. (E.g., for accessing the camera functions of the device, such as displaying a flashlight affordance to enable a flashlight operating mode that is lit on the device and/or a camera user interface for capturing images and/or videos to the device. Camera affordance).

In some examples, while displaying one or more affordances for performing operations for which authentication is not required, the electronic device provides an affordance (e.g., 2107, 2108) of each of the one or more affordances for performing operations for which authentication is not required. Activation of (eg, 2130) is detected. In some examples, in response to detecting activation of each of the one or more affordances for performing operations for which authentication is not required, determining that the face was looking at the display of the electronic device when the activation of each affordance was detected. Depending on (e.g., determining that there is a face with facial features representing the face viewing the electronic device within the field of view of one or more cameras or one or more biometric sensors of the device), the electronic device performs an operation associated with each affordance. do. Performing an action associated with each affordance according to a determination that the (e.g., user's) face was looking at the device's display means that the action is performed when the device detects that the user is looking at the device (e.g., and the user Do not perform an action if you are not looking at the device-this optionally indicates that affordance has been unintentionally selected) reduces the device's power usage and improves battery life.

In some examples, if the flashlight affordance (e.g., 2107) is activated while the face is looking at the display of the electronic device, the electronic device enables a flashlight operation mode in which the light on the device is turned on and/or the face is If the camera affordance (eg, 2108) is activated while looking at the display, the electronic device accesses the device's camera functionality, such as displaying a camera user interface for capturing images and/or videos to the device. In some examples, a determination that the face was not looking at the display of the electronic device when the activation of each affordance was detected (e.g., a face was not detected, or a face was detected but one or more cameras or one or more biometrics of the device. (Determining that there is a face in the view of the sensors with facial features representing a face that is facing the electronic device), the electronic device withholds the performance of the operation associated with each affordance. In some examples, if the flashlight affordance is activated while the face is not looking at the display of the electronic device, the electronic device suspends enabling the flashlight operation mode in which the illumination on the device is turned on and/or the face is the display of the electronic device. If the camera affordance is activated while not looking at the electronic device, the electronic device withholds access to the device's camera function, such as displaying a camera user interface for capturing images and/or videos with the device.

In some examples, while the electronic device is in a locked state, the electronic device is a condition associated with performing a biometric authentication verification using a biometric sensor without explicit input from a user requesting biometric authentication (e.g., a user Elevates the device 2100 to the position shown in FIG. 21B). In some examples, a condition associated with performing a biometric authentication verification using a biometric sensor without explicit input from a user requesting biometric authentication is to raise the device and/or display a wake button (e.g., 2104 Includes pressing ).

In some examples, the one or more biometric sensors are configured to capture biometric data associated with biometric features located within a predetermined range of distances from the non-contact biometric sensor (e.g., 2103). 2103) (e.g., a facial recognition sensor) (2204). In some examples, the biometric sensor includes a camera. In some examples, the biometric sensor includes a light projector (eg, an IR transmissive or structured light projector).

In some examples, the device is restricted from performing more than a predefined number of biometric authentication verifications without successful authentication (2206). Restricting a device from performing more than a predefined number of biometric authentication verifications without successful authentication improves device security by limiting fraudulent authentication attempts on the device. Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life.

In some examples, successful authentication includes successful authentication through biometric authentication, or any other form of authentication, such as using a passcode, password, or pattern. In some examples, the device performs at least one biometric authentication for use in response to detecting a request to perform each operation by performing less than a predefined number of biometric authentication verifications in response to detecting the condition. Schedule confirmation. In some examples, the electronic device tracks a number of failed authentication attempts, such as a number of failed sequential failed attempts without intervening success authentication (eg, biometric authentication, or other authentication such as password authentication). In some such examples, if the maximum number of failed attempts has been reached, the device does not perform biometric authentication until a successful non-biometric authentication is received. In some examples, a request to perform an operation requiring authentication after reaching the maximum number of failed biometric authentication verifications results in a display of an alternative authentication user interface (e.g., password, passcode, pattern or other authentication interface). Trigger.

In some examples, while the display of the electronic device (eg, 2102) is disabled, the electronic device detects a display wake condition (2208). In some examples, the display wake condition may include movement of the device in a predefined manner, such as movement of the device above a threshold amount, movement of the device in an orientation associated with waking the device, activation of the display wake button, or touch sensitive. Includes a tap-like gesture on the mold surface.

In some examples, in response to detecting the condition, the electronic device performs a first biometric authentication verification (2210). Performing a biometric authentication verification in response to detecting a condition (eg, a wake condition) allows a user to provide authentication information to the device quickly and efficiently and with minimal input in response to the wake condition being detected. Performing an action (automatically) when a set of conditions is met without requiring additional user input (e.g., when operating the device and/or interacting with it, helps the user to provide appropriate inputs and avoids user mistakes). By reducing) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. .

In some examples, performing the first biometric authentication verification includes capturing 2212 the first biometric data using one or more biometric sensors. In some examples, the electronic device initiates a first biometric authentication procedure comprising capturing the first biometric data using one or more biometric sensors. In some examples, performing the first biometric authentication verification may be performed after capturing the first biometric data 2214 (e.g., in response to capturing the first biometric data or in response to a request to unlock the device). Thus, according to a determination that the first biometric data satisfies the biometric authentication criteria, the electronic device transitions the device from the locked state to the unlocked state (2216 ). Transitioning the device from the locked state to the unlocked state upon determining that the first biometric data satisfies the biometric authentication criteria can be accomplished by unlocking the device if the authentication process is successful (however, in some examples, authentication is successful). If not, the device security is improved by preventing the device from being unlocked. Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life.

In some examples, the electronic device determines whether the first biometric data meets biometric authentication criteria. In some examples, the biometric authentication criteria include a criterion that is satisfied when the first biometric data is matched to biometric data (eg, facial feature data, fingerprint data, iris data) corresponding to an authorized user. In some examples, while in the unlocked state and before detecting a request to perform each action, the electronic device corresponds to instructions to provide a request to perform each action, according to prompt criteria. A prompt (eg, visual, audio, or tactile output) is output (2218). In some examples, the device is in an unlocked state after detecting the face of the authorized user. In some examples, the electronic device displays instructions (eg, 2124) to “swipe up” to access a home screen (eg, 2129). In some examples, the prompt criteria include a requirement that the user's gaze (eg, 2168) is facing the electronic device (2220). In some examples, the prompt criteria include a requirement that the device detects facial features indicative of a face looking at the electronic device for at least a predetermined time (eg, detecting that the user's gaze is facing the electronic device) (2222).

In some examples, upon determining that the first biometric data does not satisfy the biometric authentication criteria, the electronic device holds the device in a locked state (2224). Keeping the device locked upon a determination that the first biometric data does not meet the biometric authentication criteria improves device security by preventing unauthorized and/or unauthorized access to the device. Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life. In some examples, if the biometric data corresponding to the biometric feature does not match the biometric authentication template, the device remains locked in response to the failed authentication.

In some examples, after performing the first biometric authentication verification, the electronic device detects, via the device, a request to perform each operation (e.g., 2134, 2176) without receiving additional authentication information from the user ( 2226). In some examples, detecting, through the device, a request to perform each operation without receiving additional authentication information from the user, may result in a request to display content that is not available for display when the electronic device is locked. Includes detecting (2228). In some examples, the user input is an input that requires access to secure data, such as a home screen or an application presenting secure data. In some examples, the request to perform each action includes a swipe gesture on the device, a swipe gesture from an edge of the device (eg, 2134), or pressing a home button. In some examples, the request to perform each action is a selection of a notification (e.g., 2176) (e.g., the request to perform each action is an application corresponding to the notification or a notification, such as a long look) A request to display associated additional information); A swipe gesture (eg, the request to perform each action is an upward swipe on the display of the electronic device; in some examples, the request to perform each action is an upward swipe starting from the edge of the display of the electronic device. In some examples, the swipe is, in particular, a request to display the home screen of the electronic device); Movement of the electronic device in a predetermined manner (eg, a request to perform each operation includes lifting the electronic device); And selection of affordances (e.g., the request to perform each operation includes selection of affordances displayed by the electronic device, including a "lock" affordance displayed when the electronic device is in a locked state). It includes (2230).

In some examples, while performing the first biometric authentication verification, the electronic device receives (2232) a second request (eg, 2134) to perform a second operation without receiving additional authentication information from the user. In some examples, the second request is a swipe gesture, selection of a notification, and the like. In some examples, in response to receiving the second request to perform the second operation (2234), a second request to perform the second operation is received after determining that the first biometric data does not satisfy the biometric authentication criteria. In accordance with the determination that it is, the electronic device displays a second alternative authentication interface (eg, 2140) (2236). In some examples, the second alternative authentication interface is a passcode, password, pattern, or fingerprint authentication user interface, and is displayed without performing a second operation if the biometric authentication fails at least once. In some examples, upon determining that a second request to perform a second action has been received prior to evaluating the first biometric data (eg, before determining whether the first biometric data satisfies the biometric authentication criteria). , The electronic device displays 2238 a biometric authentication indicator (e.g., 2156, 2162) comprising an indication that biometric authentication is being attempted without displaying a second alternative authentication interface. In some examples, the second alternative authentication interface is a passcode, password, pattern, or fingerprint authentication user interface, and if the device did not have time to complete the first biometric authentication attempt, it is not displayed and the second operation is not performed. . In some examples, if the user swipes up while the electronic device is performing the first iteration of biometric authentication, the electronic device displays an embedded interface (eg, 2154) in which the processing status of the biometric authentication appears. In some examples, in response to receiving the second request to perform the second action, upon determining that the second request to perform the second action has been received after determining that the first biometric data satisfies the biometric authentication criteria. , The electronic device performs the second operation without displaying an alternative authentication interface (eg, a passcode, password, pattern, or fingerprint authentication user interface is displayed if biometric authentication fails at least once). In some examples, in response to receiving a second request to perform a second action, a biometric authentication indication displayed in response to a determination that a second request to perform a second action has been received prior to evaluating the first biometric data. The ruler (eg, 2182) includes an indication of the application associated with the notification. In some examples, if the user selects a notification while the device is performing the first biometric authentication verification, the device represents the application associated with the notification. For example, if the user chooses to notify a message, the device may be associated with a messaging application such as "Biometric Authentication for Messages" or "Face ID for Messages". Display the indication.

In some examples, in response to detecting a request to perform each action (2240), in response to a determination that each action does not require authentication, the electronic device performs each action (2242). Performing each operation without successful authentication, subject to the determination that each operation does not require authentication, allows faster access to the operation without the need for the user to provide additional input (e.g., an input that directs the device to proceed) do. Performing an action (automatically) when a set of conditions is met without requiring additional user input (e.g., when operating the device and/or interacting with it, helps the user to provide appropriate inputs and avoids user mistakes). By reducing) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. . In some examples, if the operation does not require authentication, the electronic device performs the operation regardless of whether the device is in a locked or unlocked state. In some examples, the device does not verify authentication if each operation does not require authentication, such as using a camera or making an emergency call.

In some examples, in response to a determination that each operation requires authentication and the device is in an unlocked state, the electronic device performs each operation (2244). When the device is in the unlocked state, performing each operation according to the determination that each operation requires authentication is an operation without the need for the user to provide additional input (e.g., an input instructing the device to proceed). Faster access. Performing an action (automatically) when a set of conditions is met without requiring additional user input (e.g., when operating the device and/or interacting with it, helps the user to provide appropriate inputs and avoids user mistakes). By reducing) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. .

In some examples, upon determining that each operation requires authentication and that the device is in a locked state (2246), the electronic device attempts to configure one or more biometric sensors without explicit input from the user requesting a second biometric authentication verification. The second biometric data is captured (2248). Capturing the second biometric data without explicit input from the user requesting a second biometric authentication confirmation in accordance with each action requiring authentication and determining that the device is in a locked state is performed while the device is in a locked state. It improves device security by requiring successful authentication and thereby preventing unauthorized and/or unauthorized access to the device. Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life.

In some examples, after capturing the second biometric data, the electronic device performs a second biometric authentication verification (2250). In some examples, the first biometric data and the second biometric data are compared to the same set of biometric criteria. In some examples, the first and second biometric data are compared to each set of biometric criteria. In some examples, performing the second biometric authentication verification includes performing 2252 each operation in accordance with a determination that the second biometric data satisfies the biometric authentication criteria. In some examples, the electronic device optionally further transitions the device from a locked state to an unlocked state. In some examples, performing the second biometric authentication verification comprises suspending (and optionally, locking the device) the performance of each operation, depending on the determination that the second biometric data does not meet the biometric authentication criteria. To keep in a state) (2254). In some examples, suspending the performance of each operation includes keeping the device locked (2256). In some examples, pending performance of each operation includes displaying 2258 an alternative authentication user interface (eg, 2140, 2198). In some examples, an alternative authentication interface is a passcode, password, pattern or fingerprint authentication user interface. In some examples, while displaying the alternative authentication user interface, the electronic device detects an alternative authentication challenge (eg, input of a passcode including tap gesture 2102A) corresponding to the alternative authentication user interface. In some examples, the alternative authentication attempt corresponding to the alternative authentication user interface is an input passcode, input password, input pattern, or fingerprint detected on a fingerprint sensor. In some examples, in response to detecting the alternative authentication attempt corresponding to the alternative authentication user interface, the authentication attempt is successful (e.g., the provided authentication information is stored with a stored passcode, Biometric data corresponding to an alternative authentication attempt (e.g., the last letter of a passcode or when the password submit button is selected) that is captured while or immediately after an authentication attempt was in progress. According to a determination that the measurement data or second biometric data) meets the first similarity criteria for stored biometric data corresponding to an authorized user of the device, the electronic device performs each operation. In some examples, the electronic device stores additional information based on biometric data corresponding to the alternative authentication attempt as biometric data that can be used in future biometric authentication attempts to identify an authorized user of the device. In some examples, the electronic device learns changes to the user's face for use in authenticating the user in future authentication attempts. In some examples, further, in response to detecting the alternative authentication attempt corresponding to the alternative authentication user interface, the authentication attempt is successful and the biometric data corresponding to the alternative authentication attempt corresponds to an authorized user of the device. Upon determining that the first similarity criteria for stored biometric data are met, the electronic device modifies information (e.g., a biometric template) to be used in future biometric authentication attempts to identify an authorized user of the device. Outputs (e.g., visual, audio, and/or tactile output) indicating that it is. In some examples, the electronic device displays an indication that the biometric data has been updated to better recognize the user's face.

In some examples, the authentication attempt is successful (e.g., the authentication information provided matches stored authentication information, such as a stored passcode, stored password, stored pattern, or stored fingerprint information) and biometric data corresponding to an alternative authentication attempt ( Biometric data or second biometric data captured during or immediately after an authentication attempt was in progress, such as when the last letter of the passcode or the submit password button is selected), corresponding to the authorized user of the device. According to a determination that the first similarity criteria for stored biometric data are not met, the electronic device performs each operation. Performing each operation according to the determination that the authentication attempt is successful and that the biometric data corresponding to the alternative authentication attempt does not meet the first similarity criteria for the stored biometric data is that the biometric data is stored. It provides a user with an alternative method for accessing the device's operations (eg, locked operations) that require successful authentication when the data does not correspond. Providing additional control options with additional displayed controls improves the operability of the device and improves the operability of the user (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors). -Make the device interface more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device does not store additional information based on biometric data corresponding to the alternative authentication attempt as biometric data that can be used in future biometric authentication attempts to identify an authorized user of the device. . In some examples, in response to detecting an alternative authentication attempt corresponding to the alternative authentication user interface, depending on a determination that the authentication attempt was not successful (e.g., the provided authentication information may be a stored passcode, stored password, stored pattern, or Does not match the stored authentication that matches the stored authentication information, such as the stored fingerprint information), the electronic device withholds performing each operation and provides additional information based on biometric data corresponding to the alternative authentication attempt, the device Do not store as biometric data that can be used in future biometric authentication attempts to identify authorized users of

In some examples, in response to detecting a request to perform each operation and upon determining that each operation requires authentication and the device is locked, the electronic device displays an alternative authentication interface. Providing an alternative authentication interface (e.g., to provide an alternative method for providing authentication as an alternative to or in addition to biometric authentication) means that the current authentication method is unsuccessful or continues to be unsuccessful. In case it makes it easy for the user to provide authentication for the operation using different authentication methods. Providing additional control options (e.g., to provide authentication) in this manner without cluttering the UI with additional displayed controls allows the user to make appropriate inputs (e.g., when operating/interacting with the device). It improves the operability of the device and makes the user-device interface more efficient (by helping to provide and reducing user mistakes), which additionally reduces the power usage of the device by enabling users to use the device more quickly and efficiently. Reduce and improve battery life.

In some examples, the electronic device, in response to the user requesting access to the secure data after the failure of the first iteration of biometric authentication, may be configured with an alternative authentication interface (e.g., 2140, 2198), such as a password or passcode interface. ) Is displayed. In response to a user requesting access to secure data after failure of the first iteration of biometric authentication, displaying an authentication interface such as a password or passcode interface ensures successful authentication when the biometric data is unsuccessful. It provides a user with a quick alternative way to access the operations of the requesting device (eg, locked operations). Providing additional control options with additional displayed controls improves the operability of the device and improves the operability of the user (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors). -Make the device interface more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, an alternative authentication interface is displayed after an additional time delay and/or after an additional biometric authentication attempt has failed (eg, as described in more detail with reference to FIGS. 26A-26A ). In some examples, the biometric authentication criteria include a requirement that authentication using an alternative authentication interface has not yet started in order for the biometric authentication criteria to be met (2260). In some examples, by at least partially attempting (e.g., in response to) biometric authentication while displaying an alternative authentication user interface: upon determination that biometric authentication was successful and authentication using the alternative authentication interface has not started. , The electronic device performs each operation; Upon a determination that authentication using an alternative authentication interface has been initiated (e.g., at least, a determination that a partial credential, such as a partial passcode, pattern, or password, has been received using an alternative authentication interface), the electronic device is subjected to a biometric measurement. It is reserved to perform each operation based on authentication. In some examples, the electronic device waits for the user to perform the second biometric authentication until it finishes providing the passcode. In some examples, the device delays displaying the alternative authentication user interface until after the second biometric authentication verification fails (e.g., as described in more detail with reference to FIGS. 26A-26A), and the device After the classic authentication user interface is displayed, a third biometric authentication check is performed.

In some examples, the second biometric authentication verification is performed while displaying an alternative authentication interface (eg, 2140) (2262). Performing the second biometric authentication verification while displaying the alternative authentication interface may, in some examples, operate the device by completing the second biometric authentication verification prior to the completion of the user providing the manual alternative authentication input. Improves performance, thereby making the user-device interface more efficient.

In some examples, an alternative authentication interface is a passcode, password, pattern or fingerprint authentication user interface. In some examples, performing at least a portion of the second biometric authentication verification includes performing at least a portion of the second biometric authentication verification while displaying an alternative authentication interface. In some examples, biometric authentication is performed during passcode entry. In some examples, the biometric authentication UI is displayed on the passcode input interface (eg, biometric progress indicators 2142, 2144, 2146).

In some examples, while displaying an alternative authentication user interface (eg, passcode, password, pattern, or fingerprint authentication user interface), the electronic device determines that biometric authentication criteria have been met. In some examples, in response to determining that the biometric authentication criteria have been met, the electronic device performs each operation. Performing each action in response to determining that the biometric authentication criteria have been met while displaying the alternative authentication user interface is, in some examples, a second prior to completion of the user providing the manual alternative authentication input. Completing the biometric authentication verification improves the operability of the device, thereby making the user-device interface more efficient. In some examples, the biometric authentication criteria include a requirement that the user has not entered at least a portion of the credentials using an alternative authentication interface. In some examples, the biometric authentication criteria include a requirement that the user has not entered at least a portion of the credentials using an alternative authentication interface. In some examples, if the user has already started entering an alternative form of authentication, such as a passcode, password, pattern, or fingerprint, then each action is not performed if there is a successful biometric authentication.

In some examples, in response to detecting a request to perform each operation and upon determining that each operation requires authentication and the device is locked, the electronic device provides an option to proceed with an alternative form of authentication. Display an authentication indication for biometric authentication (eg, a progress indicator or other indication that biometric authentication is being attempted) without displaying. In some examples, the electronic device displays an authentication indication for biometric authentication without displaying an alternative authentication interface and/or without displaying a selectable option to display an alternative authentication interface. In some examples, while attempting biometric authentication in response to a request to perform each operation, the device provides options for an alternative form of authentication to indicate to the user that the biometric authentication has not yet failed. Hold (eg, as described in more detail with reference to FIGS. 26A-26A).

In some examples, while the device is in an unlocked state, the electronic device is prompted to store additional information for use in biometric authentication (e.g., in a system preference user interface or a biometric registration user interface in a device settings user interface). Receive the request. In some examples, in response to a request to store additional information for use in biometric authentication, the electronic device captures third biometric data. In some examples, additionally, in response to a request to store additional information for use in biometric authentication, the third biometric data determines second similarity criteria for the stored biometric data corresponding to the authorized user of the device. Upon determining that it is satisfied, the electronic device stores additional information based on the third biometric data that can be used in future biometric authentication attempts to identify an authorized user of the device. Storing additional information based on third biometric data that can be used in future biometric authentication attempts to identify an authorized user of the device while the device is in the unlocked state (e.g., and when the device is locked Prohibiting such actions while in existence) improves device security, preventing fraudulent attempts and/or unauthorized attempts to stored biometric authentication data on the device, thereby gaining future access to the device. . Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life.

In some examples, the electronic device learns changes to the user's face for use in authenticating the user in future authentication attempts. In some examples, the second similarity criteria require that the similarity between the third biometric data and the stored biometric data is less than that required by the first similarity criteria. In some examples, if the device is in an unlocked state and in the biometric data registration user interface, the device learns biometric features that are detected when alternative authentication is successfully provided after biometric authentication fails. And is configured to receive additional biometric data corresponding to a biometric feature that is more different than the currently registered biometric features than when they were. In some examples, upon determining that the third biometric data does not meet the second similarity criteria for the stored biometric data corresponding to an authorized user of the device, the electronic device is configured to identify an authorized user of the device. It stores additional information based on third biometric data that can be used in future biometric authentication attempts. In some examples, the electronic device learns changes to the user's face for use in authenticating the user in future authentication attempts.

It is noted that the details of the processes described above with respect to method 1200 (eg, FIGS. 22A-22F) are also applicable in a similar manner to the methods described herein. For example, method 2200 can optionally include one or more of the characteristics of the various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 1800, 2000, 2500, 2700. Include. For example, the registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with FIGS. 21C-21E. For another example, one or more implantable interfaces as described in methods 2000 and 2700 are optionally displayed in response to receiving an input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 22A-22F are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, detect operation 2202, perform operation 2210, capture operation 2212, transition operation 2216, hold operation 2224, detect operation 2226, perform operation 2250, and hold operation ( 2254 is, optionally, implemented by event classifier 170, event recognizer 180, and event handler 190. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

23A-23Q illustrate example user interfaces for managing biometric authentication, in accordance with some examples. As described in more detail below, an exemplary example of user interfaces illustrated in FIGS. 23A-23Q relates to an exemplary example of user interfaces illustrated in FIGS. 24A-24B, which is then followed by FIGS. It is used to illustrate the processes described below, including the processes of 25c.

23A illustrates an electronic device 2300 (eg, portable multifunction device 100, device 300, or device 500). In the illustrative example illustrated in FIGS. 23A-23Q, the electronic device 2300 is a smartphone. In other examples, electronic device 2300 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 2300 has a display 2302, one or more input devices (eg, a touchscreen of the display 2302, a button 2304, a microphone (not displayed)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 2303) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more biometric sensors 2303 are one or more biometric sensors 703. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 23A, the electronic device 2300 displays a photo gallery user interface 2310 on the display 2302. In some examples, photo gallery user interface 2310 slides from the edge of the display into the display (eg, sliding up from the lower edge of the display), replacing the display of the previous interface, application, and/or virtual keyboard. In some examples, photo gallery user interface 2310 slides up in response to a request to open a photo gallery application. In some examples, the photo gallery user interface 2310 slides up in response to a request to send photos to a participant in the conversation in the messaging application.

In some examples, as shown in FIG. 23A, the photo gallery user interface 2310 includes a plurality of selectable photos corresponding to photos stored on the electronic device 2300 (or accessible by the device via a remote server). Includes preview images. In some examples, as also shown in FIG. 23A, a plurality of selectable preview images are based on time (eg, the date the photo was taken) and/or based on location (eg, where the photo was taken). Organized. For example, a plurality of selectable preview images 2312A to 2312F shown below the header 2312 correspond to photos taken on April 30 in Cupertino, CA, USA, and shown below the header 2314 The plurality of selectable preview images 2314A to 2314C correspond to photos taken yesterday in San Francisco, California, USA.

In some examples, upon launching the photo gallery application, the electronic device 2300 displays selectable preview images of the photo gallery user interface 2310 that may be selected (to be transmitted). For example, the plurality of selectable preview images includes selectable preview images 2314-2314C. As shown in FIG. 23A, a plurality of selectable preview images 2314A-2314C may be selected by a user for transmission to a participant via one or more applications, such as a messaging application or an email application.

In FIG. 23B, while displaying a photo gallery user interface 2310 with selectable preview images 2314A-2314C (corresponding to the pictures selected to be transmitted), the electronic device 2300 A user activation 2301 of a transmission affordance 2316 (eg, a button) to initiate transmission of photos corresponding to images 2314A and 2314B is detected. For example, user activation 2301 is a tap gesture on transfer affordance 2316.

In FIG. 23C, in response to detecting activation of the transmit affordance 2316, the electronic device 2300 provides a prompt 2318. As illustrated in FIG. 23C, in some examples, prompt 2318 instructs the user to provide one or more activations of button 2304, such as a double press of button 2304. In some examples, prompt 2318 is highlighted relative to one or more other displayed objects. Emphasizing a prompt in this manner includes, for example, darkening, blurring, and/or otherwise obscuring one or more portions of the photo gallery user gallery 2310.

As also illustrated in FIG. 23C, additionally, in response to detecting activation of the transmission affordance 2316, the electronic device 2300 is configured with an application selection interface comprising a plurality of application affordances 2320A-2320H. 2320) is displayed. In some examples, each of the application affordances 2320A-2320H is used to transmit images (to a different device other than electronic device 2300), such as images corresponding to selectable preview images 2314A-2314C. Corresponds to applications that can be used.

In some examples, button 2304 has a fixed position relative to display 2302 and/or one or more other components of electronic device 2300. In some examples, the prompt 2318 is also displayed in a fixed position relative to the display 2302 and/or one or more other components of the electronic device. In this way, prompt 2318 is displayed at a predetermined location for button 2304.

In FIG. 23D, while displaying the prompt 2318 (optionally overlaid over the photo gallery user interface), the electronic device 2300 detects a user activation 2306 of the button 2304. In some examples, as shown in FIG. 23D, user activation is a double press of button 2304. In some examples, the double pressing of button 2304 includes a first pressing of the button and a second pressing of the button that occur within a predetermined time (eg, 1 second).

In response to detecting one or more activations of button 2304, electronic device 2300 initiates biometric authentication (eg, face recognition authentication) for the user's biometric feature (eg, face). As illustrated in FIG. 23E, in some examples, upon initiation of biometric authentication, a biometric authentication interface 2322 is provided (eg, displayed on display 2302). In some examples, the biometric authentication interface is overlaid over an application interface, such as photo gallery user interface 2310, during biometric authentication. In some examples, biometric authentication includes simulation of a representation of a biometric feature, such as glyph 2324. Additionally, in response to one or more activations of the button 2304, one or more biometric sensors 2303 of the electronic device 2300, such as one or more cameras or a facial recognition sensor (e.g., one or more biometric sensors). (Included in 2303) is activated.

In some examples, once one or more biometric sensors 2303 is activated, electronic device 2300 acquires (eg, captures) biometric data corresponding to a biometric feature associated with the user. In some examples, the biometric feature captures biometric data using one or more biometric sensors 2303 (and/or biometric sensors of one or more cameras) of the electronic device. Optionally, a light emitting device such as an IR floodlight or structured light projector is used to help illuminate the biometric features. In other examples, the electronic device receives biometric data from another device.

In some examples, once the electronic device 2300 has obtained the biometric data, the electronic device processes (eg, analyzes) the biometric data to determine whether the biometric authentication is successful. In some examples, such determination includes determining whether the biometric data matches a biometric template associated with the user. The biometric template is optionally stored on the electronic device 2300.

In some examples, while processing biometric data, as illustrated in FIG. 23F, the biometric authentication interface 2322 is a biometric authentication interface, e.g., as described with reference to FIGS. 17A-17A. Displaying the one or more rotating rings 2326 using s indicates that biometric data is being processed by the electronic device. In some examples, one or more rotating rings 2326 replace the glyph 2324 in the biometric authentication interface.

When the electronic device 2300 determines that biometric authentication is successful (e.g., biometric data is matched to a biometric template associated with a user), the electronic device is in a state in which a function (e.g., image transmission) is disabled. Transitions from to the state in which the function is enabled. As an example, successful biometric authentication allows the electronic device to transmit (eg, share) images, such as images corresponding to selectable preview images 2314A- 2314C. In some examples, the electronic device further indicates that the biometric authentication was successful, for example by displaying a simulation of the representation of the biometric feature in the biometric authentication interface. As shown in FIG. 23G, in some examples, biometric authentication interface 2322 includes a glyph 2328 indicating (to the user) that biometric authentication was successful. In some examples, glyph 2328 replaces one or more rotating rings 2326 in biometric authentication interface 2322.

23H, after the image transmission on the electronic device 2300 is enabled in response to successful biometric authentication, and while displaying the application selection interface 2320, the electronic device (to launch the corresponding application ) Detect user activation 2305 of application affordance. For example, the activated affordance is the application affordance 2320A. Activation of the application affordance 2320A triggers an application 2330 (e.g., a messaging application) corresponding to the application affordance 2320A and/or causes the electronic device to cause the electronic device (e.g., application (At the same time as the start of) application 2330 is used to transmit images corresponding to the selectable preview images 2314A to 2314C.

If the electronic device 2300 determines that the biometric authentication was unsuccessful (e.g., the biometric data does not match the biometric template associated with the user), the electronic device performs transmission of images between states (e.g., The same state is maintained without transitioning from a state in which a function such as applying is disabled to a state in which the function is enabled. In some examples, the electronic device further indicates (to the user) that the biometric authentication was unsuccessful, for example by displaying a simulation of the representation of the biometric feature in the biometric authentication interface. 23J, in some examples, biometric authentication interface 2322 includes a glyph 2332 indicating that biometric authentication was not successful. Glyph 2332 indicates, for example, that the biometric feature has not been recognized by the electronic device.

In FIG. 23K, after image transmission on the electronic device 2300 is not enabled in response to unsuccessful biometric authentication, and while displaying the application selection interface 2320, the electronic device is configured with the user of application affordance 2320A Activation 2307 is detected. In some examples, in response to detecting activation of the application affordance 2320A of the application selection user interface 2320, as shown in FIG.23L, the electronic device 2300 provides an alternative authentication affordance 2334 (e.g., Password affordance and passcode affordance) are displayed. In some examples, while displaying the alternative authentication affordance 2334, the electronic device detects a user activation 2309 of the alternative authentication affordance 2334. Activation of the alternative authentication affordance results in the display of the alternative authentication interface 2336 (eg, password interface, passcode interface), as shown in Fig. 23M.

In some examples, electronic device 2300 performs biometric authentication during display of alternative authentication interface 2336. In some examples, the electronic device obtains and processes the biometric data to determine whether the obtained biometric data matches a biometric template associated with the user. As such, in some examples, alternative authentication interface 2336 simulates a representation of a biometric feature, such as glyph 2338 (e.g., corresponding to glyph 2324), as shown in FIG. 23M. Include. In some examples, the alternative authentication interface 2336 may include one or more rotating rings 2340 (e.g., as shown in Figure 23N, and described with reference to Figures 17A-17Ai). (Corresponding to one or more rotating rings 2326) indicating that biometric data is being processed by the electronic device. In some examples, one or more rotating rings 2340 replace glyph 2338 in an alternative authentication interface.

When the electronic device 2300 determines that the biometric authentication has not been successful (eg, the biometric data does not match the biometric template associated with the user), the electronic device disables the function (eg, image transmission). It remains in a state of being. In some examples, the electronic device further indicates that the biometric authentication was unsuccessful, for example by displaying a simulation of the representation of the biometric feature in an alternative authentication interface 2336. As shown in Figure 23O, in some examples, the alternative authentication interface 2336 includes a glyph 2342 (e.g., corresponding to glyph 2328) indicating (to the user) that biometric authentication was unsuccessful. do. In some examples, the glyph 2342 replaces one or more rotating rings 2340 in an alternative authentication interface.

In some examples, in addition to or instead of biometric authentication, electronic device 2300 performs passcode authentication during display of alternative authentication interface 2336. Accordingly, the electronic device receives and processes the passcode data to determine whether the received passcode data matches a registered passcode associated with the user. As such, in some examples, the alternative authentication interface 2336 includes an indication of the received passcode input, such as passcode indication 2344, as shown in FIG. 23P.

As discussed above, when the electronic device 2300 determines that biometric authentication and/or passcode authentication is successful, the electronic device activates the function from a state in which the function (eg, image transmission) is disabled. Transition to the enabled state. For example, as shown in Figure 23Q, successful biometric authentication and/or passcode authentication allows the electronic device to select, via application 2330 (e.g., a messaging application) preview images 2314A-2314C. It makes it possible to transmit (eg, share) images, such as images corresponding to.

As mentioned above, exemplary examples of user interfaces illustrated in FIGS. 23A to 23Q described above relate to exemplary examples of user interfaces illustrated in FIGS. 24A to 24B described below. Accordingly, the processes described above in connection with the exemplary user interfaces illustrated in FIGS. 23A-23Q and the processes described below in connection with the exemplary user interfaces illustrated in FIGS. 24A-24B include: , 100, 300, 500, 2300, or 2400) are very similar processes that similarly involve initiating and managing biometric authentication.

24A-24BC illustrate example user interfaces for managing biometric authentication, according to some examples. The user interfaces of these figures are used to illustrate the processes described below, including those of FIGS. 25A-25C.

24A illustrates an electronic device 2400 (eg, portable multifunction device 100, device 300, or device 500). In the illustrative example illustrated in FIGS. 24A-24B, the electronic device 2400 is a smartphone. In other examples, electronic device 2400 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 2400 has a display 2402, one or more input devices (eg, a touchscreen of the display 2402, a button 2404, a microphone (not displayed)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 2403) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 24A, electronic device 2400 displays instructional user interface 2410 on display 2402. In some examples, the instructional user interface 2410 slides from the edge of the display into the display (eg, sliding up from the lower edge of the display), replacing the display of a previous interface, application, and/or virtual keyboard. In some examples, instructions user interface 2410 slides up in response to a request to proceed with a payment transaction (eg, with a different device such as a transaction terminal).

In some examples, as shown in FIG. 24A, instruction manual user interface 2410 displays text indicating to the user that an input (e.g., a double click of button 2404) may be performed to proceed with a payment transaction. (2410A) is included. In some examples, as also shown in FIG. 24A, the instructional user interface 2410 indicates (to the user) that an input (e.g., a double click of button 2404) may be performed to proceed with the payment transaction. And a graphic display 2410B, corresponding to the text display 2410A, which is indicated.

In some examples, in response to detecting a user activation of an affordance (eg, a “continue” affordance) on the instructional user interface 2410, the electronic device 2400 displays a display 2402, as shown in FIG. 24B. On top, the payment account currently selected for use in a payment transaction overlaid by a prompt 2416 instructing the user to provide one or more activations of the button 2404 (e.g., a double click of the button 2404). A payment user interface 2412 including the expression 2414 is displayed. In some examples, prompt 2416 is highlighted relative to one or more other displayed objects (on payment user interface 2412). Emphasizing a prompt in this manner includes, for example, darkening, blurring, and/or otherwise obscuring one or more portions of payment user interface 2412.

In some examples, the location of button 2404 requested by prompt 2416 to be activated (eg, to proceed with a payment transaction) is highlighted by dynamic indication 2418. For example, as shown by the transition from Fig. 24B to Fig. 24C, the dynamic display 2418 can be further changed in size (e.g., wider and more) adjacent to the position of the button 2404 on the display. By continually alternating between narrowing, or otherwise continuously changing the size), highlighting the position of the button 2404 on the device, thereby making it easier for the user to find the button corresponding to the request in the prompt 2416. Make it possible.

In FIG. 24D, while displaying prompt 2416, electronic device 2400 detects activation 2401 of button 2404. In some examples, as shown in FIG. 24D, the activation is a double press of button 2404. In some examples, the double pressing of button 2404 includes a first pressing of the button and a second pressing of the button that occur within a predetermined time (eg, 1 second).

In response to one or more activations of the button 2404, the electronic device 2400 causes a prompt 2416 (and any corresponding of the prompts) to be overlaid on the payment user interface 2412, as shown in FIG. 24E. Highlight) and the display of the dynamic indication 2418, and initiate biometric authentication (eg, face recognition) for the user's biometric features (eg, face), as shown in FIG. 24F. In some examples, the biometric feature is at least a portion of a face (eg, a user's face), and biometric authentication involves facial recognition of at least a portion of the (user's) face.

As illustrated in FIG. 24F, in some examples, upon initiation of biometric authentication, a biometric authentication interface 2420 is provided. In some examples, the biometric authentication interface is overlaid over the payment user interface 2412 during biometric authentication. In some examples, biometric authentication includes simulation of a representation of a biometric feature, such as glyph 2422. Additionally, in response to one or more activations of button 2404, one or more biometric sensors of electronic device 2400, such as one or more cameras or a facial recognition sensor (eg, one or more biometric sensors 2403 ). Included in) is activated. In some examples, the electronic device displays the biometric authentication interface 2420 in a central area of the display and displays (eg, by displacing or moving up) a representation of the payment account 2414 in the upper portion of the display.

In some examples, once one or more biometric sensors are activated, electronic device 2400 acquires (eg, captures) biometric data corresponding to a biometric feature associated with the user. In some examples, the biometric feature captures biometric data using one or more biometric sensors 2403 (and/or biometric sensors of one or more cameras) of the electronic device. Optionally, a light emitting device such as an IR floodlight or structured light projector is used to help illuminate the biometric features. In other examples, the electronic device receives biometric data from another device.

In some examples, once electronic device 2400 has obtained the biometric data, the electronic device processes (eg, analyzes) the biometric data to determine whether the biometric authentication is successful. In some examples, such determination includes determining whether the biometric data matches a biometric template associated with the user. The biometric template is optionally stored on the electronic device 2400.

In some examples, as illustrated in FIG. 24G, the biometric authentication interface 2420 displays the one or more rotating rings 2424 using, for example, the biometric authentication interface, so that the biometric data can be transferred to the electronic device. Is being processed by In some examples, one or more rotating rings 2424 replace glyph 2422 in the biometric authentication interface.

If the electronic device 2400 determines that the biometric authentication is successful (e.g., the biometric data matches the biometric template associated with the user), the electronic device is authorized to transmit the function (e.g., payment credentials). ) Transitions from the disabled first state to the second state in which the function is enabled. In some examples, the first state is a state in which the secure element of the device is disabled to emit secure data (e.g., payment credentials of a payment account provisioned on the device), and the second state is a state in which the secure element is It is enabled to emit security data.

In some examples, successful biometric authentication authorizes the electronic device to send account credentials in connection with the payment transaction. In some examples, the electronic device further indicates (to the user) that the biometric authentication was successful, for example by displaying a simulation of the representation of the biometric feature in the biometric authentication interface. As shown in FIG. 24H, in some examples, biometric authentication interface 2420 includes a glyph 2426 indicating (to the user) that biometric authentication was successful. In some examples, glyph 2426 replaces one or more rotating rings 2424 in the biometric authentication interface.

In Figure 24I, following the electronic device 2400 determining that the biometric authentication was successful, the electronic device is provided with authorization to proceed with the payment transaction using the currently selected payment account (e.g., payment account 2414). And the payment transaction can be initiated accordingly. In some examples, electronic device 2400 displays textual indication 2428A and/or graphical indication 2428B to indicate that a payment transaction can be initiated. In some examples, textual representation 2428A and/or graphical representation 2428B replaces biometric authentication interface 2420 on payment user interface 2412, as shown in FIG. 24I. In some examples, graphical representation 2428B replaces glyph 2426 in payment user interface 2412.

In FIG. 24J, while displaying a payment user interface 2412 with a payment account 2414 selected and authorized for use in a payment transaction, the electronic device 2400 is (e.g., via the device's wireless transmitting radio). A second device 2430 (eg, a transaction terminal) different from the electronic device is detected. In response to detecting the second device (e.g., a transaction terminal), the electronic device 2400 transmits payment credentials associated with the payment account 2414 (e.g., via the device's wireless transmitting radio) to the second device. To complete the payment transaction.

In some examples, after successfully transmitting the payment credentials to the second device 2430, the electronic device 2400, as shown in Figure 24K, to indicate (to the user) that the payment transaction has been successfully completed. Updates the textual representation 2428A in the payment user interface 2412 (eg, to “payment completed”) and/or the graphical representation 2428B (eg, with a check mark).

In some examples, before proceeding with a payment transaction with a second device (eg, a transaction terminal) using payment account 2414, a different payment account may be selected for use in the transaction. In some examples, as shown in FIG. 24L, the electronic device 2400 has different payment accounts (e.g., payments) within payment user interface 2412 (e.g., in a lower area of the interface) than the currently selected payment account 2414 Displays one or more representations of accounts 2432A-2432C. In some examples, as shown in FIG. 24L, the electronic device 2400 may select a user of a different payment account (e.g., payment account 2432A) of one or more payment accounts different from payment account 2414. 2406) (e.g., a tap gesture) is received.

In some examples, when the second device is a transaction terminal in a store, in order to authorize in-store payment using biometric authentication (e.g., face recognition authentication), the user first selects a hardware button (e.g., button 2404). ), you need to confirm your intention to pay by activating (by double clicking on the Sleep/Wake button). In some examples, the user then authenticates using biometric authentication (eg, facial recognition authentication) prior to placing the device near a second device (eg, a transaction terminal). In some examples, if the user wishes to select a different payment method after biometric authentication (e.g., face recognition authentication), the device prompts the user to re-authenticate with biometric authentication, but the user (2404)) is not required to activate (e.g., double-click the sleep/wake button again).

In some examples, upon user selection 2406 of payment account 2432A, the representation of payment account 2432A slides up within payment user interface 2412, as shown in FIG. 24M, and payment account 2414 The expression of) slides down within the payment user interface 2412. In some examples, as shown in FIG. 24N, the representation of payment account 2432A slides upward to a location previously occupied by the representation of payment account 2414 within payment user interface 2412 (and thereby Indicating to the user that account 2432A is now selected for use in a payment transaction), the representation of the payment account 2414 is a payment user interface to join one or more representations of payment accounts different from the currently selected payment account. 2412) Sliding down inside. Once the currently selected payment account has been switched from the payment account 2414 to the payment account 2432A, the device uses the payment account 2432A to proceed with a payment transaction (e.g., as described with reference to FIG. 24J) to make a transaction. Can be completed.

In some examples, the technique described with reference to FIGS. 24B-24N is an application 2434 in which the electronic device 2400 is on the display 2402, different from the instructional user interface 2410, as shown in FIG. While being displayed (eg, a messaging application), it may be initiated (eg, as initiated by activation 2401 according to prompt 2416). For example, FIG. 24O illustrates an electronic device 2400 displaying an application 2434 (eg, a messaging application) on a display 2402. While displaying application 2434, electronic device 2400 receives a user activation of button 2404 (eg, double click 2405). In response to receiving the user activation, the electronic device proceeds with the technique described with reference to FIGS. To obtain.

In some examples, the technique described with reference to FIGS. 24B-24N is, as shown in FIG. 24P, while the display 2402 of the electronic device 2400 is in the off state (e.g., at a prompt 2416). It may be initiated by activation 2401 accordingly or as initiated by activation 2405 while the application 2434 is being displayed). While display 2402 is in the off state, electronic device 2400 receives a user activation of button 2404 (e.g., double click 2407). In response to receiving the user activation, the electronic device proceeds with the technique described with reference to FIGS. To obtain.

24Q illustrates an electronic device 2400 with a display 2402 in an off state. While the display 2402 is in the off state, the electronic device detects the second device 2430 (eg, a transaction terminal) (eg, via the device's wireless communication radio). In some examples, in response to detecting the second device 2430 while the display 2402 is in the off state, the electronic device 2400 is on the display 2402 to proceed with a payment transaction (e.g., Displays a prompt 2416 and a payment user interface 2412 (as illustrated in 24b).

When the electronic device 2400 determines that the biometric authentication has not been successful (e.g., the biometric data does not match the biometric template associated with the user), the device does not transition from the first state to the second state. , In some examples, the electronic device remains in the first state (eg, authorization to proceed with the payment transaction remains disabled). In some examples, the electronic device further indicates that the biometric authentication was unsuccessful, for example by displaying a simulation of the representation of the biometric feature in the biometric authentication interface 2420. As shown in FIG. 24R, in some examples, biometric authentication interface 2420 includes a glyph 2436 indicating that biometric authentication was unsuccessful. Glyph 2436 indicates that, for example, the biometric feature has not been recognized by the electronic device. In some examples, in addition to the glyph 2436 in the biometric authentication interface 2420, the electronic device 2400 further indicates (to the user) that the biometric authentication was unsuccessful (e.g., a haptic output 2438). Feedback).

In some examples, the glyph 2436 is further moved (e.g., horizontally or vertically) within the area of the biometric authentication interface 2420 to further indicate (to the user) that the biometric authentication was not successful. do. For example, as shown in the transition from Fig. 24R to Fig. 24S to Fig. 24T, the glyph 2436 slides back and forth in the horizontal direction for a predetermined period (e.g., 3 seconds) (e.g., repeats the left and right continuous sliding movement. box). In some examples, the device continues to generate tactile output 2438 (eg, haptic feedback) for the duration of movement of glyph 2436 in biometric authentication interface 2420. In some examples, the tactile output 2438 is synchronized with the movement of the glyph 2436.

In some examples, while displaying in the biometric authentication interface 2420 a glyph 2436 indicating to the user that the biometric authentication was not successful, as shown in FIG. 24U, the electronic device 2400 is An alternative authentication affordance 2440 to provide alternative (e.g., passcode, password) authentication in addition to or instead of measurement authentication (e.g., under biometric authentication interface 2420) within payment user interface 2412. E) display and proceed with payment In some examples, while displaying an alternative authentication affordance 2440 to provide an alternate authentication, the electronic device detects a user selection 2411 (e.g., a tap gesture) of affordance, as shown in FIG. 24V. .

As shown in FIG. 24W, in response to detecting a user selection of affordance 2440, electronic device 2400 displays an alternative authentication interface 2442 on display 2402. In some examples, electronic device 2400 performs biometric authentication during display of alternative authentication interface 2442. In some examples, the electronic device obtains and processes the biometric data to determine whether the obtained biometric data matches a biometric template associated with the user. As such, in some examples, the alternative authentication interface 2442 simulates a representation of a biometric feature, such as glyph 2444 (e.g., corresponding to glyph 2422), as shown in FIG. 24W. Include. In some examples, alternative authentication interface 2442 is by displaying one or more rotating rings 2446 (e.g., corresponding to one or more rotating rings 2424), for example, as shown in FIG. 24X. , Indicates that biometric data is being processed by the electronic device. In some examples, one or more rotating rings 2446 replace glyph 2444 in an alternative authentication interface.

If the electronic device 2400 determines that the biometric authentication is successful (e.g., biometric data matches a biometric template associated with the user), the device functions (e.g., authorization for sending payment credentials). A transition is made from the disabled first state to the second state in which the function is enabled. In some examples, successful biometric authentication allows the electronic device to send payment credentials (eg, associated with payment account 2414 ), eg, to a transaction terminal. In some examples, the electronic device further indicates that biometric authentication was successful, for example, by displaying a simulation of the representation of the biometric feature in an alternative authentication interface 2442. 23Y, in some examples, the alternative authentication interface 2442 includes a glyph 2448 (e.g., corresponding to glyph 2426) indicating (to the user) that the biometric authentication was successful. . In some examples, glyph 2448 replaces one or more rotating rings 2446 in an alternative authentication interface.

In some examples, in addition to or instead of biometric authentication, electronic device 2400 performs passcode authentication during display of alternative authentication interface 2442. Accordingly, the electronic device receives and processes the passcode data to determine whether the received passcode data matches a registered passcode associated with the user. As such, in some examples, the alternative authentication interface 2442 includes an indication of the received passcode input, such as passcode indication 2450, as shown in FIG. 23Y.

In FIG. 24Z, following the electronic device 2400 determining that the biometric authentication (and/or alternative authentication, e.g., passcode authentication) was successful, the electronic device may be configured with the currently selected payment account (e.g., payment account 2414). )) to proceed with a payment transaction, indicating that a payment transaction (e.g., with a transaction terminal) can be initiated accordingly. In some examples, electronic device 2400 may display textual display 2452A (e.g., corresponding to textual display 2428A) and/or graphic display 2452B (e.g., graphic display 2452B) to indicate that a payment transaction can be initiated. 2428B)).

24AA illustrates an electronic device 2400 displaying an alternative authentication interface 2442 similar to the alternative authentication interface of FIG. 24W on a display. As in FIG. 24W, electronic device 2400 performs biometric authentication during display of alternative authentication interface 2442. Accordingly, the electronic device obtains and processes the biometric data to determine whether the obtained biometric data matches the biometric template associated with the user. As such, the alternative authentication interface 2442 includes a glyph 2444 indicating to the user that biometric data has been (or is being obtained). In FIG. 24Ab, as in FIG. 24X, an alternative authentication interface 2442 indicates that biometric data is being processed by the electronic device, for example by displaying one or more rotating rings 2446.

If the electronic device 2400 determines that the biometric authentication has not been successful (e.g., the biometric data does not match the biometric template associated with the user), the electronic device performs a function (e.g., transmits payment credentials). (Authorization for the thing) is reserved for transitioning from the disabled first state to the second state in which the function is enabled (thereby not allowing the device to proceed with the payment transaction). In some examples, the electronic device 2400 further indicates (to the user) that the biometric authentication was unsuccessful, for example, by displaying a simulation of the representation of the biometric feature in an alternative authentication interface 2442. As shown in Figure 23ac, in some examples, the alternative authentication interface 2442 includes a glyph 2454 (e.g., corresponding to glyph 2436) indicating (to the user) that the biometric authentication was unsuccessful. do.

24A illustrates electronic device 2400 displaying an alternative authentication interface 2442 on display 2402 after unsuccessful biometric authentication. The electronic device displays an indication (eg, via glyph 2454) that the biometric authentication was not successful. In some examples, as shown in FIG. 24A, after unsuccessful biometric authentication, the electronic device 2400 while displaying the alternative authentication interface 2442 (e.g., described with reference to FIGS. 24B-24J). As previously described), one or more activations of button 2404 (eg, double press of button 2404) are received to restart the biometric authentication process. Thus, upon failure of the biometric authentication and/or alternative authentication process, the user may retry the process via one or more activations of button 2404. In some examples, if the biometric authentication process has not been successfully attempted for a predetermined number of consecutive attempts, or has not been successfully attempted for a predetermined number of consecutive attempts within a predetermined time period, the button 2404 One or more activations (eg, double pressing of button 2404) no longer enable restart of the biometric authentication process (eg, as described with reference to FIGS. 24B-24J).

In FIG. 24AF, the electronic device 2400 detects a second device 2430 (eg, a transaction terminal) while displaying an alternative authentication interface 2442 (eg, via the device's wireless communication radio). . In some examples, in response to detecting the second device 2430 while displaying the alternative authentication interface, the electronic device 2400 is a prompt to proceed with the payment transaction (e.g., a prompt as illustrated in FIG. 2416)) and a payment user interface.

24AG is authorized to initiate a transaction using the currently selected payment account (e.g., payment account 2414) (e.g., after a biometric authentication and/or alternative authentication, e.g. passcode authentication has been successfully provided) and display ( Illustrating an electronic device 2400 displaying a payment user interface 2412 on 2402. In some examples, payment user interface 2412 includes a menu tab 2456 (eg, next to the lower edge of the display, in a lower area of the interface), as shown in FIG. 24AG. In some examples, the electronic device detects a sliding gesture 2415 (eg, in an upward direction) of the menu tab 2456. For example, the sliding gesture 2415 corresponds to a touch-and-slide gesture (in the upward direction) of the menu tab 2456.

In some examples, sliding gesture 2415 on menu tab 2456 expands a menu tab (eg, over payment user interface 2412 ), as shown in FIG. 24Ah. Once expanded, the menu tab 2456 includes one or more application affordances (eg, application affordances 2456A-2456D) accessible from the menu tab and corresponding to applications installed on the device. For example, the menu tab 2456 includes a first application affordance 2456A corresponding to a messaging application, a second application affordance 2456B corresponding to a voice call application, and a third application affordance 2456C corresponding to an email application. , And a fourth application affordance 2456D corresponding to the browsing application. In some examples, only first party applications (controlled only by the device's operating system) may be included in the menu tab 2456.

24AI illustrates an electronic device 2400 that detects a sliding gesture 2415 while the gesture slides downward on the display (and thus reduces the expanded menu bar). As a result of the sliding gesture 2415 of the menu bar 2456 in the downward direction, the menu bar changes its original size and position (e.g., at the bottom of the payment user interface 2412), as shown in FIG. Reduce (or fold back to it) Once the menu bar is completely folded, the payment user interface is again fully visible on the display.

24Ak illustrates an electronic device 2400 displaying a webpage 2458 of a browsing application on a display 2402. For example, the web page 2458 is a checkout page of the item 2460 that the user wants to purchase, and includes a purchase affordance 2462 for proceeding with the purchase of the item. In some examples, as shown in FIG. 24Ak, the electronic device detects user activation 2417 of purchase affordance 2462.

In some examples, upon detecting user activation of purchase affordance 2462, electronic device 2400 displays payment sheet interface 2464 on display 2402, as shown in FIG. 24A. In some examples, the payment sheet interface 2464 (partially) overlays the browsing application and includes a biometric authentication interface 2420. In some examples, as also shown in FIG. 24A, in addition to the payment sheet interface, the device may additionally perform one or more activations (e.g., a double press of button 2404) to proceed with providing authorization for the purchase. Display a prompt 2466 (e.g., corresponding to prompt 2416) indicating (to the user) to provide a.

In some examples, payment sheet interface 2464 may provide one or more details (e.g., payment account, shipping method, billing address, shipping address, contact information) related to the proposed transaction, as shown in FIG. 24A. Include. In some examples, the one or more details include the selected payment account. In some examples, the user may change the selected payment account to a different payment account by selecting the details area 2464A (the area within it or an icon therein) corresponding to the selected payment account. In some examples, the one or more details include the selected shipping method. In some examples, the user may change the selected shipping method to a different shipping method by selecting the details area 2464B (an area within it or an icon therein) corresponding to the selected shipping method. In some examples, the one or more details include the selected address (eg, billing address, shipping address). In some examples, the user can change the selected address to a different address by selecting the details area 2464C (the area inside it or an icon therein) corresponding to the selected address. In some examples, the one or more details include selected contact information (eg, email, phone number). In some examples, the user may change the selected contact information to different contact information by selecting the details area 2464D (an area within it or an icon therein) corresponding to the selected contact information.

In FIG. 24AM, after displaying the payment sheet interface 2464 and the prompt 2466 over the webpage 2458 of the browsing application, the electronic device 2400 may input an input corresponding to the request of the prompt 2466 (e.g., a button ( 2404) is detected. In some examples, upon receiving an input corresponding to the request of the prompt 2466 (e.g., a double press of the button 2404), a glyph within the biometric authentication interface 2420 displayed within the payment sheet interface 2464 2468 (e.g., corresponding to glyph 2422) is provided. Additionally, in response to the input, one or more biometric sensors of the electronic device 2400, such as one or more cameras or a facial recognition sensor (eg, included among one or more biometric sensors 2403) are activated.

In some examples, once one or more biometric sensors are activated, electronic device 2400 acquires (eg, captures) biometric data corresponding to a biometric feature associated with the user. In some examples, the biometric feature captures biometric data using one or more biometric sensors 2403 (and/or one or more cameras) of the electronic device. Optionally, a light emitting device such as an IR floodlight or structured light projector is used to help illuminate the biometric features. In other examples, the electronic device receives biometric data from another device.

In some examples, once electronic device 2400 has obtained the biometric data, the electronic device processes (eg, analyzes) the biometric data to determine whether the biometric authentication is successful. In some examples, such determination includes determining whether the biometric data matches a biometric template associated with the user. The biometric template is optionally stored on the electronic device 2400.

In some examples, as illustrated in FIG. 24Ao, the biometric authentication interface 2420 in the payment sheet interface 2464 includes one or more rotating rings 2470 (e.g., using a biometric authentication interface). By displaying one or more rotating rings 2424), indicating that biometric data is being processed by the electronic device. In some examples, one or more rotating rings 2470 replace glyph 2468 in the biometric authentication interface.

When the electronic device 2400 determines that the biometric authentication is successful (e.g., biometric data is matched to a biometric template associated with the user), the electronic device performs a function (e.g., payment credentials for use in a payment transaction). Transmitting the transmission of data) transitions from the disabled first state to the second state where the function is enabled. As such, if the biometric authentication is successful, the device will receive payment credentials (e.g., associated with payment account 2472) for use in a payment transaction (e.g., to make a purchase of item 2460). To the transaction terminal, to an external server). In some examples, the electronic device further displays a glyph 2474 (e.g., corresponding to glyph 2426) indicating (to the user) that the biometric authentication was successful, e.g., as shown in FIG. 24AP. By doing so, it indicates that the biometric authentication was successful. In some examples, glyph 2474 replaces one or more rotating rings 2470 in the biometric authentication interface.

In some examples, in response to determining that the biometric authentication was successful, the electronic device 2400 processes the payment transaction (e.g., sending payment credentials to an external device such as an external server, indicating that the credentials have been successfully received). It receives a response from the external device indicating that it is). In some examples, as shown in FIG. 24aq, the electronic device 2400 also indicates a processing indication (e.g., having a similar or identical pattern to one or more rings 2470) indicating (to the user) that the payment transaction is being processed. Display 2476 in payment sheet interface 2464. In some examples, once processing of the transaction is complete, the electronic device 2400 completes the processing indication 2476 as completed indication 2467 (e.g., it is Inclusive), thereby indicating (to the user) that the payment transaction has been successfully completed (and item 2460 has been successfully purchased).

In some examples, to make a payment within an application or on the web (e.g., webpage 2458), the electronic device allows the user to activate a hardware button (e.g., button 2404) (e.g., press a sleep/wake button). Confirm the intention to pay (by double-clicking), and then ask to authorize the payment by authenticating using biometric authentication (eg, face recognition authentication). In some examples, if the payment transaction is not completed within a predetermined time threshold (e.g., 30 seconds) that activates a hardware button (e.g., 2404) (e.g., double-clicking the sleep/wake button), the device returns By activating the button (eg, button 2404) (eg, by double-clicking the sleep/wake button) it requires reconfirmation of intent to pay.

FIG. 24AS illustrates an electronic device 2480 (eg, a laptop computer) displaying a webpage 2484 (eg, similar to webpage 2458) of a browsing application on a display 2482. For example, the webpage 2484 is a checkout page of the item 2486 that the user wants to purchase. In some examples, the webpage 2484 of the browsing application is a purchase affordance to provide authorization to proceed with the purchase of the item using a different device than the electronic device 2480 (e.g., using the electronic device 2400). (2488) is included.

In some examples, user activation of purchase affordance 2480 on electronic device 2480 causes electronic device 2400 to display remote payment user interface 2490, as shown in FIG. 24A. In some examples, the remote payment user interface 2490 is a (graphical) display 2492 of a device (e.g., electronic device 2480) requesting remote authentication to proceed with a payment transaction, for use in a payment transaction. An indication 2494 of the currently selected payment account, and the user may provide one or more activations (e.g., double click) of the button 2404 to proceed with providing authentication (e.g., biometric authentication) for the payment transaction. A prompt 2496 (e.g., corresponding to prompt 2416) to request a request. In some examples, as also shown in FIG. 24A, the prompt 2496 is highlighted relative to one or more other displayed objects (eg, compared to the indication 2492 of the electronic device 2480 ). Emphasizing a prompt in this manner includes, for example, darkening, blurring, and/or otherwise obscuring one or more portions of the remote payment user interface 2490.

In some examples, the indication 2494 of a payment account currently selected for use in a payment transaction includes an affordance 2494A. In some examples, as shown in FIG. 24AU, electronic device 2400 detects user activation 2421 (eg, a tap gesture) of affordance 2494A. In some examples, in response to detecting a user selection of affordance 2494A, electronic device 2400 is provisioned on (and thereto) the device, as shown in FIG. 24AV, within remote payment user interface 2490. Accordingly, it displays representations of one or more payment accounts (eg, payment account 2494, payment account 2498) available for use in a payment transaction. In some examples, as also shown in FIG. 24AV, the representation of the currently selected payment account also includes an indication 2494B (eg, a check mark) indicating (to the user) that it corresponds to the currently selected account.

In FIG. 24A, while displaying representations of payment accounts (e.g., payment account 2494, payment account 2498) provisioned on the electronic device in the remote payment user interface 2490, the electronic device 2400 is currently A user selection 2423 of a payment account (eg, payment account 2498) different from the selected payment account (eg, payment account 2494) is detected. In response to detecting user selection 2423 of payment account 2498, electronic device 2400 removes representations of available payment accounts from remote payment user interface 2490 and, as shown in FIG. , Displays payment account 2498 (instead of payment account 2494) as the currently selected payment account for use in a payment transaction.

As also shown in FIG. 24ax, after replacing the payment account 2494 with the payment account 2498, the electronic device 2400 displays one or more activations of the button 2404 corresponding to the request of the prompt 2496. 2425) (e.g., double click) is detected. In FIG. 24Ay, in response to detecting one or more activations 2425 of button 2404, electronic device 2400 displays biometric authentication interface 2420 within remote payment user interface 2490. In some examples, the electronic device further displays glyph 2499 (eg, corresponding to glyph 2422) in biometric authentication interface 2420 displayed in remote payment user interface 2490. Additionally, in response to the input, one or more biometric sensors of the electronic device 2400, such as one or more cameras or a facial recognition sensor (eg, included among one or more biometric sensors 2403) are activated.

In some examples, once one or more biometric sensors are activated, electronic device 2400 acquires (eg, captures) biometric data corresponding to a biometric feature associated with the user. In some examples, the biometric feature captures biometric data using one or more biometric sensors 2403 (and/or one or more cameras) of the electronic device. Optionally, a light emitting device such as an IR floodlight or structured light projector is used to help illuminate the biometric features. In other examples, the electronic device receives biometric data from another device.

In some examples, once electronic device 2400 has obtained the biometric data, the electronic device processes (eg, analyzes) the biometric data to determine whether the biometric authentication is successful. In some examples, such determination includes determining whether the biometric data matches a biometric template associated with the user. The biometric template is optionally stored on the electronic device 2400.

In some examples, as illustrated in FIG. 24AZ, the biometric authentication interface 2420 in the remote payment user interface 2490 includes one or more rotating rings 2497 (e.g., using a biometric authentication interface). , Corresponding to one or more rotating rings 2424), indicating that biometric data is being processed by the electronic device. In some examples, one or more rotating rings 2497 replace the glyph 2499 in the biometric authentication interface.

When the electronic device 2400 determines that the biometric authentication is successful (e.g., biometric data is matched to a biometric template associated with the user), the electronic device performs a function (e.g., payment credentials for use in a payment transaction). Transmitting the transmission of data) transitions from the disabled first state to the second state where the function is enabled. As such, if the biometric authentication is successful, the device will receive payment credentials (e.g., associated with payment account 2498) for use in a payment transaction (e.g., to make a purchase of item 2486). To the transaction terminal, to an external server). In some examples, the electronic device further displays a glyph 2495 (e.g., corresponding to glyph 2426) indicating (to the user) that the biometric authentication was successful, e.g., as shown in Figure 24B. By doing so, it indicates that the biometric authentication was successful. In some examples, glyph 2495 replaces one or more rotating rings 2497 in biometric authentication interface 2420 of remote payment user interface 2490.

In some examples, in response to determining that the biometric authentication was successful, the electronic device 2400 processes the payment transaction (e.g., sending payment credentials to an external device such as an external server, indicating that the credentials have been successfully received). It receives a response from the external device indicating that it is). In some examples, as shown in FIG. 24BB, the electronic device 2400 also indicates a processing indication (e.g., having a similar or identical pattern to one or more rings 2497) indicating (to the user) that the payment transaction is being processed. Display 2493 in remote payment user interface 2490. In some examples, once processing of the transaction is complete, the electronic device 2400 completes the processing indication 2493 as a completed indication 2491 (e.g., this is a check mark to indicate completion. Including ), thereby indicating (to the user) that the payment transaction has been successfully completed (and item 2486 has been successfully purchased).

25A-25C are flow charts illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. Method 2500 includes a device with a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 1900). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric feature by one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 2500 provides an intuitive method for managing biometric authentication. This method reduces the user's cognitive burden on managing biometric authentication, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, allowing a user to manage biometric authentication faster and more efficiently saves power and increases the time between battery charges.

In some examples, the electronic device (eg, 2300, 2400) receives, from a second device, a request to proceed with an action, wherein the request includes information associated with one or more options selected in the second device (2502). . In some examples, the electronic device receives a request to proceed with the transaction, and further receives information from the second device regarding the details of the transaction. In some examples, the action involves a transaction. In some examples, prior to receiving user input corresponding to the request to participate in the transaction, the electronic device receives, from the second device, an input corresponding to the transaction, wherein the input includes one or more details of the transaction, Display one or more transaction details associated with the transaction along with a request for authorization to proceed with the transaction.

The electronic device (e.g., 2300, 2400) may perform one or more activations of a button (e.g., 2304, 2404) (e.g., a hardware button) while the electronic device is in a first state with each function of the device disabled. Or a double click of a button, such as a mechanical button, a double click of a button 2304 or a button 2404) (2508). In some examples, each function is associated with a financial transaction, such as payment for a product or service. In some examples, when the function is disabled, the device cannot participate in the transaction.

In some examples, each function of the electronic device (eg, 2300, 2400) is participation in a transaction (2510). In some examples, participating in the transaction includes the transmission of secure data from the electronic device. In some examples, the secure data is financial data. In some examples, the transaction additionally or alternatively includes the transmission of non-secure data. In some examples, the information that enables the device to participate in the transaction is in a secure element (e.g., a physically and/or logically separate memory that stores the credentials in a manner that prevents them from being accessed maliciously). It is stored safely. In some examples, the electronic device is not enabled to participate in a transaction (eg, a financial transaction, such as payment for a product or service) when in the first state. In some examples, when the device is in the first state, the information that enables the device to participate in the transaction is not accessible to the device outside the secure element (e.g., payment credentials are used in a wireless payment transaction. Not available for).

In some examples, each function of the electronic device (eg, 2300, 2400) is a function for providing information associated with the action via the near field communication radio of the electronic device (2512). In some examples, the electronic device is a display (e.g., 2302, 2402), biometric sensor(s) (e.g., 2303, 2403), and/or a first while in an inactive state where one or more other components of the device are inactive. In the state. In some examples, since each function of the device is a function to provide information (e.g., payment information) associated with an action (e.g., transaction) via the device's near field communication wireless device (e.g., NFC transmitter), the electronic device is Not configured to participate in transactions when in the first state. For example, the device will continue until authorization to provide payment information is provided by the user, such as a double click of a hardware button (e.g. 2304, 2404) received with biometrics or passcode/password authentication. Do not respond with payment information to requests for payment information.

In some examples, one or more activations of a button (e.g., 2304, 2404) may result in a user interface (e.g., a lock screen user interface, a plurality of Cover sheet user interface with recent notifications, home screen user interface including application icons for a plurality of different applications and optionally one or more widgets, or payment such as an email application, phone application, messaging application, or camera application Occurs at least partially while displaying (2514) an application user interface for an application that is not an application.

In some examples, while the display of the electronic device (e.g., 2300, 2400) is off or while displaying a user interface that is not related to payment, the electronic device (e.g., in a situation where the user does not intend to provide payment information) In order to prevent the payment information from being provided inadvertently), it is not configured to transmit payment information to the payment terminal (eg, 2430) in response to a request for payment information. In some examples, in at least some situations when the display of the device is off or when displaying a user interface that is not related to payment, the electronic device listens to requests for payment information, informs the user that payment information has been requested, and makes payment to the user. Respond to at least some requests for payment information by displaying a payment user interface (eg, a virtual wallet) that prompts you to provide authorization to provide the information.

In some examples, one or more activations of the (hardware) button include a double press of the button (eg, a first press and a second press of the button within a predetermined period of time) (2516). In some examples, a hardware button (eg, 2304, 2404) is located on the side of the electronic device (eg, 2300, 2400). In some examples, the hardware button is a mechanical button. In some examples, activation of a button without a second activation of the button within a predetermined period of time performs a different function (eg, turns the display of the device on or off). In some examples, different activation of a button (eg, long pressing of a button for a different period of time) causes a different function (eg, powering off a device or entering a user interface to invoke a virtual assistant) to occur.

In some examples, one or more activations of the (hardware) button (eg, 2304, 2404) are detected while the first application is active on the electronic device (2518). In some examples, detecting one or more activations of the button occurs while displaying the instruction sheet interface (eg, 2410) (2520). In some examples, the electronic device (eg, 2300, 2400) does not display the instructional interface, but rather displays a biometric authentication interface (eg, 2322, 2420) and performs biometric authentication. Performing biometric authentication (as opposed to other forms of authentication, such as password authentication) makes it quicker and easier for a user to authenticate to perform a specific action (e.g., transaction) using the device (e.g., Without any input and within a shorter period of time). Reducing the number of inputs required to perform an operation improves the operability of the device and improves the operability of the device (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). -Make the device interface more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the button (eg, 2304, 2404) has a fixed position relative to the display of the electronic device (eg, 2300, 2400) (eg, the button is not purely a software button). In some examples, the button is a hardware button, such as a mechanical button or a solid state button. In some examples, the button is a switch or any other type of toggle. In some examples, the button has a fixed position relative to the electronic device, in particular relative to the display of the electronic device, such that the electronic device can display prompts based on the position of the button.

In some examples, the button (eg, 2304, 2404) is a mechanical button (eg, a hardware button such as a push button). In some examples, the button is not a software button, such as a button on a touchscreen of an electronic device (eg, 2300, 2400). In some examples, the button is a solid state button. In some examples, the button is a solid state button that operates in response to a capacitive and/or resistive touch and/or responds to changes in the strength of the input without having a mechanical switch pressed to activate the button, and instead, the input Monitors whether the intensity of the solid state button exceeds the intensity threshold corresponding to the activation of the solid state button.

In some examples, before detecting one or more activations of a button (e.g., 2304, 2404) (2508), the electronic device (e.g., 2300, 2400) is prompted to request that one or more activations of the button be provided (e.g., 2318). , 2416 (eg, by displaying on the display) (2504). In some examples, the electronic device prompts the user by displaying “DOUBLE CLICK FOR PAY”. In some examples, the prompt is displayed on a display (eg, 2302, 2404) of the electronic device. In some examples, the prompt is displayed adjacent to the button. In some examples, the prompt is an audible and/or tactile prompt. In some examples, the prompt is displayed when the device is not receiving any indication that the transaction terminal is nearby and is requesting transaction credentials, but is displaying the transaction user interface (e.g., requesting payment information. A prompt is displayed to provide one or more activations of the button before the device is placed within the NFC field of the NFC reader). In some examples, prior to outputting the prompt, the electronic device displays a tutorial interface including affordance.

In some examples, outputting a prompt (eg, 2318, 2416) occurs in response to selection of affordance. In some examples, a tutorial interface (eg, 2410) is displayed the first time a user attempts to implement each function without providing one or more activations of a button. In some examples, the tutorial interface animates a location based on the location of a button (e.g., 2304, 2404) on the device (e.g., the animation is a user interface in a direction in which the button can be pressed at a location adjacent or proximate the button on the device). Including movement of objects).

In some examples, outputting a prompt (e.g., 2318, 2416) to the user to provide one or more activations of the button is a prompt relative to one or more elements displayed on the display of the electronic device (e.g., 2300, 2400). It includes emphasizing (2506). In some examples, highlighting the prompt includes dimming, dimming, and/or stopping displaying at least a portion of the display of the electronic device. In some examples, highlighting a prompt includes brightening the prompt, flashing the prompt, or otherwise drawing attention to the prompt. In some examples, emphasizing the prompt relative to one or more elements displayed on the display of the electronic device includes blurring the one or more elements. In some examples, all elements displayed on a display (eg, 2302, 2402) (except for a prompt) are blurred. In some examples, only elements adjacent to the prompt are blurred. In some examples, emphasizing the prompt relative to one or more elements displayed on the display of the electronic device includes dimming the display of the one or more elements. In some examples, all elements displayed on the display (except for the prompt) are dimmed. In some examples, only elements adjacent to the prompt are dimmed. Dimming in this manner optionally includes reducing the brightness and/or darkening the displayed colors.

In some examples, outputting a prompt (eg, 2318, 2416) occurs in response to detecting an external signal of a predetermined type. In some examples, the electronic device (e.g., 2300, 2400) detects a signal, such as an NFC field from an NFC reader, such as a payment terminal (e.g., 2430), and the device sends payment credentials to the NFC reader. Prompts the user to provide an input to initiate the biometric authentication process to authorize it to be made available.

In some examples, outputting a prompt (eg, 2318, 2416) includes displaying an educational interface including a prompt element adjacent to the button. In some examples, the electronic device (e.g., 2300, 2400) is configured to provide one or more activations of the button (e.g., 2304, 2404) through an interface where a prompt is displayed near the location of the button and/or indicates the location of the button. Prompt the user. In some examples, the educational interface did not provide the one or more activations required to initiate biometric authentication that allows the user to implement each function of the electronic device, but the electronic device is enabled to implement each function. If not, it is displayed.

In some examples, the electronic device (e.g., 2300, 2400) prompts, on a display, to provide one or more activations of a button (e.g., 2304, 2404) at a first location in a biometric authentication interface (e.g., 2322, 2420). Display the prompt. Outputting a prompt requesting that one or more activations of the button be provided provides feedback to the user about the current state of the device, and visual feedback indicating what steps the user must take to proceed with a particular function using the device. To the user. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (eg, 2300, 2400) detects the activation (eg, selection) of the affordance of the first application (eg, activation of the affordance of the application requesting a transaction for a product or service). In some examples, the first application is a communication application. In some examples, the device displays the details of the transaction, and one or more of an affordance to initiate the transaction and a prompt to trigger biometric authentication. In some examples, the details of the transaction are optionally modified prior to detection of the biometric feature or prior to activation of affordance after biometric authentication is triggered via user input (eg, double click).

In some examples, in response to detecting activation of affordance of the first application (2522), the electronic device (e.g., 2300, 2400) provides information associated with an action from the first application to the second application (e.g., send). In some examples, the action from the first application to the second application involves a transaction. In some examples, prior to receiving user input corresponding to a request to participate in the transaction, the electronic device, in response to detecting activation of affordance of the first application, and in response to detecting activation of affordance of the first application, the first Provides information about the transaction from the application to the second application, and proceeds the transaction using the second application.

In some examples, the electronic device also displays transaction information on a display (e.g., 2302, 2402) (e.g., separate from the first application, and not shared with the first application, such as a credit card number, billing address, etc.). In a payment user interface comprising) at the same time display a second prompt to provide at least a portion of the information associated with the action at the first location and one or more activations of the button at the second location, wherein the second location is the first location It is more like a button than.

In some examples, prior to receiving activation of a button (eg, 2304, 2404), the details of the transaction are limited to a specific portion of the display so that a prompt to provide activation of the button can be displayed in proximity to the button. Limiting the details of the transaction to a specific portion of the display so that the prompt can be displayed close to the associated button provides the user with visual feedback that allows the user to follow the prompt's request more quickly and easily. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the details are limited to a specific height of the display. In some examples, if there is more information than can be displayed in the available area beneath the second prompt, the information associated with the action is the additional information that was hidden (eg, from the screen) before the scrollable area was scrolled Displayed in a scrollable area that is scrolled in response to user inputs for display. In some examples, providing information about a transaction from the first application to the second application includes providing information that may be displayed in the available area and additional information that was hidden.

In some examples, after displaying the prompt (e.g., 2318, 2416), the electronic device (e.g., 2300, 2400) sends a representation of the user credentials from a second location on the display (e.g., 2302, 2402) to a first on the display. Move to the position. In some examples, the representation of the user credential covers a prompt (e.g., double click) for the user credential to press a button (e.g., 2304, 2404) and/or includes a biometric authentication glyph (e.g., 2324, 2422). Moved to reveal. In some examples, moving the representation of the user credentials from the second location to the first location displays the biometric authentication glyph on the portion of the display that was occupied by the user credentials when the user credentials were displayed in the second location. Includes doing.

In response to detecting one or more activations of the button (2522), the electronic device (e.g., 2300, 2400) may be configured with one or more biometric sensors (e.g., 2303, 2403) separate from the button (e.g., 2304, 2404). ) To capture biometric data (2524). In some examples, in response to a double press of a hardware button, the device receives biometric data, such as data about the user's face. In some examples, the one or more biometric sensors include a face recognition sensor, and the biometric data corresponds to at least a portion of the face.

In some examples, capturing biometric data includes using a camera to capture biometric data. In some examples, biometric data is captured using a camera and/or a facial recognition sensor (eg, 2303, 2403). In some examples, a camera is used to ensure that the user is looking at the device, and a facial recognition sensor is used to authenticate the user's face.

In some examples, capturing biometric data with one or more biometric sensors includes activating one or more biometric sensors (eg, 2303, 2403) for a second predetermined period of time. For example, in response to a pressing of a button (e.g., 2304, 2404), the electronic device (e.g., 2300, 2400) may be Activating (eg, transitioning biometric sensors from an inactive state to an active state) and capturing biometric data using one or more activated biometric sensors. In some examples, the activated one or more biometric sensors are activated for a period of time, and if biometric data has not been captured for a period of time, the biometric authentication process fails. In some examples, the second predetermined period begins when one or more activations of the button are detected. In some examples, a period of time begins when the button is pressed. In some examples, capturing biometric data in this manner includes illuminating the biometric feature and capturing data corresponding to the illumination. In some examples, the biometric feature is illuminated using an IR floodlight or a structured light projector.

In some examples, in response to detecting one or more activations of the button (2522), the electronic device (e.g., 2300, 2400) also includes a biometric representation of user credentials that are restricted to be used without appropriate biometric authentication The measurement authentication interface (eg, 2322, 2420) is displayed (2526). In some examples, the biometric authentication interface includes an authentication glyph (e.g., 2324, 2422) and/or one or more representations of user credentials (e.g., an image of a credit card, an image of a bank account, an image of a business card). And images representing data to be used by the function of the electronic device). Providing the authentication glyph provides the user with easily visible and recognizable visual feedback regarding the current state or progress of the authentication process. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, the function performs a transaction using the represented data. In some examples, biometric authentication is performed for a particular credential, and that credential is highlighted relative to other credentials. In some examples, the biometric authentication interface (eg, 2322, 2420) includes an animation (eg, card carousel).

Upon determining that the biometric data satisfies the biometric authentication criteria (e.g., the biometric criteria matched the biometric template stored on the device), the electronic device (e.g., 2300, 2400), the respective functions of the device It transitions to the second state in which it is enabled (2528). In some examples, when the device is enabled, the device can participate in the transaction. In some examples, the electronic device determines whether the biometric data meets biometric authentication criteria. Limiting the device's ability to participate in transactions to when the device is enabled (to participate in transactions) helps users avoid unintentional execution of transactions and at the same time provides improved device security, allowing users to Gives you more control of your device. Providing additional control of the device without cluttering the UI with the additional displayed controls (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) the device It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (eg, 2300, 2400) is enabled to participate in a transaction when in a second state. In some examples, when the device is in the second state, the information that enables the device to participate in the transaction is made temporarily accessible by the secure element to the device outside the secure element (e.g., payment credentials are Available for use in wireless payment transactions).

In some examples, after transitioning to the second state, the electronic device (eg, 2300, 2400) holds the device in the second state for a first predetermined period (eg, 60 seconds) (2530). In some examples, the functionality of the electronic device is also enabled upon change of user credentials (eg, as a result of a card switch). In some examples, the first predetermined period begins when one or more activations of the button are detected (eg, when the button is pressed). In some examples, after transitioning to the second state, the electronic device transitions from the second state to the first state (2532) after the first predetermined period has elapsed. In some examples, after transitioning to the second state, the electronic device performs an information-based action (e.g., sending credentials to a remote server to process a transaction), using each function of the electronic device. (2534). In some examples, the electronic device proceeds with the transaction using the credentials provided in the request. In some examples, the credentials are provided to a remote server to process the transaction. In some examples, the electronic device causes, in another device, the display of an indication indicating whether the authentication was successful. In some examples, the electronic device causes, at another device (eg, another device or a second device), display of an indication indicating whether the transaction was successful. In some examples, the prompt is output while the details of the transaction are displayed.

In some examples, while the device is in the second state, the electronic device (eg, 2300, 2400) detects (2536) a user input corresponding to the request to terminate the first application. In some examples, in response to detecting a user input corresponding to the request to terminate the first application, the electronic device terminates the first application and transitions to the first state (2538). In some examples, when the device is enabled to participate in a transaction, terminating the application that the input that was received has enabled the device to participate in the transaction causes the device to stop being enabled to participate in the transaction. . In some examples, when a device is authorized to provide payment credentials for a payment transaction in a wallet application and the device is switched from a wallet application to a different application, the device is required to provide payment credentials (e.g., using biometric authentication. Thus) disables the ability to provide payment credentials until re-authorized by the user. Thus, unintended transmission of payment information is prevented by disabling transmission of payment information when the device is not displaying a user interface indicating that the device is configured to provide payment credentials.

Upon determination that the biometric data does not meet the biometric authentication criteria (e.g., the biometric data does not match the biometric template stored on the device), the electronic device (e.g., 2300, 2400) maintains the first state. Then (2540), an indication that biometric authentication has failed is displayed on the display (2540). Maintaining the first state when authentication fails (eg, the device is not authorized to proceed with the transaction) provides the user with improved control and security of the device. Providing additional control and improved security of the device without cluttering the UI with the additional displayed controls (e.g., helping the user to provide appropriate inputs when operating/interacting with the device and avoiding user mistakes) By reducing) improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. .

In some examples, the electronic device (eg, 2300, 2400) also displays (2542) an alternative authentication affordance (eg, 2334, 2440). In some examples, the alternative authentication affordance, when selected, causes the electronic device to provide an alternative form of authentication (e.g., non-biometric form of authentication), such as when the user enters a password, passcode, or pattern. It is an affordance to display a capable interface (eg, 2336, 2442). In some examples, successful authentication through alternative authentication causes the electronic device to transition to a second state. In some examples, the first failure results in the display of a “TRY AGAIN” affordance, and the second failure results in the display of an alternative authentication affordance (e.g., 2336, 2442) such as a “passcode” affordance. do. In some examples, the electronic device receives a user input, such as a double press of a button. In some examples, if a threshold number of biometric authentication attempts has been reached, the electronic device provides an affordance for entering a passcode (or password) and, optionally, that biometric authentication is not available and/or that the threshold number has been reached. Display an indication (eg, “passcode required to enable FaceID”).

In some examples, after determining that the biometric data does not meet the biometric authentication criteria (e.g., while displaying an alternative authentication interface or alternative authentication affordance), the electronic device (e.g., 2300, 2400) A selection of affordances (eg, 2334, 2440) is detected (2544). In some examples, in response to detecting the selection of the alternative authentication affordance, the electronic device (e.g., 2300, 2400), in response to the selection of the affordance, on the display, an alternative authentication interface such as a password or passcode interface. (E.g., 2336, 2442) is displayed (2546).

In some examples, the electronic device (eg, 2300, 2400) also captures (2548) second biometric data with one or more biometric sensors (eg, 2303, 2403). In some examples, upon determining that the second biometric data satisfies the biometric authentication criteria, the electronic device transitions to a second state (2550). In some examples, in response to the selection of affordance, the electronic device performs a second iteration of biometric authentication.

In some examples, biometric authentication is performed during the display or transition to an alternative authentication interface (eg, 2336, 2442). In some examples, an alternative authentication interface includes a display of a biometric authentication glyph sequence that allows the user to be informed that biometric authentication is occurring. In some examples, successful biometric authentication avoids the need for alternative authentication. As a result, the electronic device (eg, 2300, 2400) stops displaying the alternative authentication interface (eg, 2336, 2442) and proceeds as if the user was successfully authenticated on the first attempt.

In some examples, upon determining that the second biometric data does not meet the biometric authentication criteria, the electronic device (e.g., 2300, 2400) remains in the first state and an alternative on the display (e.g., 2302, 2402). An authentication interface (e.g., 2336, 2442) is displayed (2552). In some examples, upon failure, the display of the alternative authentication interface is maintained so that the user optionally provides alternative authentication. Maintaining the display of the alternative authentication interface so that the user can provide alternative authentication (in case of failure) provides the user with a number of different ways to provide authentication (for specific actions performed by the device). By doing so, it gives the user more control of the device. Providing additional control of the device without cluttering the UI with the additional displayed controls (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) the device It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (eg, 2300, 2400) detects (2554) each user input corresponding to a request to retry biometric authentication. In some examples, the electronic device detects a user input, such as pressing or moving a button on the electronic device (eg, raising and/or lowering the device) or selection of an alternative authentication affordance (eg, 2334, 2440). In some examples, the user input corresponding to the request to retry biometric authentication includes one or more activations of the button. In some examples, the user input includes one or more activations of a button used to initiate a first iteration of biometric authentication. In some examples, the user input corresponding to the request to retry biometric authentication includes movement of the electronic device. In some examples, the predetermined type of user input is a different input than activation of a button. In some examples, the predetermined type of user input is raising and/or lowering the electronic device (e.g., the electronic device lowers near another electronic device, such as an NFC-compatible device, and rises back to the user's eye level. ).

In some examples, in response to detecting a user input corresponding to a request to retry biometric authentication, the electronic device (eg, 2300, 2400) captures third biometric data with one or more biometric sensors ( 2556). In some examples, in response to user input, the device performs additional iterations of biometric authentication. In some examples, upon determining that the third biometric data satisfies the biometric authentication criteria, the electronic device transitions (2558) to a second state in which each function of the device is enabled. In some examples, upon determining that the third biometric data does not meet the biometric authentication criteria, the electronic device maintains the first state (and, optionally, displays, on the display, an indication that the biometric authentication failed. (2560).

In some examples, the electronic device (eg, 2300, 2400) detects other one or more activations of the button (eg, 2304, 2404). In some examples, upon determining that the biometric capture criteria are met, the electronic device sends the second biometric data to one or more biometric sensors (e.g., 2303, 2403) separate from the button (e.g., 2304, 2404). To capture. In some examples, upon determining that the biometric capture criteria are not met, the electronic device withholds capturing the second biometric data. In some examples, the number of biometric authentication attempts is limited to a predetermined number (eg, 5). In some examples, this number is reset in response to successful authentication. In some examples, this number is reset after a set time.

It is noted that the details of the processes described above with respect to method 1200 (eg, FIGS. 25A-25C) are also applicable in a similar manner to the methods described herein. For example, method 2500 optionally includes one or more of the characteristics of the various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 1800, 2000, 2200, 2700. Include. For example, the registered biometric data described in method 1200 can be used to perform biometric authentication as described in connection with FIGS. 24F and 24G. For another example, one or more implantable interfaces as described in methods 2000 and 2700 are optionally displayed in response to receiving an input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 25A-25C are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, detect operation 2508, transition operation 2528, and maintenance operation 2540 are optionally implemented by event classifier 170, event recognizer 180, and event handler 190. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

26A-26A illustrate example user interfaces for biometric authentication, according to some examples. As described in more detail below, an illustrative example of user interfaces illustrated in FIGS. 26A-26A is used to illustrate the processes described below, including those of FIGS. 27A-27E.

26A illustrates an electronic device 2600 (eg, portable multifunction device 100, device 300, or device 500). In the illustrative example illustrated in FIGS. 26A-26A, the electronic device 1900 is a smartphone. In other examples, electronic device 1500 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 1900 has a display 2602, one or more input devices (eg, a touchscreen of the display 2602, a button 2604, a microphone (not displayed)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 2603) that optionally includes a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more biometric sensors 2603 are one or more biometric sensors 703. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 26A, the electronic device displays an unlocked interface 2606 while in the unlocked state. The unlocked interface 2606 includes a notification affordance 2608 and an unlocked status indicator 2610. In some examples, because electronic device 2600 is in an unlocked state, notification affordance 2608 includes an indication of secure content associated with notification affordance 2608. For example, as shown, a notification affordance is associated with a messaging application and includes at least a portion of a message received by the electronic device.

26B-26D, while displaying the unlocked interface 2606, the electronic device 2100 detects a user input 2612 (FIG. 26B) near the edge of the display 2602, for example. do. User input 2612 is, in some examples, a swipe gesture, which is a request to access the home screen interface of electronic device 2600, and in response to the swipe input 2612, the electronic device displays the home screen interface of FIG. 2614) (e.g., replacing the display of unlocked interface 2606 with it). In some examples, displaying the home screen interface 2129 may open the home screen interface 2614 by sliding the unlocked interface 2606 upward, as described similarly with reference to FIGS. 19P-19R. Includes displaying (eg, revealing).

In FIG. 26E, the electronic device displays an unlocked interface 2606 while in the unlocked state. The unlocked interface 2606 includes a notification affordance 2608 and an unlocked status indicator 2610. In some examples, because electronic device 2600 is in an unlocked state, notification affordance 2608 includes an indication of secure content associated with notification affordance 2608. For example, as shown, a notification affordance is associated with a messaging application and includes at least a portion of a message received by the electronic device.

While displaying the unlocked interface 2606, the electronic device detects activation of the notification affordance 2608. Activation of notification affordance 2608 is a tap gesture 2615 in some examples. In response to activation of notification affordance 2608, the electronic device displays messaging application interface 2616 of FIG. 26G (eg, replacing the display of unlocked interface 2606 with it). Referring to FIGS. 21F and 21G, in some examples, displaying the messaging application interface 2616 may cause the unlocked interface 2606 to move upwardly, as described similarly with reference to FIGS. 19P-19R. Sliding to display (eg, revealing) the messaging application interface 2616.

In FIG. 26H, the electronic device, while in the locked state, displays a locked interface 2620. The locked interface 2620 includes a notification affordance 2622 and a locked status indicator 2624. In some examples, because electronic device 2600 is in a locked state, notification affordance 2622 does not include an indication of secure content associated with notification affordance 2622.

26I-26K, while displaying the locked interface 2620, the electronic device 2600 detects a user input 2628 (FIG. 26I) near the edge of the display 2602, for example. User input 2628 is, in some examples, a swipe gesture that is a request to access the home screen interface of electronic device 2600. In some examples, electronic device 2600 may perform user input 2628 prior to completing initial biometric authentication (e.g., biometric authentication performed in response to a wake condition, as described with reference to FIGS. 21A-21C ). Receive. Thus, in response to the swipe input 2628, the electronic device displays the implantable interface 2630 of FIG. 26K to indicate that the electronic device has not yet completed biometric authentication (e.g., locked interface 2620). Replace the display of it with it). In some examples, displaying the implantable interface 2630 may display the implantable interface 2630 by sliding the locked interface 2620 upward, as described similarly with reference to FIGS. 19P-19R (e.g., , Revealing). Insertable interface 2630 includes locked status indicator 2624 in some examples.

Alternatively, in some examples, the electronic device determines that a threshold number (eg, 5) of biometric authentication attempts has been reached. Thereafter, in response to user input 2628, electronic device 2600 displays implantable interface 2632. The implantable interface includes a biometric authentication enable indicator indicating that biometric authentication is disabled (eg, because that number of attempts have been reached). Insertable interface 2632 further includes alternative authentication affordances 2636, 2638. Activation of alternative authentication affordance 2636 causes the electronic device to display a first alternative authentication interface, such as a fingerprint authentication interface, and activation of alternative authentication affordance 2638 causes the electronic device to cause the passcode authentication interface. To display a second alternative authentication interface such as.

In some examples, while displaying the implantable interface 2630, the electronic device detects biometric data (eg, facial biometric data) and, in response, performs biometric authentication. Referring to FIG. 26M, electronic device 2600 displays a biometric progress indicator 2625 to indicate that biometric data is being processed.

In Figure 26N, the electronic device 2600 determines that the biometric authentication is successful. In response, the electronic device 2600 displays the unlocked status indicator 2626 and optionally, outputs a tactile output 2640. After indicating that the biometric authentication was successful (e.g., after a predetermined time), the electronic device displays the home screen interface 2614 of FIG. 26P (e.g., replacing the display of the implantable interface 2630 with it). . 21O and 21P, in some examples, displaying the home screen interface 2614 includes sliding the home screen interface 2614, as described similarly with reference to FIGS. 19P-19R. do.

Alternatively, in FIG. 26Q, electronic device 2600 determines that biometric authentication was not successful. In response, the electronic device 2600 alternates the position of the locked state indicator 2627 to simulate a "shake" effect. The electronic device 2600 further outputs a tactile output 2644 to indicate that the biometric authentication was not successful. In some examples, tactile output 2644 is the same as tactile output 2640. In some examples, tactile output 2644 is different than tactile output 2640. In some examples, in response to determining that the biometric authentication was unsuccessful, the electronic device displays an alternative authentication affordance 2642.

Referring to FIG. 26R, the electronic device receives activation of the locked status indicator 2624. In some examples, activation of the locked status indicator is a tap gesture 2650 on the locked status indicator 2624. In response, as shown in Fig. 26S, the electronic device 2600 initiates biometric authentication. In some examples, initiating biometric authentication includes obtaining data corresponding to at least a portion of the biometric feature (e.g., capturing with one or more biometric sensors 2603), and processing the biometric data. Thus, determining whether the biometric feature (or a portion thereof) satisfies the biometric authentication criteria (e.g., determining whether the biometric data matches the biometric template, within a threshold). do. While processing biometric data, the electronic device displays a biometric progress indicator 2625 indicating that the electronic device 2600 is processing the biometric data (e.g., of the locked status indicator 2624). Replace the display with it). If the electronic device 2600 determines that the biometric authentication is successful, the electronic device indicates success, as described in connection with FIGS.

In FIG. 26T, the electronic device 2600 determines that the biometric authentication (eg, as described with reference to FIG. 26S) was unsuccessful, and in response, locates the locked status indicator to simulate a “shake” effect. Alternate, output a tactile output 2652, and display an alternative authentication affordance 2642.

In FIG. 26U, the electronic device detects activation of an alternative authentication affordance 2642. In some examples, activation of the alternative authentication affordance is a tap gesture 2654 on the alternate authentication affordance 2642. Referring to FIG. 26V, in response to activation of alternative authentication affordance 2642, the electronic device displays an alternative authentication interface 2656 (e.g., replacing the display of implantable interface 2630 with it). As a result, the user authenticates with the electronic device upon inputting a valid passcode (or password).

Referring to FIGS. 26W-26Y, in some examples, where the electronic device fails to detect the biometric feature for a predetermined time, the electronic device displays one or more interfaces and/or enters a low power state. In Fig. 26W, the electronic device displays the implantable interface 2630 (recall that the electronic device displays the implantable interface 2630 in response to a request for secure content received prior to completion of biometric authentication). If, for a predetermined period of time, the electronic device 2600 has not detected a biometric feature, the electronic device displays an alternative authentication interface 2657 (eg, replacing the display of the implantable interface 2630 with it). In some examples, alternative authentication interface 2657 includes an indicator that instructs the user to provide alternative authentication, such as a passcode. In other examples, as shown in FIG. 26X, the alternative authentication interface 2657 does not include an indicator indicating to provide the alternative authentication to the user.

If, during display of the alternative authentication interface 2657, the biometric features are not detected for a predetermined period of time, and no alternative authentication is provided, the electronic device 2600 is in a low power state ( For example, a transition to a display-disabled state).

During display of the alternative authentication interface 2657, if a biometric feature is detected, the electronic device 2600 performs biometric authentication, as described. 26Z, the electronic device displays a biometric progress indicator 2625 to indicate that the electronic device is processing biometric data (e.g., the display of the locked status indicator 2624). Replaced with). In Figure 26AA, the electronic device 2600 determines that the biometric authentication is successful. In response, the electronic device displays the unlocked status indicator 2610 (replaces the display of the biometric progress indicator 2625 with it), and optionally, tactiles to indicate that the biometric authentication is successful. Red output (2658) is output. In some examples, the electronic device 2600 subsequently displays the home screen interface 2614, as shown in FIG. 26A.

Referring to Figures 26A-26A, during display of the alternative authentication interface 2657, if the biometric authentication fails and at least a portion of the alternative authentication is provided, the electronic device 2600 does not provide a tactile output. Without this, it indicates that biometric authentication is not successful. As shown in Figure 26ac, the electronic device, while performing biometric authentication (as indicated by the biometric progress indicator 2625), via user input (e.g., tap gesture) 2660. Receive a portion of the authentication (eg, passcode). In FIG. 26AD, the electronic device determines that the biometric authentication was unsuccessful, and in response, displays a locked status indicator 2627, and further alters the position of the locked status indicator to simulate a "shake" effect . In some examples, electronic device 2600 does not output a tactile output, and additionally maintains a display of an alternative authentication interface 2657, as shown in FIG. 26A.

In FIG. 26Af, the electronic device 2600 displays a locked interface 2620 while in the locked state. As described, the locked interface 2620 includes a notification affordance 2622 and a locked status indicator 2624. In some examples, the electronic device receives a request for secure content (eg, a message associated with notification affordance 2622) on the electronic device. The electronic device 2600 detects, for example, activation of the notification affordance 2262. In some examples, the activation of notification affordance 2262 is a tap gesture 2662.

In some examples, activation of notification affordance 2262 is received prior to completion of biometric authentication. Thus, in response to activation of notification affordance 2262, as shown in FIG. 26Ag, electronic device 2600 displays implantable interface 2629 including biometric indicator 2666. The biometric indicator 2666 identifies secure content associated with a received request for secure content, in some examples.

As shown in FIG. 26A, while displaying the implantable interface 2629, if the electronic device 2600 does not detect a biometric feature, the electronic device displays an alternative authentication affordance 2668. In some examples, activation of alternative authentication affordance 2668 causes the electronic device to display an alternative authentication interface (eg, alternative authentication interface 2657 in FIG. 26X).

During the display of the alternative authentication interface, if the biometric features are not detected for a predetermined period of time and no alternative authentication is provided, the electronic device 2600 is in a low power state (e.g., display), as shown in FIG. -Transition to the disabled state).

As described in connection with FIG. 26Ah, the electronic device displays an alternative authentication affordance 2668 if no biometric features are detected. In some examples, a biometric feature is detected after display of the alternative authentication affordance 2668, and in response, the electronic device performs biometric authentication, as described above. As shown in FIG. 26Aj, the electronic device 2600 displays a biometric progress indicator 2625 to indicate that biometric data is being processed. In FIG. 26Ak, electronic device 2600 determines that biometric authentication is successful. In response, electronic device 2600 displays an unlocked status indicator 2610 and optionally provides a tactile output 2670 to indicate that the biometric authentication was successful. In some examples, electronic device 2600 subsequently displays messaging application interface 2616, as shown in FIG. 26A. Referring to Figures 26A and 26A, in some examples, displaying the messaging application interface 2616 may be performed by sliding the implantable interface 2629 upward, as described similarly with reference to Figures 19P-19R. And displaying (eg, revealing) the messaging application interface 2616.

In FIG. 26A, the electronic device 2600 displays an embedded interface 2629 with an alternative authentication affordance 2668. While displaying the implantable interface 2629, the electronic device detects activation of an alternative authentication affordance 2668. In some examples, activation of the alternative authentication affordance 2668 is a tap gesture 2674 on the alternative authentication affordance 2668.

Referring to FIG. 26Ao, in response to activation of an alternative authentication affordance 2668, the electronic device 2600 displays an alternative authentication interface 2631. In some examples, alternative authentication interface 2631 identifies the requested secure content ("ENTER PASSCODE FOR MESSAGES").

Referring to Figures 26AP and 26AQ, at least in part, in response to a tap gesture 2076 (Figure 26AP), and, optionally, one or more other inputs representing additional alphanumeric digits of a valid passcode, electronic device 2600 By this, a valid passcode (or password) is received. As shown in Figures 26A and 26A, once a valid passcode has been received, the electronic device is unlocked and displays the messaging application interface 2616 (e.g., the display of the alternative authentication interface 2261 with it. Replace). In some examples, displaying the messaging application interface 2616 includes sliding the alternative authentication interface 2631 upwardly to open the messaging application interface 2616, as described similarly with reference to FIGS. 19P-19R. Includes displaying (eg, revealing).

27A-27E are flowcharts illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. The method 2700 includes a device with a display, one or more input devices (e.g., touchscreen, microphone, camera), and a wireless communication wireless device (e.g., a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 2600). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric feature by one or more biometric sensors. Some operations of method 2700 are selectively combined, the order of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 2700 provides an intuitive method for performing biometric authentication. This method reduces the user's cognitive burden for the authentication of biometric features, thereby creating a more efficient human-machine interface and an intuitive user experience. In the case of battery-operated computing devices, allowing a user to perform authentication of biometric features faster and more efficiently saves power and increases the time between battery charges.

In some examples, while the electronic device (eg, 2700) is in a locked state that the device is not authorized to perform each operation, the electronic device displays a first graphical display (eg, 2624) indicating that the device is in the locked state. (E.g., a closed lock icon) is displayed. Displaying the first graphical indication that the device is in a locked state provides a user with an easily available indication of the state of the device. The user is then informed of which functions of the device are enabled and/or available, thereby (e.g., by helping the user to provide appropriate inputs when operating and/or interacting with the device and reducing user mistakes. ) Makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, while the device is in an unlocked state in which the device is authorized to perform each operation, the electronic device may display a second graphic indicating that the device is in the unlocked state instead of the first graphical display (e.g. , 2610) (eg, an open lock icon) is displayed. Displaying a second graphical indication indicating that the device is in an unlocked state provides a user with an easily available indication of the state of the device. The user is then informed of which functions of the device are enabled and/or available, thereby (e.g., by helping the user to provide appropriate inputs when operating and/or interacting with the device and reducing user mistakes. ) Makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the first graphical representation and the second graphical representation are displayed at respective locations in the user interface (eg, 2606, 2620) (eg, near substantially the upper center of the display 2602).

In some examples, the electronic device detects (2702) a request to perform each operation requiring authentication. In some examples, the request to perform each operation requiring authentication is a request (e.g., 2612) to display a home screen (e.g., 2614) having a plurality of application open icons that, when selected, open corresponding applications, Or a request to display an application user interface corresponding to the selected notification. In some examples, the request to perform each operation includes a home input (eg, 2612). In some examples, the home input is a selection of a home button or a home gesture, such as an upward swipe from each edge of the display, such as a button on the display. In some examples, the request to perform each action includes the selection of a notification (eg, 2608) (eg, 2615). In some examples, the choice of notification is a tap, long press, hard press, or swipe on the notification user interface object. In some examples, each operation includes displaying a home screen that includes a plurality of application icons to open different applications. In some examples, a plurality of application icons for opening different applications are application icons that, when selected, cause the corresponding application to open. In some examples, the home screen also includes one or more widgets, system status indicators, device controls, and the like. In some examples, each action includes displaying an application user interface (eg, 2616) for an application corresponding to the notification. In some examples, the application interface includes information specifically related to the notification (eg, the notification is a notification of an electronic communication, and the application user interface includes a notification or a representation of the electronic communication).

In response to detecting a request to perform each operation requiring authentication (2704), upon determining that the device is unlocked, the electronic device performs each operation (2706). Additionally, upon determining that the device is locked and that a first form of authentication is available for use (2708), the electronic device may, on a display (e.g., 2602), use one or more forms of authentication for use. Display (2712) an authentication indicator (e.g., 2625) for the first form of authentication without displaying affordances (e.g., 2636, 2638). Displaying the authentication indicator without displaying affordances for using the second form of authentication provides the user with an intuitive interface that holds the device from providing additional options while biometric authentication is being performed. Providing an intuitive interface in this way improves the operability of the device (e.g., by helping the user to provide appropriate inputs and reducing user mistakes when operating/interacting with the device) and It avoids the user from attempting alternative authentication prior to completion of the measurement authentication) and makes the user-device interface more efficient, which additionally reduces the power usage of the device by allowing the user to use the device more quickly and efficiently. Reduce and improve battery life.

In some examples, the authentication indicator is a visual indication that the first form of authentication is being attempted by the device, such as text describing the first form of authentication (e.g., password, passcode, fingerprint, or other form of authentication) or These are graphic elements. In some examples, the first form of authentication is a form of biometric authentication based on data acquired by one or more biometric sensors (eg, a non-contact form of biometric authentication such as face recognition or iris recognition) 2710. In some examples, the authentication indicator includes information indicating that the device is attempting to use the first form of authentication (2714). In some examples, the authentication indicator includes a graphical or textual description indicating that facial biometric authentication is available, such as "Face ID" or "Face ID to open Messages". In some examples, the authentication indicator is displayed with an option to revoke authentication. In some examples, the authentication indicator is displayed with an option to display emergency information (eg, emergency call user interface and/or emergency medical information) without unlocking the device. In some examples, the authentication indicator includes (2716) information of the progress of the attempt in the first form of authentication, such as a progress indicator as described in more detail with respect to FIGS. 11A-11O.

In some examples, while displaying an authentication indicator for the first form of authentication without displaying affordances for using the second form of authentication, the electronic device Process the data (2718). In some examples, each of the one or more biometric sensors processed while displaying the biometric authentication indicator for the first type of biometric authentication without displaying one or more affordances for using the second type of authentication. At least a portion of the data was obtained (2720) by one or more biometric sensors prior to displaying the authentication indicator for the first form of authentication. In some examples, each of the one or more biometric sensors processed while displaying the biometric authentication indicator for the first type of biometric authentication without displaying one or more affordances for using the second type of authentication. At least a portion of the data was obtained (2722) by one or more biometric sensors after displaying an authentication indicator for the first form of authentication.

In some examples, after processing (2724) each data from one or more biometric sensors, determining that each data from one or more biometric sensors matches the biometric information that is applied to perform each operation. According to (eg, the device detects an applied face in each biometric data), the electronic device performs each operation (2726). Performing each action in response to determining that each data from one or more biometric sensors matches the biometric information authorized to perform the respective action requires manual authentication by the user, in some examples. By allowing the device to authenticate without it, the operability of the device is improved, thereby making the user-device interface more efficient.

In some examples, additionally, after processing each data from one or more biometric sensors, according to a determination that each data does not match the biometric information that is authorized to perform the respective operation (e.g., the device Detecting no face or a face that does not match the applied faces) (2728), the electronic device has a second type of non-displayed prior to processing each data from one or more biometric sensors. One or more affordances (eg, 2636, 2638) for using authentication are displayed (2730). Displaying one or more affordances for using a second form of authentication that was not displayed prior to processing each data from the one or more biometric sensors is the ability of a device requiring successful authentication when the biometric data is unsuccessful. It provides a user with a quick alternative way to access actions (eg, locked actions). Providing additional control options with additional displayed controls improves the operability of the device and improves the operability of the user (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors). -Make the device interface more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the one or more affordances include displaying a "Use Passcode" button, a "Use Password" button, or a keypad/keyboard for entering a passcode/password. In some examples, the one or more affordances for using the second form of authentication are after each delay in which the authentication indicator for the first form of authentication is displayed without displaying one or more affordances for using the second form of authentication. Is displayed on.

In some examples, displaying the one or more affordances is after the first period has elapsed (e.g., the authentication indication), depending on the determination that the biometric feature corresponding to the first form of authentication is detected by the one or more biometric sensors. After the self is displayed) displaying one or more affordances for using the second form of authentication; And after the second period has elapsed (e.g., after the authentication indicator is displayed), according to a determination that no biometric features corresponding to the first form of authentication are detected by the one or more biometric sensors. And displaying one or more affordances for using the authentication of. In some examples, the second period is different from the first period (eg, longer or shorter than that).

In some examples, displaying one or more affordances may be used in a first form of authentication, but upon determination that a biometric feature that does not match the authorized biometric features is detected, using a second form of authentication to authenticate. Displaying a user interface (e.g., 2656) for a second form of authentication (e.g., a sequence of characters for authentication (e.g., password or passcode)) concurrently with each instruction allowing one or more inputs to be provided. Displaying a plurality of character entry keys (e.g., keyboard or keypad) for input) (e.g., displaying instructions for entering a sequence of authentication characters using one or more character entry keys (e.g., passcode) The keypad is displayed with the commands "Enter passcode to unlock")); And each instruction to provide one or more inputs for authentication using a second form of authentication, upon determination that no biometric feature corresponding to the first form of authentication has been detected by the one or more biometric sensors. Displaying a user interface (e.g., 2657) for a second type of authentication without displaying them (e.g., a plurality of character input keys (e.g., a sequence of characters for authentication (e.g., password or passcode)) Keyboard or keypad). In some examples, the user interface for the second form of authentication is displayed without displaying respective instructions that allow one or more character entry keys to enter a sequence of characters for authentication (eg, the passcode keypad is “locked”). Enter passcode to unlock" displayed without commands) In some examples, the plurality of character entry keys are each instruction that initially (e.g., while the device is attempting to use a first form of authentication) to enter a sequence of characters for authentication using one or more character entry keys. And then when the use of the first form of authentication fails, the device displays explicit instructions for entering a sequence of characters for authentication using one or more character entry keys.

In some examples, displaying one or more affordances may include entering a plurality of characters to enter a sequence of characters for authentication (e.g., password or passcode), depending on the determination that the request to perform each action includes a home input. Displaying keys (eg, keyboard or keypad); And a plurality of character entry keys (e.g., keyboard or passcode) for entering a sequence of characters for authentication (e.g. Keypad), causing display of the passcode affordance. In some examples, the passcode affordance is limited in activation in response to tap inputs and responds to one or more other types of inputs including additional input requirements in addition to touch input. In some examples, one or more additional input requirements include: a requirement that the input is a hard press input (e.g., a requirement that the input reaches a characteristic strength that exceeds each intensity threshold), a requirement that the input is a long press input (e.g., the input is , A requirement that the input includes a contact that remains on the touch-sensitive surface for a predetermined time period without moving beyond a predetermined distance), and/or the requirement that the input is a swipe input (e.g., the input is, in each direction). (A requirement to include the movement of the contact in excess of the threshold amount of movement of the). Limiting activation in response to tap inputs in this manner avoids spurious (e.g. accidental and/or unintended) activation of the passcode affordance, thereby providing improved control and usability of the electronic device, whereby It reduces user errors when operating/interacting with the device, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, after displaying one or more affordances for using a second form of authentication that was not displayed prior to processing each data from one or more biometric sensors, the request to perform each action results in a home input. Upon a determination to include, the electronic device (with no further user input, automatically) a first delay period before stopping (e.g., turning off the display) from displaying one or more affordances for using the second form of authentication. While waiting for further input; Upon determining that the request to perform each action includes a selection of notification, the electronic device stops displaying one or more affordances for using the second form of authentication (automatically, without further user input). Wait for further input for a second delay period before (e.g., turn off the display). In some examples, the second delay period is different (eg, shorter or longer) than the first delay period.

In some examples, while the device is locked and a first form of authentication is available for use, the electronic device attempts (2732) biometric authentication using the first form of authentication. In some examples, in response to a request to perform each action, in response to an attempt to use a second form of authentication, or an input requesting authentication, e.g., lifting the device, a button on the device (e.g., 2604). In response to pressing ), tapping the lock icon on the device, or tapping the touch-sensitive display of the device, a first form of authentication is available for use and/or the device is locked. In some examples, while attempting biometric authentication using a first form of authentication, the electronic device is a progress indicator (e.g., progress indicator) that changes its appearance to indicate progress towards biometric authentication using the first form of authentication. (As indicated by indicators 2624 and/or 2625) are displayed (2734). In some examples, the electronic progress indicator is an icon or progress bar that changes from a "face detection" icon or animation to a "face analysis" icon or animation. In some examples, while attempting biometric authentication using the first form of authentication, the device replaces the first graphical display with a progress indicator. In some examples, after completing the attempt in the first form of authentication, upon determining that the authentication was unsuccessful, the electronic device replaces the progress indicator with a first graphical indication (eg, a closed lock icon); Upon determining that the authentication was successful, the electronic device replaces the progress indicator with a second graphical indication (eg, an open lock icon).

In some examples, after attempting biometric authentication using the first form of authentication (2736), according to the determination that the biometric authentication using the first form of authentication is successful, the electronic device is successfully authenticated using the first form of authentication. Update the progress indicator (and, optionally, perform each action) 2738 in a first manner (eg, displaying a check mark or an open lock icon) to indicate a; And/or generate a second tactile output indicating authentication success (eg, this is different from the first tactile output indicating authentication failure) (eg, a single tap).

In some examples, after attempting biometric authentication using the first form of authentication, biometric authentication using the first form of authentication may be used in the first form of authentication, but a biometric that does not match the authorized biometric features. Upon determining to detect the measurement feature, the electronic device updates the progress indicator in a second manner to indicate unsuccessful authentication (e.g., shakes a lock icon or face icon left and right to indicate that authentication has failed). (2740). In some examples, the second way of updating the progress indicator is different (2742) from the first way of updating the progress indicator. In some examples, the electronic device generates a first tactile output (eg, a triple tap) indicating an authentication failure.

In some examples, after attempting biometric authentication using the first form of authentication, following a determination that biometric authentication using the first form of authentication does not detect a biometric feature that can be used in the first form of authentication, The electronic device updates the progress indicator in a third way different from the first way and the second way (e.g., displaying a closed lock icon without shaking the lock icon left or right to indicate that authentication has failed) 2744 .

In some examples, after attempting biometric authentication using the first form of authentication, following a determination that biometric authentication using the first form of authentication does not detect a biometric feature that can be used in the first form of authentication, The electronic device displays a graphical indication that no successful authentication has occurred without generating a tactile output. In some examples, the device does not generate a first tactile output or other tactile output indicative of an authentication failure because the device did not recognize any biometric features that could be used for the first form of authentication.

In some examples, after attempting biometric authentication using a first form of authentication for a first time, the electronic device may be configured to enter a sequence of characters for authentication (e.g., password or passcode). Display a user interface (eg, 2654) for a second type of authentication, including a keyboard or keypad. Additionally, the electronic device attempts biometric authentication using the first type of authentication for a second time while displaying the user interface for the second type of authentication. In addition, according to the determination that biometric authentication using the first type of authentication is successful, the electronic device performs each operation (and, optionally, a first type of authentication to indicate successful authentication using the first type of authentication). In a manner (eg, displaying a check mark or an open lock icon (eg, 2610)) to update the progress indicator). Additionally, prior to receiving an input for entering less than a threshold number of characters (eg, less than 1, 2, 3, 4, or 5 characters) through one or more character input keys of the plurality of character input keys, Biometric authentication using the first form of authentication can be used in the first form of authentication, but upon a determination to detect biometric features that do not match the approved biometric features, the electronic device performs each operation. Hold to do so and generate a first tactile output (e.g., a triple tap) indicating authentication failure (and, optionally, displaying a graphical indication that no successful authentication has occurred). Additionally, after receiving an input for entering at least a threshold number of characters (e.g., less than 1, 2, 3, 4, or 5 characters) through one or more character input keys of the plurality of character input keys, Biometric authentication using the first form of authentication can be used in the first form of authentication, but upon a determination to detect biometric features that do not match the approved biometric features, the electronic device performs each operation. And displays a graphical indication (eg, a closed lock icon) that no successful authentication has occurred without generating a tactile output.

In some examples, in response to detecting a request to perform each operation requiring authentication, the device is locked (e.g., when a request to perform each operation is received) and a first form of biometric authentication is used. Upon determination that it is not available to perform, the electronic device may provide one or more affordances for using a second form of authentication (e.g., a passcode or password input user interface, or a second form of biometric authentication such as fingerprint authentication). A prompt to use is displayed (2746). In some examples, the first form of authentication is not available for use (2748) because it has been disabled. In some examples, the first form of authentication is due to failed biometric authentication attempts exceeding a threshold number using the first form of biometric authentication, due to a restart of the device, or disabling the first form of biometric authentication. Not available for use due to user request to do. In some examples, the first form of authentication is disabled in response to user input to the emergency options user interface without selecting an option corresponding to a request to access additional information at the device (e.g., the user Trigger the display of the emergency options user interface by simultaneously pressing two or more buttons during the operation, then deactivate the device or disable the emergency options user interface, rather than selecting an option to display medical information or to display the emergency dialing interface. Select the option to cancel the display of). In some examples, the first form of authentication is disabled in response to a user selection of an option to disable the first form of biometric authentication (eg, through biometric authentication setting in the setup user interface). In some examples, the first form of authentication is due to the current environment and/or device conditions that the operation of one or more biometric sensors reduces the ability of the one or more biometric sensors to operate within predefined parameters. It is limited and not available for use (2750). In some examples, the device is too hot, the device is too cold, there is too much light in the environment of the device, there is too little light in the environment of the device, and/or the battery of the device is to drive one or more biometric sensors. Not sufficiently charged.

In some examples, the electronic device detects a first input (eg, 2650) (eg, tap input) at a location corresponding to each location in the user interface. In some examples, in response to detecting the first input at a location corresponding to each location in the user interface, depending on a determination that the device is in a locked state (e.g., a tap input was detected on a closed lock icon), the electronic The device attempts a first type of authentication. Attempting a first form of authentication in response to detecting a first input at a location corresponding to each position in the user interface and upon determining that the device is in a locked state is an intuitive way to initiate the first form of authentication. And convenient features, thereby making the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device detects a second input (eg, tap input) at a location corresponding to each location in the user interface. In some examples, in response to detecting a second input at a location corresponding to each location in the user interface, depending on a determination that the device is in an unlocked state (e.g., a tap input was detected on an open lock icon). , The electronic device transitions the device from the unlocked state to the locked state. In some examples, each location is on a cover sheet user interface that is displayed when the device screen is initially turned on, and a second graphical indication (e.g., an open lock icon) is a cover sheet while the device is still in an unlocked state. While the user interface is displayed when displayed on the device, a first graphical indication (eg, a lock icon) is displayed when the cover sheet user interface is displayed on the device while the device is in a locked state.

It is noted that the details of the processes described above with respect to method 1200 (eg, FIGS. 27A-27E) are also applicable in a similar manner to the methods described herein. For example, method 2700 optionally incorporates one or more of the characteristics of the various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 1800, 2000, 2200, 2500. Include. For example, the registered biometric data described in method 1200 can be used to perform biometric authentication as described in connection with FIGS. 26L-26N. For another example, one or more implantable interfaces as described in methods 2000 and 2700 are optionally displayed in response to receiving an input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

The operations in the information processing methods described above may optionally include one or more functional modules in an information processing apparatus such as general purpose processors or application specific chips (e.g., as described in connection with FIGS. 1A, 3, and 5A). It is implemented by driving. Additionally, the operations described above with reference to FIGS. 27A-27E are, optionally, implemented by the components shown in FIGS. 1A and 1B. For example, the detection operation 2702, the performing operation 2706, the display operation 2712, and the display operation 2746 are optionally selected by the event classifier 170, the event recognizer 180, and the event handler 190. Is implemented. The event monitor 171 in the event classifier 170 detects a contact on the touch-sensitive surface 604, and the event dispatcher module 174 communicates event information to the application 136-1. Each event recognizer 180 of the application 136-1 compares the event information with the respective event definition 186, and the first contact at a first location on the touch-sensitive surface is associated with the selection of an object on the user interface. Determine whether to correspond to the same predefined event or sub-event. When an individual predefined event or subevent is detected, the event recognizer 180 activates the event handler 190 associated with detection of the event or subevent. The event handler 190 optionally updates the application internal state 192 by using or calling the data updater 176 or the object updater 177. In some examples, the event handler 190 accesses the respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B.

28A-28AA illustrate example user interfaces for preventing retrying of biometric authentication, according to some examples. As described in more detail below, illustrative examples of user interfaces illustrated in FIGS. 28A-28A are used to illustrate the processes described below, including those of FIGS. 29A and 29B.

28A illustrates an electronic device 2800 (eg, portable multifunction device 100, device 300, device 500, or device 1700). In the illustrative examples illustrated in FIGS. 28A-28A, the electronic device 2800 is a smartphone. In other examples, electronic device 2800 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). Electronic device 2800 includes a display 2802, one or more input devices (eg, a touchscreen and a microphone of display 2802), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 28A, the electronic device includes a biometric sensor 2803. In some examples, the biometric sensor is one or more biometric sensors, which may include a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 2803 is biometric sensor 703. In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 28A, electronic device 2800 displays the application's user interface 2804 on display 2802. The application is a mobile browser application, and the user interface 2804 corresponds to a website (onlinestore.com). In FIG. 28B, electronic device 2800 detects a tap gesture 2806 on login affordance 2808. Electronic device 2800 identifies tap gesture 2806 as a request to load login user interface 2810 (shown in FIG. 28C). The electronic device 2800 also displays the tap gesture 2806, fillable fields in the login user interface 2810, i. Identifies it as a request to automatically fill it with a username and password that allows you to successfully log in to your account. The request to automatically fill requires biometric authentication in order to proceed to automatically fill the fillable fields. In some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submit affordance (eg, 2860 in FIG. 28Z) to submit credentials and log in.

In FIG. 28C, in response to a tap gesture 2806 (e.g., a request to automatically fill fillable fields), the electronic device 2800 uses the biometric sensor 2803 to determine whether certain biometric authentication criteria have been met. Decide whether or not. The electronic device 2800 captures and processes (e.g., analyzes) biometric data from the biometric sensor 2803 so that, based on the biometric data, the biometric features (or portions thereof) are (E.g., determine whether the biometric data matches the biometric template, within a threshold). Biometric sensor 2803 is contactless, allowing the sensor to be configured to perform biometric authentication without physical input from a user (eg, without any additional gestures after tap gesture 2806). As a result, the electronic device 2800 initiates biometric authentication using the biometric sensor 2803 without having to receive an explicit request from the user to initiate biometric authentication.

Performing biometric authentication includes displaying biometric authentication interface 2816 having biometric authentication glyph 2818. The biometric authentication glyph 2818 is a simulation of the representation of a biometric feature (eg, face). As shown in FIG. 28C, biometric authentication interface 2816 is overlaid on at least a portion of login user interface 2810. The biometric authentication interface 2816 is, optionally, an operating system level interface (e.g., an interface generated by the operating system of the device), and the login user interface 2810 is an application level interface (e.g., an operating system of the device). (A user interface created by a separate third-party application). In some examples, the displayed biometric authentication interface is approximately centered along a horizontal and/or vertical axis as in FIGS. 28B-28E. In some examples, electronic device 2800 displays a biometric authentication interface at the top, bottom, side, or corner of display 2802. For example, the electronic device 2800 displays a biometric authentication interface near the top of the display 2802, as in FIG. 30A, for example. In some examples, the electronic device 3000 does not display a biometric authentication interface while biometric authentication is being performed.

In Figures 28D and 28E, the electronic device 2800 displays a biometric authentication animation including a biometric authentication glyph 2820 in Figure 28D and a biometric authentication glyph 2822 in Figure 28E, which glyphs are The biometric sensor 2803 serves as part of an animation attempting to acquire biometric data.

In Fig. 28F, a determination is made that biometric authentication has failed (eg, biometric authentication criteria have not been met). As a result, the electronic device 2800 holds back from automatically filling in the username field 2812 and the password field 2814. Additionally, the electronic device 2800 does not display an indication to the user that the user should retry biometric authentication. In some examples, a determination is made that biometric authentication is successful (eg, biometric authentication criteria have been met). As a result, in such examples, electronic device 2800 automatically fills in user name field 2812 and password field 2814.

In FIG. 28G, the electronic device 2800 detects a tap gesture 2824 on the reload affordance 2826 after determining that the biometric authentication has failed. Electronic device 2800 identifies tap gesture 2824 as a request to reload login user interface 2810. The electronic device 2800 also requests a tap gesture 2824 to automatically fill in one or more fillable fields (e.g., username field 2812 and password field 2814) within login user interface 2810. Is identified as As previously described, a request to fill in automatically requires biometric authentication to proceed with automatically filling fillable fields.

In response to a request to automatically fill fillable fields, a determination is made that the failure of biometric authentication in FIG. 28F was due to failure to detect the presence of a face for a predetermined time. As a result, the electronic device 2800 performs biometric authentication again using the biometric sensor 2803, as shown in FIG. 28H. The electronic device 2800 automatically performs biometric authentication again without the need for the user to provide an input for initiating authentication.

In FIGS. 28H and 28I, the electronic device 2800 performs biometric authentication, which includes displaying the biometric authentication interface and biometric authentication glyphs, as described in connection with FIGS. 28C and 28D. Once the electronic device 2800 has obtained biometric data (eg, has obtained sufficient biometric data), the electronic device transitions to displaying a biometric authentication glyph 2828. Electronic device 2800 displays biometric authentication glyph 2828 to indicate that biometric data is being processed. In some examples, biometric authentication glyph 2828 includes a plurality of rings that rotate in a spherical shape, eg, while displayed.

In Fig. 28K, a determination is made that biometric authentication has failed again. Consequently, electronic device 2800 displays failed biometric authentication interface 2830 with failed biometric authentication glyph 2832. As a result, the electronic device 2800 holds back from automatically filling in the username field 2812 and the password field 2814. In some examples, a determination is made that biometric authentication is successful. As a result, in such examples, electronic device 2800 automatically fills in user name field 2812 and password field 2814.

In FIG. 28L, electronic device 2800 detects a tap gesture 2824 on reloading affordance 2826 after determining that biometric authentication has failed a second time. Electronic device 2800 identifies tap gesture 2826 as a request to reload login user interface 2810. The electronic device 2800 also requests a tap gesture 2826 to automatically populate one or more fillable fields (e.g., username field 2812 and password field 2814) within login user interface 2810. Is identified as As previously described, a request to fill in automatically requires biometric authentication to proceed with automatically filling fillable fields.

In response to a request to automatically fill fillable fields, a determination is made that the failure of biometric authentication in FIG. In, does not match the biometric template). Consequently, the electronic device 2800 withholds from performing biometric authentication, as illustrated by FIG. 28M.

In FIG. 28N, the electronic device 2800 detects the tap gesture 2834 on the user name field 2812 after withholding from performing biometric authentication in response to the tap gesture 2826. As a result, the electronic device 2800 displays a cursor 2836 in the user name field 2812, as shown in FIG. 28O, and also displays a virtual keyboard 2838 and password affordance 2840. In FIG. 28P, the electronic device 2800 detects a tap gesture 2842 on the password affordance 2840. As a result, the electronic device 2800 displays a list of candidate input affordances (eg, 2844, 2846, 2848), as shown in FIG. 28Q. In some examples, in response to detecting the tap gesture 2834 on the username field 2812, the electronic device 2800 displays an affordance labeled “usernames” instead of the password affordance 2840. do.

In FIG. 28R, electronic device 2800 detects a tap gesture 2850 on candidate input affordance 2848 (labeled “JJ_APPLESEED@EMAIL.COM”). Electronic device 2800 identifies tap gesture 2850 as a request to automatically populate user name field 2812 and password field 2814 with credential information corresponding to candidate input affordance 2848. This request to automatically fill in fillable fields is a request to automatically fill in a different type than those resulting from a request to load or reload login user interface 2810. The request to automatically fill through a request to load the login user interface is an implicit request because the request to automatically fill is performed as part of the request to load the login user interface. In contrast, the request to automatically fill in FIG. 28R is an explicit request by the user to automatically fill the username field 2812 and the password field 2814 with credential information corresponding to the candidate input affordance 2848. to be. In response to a request to automatically fill fillable fields through the explicit request in FIG. 28R, the electronic device 2800 initiates biometric authentication, as shown in FIG. 28S.

In Figures 28S-28U, the electronic device 2800 performs biometric authentication, which includes displaying the biometric authentication interface and biometric authentication glyphs, as described in connection with Figures 28H-28J.

In Figure 28V, a determination is made that biometric authentication is successful. As a result, electronic device 2800 displays a successful biometric authentication glyph 2852 indicating that the biometric authentication was successful.

In FIG. 28W, since the biometric authentication was successful, the electronic device 2800 automatically populates the user name field 2812 and the password field 2814 with credential information corresponding to the candidate input affordance 2848. In some examples, a determination is made that biometric authentication has failed. As a result, in such examples, electronic device 2800 withholds automatically filling user name field 2812 and password field 2814 with credential information. In some examples, upon failing biometric authentication, electronic device 2800 displays failure interface 2854 in FIG. 28X, as described in connection with FIG. 17M. Alternatively, the electronic device 2800 may display the failure interface 2856 in FIG. 28Y, as described in connection with FIG. 15S. Failure interface 2854 may be displayed when the user has not reached a maximum number of failed biometric authentication attempts (eg, a maximum number of failed attempts without intervening successful authentication attempts). When the maximum number of failed biometric authentication attempts has been reached, a failed interface 2856 may be displayed instead.

After the electronic device 2800 automatically fills in the username field 2812 and the password field 2814 in FIG. 28W, the electronic device may perform a tap gesture ( 2858). Electronic device 2800 identifies tap gesture 2858 as a request to submit credential information in user name field 2812 and password field 2814 for user authentication. Upon successful user authentication, electronic device 2800 provides access to restricted content within user interface 2862 of FIG. 28AA (eg, content that can only be viewed when the user is logged in).

29A and 29B are flowcharts illustrating a method for performing biometric authentication again after an initial unsuccessful biometric authentication attempt using an electronic device, according to some examples. Method 2900 includes one or more biometric sensors (e.g., 2803) (e.g., a fingerprint sensor, a non-contact biometric sensor (e.g., a biometric sensor that does not require physical contact, such as a thermal or optical facial recognition sensor), an iris. Scanner) with a device (eg, 100, 300, 500, 1700, 2800). In some examples, one or more biometric sensors (eg, 2803) include one or more cameras. The electronic device (eg, 100, 300, 500, 1700, 2800) optionally includes a display (eg, 2802). In some examples, the display (eg, 2802) is a touch-sensitive display. In some examples, the display (eg, 2802) is not a touch-sensitive display.

Some operations of method 2900 are selectively combined, the order of some operations is selectively changed, and some operations are selectively omitted. As described below, method 2900 provides an intuitive method for performing biometric authentication again after an initial unsuccessful biometric authentication attempt. This method reduces the user's cognitive burden for authenticating on the electronic device, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to authenticate faster and more efficiently saves power and increases the time between battery charges.

The electronic device (e.g., 100, 300, 500, 1700, 2800) receives a first request (e.g., 2806) to perform each operation requiring authentication (e.g., auto-fill, unlock the device, make a payment) Do (2902). In some examples, the first request (eg, 2806) is associated with performing each operation. In some examples, the first request (e.g., 2806) is also a request to perform a second operation different from each operation (e.g., a request to display a webpage (e.g., 2810) or load content that requires authentication). )to be. In some examples, the second operation does not require authentication.

According to some examples, the first request (eg, 2806) is also a request to perform an operation that does not require biometric authentication. In response to receiving the first request (eg, 2806), the electronic device (eg, 100, 300, 500, 1700, 2800) performs an operation that does not require biometric authentication.

According to some examples, the first request (eg, 2806) is a request to open a webpage (eg, 2810).

In response to receiving (2904) a first request (e.g., 2806) to perform each action, the electronic device (e.g., 100, 300, 500, 1700, 2800) is directed to blocks 2906 through 2910. Proceed.

The electronic device (e.g., 100, 300, 500, 1700, 2800) uses one or more biometric sensors (e.g., 2803) to determine whether the biometric authentication criteria are met, wherein the biometric authentication criteria are each Includes the requirement that each type of biometric feature (eg, face or fingerprint) that is applied to perform the operation of the biometric sensor (eg, 2803) is detected (2906). In some examples, the biometric authentication criteria include a requirement that an applied biometric feature is detected by one or more biometric sensors (eg, 2803).

Upon determining that the biometric authentication criteria are met, the electronic device (eg, 100, 300, 500, 1700, 2800) performs each operation (2908).

Upon determining that the biometric authentication criteria are not met (2910), the electronic device (eg, 100, 300, 500, 1700, 2800) withholds (2912) performing the respective operation. Suspending (or performing) each action based on not meeting biometric authentication criteria can provide security and prevent unauthorized users from initiating sensitive actions. Providing improved security improves the operability of the device (e.g., by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the power of the device by limiting the performance of restricted operations. Reduces usage and improves battery life.

According to some examples, further in response to receiving a first request (e.g., 2806) to perform each action (2904) and upon a determination that the biometric authentication criteria are not met (2910), the electronic device ( For example, 100, 300, 500, 1700, 2800 displays on the display (e.g., 2802) that authentication is retried using one or more biometric sensors (e.g., 2803) (e.g., biometric authentication to the user) (2914). In some examples, the electronic device (eg, 100, 300, 500, 1700, 2800) also suspends displaying an indication that it re-requests each operation.

According to some examples, determining whether biometric authentication criteria are met is determined based on data obtained from one or more biometric sensors (e.g., 2803) corresponding to the biometric feature. And determining whether at least a portion satisfies the biometric authentication criteria. In some examples, when the request (e.g., 2806) is also a request to perform a second operation different from each operation without requiring authentication, the second operation is even according to a determination that the biometric authentication criteria are not met. Is also performed. For example, a first request (e.g., 2806) (e.g., input of a URL address) is a user name and/or password of a webpage (e.g., 2810) associated with the URL address for each operation requiring authentication. Is a request to perform a second operation (display of a web page (eg, 2810) associated with a URL address) that does not require authentication. Even when the biometric authentication criteria are not satisfied, performing the second operation that does not require authentication may provide feedback on the request to the user even when the biometric security operation is not performed. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

Following a determination that the biometric authentication criteria were not met in response to receiving the first request (e.g., 2806) (e.g., no face was detected or the face that was detected does not match an authorized face), The electronic device (eg, 100, 300, 500, 1700, 2800) receives (2916) a second request (eg, 2824) to perform a respective operation. In some examples, a non-user request to reload a webpage (eg, 2810) is not a request associated with retrying biometric authentication.

In response to receiving (2918) a second request (e.g., 2824) to perform each operation, the electronic device (e.g., 100, 300, 500, 1700, 2800) is directed to blocks 2920 and 2922. Proceed.

In response to a determination that the biometric authentication criteria were not met in response to a first request (e.g., 2806) due to one or more biometric sensors (e.g., 2803) not detecting the presence of each type of biometric feature, The electronic device determines (2920) whether the biometric authentication criteria are met in response to a second request (eg, 2824) using one or more biometric sensors (eg, 2803). Re-performing biometric authentication when the previous authentication failure was due to the failure to detect the presence of the biometric feature would require the user to confuse the user interface without the need for additional inputs and with additional displayed controls. It provides the ability to retry authentication without it. Providing the ability to retry authentication without additional input and without cluttering the UI with additional displayed controls (e.g., helps the user to provide appropriate inputs when actuating/interacting with the device and By reducing mistakes) it improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device faster and more efficiently. Improve.

In some examples, the biometric feature is a face, and data from biometric sensors (eg, 2803) does not include data indicating that a face has been detected. In some examples, the determination that biometric authentication criteria have not been met in response to a first request (e.g., 2806) means that the one or more biometric sensors (e.g., 2803) are Occurs when the presence cannot be detected.

According to some examples, biometric authentication criteria are not met in response to a first request (e.g., 2806) due to one or more biometric sensors (e.g., 2803) not detecting the presence of each type of biometric feature. The determination that the one or more biometric sensors (e.g., 2803) is at least in advance after a predetermined time (e.g., biometric authentication has been triggered, e.g., by a first request (e.g., 2806) to perform each action). A determination that the biometric authentication criteria have not been met in response to the first request (eg, 2806) due to failure to detect the presence of the respective type of biometric feature during the determined time period.

Biometric authentication criteria in response to a first request (e.g., 2806) due to one or more biometric sensors (e.g., 2803) detecting each type of biometric feature that does not correspond to the applied biometric feature. Depending on the determination that it was not met (e.g., the face that was detected does not match the authorized face), the electronic device (e.g., 100, 300, 500, 1700, 2800) responds to the second request (e.g., 2824). Withholds determining whether the biometric authentication criteria are met using one or more biometric sensors (e.g., 2803) (e.g., the device responsive to reloading the webpage (e.g., 2810)) Do not retry automatically) (2922). In some examples, withholding re-performing biometric authentication further includes withholding performing the action performed when biometric authentication criteria are met. Withholding retrying biometric authentication when previous authentication failures were due to detection of unauthorized biometric features improves security and increases the number of resource-intensive retries of unauthorized users. Reduce the cases. Providing improved security improves the operability of the device (e.g., by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the power of the device by limiting the performance of restricted operations. Reduces usage and improves battery life.

According to some examples, following the determination that the biometric authentication criteria have not been met in response to receiving the first request (e.g., 2806), the electronic device (e.g., 100, 300, 500, 1700, 2800) Receives a third request (e.g. 2850) to perform an action (e.g., tapping a secure password field and selecting a password to fill in automatically, tapping an unsecured username field and selecting a username to be filled in automatically), where The third request is a different type of request than the first request (e.g., 2806) and the second request (e.g., 2824) (e.g., the third request is a different type of request than was used to make the first and second requests). Whereas the third type of request is also made using a selection of affordances and is not a request to perform a second operation (e.g., loading a webpage), the first request and the second request are also requested to perform a second operation. Requests). In response to receiving a third request (e.g., 2850) to perform each operation, the electronic device (e.g., 100, 300, 500, 1700, 2800) is in response to the third request (e.g., 2850). Biometric sensors (e.g., 2803) are used to determine whether the biometric authentication criteria are met (e.g., in response to a first request (e.g., 2806), regardless of why the biometric authentication criteria are not met ( For example, biometric authentication criteria may be due to one or more biometric sensors detecting a respective type of biometric feature that does not correspond to an applied biometric feature, or because one or more biometric sensors have each type of biometric feature. One or more biometric sensors are used to determine whether the biometric authentication criteria are met), whether not met due to failure to detect the presence of a negative. Regardless of the reason for the previous authentication failure, performing biometric authentication again after receiving a different type of request (e.g., an explicit request) gives the user the ability to explicitly request re-authentication, Provides additional control options for the user. Providing the user with additional control options improves the operability of the device and improves the user-device interface (e.g., by helping the user to provide appropriate inputs and reducing user mistakes when operating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

According to some examples, further in response to receiving a second request (e.g., 2824) to perform each action and upon a determination that biometric authentication is not available (e.g., the maximum number of failed biometric authentications). Attempts reached, attempts since the last successful authentication have exceeded a predefined number of allowed attempts), an electronic device (e.g., 100, 300, 500, 1700, 2800) may use an alternative form of authentication (e.g., Prompt for non-biometric forms of authentication such as passwords or passcodes) (e.g. 2854, 2856). Providing a prompt for an alternative authentication when biometric authentication is no longer available (e.g., displaying a notification) provides feedback to the user regarding the current state of the device, and what is needed to authenticate. Provide the user with the feedback that indicates. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

According to some examples, the electronic device (e.g., 100, 300, 500, 1700, 2800) imposes a respective limit on the number of unsuccessful biometric authentication attempts allowed before an alternative form of authentication is required. . The electronic device (e.g., 100, 300, 500, 1700, 2800) is prompted to perform each operation after a predetermined number of requests to perform each operation (e.g., within a threshold period) result in failed biometric authentication attempts. Stop determining whether biometric authentication criteria are met using one or more biometric sensors (eg, 2803) in response to the requests, wherein the predefined number of requests is less than each limit.

In some examples, in response to detecting each request to perform each operation, the device (e.g., 100, 300, 500, 1700, 2800) is a biometric device in which a predetermined number of requests to perform each operation have failed. Determine whether measurement authentication attempts have been caused. In accordance with a determination that a predetermined number of requests to perform each operation resulted in failed biometric authentication attempts, the electronic device (eg, 100, 300, 500, 1700, 2800) withholds from attempting biometric authentication. Upon determination that the predetermined number of requests to perform each operation did not result in failed biometric authentication attempts, the electronic device (eg, 100, 300, 500, 1700, 2800) proceeds with further biometric authentication attempts.

In some examples, the number of biometric authentication attempts or retries that can be made (e.g., that can be made without success) is a predetermined number of unsuccessful attempts before an alternative authentication (e.g., password or passcode) is required. Limited. In such examples, the electronic device (e.g., 100, 300, 500, 1700, 2800), in order not to exceed a predetermined number of acceptable attempts (e.g., failing to detect the presence of each type of biometric feature. Even under conditions in which biometric authentication is otherwise attempted (after a previous failure due to), retrying biometric authentication after a predetermined number of attempts is reserved. Stopping the use of a biometric sensor (e.g., pending biometric authentication) after repeated requests and before the allowed number of attempts have been exhausted, means that the user has repeated requests (e.g., the same type of repetition). Preserving at least one attempt for requests for other operations that require biometric authentication, avoiding consuming the allowed number of attempts upon request). Preserving at least one attempt improves the operability of the device (e.g., by avoiding exhaustion of authentication attempts for repeated similar requests) and makes the user-device interface more efficient, which additionally allows the user to It reduces the power usage of the device and improves battery life by enabling faster and more efficient use of

According to some examples, determining whether biometric authentication criteria are met using one or more biometric sensors (e.g., 2803) in response to a second request (e.g., 2824) is a request to perform each action. 2 Occurs automatically (eg, without the need for input from the user) in response to receiving the request (eg, 2824).

According to some examples, one or more biometric sensors (e.g., 2803) are contactless biometric sensors (e.g., 2803) (e.g., infrared cameras, visible light cameras, etc.) configured to perform biometric authentication without physical contact from a user. Or combinations thereof).

According to some examples, in response to a second request (eg, 2824) and in response to a second request (eg, 2824), in response to a determination that the biometric authentication criteria are met, the electronic device (eg, 100, 300, 500, 1700, 2800 performs each operation (eg, the operation includes auto-populating, accessing data, unlocking the device, and/or making a payment).

According to some examples, each operation is to automatically populate one or more fillable fields (eg, 2812, 2814) with credential information (eg, credit card information or login information). In some examples, the credit card information includes information associated with payment account information (eg, credit card, bank account, or payment service information). In some examples, the login information includes information required to log in to an application, account, or website (eg, 2862). Automatic filling of credential information upon request and successful authentication provides the user with the ability to populate credentials without requiring additional inputs (in addition to the request). Performing an action when a set of conditions is met without requiring additional user input (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) the device It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, each operation is to provide access to restricted content (e.g., log in to a webpage (e.g., 2862), display a list of passwords associated with the user, display credit card information). will be.

According to some examples, each operation is to transition the electronic device (eg, 100, 300, 500, 1700, 2800) from a locked state to an unlocked state. In some examples, transitioning the electronic device (e.g., 100, 300, 500, 1700, 2800) to the unlocked state includes the display of the electronic device (e.g., 2802), one or more biometric sensors (e.g., 2803). , And/or enabling the microphone.

According to some examples, each operation is to enable an electronic device (eg, 100, 300, 500, 1700, 2800) to participate in a transaction (eg, a financial transaction such as payment for a product or service).

According to some examples, while determining whether biometric authentication criteria are met using one or more biometric sensors (e.g., 2803), the electronic device (e.g., 100, 300, 500, 1700, 2800) On (eg, 2802), an indication that biometric authentication is being performed is displayed (eg, a small indicator is displayed on the top, bottom, side, or corner). In some examples, no indicator is displayed during biometric authentication. In some examples, the electronic device (e.g., 100, 300, 500, 1700, 2800) uses one or more biometric sensors (e.g., 2803) to determine whether the biometric authentication criteria are met, while It is reserved to display an indication that measurement authentication is being performed. In some examples, biometric authentication criteria are not met in response to a first request (e.g., 2806) due to one or more biometric sensors (e.g., 2803) failing to detect the presence of each type of biometric feature. In case a first visual indication (eg, 2822) is displayed. In some examples, in response to a first request (e.g., 2806) due to one or more biometric sensors (e.g., 2803) detecting each type of biometric feature that does not correspond to the applied biometric feature. If the measurement authentication criteria are not met, a second visual indication (eg, 2832) (eg, the same as or different from the first visual indication) is displayed. In some examples, a third visual indication (eg, 2852) (eg, a third visual indication different from the first visual indication and/or the second visual indication) is displayed if the biometric authentication criteria are met.

It is noted that the details of the processes described above with respect to method 2900 (eg, FIGS. 29A and 29B) are also applicable in a similar manner to the methods described below and above. For example, method 2900 can optionally include characteristics of various methods described above with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700, 3100, 3300, 3500. Contains one or more of. For example, registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with method 2900. As a further example, authentication caching of method 3100 may be based on successful authentication performed in accordance with re-performed biometric authentication as described in connection with method 2900. For brevity, these details are not repeated below.

30A-30A illustrate example user interfaces for cached biometric authentication, according to some examples. As described in more detail below, illustrative examples of user interfaces illustrated in FIGS. 30A-30A are used to illustrate the processes described below, including the processes of FIGS. 31A and 31B.

30A illustrates an electronic device 3000 (eg, portable multifunction device 100, device 300, device 500, or device 1700 ). In the example examples illustrated in FIGS. 30A-30A, the electronic device 3000 is a smartphone. In other examples, the electronic device 3000 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 3000 includes a display 3002, one or more input devices (eg, a touch screen of the display 3002, a button 3004, and a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 30A, the electronic device includes a biometric sensor 3003. In some examples, the biometric sensor is one or more biometric sensors, which may include a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 3003 is biometric sensor 703. In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 30A, the electronic device 3000 displays the user interface 3006 of the application on the display 3002. The application is a mobile browser application, and the interface corresponds to a website (online.com). In some examples, the website online.com is the root domain of the online.com domain. The electronic device 3000 detects a tap gesture 3008 on the login affordance 3010. The electronic device 3000 identifies the tap gesture 3008 as a request to load the login user interface 3012 (shown in FIG. 30B). The user interface 3012 is a web page id.online.com. In some examples, id.online.com is a subdomain of the online.com domain that requires successful authentication before access to restricted content is granted. The electronic device 3000 also identifies the tap gesture 3008 as a request to automatically fill in fillable fields in the login user interface 3012, i.e., the username field 3014 and the password field 3016. . The request to automatically fill requires biometric authentication in order to proceed to automatically fill the fillable fields. In some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submit affordance (eg, 3030, 3046) to submit credentials and log in.

In FIG. 30B, in response to a tap gesture 3008 (e.g., a request to automatically fill fillable fields), the electronic device 3000 uses the biometric sensor 3003 to determine whether certain biometric authentication criteria have been met. Decide whether or not. The electronic device 3000 captures and processes (e.g., analyzes) biometric data from the biometric sensor 3003, so that based on the biometric data, the biometric feature (or a portion thereof) is (E.g., determine whether the biometric data matches the biometric template, within a threshold). The biometric sensor 3003 is contactless, allowing the sensor to be configured to perform biometric authentication without physical input from the user (eg, without any additional gestures after the tap gesture 3008 ). As a result, the electronic device 3000 initiates biometric authentication using the biometric sensor 3003 without needing to receive an explicit request from the user to initiate biometric authentication.

Performing biometric authentication includes displaying biometric authentication interface 3018 with biometric authentication glyph 3020. The biometric authentication glyph 3020 is a simulation of the representation of a biometric feature (eg, a face). As shown in FIG. 30B, biometric authentication interface 3018 is overlaid on at least a portion of login user interface 3012. The biometric authentication interface 3018 is, optionally, an operating system level interface (e.g., an interface created by the operating system of the device), and the login user interface 3012 is an application level interface (e.g., an operating system of the device). (A user interface created by a separate third-party application).

In FIG. 30C, the electronic device 3000 displays a portion of a biometric authentication animation including a biometric authentication glyph 3022, which glyph is a portion of an animation in which the biometric sensor 3003 acquires biometric data. It plays a role as In some examples, an animation in which glyphs 3020 and 3022 are part indicates that the electronic device is attempting to identify a particular type of biometric feature (eg, to identify a face). Once the electronic device 3000 has obtained biometric data (e.g., has obtained sufficient biometric data), the electronic device 3000 displays a biometric authentication glyph 3024, as shown in FIG. 30D. Transition to Electronic device 3000 displays biometric authentication glyph 3024 to indicate that biometric data is being processed. In some examples, biometric authentication glyph 3024 includes a plurality of rings that rotate in a spherical shape, eg, while displayed.

In Fig. 30E, a determination is made that biometric authentication is successful. As a result, the electronic device 3000 displays a successful biometric authentication glyph 3026 indicating that the biometric authentication was successful.

In FIG. 30F, since the biometric authentication was successful, the electronic device 3000 displays the user name field 3014 and the password field 3016 with credential information (e.g., a user name that allows the user to successfully log in to the account And password). The electronic device 3000 automatically fills in the fields while the device is in the unlocked state. In some examples, a determination is made that biometric authentication has failed (eg, biometric authentication criteria have not been met). As a result, in such examples, the electronic device 3000 withholds automatically filling in one or more fillable fields (eg, username field 3014 and password field 3016).

In FIG. 30G, the electronic device 3000 detects a tap gesture 3028 on the submission affordance 3030. In response to detecting the tap gesture 3028, the electronic device 3000 submits credential information to the user name field 3014 and password field 3016 for user authentication. Upon successful user authentication, the electronic device 3000 provides access to restricted content (eg, content that can only be viewed when the user logs in) within the account user interface 3032 of FIG. 30H.

In FIG. 30I, the electronic device 3000 detects a tap gesture 3034 on a shop affordance 3036. Electronic device 3000 identifies tap gesture 3034 as a request to load login user interface 3038 (shown in FIG. 30J). The user interface 3038 is a web page shop.online.com. In some examples, shop.online.com is a subdomain of the online.com domain that requires successful authentication before access to restricted content is granted. In some examples, such as the example of FIG. 30J, the subdomain shop.online.com is one or more other subdomains of the online.com domain, such as the subdomain id.online.com, discussed in connection with FIGS. 30B-30I. It requires authentication separate from what is required by domains. The electronic device 3000 also requests the tap gesture 3034 to automatically fill in one or more fillable fields (e.g., username field 3040 and password field 3042) within login user interface 3038. Is identified as As previously described, in some examples, the request also includes a request to automatically log in the user so that the user does not need to tap a submit affordance (e.g., 3030, 3046) to submit credentials and log in. .

In response to a request to automatically fill in fillable fields, a determination is made that a cached authentication is available for use from the successful authentication that occurred in FIG. 30E. As a result, the electronic device 3000 suspends performing biometric authentication again, as shown in FIG. 30J, and proceeds to automatically fill in the user name field 3040 and the password field 3042. The electronic device 3000 automatically fills the fields regardless of whether the biometric sensor 3003 detects a biometric feature (eg, a face or a finger). In FIG. 30K, the electronic device 3000 detects a tap gesture 3044 on the submission affordance 3046. In response to detecting the tap gesture 3044, the electronic device 3000 submits credential information to the user name field 3040 and the password field 3042 for user authentication. Upon successful user authentication, the electronic device 3000 provides access to restricted content (eg, content that can only be viewed when the user is logged in) within the store user interface 3048 of FIG. 30L.

Alternatively, in response to a request to automatically fill in fillable fields, a determination is made that a cached authentication is not available for use. 30N-30V illustrate various examples of making cached authentication unavailable for use by electronic device 3000, as described below. 30W-30Y illustrate that biometric authentication should be performed when cached authentication is not available for use, as described below.

In FIG. 30M, the electronic device 3000 displays a store user interface 3048 and detects a tap gesture 3050 on the link affordance 3052. In response to detecting the tap gesture 3050, the electronic device 3000 displays an account user interface 3032, as shown in FIG. 30N.

30N and 30O illustrate an example of making cached authentication unavailable for use by electronic device 3000. In FIG. 30N, the electronic device 3000 detects an input (eg, a single press) by a finger 3054 at the home button 3056. In response to detecting the input, the electronic device 3000 displays the home screen 3058, as shown in FIG. 30O, and causes the application with the account user interface 3032 to be in an inactive state (e.g. , Dormant state, background state, and/or non-active state). When an application is automatically filled in the fillable fields in the login user interface 3012 (e.g., Figure 30F) and a request to automatically fill in the fillable fields in the login user interface 3038 (e. When inactive for more than a threshold time (eg, 2 minutes and 40 seconds) between times, the cached authentication is not available for use by the electronic device 3000.

30P-30T illustrate an example of making cached authentication unavailable for use by electronic device 3000. In FIG. 30P, the electronic device 3000 detects an input (eg, double press) by the finger 3054 at the home button 3056. In response to detecting the input, the electronic device 3000 displays a recently used app view 3060, as shown in FIG. 30Q. In FIGS. 30R and 30S, the electronic device 3000 detects a swipe gesture 3062, which causes the application with the account user interface 3032 to close (eg, terminate). As a result, the electronic device 3000 displays a recently used app view 3060, which no longer includes an application with an account user interface 3032, as illustrated by FIG. 30T. Once the application receives a request to automatically fill in the fillable fields in the login user interface 3012 (e.g., Figure 30J) and when the fillable fields in the login user interface 3012 (e.g., Figure 30J) are automatically filled in. If closed in between, the cached authentication is not available for use by electronic device 3000.

30U and 30V illustrate an example of making cached authentication unavailable for use by electronic device 3000. In FIG. 30U, the electronic device 3000 detects an input (eg, a single press) by a finger 3064 at a button 3004. In response to detecting the input, the electronic device 3000 transitions the device from the unlocked state to the locked state. Transitioning the device to the locked state includes disabling (eg, disabling) the display 3002 of the electronic device 3000, one or more biometric sensors 3003, and/or the microphone. In FIG. 30V, the electronic device 3000 is in a locked state and displays nothing on the display 3002. Once the electronic device 3000 automatically fills in the fillable fields in the login user interface 3012 (e.g., Figure 30F) and when the fillable fields in the login user interface 3038 (e. If the transition to the locked state between when the request is received, the cached authentication is not available for use by the electronic device 3000.

In FIG. 30W, the electronic device 3000 is configured after the cached authentication is no longer available (e.g., FIGS. 30N and 30O, FIGS. 30P- After one or more of the sequences), displays the account user interface 3032. The electronic device 3000 detects a tap gesture 3034 on the store affordance 3036. Electronic device 3000 identifies tap gesture 3034 as a request to load login user interface 3038 (shown in FIG. 30X). The electronic device 3000 also requests the tap gesture 3034 to automatically fill in one or more fillable fields (e.g., username field 3040 and password field 3042) within login user interface 3038. Is identified as As previously described, in some examples, the request also includes a request to automatically log in the user so that the user does not need to tap the submit affordance to submit credentials and log in.

In response to a request to automatically fill one or more fillable fields, a determination is made that a cached authentication is not available for use by the electronic device 3000. In FIG. 30Y, the electronic device 3000 performs biometric authentication again using one or more biometric sensors 3003. Biometric authentication occurs automatically in response to receiving a request to automatically fill fillable fields such that no intermediate input from the user is required to initiate biometric authentication. If biometric authentication is successful (eg, biometric authentication criteria are met), the electronic device automatically fills in the fillable fields. If the biometric authentication is not successful (eg, biometric authentication criteria are not met), the electronic device 3000 reserves the automatic filling of the fillable fields.

In Fig. 30z, the user is not logged in, and a user interface similar to that of Fig. 30a is presented. The electronic device 3000 displays the user interface 3006 of the application on the display 3002. The electronic device 3000 detects a tap gesture 3008 on the login affordance 3010. Electronic device 3000 identifies tap gesture 3008 as a request to load login user interface 3012 (shown in FIG. 30AA). The electronic device 3000 also requests a tap gesture 3008 to automatically fill in one or more fillable fields (e.g., username field 3014 and password field 3016) within login user interface 3012. Identify as The request to automatically fill requires biometric authentication in order to proceed to automatically fill the fillable fields. As previously described, in some examples, the request also includes a request to automatically log in the user so that the user does not need to tap the submit affordance to submit credentials and log in.

In FIG. 30AA, in response to a request to automatically fill fillable fields, the electronic device 3000 uses the biometric sensor 3003 to determine whether predetermined biometric authentication criteria have been met. The biometric sensor 3003 is non-contact, allowing the sensor to be configured to perform biometric authentication without physical input from a user. As a result, the electronic device 3000 initiates biometric authentication using the biometric sensor 3003 without needing to receive an explicit request from the user to initiate biometric authentication. Biometric authentication is not successful (eg, biometric authentication criteria are not met). As a result, the electronic device 3000 displays the failure interface 3066 in FIG. 30Ab upon failed biometric authentication, as described in connection with FIG. 17M. Failure interface 3066 may be displayed when the user has not reached the maximum number of failed biometric authentication attempts.

In FIG. 30AC, the electronic device 3000 detects a tap gesture 3068 on the cancellation affordance 3070. In response to detecting the tap gesture 3068, the electronic device 3000 displays a login user interface 3012 (shown in FIG. 30AD). In FIG. 30A, in response to detecting the selection of the user name field 3014, the electronic device 3000 displays a cursor 3072 in the user name field 3014 and also displays a virtual keyboard 3074. The electronic device 3000 receives an input for entering one or more characters corresponding to credential information in the user name field 3014 and the password field 3016. In FIG. 30AE, the electronic device 3000 detects a tap gesture 3028 on the submission affordance 3030. As a result, the electronic device 3000 submits credential information to the user name field 3014 and the password field 3016 for user authentication. Upon successful user authentication, the electronic device 3000 provides access to restricted content (eg, content that can only be viewed when the user logs in) within the account user interface 3032 of FIG. 30Af.

In FIG. 30AG, the electronic device 3000 detects a tap gesture 3034 on the store affordance 3036. The electronic device 3000 identifies the tap gesture 3034 as a request to load a login user interface 3038 (shown in FIG. 30A). The electronic device 3000 also requests the tap gesture 3034 to automatically fill in one or more fillable fields (e.g., username field 3040 and password field 3042) within login user interface 3038. Is identified as As previously described, in some examples, the request also includes a request to automatically log in the user so that the user does not need to tap the submit affordance to submit credentials and log in.

In response to a request to automatically fill one or more fillable fields, a determination is made that a cached authentication is not available for use by the electronic device 3000. In FIG. 30A, the electronic device 3000 performs biometric authentication using the biometric sensor 3003. Biometric authentication occurs automatically in response to receiving a request to automatically fill fillable fields such that no intermediate input from the user is required to initiate biometric authentication.

In Fig. 30Ai, a determination is made that biometric authentication is successful (eg, biometric authentication criteria are met). As a result, the electronic device 3000 displays a biometric authentication interface 3018 with a successful biometric authentication glyph 3026 indicating that the biometric authentication was successful. Upon successful biometric authentication, the electronic device 3000 automatically fills in the user name field 3040 and the password field 3042 with credential information, as shown in FIG. 30Aj.

In FIG. 30AJ, the electronic device 3000 detects a tap gesture 3044 on the submission affordance 3046. In response to detecting the tap gesture 3044, the electronic device 3000 submits credential information to the user name field 3040 and the password field 3042 for user authentication. Upon successful user authentication, the electronic device 3000 provides access to restricted content (eg, content that can only be viewed when the user is logged in) within the store user interface 3048 of FIG. 30AK.

In some examples, electronic device 3000 displays a biometric authentication interface with a biometric authentication glyph indicating that biometric authentication is being performed. In some examples, the displayed biometric authentication interface is approximately centered along a horizontal and/or vertical axis as in FIGS. 30B-30E. In other examples, the electronic device 3000 displays a biometric authentication interface on the top, bottom, side, or corner of the display 3002. For example, the electronic device 3000 displays a biometric authentication interface 3076 near the top of the display 3002, as shown in FIG. 30A. In some examples, the electronic device 3000 does not display a biometric authentication interface while biometric authentication is being performed.

31A and 31B are flow diagrams illustrating a method for determining whether biometric re-authentication is required or cached authentication is available for use using an electronic device, in accordance with some examples. Method 3100 includes one or more biometric sensors (e.g., 3003) (e.g., a fingerprint sensor, a non-contact biometric sensor (e.g., a biometric sensor that does not require physical contact, such as a thermal or optical facial recognition sensor), an iris. Scanner) with a device (eg 100, 300, 500, 1700, 3000). In some examples, one or more biometric sensors (eg, 3003) include one or more cameras. The electronic device (eg, 100, 300, 500, 1700, 3000) optionally includes a display (eg, 3002). In some examples, the display (eg, 3002) is a touch-sensitive display. In some examples, the display (eg, 3002) is not a touch-sensitive display.

Some operations of method 3100 are selectively combined, the order of some operations is selectively changed, and some operations are selectively omitted. As described below, method 3100 provides an intuitive method for determining whether biometric re-authentication is required or if cached authentication is available for use. This method reduces the user's cognitive burden for authenticating on the electronic device, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to authenticate faster and more efficiently saves power and increases the time between battery charges.

The electronic device (e.g., 100, 300, 500, 1700, 3000) requests a first request (e.g., 3008) to perform a first operation that requires authentication (e.g., selects a password to be automatically filled, unlocks the device, pays The following) is received (3102).

In response to receiving a first request (e.g., 3008) to perform a first operation (3104), the electronic device (e.g., 100, 300, 500, 1700, 3000) is directed to blocks 3106 to 3110. Proceed.

The electronic device (eg, 100, 300, 500, 1700, 3000) uses one or more biometric sensors (eg, 3003) to determine whether the first biometric authentication criteria are met (3106). The first biometric authentication criteria include the requirement that each type of biometric feature (eg, face or fingerprint) that is authorized to perform the first operation is detected by the biometric sensors (eg, 3003).

In accordance with a determination that the first biometric authentication criteria are met (e.g., at least a portion of the biometric feature, determined based on data obtained from one or more biometric sensors (e.g., 3003) corresponding to the biometric feature) When the biometric authentication criteria are satisfied (eg, a face that has been detected matches an approved face)), the electronic device (eg, 100, 300, 500, 1700, 3000) performs a first operation (3108). Performing the first operation upon request and successful authentication provides the user with the ability to perform the first operation without requiring additional inputs (in addition to the request). Performing an action when a set of conditions is met without requiring additional user input (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) the device It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In response to a determination that the biometric authentication criteria are not met, the electronic device (eg, 100, 300, 500, 1700, 3000) withholds from performing the first operation (3110). Suspending (or performing) each action based on not meeting biometric authentication criteria can provide security and prevent unauthorized users from initiating sensitive actions. Providing improved security improves the operability of the device (e.g., by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the power of the device by limiting the performance of restricted operations. Reduces usage and improves battery life.

After performing the first operation, the electronic device (e.g., 100, 300, 500, 1700, 3000) requests a second request to perform a second operation (e.g., the same or different from the first operation) requesting authentication ( For example, 3034) (eg, selecting a password to be automatically filled in, unlocking the device, making payment) is received (3112).

In response to receiving a second request (eg, 3034) (3114), the electronic device (eg, 100, 300, 500, 1700, 3000) proceeds to blocks 3116 and 3118.

Depending on the determination that the re-authentication criteria have been met (e.g., cached authentication is not allowed for the second operation or cached authentication is not available for use), the electronic device (e.g., 100, 300, 500, 1700) , 3000) uses one or more biometric sensors (eg, 3003) to determine whether the second biometric authentication criteria are met (3116). The second biometric authentication criteria include the requirement that each type of biometric feature (eg, face or fingerprint) that is authorized to perform the second operation is detected by the biometric sensors (eg, 3003). In some examples, the first and second biometric authentication criteria are the same. In some examples, the first and second biometric authentication criteria are different. Performing biometric authentication when cached authentication is not available provides security and can prevent unauthorized users from initiating sensitive operations. Providing improved security improves the operability of the device (e.g., by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the power of the device by limiting the performance of restricted operations. Reduces usage and improves battery life.

Upon determining that re-authentication criteria have not been met (e.g., cached authentication is available for use), the electronic device (e.g., 100, 300, 500, 1700, 3000) performs a second operation without performing biometric authentication. And withholding determining whether the second biometric authentication criteria are met using one or more biometric sensors (eg, 3003) (3118). Performing the second operation on request without requiring re-authentication provides the user with the ability to perform the operation without requiring additional inputs (in addition to the request). Performing an action when a set of conditions is met without requiring additional user input or re-authentication (e.g., helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user mistakes) By improving the operability of the device and making the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, the first and second actions occur while the electronic device (eg, 100, 300, 500, 1700, 3000) is in an unlocked state. In some examples, determining whether the second biometric authentication criteria are met using one or more biometric sensors (e.g., 3003) is the electronic device (e.g., 100, 300, 500, 1700, 3000) is locked. Occurs while in an unlocked state. Performing biometric authentication while the device is in an unlocked state allows the device to provide feedback by displaying an indication of the progress of the biometric authentication. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, in response to receiving a second request (e.g., 3034) and upon determining that the second biometric authentication criteria are not met, the electronic device (e.g., 100, 300, 500, 1700, 3000) Withholding the second operation

According to some examples, performing the second action means that each type of biometric feature that is authorized to perform the second action in response to receiving the second request (e.g., 3034) is biometric sensors (e.g., 3003) occurs regardless of whether it is detected by.

According to some examples, the first operation is to log on to a first web domain (eg, 3028), and the second operation is to log on to a second web domain corresponding to the first web domain (eg, 3044). In some examples, the second web domain is the same as the first web domain. In some examples, the second web domain is a subdomain of the first web domain.

According to some examples, the re-authentication criteria are in the locked state of the device (e.g., 100, 300, 500, 1700, 3000) between when a first operation is performed and a second request (e.g., 3034) is received. Includes the requirement that there was (e.g., cached authentication is not available for use) (e.g., when the device was held in an unlocked state between when a first operation is performed and a second request is received) Re-authentication criteria are not met and biometric authentication is not required again).

According to some examples, the first operation is performed in the application, and the re-authentication criteria indicate that the application is closed (e.g., terminated) between when the first operation is performed and when a second request (e.g., 3034) is received. ) Requirements (e.g., cached authentication is not available for use) (e.g., re-authentication criteria when the application remains open between when a first operation is performed and a second request is received) Are not met and biometric authentication is not required again).

According to some examples, the re-authentication criteria are inactive (e.g., inactive) for more than a threshold time (e.g., 2 minutes and 40 seconds) between when a first operation is performed and a second request (e.g., 3034) is received. , A requirement to have been in a pending state, dormant state, background state, non-active state (e.g., a cached authentication is not available for use) (e.g., when a first operation is performed and a second request The re-authentication criteria are not met and biometric authentication is not required again when the application has been kept active between when is received).

According to some examples, determining whether the second biometric authentication criteria are met using one or more biometric sensors (e.g., 3003) comprises: 3034) automatically (eg, without the need for intermediate input from the user).

According to some examples, one or more biometric sensors (e.g., 3003) are contactless biometric sensors (e.g., infrared cameras, visible light cameras, or combinations thereof) configured to perform biometric authentication without physical contact from a user. ) (Eg, one or more biometric sensors (eg, 3003) can perform biometric authentication without physical input (eg, touch or button press) from a user).

According to some examples, while determining whether the first or second biometric authentication criteria are met using one or more biometric sensors (e.g., 3003), the electronic device (e.g., 100, 300, 500, 1700, 3000) displays an indication (eg, 3076) that biometric authentication is being performed on a display (eg, 3002) (eg, a small indicator is displayed on the top, bottom, side, or corner). Displaying a small indicator away from the center of the display provides the user with an indication of the progress of biometric authentication without distracting the user and disturbing or confusing the display, thereby providing improved visual feedback during authentication. do. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication. In some examples, the electronic device (e.g., 100, 300, 500, 1700, 3000) uses one or more biometric sensors (e.g., 3003) to determine whether the biometric authentication criteria are met. It is reserved to display an indication that measurement authentication is being performed.

It is noted that the details of the processes described above with respect to method 3100 (eg, FIGS. 31A and 31B) are also applicable in a similar manner to the methods described below and above. For example, method 3100 may optionally include characteristics of various methods described above with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700, 2900, 3300, 3500. Contains one or more of. For example, registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with method 3100. As a further example, the visibility criteria of method 3300 may be used in conjunction with method 3100 to control when biometric authentication should be performed (or should be performed again). For brevity, these details are not repeated below.

32A-32W illustrate example user interfaces for automatically filling fillable fields based on visibility criteria, according to some examples. As described in more detail below, illustrative examples of user interfaces illustrated in FIGS. 32A-32W are used to illustrate the processes described below, including the processes of FIG. 33.

32A illustrates an electronic device 3200 (eg, portable multifunction device 100, device 300, or device 500). In the example examples illustrated in FIGS. 32A-32W, the electronic device 3200 is a smartphone. In other examples, electronic device 3200 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 3200 includes a display 3202, one or more input devices (eg, a touchscreen and a microphone of the display 3202), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 32A, the electronic device includes a biometric sensor 3203. In some examples, the biometric sensor is one or more biometric sensors, which may include a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 3203 is biometric sensor 703. In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 32A, electronic device 3200 displays a user interface 3204 of the application on display 3202. The application is a mobile browser application, and the interface corresponds to a website (airline.com). In FIGS. 32B to 32D, the electronic device 3200 does not initiate biometric authentication because the login user interface did not meet certain visibility criteria. For example, visibility criteria may include whether a threshold amount of one or more fillable fields (eg, corresponding to credential information) is displayed within the visible area of the user interface.

In FIGS. 32B and 32C, the electronic device 3200 detects a scroll gesture 3206 in upward motion. In response to detecting the scroll gesture 3206, the electronic device 3200 causes the user interface 3204 to scroll down. In FIG. 32D, following the scroll gesture 3206, the electronic device 3200 displays the scrolled user interface 3208. Electronic device 3200 still has not initiated biometric authentication due to a determination that visibility criteria have not been met.

In FIG. 32E, the electronic device 3200 detects a tap gesture 3210 on the hidden menu affordance 3212. In response to detecting the tap gesture 3210, the electronic device 3200 displays a hidden menu 3214, which hidden menu includes one or more fillable fields (e.g., user name Field 3216 and password field 3218). The electronic device 3200 displays a hidden menu 3214, which is overlaid on the scrolled user interface 3208 so that the covered portion of the scrolled user interface 3208 is no longer displayed. A determination is made as to whether the fillable fields meet certain visibility criteria.

If it is determined that the fillable fields meet certain visibility criteria, the electronic device 3200 may display the fillable fields in the hidden menu 3214 with credential information (e.g., a username that allows the user to successfully log in to the account). And a password). The request to automatically fill requires biometric authentication in order to proceed to automatically fill the fillable fields. In some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submit affordance (eg, submit affordance 3232 in FIG. 32L) to submit credentials and log in.

In FIG. 32G, upon determining that one or more fillable fields meet certain visibility criteria, electronic device 3200 uses biometric sensor 3203 to determine whether certain biometric authentication criteria have been met. The electronic device 3200 captures and processes (e.g., analyzes) biometric data from the biometric sensor 3203 so that, based on the biometric data, the biometric feature (or a portion thereof) is (E.g., determine whether the biometric data matches the biometric template, within a threshold). Biometric authentication occurs automatically once a determination is made that the fillable fields meet the visibility criteria. The biometric sensor 3203 is contactless, allowing the sensor to be configured to perform biometric authentication without physical contact from a user. As a result, the electronic device 3200 initiates biometric authentication using the biometric sensor 3203 without receiving an explicit request from the user to initiate biometric authentication. In some examples, initiating biometric authentication includes detecting contact with one or more fingerprint sensors, and determining whether the contact meets certain fingerprint authentication criteria (e.g., secure element 115 and Determine whether the fingerprint matches the enrolled fingerprint as discussed above in connection with; and match the information stored in the fingerprint as discussed above with respect to methods 1600, 1800, 2200, and FIGS. 17O and 21 To determine whether or not). In some examples, determining whether the fingerprint matches an enrolled fingerprint is according to one or more of the methods discussed in US Patent Application Publication No. 2015/0146945 (eg, in paragraphs [0119]-[0121]). Performed. US Patent Application Publication No. 2015/0146945 is incorporated herein by reference, specifically with respect to its disclosure of methods of determining whether a fingerprint matches an enrolled fingerprint.

Alternatively, a determination may be made that one or more fillable fields do not meet certain visibility criteria. If the fillable fields do not meet the visibility criteria, the electronic device 3200 withholds from initiating biometric authentication.

Performing biometric authentication includes displaying biometric authentication interface 3220 with biometric authentication glyph 3222. Biometric authentication glyph 3222 is a simulation of the representation of a biometric feature (eg, face). As shown in FIG. 32G, biometric authentication interface 3220 is overlaid on at least a portion of hidden menu 3214. The biometric authentication interface 3220 is, optionally, an operating system level interface (e.g., an interface created by the operating system of the device), and the hidden menu 3214 is an application level interface (e.g., separate from the operating system of the device). It is a user interface created by a personal third party application). In some examples, the displayed biometric authentication interface is approximately centered along a horizontal and/or vertical axis as in FIGS. 32G-32J. In some examples, electronic device 3200 displays a biometric authentication interface at the top, bottom, side, or corner of display 3202. For example, the electronic device 3200 displays a biometric authentication interface near the top of the display 3202, for example as in FIG. 30A. In some examples, the electronic device 3200 does not display a biometric authentication interface while biometric authentication is being performed.

In FIG. 32H, the electronic device 3200 displays a portion of a biometric authentication animation including a biometric authentication glyph 3224, which is a portion of the animation in which the biometric sensor 3203 acquires biometric data. It plays a role as Once the electronic device 3200 has obtained biometric data (e.g., has obtained sufficient biometric data), the electronic device 3200 displays a biometric authentication glyph 3226, as shown in FIG. Transition to Electronic device 3200 displays biometric authentication glyph 3226 to indicate that biometric data is being processed. In some examples, biometric authentication glyph 3226 includes a plurality of rings that rotate in a spherical shape, eg, while being displayed.

In Fig. 32J, a determination is made that biometric authentication is successful. As a result, the electronic device 3200 displays a successful biometric authentication glyph 3228 indicating that the biometric authentication was successful.

In FIG. 32K, since biometric authentication was successful, the electronic device 3200 registers one or more fillable fields (e.g., user name field 3216 and password field 3218) for credential information (e.g., user account Automatically filled in with login information such as username and password) that allows you to log in successfully. In some examples, electronic device 3200 automatically populates fillable fields with credit card information (eg, information associated with payment account information).

Alternatively, a determination may be made that the biometric authentication criteria have not been met. If the biometric authentication fails, the electronic device 3200 suspends automatically filling one or more fillable fields with credential information (eg, login information or credit card information). Pending automatic filling of one or more fillable fields optionally includes displaying a failed interface, such as failed interface 2854 in FIG. 28X or failed interface 2856 in FIG. 28Y.

In FIG. 32L, the electronic device detects a tap gesture 3230 on submission affordance 3232. In response to detecting the tap gesture 3230, the electronic device 3200 submits credential information to the user name field 3216 and password field 3218 for user authentication. Upon successful authentication, electronic device 3200 provides access to restricted content (eg, content that can only be viewed when the user is logged in) within member user interface 3234 of FIG.

32N-W illustrate various scenarios in which certain visibility criteria were not initially met, and then, following user input, the visibility criteria were satisfied.

In FIG. 32N, electronic device 3200 displays the application's user interface 3236 on display 3202. The application is a mobile browser application, and the interface corresponds to a website (restaurant.com). User interface 3236 includes one or more fillable fields (eg, username field 3238 and password field 3240). Fillable fields are displayed in a size that is less than a threshold size (eg, a threshold size that must be met or exceeded to meet certain visibility criteria) within the visible area of the user interface 3236.

In FIG. 32O, while displaying user interface 3236, electronic device 3200 detects zoom gesture 3242. In response to detecting the zoom gesture 3242, the electronic device 3200 displays an enlarged user interface 3244, as shown in FIG. 32P. The enlarged user interface 3244 includes an enlarged user name field 3246 and an enlarged password field 3248. A determination is made that the zoom gesture 3242 did not cause the fillable fields to meet certain visibility criteria. For example, fillable fields are still displayed at a size that is less than a threshold size within the visible area of the enlarged user interface 3244. Upon determining that the visibility criteria are still not met, the electronic device 3200 withholds from initiating biometric authentication.

In FIG. 32Q, while displaying the enlarged user interface 3244, the electronic device 3200 detects a zoom gesture 3250. In response to detecting the zoom gesture 3250, the electronic device 3200 displays an enlarged user interface 3252, as shown in FIG. 32R. The enlarged user interface 3252 includes an enlarged user name field 3254 and an enlarged password field 3256. A determination is made that the zoom gesture 3250 caused the fillable fields to meet the visibility criteria. For example, fillable fields are now displayed at a size that is greater than or equal to a threshold size within the visible area of the enlarged user interface 3252. Upon determining that the visibility criteria are met, the electronic device 3200 initiates biometric authentication and displays a biometric authentication interface 3220 with a biometric authentication glyph 3222, as described in connection with FIG. 32G. do.

In FIG. 32S, electronic device 3200 displays the application's user interface 3258 on display 3202. The application is a mobile browser application, and the interface corresponds to a website (newsfeed.com). User interface 3258 is a user interface area corresponding to a portion of an electronic document (eg, HTML document). The electronic document includes one or more fillable fields outside the visible area of user interface 3258 (eg, username field 3268 and password field 3270 in FIG. 32W).

In FIG. 32T, while displaying the user interface 3258, the electronic device 3200 detects a scroll gesture 3260 in upward motion. In response to detecting the scroll gesture 3260, the electronic device 3200 causes the user interface 3258 to scroll down. In FIG. 32U, following scroll gesture 3260, electronic device 3200 displays a scrolled user interface 3262, which displays a portion of one or more fillable fields (e.g., user name field 3268). Includes doing. A determination is made that scroll gesture 3260 failed to cause one or more fillable fields to meet certain visibility criteria. For example, visibility criteria include whether a threshold amount of one or more fillable fields is displayed within the visible area of the scrolled user interface 3262. Upon determining that the visibility criteria are still not met, the electronic device 3200 withholds from initiating biometric authentication.

In FIG. 32V, while displaying the scrolled user interface 3262, the electronic device 3200 detects a scroll gesture 3264. In response to detecting the scroll gesture 3264, the electronic device 3200 causes the scrolled user interface 3262 to scroll further down. In FIG. 32W, following scroll gesture 3264, electronic device 3200 displays a scrolled user interface 3266, which displays one or more fillable fields (e.g., username field 3268 and password field ( 3270)). A determination is made that the scroll gesture 3264 caused the fillable fields to meet the visibility criteria. For example, a threshold amount of one or more fillable fields is now displayed within the visible area of the scrolled user interface 3262. Upon determining that the visibility criteria are met, the electronic device 3200 initiates biometric authentication and displays a biometric authentication interface 3220 with a biometric authentication glyph 3222, as described in connection with FIG. 32G. do.

33 is a flow chart illustrating a method for determining when to perform an authentication operation using an electronic device, in accordance with some examples. The method 3300 is performed in a device (eg, 100, 300, 500, 1700, 3200) having a display (eg, 3202). In some examples, the display (eg, 3202) is a touch-sensitive display. In some examples, the display (eg, 3202) is not a touch-sensitive display.

Some operations of the method 3300 are selectively combined, the orders of some operations are selectively changed, and some operations are selectively omitted. As described below, method 3300 provides an intuitive method for determining when to perform an authentication operation. This method reduces the user's cognitive burden on performing an authentication operation, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to authenticate faster and more efficiently saves power and increases the time between battery charges.

The electronic device (e.g., 100, 300, 500, 1700, 3200) requests (e.g., 3210) (e.g., loads a webpage) to display a first portion (e.g., 3214) of each content (e.g., 3208). , A request to scroll the web page and zoom the web page) is received (3302).

In response to a request (e.g., 3210) to display a first portion (e.g., 3214) of each content (e.g., 3208) (3304), the electronic device (e.g., 100, 300, 500, 1700, 3200) blocks It proceeds to (3306) to block 3310.

The electronic device (e.g., 100, 300, 500, 1700, 3200) is at least a first portion (e.g., 3214) of each content (e.g., 3208) on the display (e.g., 3202) (e.g., user-interactive Display 3306 an area of an electronic document (eg, an HTML document) with elements. Each content (e.g., 3208) optionally includes an element (e.g., 3216, 3218) associated with an authentication operation (e.g., one or more fillable fields such as a credit card entry field, username and password fields to log in to the service). Contains login user interface elements).

Depending on the determination that the element associated with the authentication operation (e.g., 3216, 3218) meets the visibility criteria (e.g., the element associated with the authentication operation is entirely outside the visible area of the content, and at least a threshold amount of the element associated with the authentication operation is Is outside the visible area of, and an element associated with the authentication action is displayed in a size less than a threshold size within the visible area of the content, and/or an element associated with the action is contained within a folded menu area or other hidden element. Contained within a portion of the content that is hidden from view) (e.g., at least a portion of one or more fillable fields is displayed, one or more fillable fields are fully displayed, and/or one or more fillable fields are greater than a threshold size) , The electronic device (eg, 100, 300, 500, 1700, 3200) initiates biometric authentication (eg, as described with reference to FIGS. 17G and 17H) (3308). In some examples, the region corresponds to a portion of an electronic document (e.g., an HTML document), and the one or more fillable fields are Elements (eg, HTML elements with the "style.display" property of "inline"). Initiating biometric authentication upon meeting the visibility criteria provides the user with the ability to perform biometric authentication without requiring additional inputs (in addition to an input that causes the visibility criteria to be met). Performing biometric authentication when a set of conditions is met without requiring additional user input (e.g., by helping the user provide appropriate inputs when actuating/interacting with the device and reducing user errors) ) It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

Depending on the determination that the element associated with the authentication operation (e.g., 3216, 3218) does not meet the visibility criteria (e.g., the element associated with the authentication operation is displayed entirely within the visible area of the content, and at least a threshold amount of the element associated with the authentication operation) Is displayed within the visible area of, and the element associated with the authentication action is displayed in a size exceeding a threshold size within the visible area of the content, and/or the element associated with the action is contained within a folded menu area or other hidden element. Also included within a portion of the content that is not otherwise hidden from the view), the electronic device (eg, 100, 300, 500, 1700, 3200) withholds from initiating biometric authentication (3310). Withholding initiating biometric authentication based on not meeting visibility criteria prevents biometric authentication from occurring when the user is not intended to initiate biometric authentication by the device. Preventing unintentional biometric authentication improves the operability of the device (e.g., by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the performance of restricted operations to the device. It reduces the power usage of the battery and improves battery life.

According to some examples, a first portion (eg, 3214) of each content (eg, 3208) is displayed without displaying a second portion of each content on a display (eg, 3202). In some examples, the second portion is displayed prior to displaying the first portion.

According to some examples, biometric authentication is automatically (e.g., without requiring intermediate input to initiate biometric authentication) upon determination that an element (e.g., 3216, 3218) associated with the authentication operation meets visibility criteria. Occurs.

According to some examples, while displaying a first portion (e.g., 3236, 3258) of each content, the electronic device (e.g., 100, 300, 500, 1700, 3200) inputs (e.g., 3242, 3250, 3260, 3264) (e.g., zoom, scroll, menu display) is detected. In response to detecting the input (e.g., 3250, 3264) and upon a determination that the input causes the element associated with the authentication operation (e.g., 3246, 3248, 3268, 3270) to meet the visibility criteria, the electronic device (e.g. , 100, 300, 500, 1700, 3200) initiate biometric authentication. Initiating the biometric authentication in response to an input and upon meeting the visibility criteria provides the user with the ability to perform biometric authentication without requiring additional inputs (in addition to the input allowing the visibility criteria to be met). Performing biometric authentication when a set of conditions is met without requiring additional user input (e.g., by helping the user provide appropriate inputs when actuating/interacting with the device and reducing user errors) ) It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In response to detecting the input (e.g., 3242, 3260) and upon a determination that the input does not cause the element associated with the authentication operation (e.g., 3238, 3240, 3268, 3270) to meet the visibility criteria, the electronic device ( For example, 100, 300, 500, 1700, 3200) withhold from initiating biometric authentication. In some examples, the input (e.g., 3210, 3242, 3250, 3260, 3264) (e.g., selection of affordance, resize request) is an element associated with the authentication operation (e.g., 3216, 3218, 3246, 3248, 3268, 3270). ), which causes the element to transition from not meeting the visibility criteria to meeting the visibility criteria. Withholding initiating biometric authentication based on not meeting visibility criteria prevents biometric authentication from occurring when the user is not intended to initiate biometric authentication by the device. Preventing unintentional biometric authentication improves the operability of the device (e.g., by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the performance of restricted operations to the device. It reduces the power usage of the battery and improves battery life.

According to some examples, the input (e.g., 3242, 3250) is a request to perform a zoom operation, and the visibility criteria are that the factor (3238, 3240, 3246, 3248, 3254, 3256) associated with the authentication operation is greater than the threshold size. Includes the requirement to have size.

According to some examples, input 3260, 3264 is a request to perform a scroll operation, and the visibility criteria indicate that at least a predetermined amount of element 3268, 3270 associated with the authentication operation is displayed on the display (e.g., 3202). Include requirements.

According to some examples, the input (e.g., 3210) is a request to perform a hidden interface area display operation (e.g., a request to display a hidden menu or other hidden interface area), and the visibility criteria are an element associated with the authentication operation (e.g., 3216, 3218) are not designated to display in the hidden interface area.

According to some examples, the electronic device (e.g., 100, 300, 500, 1700, 3200) further includes one or more biometric sensors (e.g., 3203), and initiating biometric authentication may include one or more biometrics And initiating biometric authentication using sensors (eg, 3203).

According to some examples, one or more biometric sensors (e.g., 3203) are one or more non-contact biometric sensors (e.g., infrared cameras, visible light cameras, or their Combinations) (eg, one or more biometric sensors (eg, 3203) may perform biometric authentication without physical input (eg, touch or button press) from a user). Initiating biometric authentication occurs without receiving an explicit request to initiate biometric authentication.

According to some examples, one or more biometric sensors (eg, 3203) include one or more facial recognition sensors. Initiating biometric authentication includes using one or more facial recognition sensors to determine whether facial authentication criteria have been met (eg, as described in connection with FIGS. 23D-23F).

According to some examples, one or more biometric sensors (eg, 3203) include one or more fingerprint sensors. Initiating biometric authentication includes detecting contact with one or more fingerprint sensors, and determining whether the contact meets fingerprint authentication criteria (e.g., the fingerprint matches an enrolled or authorized fingerprint). Include.

According to some examples, initiating biometric authentication includes displaying, on a display (e.g., 3202), a progress indicator (e.g., 3222, 3224, 3226, 3228) indicating the status of the biometric authentication process. . In some examples, the progress indicator is a portion of the features of the progress indicator displayed surrounding a simulation of a biometric feature such as a plurality of progress elements distributed around a simulated progress indicator (e.g., a representation of the user's biometric feature). Or a progress indicator with all). In some examples, a small progress indicator is displayed at the top, bottom, side, or corner. Displaying a small indicator away from the center of the display provides the user with an indication of the progress of biometric authentication without distracting the user and disturbing or confusing the display, thereby providing improved visual feedback during authentication. do. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication. In some examples, no progress indicator is displayed during biometric authentication. In some examples, the electronic device (eg, 100, 300, 500, 1700, 3200) withholds displaying a progress indicator indicating the status of the biometric authentication process.

According to some examples, the element associated with the authentication operation is a fillable field (eg, 3216, 3218, 3254, 3256, 3268, 3270) (eg, a username, password, credential, or payment information input field). In response to initiating biometric authentication and upon determining that the biometric authentication criteria have been met, the electronic device (e.g., 100, 300, 500, 1700, 3200) may be 3256, 3268, 3270) is automatically populated with credential information (e.g., fields, electronic devices (e.g., 100, 300, 500, 1700, 3200), such as username, password, credit card information or other sensitive information) Populated with data accessible by or stored by an electronic device (eg, 100, 300, 500, 1700, 3200). In response to initiating biometric authentication and upon determining that the biometric authentication criteria have not been met, the electronic device (e.g., 100, 300, 500, 1700, 3200) is 3256, 3268, 3270) are reserved for automatic filling of credential information.

According to some examples, in response to initiating biometric authentication and upon determining that the biometric authentication criteria have been met, the electronic device (e.g., 100, 300, 500, 1700, 3200) has access to the restricted content (e.g., Log in to a webpage (eg, 3234), display a list of passwords associated with a user, display credit card information. In response to initiating biometric authentication and upon determining that biometric authentication criteria have not been met, the electronic device (eg, 100, 300, 500, 1700, 3200) withholds providing access to restricted content.

According to some examples, the credential information includes login information (eg, information required to log in to an application, account, or website).

According to some examples, the credential information includes information associated with payment account information (eg, credit card, bank account, or payment service information).

It is noted that the details of the processes described above with respect to method 3300 (eg, FIG. 33) are also applicable in a similar manner to the methods described below and above. For example, method 3300 may optionally include characteristics of various methods described above with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700, 2900, 3100, 3500. Contains one or more of. For example, registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with method 3300. As a further example, the re-authentication criteria of method 3100 may be used with method 3300 to control when biometric authentication should be performed (or should be performed again). For brevity, these details are not repeated below.

34A-34N illustrate example user interfaces for automatic login using biometric authentication, according to some examples. As described in more detail below, illustrative examples of user interfaces illustrated in FIGS. 34A-34N are used to illustrate the processes described below, including the processes of FIG. 35.

34A illustrates an electronic device 3400 (eg, portable multifunction device 100, device 300, device 500, or device 1700). In the example examples illustrated in FIGS. 34A-34N, the electronic device 3400 is a smartphone. In other examples, electronic device 3400 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 3400 includes a display 3402, one or more input devices (eg, a touchscreen and a microphone of the display 3402 ), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 34A, the electronic device includes a biometric sensor 3403. In some examples, the biometric sensor is one or more biometric sensors, which may include a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the biometric sensor is a depth camera or device 100 having one or more features and/or functions of a depth camera as described in connection with device 700 and certain examples of biometric sensor 703. ) Is the depth camera 175. In some examples, biometric sensor 3403 may be used with a visible light camera to determine a depth map of different portions of the object captured by the visible light camera, as described above with respect to biometric sensor 703. It's a camera.

As can be seen in FIG. 34A, the electronic device 3400 also includes a fingerprint sensor 3414 (eg, a biometric sensor) incorporated into the button. In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In some examples, the electronic device 3400 includes devices 100, 300, 500, 700, 900, 1100, 1300, 1500, 1700, 1900, 2100, 2300, 2400, 2600, 2800, 3000, 3200, 3600, 3800 , 4000, 4200) and one or more features, elements, and/or components, each of which devices share one or more features, elements, and/or components of another of those devices Can (eg, device 700 can include components of device 3200 and vice versa). For example, the biometric sensor 3403 may be a biometric sensor 903, or the biometric sensor 1103 may be a biometric sensor 1303. As another example, the button-integrated fingerprint sensor 3414 may be a fingerprint sensor 1764. For another example, display 3402 may be display 1302, or display 1502 may be display 2102.

Prior to displaying login user interface 3404 in FIG. 34A, electronic device 3400 detects a request to load login user interface 3404. In response to detecting the request, a determination is made as to whether or not biometric authentication using fingerprint sensor 3414 is available. Upon determining that biometric authentication is available, the electronic device 3400 puts the credential information in the submission affordance 3420 (e.g., upon selection, in one or more fillable fields (e.g., username field or password field). Displays a login user interface 3404 with a prompt 3406 (“SCAN FINGER TO LOGIN”) located within the affordance to submit). Prompt 3406, to the user, displays a fingerprint sensor. Placing their fingers on 3414 allows for credential information (e.g., a username and password that allows the user to successfully log into the account) and submits via the username field 3408 and password field 3410 Additionally, the username field 3408 is pre-populated with a default username (eg, jj_appleseed@email.com), as shown in Figure 34A. In some examples, the username field is a username field. Not pre-filled

In FIG. 34B, while displaying login user interface 3404, electronic device 3400 detects finger 3412 using fingerprint sensor 3414. In response to detecting the finger 3412, a determination is made that the finger meets certain biometric authentication criteria (eg, the fingerprint matches an enrolled fingerprint). Upon successful authentication, in FIG. 34C, the electronic device 3400 automatically enters the credential information in the user name field 3408 and/or the password field 3410, and submits the credential information for user authentication ( For example, submitting the information without requiring further input from the user). Upon successful user authentication, the electronic device 3400 provides access to restricted content (eg, content that can only be viewed when the user logs in) within the account user interface 3416 of FIG. 34D.

Alternatively, if a determination is made that the finger does not meet predetermined biometric authentication criteria, the electronic device 3400 withholds input and submission of credential information, and as shown in FIG. 3418) is displayed. Failure interface 3418 may be displayed when a user has reached a maximum number of failed biometric authentication attempts. If the maximum number of failed biometric authentication attempts has been reached, the fingerprint sensor 3414 is not available for biometric authentication.

Figure 34F shows a login displayed when biometric authentication using fingerprint sensor 3414 is not available (e.g., when such authentication is disabled through a user-selectable setting or when the maximum number of attempts has been exceeded). The user interface 3404-1 is illustrated. In response to detecting a request to display a login user interface, a determination is made that biometric authentication using fingerprint sensor 3414 is not available. Upon this determination, the electronic device 3400 displays a login user interface 3404-1 without a prompt 3406. The electronic device 3400 displays the submission affordance 3420-1 in its original, unmodified state, where text 3422 ("LOGIN") is displayed within the submission affordance 3420-1.

In some examples, electronic device 3400 does not immediately display prompt 3406 in response to a request to load a login user interface. Instead, the electronic device 3400 displays a prompt 3406 after receiving a selection of a fillable field to enter text. In FIG. 34G, electronic device 3400 initially displays login user interface 3404-1 without prompt 3406. The electronic device 3400 detects a tap gesture 3424 on the password field 3410. In response to detecting the tap gesture 3424, the electronic device 3400, as shown in FIG. 34H, a virtual keyboard 3426 (e.g., a keyboard for entering one or more characters) and a password field 3410. A cursor 3428 is displayed. Additionally, in response to the tap gesture 3424, the electronic device 3400 displays a login user interface 3404 with a prompt 3406 located within the submission affordance 3420.

In FIG. 34I, the electronic device 3400 receives an input corresponding to the input of one or more characters (eg, the character 3430) through the virtual keyboard 3426. In response to receiving the input of text 3430, electronic device 3400 again displays login user interface 3404-1 without prompt 3406. The electronic device 3400 displays the submission affordance 33420-1 in its original, unmodified state, where the text 3422 is displayed within the submission affordance 3422-1.

In FIG. 34J, after receiving input via virtual keyboard 3426, electronic device 3400 detects a tap gesture 3432 on submission affordance 3342-1. In response to detecting the tap gesture 3432, the electronic device 3400 submits one or more characters in the user name field 3408 and password field 3410 for user authentication. Upon successful user authentication, the electronic device 3400 provides access to restricted content (eg, content that can only be viewed when the user is logged in) within the account user interface 3416 of FIG. 34K.

In some examples, successful user authentication via fingerprint authentication (as described in connection with FIGS. 34A-34D) results in certain results (eg, access to restricted applications, webpages, or accounts). In some examples, successful user authentication by typing and submitting credential information (as described in connection with FIGS. 34F-34K) produces the same result (e.g., restricted application, webpage, or access to an account). Cause.

34L illustrates that the prompt 3406 may be displayed at different locations on the login user interface and some elements discussed with respect to interfaces 3404 and 3404-1 may be omitted. In FIG. 34L, in response to detecting a request to display a login user interface and if biometric authentication is available, the electronic device 3400 displays a prompt 3406 in the password field 3410 and a submission affordance (e.g. , 3420, 3420-1) displays a login user interface 3404-2 that is not displayed.

In FIG. 34M, while displaying login user interface 3404-2, electronic device 3400 detects finger 3412 using fingerprint sensor 3414. In response to detecting the finger 3412, a determination is made that the finger meets certain biometric authentication criteria (eg, the fingerprint matches an enrolled fingerprint). Upon successful authentication, the electronic device 3400 automatically submits the credential information for user authentication. Upon successful user authentication, the electronic device 3400 provides access to restricted content (eg, content that can only be viewed when the user logs in).

Alternatively, if a determination is made that the finger does not meet certain biometric authentication criteria (eg, the fingerprint does not match the registered fingerprint), the electronic device 3400 withholds to submit the credential information. Additionally, upon failed biometric authentication, the electronic device 3400 displays a login user interface 3404-1 that includes previously hidden submission affordances (e.g., 3420, 3420-1) (shown in FIG. 34N). do. Additionally, upon failed biometric authentication, electronic device 3400 prompts the user for manual input by displaying a cursor 28 in a fillable field, such as password field 3410.

35 is a flow diagram illustrating a method for demonstrating the availability of biometric authentication using an electronic device, in accordance with some examples. The method 3500 includes a display (e.g., 3402) and one or more biometric sensors (e.g., 3403, 3414) (e.g., a fingerprint sensor, a non-contact biometric sensor (e.g., a thermal or optical facial recognition sensor, such as It is performed in a device (eg, 100, 300, 500, 1700, 3400) with a biometric sensor (not required), an iris scanner). In some examples, one or more biometric sensors (eg, 3403) include one or more cameras. In some examples, the display (eg, 3402) is a touch-sensitive display. In some examples, the display (eg, 3402) is not a touch-sensitive display.

Some operations of method 3500 are selectively combined, the order of some operations is selectively changed, and some operations are selectively omitted. As described below, method 3500 provides an intuitive method for indicating the availability of biometric authentication. This method reduces the user's cognitive burden on determining the availability of biometric authentication, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to more quickly and more efficiently identify the availability of biometric authentication saves power and increases the time between battery charges.

The electronic device (e.g., 100, 300, 500, 1700, 3400) has a credential submission (e.g., login) user interface element (e.g., 3408, 3410) (e.g., a fillable field such as a username or password). Detects a predefined action (e.g., a request to load and/or display a user interface, selection of a specific element of the user interface) corresponding to a credential submission (e.g., login) user interface (e.g., 3404) (3502) .

In response to detecting the predefined action (3504), the electronic device (eg, 100, 300, 500, 1700, 3400) proceeds to blocks 3506 through 3516.

In response to detecting the predefined action (3504) and upon a determination that biometric authentication (e.g., Touch ID, Face ID) via one or more biometric sensors (e.g., 3403, 3414) is available (3506). ), the electronic device (e.g., 100, 300, 500, 1700, 3400) displays, on a display (e.g., 3402), one or more biometric sensors A credential submission (e.g., 3406) with a visual indication (e.g., 3406) that presenting to a field (e.g., 3403, 3414) will cause the credentials to be submitted through a credential submission user interface element (e.g., 3408, 3410). For example, a login) user interface (eg, 3404) is displayed (3508).

In some examples, the credential submission user interface is generated based on an electronic document (eg, an HTML document), and the credential submission user interface element is an input element (eg, a login button) for submitting credentials. In some examples, if biometric authentication is available, the electronic device (e.g., 100, 300, 500, 1700, 3400) places the credential input element in a first state (e.g., default state, biometric authentication is not available). Rather than rendering and displaying as a displayed state when not), a biometric authentication element (e.g., instructions to provide the required biometric authentication input (e.g., fingerprint), instead of a credential submission user interface element). Display. Displaying, to the user, a prompt indicating that placing their fingers on the sensor causes automatic login, provides feedback to the user regarding the current state of the device (e.g., biometric authentication is available), and Provides feedback to users indicating effective options for logging in. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

According to some examples, in response to detecting the predefined action (3504) and upon determining that biometric authentication through one or more biometric sensors (e.g., 3403, 3414) is available (3506), the electronic device (E.g., 100, 300, 500, 1700, 3400) withholds (e.g., does not display a login button) to display the credential submission affordance (e.g., 3420) on the display (e.g., 3402) 3516 . Omitting the display of the login button encourages the user to seek an efficient way to log in, thereby providing improved feedback. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

According to some examples, in response to detecting the predefined action (3504) and upon a determination that biometric authentication through one or more biometric sensors (e.g., 3403, 3414) is not available (3510), the electronic The device (e.g., 100, 300, 500, 1700, 3400) is on a display (e.g., 3402), without displaying a visual indication (e.g., 3406), a credential submission (e.g., login) user interface (e.g. 1) is displayed (3512). Pending the display of the prompt to log in via biometric authentication provides feedback to the user as to the current state of the device, since it indicates to the user that login via biometric authentication is not available. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

According to some examples, further in response to detecting the predefined action (3504) and upon a determination that biometric authentication through one or more biometric sensors (e.g., 3403, 3414) is not available (3510). ), an electronic device (e.g., 100, 300, 500, 1700, 3400) may have a credential submission affordance (e.g., 3420) on a display (e.g., 3402) (e.g., a touch activated Login button) is displayed (3514). Receiving an input (e.g., 3432) corresponding to the selection of a credential submission affordance (e.g., 3420) allows the credentials to be submitted via a credential submission user interface element (e.g., 3408, 3410) (e.g. , Allows credentials to be submitted without using biometric authentication).

According to some examples, while displaying a credential submission user interface (e.g., 3404), the electronic device (e.g., 100, 300, 500, 1700, 3400) may include one or more biometric sensors (e.g., 3403, 3414). Via, each type of biometric feature (eg, 3412) is detected. In response to detecting each type of biometric feature (e.g., 3412), and upon determining that the biometric feature (e.g., 3412) meets the biometric authentication criteria, the electronic device (e.g., 100, 300) , 500, 1700, 3400 submit credentials via a credential submission user interface element (eg, 3408, 3410) (eg, successful authentication results in submitting credentials). In response to detecting each type of biometric feature (e.g., 3412), and upon a determination that the biometric feature (e.g., 3412) does not meet the biometric authentication criteria, the electronic device (e.g., 100, 300, 500, 1700, 3400 hold submitting credentials via a credential submission user interface element (eg, 3408, 3410). Withholding the submission of credentials based on not meeting biometric authentication criteria provides security and may prevent unauthorized users from initiating sensitive actions. Providing improved security improves the operability of the device (e.g., by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the power of the device by limiting the performance of restricted operations. Reduces usage and improves battery life.

According to some examples, a credential submission user interface element (eg, 3408, 3410) includes one or more fillable fields.

According to some examples, displaying the credential submission user interface (e.g., 3404, 3404-1, 3404-2) may be performed with credentials to be submitted via the credential submission user interface element (e.g. And displaying the filled (eg, pre-populated with a default user name) credential submission user interface element. Pre-populating the default username gives the user the ability to log in using fewer inputs. Performing an operation with a reduced number of inputs improves the operability of the device and improves the user- It makes the device interface more efficient, which in addition reduces the power usage of the device and improves battery life by allowing the user to use the device more quickly and efficiently.

According to some examples, the electronic device (eg, 100, 300, 500, 1700, 3400) receives a selection of a fillable field (eg, 3408, 3410) of one or more fillable fields. In response to receiving the selection of the fillable field, the electronic device (e.g., 100, 300, 500, 1700, 3400) displays a character input interface (e.g. 3426) (e.g. A keypad or keyboard including character input keys for entering a code) is displayed.

According to some examples, the electronic device (e.g., 100, 300, 500, 1700, 3400) can input one or more characters (e.g., via character entry keys) through a character input interface (e.g. 3426) in a fillable field. An input corresponding to (eg, 3430) is received. In some examples, the text entry interface includes text entry keys. Following receiving the input, the electronic device (eg, 100, 300, 500, 1700, 3400) receives a selection of a second credential submission affordance (eg, 3420) (eg, a login button). In response to receiving the selection of the second credential submission affordance, the electronic device (e.g., 100, 300, 500, 1700, 3400) displays one or more characters in the fillable field (e.g., 3408, 3410) for credential verification. Submit them.

According to some examples, presenting a biometric feature (e.g., 3412) that meets the biometric authentication criteria to one or more biometric sensors (e.g., 3403, 3414) allows credentials to be submitted to the credential submission user interface. A visual indication (e.g., 3406) that will be submitted via an element (e.g., 3408, 3410) is a fillable field (e.g., 3410) of one or more fillable fields (e.g., username field, password field). Is displayed on. Displaying, to the user, a prompt indicating that placing their fingers on the sensor causes automatic login, provides feedback to the user regarding the current state of the device (e.g., biometric authentication is available), and Provides feedback to users indicating effective options for logging in. Displaying a prompt in the password field can provide feedback on an action to be performed upon successful authentication (eg, automatically filling in the password field). Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

According to some examples, the predefined action is to display a credential submission interface (e.g., 3404, 3404-1, 3404-2) on a display (e.g., 3402) (e.g., load a credential submission user interface). , To scroll the credential submission user interface into the view, to zoom in the credential submission user interface, to reveal the credential submission user interface from hidden user interface elements). In some examples, the predefined action, which is a request to display the credential submission interface, also includes a first portion of each content, as described with respect to method 3300 (e.g., at 3302 of method 3300). Is a request to display.

According to some examples, a predefined action is detected while displaying a credential submission interface (e.g., 3404, 3404-1), and the predefined action is an input to a portion of the credential submission user interface (e.g., 3424). (Eg, user input on a credential submission user interface (eg, a tab) or user input on a fillable field such as a username field or a password field).

According to some examples, in response to submission of one or more characters to a fillable field (e.g., 3408, 3410) for credential verification and in response to receiving a selection of a second credential submission affordance (e.g., 3420), the electronic The device (eg 100, 300, 500, 1700, 3400) provides the first result. A biometric feature (e.g., 3412) that is detected upon submission of credentials via a credential submission user interface element (e.g. 3408, 3410) and via one or more biometric sensors (e.g. 3403, 3414) In response to determining that the measurement authentication criteria are met, the electronic device (eg, 100, 300, 500, 1700, 3400) provides a first result. In some examples, submitting (e.g., successfully submitting) credentials (e.g., valid credentials) via a password or passcode entered through a credential submission user interface element may result in biometric authentication. This results in the same result as a successful authentication via (eg, restricted application, webpage, or access to an account).

It is noted that the details of the processes described above with respect to method 3500 (eg, FIG. 33) are also applicable in a similar manner to the methods described below and above. For example, method 3500 may optionally include characteristics of various methods described above with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700, 2900, 3100, 3300. Contains one or more of. For example, registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with method 3500. As a further example, the re-authentication criteria of method 3100 may be used in conjunction with method 3500 to control when biometrics are available. For brevity, these details are not repeated below.

In some examples (e.g., in some examples of methods 1600, 1800, 2000, 2200, 2900, 3100, 3300, 3500), the electronic device makes brute force attempts that ignore security. Of biometric authentication attempts that can be made before biometric authentication is disabled (e.g., disabled until successful authentication occurs through alternative means) to provide improved security by preventing and conserving device resources. Limit the number allowed. In some such examples, stopping the use of the biometric sensor (e.g., pending further biometric authentication retries) before the allowed/limited number of attempts have been exhausted may result in the user having repeated requests (e.g. , Requests for other actions that require biometric authentication (e.g., requests for other more important actions), thereby avoiding consuming the allowed number of attempts upon repeated requests of the same type). Preserve at least one attempt for Preserving at least one attempt improves the operability of the device (e.g. by avoiding exhaustion of authentication attempts for repeated similar requests) and makes the user-device interface more efficient, which additionally allows the user to It reduces the power usage of the device and improves battery life by making it possible to use the device more quickly and efficiently. Additionally, preserving at least one biometric authentication attempt can reduce the cases in which the user has to provide an alternative non-biometric authentication (e.g., such as password or passcode authentication), which in turn, It may facilitate the use of more secure (e.g., more complex) passwords/passcodes, which allows the user to frequently use such passwords/passcodes when biometric authentication is disabled due to exhaustion of allowed attempts. This is because it is not frustrating to use more secure passwords/passcodes by necessity. Promoting the use of more secure passwords/passcodes improves the operability of the device by reducing the risk of unauthorized access.

36A-36L illustrate example user interfaces for retrying biometric authentication in a credential input user interface, in accordance with some examples. The user interfaces of these figures are used to illustrate the processes described below, including those of Figs. 37A and 37B.

36A illustrates an electronic device 3600 (eg, portable multifunction device 100, device 300, device 500). In the example examples illustrated in FIGS. 36A-36L, the electronic device 3600 is a smartphone. In other examples, electronic device 3600 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 3600 includes a display 3602, one or more input devices (eg, a touchscreen of the display 3002, a button 3604, and a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 36A, the electronic device includes a biometric sensor 3603. In some examples, the biometric sensor is one or more biometric sensors, which may include a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 3603 is biometric sensor 703. In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 36A, electronic device 3600 displays a locked state user interface (UI) 3606 including a lock icon 3608 that provides an indication to the user that the electronic device 3600 is in a locked state. Because electronic device 3600 is in a locked state, the user cannot see the restricted content of notification 3610A (eg, a message from John Appleseed).

In Figure 36B, the user wants to unlock the electronic device 3600 to access restricted content on the device (e.g., a message from John Appleseed, home screen 3628 in Figure 36L, the most recently used application). . Unlocking the device requires successful authentication of the user. To request the device to be unlocked, the user performs an upward swipe starting from within area 3612A, a predefined area adjacent to the lower edge of the display 3602.

While displaying the locked state UI 3606, the electronic device 3600 receives an input 3614A (eg, an upward swipe). While displaying the locked state UI 3606, the electronic device 3600 requests an upward swipe to start from within area 3612A to trigger a request to unlock the device. In response to receiving input 3614A, electronic device 3600 determines whether input 3614A starts from within area 3612A.

Upon detecting input 3614A (e.g., input starting within area 3612A), electronic device 3600 initiates biometric authentication and whether biometric authentication is currently enabled (or using) on the device. Is available for use). Biometric authentication may be unavailable for a variety of reasons, including, for example, that biometric authentication has failed more than a predetermined number of times (e.g., 5, 10, 15) since the last successful authentication by the device. have.

In some examples, instead of receiving the input 3614A, the electronic device 3600 receives any one of the inputs 3614B-3614E (e.g., swipe inputs moving a similar distance to the input 3614A). Receive. Like input 3614A, each of inputs 3614B-3614E is an upward swipe. In some examples, because input 3614B also begins within region 3614A, electronic device 3600 treats input 3614A and input 3614B as the same (e.g., electronic device 3600 has two Have the same response for the inputs). In contrast, in some examples, the response of the electronic device 3600 to the inputs 3614C-3614E is different than the response to the inputs 3614A, 3614B. Specifically, in some examples, in response to receiving any one of inputs 3614C-3614E, electronic device 3600 does not initiate biometric authentication, as described below with respect to FIG. 36C. Does not. Instead, the electronic device 3600, as shown in FIG. 36K (e.g., by scrolling a portion of the wake screen user interface (e.g., 3606) to display one or more notifications that were not previously seen on the display-where Display one or more notifications (eg, 3610A-3610E) (eg, unread notifications) while keeping the device locked (the amount of scrolling is optionally determined based on the speed or magnitude of the movement of the contact).

In Figure 36C, in response to input 3614 and upon determining that biometric authentication is currently enabled, electronic device 3600 attempts to biometrically authenticate the user (e.g., using biometric sensor 3603). Then, it attempts to match the acquired information on the user's face with the stored authorized credentials). While attempting to biometrically authenticate the user, the electronic device 3600 displays an implantable interface 3616 with an authentication glyph 3618 (e.g., replacing the display of the locked UI 3606 with it). An authentication glyph 3618 comprising a plurality of rings rotating about an axis parallel to the display to appear to rotate off the z axis of the device provides an indication to the user that biometric authentication is being performed.

While attempting to biometrically authenticate the user, the electronic device 3600 uses the biometric sensor 3603 to determine whether certain biometric authentication criteria have been met. More specifically, electronic device 3600 captures and processes (e.g., analyzes) biometric data from biometric sensor 3603 so that, based on the biometric data, biometric features (or portions thereof) are Determine whether the biometric authentication criteria are satisfied (eg, determine whether the biometric data matches, within a threshold, a biometric template (eg, stored authorized credentials)). After initiating biometric authentication, electronic device 3600 determines that biometric authentication has failed (eg, biometric data from biometric sensor 3603 does not match the stored authorized credentials).

In FIG. 36D, upon determining that the biometric authentication has failed, the electronic device 3600 displays an animation of the lock icon 3608 alternating between different locations to simulate a “shake” effect. This “shake” animation provides an indication to the user that the electronic device 3600 was unable to biometrically authenticate the user.

In addition, as shown in FIG. 36E, in response to determining that the biometric authentication has failed, the electronic device 3600 displays a passcode input UI 3620 (e.g., displays a display of the embedded interface 3616). Replaced by it), which provides an alternative (eg, non-biometric) method of authenticating a user at electronic device 3600. The passcode input UI 3620 includes a lock icon 3608 and a plurality of input keys for entering (or writing) a password or a passcode. Passcode input UI 3620 also prompts the user to swipe up to retry biometric authentication or to enter a passcode (or password) to authenticate the user (e.g., non-biometrically). And a prompt 3622A. Electronic device 3600 displays a prompt 3622A upon determining that biometric authentication is currently enabled on the device. Additionally, upon determining that biometric authentication is currently enabled, electronic device 3600 displays an unlock indication 3624, which allows the user to initiate an upward swipe to retry biometric authentication. 3602) provides an indication of the approximate location of the image.

In Fig. 36E, the user attempts to retry biometric authentication rather than entering a password or passcode to authenticate. While displaying the passcode input UI 3620, the electronic device 3600 receives an input 3614C, starting outside the area 3612A of FIG. 36B. Nonetheless, input 3614C triggers a retry of biometric authentication because input 3614C originates from within area 3612B. In particular, area 3612B is larger than area 3612A, which means that parameters for where the upward swipe should start to initiate biometric authentication are compared to the locked state UI 3606 and the passcode input UI 3620 ) Because it is alleviated.

In some examples, instead of receiving input 3614C, the electronic device receives any one of inputs 3614A, 3614B, 3614D, 3614E. In some examples, taking into account the relaxed parameters for passcode input UI 3620, everyone other than input 3614E will trigger biometric authentication to retry. In some examples, in response to receiving input 3614E, electronic device 3600 determines that input 3614E does not start from within area 3612B, and in response, does not retry biometric authentication. .

In FIG. 36F, in response to receiving input 3614C, electronic device 3600 determines that input 3614 starts from within area 3612B. Upon determining that input 3614 starts from within area 3612B, electronic device 3600 retries biometric authentication. While retrying biometric authentication, electronic device 3600 displays authentication glyph 3618 (eg, replacing the display of lock icon 3608 with it). Authentication glyph 3618 provides an indication to the user that biometric authentication is being performed.

While retrying the biometric authentication, the electronic device 3600 determines that the biometric authentication is successful (e.g., the biometric data obtained using the biometric sensor 3603 is matched to the stored authorized credentials. ).

In FIGS. 36G and 36H, upon determining that the biometric authentication is successful, the electronic device 3600 transitions from the locked state to the unlocked state. Electronic device 3600 provides an indication of this transition by displaying an animation of lock icon 3608 transitioning to unlock icon 3626 in FIG. 36H, which transitions electronic device 3600 to an unlocked state. Provide an indication that you did. Additionally, upon determining that the biometric authentication is successful and after displaying the unlock icon 3626, the electronic device 3600 provides access to the restricted content. For example, the electronic device 3600 may be configured with the home screen 3628 of FIG. Displays.

In some examples, instead of determining that the biometric authentication failed in FIG. 36C, the electronic device 3600 determines that the biometric authentication was successful. In some examples, upon determining that the biometric authentication is successful, the electronic device 3600 transitions to the unlocked state and displays an unlock icon 3626, as described above with respect to FIGS. 36G and 36H. . Additionally, in some examples, upon determining that the biometric authentication was successful and after displaying the unlock icon of FIG. 36H, the electronic device 3600 displays the home screen 3628. (Home screen 3628 may include some or all of the features of home screen interface 2614 of FIG. 26D.) In some examples, upon determining that biometric authentication is successful and unlock icon 3626 After displaying, electronic device 3600 displays the most recently used application (eg, messaging application interface 2616 in FIG. 26G ).

In some examples, instead of determining that biometric authentication is enabled on the device as described above with respect to FIGS. 36B and 36C, the electronic device 3600 (e.g., biometric authentication is (manually) by the user). It is determined that biometric authentication is not currently enabled because it has been disabled or because a predetermined biometric authentication has been attempted without success. In some examples, upon determining that biometric authentication is not currently enabled, electronic device 3600 displays prompt 3622B of FIG. 36I instead of prompt 3622A of FIG. 36E. In contrast to prompt 3622A, prompt 3622B only prompts the user to enter a passcode (or password) to authenticate the user without prompting the user to swipe to retry biometric authentication. do. Additionally, in some examples, upon determining that biometric authentication is not currently enabled, the electronic device 3600 does not display the unlock indication 3624, as shown in FIG. 36I. As described above, unlock indication 3624 provides an indication of the approximate location on display 3602 from which the user can initiate an upward swipe to retry biometric authentication. In some examples, the electronic device 3600 does not display an unlock indication 3624 because biometric authentication is currently not enabled.

In some examples, instead of determining that the biometric authentication was successful in FIG. 36F, the electronic device 3600 determines that the biometric authentication failed. In some examples, upon determining that the biometric authentication has failed, the electronic device 3600 (instead of displaying a transition to the unlocked state as described above with respect to FIGS. 36G and 36H) has a “shake” effect. Display an animation of the lock icon 3608 alternating between different locations to simulate. As described above, this “shake” animation provides the user with an indication that the electronic device 3600 was unable to biometrically authenticate the user.

37A and 37B are flow charts illustrating a method for retrying biometric authentication in a credential input user interface using an electronic device, in accordance with some examples. The method 3700 includes a touch-sensitive display (e.g., 3602) and one or more biometric sensors (e.g., 3603) (e.g., a first biometric sensor of a device having a plurality of biometric sensors) (e.g. It is performed in an electronic device (e.g., 100, 300, 500, 3600) with a non-contact biometric sensor (e.g., a biometric sensor that does not require physical contact, such as a thermal or optical facial recognition sensor), an iris scanner. In some examples, the one or more biometric sensors include one or more cameras. Some operations of method 3700 are selectively combined, the order of some operations are selectively changed, and some operations are selectively omitted.

As described below, method 3700 provides an intuitive method for retrying biometric authentication in a credential input user interface using an electronic device. This method reduces the user's cognitive burden for retrying biometric authentication, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, allowing a user to retry biometric authentication faster and more efficiently saves power and increases the time between battery charges.

The electronic device (e.g., 100, 300, 500, 3600) is, on a touch-sensitive display (e.g., 3602), a credential input (e.g., passcode, password, pattern) user interface ( For example, 3620 is displayed (3706). In some examples, the credential input user interface includes a virtual keypad or virtual keyboard. In some examples, the virtual keypad or virtual keyboard includes a plurality of character entry keys. In some examples, while displaying a credential input user interface (eg, 3620), the electronic device receives input corresponding to one or more of the plurality of character input keys. In some examples, in response to receiving (or subsequent to) an input corresponding to the plurality of character input keys, the electronic device corresponds to credentials (e.g., a stored passcode or password) to which the received input is authorized. Upon a determination to do (or match), a transition from a locked state (e.g., corresponding to 3606) to an unlocked state (e.g., corresponding to 3628).

While displaying the credential input user interface (e.g., 3620), the electronic device, via the touch-sensitive display (e.g., 3602), includes a touch gesture input (e.g., 3614A, 3614B) (e.g., a swipe at a predefined location) is received (3708).

In response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display (3712) and upon a determination that one or more criteria of the first set are met-the one or more criteria of the first set are biometric authentication. Including the requirement to be currently enabled on this electronic device—the electronic device attempts 3714 to biometrically authenticate the user of the electronic device based on the biometric information captured using one or more biometric sensors. In some examples, the one or more criteria in the first set include only one criterion. In some examples, biometric authentication may become unavailable (or may not be enabled on the electronic device) when one or more of the following conditions are met: The electronic device is successfully turned on or restarted. Not certified; The electronic device has not been unlocked for more than a predetermined time (eg, 48 hours); The passcode was not used to unlock the device for more than a predetermined time (eg, 156 hours); Biometric authentication using biometric features (eg, face, fingerprint) was not used to unlock the device for more than a predetermined time (eg, 4 hours); The electronic device has received a remote lock command; Biometric authentication has failed more than a predetermined number of times (eg, 5, 10, 15) since the last successful authentication by the device; And the electronic device has received a power off and/or emergency SOS command. In some examples, the touch gesture input is a request to unlock the electronic device 3600. Providing the user with the ability to retry biometric authentication by performing a touch gesture input in the credential input user interface is the operability of the device by providing additional control of the device without confusing the UI with additional displayed controls. Improves. Providing this capability improves the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate inputs when operating and/or interacting with the device and reducing user mistakes). This additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, in response to receiving a touch gesture input comprising movement of a contact on a touch-sensitive display (3712) and (e.g., because biometric authentication is not currently enabled on the device) one or more of the first set Upon determining that the criteria are not met, the electronic device withholds attempting to biometrically authenticate the user of the electronic device based on the biometric information captured using one or more biometric sensors (e.g., 3603). 3716). Withholding attempting to biometrically authenticate the user when biometric authentication is not enabled improves the security of the device by preventing unauthorized use of the device.

In some examples, displaying a credential input user interface (e.g., 3620) includes a request to perform an operation that requires authentication (e.g., a request to unlock the electronic device (e.g., 3614A, 3614B) (e.g., A swipe starting from an edge (e.g., a lower edge) or starting from within a predefined area (e.g., a lower portion) of the display), and biometric information captured using one or more biometric sensors. In response to failing to biometrically authenticate the user of the electronic device based on (3702 ). In some examples, the electronic device (e.g., 100, 300, 500, 3600) has the biometric information captured using one or more biometric sensors with authorized credentials (e.g., authorized for use in biometric authentication). Biometric authentication of the user of the electronic device fails when it does not correspond to (or does not match) the stored information about the biometric features (eg, face, fingerprint). Displaying the credential input user interface when the set of conditions is met provides the user with the ability to authenticate through an alternative method without requiring the user to explicitly request that the credential input user interface be displayed. Performing an action when a set of conditions is met without requiring additional user input (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) the device It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the request to perform an operation that requires authentication (e.g., 3614A, 3614B) is a second touch gesture input (e.g., edge (e.g., lower edge) of the display) that includes movement of the contact on the touch-sensitive display. Or a swipe starting from within a predefined area (eg, 3612A) (eg, lower portion) of the display (3704). In some examples, the set of one or more criteria is such that the touch gesture input begins in a first area of the display (eg, 3612A) (eg, an area along the lower edge of the display) and a second area of the display (eg, Includes a requirement to end in (or go through) the area along the lower edge (eg, the area above 3612A).

In some examples, upon determining that one or more criteria of the second set are met-the one or more criteria of the second set include a requirement that biometric authentication is currently enabled on the electronic device -, a credential input user interface ( For example, displaying the 3620 may include, on the touch-sensitive display (e.g., 3602), an indication to perform a gesture on the touch-sensitive display (e.g., 3622A) to attempt to biometrically authenticate the user (e.g., text , Graphics, icons). In some examples, upon determining that one or more criteria in the second set are not met, the electronic device withholds displaying an indication to perform a gesture on the touch-sensitive display to attempt to biometrically authenticate the user. In some examples, the one or more criteria in the second set are the same as the one or more criteria in the first set. In some examples, the second set of one or more criteria includes only one criterion. Displaying an indication to perform a gesture when biometric authentication is available provides feedback to the user about the current state of the device (e.g., biometric authentication is available) and prompts the user to perform a gesture associated with the indication. Prompt. In addition, not displaying an indication to perform a gesture when biometric authentication is not available also provides feedback to the user about the current state of the device (eg, biometric authentication is not available). Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, upon a determination that a third set of one or more criteria are met-the third set of one or more criteria includes a requirement that biometric authentication is currently enabled on the electronic device -, a credential input user interface ( For example, displaying 3620 may include, on a touch-sensitive display (e.g., 3602), a user interface element (e.g., 3624) (e.g., a graphic element) adjacent to the edge of the touch-sensitive display (e.g. , A horizontal bar, home affordance, an indication of where the user should swipe to attempt biometric authentication). In some examples, the third set of one or more criteria is the same as the first set of one or more criteria. In some examples, the third set of one or more criteria includes only one criterion. In some examples, upon a determination that the third set of one or more criteria are not met, the electronic device (eg, 100, 300, 500, 3600) withholds displaying the user interface element. In some examples, the set of one or more criteria is such that the touch gesture input begins in a first area of the display (eg, 3612A) (eg, an area along the lower edge of the display) and a second area of the display (eg, It includes the requirement to end at (or go through) the area above the area along the lower edge. In some examples, the user interface element (eg, 3624) is displayed at a location corresponding to (eg, within) the first area of the display. Displaying a user interface element proximate the edge of the display when biometric authentication is available provides feedback to the user about the current state of the device and how the user can request unlocking of the device. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, while attempting to biometrically authenticate a user of the electronic device based on the biometric information captured using one or more biometric sensors, the electronic device (e.g., 100, 300, 500, 3600) Display, on the responsive display, an animation (e.g., 3618) with one or more moving elements indicating that biometric authentication is taking place (e.g., an animation (e.g., a graphic icon) including one or more rings moving on the display) Displays). In some examples, the animation provides an indication that biometric information is being processed. In some examples, the animation includes rings that rotate around an object (eg, a sphere). In some examples, the sphere is visible. In some examples, the sphere is not visible. Displaying one or more moving elements indicating that biometric authentication is taking place can provide feedback to the user about the current state of the device (e.g., biometric authentication is being performed) and that the user does not need to take any action at this time. Provides. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, displaying an animation with one or more moving elements includes transitioning from an animation with one or more moving elements to a lock icon (eg, 3608) (eg, an icon representing a locked state). In some examples, after transitioning from an animation with one or more moving elements (e.g., 3618) to a lock icon and using one or more biometric sensors, the biometric information captured is applied to the credentials (e.g., biometric authentication). Upon determining that it corresponds to (eg, matches) the biometric feature (eg, stored information about the biometric feature (eg, face, fingerprint)) that is applied for use, the electronic device transitions from the locked state to the unlocked state. In some examples, transitioning the electronic device from a locked state to an unlocked state includes displaying an animation of a lock icon transitioning to an unlock icon (e.g., 3626) (e.g., an icon representing an unlocked state). do. In some examples, after transitioning from an animation with one or more moving elements to a lock icon and using one or more biometric sensors to determine that the biometric information captured does not correspond to the applied credentials (e.g., does not match). Accordingly, the electronic device displays, on the touch-sensitive display (e.g., 3602), an animation with a lock icon (e.g., 3608) that alternates between the first position and the second position, the second position being the first position It is different from. In some examples, an animation with a lock icon is an animation of a lock icon that shakes (eg, rotates left and right, back and forth). In some examples, the electronic device displays an animation accompanying a lock icon to indicate that the biometric authentication has failed. In some examples, a tactile output is provided in combination with a shaking lock icon. In some examples, no tactile output is provided. In some examples, upon determining that the biometric information captured using one or more biometric sensors does not correspond or does not match the authorization credentials, the electronic device (e.g., 100, 300, 500, 3600) Remain locked. Displaying the animation of the lock icon transitioning to the unlock icon tells the user to the current state of the device (e.g., biometric authentication was successful, the device was unlocked, the user can now access restricted content). Provide feedback on In addition, displaying the animation of the shaking lock icon provides feedback to the user as to the current state of the device (eg, biometric authentication has failed) and prompts the user to take further action. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, a touch gesture input, including movement of a contact on a touch-sensitive display, starts from a location that is remote (e.g., not substantially near) the edge of the touch-sensitive display (e.g., the lower edge of the display). Do (3710). In some examples, a location further from the edge of the touch-sensitive display (eg, 3602) includes a location closer to the center of the display than the edge. In some examples, a location that is far from the edge of the touch-sensitive display includes a location that exceeds a threshold distance from the edge of the display (or is outside a predefined area (eg, 3612A)). In some examples, the threshold distance (or predefined area) is used on the wake screen to determine whether to release the wake screen when the swipe input starts less than the threshold distance away from the edge of the display. In some examples, the threshold distance (or predefined area (e.g., 3612A)) starts when the swipe input exceeds the threshold distance away from the edge of the display (or out of the predefined area (e.g., 3612A)). Used to perform different actions on the wake screen, such as scrolling through content on the wake screen (eg 3610A-3610E). In some examples, parameters for where touch gesture input should begin are relaxed for a credential input user interface (eg, 3620). Relaxing the parameters in the credential input user interface for where the touch gesture input should start improves the operability of the device by causing less precise gestures to initiate biometric authentication. The parameters are mitigated because the user has already conveyed the desire to initiate biometric authentication. As a result, in the credential input user interface, there is little risk that the user will not intend to initiate biometric authentication. Having a less precise gesture initiate biometric authentication after the user has already communicated the desire to initiate biometric authentication, which improves the operability of the device and makes the user-device interface more efficient, which in addition, limited operation. By limiting their performance, the device's power usage is reduced and battery life is improved.

In some examples, in response to receiving a touch gesture input (e.g., 3614C-3614E) including movement of a contact on the touch-sensitive display starting from a location remote from the edge of the touch-sensitive display and one or more biometric sensors. That the biometric information captured using them corresponds to (e.g., matches) the authorized credentials (e.g., stored information about a biometric feature (e.g., face, fingerprint) that is applied for use in biometric authentication). ), the electronic device transitions from the locked state to the unlocked state (3718). In some examples, transitioning the electronic device to the unlocked state includes an unlocked user interface (e.g., a home screen (e.g., 3628) or a user interface representing an unlocked state, such as the most recently used application). It includes displaying.

In some examples, prior to displaying the credential input user interface, the electronic device (e.g., 100, 300, 500, 3600) is a lock user interface (e.g., 3606) on the touch-sensitive display (e.g., 3602) (e.g., Display the user interface, wake screen, lock screen) indicating the locked state of the electronic device. In some examples, the lockout user interface is different from the credential input user interface (eg, 3620). In some examples, while displaying the locked user interface, the electronic device receives, via a touch-sensitive display (e.g., 3602), a touch gesture input (e.g., 3614A, 3614B) (e.g., upward swipe) with a starting position. do. In response to receiving a touch gesture input having a starting position and upon determining that one or more of the criteria of the fourth set are met-the one or more criteria of the fourth set of which the starting position of the touch gesture input is substantially the touch-sensitive display Includes the requirement to be located near the edge of (e.g., within a predefined area (e.g., 3612A), within a predefined distance from the edge; a location closer to the edge than the center of the display) of Start. In some examples, the fourth set of one or more criteria includes only one criterion. In some examples, initiating biometric authentication includes attempting to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors. In some examples, in response to receiving a touch gesture input having a starting position and upon determining that one or more criteria of the fourth set are not met, the electronic device withholds initiating biometric authentication.

It is noted that the details of the processes described above with respect to method 3700 (eg, FIGS. 37A and 37B) are also applicable in a similar manner to the methods described below. For example, method 3900, method 4100, and/or method 4300 optionally include one or more of the features of the various methods described above with respect to method 3700. For example, processes for retrying biometric authentication, as described above with respect to method 3700, may require biometric authentication to authorize payment of a product, as described with respect to method 4100 Can be used to retry. Similarly, a process for retrying biometric authentication may be used to retry biometric authentication in the processes described in connection with method 3900. For brevity, these details are not repeated below.

38A-38A illustrate example user interfaces for providing indications of error conditions during biometric authentication, according to some examples. The user interfaces of these figures are used to illustrate the processes described below, including those of Figures 39A and 39B.

38A illustrates an electronic device 3800 (eg, portable multifunction device 100, device 300, device 500). In the example examples illustrated in FIGS. 38A-38A, the electronic device 3800 is a smartphone. In other examples, electronic device 3600 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 3600 includes a display 3802, one or more input devices (eg, a touchscreen of the display 3802, a button 3804, and a microphone), and a wireless communications radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 38A, the electronic device includes a biometric sensor 3803. In some examples, the biometric sensor is one or more biometric sensors, which may include a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 3803 is biometric sensor 703. In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In Fig. 38A, the user knows from notification 3808 that she has received a message from John Appleseed. The user wants to view the restricted content of the notification 3808 (eg, a message from John Appleseed), but cannot do so because the electronic device 3800 is currently locked. The electronic device 3800 displays a locked state user interface (UI) with a lock icon 3806 that provides an indication that the electronic device 3800 is in a locked state. Viewing the restricted content of notification 3808 indicates that a successful authentication (e.g., information (or data) about a biometric feature obtained using biometric sensor 3803 corresponds to (or matches) the stored authorized credentials. To decide). To view the restricted content of notification 3808, the user lifts (or raises) the electronic device 3800 (eg, from a substantially horizontal orientation to the orientation of the device, as shown in the user's hand in FIG. 38A). The electronic device 3800 detects a change in the orientation of the electronic device 3800 and, in response, initiates biometric authentication. In some examples, after initiating biometric authentication, electronic device 3800 determines that the biometric authentication is successful. In some examples, upon determining that the biometric authentication is successful, the electronic device 3800 transitions from a locked state to an unlocked state, and displays the restricted content of the notification 3808.

After initiating biometric authentication (eg, prior to successful authentication), electronic device 3800 determines whether a face is detected by biometric sensor 3803. In FIG. 38B, upon determining that a face is detected, the electronic device 3803 displays an authentication glyph 3810, including a plurality of rings rotating in a sphere. Authentication glyph 3810 provides an indication that biometric authentication is being performed. In some examples, electronic device 3800 displays an animation of lock icon 3806 morphing into authentication glyph 3810. In some examples, upon determining that no face is detected using biometric sensor 3803, electronic device 3803 remains locked and does not display authentication glyph 3810.

After detecting the presence of the face, the electronic device 3800 determines that authentication has not been successful due to failure to obtain sufficient information about the user's face using the biometric sensor 3803. Specifically, as shown by FIG. 38B, the biometric sensor 3803 is positioned outside the allowable distance range 3812 (eg, exceeding the maximum threshold range) to obtain sufficient information about the user's face. Cause failure. Upon determining that the biometric authentication was unsuccessful due to the user's face being outside the acceptable distance range 3812, the electronic device 3800 keeps the device locked and does not display the restricted content of the notification 3808. Does not. In some examples, the electronic device 3800, upon determining that authentication is not successful and an error condition does not exist, keeps the device locked and does not display the restricted content of notification 3808. In some examples, the authentication is not successful and the error condition does not exist (e.g., because the captured biometric information does not match the applied biometric information profile (e.g., stored authorized credentials)). There are no conditions that prevent the capture of sufficient biometric information) upon determination, the electronic device 3800 remains locked and automatically retries biometric authentication. In some examples, while retrying biometric authentication, electronic device 3800 continues to display authentication glyph 3810 in FIG. 38B.

38C-38G, upon determining that the biometric authentication was not successful due to the user's face being outside the allowable distance range 3812, the electronic device 3800 displays an error indication 3814A. Displays an animation of the authentication glyph 3810 that is morphed into an error indication 3814A to replace the display of the authentication glyph 3810. In FIG. 38G, electronic device 3800 displays an error indication 3814A, which prompts the user to take action to correct the error condition that underlies the error indication 3814A. Specifically, the error indication 3814A prompts the user to move her face closer to the biometric sensor 3803. The error indication 3814A also suggests to the user that the user's face, which is the cause of the error indication 3814A, is too far away from the biometric sensor 3803. As long as the user's face is outside the acceptable distance range 3812, the electronic device 3800 will continue to determine that an error indication 3814A exists. Upon determining that the error indication 3814A still exists, the electronic device 3800 does not attempt to retry the biometric authentication. Note that the electronic device 3800 displays an error indication 3814A at a location that matches the location of the lock icon 3806 in FIG. 38A. Additionally, the electronic device 3800 may be configured with a portion of the display 3802 adjacent to the biometric sensor 3803 to suggest to the user that the error indication 3814A is associated with (or corresponds to) the biometric sensor 3803. The error indication 3814A is displayed on the image.

38H, after being prompted to correct the error indication 3814A, the user moves her face closer to the biometric sensor 3803 so that the user's face is within the acceptable distance range 3812. . In Figure 38H, the electronic device determines that the error indication 3814A no longer exists. Upon determining that the error indication 3814A no longer exists, the electronic device 3800 enables biometric authentication on the device and automatically retry biometric authentication using the biometric sensor 3803.

In response to automatically retrying the biometric authentication, the electronic device 3800 causes a shimmer effect (e.g., an error) to indicate that the electronic device 3800 is attempting to biometrically authenticate the user again. Displaying an error indication 3814A with one or more portions of the indication moving left or right to animate the error indication to produce an effect that the error indication appears to flash. 38H-38L show an animation of an error indication 3814A having a shimmer effect. In some examples, instead of displaying an error indication 3814A with a shimmer effect, the electronic device 3800 uses an authentication glyph to indicate that the electronic device 3800 is attempting to biometrically authenticate the user again. 3810) (e.g., replacing the display of error indication 3814A with it). Thus, in some examples, electronic device 3800 displays an animation of authentication glyph 3814A morphed into lock icon 3806 instead of error indication 3814A morphed into lock icon 3806.

In Figure 38L, after retrying biometric authentication, the electronic device 3800 successfully biometrically authenticates the user. In response to successful biometric authentication, the electronic device 3800 transitions the device from the locked state to the unlocked state. During the transition from the locked state to the unlocked state, the electronic device 3800 displays an animation of an error indication 3814A that is morphed into a lock icon 3806, as shown in FIGS. 38L-38N. After displaying the animation of the error indication 3814A morphed into the lock icon 3806, the electronic device 3800 causes the lock icon 3806 to transition to the unlock icon 3816, as shown in FIGS. 38N and 38O. ) To display the animation. The unlock icon 3816 provides an indication that the electronic device 3800 is in an unlocked state. Additionally, as shown in FIG. 38O, the electronic device 3800 displays the restricted content of the notification 3808 (eg, “Hey, is our meeting still on?”) in response to the biometric authentication being successful.

In FIG. 38P, instead of determining that the user's face is outside the acceptable distance range 3812 as discussed above with respect to FIG. 38B, the electronic device 3800 determines that biometric authentication is not available on the device. . Upon determining that biometric authentication is not available, electronic device 3800 displays an error indication 3814B in FIG. 38P, which provides an indication that biometric authentication is not currently available on the device. Biometric authentication may be unavailable for a variety of reasons, including that biometric authentication has failed more than a predefined number of times (eg, 5, 10, 15) since the last successful authentication.

Because biometric authentication is not available, the user must use an alternative method to authenticate the user. For example, the user may authenticate by entering a passcode on the electronic device 3800. While displaying the error indication 3814B in FIG. 38P, the electronic device 3800 receives an input 3820 at the error indication 3814B.

In Fig.38Q, in response to receiving the input 3820 at the error indication 3814B, the electronic device 3800, a passcode input UI having a plurality of input affordances for entering a passcode (or password). 3822A).

In some examples, instead of determining that authentication was successful as a result of retrying biometric authentication, as discussed above with respect to FIGS. 38L-38O, electronic device 3800 determines that authentication was unsuccessful. In some examples, upon determining that authentication was unsuccessful, the electronic device 3800 remains locked, and the lock icon 3806 in FIG. 38R alternates between different locations to simulate a “shake” effect. Display the animation. The shake animation provides an indication to the user that biometric authentication has failed and that electronic device 3800 remains locked.

After determining that the authentication was unsuccessful, the user may perform an action on the electronic device 3800 to trigger retrying the biometric authentication. In FIG. 38S, the user triggers retrying biometric authentication by swiping up, starting from an area near the lower edge of the display 3802. Electronic device 3800 receives input 3824 and, in response, retries biometric authentication. In some examples, after retrying biometric authentication, electronic device 3800 determines that authentication is successful. In some examples, upon determining that authentication is successful as a result of retrying biometric authentication, electronic device 3800 transitions from a locked state to an unlocked state.

38S and 38T, the electronic device, in response to the input 3824, determines that authentication has not been successful as a result of retrying biometric authentication. Upon determining that the authentication has not been successful as a result of retrying the biometric authentication, the electronic device 3800 displays the passcode input UI 3822B in FIG. 38T. As described in connection with the processes in FIG. 37, the user may retry biometric authentication in the passcode input UI 3822B by performing an upward swipe (eg, input 3826). (Passcode input UI 3822B includes some or all of the features of passcode input UI 3620, including relaxed parameters for where the upward swipe should start to initiate biometric authentication. .)

In Fig. 38U, the electronic device determines that the authentication is successful as a result of retrying the biometric authentication in the passcode input UI 3822B. Upon determining that the authentication is successful, the electronic device transitions from the locked state to the unlocked state, as shown in FIGS. 38U-38W. In some examples, in FIG. 38U, the electronic device determines that authentication is not successful as a result of retrying biometric authentication in passcode input UI 3822B. In some examples, upon making this determination, the electronic device remains locked.

38X-38A illustrate various error conditions that the electronic device 3800 may detect while attempting to biometrically authenticate a user. Instead of displaying the error indication 3814A as described above with respect to FIG. 38G, the electronic device 3800 displays any one of the error indications (e.g., error indications 3814C-3814I) described below. can do. 38X-38A also indicate that the electronic device 3800 may take action to correct the detected error condition so that it may retry to biometrically authenticate the user (e.g., error indications 3814C-3814I). Via) an electronic device 3800 coaching a user.

In FIG. 38X, the user's face is positioned too close to the biometric sensor 3803. As a result, the electronic device 3800 determines that the user's face is positioned outside the allowable distance range 3812 (eg, below the minimum threshold range). Upon determining that the user's face is positioned outside the acceptable distance range 3812, the electronic device 3800 displays an error indication 3814C, which tells the user her face further away from the biometric sensor 3803. Prompt to move. The error indication 3814C also provides an indication of the cause of the error condition (eg, an indication that the user's face is too close to the biometric sensor 3803).

In FIG. 38Y, the user's hand covers the biometric sensor 3803. Consequently, the electronic device 3800 determines that the object (eg, the user's hand) covers the biometric sensor 3803 so that the sensor cannot obtain any information about the user's face. Upon determining that the object is covering biometric sensor 3803, electronic device 3800 displays an error indication 3814D, which prompts the user to move her hand away from biometric sensor 3803. do. The error indication 3814D also provides an indication of the cause of the error condition (eg, an indication that the biometric sensor 3803 is covered).

In FIG. 38Z, the user is not looking at the electronic device 3800. As a result, electronic device 3800 determines that the user's eyes are not looking at the device. Upon determining that the user's eyes are not looking at the device, the electronic device 3800 displays an error indication 3814E, which prompts the user to see the device to correct the error condition. Error indication 3814E also provides an indication of the cause of the error condition (eg, an indication that the user is not looking at the device).

In Fig. 38AA, the user's face is within the field of view 3828, but the user is wearing a hat. Consequently, the electronic device 3800 determines that a portion of the user's face is hidden (or obscured). For example, electronic device 3800 obtains partial information about the user's face using biometric sensor 3803, where the partial information is less than a threshold amount required for comparison with stored authorized credentials. Upon determining that a portion of the user's circumference is hidden, the electronic device 3800 displays an error indication 3814F, which prompts the user to remove the hat. Error indication 3814F also provides an indication of the cause of the error condition (eg, an indication that a portion of the user's face is hidden).

In FIG. 38A, the user's face is outside the field of view 3828 of the biometric sensor 3803. As a result, the electronic device 3800 determines that the user's face is outside the field of view 3828 of the biometric sensor 3803. In some examples, the user's face is outside the field of view 3828 when more than the critical portion of the face is outside the field of view. In some examples, the user's face is outside the field of view 3828 when no face is detected within the field of view. Upon determining that the user's face is outside the field of view 3828, the electronic device 3800 displays an error indication 3814G, which prompts the user to move her face into the field of view 3828. The error indication 3814G also provides an indication of the cause of the error condition (eg, indication 3814G that the user's face is out of view).

In FIG. 38Ac, the user's face is within the field of view 3828, but turned away from the biometric sensor 3803. As a result, the electronic device 3800 determines that the user's face is turned away from the biometric sensor 3803. Upon determining that the user's face is turned away from the biometric sensor 3803, the electronic device 3800 displays an error indication 3814H, which prompts the user to turn her face towards the sensor. Error indication 3814H also provides an indication of the cause of the error condition (eg, an indication that the user's face is turned away from biometric sensor 3803).

In FIG. 38A, the user's face is positioned approximately within the range of the field of view and allowable distance of the biometric sensor 3803. However, the lighting conditions of the environment in which the user is located are not suitable for performing biometric authentication. Specifically, the amount of light is too high, which hinders performing biometric authentication. Consequently, electronic device 3800 determines that the amount of light (eg, through one or more ambient light sensors) exceeds a predefined threshold. Upon determining that the amount of light exceeds the threshold, the electronic device 3800 displays an error indication 3814I, which prompts the user to find improved lighting conditions with a lower amount of light. Error indication 3814I also provides an indication of the cause of the error condition (eg, an indication that the light conditions are not suitable for performing biometric authentication).

39A and 39B are flow charts illustrating a method for providing indications of error conditions during biometric authentication, in accordance with some examples. The method 3900 includes an electronic device (e.g., 100, 300, 500, touchscreen) having a display (e.g., 3802) and one or more input devices (e.g., accelerometer (e.g., 168), touchscreen of display (e.g., 3802)). 3800). In some examples, the electronic device includes one or more biometric sensors (e.g., a fingerprint sensor, a non-contact biometric sensor (e.g., a biometric sensor that does not require physical contact, such as a thermal or optical facial recognition sensor), an iris scanner). Include. In some examples, the one or more biometric sensors include one or more cameras. Some operations of method 3900 are selectively combined, the order of some operations is selectively changed, and some operations are selectively omitted.

As described below, method 3900 provides an intuitive method for providing indications of error conditions during biometric authentication. This method reduces the user's cognitive burden for performing biometric authentication, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to perform biometric authentication faster and more efficiently saves power and increases the time between battery charges.

The electronic device (e.g., 100, 300, 500, 3800) is authenticated (e.g., biometric authentication) via one or more input devices (e.g., accelerometer (e.g., 168), touchscreen of display (e.g., 3802)) A request to perform an operation requesting an operation is received (3902). In some examples, the request to perform an operation that requires authentication includes a request to unlock the device (eg, a swipe at a predefined location). In some examples, the request is triggered by lifting the device from a substantially horizontal position.

In response to a request to perform an operation requiring authentication (eg, biometric authentication) (3904) and upon determining that authentication (eg, biometric authentication) is successful, the electronic device performs the operation (3906). In some examples, a user input (e.g., data obtained from one or more biometric sensors corresponding to the user's biometric features (e.g., face, finger), a passcode) has been applied , Face, or passcode) when corresponding (eg, matched), the authentication is successful. In some examples, when the user input matches the authorized credential, the user input corresponds to the authorized credential.

In response to a request to perform an operation that requires authentication (e.g., biometric authentication) (3904) and authentication (e.g., biometric authentication) is not successful and the set of error condition criteria is met (e. Depending on the determination 3908), the electronic device (e.g., 100, 300, 500, 3800) displays an indication of the error condition (e.g., out of a set of error condition criteria) on a display (e.g., 3802) (e.g. 3814I) is displayed (3910), and the operation is suspended (3916). The indication contains information about the cause of the error condition (3912). In some examples, a user input (e.g., data obtained from one or more biometric sensors corresponding to a user's biometric features (e.g., face, finger), a passcode) is applied to a credential (e.g., a registered fingerprint). , Face, or passcode), authentication is not successful when it does not correspond (eg, does not match). In some examples, the user input does not correspond to the applied credential when the user input does not match the applied credential. In some examples, the set of error condition criteria includes only one criterion. Displaying an indication of the error condition provides feedback to the user about the current state of the device (e.g., the error condition is preventing successful biometric authentication), and takes further action to correct the error condition to the user. Prompting. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently. In addition, withholding to perform an action when biometric authentication has failed and an error condition is detected improves security, and in the case of multiple resource-intensive retries of biometric authentication that are likely to fail due to an error condition. Reduce them. Providing improved security improves the operability of the device (e.g., by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the power of the device by limiting the performance of restricted operations. Reduces usage and improves battery life.

In some examples, in response to a request to perform an operation that requires authentication (3904) and upon determining that the authentication (e.g., biometric authentication) is not successful and the set of error condition criteria is not met (3926), the electronic device (E.g., 100, 300, 500, 3800) suspends displaying an indication of an error condition on a display (e.g., 3802) (3928) and suspends performing the operation (3930).

In some examples, an indication of an error condition (e.g., 3814A-3814I) is an indication (e.g., a visual indication (e.g., graphical or textual)) of a user action that can be performed to correct the error condition (e.g., for a subsequent authentication attempt). )) (3914). In some examples, the indication of the user action indicates how to correct the error condition for subsequent authentication attempts. Displaying an indication of a user action that can be performed to correct an error condition provides the user with feedback on what action steps to take so that the user can be biometrically authenticated in a subsequent authentication attempt. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

In some examples, the indication of the error condition (eg, 3814A-3814I) includes information about the cause of the error condition (eg, indication of a user action and/or device condition, a visible indication (eg, graphic or text)). Displaying an indication of the cause of the error condition provides feedback to the user as to what actions to take so that the user can be biometrically authenticated in a subsequent authentication attempt. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

In some examples, the set of error condition criteria is that the biometric feature (e.g., fingerprint, face) of the first type (e.g., the type corresponding to the applied biometric features) is one or more biometric sensors of the electronic device. Includes requirements that are met when detected using (e.g. 3803). In some examples, an indication of an error condition (eg, 3814A-3814I) is not displayed when a potentially valid biometric feature is not detected (eg, indicating that the user is not currently associated with the device). Withholding the display of an indication of an error condition when no biometric features are detected is potentially confusing to the user, since it is likely that the user would not have intended to perform biometric authentication if no biometric features were detected. To prevent Thus, withholding displaying an indication in such a scenario makes the user-device interface more efficient (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user mistakes). This additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, upon determining that the authentication (e.g., biometric authentication) is successful, the electronic device (e.g., 100, 300, 500, 3800) displays an indication of the error condition (e.g., 3814A through 3814A) on the display (e.g., 3802). 3814I) to display.

In some examples, following displaying an indication of an error condition (e.g., 3814A-3814I) and upon a determination that the set of error condition criteria are still being met, the electronic device (e.g., 100, 300, 500, 3800) , Withholding attempting biometric authentication on the electronic device (and, optionally, disabling further attempts in biometric authentication) (e.g., the biometric authentication function is on the device while a set of error conditions are met) Not available) (3918). In some examples, subsequent to displaying an indication of the error condition and upon determining that the set of error condition criteria is no longer met, the electronic device enables the electronic device to retry the biometric authentication on the electronic device (e.g., The error condition no longer exists (eg, has been corrected (eg, due to the user taking an action to correct the error condition)) 3922. Automatically retrying biometric authentication when the set of error condition criteria is no longer met, allows the user to quickly attempt to authenticate himself biometrically without requiring the user to explicitly request biometric authentication. do. Performing an optimized operation when a set of conditions is met without requiring additional user input (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) ) It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, subsequent to displaying an indication of the error condition and in response to determining that the set of error condition criteria are no longer met, the electronic device retries the authentication (eg, biometric authentication) (eg, authentication Retry automatically) (3924). In some examples, retrying authentication attempts to match biometric information obtained by one or more biometric sensors with authorized credentials (e.g., stored data that has been authorized for use in biometric authentication). Includes that. In some examples, the determination that the error condition is not met occurs subsequent to (eg, in response to) receiving the input to correct the error condition. In some examples, retrying authentication occurs (or only occurs) with a determination that the error condition is not met due to detecting user input that causes the error condition to not be met.

In some examples, following a determination that the set of error condition criteria is no longer met (e.g., detecting that the error condition has been corrected), the electronic device (e.g., 100, 300, 500, 3800) may input one or more inputs. Through the devices, an input (eg, 3824, 3826) corresponding to a request to retry authentication is received. In some examples, the input is a touch gesture input (eg, tap, swipe (eg, swipe up)) or activation of a hardware button (eg, a power button). In some examples, in response to receiving an input corresponding to a request to retry authentication, the electronic device retry authentication (eg, biometric authentication) (eg, automatically retry authentication). In some examples, retrying authentication attempts to match biometric information obtained by one or more biometric sensors with authorized credentials (e.g., stored data that has been authorized for use in biometric authentication). Includes that. In some examples, retrying authentication includes using one or more biometric sensors to obtain data of the user's biometric features (eg, face, fingerprint).

In some examples, displaying an indication of an error condition (eg, 3814A-3814I) includes an animation (eg, shimmering) indicating that an attempt to authenticate is in progress. In some examples, attempting to authenticate includes attempting to detect biometric information using one or more biometric sensors. Displaying a shimmering animation indicating that an attempt to authenticate is in progress provides the user with feedback on the current state of the device and that no further action is required at this time. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

In some examples, following (or in response to) receiving a request to perform an operation requiring authentication and prior to displaying an indication of an error condition (e.g., 3814A-3814I), the electronic device (e.g., 100, 300). , 500, 3800) performs authentication. In some examples, while performing authentication, the electronic device 3800 is on a display (e.g., 3802), and the electronic device is on a biometric feature using one or more biometric sensors (e.g., 3803) of the electronic device. A first indication that information about is being obtained (e.g., 3810, 3814A to 3814I) (e.g., rings rotating around a sphere, user interface objects shimmering, wherein the user interface object includes an indication of an error condition) Displays. In some examples, displaying the indication of the error condition includes replacing the display of the first indication with a display of the indication of the error condition. Displaying an indication that biometric authentication is taking place provides feedback to the user as to the current state of the device (eg, biometric authentication is being performed) and that the user does not need to take any action at this time. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, while performing authentication, the electronic device (e.g., 100, 300, 500, 3800) is on a display (e.g., 3802), a first lock icon (e.g., 3806) (e.g., the locked state of the electronic device). ) And a first animation transitioning from the first lock icon to the first display. In some examples, subsequent to displaying an indication of the error condition (e.g., and according to a determination that authentication was successful) and subsequent to displaying the first animation, the electronic device displays an error on the display (e.g., 3802). Display a second animation transitioning from the indication of the condition to an unlock icon (eg, 3816) (eg, an icon representing the locked state of the electronic device). In some examples, the first animation and the second animation represent morphing from one object to the next. In some examples, the second animation includes displaying the first lock icon following the indication of the error condition and before the unlock icon.

In some examples, following displaying the indication of the error condition, the electronic device is on a display (eg, 3802), from the indication of the error condition to a second lock icon (eg, 3806), or the electronic device A second lock icon (e.g., from a second indication (e.g. 3810, 3814A-3814I) (e.g., rings rotating around a sphere) that information about a biometric feature is being obtained using one or more biometric sensors. Displays an animation that transitions to an icon indicating the locked state of the electronic device) In some examples, the second lock icon is the first lock icon. In some examples, the second indication is the first indication.

In some examples, while retrying authentication and subsequent to displaying an indication of an error condition and upon a determination that there is no error condition, the electronic device uses one or more biometric sensors of the electronic device on the display. A third indication (e.g., 3810, 3814A to 3814I) that information about the biometric feature is being obtained (e.g., rings rotating around a sphere, user interface objects shimmering, where the user interface object is an error condition (Including the indication of) is displayed. In some examples, the third indication is the first indication.

In some examples, prior to displaying the indication of the error condition, the electronic device (e.g., 100, 300, 500, 3800) is on the display (e.g., 3802), a third lock icon (e.g., 3806) at a location on the display. ) (Eg, an icon representing the locked state of the electronic device) is displayed. In some examples, an indication of an error condition (eg, 3814A-3814I) is displayed in proximity to (eg, near, adjacent, at, within a predetermined distance therefrom) its location on the display. In some examples, the third lock icon is a first lock icon and/or a second lock icon.

In some examples, when the electronic device is in a locked state while receiving a request to perform an operation requiring authentication, and upon a determination that authentication is successful, the electronic device (e.g., 100, 300, 500, 3800) is in a locked state. Transition from to the unlocked state. In some examples, the operation requiring authentication is to transition the electronic device from a locked state to an unlocked state. In some examples, when the electronic device is in a locked state while receiving a request to perform an operation that requires authentication, and upon a determination that authentication is not successful, the electronic device remains locked. Keeping the device locked when authentication is unsuccessful improves device security by preventing unauthorized and/or unauthorized access to the device. Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life.

In some examples, when the electronic device is in a locked state while receiving a request to perform an operation requiring authentication, and upon a determination that authentication is not successful, the electronic device (e.g., 100, 300, 500, 3800) is locked. Maintain state and retry authentication (eg, biometric authentication) (eg, automatically retry authentication). In some examples, retrying authentication includes attempting to obtain information about a biometric feature (eg, a face, fingerprint) using one or more biometric sensors of the electronic device. In some examples, retrying authentication attempts to match biometric information obtained by one or more biometric sensors with authorized credentials (e.g., stored data that has been authorized for use in biometric authentication). Includes that. In some examples, after retrying authentication and upon a determination that authentication is successful resulting from retrying authentication, the electronic device transitions from a locked state to an unlocked state. In some examples, after retrying authentication and upon a determination that authentication is not successful resulting from retrying authentication, the electronic device remains locked.

In some examples, following (or in response to) receiving a request to perform an operation requiring authentication, the electronic device (e.g., 100, 300, 500, 3800) attempts to authenticate (e.g., biometric authentication). do. In some examples, while attempting authentication, the electronic device displays information about a biometric feature (e.g., face, fingerprint) on a display (e.g., 3802), wherein the electronic device uses one or more biometric sensors of the electronic device. A third indication (eg, 3810, 3814A to 3814I) (eg, rings rotating around a sphere) is displayed. In some examples, the indication is a scanning animation. In some examples, the third indication is a first indication and/or a second indication. In some examples, while retrying authentication, the electronic device maintains display of the third indication on the display (eg, 3802).

In some examples, upon a determination that authentication is not successful resulting from retrying authentication, the electronic device displays, on a display (e.g., 3802), an alternating lock icon (e.g., a lock icon (e.g., 3806) (eg, an icon indicating the locked state of the electronic device), and the second position is different from the first position. In some examples, an animation with a lock icon is an animation of a lock icon that shakes (eg, rotates left and right, back and forth). In some examples, the electronic device displays an animation accompanying a lock icon to indicate that the biometric authentication has failed. In some examples, a tactile output is provided in combination with a shaking lock icon. In some examples, no tactile output is provided. In some examples, upon determining that the biometric information captured using one or more biometric sensors does not correspond to or does not match the authorization credentials, the electronic device (e.g., 100, 300, 500, 3800) Remain locked. Displaying the animation of the shaking lock icon provides feedback to the user about the current state of the device (eg, biometric authentication has failed) and prompts the user to take further action. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, the electronic device (eg, 100, 300, 500, 3800) includes a biometric sensor (eg, 3803), and the set of error condition criteria includes one or more of the following error condition criteria:

생체측정 센서로부터의 생체측정 특징부의 거리는 제1 미리결정된 임계 거리를 초과하거나(예컨대, 생체측정 특징부(예컨대, 얼굴)가 생체측정 센서로부터 너무 멀리 있음) 또는 거리 범위(예컨대, 3812)의 최대치를 초과한다. 일부 예들에서, 제1 미리결정된 임계치 또는 거리 범위의 최대치를 초과하는 것은, 생체측정 센서에 의해 획득된 생체측정 특징부에 관한 정보의 감소된 정확도 또는 열화와 높은 상관 관계가 있다. 일부 예들에서, 사용자는 사용자의 얼굴을 생체측정 센서에 더 가깝게 이동시킴으로써 이러한 에러 조건을 보정할 수 있다.

The distance of the biometric feature from the biometric sensor exceeds a first predetermined threshold distance (e.g., the biometric feature (e.g., face) is too far from the biometric sensor) or the maximum of the distance range (e.g., 3812). Exceeds. In some examples, exceeding the first predetermined threshold or maximum of the distance range is highly correlated with a reduced accuracy or degradation of information about a biometric feature obtained by the biometric sensor. In some examples, the user can correct for this error condition by moving the user's face closer to the biometric sensor.

생체측정 센서로부터의 생체측정 특징부의 거리는 제2 미리결정된 임계 거리 미만이거나(예컨대, 생체측정 특징부(예컨대, 얼굴)가 생체측정 센서에 너무 가까이 있음) 또는 거리 범위(예컨대, 3812)의 최소치 미만으로 떨어진다. 일부 예들에서, 제2 미리결정된 임계치 또는 거리 범위의 최소치 미만으로 떨어지는 것은, 생체측정 센서에 의해 획득된 생체측정 특징부에 관한 정보의 감소된 정확도 또는 열화와 높은 상관 관계가 있다. 일부 예들에서, 사용자는 사용자의 얼굴을 생체측정 센서로부터 더 멀리 이동시킴으로써 이러한 에러 조건을 보정할 수 있다.

The distance of the biometric feature from the biometric sensor is less than a second predetermined threshold distance (e.g., the biometric feature (e.g., face) is too close to the biometric sensor) or less than the minimum of the distance range (e.g., 3812). Falls into In some examples, falling below the second predetermined threshold or minimum of the distance range is highly correlated with reduced accuracy or degradation of the information about the biometric feature obtained by the biometric sensor. In some examples, the user can correct for this error condition by moving the user's face further away from the biometric sensor.

생체측정 센서(예컨대, 3803)는 가려져(예컨대, 부분적으로 가려져, 완전히 가려져, 센서의 동작을 억제하기에 충분한 정도로 가려져) 있다(예컨대, 전자 디바이스와 상호작용하는 동안, 사용자의 일부분(예컨대, 손)에 의해 가려짐). 일부 예들에서, 사용자는 사용자의 손을 생체측정 센서로부터 멀리 이동시킴으로써 이러한 에러 조건을 보정할 수 있다.

The biometric sensor (e.g., 3803) is obscured (e.g., partially obscured, completely obscured, obscured to an extent sufficient to inhibit the motion of the sensor) (e.g., while interacting with an electronic device, a portion of the user ). In some examples, the user can correct for this error condition by moving the user's hand away from the biometric sensor.

검출된 생체측정 특징부의 하위부분(예컨대, 검출된 얼굴의 눈)이 생체측정 센서를 향해 배향되어 있지 않다(예컨대, 하나 이상의 눈이 전자 디바이스(예컨대, 생체측정 센서)에 초점을 맞추고 있지 않다). 일부 예들에서, 사용자는 사용자가 눈을 뜨거나 전자 디바이스(예컨대, 생체측정 센서)를 바라봄으로써 이러한 에러 조건을 보정할 수 있다.

The lower part of the detected biometric feature (e.g., the eye of the detected face) is not oriented towards the biometric sensor (e.g., one or more eyes are not focused on the electronic device (e.g., biometric sensor)) . In some examples, the user may correct this error condition by opening the user's eyes or looking at an electronic device (eg, a biometric sensor).

검출된 생체측정 특징부의 적어도 일부분이 가려져(예컨대, 부분적으로 가려져, 완전히 가려져, 생체측정 특징부에 관한 불완전한 정보를 야기하기에 충분한 정도로 가려져) 있다. 일부 예들에서, 사용자는, 사용자의 얼굴을 차단하고 있는 액세서리(예컨대, 선글라스) 또는 의류(예컨대, 스카프, 모자)를 제거함으로써 이러한 에러 조건을 보정할 수 있다.

At least a portion of the detected biometric feature is obscured (eg, partially obscured, completely obscured, obscured to a sufficient degree to cause incomplete information about the biometric feature). In some examples, the user may correct this error condition by removing an accessory (eg, sunglasses) or clothing (eg, scarf, hat) that is blocking the user's face.

어떠한 생체측정 특징부도 생체측정 센서의 시야(예컨대, 3828) 내에서 검출되지 않는다.

No biometric features are detected within the field of view (eg, 3828) of the biometric sensor.

검출된 생체측정 특징부의 포즈(pose)(예컨대, 생체측정 센서와 관련한 배향)가 임계 범위를 초과한다(예컨대, 생체측정 특징부(예컨대, 얼굴)가 생체측정 센서로부터 멀리 돌려져 있다). 일부 예들에서, 임계 범위를 초과하는 것은, 생체측정 센서에 의해 획득된 생체측정 특징부에 관한 정보의 감소된 정확도 또는 열화와 높은 상관 관계가 있다. 일부 예들에서, 사용자는 사용자의 얼굴을 전자 디바이스(예컨대, 생체측정 센서)를 향해 돌림으로써 이러한 에러 조건을 보정할 수 있다.

The pose of the detected biometric feature (eg, orientation relative to the biometric sensor) exceeds a threshold range (eg, the biometric feature (eg, face) is rotated away from the biometric sensor). In some examples, exceeding a threshold range is highly correlated with reduced accuracy or degradation of information about biometric features obtained by the biometric sensor. In some examples, the user can correct for this error condition by turning the user's face toward an electronic device (eg, a biometric sensor).

전자 디바이스는 (예컨대, 하나 이상의 주변 광 센서들을 통해) 미리결정된 광 임계치를 초과하는 광량(예컨대, 주변 광)을 검출한다(예컨대, 미리결정된 광 임계치를 초과하는 것은 생체측정 센서에 의해 획득된 생체측정 특징부에 관한 정보의 감소된 정확도 또는 열화와 높은 상관 관계가 있다). 일부 예들에서, 사용자는, 태양을 향해 사용자의 등을 돌려서 전자 디바이스에 의해 검출된 광량을 줄이거나 또는 더 적은 주변 광을 갖는 새로운 위치(예컨대, 실내)로 이동함으로써 이러한 에러 조건을 보정할 수 있다.

The electronic device detects an amount of light (e.g., ambient light) that exceeds a predetermined light threshold (e.g., via one or more ambient light sensors) (e.g., exceeding the predetermined light threshold is a biometric obtained by the biometric sensor). There is a high correlation with reduced accuracy or degradation of information about measurement features). In some examples, the user can correct this error condition by turning the user's back towards the sun to reduce the amount of light detected by the electronic device or moving to a new location (e.g., indoors) with less ambient light. .

In some examples, the set of error condition criteria may be a first subset of the error conditions listed above. For example, the first subset is that the distance of the biometric feature exceeds a first predetermined threshold distance, that the distance of the biometric feature is less than a second predetermined threshold distance, the biometric feature is a biometric sensor And one or more error condition criteria selected from the group consisting of being outside the field of view of, and that the pose of the biometric feature exceeds a threshold range. The first subset focuses on guiding the user to correct for error conditions involving the orientation and/or positioning of the face. As a further example, the second subset may include one or more error condition criteria selected from the group consisting of that the biometric sensor is obscured, and that no biometric features are detected within the field of view of the biometric sensor. The second subset focuses on guiding the user to correct error conditions in which the biometric sensor cannot obtain any information about the user's biometric features. For another example, the third subset may include one or more error condition criteria selected from the group consisting of that the detected biometric feature's pose exceeds a threshold range and that the biometric sensor is obscured. The third subset focuses on error conditions that are likely to occur for devices of a given form factor/size (eg, tablet device (eg, iPad)).

In some examples, an electronic device (eg, 100, 300, 500, 3800) includes a biometric sensor (eg, 3803) in a portion (eg, a location) of the electronic device (eg, a portion that is not on the display). In some examples, in response to a request to perform an operation that requires authentication, the electronic device is placed on a display (e.g., 3802), in proximity to (e.g., adjacent to, near, a predetermined distance therefrom) a portion of the electronic device. Within), displays a progress indicator (eg, 3814A to 3814I) including an indication of the error condition. Displaying a progress indicator near the biometric sensor provides feedback to the user about the association of the biometric sensor with processes occurring at the device (eg, attempted authentication). Specifically, the user is aware of the biometric sensor during biometric authentication so that the user is less likely to perform an action that interferes with the biometric sensor or, alternatively, the user is prompted to take a corrective action. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, the indication of an error condition (eg, 3814B) includes an indication that biometric authentication is not currently enabled on the electronic device according to a determination that biometric authentication is not currently enabled on the electronic device. In some examples, biometric authentication may become unavailable (or may not be enabled on the electronic device) when one or more of the following conditions are met: The electronic device is successfully turned on or restarted. Not certified; The electronic device has not been unlocked for more than a predetermined time (eg, 48 hours); The passcode was not used to unlock the device for more than a predetermined time (eg, 156 hours); Biometric authentication using biometric features (eg, face, fingerprint) was not used to unlock the device for more than a predetermined time (eg, 4 hours); The electronic device has received a remote lock command; Biometric authentication has failed more than a predetermined number of times (eg, 5, 10, 15) since the last successful authentication by the device; The electronic device has received a power off and/or emergency SOS command; Then, an explicit request by the user to disable biometric authentication was detected. Displaying an indication that biometric authentication is not currently enabled provides feedback to the user of the current state of the device and prompts the user to pursue alternative methods to authenticate themselves. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, the indication that biometric authentication is currently not enabled includes an affordance (eg, 3814B) (eg, the indication is affordance). In some examples, the electronic device (e.g., 100, 300, 500, 3800) receives an input corresponding to the affordance (e.g., 3820), and in response to receiving the input corresponding to the affordance, the electronic device (e.g., 100 , 300, 500, 3800 displays, on a display (eg, 3802), a credential input user interface (eg, 3822A) having a plurality of character input keys. In some examples, the credential input user interface includes a virtual keypad or virtual keyboard. In some examples, the virtual keypad or virtual keyboard includes a plurality of character entry keys.

In some examples, the electronic device (eg, 100, 300, 500, 3800) detects a condition that triggers an attempt to authenticate (eg, biometric authentication). In some examples, the request to perform an operation that requires authentication includes a request to unlock the device (eg, a swipe at a predefined location). In some examples, in response to detecting a condition that triggers an attempt to authenticate (e.g., biometric authentication) and while the condition is available for detection by one or more biometric sensors ( For example, a face is detected in the field of view of one or more face detection sensors, such as a depth camera) (e.g., based on satisfaction of criteria other than detection of a user input) an alert generated by the device without user input to the device (e.g., 3808 ), the electronic device displays a fifth indication (e.g., 3810) (e.g., a phrase) that the electronic device is obtaining information about the biometric feature using one or more biometric sensors of the electronic device. Rings rotating around the center) are displayed. In some examples, the condition is that while the biometric feature is not available for detection by one or more biometric sensors (e.g., no face is detected in the field of view of one or more face detection sensors, such as a depth camera) ( In response to a determination that the electronic device responds to an alert generated by the device without user input to the device, e.g., based on satisfaction of criteria other than detection of user input), the electronic device uses one or more biometric sensors of the electronic device. Thus, displaying a fifth indication (eg, rings rotating around a sphere) that information about the biometric feature is being held is reserved. In some examples, the condition is a user input to the device (e.g., a request not associated with a notification; a touch gesture input (e.g., tap, swipe (e.g., 3824)) (e.g., swipe up) or a hardware button (e.g., power Button) or a request that is an activation of sensor data indicative of movement of the device (e.g., lifting)), the electronic device may request that the electronic device uses one or more biometric sensors of the electronic device (e.g., Display a fifth indication that information about the biometric feature is being acquired, regardless of whether the biometric feature is available for detection by one or more biometric sensors. Withholding the display of the indication when no face is detected avoids potentially confusing the user, since it is likely that the user will not intend to initiate biometric authentication if no biometric features are detected. . Thus, withholding displaying an indication in such a scenario makes the user-device interface more efficient (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user mistakes). This additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

It is noted that the details of the processes described above with respect to method 3900 (eg, FIGS. 39A and 39B) are also applicable in a similar manner to the methods described below/above. For example, method 3700, method 4100, and/or method 4300 optionally include one or more of the features of the various methods described above with respect to method 3900. For example, error indications (e.g., 3814A-3814I) as described in connection with method 3900 may be performed during biometric authentication performed in the processes described in connection with method 3700 and method 4100. It can be used to provide indications of error conditions. For brevity, these details are not repeated below.

40A-40U illustrate example user interfaces for providing indications regarding a biometric sensor during biometric authentication, in accordance with some examples. The user interfaces of these figures are used to illustrate the processes described below, including those of Figures 41A-41C.

40A illustrates an electronic device 4000 (eg, portable multifunction device 100, device 300, device 500). In the illustrative examples illustrated in FIGS. 40A-40U, electronic device 4000 is a tablet computer. In other examples, electronic device 4000 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 4000 includes a display 4002, one or more input devices (eg, a touchscreen of the display 4002, a button 4004, and a microphone), and a wireless communications radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 40A, the electronic device includes a biometric sensor 4003. In some examples, the biometric sensor is one or more biometric sensors, which may include a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 4003 is biometric sensor 703. In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 40A, a user desires to purchase products using payment information stored on the electronic device 4000. As shown in FIG. 40A, the electronic device 4000 is in a split screen (eg, multitasking) mode. While in the split screen mode, the electronic device 4000 draws an app store user interface (UI) 4006 in the left area 4007 of the display 4002 and the browser UI in the right area 4009 of the display 4002 4008) are displayed simultaneously. While simultaneously displaying the app store UI 4006 and the browser UI 4008, the electronic device 4000 receives an input 4010 from the purchase affordance 4012.

In FIG. 40B, in response to receiving the input 4010 at the purchase affordance 4012, the electronic device 4000 displays applications being displayed in the left area 4007 and the right area 4009 of the display 4002. Swap. Specifically, the electronic device 4000 displays the browser UI 4008 in the left area 4007 and the app store UI 4006 in the right area 4009. The electronic device 4000 swaps applications to place an application associated with the products being purchased in an area closer to the biometric sensor 4003. By arranging the browser UI 4008 in the left area 4007, the electronic device 4000 provides the user with an indication of the location of the biometric sensor 4003, which prevents the user from authorizing payment for purchasing products. It is used to authenticate. As shown in FIG. 40B, swapping applications also places the application associated with the products being purchased in an area closer to the button 4004. In some examples, if the button 4004 and the biometric sensor 4003 are not in close proximity (e.g., on the same side), the electronic device 4000 swaps the applications and, if necessary, the product being purchased. The applications associated with them are placed in an area closer to the biometric sensor 4003. In some examples, if the button 4004 and the biometric sensor 4003 are not in close proximity (e.g., on the same side), the electronic device 4000 swaps the applications and, if necessary, the product being purchased. The applications associated with them are placed in an area closer to the button 4004.

Additionally, as shown in FIG. 40B, in response to receiving the input 4010 in the purchase affordance 4012, the electronic device 4000 darkens the browser UI 4008, while the app store UI 4006 ) To a greater degree than that of the browser UI 4008. By making the browser UI 4008 less dark than the app store UI 4006, the electronic device 4000 indicates to the user which application is associated with the payment sheet interface 4014 and which products the user wants to purchase.

In addition, in response to receiving the input 4010 in the purchase affordance 4012, the electronic device 4000 provides a payment sheet interface 4014 with information about the products being purchased, and provides the user with information about the products. Simultaneously displays a prompt 4016 prompting a double-click on button 4004 to initiate a process for authorizing payment. Additionally, in response to receiving input 4010 at purchase affordance 4012, electronic device 4000 displays dynamic indication 4018 to highlight the location of button 4004. While displaying payment sheet interface 4014, the electronic device receives an input 4020 at button 4004 (eg, a double press of button 4004). In some examples, prompt 4016 includes some or all of the features of prompt 2416. In some examples, dynamic indication 4018 includes some or all of the features of dynamic indication 2418. In some examples, payment sheet interface 1014 includes the name of the application to which it corresponds (eg, the name of the application the user initiated the process for authorizing payment).

In FIG. 40C, in response to receiving an input 4020 at button 4004, electronic device 4000 initiates a process for authorizing payment for goods. Authorizing payment for goods requires successfully authenticating the user. Consequently, in response to receiving the input 4020, the electronic device 4000 initiates biometric authentication using the biometric sensor 4003. After initiating biometric authentication, the electronic device 4000 displays a face glyph 4022, which the electronic device 4000 is attempting to biometrically authenticate the user (e.g., biometric sensor 4003). Is attempting to obtain biometric information about the user). In some examples, facial glyph 4022 includes some or all of the features of glyph 2468 in FIG. 24F. In some examples, in response to receiving the input 4020 at the button 4004, the electronic device displays a facial glyph 4022 from the location of the prompt 4016, as shown in FIG. 40C. Displays the animation moving to the position of ). In some examples, the animation is to make the face glyph 4022 appear to slide out of the prompt 4016.

In Figure 40D, after displaying the face glyph 4022, the electronic device transitions to displaying the authentication glyph 4024, which the electronic device 4000 is attempting to biometrically authenticate the user (e.g., Continuously attempting to obtain measurement information, attempting to match the obtained information with stored authorized credentials) provides an indication. Authentication glyph 4024 includes a plurality of rings rotating in a spherical shape. In some examples, authentication glyph 4024 includes some or all of the features of one or more rings 2470 of FIG. 24G.

While displaying the authentication glyph 4024, the electronic device 4000 detects that an error condition exists (eg, a condition that prevents the biometric sensor 4003 from obtaining sufficient information about the user's face). Specifically, the electronic device 4000 detects that the biometric sensor 4003 is covered by a physical object (eg, a user's hand). In some examples, the electronic device 4000 may obtain sufficient information about the user's face without detecting an error condition. In some examples, after obtaining sufficient information about the user's face, and while displaying the authentication glyph 4024, the electronic device 4000 determines whether the obtained information satisfies the biometric authentication criteria ( For example, it is determined whether the obtained biometric information matches, within a threshold, a biometric template associated with the user (eg, stored authorized credentials). In some examples, upon determining that the biometric authentication is successful (eg, that the biometric authentication criteria are satisfied), the electronic device 4000 transitions to the unlocked state.

In FIG. 40E, in response to detecting that an error condition exists, the electronic device 4000 displays an error 4026 at a location at the top of the display 4002 (e.g., relative to the ground, relative to the user). ) Is displayed. Error indication 4026 provides an indication of an error condition that currently exists. Additionally, in response to detecting that an error condition exists, the electronic device 4000 displays an error icon 4028 at a location of the display 4002 adjacent to the biometric sensor 4003, thereby Provides an indication of the location of the sensor 4003. By providing an indication of the location of the biometric sensor 4003, the error icon 4028 suggests to the user the cause of the error condition. In some examples, in response to detecting that an error condition exists, electronic device 4000 displays an error indication 4026 in a location adjacent to biometric sensor 4003. In some examples, error indication 4026 includes some or all of the features of error indication 3814A, including a shimmer effect.

In FIG. 40F, in addition, in response to detecting that an error condition exists, the electronic device 4000 indicates that the payment sheet interface 4014 is closer to the biometric sensor 4003 from its initial position in FIG. 40E. Displays the animation moving to the position at 40f.

. By moving the payment sheet interface towards the biometric sensor 4003, the electronic device 4000 not only indicates the location of the biometric sensor 4003 to the user, but also indicates the presence of the error icon 4028 (and thus , Indicate the cause of the error condition to the user).

In some examples, the error icon 4028 is displayed at different locations on the display 4002 depending on the positioning of the user's hand on the display 4002. As illustrated in FIG. 40F, the user's hand covers a portion of the display 4002 adjacent to the biometric sensor 4003. While the user's hand is in contact with the display 4002, the electronic device 4000 detects an input as a result of the contact from the user's hand. In response to detecting this input, the electronic device 4000 displays an error icon 4028 at a location where no input is detected. As another example, in FIG. 40G, the user's hand covers a smaller portion of the display 4002 than the user's hand in FIG. 40F. In some examples, in response to detecting an input of the user's hand in FIG. 40G, the electronic device 4000 displays an error icon 4028 at a different location than the location in FIG. 40F, wherein The location is closer to the biometric sensor 4003 than in FIG. 40F. As another example, in FIG. 40H, the user's hand covers a large portion of the upper left of the display 4002. In some examples, in response to detecting an input of the user's hand in FIG. 40H, the electronic device 4000 displays an error icon 4028 at a different location than the locations in FIGS. 40F and 40G. Specifically, in some examples, the electronic device 4000 displays the error icon 4028 at a location close to (or substantially near) the biometric sensor 4003 if the user's hand input is not in a location where input is detected. Display.

In FIG. 40I, the user removes her hand so that the hand no longer covers the biometric sensor 4003. While displaying error icon 4028 and error icon 4028, electronic device 4000 detects that an error condition no longer exists.

In Fig. 40J, in response to detecting that the error condition no longer exists, the electronic device 4000 automatically retries the biometric authentication. While retrying biometric authentication, the electronic device 4000 displays an authentication glyph 4024. While displaying the authentication glyph 4024, the electronic device 4000 attempts to biometrically authenticate the user. Specifically, the electronic device 4000 uses the biometric sensor 4003 to obtain information on the user's face, and whether the biometric authentication is successful (e.g., whether the obtained information matches the stored authorized credentials). ) To determine whether

While retrying the biometric authentication, the electronic device 4000 determines that the biometric authentication is successful. In FIG. 40K, upon determining that the biometric authentication was successful, the electronic device 4000 displays a success glyph 4030, which provides an indication that the biometric authentication was successful. In some examples, success glyph 4030 includes some or all of the features of glyph 2474.

In Figure 40L, further, in response to determining that the biometric authentication was successful, the electronic device 4000 displays a processing indicator 4032, which provides an indication that the payment transaction is being processed (e.g., electronic device Reference numeral 4000 is transmitting payment information (eg, credentials) to authorize payment to an external device (eg, a server)). In some examples, processing indicator 4032 has some or all of the features of processing indication 2476.

In FIG. 40M, upon receiving an indication that payment has been completed (eg, authorized), the electronic device 4000 displays a completed indication 4034, which provides an indication that the payment has been completed. In some examples, completed indication 4034 has some or all of the features of completed indication 2478 of FIG. 24A.

40N-40S illustrate a technique for displaying error indication 4026 and error icon 4028 when error indication 4026 and error icon 4028 should be displayed at approximately the same location. In Figure 40N, the user wishes to unlock the device to access restricted content (eg, home screen, most recently used application). 40N shows the electronic device 4000 in a vertical orientation with respect to the ground, where the user is covering the biometric sensor 4003 with her hand. Additionally, the electronic device 4000 displays a locked state UI 4036 with a lock icon 4038. The lock icon 4038 provides an indication that the electronic device 4000 is in a locked state.

While displaying the locked state UI 4036, the electronic device 4000 receives a request to unlock the device. For example, electronic device 4000 detects that the user lifts the device from a substantially horizontal position.

In FIG. 40O, in response to receiving a request to unlock the device, the electronic device 4000 attempts to biometrically authenticate the user. While attempting to biometrically authenticate the user, the electronic device 4000 displays an authentication glyph 4024. Additionally, while attempting to biometrically authenticate the user, the electronic device 4000 indicates that an error condition (e.g., a condition that prevents the biometric sensor 4003 from obtaining sufficient information about the user's face) exists. Detect it. Specifically, the electronic device 4000 detects that the biometric sensor 4003 is covered by a physical object (eg, a user's hand).

In FIG. 40P, in response to detecting that an error condition exists, the electronic device 4000 causes an error at the location of the display 4002 near the biometric sensor 4003 (e.g., on top of the display 4002). The icon 4028 is displayed. Further, in response to detecting that an error condition exists, the electronic device 4000 determines that the error indication 4026 should be displayed at approximately the same location as the error icon 4028. Upon determining that the error indication 4026 should be displayed at approximately the same location, the electronic device 4000 does not immediately display the error indication 4028, as described below in connection with FIGS. 40Q and 40R, Instead, it displays error indication 4026 as part of an animation that transitions from error icon 4028 to lock icon 4038 for error indication 4026.

In Figure 40Q, after displaying the error icon 4028, the electronic device 4000 displays an error indication 4026 (e.g., replacing the display of the error icon 4028 with it), as discussed above. Likewise, it provides an indication of the cause of the error condition.

While displaying the error indication 4026, the user removes her hand from the biometric sensor 4003 so that it no longer covers the biometric sensor 4003. In response to detecting that the error condition no longer exists, the electronic device 4000 automatically retries the biometric authentication.

In Figs. 40R and 40S, upon determining that authentication is successful as a result of retrying biometric authentication, the electronic device 4000 transitions from the locked state to the unlocked state. Specifically, the electronic device 4000 displays an animation of the lock icon 4038 transitioning to the unlock icon 4040 (e.g., replacing the display of the error indication 4026 with it), which gives the user the electronic device Provides an indication that (4000) has transitioned to the unlocked state. In some examples, instead of successful biometric authentication, electronic device 4000 determines that the authentication is not successful as a result of retrying the biometric authentication. In some examples, upon determining that the authentication is not successful, the electronic device 4000 displays a passcode input UI with affordance that, when activated, triggers retrying the biometric authentication. In some examples, while retrying biometric authentication, electronic device 4000 dims all portions of display 4002 except for the user interface associated with retrying biometric authentication.

40T illustrates a technique for displaying the error icon 4028 when the error icon 4028 should be displayed at approximately the same location as the notification of one of the notifications being displayed (eg, 4044A-4044D). In some examples, the user desires to view the restricted content of one or more of the notifications (eg, 4044A-4044D) displayed while the electronic device 4000 is locked. As shown in FIG. 40T, the user is covering the biometric sensor 4003 with her hand when the electronic device is in a vertical orientation, where the biometric sensor 4003 is located near the bottom of the device. In some examples, while attempting to biometrically authenticate the user to access the restricted content of notifications, the electronic device 4000 may have an error condition as a result of the user covering the biometric sensor 4003 with her hand. Detect that it exists. In response to detecting that an error condition exists, electronic device 4000 determines that error icon 4028 should be displayed at approximately the same location as the notification of one of the notifications (eg, 4044A-4044D). Upon making this determination, and in response to detecting that an error condition exists, the electronic device 4000 displays a UI element 4042 (e.g., background) concurrently with the error icon 4028, resulting in an error icon 4028. ) To overlay the display. As shown in FIG. 40T, the UI element 4042 is opaque, making the notification (eg, 4042D) overlaid with the error icon 4028 invisible to the user. In some examples, the UI element 4042 is transparent such that the notification over which the error icon 4028 is overlaid is visible to the user.

40T also illustrates a technique for hiding the unlock indication 4044 of FIG. 40U when the error icon 4028 should be displayed at approximately the same location as the unlock indication 4044. In some examples, electronic device 4000 displays an unlock indication 4044, which provides an indication of an approximate location on display 4002 from which the user can initiate an upward swipe to initiate biometric authentication. . In some examples, while displaying the unlock indication 4044, the electronic device 4000 detects that an error condition exists as a result of the user covering the biometric sensor 4003 with her hand. In some examples, in response to detecting that an error condition exists, the electronic device 4000 determines that the error icon 4028 should be displayed at approximately the same location as the unlock indication 4044. In some examples, upon making this determination, and in response to detecting that an error condition exists, the electronic device 4000 stops displaying the unlock indication 4044, and the unlock indication 4044 is displayed. The error icon 4028 is displayed at approximately the same position as where it was.

While displaying the error icon 4028, the electronic device 4000 detects that the error condition no longer exists (eg, due to the user removing her hand from the biometric sensor 4003). As shown in FIG. 40U, the user removed her hand from the biometric sensor 4003. In Figure 40u, upon detecting that the error condition no longer exists, the electronic device 4000 stops displaying the error icon 4028, and reappears the unlock indication 4044 in the position where it was previously displayed Display.

41A-41C are flow charts illustrating a method for providing indications regarding a biometric sensor during biometric authentication, in accordance with some examples. The method 4100 includes a display (e.g., 4002) and a biometric sensor (e.g., 4003) (e.g., a device having a plurality of biometric sensors) in a first portion of the electronic device (e.g., a portion that is not part of the display). 1 biometric sensor) (e.g., a fingerprint sensor, a non-contact biometric sensor (e.g., a biometric sensor that does not require physical contact, e.g., a thermal or optical face recognition sensor), an iris scanner) with an electronic device (e.g., 100, 300, 500, 4000). In some examples, the biometric sensor includes one or more cameras. Some operations of method 4100 are selectively combined, the order of some operations is selectively changed, and some operations are selectively omitted.

As described below, method 4100 provides an intuitive method for providing indications regarding a biometric sensor during biometric authentication. This method reduces the user's cognitive burden for performing biometric authentication, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to perform biometric authentication faster and more efficiently saves power and increases the time between battery charges.

An electronic device (e.g., 100, 300, 500, 4000) is an error condition that prevents the biometric sensor from acquiring biometric information about the user of the device (e.g., a non-contact biometric sensor such as a thermal or optical facial recognition sensor). Is obscured (e.g., partially obscured, completely obscured, obscured to a sufficient degree to inhibit the operation of the sensor) (e.g., while interacting with an electronic device, by a part of the user (e.g., hand) Obscured) is detected (4102) (eg, in response to a request to perform an operation requiring authentication).

In response to detecting the presence of an error condition (4104), the electronic device (e.g., 100, 300, 500, 4000), on a display (e.g., 4002), an error indication (e.g., 4028) (e.g., a graphic icon ) Is displayed. In some examples, the error indication includes text (eg, indicating that the sensor is obscured). In some examples, the error indication does not include text. The error indication is displayed 4106 in a location proximate the first portion of the electronic device. In some examples, the location is at or near the portion of the display that is closest to the location of the biometric sensor (eg, 4003). Displaying an error indication provides feedback to the user regarding the current state of the device (e.g., that an error condition is preventing successful biometric authentication) and prompts the user to take further action to correct the error condition. . Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently. Displaying an error indication near the biometric sensor provides feedback to the user about the association of the biometric sensor with a process occurring on the device (eg, authentication attempted). Specifically, the user is aware of the biometric sensor during biometric authentication so that the user is less likely to perform an action that interferes with the biometric sensor or, alternatively, the user is prompted to take a corrective action. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, the error indication (eg, 4028) includes a biometric sensor occlusion icon and reticle, and the error indication provides an indication 4108 that the biometric sensor is occluded. (ISE, an error indication is associated with an electronic device that performs biometric authentication (eg, using a biometric sensor to obtain biometric information about a biometric feature (eg, face, fingerprint)).) Providing an indication that the sensor is obscured provides feedback to the user about the current state of the device (eg, the biometric sensor is obscured) and prompts the user to take further action to correct the error condition. Thus, providing improved feedback with instructions for appropriate movements of a biometric feature (e.g., by helping the user to provide appropriate inputs when actuating/interacting with the device and reducing user errors) It improves the operability of the device and makes the user-device interface more efficient, which in addition reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

Upon determination that the user interface of the electronic device is in a first orientation with respect to the biometric sensor (4110), the electronic device (e.g., 100, 300, 500, 4000) is in proximity to (e.g., adjacent to) a first portion of the electronic device. Display an error indication at a first location in the user interface, near it, within its predetermined distance

Upon determination that the user interface of the electronic device is in a second orientation with respect to the biometric sensor (4112), the electronic device (e.g., 100, 300, 500, 4000) is in proximity to (e.g. , Displays an error indication (eg, 4028) at a second location in the user interface, near it, within its predetermined distance, and the first orientation is different from the second orientation.

In some examples, while attempting to acquire biometric information using a biometric sensor (e.g., 4003) (4114), the electronic device (e.g., 100, 300, 500, 4000) is on a display (e.g., 4002). A first progress indicator (eg, 4024, 4026, 4038, 4040) is displayed (4116). In some examples, the first progress indicator provides an indication of a current state of the electronic device (eg, locked state, unlocked state, performing biometric authentication, error state, error condition). In some examples, upon determination that the user interface of the electronic device (e.g., 4006, 4008) is in a third orientation with respect to the biometric sensor-the user interface in the third orientation has a first top side-(4118), The electronic device displays a first progress indicator in proximity to (eg, adjacent to, near, within a predetermined distance thereof) a first upper side of the user interface in a third orientation. In some examples, upon determining that the user interface of the electronic device is in a fourth orientation with respect to the biometric sensor-the user interface in the fourth orientation has a second top side-(4120), the electronic device in the fourth orientation. Displays a first progress indicator in proximity to (eg, adjacent to, near, within a predetermined distance thereof) a second upper side of the user interface of, and the third orientation is different from the fourth orientation. In some examples, the first progress indicator is displayed on the display at a location closest to or proximate to the biometric sensor (eg, near, near, within a predetermined distance thereof). Displaying the first progress indicator near the top of the display regardless of orientation ensures that the user is more likely to recognize the feedback provided to the user (eg, a progress indicator). Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

In some examples, the electronic device (eg, 100, 300, 500, 4000) displays, on a display (eg, 4002), a second progress indicator (eg, 4024, 4026, 4038, 4040) of the electronic device. . In some examples, the second progress indicator provides an indication of a current state of the electronic device (eg, a locked state, an unlocked state, performing biometric authentication, an error state). In some examples, the first progress indicator is a second progress indicator. In some examples, the second progress indicator includes a first portion (e.g., an indication that the electronic device is performing biometric authentication using a biometric sensor (e.g., 4024) (e.g., rotating rings)) and the first portion. A different second part (e.g., an indication of an error condition or error condition (e.g., 4026), an indication of the current locked or unlocked state of the electronic device (e.g., a lock icon (e.g., 4038)), an unlock icon (e. ))). In some examples, upon determining that the second progress indicator is displayed in a location proximate the first portion of the electronic device, the electronic device displays an error as part of the animation after the first portion and before the second portion (eg, 4028). Displays.

In some examples, the electronic device (e.g., 100, 300, 500, 4000) is, on a display (e.g., 4002), in proximity to a third location within the user interface (e.g., one side (e.g., lower side) of the user interface). A home affordance (e.g., 4044) (e.g., when performed, an indication of the location of a gesture that results in displaying the home screen, such as a swipe upward gesture from the edge of the display or a tap gesture on the affordance). Display. In some examples, upon determining that an error indication (eg, 4028) is displayed in the third location, the electronic device stops displaying the home affordance (eg, 4044) while displaying the error indication in the third location. Stopping the display of the home affordance while displaying the error indication allows the user to quickly recognize that the home affordance is not accessible because there is an error and prompts the user to take further action to correct the error condition. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

In some examples, after stopping displaying the home affordance (e.g., 4044), the electronic device (e.g., 100, 300, 500, 4000) may cause the biometric sensor (e.g., 4003) to display biometric information about the user of the device. It detects the correction of the error condition that prevents acquiring. In some examples, the electronic device detects the absence of an error condition after displaying an error indication (eg, 4028) in a third location. In some examples, in response to detecting a correction of the error condition, the electronic device displays, on a display (eg, 4002), the home affordance at a third location in the user interface (eg, and an error indication (eg, 4028). ) To stop displaying).

In some examples, the electronic device (e.g., 100, 300, 500, 4000) is an input at a location (e.g., adjacent to, near, within a predetermined distance thereof) to a first portion of the electronic device. , Palms, fingers). In some examples, in response to detecting an input at a location proximate the first portion of the electronic device, the electronic device displays, on the display, an error indication (eg, 4028) at a different location. In some examples, the different location is a location where no input is detected. In some examples, prior to displaying the error indication at the new location, the electronic device determines a different location based on the location of the input to the display. In some examples, the different location is proximate a location proximate the first portion of the electronic device. In some examples, the error indication is initially displayed at a first location proximate the first portion of the electronic device and then moved to a different location. In some examples, the error indication is initially displayed at a selected location away from any areas of the display that are known to be obscured (eg, obscured by a detected touch input). Displaying the error indication at different locations depending on the location of the input (e.g., the user's hand) provides feedback to the user regarding the current state of the device (e.g., that an error condition is preventing successful biometric authentication) and Prompts the user to take further action to correct the error condition. Also, by adjusting the position, the device ensures that the error indication is visible to the user, and thus the user is more likely to take a corrective action on the device. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, the electronic device (e.g., 100, 300, 500, 4000) is on a display (e.g., 4002) in proximity to (e.g., adjacent to, near, a predetermined portion of the electronic device). A first transaction interface (e.g., 4014) at a location within a distance (e.g., a transaction (or payment) that is separate from (or overlaid on top of) the user interface and contains transaction information such as credit card number, billing address, etc. Interface). In some examples, the first transaction interface is on receiving an input (e.g., 4010) corresponding to an affordance (e.g., 4012) (e.g., affordance to make a payment or complete a transaction) of the user interface (e.g., 4008). It is displayed in response.

In some examples, displaying the first transaction interface (eg, 4014). The first transaction interface includes displaying an animation transitioning (eg, transforming) from an initial position substantially centered with respect to the display to a position proximate the first portion of the electronic device. In some examples, the animation includes displaying the first trading interface (eg, maintaining its display) while the first trading interface transitions (eg, transforms) from an initial location to a location proximate a first portion of the electronic device. Includes. In some examples, the animation includes a visual effect in which the first transaction interface appears to float during the transition.

In some examples, the electronic device (eg, 100, 300, 500, 4000) prompts (eg, 4016) to provide, on a display (eg, 4002), one or more activations of a hardware button (eg, 4004) of the electronic device. ) Is displayed. In some examples, the electronic device prompts the user by displaying “double click for Apple Pay”. In some examples, the prompt is displayed adjacent to the button. In some examples, the prompt is displayed when the device is not receiving any indication that the transaction terminal is nearby and is requesting transaction credentials, but is displaying the transaction user interface area (e.g., 4014) (e.g., A prompt is displayed to provide one or more activations of the button before the device is placed within the NFC field of the NFC reader requesting payment information). In some examples, the hardware button is a mechanical button or a solid state button. In some examples, the button is a switch or any other type of toggle. In some examples, the button has a fixed position relative to the electronic device, in particular relative to the display of the electronic device, such that the electronic device can display prompts based on the position of the button. In some examples, the button is a solid state button that operates in response to a capacitive and/or resistive touch and/or responds to changes in the strength of the input without having a mechanical switch pressed to activate the button, and instead, the input Monitors whether the intensity of the solid state button exceeds the intensity threshold corresponding to the activation of the solid state button. In some examples, the electronic device (e.g., 100, 300, 500, 4000) receives one or more activations (e.g., 4020) of a hardware button of the electronic device, and in response to receiving one or more activations of the hardware button, The electronic device displays, on a display (eg, 4002), an authentication progress indicator (eg, 4022, 4024, 4030, 4032, 4034). In some examples, displaying the authentication progress indicator includes displaying an animation in which the authentication progress indicator transitions from the location of the prompt (eg, 4016) to the final position of the authentication progress indicator. In some examples, the authentication indicator provides the status of the authentication (eg, in progress, successful, unsuccessful). In some examples, the animation includes displaying the authentication progress indicator (eg, maintaining its display) while the authentication progress indicator transitions (eg, transforms) from the location of the prompt to the final location. In some examples, the animation includes a visual effect where the authentication progress indicator appears to slide out of the prompt. In some examples, the authentication progress indicator is displayed (or overlaid on) with a user interface (eg, 4014) (or a transactional user interface area). Prompting the user to activate the hardware button guides the user to perform an action to complete the transaction on the device. Prompting the user in this way improves the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate inputs when operating and/or interacting with the device and reducing user mistakes). This additionally reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently. Displaying the authentication progress indicator provides feedback to the user regarding the status of the authentication. Improved feedback improves the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide appropriate inputs when operating and/or interacting with the device and reducing user mistakes). This additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (e.g., 100, 300, 500, 4000) corresponds to a first application (e.g., 4006, 4008) in a first region (e.g., 4007, 4009), on a display (e.g., 4002). ) And simultaneously display a second application (e.g., corresponding to 4006, 4008) in a second area (e.g. 4007, 4009), and the second application is adjacent to the first application (e.g., next to it, Close to him, within his predetermined distance) (4122). In some examples, the electronic device displays (4124) a second transaction interface (eg, 4014) on the display. In some examples, the second trading interface is the first trading interface. In some examples, the second transaction interface is displayed overlaid on the first application and/or the second application. In some examples, upon determining that the second transactional interface corresponds to the first application (4126), the electronic device modifies a first visual characteristic (eg, ambiguity, darkness, blurryness) of the first application. In some examples, the second transaction interface includes information about a product or service (or transaction) being purchased (or completed) using (or through) the second transaction interface. Corresponds to In some examples, this determination is made while displaying the second transaction interface. In some examples, upon determining that the second transaction interface corresponds to the second application (4130), the electronic device (e.g., 100, 300, 500, 4000) is the first visual characteristic of the second application (e.g., ambiguity, darkness). , Blur). In some examples, the second transaction interface includes information about a product or service (or transaction) being purchased (or completed) using (or through) the second transaction interface. Corresponds to In some examples, this determination is made while displaying the second transaction interface.

In some examples, modifying the first visual characteristic of the first application includes modifying the second visual characteristic of the second application. In some examples, modifying the second visual characteristic of the second application increases the darkening and/or to a greater extent (or amount) the blur radius of the blur effect applied to the second application than for the first application. Includes increasing to. In some examples, modifying the first visual characteristic of the second application includes modifying the second visual characteristic of the first application. In some examples, modifying the second visual characteristic of the first application increases the darkening and/or to a greater extent (or amount) the blur radius of the blur effect applied to the first application than for the second application. Includes increasing to. Modifying the visual characteristics of one application to a greater extent than for the other provides feedback to the user as to which application is more relevant at that time. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

In some examples, modifying the first visual characteristic of the first application means that the second area is closer to (eg, closer to) a first portion of the electronic device (eg, a biometric sensor) than the first area. And displaying the first application in the second area according to the determination (4128). In some examples, displaying the first application in the second area includes stopping displaying the first application in the first area. In some examples, modifying the first visual characteristic of the second application means that the first area is closer to (eg, closer to) a first portion of the electronic device (eg, a biometric sensor) than the second area. And displaying the second application in the first area according to the determination (4132). In some examples, displaying the second application in the first area includes stopping displaying the second application in the second area. In some examples, the electronic device displays an animation in which the first application swaps the second application and places.

In some examples, upon determining that the second transaction interface (eg, 4014) corresponds to the first application, the second transaction interface includes an indication of the first application (eg, the name of the first application). In some examples, according to the determination that the second transaction interface corresponds to the second application, the second transaction interface includes an indication of the second application (eg, the name of the second application).

Note that the details of the processes described above with respect to method 4100 (eg, FIGS. 41A-41C) are also applicable in a similar manner to the methods described above/below. For example, method 3700, method 3900, and/or method 4300 optionally include one or more of the features of the various methods described above with respect to method 4100. For example, as described in method 4100, error icon 4028 indicates that the biometric sensor is Can be used to indicate being disturbed. For brevity, these details are not repeated below.

42A-42P illustrate example user interfaces for orienting a device to register a biometric feature (eg, a face for later use in biometric authentication), in accordance with some examples. The user interfaces of these figures are used to illustrate the processes described below, including those of FIGS. 43A-43C.

42A illustrates an electronic device 4200 (eg, portable multifunction device 100, device 300, device 500). In the illustrative examples illustrated in FIGS. 42A-42P, electronic device 4200 is a tablet computer. In other examples, the electronic device 4200 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 4200 includes a display 4202, one or more input devices (eg, a touchscreen, buttons, and microphone of the display 4202), and a wireless communications radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 42A, the electronic device includes a biometric sensor 4203. In some examples, the biometric sensor is one or more biometric sensors, which may include a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 4203 is biometric sensor 703. In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector) such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate a biometric feature (eg, a face) during capture of biometric data of the biometric features by one or more biometric sensors.

In FIG. 42A, a user wishes to set up biometric (eg, facial) authentication on electronic device 4200. Successfully setting up biometric authentication on the device allows the user to perform actions on the device that require authentication (eg, unlocking the device) by presenting the user's face for biometric authentication. To set up biometric authentication on an electronic device, the user must first register her face. The process for registering a face may include some or all of the features (or processes) of FIGS. 11A-11O.

As illustrated in FIG. 42A, the electronic device 4200 displays an introductory user interface (UI) 4206 with an initiation affordance 4208. The electronic device 4200 receives an input 4210 at an initiation affordance 4208 that initiates the process of registering the user's face for biometric authentication.

In FIG. 42B, in response to receiving the input 4210 at the initiation affordance 4208, the electronic device 4200 determines that the orientation of the device is not suitable for registering the user's face. In some examples, a suitable orientation for enrolling the user's face is a vertical orientation that is upright (e.g., vertical), where the vertical orientation is the top of the device (e.g., the side of the device furthest from the ground). ). In response to determining that the orientation of the device is not suitable for registering the user's face, the electronic device 4200 displays one or more prompts prompting the user to orient the electronic device 4200 to the appropriate orientation (e.g., , Replacing the display of the introduction UI 4206 with it). More specifically, the electronic device 4200 determines that the electronic device 4200 is in a substantially horizontal orientation (eg, approximately parallel to the ground). Consequently, as shown in FIG. 42B, electronic device 4200 displays a prompt 4212A prompting the user to lift electronic device 4200 to an upright position.

In some examples, in response to receiving input 4210 at initiation affordance 4208, the electronic device determines that the orientation of the device is suitable for enrolling the user's face. In some examples, upon determining that the orientation is suitable for registering the user's face, the electronic device 4200 automatically initiates a process for registering the user's face, as described below with respect to FIG. 42D. do.

In Figure 42C, in response to determining that the electronic device 4200 is in an upright position but not in a portrait orientation (e.g., the user has lifted the device from the table in response to prompt 4212A), the electronic device 4200 Display a prompt 4212B prompting the user to rotate the electronic device 4200 in a vertical orientation (e.g., having a biometric sensor 4203 on top) (e.g., replacing the display of prompt 4212A with it. box). Specifically, prompt 4212B prompts the user to rotate in a specific direction such that minimal rotation is required to achieve the desired (or suitable) orientation. For example, rotating the electronic device 4200 clockwise requires less rotation to achieve the desired orientation than rotating the device counterclockwise.

In FIG. 42D, in response to determining that the electronic device 4200 is in a suitable orientation, the electronic device 4200 automatically initiates a process for registering the user's face. As illustrated in FIGS. 42D to 42F, after initiating a process for registering the user's face, the electronic device 4200 displays the face registration UI 4214. The face registration UI 4214 includes some or all of the features of the face registration UI 1104.

In Figure 42G, after successfully completing the registration of the user's face, the electronic device 4200 displays a scan completion interface 4216 (e.g., replacing the display of the face registration UI 4214 with it), which Includes continuation affordance 4218. The scan complete interface 4216 includes some or all of the features of the scan complete interface 1130.

After completing registration of the user's face, a second iteration of the registration process is performed without requiring the user to reorient the device. While displaying the scan complete interface 4216, as shown in FIG. .

In FIG. 42H, in response to receiving input 4220 at continue affordance 4218, electronic device 4200 undergoes a second iteration of the registration process similar to the processes described above with respect to FIGS. 42D-42F. Start. Electronic device 4200 initiates a second iteration without prompting the user to reorient the device to an orientation different from its current orientation. Initiating the registration process of the second iteration includes displaying the second face registration UI 4222. The second face registration UI 4222 includes some or all of the features of the second face registration UI 1138.

In FIG.42I, after successfully completing the registration process of the second iteration, the electronic device 4200 displays a second scan completion interface 4224 (e.g., display of the second face registration UI 4222 to it). Replaced), which includes affordance 4226 to continue. The second scan complete interface 4224 includes some or all of the features of the second scan complete interface 1156. As illustrated in FIG. 42I, electronic device 4200 receives input 4228 at continue affordance 4226.

In FIG. Replace the display with it), providing an indication to the user that biometric authentication has been successfully set up on electronic device 4200. The registration completion interface 4230 includes some or all of the features of the registration completion interface 1166.

In FIG. 42K, after biometric authentication is set up on the electronic device 4200, the user may unlock the electronic device 4200 using biometric authentication by presenting the user's face to the biometric sensor 4203. (E.g., transitioning the device from a locked state to an unlocked state). In some examples, the user initiates biometric authentication to unlock the device by lifting (or raising) the electronic device 4200 (eg, from a substantially horizontal orientation). While electronic device 4200 is being raised, electronic device 4200 detects a change in the orientation of the device and, in response, initiates biometric authentication to unlock the device. While the electronic device 4200 is in the locked state, the electronic device 4200 has a biometric sensor indicator 4234 that provides an indication of the location of the biometric sensor 4203 to the user and the electronic device 4200 is locked Note that it displays a locked state interface 4232 that includes a lock icon 4236 that provides an indication that it is in a state. In some examples, electronic device 4200 does not display biometric sensor indicator 4234 while electronic device 4200 is in a locked state.

As shown in FIG.42L, when the electronic device 4200 initiates biometric authentication, the user holds the electronic device 4200 such that the user's face is outside the field of view 4238 of the biometric sensor 4203. . In some examples, the user's face is outside the field of view 4238 when more than a critical portion of the face is outside the field of view. In some examples, the user's face is outside the field of view 4238 when no face is detected within the field of view. While attempting to biometrically authenticate the user's face, the electronic device 4200 may not obtain sufficient information about the user's face using the biometric sensor 4203. As a result, the electronic device 4200 does not have enough information for comparison with stored authorized credentials that were generated from the registration process described above with respect to FIGS. 42D-42J.

In FIG. . (Error indication 4240 includes some or all of the features of error indication 3814G.) Additionally, upon determining that the user's face is outside the field of view 4238, the electronic device 4200 automatically performs authentication Do not retry. In some examples, electronic device 4200 also displays biometric sensor indicator 4234. In some examples, if sufficient information has been obtained, but authentication nevertheless fails (e.g., the obtained information did not match the stored authorized credentials), the electronic device 4200 automatically retries the biometric authentication. do.

As shown in FIG.42N, after learning from the error indication 4240 that the user's face is outside the field of view 4238 of the biometric sensor 4203, the user Move the face into the field of view 4238. In response to detecting that the cause of the error indication 4240 has been corrected (eg, detecting the user's face exceeding a threshold amount), the electronic device 4200 automatically retries the biometric authentication. When it is determined that authentication is successful (e.g., information obtained using the biometric sensor 4203 is matched with stored authorized credentials) as a result of retrying biometric authentication, the electronic device 4200 is locked. Transition from to the unlocked state. After transitioning to the unlocked state, the electronic device displays the unlocked state interface 4242.

In some examples, while displaying the unlocked status interface 4242, the electronic device 4200 requests access to restricted content on the device (e.g., home screen 4244, most recently used application in Figure 42O). (For example, an upward swipe starting from within an area adjacent to the lower edge of the display 4202) is received. In response to receiving a request to access restricted content, the electronic device 4200, when activated, displays a home screen 4244 including a plurality of icons that, when activated, launch an application corresponding to the activated icon. In some examples, instead of displaying the home screen 4244, the electronic device 4200 displays the most recently used application (eg, the application's user interface). It is noted that the above processes described above with respect to FIGS. 42K-42O are performed when the electronic device 4200 is in a landscape orientation. However, in some examples, some or all of the processes described above with respect to FIGS. 42K-42N may be performed when the electronic device 4200 is in a vertical orientation.

In some examples, instead of transitioning to the unlocked state as described in connection with FIG. 42N, the electronic device 4200 remains locked if the acquired information does not match the stored authorized credentials. . In some examples, as shown in FIG. 42P, upon determining that the obtained information does not match the stored authorized credentials, the electronic device 4200 causes the locked state interface 4232 to simulate a “shake” effect. The locked state interface is displayed while alternating positions of the lock icon 4236, thereby providing an indication to the user that the electronic device 4200 is kept locked.

43A-43C are flow charts illustrating a method for orienting a device to register a biometric feature (eg, a face for later use in biometric authentication), in accordance with some examples. The method 4300 includes a display (e.g., 4202) and one or more biometric sensors (e.g., 4203) (e.g., a first biometric sensor of a device having a plurality of biometric sensors) (e.g., a fingerprint sensor, a contactless biometric sensor). (E.g., a biometric sensor that does not require physical contact, e.g., a thermal or optical facial recognition sensor), an iris scanner) and is performed in an electronic device (e.g., 100, 300, 500, 4200). In some embodiments, the one or more biometric sensors include one or more cameras. Some operations of the method 4300 are selectively combined, the order of some operations is selectively changed, and some operations are selectively omitted.

As described below, method 4300 provides an intuitive method for prompting the user to orient the device to register biometric features. This method reduces the user's cognitive burden for registering biometric features (eg, faces for later use in biometric authentication), thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, enabling a user to register biometric features faster and more efficiently saves power and increases the time between battery charges.

An electronic device (e.g., 100, 300, 500, 4200) displays, on a display (e.g., 4202), a biometric registration user interface (e.g., 4206) for initiating biometric registration with one or more biometric sensors. Do (4302).

While displaying the biometric registration user interface (4304), the electronic device inputs (e.g., 4210) (e.g., touch gesture (e.g., tap), spoken user input) corresponding to the request to initiate biometric registration. ) Is received.

In response to receiving the input (e.g., 4210) (4306) and the orientation of the electronic device (e.g., the current orientation, the orientation of the electronic device at (or near) the time of the input) satisfies the set of registration criteria. Upon determining 4308, the electronic device initiates a process for registering the biometric feature with one or more biometric sensors (eg, 4203). In some examples, the set of registration criteria is whether the electronic device is oriented in a vertical orientation with respect to a frame of reference (e.g., Earth, ground), one or more biometric sensors are Or whether the electronic device is oriented so that it is not approximately parallel to the ground. In some examples, the set of registration criteria is defined by whether the electronic device is in a predetermined (e.g., appropriate) orientation with respect to the biometric feature (e.g., face) (e.g., defined by the main plane of the device (e.g., display of the device). Plane) faces the biometric feature). In some examples, initiating a process for registering a biometric feature includes using one or more biometric sensors to capture data corresponding to the user's face.

In response to receiving an input (e.g., 4210) (4306), and upon a determination that the orientation of the electronic device does not satisfy the set of registration criteria (4322), the electronic device determines the orientation of the electronic device. Output one or more prompts (eg, 4212A, 4212B) (eg, visual, audio, and/or tactile prompt) to change to a different orientation that satisfies the set. Outputting one or more prompts if the set of registration criteria is not satisfied provides feedback to the user about corrective actions to take to continue registering the biometric feature. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

In some examples, outputting the one or more prompts includes outputting a first prompt (eg, 4212A) to orient the electronic device to an initial orientation (4324). In some examples, the initial orientation is an orientation such that the electronic device is not approximately parallel to the ground. In some examples, the initial orientation is an orientation that causes the electronic device to be approximately parallel to the force of gravity. In some examples, the set of registration criteria includes a requirement that the major plane of the device must be substantially aligned with a predetermined plane (eg, a plane substantially normal to the ground) such that the display of the device is substantially perpendicular. In some examples, the set of registration criteria is such that the main plane of the device is a (second) predetermined plane (e.g., a plane substantially parallel to the ground) such that the device does not sit on a horizontal surface while attempting to register the biometric feature. ) And not substantially aligned. In some examples, outputting the one or more prompts, following outputting the first prompt (e.g., 4212A), is followed by a second prompt (e.g., a second prompt (e.g., 4212B), wherein the first prompt is different from the second prompt (4326). In some examples, the electronic device outputs a first prompt without outputting a second prompt. In some examples, the electronic device stops outputting the first prompt when the orientation of the electronic device changes to the initial orientation. In some examples, the electronic device outputs a second prompt when the orientation of the electronic device changes to the initial orientation. In some examples, the electronic device outputs a second prompt without outputting the first prompt (eg, when the electronic device is already in an initial orientation). In some examples, the set of registration criteria is whether the electronic device is oriented in a vertical orientation with respect to a frame of reference (e.g., Earth, ground), one or more biometric sensors are Or whether the electronic device is oriented so that it is not approximately parallel to the ground. Outputting the first prompt without outputting the second prompt provides improved feedback to the user as it reduces the chance of confusion when the user is taking corrective actions to trigger registration of the biometric feature. Providing improved visual feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). This makes the device more efficient, which in addition, reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

In some examples, outputting one or more prompts outputs a third prompt (e.g., 4212B) to rotate the electronic device (e.g., about an axis perpendicular to the electronic device) in a different orientation that satisfies the set of registration criteria. And the third prompt is based on an orientation of the electronic device while receiving the input. In some examples, the third prompt is the second prompt. In some examples, upon determining that the orientation of the electronic device is the first orientation, the electronic device outputs a first rotation prompt to rotate the electronic device to a different orientation that satisfies the set of registration criteria. In some examples, according to the determination that the orientation of the electronic device is a second orientation different from the first orientation, the electronic device outputs a second rotation prompt to rotate the electronic device to a different orientation that satisfies the set of registration criteria, and , The second rotation prompt is different from the first rotation prompt. In some examples, the first rotation prompt or the second rotation prompt is a second prompt. In some examples, the set of registration criteria is whether the electronic device is oriented in a vertical orientation with respect to a frame of reference (e.g., Earth, ground), one or more biometric sensors are Or whether the electronic device is oriented so that it is not approximately parallel to the ground. Outputting a prompt based on the orientation of the device provides feedback to the user on an efficient process to achieve a suitable orientation of the device to register the biometric features. Providing improved feedback to the user improves the operability of the device and improves the user-device interface (e.g., by helping the user provide appropriate inputs and reducing user mistakes when actuating/interacting with the device). It makes it more efficient, which in addition reduces the device's power usage and improves battery life by enabling users to use the device more quickly and efficiently.

In some examples, outputting the one or more prompts places the electronic device (e.g., about an axis perpendicular to the electronic device) in a different orientation that satisfies the set of registration criteria (e.g., the major plane of the device (e.g., And outputting a fourth prompt (e.g., 4212B) to rotate (along an axis parallel to the plane defined by the display), the third prompt being a predetermined plane (e.g., a plane substantially normal to the ground; Based on the alignment of the main plane of the device (eg, a plane defined by the display of the device) with respect to a plane substantially parallel to. In some examples, the electronic device outputs a fourth prompt upon determining that the electronic device is oriented substantially parallel to the ground. In some examples, the set of registration criteria includes a requirement that the major plane of the device must be substantially aligned with a predetermined plane (eg, a plane substantially normal to the ground) such that the display of the device is substantially perpendicular. In some examples, the set of registration criteria is such that the main plane of the device is a (second) predetermined plane (e.g., a plane substantially parallel to the ground) such that the device does not sit on a horizontal surface while attempting to register the biometric feature. ) And not substantially aligned.

In some examples, following initiating a process for registering a biometric feature (e.g., following successful registration of the biometric feature), the electronic device (e.g., 100, 300, 500, 4200) requires authentication. (E.g., a request to unlock the device (e.g., perform a swipe from a predefined location)) to perform an action to be performed. In some examples, the electronic device receives a request to perform an operation requiring authentication subsequent to performing (or completing) biometric registration. In some examples, the electronic device has one or more prompts (e.g., 4212A, 4212B) (e.g., visual, audio, and/or tactile prompt) to change the orientation of the electronic device to a different orientation that satisfies a set of registration criteria. A request to perform an operation requiring authentication is received following the output of. In some examples, in response to receiving a request to perform an operation requiring authentication, the electronic device authenticates (e.g., data by one or more biometric sensors) using one or more biometric sensors (e.g., 4203). Including obtaining a) In some examples, after attempting authentication using one or more biometric sensors (e.g., not attempting successfully), and (e.g., due to the face being outside the field of view (e.g., 4238)), one or more biometric sensors In accordance with a determination that the data obtained by means corresponds to a biometric feature less than a threshold amount (eg, part of the face/fingerprint, not the entire face/fingerprint), the electronic device withholds to retry authentication. In some examples, the electronic device withholds to automatically retry authentication. In some examples, after attempting authentication using one or more biometric sensors, the electronic device fails the biometric authentication more than a predetermined number of times (e.g., 5, 10, 15) since the last successful authentication by the device. Retrying the authentication is withheld due to what has been done. In some examples, the electronic device is prevented from retrying authentication without an explicit request to perform an action that requires authentication (e.g., a request to unlock the device (e.g., perform a swipe from a predefined location)). Withhold. In some examples, after the initial attempt at authentication is unsuccessful, the electronic device re-enters biometric authentication if a determination is not made that the data acquired by one or more biometric sensors correspond only to a portion of the biometric feature. Try. Withholding retrying authentication when less than a threshold amount of biometric features is obtained avoids the user consuming an allowed number of attempts for repeated requests (e.g., repeated requests of the same type). , Thereby preserving at least one attempt for requests for other actions requiring biometric authentication. Preserving at least one attempt improves the operability of the device and makes the user-device interface more efficient (e.g., by avoiding exhaustion of authentication attempts for repeated similar requests), which additionally allows the user to It reduces the power usage of the device and improves battery life by making it possible to use the device more quickly and efficiently.

In some examples, after attempting to authenticate using one or more biometric sensors (e.g., not attempting successfully), and the data obtained by the one or more biometric sensors is a biometric characteristic of at least a threshold (e.g., exceeding). According to the determination that it corresponds to negative, the electronic device retries authentication. Automatically retrying authentication when a threshold amount of biometric features is acquired gives the user the ability to attempt authentication when conditions are appropriate without requiring the user to explicitly request that authentication be retried. Performing an action when a set of conditions is met without requiring additional user input (e.g., by helping the user provide appropriate inputs when actuating/interacting with the device and reducing user mistakes) It improves the operability of the device (e.g., increases the chances of successful authentication) and makes the user-device interface more efficient, which additionally allows the user to use the device more quickly and efficiently, thereby reducing the power usage of the device. And improve battery life.

In some examples, upon the determination that authentication is successful resulting from retrying authentication, the electronic device (eg, 100, 300, 500, 4200) performs an action corresponding to the request. In some examples, upon a determination that authentication is not successful resulting from retrying authentication, the electronic device withholds from performing the operation corresponding to the request. In some examples, authentication includes credentials to which biometric information captured using one or more biometric sensors has been applied (e.g., a biometric feature (e.g., face, fingerprint) that is authorized for use in biometric authentication). It is successful when responding to (or matching with stored information about). In some examples, authentication includes credentials to which biometric information captured using one or more biometric sensors has been applied (e.g., a biometric feature (e.g., face, fingerprint) that is authorized for use in biometric authentication). It is unsuccessful when it does not correspond to (or does not match the stored information about). Retention of performing an operation when authentication is unsuccessful improves device security by preventing unauthorized and/or unauthorized access to the device. Improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and actions, and additionally, the power usage of the device by enabling the user to use the device more efficiently. And improve battery life.

In some examples, outputting one or more prompts (e.g., 4212A, 4212B) (e.g., visual, audio, and/or tactile prompt) to change the orientation of the electronic device to a different orientation that satisfies a set of registration criteria. Following that, the electronic device (eg, 100, 300, 500, 4200) detects that the current orientation of the electronic device satisfies the set of registration criteria (4328). In some examples, in response to determining that the current orientation of the electronic device satisfies the set of registration criteria (4330), the electronic device initiates a process for registering a biometric feature with one or more biometric sensors. In some examples, the set of registration criteria is whether the electronic device is oriented in a vertical orientation with respect to a frame of reference (e.g., Earth, ground), one or more biometric sensors are Or whether the electronic device is oriented so that it is not approximately parallel to the ground. In some examples, the set of registration criteria includes a requirement that the major plane of the device must be substantially aligned with a predetermined plane (eg, a plane substantially normal to the ground) such that the display of the device is substantially perpendicular. In some examples, the set of registration criteria is such that the main plane of the device is a (second) predetermined plane (e.g., a plane substantially parallel to the ground) such that the device does not sit on a horizontal surface while attempting to register the biometric feature. ) And not substantially aligned. In some examples, the set of registration criteria is defined by whether the electronic device is in a predetermined (e.g., appropriate) orientation with respect to the biometric feature (e.g., face) (e.g., defined by the main plane of the device (e.g., display of the device). Plane) faces the biometric feature).

In some examples, initiating a process for registering a biometric feature with one or more biometric sensors includes successfully registering the biometric feature. In some examples, following successful registration of the biometric feature, the electronic device (e.g., 100, 300, 500, 4200) is prompted to register the biometric feature for a second time with one or more biometric sensors (e.g., 4222) is output (4312). In some examples, the electronic device outputs a prompt to register the biometric feature without prompting to change the orientation of the electronic device.

In some examples, initiating a process for registering a biometric feature with one or more biometric sensors includes successfully registering the biometric feature (4310). In some examples, following successful registration of the biometric feature, the electronic device (e.g., 100, 300, 500, 4200) requests to perform an operation requiring authentication (e.g., unlock the device (e.g., in advance). A request to perform a swipe at a defined location), a request to access a home screen (e.g., 4244), is received (4314). In some examples, in response to receiving (4316) a request to perform an operation requiring authentication, and data obtained by one or more biometric sensors correspond to a registered biometric feature (e.g., with Match), the electronic device performs an operation requesting authentication (4318). In some examples, in response to receiving a request to perform an operation requiring authentication, the electronic device performs (or attempts to authenticate) authentication using one or more biometric sensors (eg, 4203). In some examples, in response to receiving a request to perform an operation requiring authentication (4316), and the data obtained by the one or more biometric sensors does not correspond to the registered biometric feature (e.g., Does not match), the electronic device suspends performing the operation requesting authentication (4320).

It is noted that the details of the processes described above with respect to method 4300 (eg, FIGS. 43A-43C) are also applicable in a similar manner to the methods described above/below. For example, method 3700, method 3900, and/or method 4100 optionally include one or more of the features of the various methods described above with respect to method 4300. For example, the processes described in method 4300 for registering a biometric feature are biometric authentication, such as retrying biometric authentication in a passcode input user interface, as described in method 3700. It can be used to register faces for future use in As another example, the registered face may be used to authorize payment for goods, as described in method 4100. For brevity, these details are not repeated below.

The foregoing description has been described with reference to specific embodiments, for purposes of explanation. However, the exemplary discussions above are not intended to clarify or limit the invention to the precise forms disclosed. Many modifications and variations are possible in terms of the above teachings. The embodiments have been selected and described in order to best explain the principles of the techniques and their practical applications. Thus, it will be possible for those skilled in the art to make the best use of the techniques and various embodiments with various modifications as appropriate for the particular use contemplated.

While the disclosure and examples have been sufficiently described with reference to the accompanying drawings, it should be noted that various changes and modifications will be apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of the disclosure and examples as defined by the claims.

As noted above, one aspect of the present technology is the collection and use of data available from various sources to improve the delivery of invited content or any other content that the user may be interested in, to users. . The present disclosure contemplates that in some cases, such collected data may include personal information data that may be used to uniquely identify, contact, or locate a particular individual. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, home addresses, or any other identifying information.

The present disclosure recognizes that the use of such personal information data in the present technology may be used to benefit users. For example, personal information data can be used to deliver targeted content of greater interest to users. Thus, the use of such personal information data enables calculated control of the delivered content. In addition, other uses for personal information data that benefit the user are also contemplated by the present disclosure.

The present disclosure further contemplates that entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information data will comply with well-established privacy policies and/or privacy practices. In particular, such entities should implement and continue to use privacy policies and practices that are generally recognized as meeting or exceeding industrial or administrative requirements for keeping personal data data private and secure. For example, personal information from users must be collected for the legitimate and appropriate uses of the entity, and must not be shared or sold outside of these legitimate uses. In addition, such collection should only take place after receiving informed consent from users. Additionally, such entities will take any necessary steps to protect and secure access to such personal information data and ensure that others with access to personal information data adhere to their privacy policies and procedures. . In addition, such entities may themselves be evaluated by third parties to demonstrate their adherence to widely recognized privacy policies and practices.

Notwithstanding the foregoing, the present disclosure also contemplates embodiments in which a user selectively blocks the use of, or access to, personal information data. That is, the present disclosure contemplates that hardware and/or software elements may be provided to prevent or block access to such personal information data. For example, in the case of advertising delivery services, the technology may be configured to allow users to select "I agree" or "I do not agree" of participation in the collection of personal information data during registration for the service. . In another example, users may choose not to provide location information for target content delivery services. In another example, users may choose not to provide accurate location information but allow delivery of location area information.

Thus, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure recognizes that various embodiments may also be implemented without the need to access such personal information data. Also consider. That is, various embodiments of the present technology are not rendered inoperable due to a lack of all or part of such personal information data. For example, the content may be based on a minimum amount of personal information or non-personal information such as content requested by a device associated with the user, other non-personal information available for content delivery services, or publicly available information It can be selected and communicated to users by inferring a preference based on it.

Claims (13)

As a method,
In an electronic device, the electronic device has a display and one or more biometric sensors,
Displaying a biometric registration user interface for initiating biometric registration using the one or more biometric sensors on the display;
Receiving an input corresponding to a request to initiate biometric registration while displaying the biometric registration user interface; And
In response to receiving the input:
Initiating a process for registering a biometric feature using the one or more biometric sensors upon determining that the orientation of the electronic device satisfies a set of registration criteria; And
In response to a determination that the orientation of the electronic device does not satisfy the set of registration criteria, outputting one or more prompts to change the orientation of the electronic device to another orientation that satisfies the set of registration criteria
How to include. The method of claim 1,
The step of outputting the one or more prompts,
Outputting a first prompt to orient the electronic device to an initial orientation; And
Following the step of outputting the first prompt, outputting a second prompt to orient the electronic device in the different orientation that satisfies the set of registration criteria-the first prompt is different from the second prompt Ha-containing, method. The method of claim 1,
The step of outputting the one or more prompts includes outputting a third prompt to rotate the electronic device in the other orientation that satisfies the set of registration criteria, the third prompt receiving the input. Based on the orientation of the electronic device during. The method of claim 1,
The outputting of the one or more prompts includes outputting a fourth prompt to rotate the electronic device to the other orientation that satisfies the set of registration criteria, wherein the fourth prompt is on a predetermined plane. Based on the alignment of the major plane of the device with respect to. The method of claim 1,
Subsequent to initiating a process for registering the biometric feature, receiving a request to perform an operation requiring authentication;
In response to receiving a request to perform an operation requiring authentication, attempting authentication using the at least one biometric sensor; And
After the step of attempting authentication using the at least one biometric sensor, in accordance with a determination that the data obtained by the at least one biometric sensor corresponds to a biometric feature less than a threshold amount, retrying the authentication is suspended. Steps to
How to further include. The method of claim 5,
After the step of attempting authentication using the at least one biometric sensor, retrying authentication according to a determination that the data obtained by the at least one biometric sensor corresponds to the biometric feature of the threshold amount or more. How to further include. The method of claim 6,
The step of retrying the authentication,
Performing an operation corresponding to the request according to a determination that authentication is successful by retrying authentication; And
In accordance with a determination that authentication is not successful by retrying authentication, suspending the step of performing an operation corresponding to the request
How to include. The method of claim 1,
Subsequent to outputting one or more prompts to change the orientation of the electronic device to another orientation that satisfies the set of registration criteria:
Detecting that the current orientation of the electronic device satisfies the set of registration criteria; And
In response to determining that the current orientation of the electronic device satisfies the set of registration criteria, initiating a process for registering the biometric feature using the one or more biometric sensors. . The method of claim 1,
Initiating a process for registering a biometric feature using the one or more biometric sensors includes successfully registering the biometric feature,
The method further comprises, following the step of successfully registering the biometric feature, outputting a prompt to register the biometric feature for a second time using the one or more biometric sensors. . The method of claim 1,
Initiating a process for registering a biometric feature using the one or more biometric sensors includes successfully registering the biometric feature, the method further comprising:
Following the step of successfully registering the biometric feature, receiving a request to perform an operation requiring authentication;
In response to receiving a request to perform the operation requiring authentication:
Performing an operation requesting the authentication according to a determination that the data obtained by the one or more biometric sensors corresponds to the registered biometric feature; And
Further comprising the step of withholding the step of performing the operation for requesting authentication according to a determination that the data acquired by the one or more biometric sensors does not correspond to the registered biometric feature. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, comprising:
A computer readable storage medium comprising instructions for performing the method of claim 1, wherein the one or more programs include instructions for performing the method of claim 1. As an electronic device,
display;
One or more biometric sensors;
One or more processors; And
A memory storing one or more programs configured to be executed by the one or more processors
11. An electronic device comprising instructions for performing the method of claim 1, wherein the one or more programs include instructions for performing the method of claim 1. As an electronic device,
display;
One or more biometric sensors; And
Means for carrying out the method of any one of claims 1 to 10
Electronic device comprising a.

Images