KR102396472B1 - Implementation of biometric authentication - Google Patents

Abstract

The present invention generally relates to providing user interfaces for biometric enrollment process instructions, aligning a biometric feature for enrollment, registering a biometric feature, providing hints during the biometric enrollment process, application based biometric authentication, autofilling biometric security fields, unlocking device using biometric authentication, retrying biometric authentication, managing transfers using biometric authentication, biometric authentication Embedded user interface during measurement authentication, preventing retries of biometric authentication, cached biometric authentication, automatically populating fillable fields based on visibility criteria, automatic login using biometric authentication, credential entry retrying the biometric authentication in the user interface, providing indications of error conditions during biometric authentication, providing indications regarding the biometric sensor during biometric authentication, and configuring the device to register the biometric feature It relates to implementing biometric authentication comprising orienting.

Description

IMPLEMENTATION OF BIOMETRIC AUTHENTICATION

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is filed on September 9, 2017 in U.S. Provisional Patent Application Nos. 62/556,413, "FACE ENROLLMENT AND AUTHENTICATION;" and 62/557,130, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed September 11, 2017; Danish Patent Application No. PA 2017 70712, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed 22 September 2017; PA 2017 No. 70713, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed September 22, 2017; PA 2017 No. 70714, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed September 22, 2017; and PA 2017 70715, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed September 22, 2017; U.S. Provisional Patent Application No. 62/581,025, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed November 2, 2017; International Application No. PCT/US2018/015603, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed January 26, 2018; U.S. Patent Application Serial No. 15/894,221, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed February 12, 2018; U.S. Patent Application Serial No. 15/903,456, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed February 23, 2018; U.S. Provisional Patent Application No. 62/679,955, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed June 3, 2018; Danish Patent Application No. PA 2018 70370, filed on June 12, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; and to Danish Patent Application No. PA 2018 70371, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION", filed on June 12, 2018. All of these applications are incorporated herein by reference in their entirety.

technical field

FIELD OF THE INVENTION The present invention relates generally to biometric authentication, and more particularly to interfaces and techniques for registration and authentication of biometric features.

Biometric authentication of, for example, a face, iris, or fingerprint using electronic devices is a convenient and efficient way to authenticate users of electronic devices. Biometric authentication allows a device to quickly and easily verify the identity of any number of users.

However, some techniques for implementing biometric authentication using electronic devices are generally cumbersome. For example, some existing techniques, such as those pertaining to facial recognition, require the user to almost perfectly align the biometric feature in the same manner during both registration and each iteration of authentication. Deviations from alignment of biometric features often result in false negative results. As a result, the user is optionally required to unnecessarily perform multiple iterations of biometric authentication, or, alternatively, is frustrated using biometric authentication in its entirety. As another example, some existing techniques rely only on two-dimensional representations of biometric features. As a result, authentication of the user is optionally limited by failing to analyze one or more three-dimensional characteristics of the biometric feature, and optionally, requiring the user to perform additional iterations of biometric authentication unnecessarily. Considering the aforementioned drawbacks, existing techniques require more time than necessary, wasting both user time and device energy. This latter consideration is particularly important in the operation of battery-operated devices.

Accordingly, the present technique provides electronic devices with faster and more efficient methods and interfaces for implementing biometric authentication. These methods and interfaces optionally complement or replace other methods for implementing biometric authentication. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges. Such methods and interfaces also reduce the number of unnecessary, irrelevant, or repetitive input required in computing devices, such as smartphones and smartwatches.

According to some examples, a method is described, comprising, in an electronic device having one or more input devices, one or more biometric sensors, and a display: displaying a first user interface on the display; detecting, during the step of displaying the first user interface, the occurrence of a condition corresponding to introduction of a biometric registration process for registering the biometric feature; in response to detecting the occurrence of a condition corresponding to introduction of the biometric registration process, displaying a biometric registration introduction interface, wherein displaying the biometric registration introduction interface comprises: a representation of a simulation of the biometric feature; and concurrently displaying a simulated progress indicator; displaying an educational animation comprising, during displaying the biometric registration introduction interface, moving the representation of the simulation of the biometric feature and displaying incremental advancement of the simulated progress indicator; after displaying at least a portion of the educational animation, detecting occurrence of a condition corresponding to initiation of the biometric enrollment process; and in response to detecting the occurrence of a condition corresponding to initiation of the biometric enrollment process: displaying a progress indicator corresponding to the simulated progress indicator; and displaying the representation of the user's biometric feature as determined by one or more biometric sensors of the device at a location previously occupied by the simulated representation of the biometric feature in the biometric enrollment introduction interface. do.

According to some examples, a non-transitory computer-readable medium is described, wherein the non-transitory computer-readable storage medium is caused by one or more input devices, one or more biometric sensors, and one or more processors of an electronic device having a display. one or more programs configured to be executed, the one or more programs configured to: display a first user interface on a display; while displaying the first user interface, for detecting the occurrence of a condition corresponding to introduction of a biometric registration process for registering the biometric feature; In response to detecting the occurrence of a condition corresponding to the introduction of the biometric registration process, for displaying the biometric registration introduction interface, displaying the biometric registration introduction interface includes a representation of a simulation of the biometric feature, and a simulated including simultaneously displaying a progress indicator; for displaying an educational animation comprising, while displaying the biometric registration introduction interface, displaying movement of the representation of the simulation of the biometric feature and incremental advancement of the simulated progress indicator; after displaying at least a portion of the educational animation, for detecting the occurrence of a condition corresponding to initiation of the biometric enrollment process; and in response to detecting the occurrence of a condition corresponding to initiation of the biometric enrollment process: to display a progress indicator corresponding to the simulated progress indicator; and at a location previously occupied by the simulated representation of the biometric feature in the biometric enrollment introduction interface, to display a representation of the user's biometric feature as determined by one or more biometric sensors of the device. include

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium being configured to be executed by one or more processors of an electronic device having one or more input devices, one or more biometric sensors, and a display. one or more programs configured to: display a first user interface on a display; while displaying the first user interface, for detecting the occurrence of a condition corresponding to introduction of a biometric registration process for registering the biometric feature; In response to detecting the occurrence of a condition corresponding to the introduction of the biometric registration process, for displaying the biometric registration introduction interface, displaying the biometric registration introduction interface includes a representation of a simulation of the biometric feature, and a simulated including simultaneously displaying a progress indicator; for displaying an educational animation comprising, while displaying the biometric registration introduction interface, displaying movement of the representation of the simulation of the biometric feature and incremental advancement of the simulated progress indicator; after displaying at least a portion of the educational animation, for detecting the occurrence of a condition corresponding to initiation of the biometric enrollment process; and in response to detecting the occurrence of a condition corresponding to initiation of the biometric enrollment process: to display a progress indicator corresponding to the simulated progress indicator; and at a location previously occupied by the simulated representation of the biometric feature in the biometric enrollment introduction interface, to display a representation of the user's biometric feature as determined by one or more biometric sensors of the device. include

According to some examples, an electronic device is described, comprising: one or more input devices; one or more biometric sensors; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs configured to: display a first user interface on the display; while displaying the first user interface, for detecting the occurrence of a condition corresponding to introduction of a biometric registration process for registering the biometric feature; In response to detecting the occurrence of a condition corresponding to the introduction of the biometric registration process, for displaying the biometric registration introduction interface, displaying the biometric registration introduction interface includes a representation of a simulation of the biometric feature, and a simulated including simultaneously displaying a progress indicator; for displaying an educational animation comprising, while displaying the biometric registration introduction interface, displaying movement of the representation of the simulation of the biometric feature and incremental advancement of the simulated progress indicator; after displaying at least a portion of the educational animation, for detecting the occurrence of a condition corresponding to initiation of the biometric enrollment process; and in response to detecting the occurrence of a condition corresponding to initiation of the biometric enrollment process: to display a progress indicator corresponding to the simulated progress indicator; and at a location previously occupied by the simulated representation of the biometric feature in the biometric enrollment introduction interface, to display a representation of the user's biometric feature as determined by one or more biometric sensors of the device. include

According to some examples, an electronic device is described, comprising: one or more input devices; one or more biometric sensors; display; means for displaying a first user interface on the display; means for detecting, while displaying the first user interface, an occurrence of a condition corresponding to introduction of a biometric registration process for registering the biometric feature; In response to detecting the occurrence of a condition corresponding to the introduction of the biometric registration process, means for displaying the biometric registration introduction interface, displaying the biometric registration introduction interface comprises: a representation of a simulation of the biometric feature, and a simulation Simultaneous display of progress indicators; means for displaying an educational animation comprising, while displaying the biometric registration introduction interface, displaying movement of the representation of the simulation of the biometric feature and incremental advancement of the simulated progress indicator; means for detecting, after displaying at least a portion of the educational animation, occurrence of a condition corresponding to initiation of the biometric enrollment process; and in response to detecting the occurrence of a condition corresponding to initiation of the biometric enrollment process: means for displaying a progress indicator corresponding to the simulated progress indicator; and means for displaying a representation of the user's biometric feature, as determined by one or more biometric sensors of the device, at a location previously occupied by the simulated representation of the biometric feature in the biometric enrollment introduction interface. include

According to some examples, a method is described, the method comprising: in an electronic device having one or more cameras and a display: displaying a first user interface on the display; detecting, during the step of displaying the first user interface, the occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; in response to detecting the occurrence of a condition corresponding to initiating the biometric registration process, displaying on the display a digital viewfinder comprising a preview of image data captured by the one or more cameras; and after initiating the biometric enrollment process: according to a determination that a biometric feature of each type that meets the alignment criteria has been detected in the field of view of the one or more cameras: highlighting the first portion of the field of view; and not emphasizing a first portion of the field of view of the one or more cameras relative to a second portion of the field of view of the one or more cameras in accordance with a determination that a biometric feature of each type that meets the alignment criteria was not detected in the field of view of the one or more cameras. and maintaining the display of the digital viewfinder without

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras and a display, and , the one or more programs to display the first user interface on the display; while displaying the first user interface, for detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; in response to detecting the occurrence of a condition corresponding to initiating the biometric enrollment process, for displaying on the display a digital viewfinder comprising a preview of image data captured by the one or more cameras; and after initiating the biometric registration process: according to a determination that a biometric feature of each type that meets the alignment criteria has been detected in the field of view of the one or more cameras, to emphasize a first portion of the field of view; and in accordance with a determination that a biometric feature of each type that meets the alignment criteria was not detected in the field of view of the one or more cameras, do not emphasize the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras. instructions for maintaining the display of the digital viewfinder without

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras and a display, and one or more The above programs are for displaying a first user interface on a display; detecting, while displaying the first user interface, occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; in response to detecting the occurrence of a condition corresponding to initiating the biometric enrollment process, for displaying on the display a digital viewfinder comprising a preview of image data captured by the one or more cameras; and after initiating the biometric enrollment process: according to a determination that a biometric feature of each type that meets the alignment criteria has been detected in the field of view of the one or more cameras, to emphasize a first portion of the field of view; and in accordance with a determination that a biometric feature of each type that meets the alignment criteria was not detected in the field of view of the one or more cameras, do not emphasize the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras. instructions for maintaining the display of the digital viewfinder without

According to some examples, an electronic device is described, comprising: one or more cameras; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs configured to: display a first user interface on the display; detecting, while displaying the first user interface, occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; in response to detecting the occurrence of a condition corresponding to initiating the biometric enrollment process, for displaying on the display a digital viewfinder comprising a preview of image data captured by the one or more cameras; and after initiating the biometric registration process: according to a determination that a biometric feature of each type that meets the alignment criteria has been detected in the field of view of the one or more cameras, to emphasize a first portion of the field of view; and in accordance with a determination that a biometric feature of each type that meets the alignment criteria was not detected in the field of view of the one or more cameras, do not emphasize the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras. instructions for maintaining the display of the digital viewfinder without

According to some examples, an electronic device is described, comprising: one or more cameras; display; one or more processors; means for displaying a first user interface on the display; means for detecting, while displaying the first user interface, occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature; means for, in response to detecting the occurrence of a condition corresponding to initiating a biometric enrollment process, for displaying, on the display, a digital viewfinder comprising a preview of image data captured by the one or more cameras; and after initiating the biometric enrollment process: according to a determination that a biometric feature of each type that meets the alignment criteria has been detected in the field of view of the one or more cameras, means for highlighting the first portion of the field of view; and not emphasizing a first portion of the field of view of the one or more cameras relative to a second portion of the field of view of the one or more cameras in accordance with a determination that a biometric feature of each type that meets the alignment criteria was not detected in the field of view of the one or more cameras. and means for maintaining the display of the digital viewfinder without

According to some examples, a method is described, in an electronic device having one or more biometric sensors and a display: simultaneously displaying a biometric enrollment interface on the display, displaying the biometric enrollment interface comprising: , a representation of the biometric feature having an orientation determined based on alignment of the biometric feature to one or more biometric sensors of the device, and a first progress indicator in a first position on the display relative to the representation of the biometric feature concurrently displaying a progress indicator comprising the portion and a second progress indicator portion at a second location on the display relative to the representation of the biometric feature, wherein the representation of the biometric feature is at the first location and the second location on the display. displayed between positions -; detecting a change in orientation of the biometric feature relative to the one or more biometric sensors while simultaneously displaying the representation of the biometric feature and the progress indicator; and in response to detecting a change in orientation of the biometric feature with respect to the one or more biometric sensors: wherein the change in orientation of the biometric feature is relative to the first portion of the biometric feature corresponding to the first progress indicator portion. updating one or more visual characteristics of the first progress indicator portion in accordance with a determination that the registration criteria are met; and in accordance with a determination that the change in orientation of the biometric feature meets registration criteria for a second portion of the biometric feature corresponding to the second progress indicator portion, updating one or more visual properties of the second progress indicator portion. includes steps.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. wherein the one or more programs are configured to simultaneously display the biometric enrollment interface on the display, wherein the displaying the biometric enrollment interface is determined based on an alignment of the biometric feature to one or more biometric sensors of the device. a representation of the biometric feature having an orientation, and a first progress indicator portion in a first position on the display relative to the representation of the biometric feature and a second progress indicator in a second position on the display relative to the representation of the biometric feature. concurrently displaying a progress indicator comprising the portion, wherein the representation of the biometric feature is displayed between the first location and the second location on the display; for detecting a change in orientation of the biometric feature relative to the one or more biometric sensors while simultaneously displaying the presentation of the biometric feature and the progress indicator; and in response to detecting a change in orientation of the biometric feature with respect to the one or more biometric sensors: the change in orientation of the biometric feature registers with the first portion of the biometric feature corresponding to the first progress indicator portion update one or more visual characteristics of the first progress indicator portion in accordance with a determination that the criteria are met; and in accordance with a determination that the change in orientation of the biometric feature meets registration criteria for a second portion of the biometric feature corresponding to the second progress indicator portion, updating one or more visual properties of the second progress indicator portion. contains instructions for

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , the one or more programs to simultaneously display the biometric enrollment interface on the display, wherein the displaying the biometric enrollment interface exhibits an orientation determined based on alignment of the biometric feature with respect to one or more biometric sensors of the device. a representation of the biometric feature having, and a first progress indicator portion in a first position on the display relative to the representation of the biometric feature and a second progress indicator portion in a second position on the display relative to the representation of the biometric feature; concurrently displaying a progress indicator comprising: the representation of the biometric feature displayed between the first location and the second location on the display; for detecting a change in orientation of the biometric feature relative to the one or more biometric sensors while simultaneously displaying the presentation of the biometric feature and the progress indicator; and in response to detecting a change in orientation of the biometric feature with respect to the one or more biometric sensors: the change in orientation of the biometric feature registers with the first portion of the biometric feature corresponding to the first progress indicator portion update one or more visual characteristics of the first progress indicator portion in accordance with a determination that the criteria are met; and in accordance with a determination that the change in orientation of the biometric feature meets registration criteria for a second portion of the biometric feature corresponding to the second progress indicator portion, updating one or more visual properties of the second progress indicator portion. contains instructions for

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs for simultaneously displaying the biometric enrollment interface on the display, wherein the displaying the biometric enrollment interface comprises: a representation of the biometric feature having an orientation determined based on the alignment of the biometric feature to the one or more biometric sensors, and a first progress indicator portion and a first progress indicator portion in a first position on the display relative to the representation of the biometric feature concurrently displaying a progress indicator comprising a second progress indicator portion at a second location on the display relative to the representation of the measurement feature, wherein the representation of the biometric feature is displayed between the first location and the second location on the display become -; for detecting a change in orientation of the biometric feature relative to the one or more biometric sensors while simultaneously displaying the presentation of the biometric feature and the progress indicator; and in response to detecting a change in orientation of the biometric feature with respect to the one or more biometric sensors: the change in orientation of the biometric feature registers with the first portion of the biometric feature corresponding to the first progress indicator portion update one or more visual characteristics of the first progress indicator portion in accordance with a determination that the criteria are met; and in accordance with a determination that the change in orientation of the biometric feature meets registration criteria for a second portion of the biometric feature corresponding to the second progress indicator portion, updating one or more visual properties of the second progress indicator portion. Includes instructions for

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; Means for concurrently displaying the biometric enrollment interface on the display, wherein displaying the biometric enrollment interface comprises: a progress indicator comprising a presentation and a first progress indicator portion at a first position on the display for the presentation of the biometric feature and a second progress indicator portion at a second position on the display for the presentation of the biometric feature; concurrently displaying, wherein the representation of the biometric feature is displayed between the first location and the second location on the display; means for detecting a change in orientation of the biometric feature relative to the one or more biometric sensors while simultaneously displaying the presentation of the biometric feature and the progress indicator; and in response to detecting a change in orientation of the biometric feature with respect to the one or more biometric sensors: the change in orientation of the biometric feature registers with the first portion of the biometric feature corresponding to the first progress indicator portion means for updating one or more visual characteristics of the first progress indicator portion in accordance with a determination that the criteria are met; and in accordance with a determination that the change in orientation of the biometric feature meets registration criteria for a second portion of the biometric feature corresponding to the second progress indicator portion, updating the one or more visual properties of the second progress indicator portion. includes means for

According to some examples, a method is described, the method comprising, in an electronic device having one or more biometric sensors and a display: displaying, on the display, a biometric registration user interface for registering a biometric feature - biometric displaying the measurement registration user interface includes displaying a representation of the biometric feature, wherein the appearance of the representation of the biometric feature changes as an orientation of the biometric feature with respect to the one or more biometric sensors changes; detecting, during displaying the biometric enrollment user interface, that enrollment prompt criteria have been met with respect to one or more portions of the biometric feature; and in response to detecting that registration prompt criteria have been met with respect to the one or more portions of the biometric feature, outputting a respective prompt to move the biometric feature in a respective manner; The prompt is selected based on a registration status of one or more portions of the biometric feature, and outputting each prompt is associated with a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner. and outputting a prompt to move the biometric feature in a first manner, and moving the biometric feature in a second manner different from the first manner, in response to a determination that the enrollment prompt criteria have been met. outputting a prompt to move the biometric feature in a second manner in accordance with a determination that the registration prompt criteria have been met with respect to the second portion of the measurement feature.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. wherein the one or more programs include, on the display, for displaying a biometric enrollment user interface for registering the biometric feature, wherein displaying the biometric enrollment user interface comprises displaying a representation of the biometric feature; the appearance of the representation of the biometric feature changes as the orientation of the biometric feature with respect to the one or more biometric sensors changes; while displaying the biometric enrollment user interface, detecting that enrollment prompt criteria have been met with respect to one or more portions of the biometric feature; and in response to detecting that registration prompt criteria have been met with respect to the one or more portions of the biometric feature, outputting a respective prompt to move the biometric feature in a respective manner; The prompt is selected based on the registration status of one or more portions of the biometric feature, and outputting each prompt is related to a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner. outputting a prompt to move the biometric feature in a first manner, and moving the biometric feature in a second manner different from the first manner, in accordance with a determination that the registration prompt criteria have been met. outputting a prompt to move the biometric feature in a second manner in accordance with a determination that registration prompt criteria have been met with respect to the second portion of the feature.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , the one or more programs to display, on the display, a biometric enrollment user interface for registering the biometric feature, wherein displaying the biometric enrollment user interface comprises displaying a representation of the biometric feature; the appearance of the representation of the feature changes as the orientation of the biometric feature with respect to the one or more biometric sensors changes; while displaying the biometric enrollment user interface, detecting that enrollment prompt criteria have been met with respect to one or more portions of the biometric feature; and in response to detecting that registration prompt criteria have been met with respect to the one or more portions of the biometric feature, outputting a respective prompt to move the biometric feature in a respective manner; The prompt is selected based on the registration status of one or more portions of the biometric feature, and outputting each prompt is related to a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner. outputting a prompt to move the biometric feature in a first manner, and moving the biometric feature in a second manner different from the first manner, in accordance with a determination that the registration prompt criteria have been met. outputting a prompt to move the biometric feature in a second manner in accordance with a determination that registration prompt criteria have been met with respect to the second portion of the feature.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs for: displaying, on the display, a biometric registration user interface for registering the biometric feature - biometric registration displaying the user interface includes displaying a representation of the biometric feature, wherein the appearance of the representation of the biometric feature changes as an orientation of the biometric feature with respect to the one or more biometric sensors changes; while displaying the biometric enrollment user interface, detecting that enrollment prompt criteria have been met with respect to one or more portions of the biometric feature; and in response to detecting that registration prompt criteria have been met with respect to the one or more portions of the biometric feature, outputting a respective prompt to move the biometric feature in a respective manner; The prompt is selected based on the registration status of one or more portions of the biometric feature, and outputting each prompt is related to a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner. outputting a prompt to move the biometric feature in a first manner, and moving the biometric feature in a second manner different from the first manner, in accordance with a determination that the registration prompt criteria have been met. outputting a prompt to move the biometric feature in a second manner in accordance with a determination that registration prompt criteria have been met with respect to the second portion of the feature.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; means for displaying, on the display, a biometric enrollment user interface for registering the biometric feature, wherein displaying the biometric enrollment user interface comprises displaying a representation of the biometric feature, wherein the appearance of the representation of the biometric feature changes as the orientation of the biometric feature with respect to the one or more biometric sensors changes; means for detecting that, while displaying the biometric enrollment user interface, enrollment prompt criteria have been met with respect to one or more portions of the biometric feature; and means for outputting a respective prompt to move the biometric feature in a respective manner in response to detecting that registration prompt criteria have been met with respect to one or more portions of the biometric feature, each The prompt is selected based on the registration status of one or more portions of the biometric feature, and the means for outputting each prompt comprises: a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner; in association with means for outputting a prompt to move the biometric feature in a first manner, in accordance with a determination that the registration prompt criteria have been met, and to be registered by moving the biometric feature in a second manner different from the first manner means for outputting a prompt to move the biometric feature in a second manner in accordance with a determination that the registration prompt criteria have been met with respect to the second portion of the biometric feature present.

According to some examples, a method is described, in an electronic device having one or more biometric sensors and a display: on the display: an application interface corresponding to the application, and a biometric controlled by an operating system of the electronic device. concurrently displaying a measurement authentication interface, wherein the biometric authentication interface is displayed over a portion of the application interface; while displaying the biometric authentication interface, obtaining, from the one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature; and based on the biometric data, according to a determination that at least a portion of the biometric feature satisfies the biometric authentication criteria: apply authentication information indicating that the biometric authentication criteria were satisfied with respect to the one or more portions of the biometric feature providing to; and after providing the authentication information to the application, maintaining the display of the biometric authentication interface for a predetermined time.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. one or more programs for simultaneously displaying on the display: an application interface corresponding to the application, and a biometric authentication interface controlled by an operating system of the electronic device, the biometric authentication interface being displayed over a portion of the application interface become -; while displaying the biometric authentication interface, to obtain, from the one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature; and in accordance with a determination, based on the biometric data, that at least a portion of the biometric feature meets the biometric authentication criteria: apply authentication information indicating that the biometric authentication criteria have been satisfied with respect to one or more portions of the biometric feature to provide to; and maintaining the display of the biometric authentication interface for a predetermined time after providing the authentication information to the application.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , the one or more programs for simultaneously displaying on the display: an application interface corresponding to the application, and a biometric authentication interface controlled by an operating system of the electronic device, the biometric authentication interface being displayed over a portion of the application interface; ; while displaying the biometric authentication interface, to obtain, from the one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature; and in accordance with a determination, based on the biometric data, that at least a portion of the biometric feature meets the biometric authentication criteria: apply authentication information indicating that the biometric authentication criteria have been satisfied with respect to one or more portions of the biometric feature to provide to; and maintaining the display of the biometric authentication interface for a predetermined time after providing the authentication information to the application.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: on the display: an application interface corresponding to the application, and biometric authentication controlled by an operating system of the electronic device. for simultaneously displaying the interface, wherein the biometric authentication interface is displayed over a portion of the application interface; while displaying the biometric authentication interface, to obtain, from the one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature; and in accordance with a determination, based on the biometric data, that at least a portion of the biometric feature meets the biometric authentication criteria: apply authentication information indicating that the biometric authentication criteria have been satisfied with respect to one or more portions of the biometric feature to provide to; and maintaining the display of the biometric authentication interface for a predetermined time after providing the authentication information to the application.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; On the display: means for simultaneously displaying an application interface corresponding to the application and a biometric authentication interface controlled by an operating system of the electronic device, the biometric authentication interface being displayed over a portion of the application interface; means for obtaining, from the one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature while displaying the biometric authentication interface; and based on the biometric data, according to a determination that at least a portion of the biometric feature satisfies the biometric authentication criteria: apply authentication information indicating that the biometric authentication criteria were satisfied with respect to the one or more portions of the biometric feature means to provide to; and means for maintaining the display of the biometric authentication interface for a predetermined time after providing the authentication information to the application.

According to some examples, a method is described, the method comprising, in an electronic device having one or more biometric sensors and a display: displaying, on the display, an application interface comprising a fillable field; receiving, during displaying the application interface, a request to automatically populate a fillable field of the application interface; and in response to receiving a request to automatically populate the fillable field of the application interface: according to a determination that the fillable field of the application interface is associated with a first type of data, replace the fillable field with the first type of data. automatic filling; and wherein at least a portion of the biometric feature is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature. automatically filling the fillable field with data of the second type upon a determination that the values are satisfied.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs for execution by one or more processors of an electronic device having one or more biometric sensors and a display. wherein the one or more programs are configured to: display, on the display, an application interface comprising a fillable field; while displaying the application interface, for receiving a request to automatically populate a fillable field of the application interface; and in response to receiving the request to automatically populate the fillable field of the application interface: upon determining that the fillable field of the application interface is associated with the first type of data, automatically filling the fillable field with the first type of data. to fill with; and wherein at least a portion of the biometric feature is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature. and instructions for automatically filling the fillable field with data of the second type upon a determination that the values are satisfied.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs for execution by one or more processors of an electronic device having one or more biometric sensors and a display, and , the one or more programs for displaying, on the display, an application interface comprising a fillable field; while displaying the application interface, for receiving a request to automatically populate a fillable field of the application interface; and in response to receiving the request to automatically populate the fillable field of the application interface: upon determining that the fillable field of the application interface is associated with the first type of data, automatically filling the fillable field with the first type of data. to fill with; and wherein at least a portion of the biometric feature is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature. and instructions for automatically filling the fillable field with data of the second type upon a determination that the values are satisfied.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs for: displaying, on the display, an application interface comprising a fillable field; while displaying the application interface, for receiving a request to automatically populate a fillable field of the application interface; and in response to receiving the request to automatically populate the fillable field of the application interface: upon determining that the fillable field of the application interface is associated with the first type of data, automatically filling the fillable field with the first type of data. to fill with; and wherein at least a portion of the biometric feature is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature. and instructions for automatically filling the fillable field with data of the second type upon a determination that the values are satisfied.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; means for displaying, on the display, an application interface comprising a fillable field; means for receiving a request to automatically populate a fillable field of the application interface while displaying the application interface; and in response to receiving the request to automatically populate the fillable field of the application interface: upon determining that the fillable field of the application interface is associated with the first type of data, automatically filling the fillable field with the first type of data. means to fill with; and wherein at least a portion of the biometric feature is associated with the second type of data and is determined based on data obtained from one or more biometric sensors corresponding to the biometric feature. and means for automatically populating the fillable field with data of the second type upon a determination that the values are satisfied.

According to some examples, a method is described, comprising: in an electronic device having one or more biometric sensors and a display: detecting that device wake criteria have been met; in response to detecting that the device wake criteria have been met, transitioning the electronic device from the first visual state to the second visual state; and after transitioning the device to the second visual state: in response to a determination that biometric authentication criteria have been met based on the biometric data provided by the one or more biometric sensors, remove the electronic device from the second visual state. 3 transitioning to the visual state, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and in accordance with a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors, maintaining the electronic device in the second visual state.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. comprising; one or more programs to detect that device wake criteria have been met; in response to detecting that the device wake criteria have been met, to transition the electronic device from the first visual state to the second visual state; and after transitioning the device to the second visual state: according to a determination that biometric authentication criteria have been met based on biometric data provided by the one or more biometric sensors, move the electronic device from the second visual state to a third visual state. to transition to a state, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and in accordance with a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors, to maintain the electronic device in the second visual state.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , one or more programs to detect that device wake criteria have been met; in response to detecting that the device wake criteria have been met, to transition the electronic device from the first visual state to the second visual state; and after transitioning the device to the second visual state: according to a determination that biometric authentication criteria have been met based on biometric data provided by the one or more biometric sensors, move the electronic device from the second visual state to a third visual state. to transition to a state, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and in accordance with a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors, to maintain the electronic device in the second visual state.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs for: detecting that device wake criteria have been met; in response to detecting that the device wake criteria have been met, to transition the electronic device from the first visual state to the second visual state; and after transitioning the device to the second visual state: according to a determination that biometric authentication criteria have been met based on biometric data provided by the one or more biometric sensors, move the electronic device from the second visual state to a third visual state. to transition to a state, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and in accordance with a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors, to maintain the electronic device in the second visual state.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; means for detecting that device wake criteria have been met; means for transitioning the electronic device from the first visual state to a second visual state in response to detecting that the device wake criteria have been met; and after transitioning the device to the second visual state: according to a determination that biometric authentication criteria have been met based on biometric data provided by the one or more biometric sensors, move the electronic device from the second visual state to a third visual state. means for transitioning to the state, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and means for maintaining the electronic device in the second visual state in accordance with a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors.

According to some examples, a method is described, in an electronic device having one or more biometric sensors and a display: while the electronic device is in a locked state, without explicit input from a user requesting biometric authentication detecting a condition associated with performing a biometric authentication check using the biometric sensor; and in response to detecting the condition, performing a first biometric authentication check, wherein performing the first biometric authentication check includes capturing first biometric data using the one or more biometric sensors. ; after capturing the first biometric data: according to a determination that the first biometric data satisfies the biometric authentication criteria, transitioning the device from the locked state to the unlocked state; and in accordance with a determination that the first biometric data does not satisfy the biometric authentication criteria, maintaining the device in a locked state; after performing the first biometric authentication check, detecting, through the device, a request to perform each operation without receiving additional authentication information from the user; and in response to detecting the request to perform each operation: in accordance with a determination that each operation does not require authentication, performing each operation; performing each operation according to a determination that each operation requires authentication and that the device is in an unlocked state; and in accordance with a determination that each operation requires authentication and that the device is in a locked state: capturing second biometric data using the one or more biometric sensors without explicit input from the user requesting a second biometric authentication confirmation to do; and after capturing the second biometric data, performing a second biometric authentication check, wherein performing the second biometric authentication check comprises: the second biometric data matching the biometric authentication criteria; performing each operation according to the determination that it is satisfied; and in accordance with a determination that the second biometric data does not satisfy the biometric authentication criteria, suspending performance of the respective operation.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. wherein the one or more programs detect a condition associated with performing a biometric authentication check using the biometric sensor without explicit input from a user requesting the biometric authentication while the electronic device is in a locked state. for; and in response to detecting the condition, perform a first biometric authentication check, wherein performing the first biometric authentication check includes: capturing first biometric data using one or more biometric sensors; after capturing the first biometric data: according to a determination that the first biometric data satisfies the biometric authentication criteria, transitioning the device from the locked state to the unlocked state; and in accordance with a determination that the first biometric data does not satisfy the biometric authentication criteria, comprising maintaining the device in a locked state; after performing the first biometric authentication check, for detecting, via the device, a request to perform each operation without receiving additional authentication information from the user; and in response to detecting the request to perform the respective operation: in accordance with a determination that the respective operation does not require authentication, to perform the respective operation; to perform each operation according to a determination that each operation requires authentication and that the device is in an unlocked state; and upon determining that each operation requires authentication and that the device is in a locked state: capture second biometric data using the one or more biometric sensors without explicit input from the user requesting a second biometric authentication confirmation to do; and after capturing the second biometric data, perform a second biometric authentication check, wherein performing the second biometric authentication check indicates that the second biometric data satisfies the biometric authentication criteria. performing each operation according to the determination; and in accordance with a determination that the second biometric data does not satisfy the biometric authentication criteria, withholding performance of the respective operation.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , one or more programs to: detect a condition associated with performing a biometric authentication check using the biometric sensor without explicit input from the user requesting the biometric authentication while the electronic device is in a locked state; and in response to detecting the condition, perform a first biometric authentication check, wherein performing the first biometric authentication check includes: capturing first biometric data using one or more biometric sensors; after capturing the first biometric data: according to a determination that the first biometric data satisfies the biometric authentication criteria, transitioning the device from the locked state to the unlocked state; and in accordance with a determination that the first biometric data does not satisfy the biometric authentication criteria, comprising maintaining the device in a locked state; after performing the first biometric authentication check, for detecting, via the device, a request to perform each operation without receiving additional authentication information from the user; and in response to detecting the request to perform the respective operation: in accordance with a determination that the respective operation does not require authentication, to perform the respective operation; to perform each operation according to a determination that each operation requires authentication and that the device is in an unlocked state; and upon determining that each operation requires authentication and that the device is in a locked state: capture second biometric data using the one or more biometric sensors without explicit input from the user requesting a second biometric authentication confirmation to do; and after capturing the second biometric data, perform a second biometric authentication check, wherein performing the second biometric authentication check indicates that the second biometric data satisfies the biometric authentication criteria. performing each operation according to the determination; and in accordance with a determination that the second biometric data does not satisfy the biometric authentication criteria, withholding performance of the respective operation.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: a biometric without explicit input from a user requesting biometric authentication while the electronic device is in a locked state detecting a condition associated with performing a biometric authentication check using the sensor; and in response to detecting the condition, perform a first biometric authentication check, wherein performing the first biometric authentication check includes: capturing first biometric data using one or more biometric sensors; after capturing the first biometric data: according to a determination that the first biometric data satisfies the biometric authentication criteria, transitioning the device from the locked state to the unlocked state; and in accordance with a determination that the first biometric data does not satisfy the biometric authentication criteria, maintaining the device in a locked state; after performing the first biometric authentication check, for detecting, via the device, a request to perform each operation without receiving additional authentication information from the user; and in response to detecting the request to perform the respective operation: in accordance with a determination that the respective operation does not require authentication, to perform the respective operation; to perform each operation, in accordance with a determination that each operation requires authentication and that the device is in an unlocked state; and upon determining that each operation requires authentication and that the device is in a locked state: capture second biometric data using the one or more biometric sensors without explicit input from the user requesting a second biometric authentication confirmation to do; and after capturing the second biometric data, perform a second biometric authentication check, wherein performing the second biometric authentication check indicates that the second biometric data satisfies the biometric authentication criteria. performing each operation according to the determination; and in accordance with a determination that the second biometric data does not satisfy the biometric authentication criteria, withholding performance of the respective operation.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; means for detecting a condition associated with performing a biometric authentication check using the biometric sensor without explicit input from the user requesting the biometric authentication while the electronic device is in a locked state; and in response to detecting the condition, means for performing a first biometric authentication check, wherein the means for performing the first biometric authentication check comprises: capturing the first biometric data using the one or more biometric sensors. means for; after capturing the first biometric data: means for transitioning the device from a locked state to an unlocked state according to a determination that the first biometric data satisfies the biometric authentication criteria; and in accordance with a determination that the first biometric data does not satisfy the biometric authentication criteria, means for maintaining the device in a locked state; means for, after performing the first biometric authentication check, for detecting, via the device, a request to perform the respective operation without receiving additional authentication information from the user; and in response to detecting the request to perform the respective operation: means for performing the respective operation, in accordance with a determination that the respective operation does not require authentication; means for performing each operation in accordance with a determination that each operation requires authentication and that the device is in an unlocked state; and in accordance with a determination that each operation requires authentication and that the device is in a locked state: capturing second biometric data using the one or more biometric sensors without explicit input from the user requesting a second biometric authentication confirmation means to do; and means for performing a second biometric authentication check after capturing the second biometric data, wherein the means for performing the second biometric authentication check comprises: means for performing each operation in accordance with the determination that it is satisfied; and means for withholding performance of the respective operation in accordance with a determination that the second biometric data does not satisfy the biometric authentication criteria.

According to some examples, a method is described, wherein the method comprises in an electronic device having a display, a button, and one or more biometric sensors separate from the button: the electronic device comprising: the electronic device first causing a respective function of the device to be disabled while in the state, detecting one or more activations of the button; and in response to detecting one or more activations of the button: capturing biometric data with one or more biometric sensors separate from the button; according to a determination that the biometric data satisfies the biometric authentication criteria, transitioning the electronic device to a second state in which a respective function of the device is enabled; and in accordance with a determination that the biometric data does not satisfy the biometric authentication criteria, maintaining the electronic device in the first state and displaying an indication on the display that the biometric authentication has failed.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium being caused by one or more processors of an electronic device having a display, a button, and one or more biometric sensors separate from the button. one or more programs configured to be executed, wherein the one or more programs are configured to: detect one or more activations of a button while the electronic device is in a first state in which a respective function of the device is disabled; and in response to detecting one or more activations of the button: to capture biometric data with one or more biometric sensors separate from the button; according to a determination that the biometric data satisfies the biometric authentication criteria, transition the electronic device to a second state in which a respective function of the device is enabled; and in accordance with a determination that the biometric data does not satisfy the biometric authentication criteria, maintain the electronic device in the first state and display an indication on the display that the biometric authentication has failed.

According to some examples, a transitory computer readable medium is described, wherein the transitory computer readable storage medium is configured for execution by one or more processors of an electronic device having a display, a button, and one or more biometric sensors separate from the button. one or more programs configured, wherein the one or more programs are configured to: detect one or more activations of a button while the electronic device is in a first state in which a respective function of the device is disabled; and in response to detecting one or more activations of the button: to capture biometric data with one or more biometric sensors separate from the button; according to a determination that the biometric data satisfies the biometric authentication criteria, transition the electronic device to a second state in which a respective function of the device is enabled; and in accordance with a determination that the biometric data does not satisfy the biometric authentication criteria, maintain the electronic device in the first state and display an indication on the display that the biometric authentication has failed.

According to some examples, an electronic device is described, comprising: a display; button; one or more biometric sensors separate from the button; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: while the electronic device is in a first state in which a respective function of the device is disabled, the one or more programs of the button to detect activations; and in response to detecting one or more activations of the button: to capture biometric data with one or more biometric sensors separate from the button; according to a determination that the biometric data satisfies the biometric authentication criteria, transition the electronic device to a second state in which a respective function of the device is enabled; and in accordance with a determination that the biometric data does not satisfy the biometric authentication criteria, maintain the electronic device in the first state and display an indication on the display that the biometric authentication has failed.

According to some examples, an electronic device is described, comprising: a display; button; one or more biometric sensors separate from the button; means for detecting one or more activations of a button while the electronic device is in a first state in which a respective function of the device is disabled; and in response to detecting one or more activations of the button: means for capturing biometric data with one or more biometric sensors separate from the button; means for transitioning the electronic device to a second state in which a respective function of the device is enabled in accordance with a determination that the biometric data satisfies the biometric authentication criteria; and means for maintaining the electronic device in the first state and displaying an indication on the display that the biometric authentication failed in accordance with a determination that the biometric data does not satisfy the biometric authentication criteria.

According to some examples, a method is described, the method comprising: in an electronic device having one or more biometric sensors and a display: detecting a request to perform each operation requiring authentication; and in response to detecting the request to perform each operation requiring authentication: in accordance with a determination that the device is unlocked, performing the respective operation; and upon determining that the device is locked and that the first form of authentication is available for use, wherein the first form of authentication is a form of biometric authentication based on data obtained by the one or more biometric sensors, on the display and displaying an authentication indicator for the first form of authentication without displaying one or more affordances for using the second form of authentication.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display. wherein the one or more programs are configured to: detect a request to perform a respective operation requiring authentication; and in response to detecting the request to perform each operation requiring authentication: according to a determination that the device is unlocked, to perform each operation; and upon determining that the device is locked and that the first form of authentication is available for use, wherein the first form of authentication is a form of biometric authentication based on data obtained by one or more biometric sensors, on the display , instructions for displaying an authentication indicator for the first form of authentication without displaying one or more affordances for using the second form of authentication.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors and a display, and , one or more programs to detect a request to perform a respective operation requiring authentication; and in response to detecting the request to perform each operation requiring authentication: according to a determination that the device is unlocked, to perform each operation; and upon determining that the device is locked and that the first form of authentication is available for use, wherein the first form of authentication is a form of biometric authentication based on data obtained by one or more biometric sensors, on the display , instructions for displaying an authentication indicator for the first form of authentication without displaying one or more affordances for using the second form of authentication.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs configured to: detect a request to perform a respective operation requiring authentication; and in response to detecting the request to perform each operation requiring authentication: according to a determination that the device is unlocked, to perform each operation; and upon determining that the device is locked and that the first form of authentication is available for use, wherein the first form of authentication is a form of biometric authentication based on data obtained by one or more biometric sensors, on the display , instructions for displaying an authentication indicator for the first form of authentication without displaying one or more affordances for using the second form of authentication.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; means for detecting a request to perform each operation requiring authentication; and in response to detecting a request to perform a respective operation requiring authentication: means for performing, in accordance with a determination that the device is unlocked, each operation; and upon determining that the device is locked and that the first form of authentication is available for use, wherein the first form of authentication is a form of biometric authentication based on data obtained by the one or more biometric sensors, on the display , means for displaying an authentication indicator for the first form of authentication without displaying one or more affordances for using the second form of authentication.

According to some examples, a method is described, comprising: at an electronic device having one or more biometric sensors: receiving a first request to perform a respective operation requiring authentication; In response to receiving a first request to perform a respective operation: determining whether biometric authentication criteria are met using the one or more biometric sensors, the biometric authentication criteria being configured to: including a requirement that each type of biometric feature applied is detected by biometric sensors; performing each action in accordance with a determination that the biometric authentication criteria are met; and in accordance with a determination that the biometric authentication criteria are not met, withholding performing the respective operation; receiving a second request to perform a respective operation subsequent to determining that the biometric authentication criteria have not been met in response to receiving the first request; and in response to receiving a second request to perform a respective operation: the biometric authentication criteria are set in response to the first request due to failure of the one or more biometric sensors to detect the presence of the respective type of biometric feature. determining whether biometric authentication criteria are met using the one or more biometric sensors in response to the second request, in accordance with a determination that it has not been met; and determining that the biometric authentication criteria have not been met in response to the first request due to the one or more biometric sensors detecting a respective type of biometric feature that does not correspond to the applied biometric feature; responsive to, withholding determining whether the biometric authentication criteria are met using the one or more biometric sensors.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, The one or more programs are configured to: receive a first request to perform a respective operation requiring authentication; In response to receiving a first request to perform a respective operation: to determine whether biometric authentication criteria are met using one or more biometric sensors, the biometric authentication criteria being authorized to perform a respective operation including a requirement that each type of biometric feature to be detected is detected by biometric sensors; in accordance with a determination that the biometric authentication criteria are met, to perform each action; and in accordance with a determination that the biometric authentication criteria are not met, to withhold performing the respective operation; receiving a second request to perform a respective action subsequent to determining that the biometric authentication criteria have not been met in response to receiving the first request; and in response to receiving a second request to perform a respective operation: the biometric authentication criteria are met in response to the first request due to the one or more biometric sensors failing to detect the presence of the respective type of biometric feature. in response to the second request, according to a determination that it is not, to determine whether biometric authentication criteria are met using the one or more biometric sensors; and in accordance with a determination that biometric authentication criteria have not been met in response to the first request due to the one or more biometric sensors detecting a respective type of biometric feature that does not correspond to the authorized biometric feature, the second request and suspend determining whether biometric authentication criteria are met using the one or more biometric sensors in response to

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, and the one or more The programs are configured to: receive a first request to perform a respective operation requiring authentication; In response to receiving a first request to perform a respective operation: to determine whether biometric authentication criteria are met using one or more biometric sensors, the biometric authentication criteria being authorized to perform a respective operation including a requirement that each type of biometric feature to be detected is detected by biometric sensors; in accordance with a determination that the biometric authentication criteria are met, to perform each action; and in accordance with a determination that the biometric authentication criteria are not met, to withhold performing the respective operation; receiving a second request to perform a respective action subsequent to determining that the biometric authentication criteria have not been met in response to receiving the first request; and in response to receiving a second request to perform a respective operation: the biometric authentication criteria are met in response to the first request due to the one or more biometric sensors failing to detect the presence of the respective type of biometric feature. in response to the second request, according to a determination that it is not, to determine whether biometric authentication criteria are met using the one or more biometric sensors; and in accordance with a determination that biometric authentication criteria have not been met in response to the first request due to the one or more biometric sensors detecting a respective type of biometric feature that does not correspond to the authorized biometric feature, the second request and suspend determining whether biometric authentication criteria are met using the one or more biometric sensors in response to

According to some examples, an electronic device is described, comprising: one or more biometric sensors; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs configured to: receive a first request to perform a respective operation requiring authentication; In response to receiving a first request to perform a respective operation: to determine whether biometric authentication criteria are met using one or more biometric sensors, the biometric authentication criteria being authorized to perform a respective operation including a requirement that each type of biometric feature to be detected is detected by biometric sensors; in accordance with a determination that the biometric authentication criteria are met, to perform each action; and in accordance with a determination that the biometric authentication criteria are not met, to withhold performing the respective operation; receiving a second request to perform a respective action subsequent to determining that the biometric authentication criteria have not been met in response to receiving the first request; and in response to receiving a second request to perform a respective operation: the biometric authentication criteria are met in response to the first request due to the one or more biometric sensors failing to detect the presence of the respective type of biometric feature. in response to the second request, according to a determination that it is not, to determine whether biometric authentication criteria are met using the one or more biometric sensors; and in accordance with a determination that biometric authentication criteria have not been met in response to the first request due to the one or more biometric sensors detecting a respective type of biometric feature that does not correspond to the authorized biometric feature, the second request and suspend determining whether biometric authentication criteria are met using the one or more biometric sensors in response to

According to some examples, an electronic device is described, comprising: one or more biometric sensors; means for receiving a first request to perform a respective operation requiring authentication; In response to receiving a first request to perform a respective operation: to determine whether biometric authentication criteria are met using one or more biometric sensors, the biometric authentication criteria being authorized to perform a respective operation including a requirement that each type of biometric feature to be detected is detected by biometric sensors; in accordance with a determination that the biometric authentication criteria are met, to perform each action; and in accordance with a determination that the biometric authentication criteria are not met, means for withholding performing the respective operation; means for receiving a second request to perform a respective action subsequent to determining that the biometric authentication criteria have not been met in response to receiving the first request; and in response to receiving a second request to perform a respective operation: the biometric authentication criteria are met in response to the first request due to failure of the one or more biometric sensors to detect the presence of the respective type of biometric feature. in response to the second request, according to a determination that it is not, to determine whether biometric authentication criteria are met using the one or more biometric sensors; and in accordance with a determination that biometric authentication criteria have not been met in response to the first request due to the one or more biometric sensors detecting a respective type of biometric feature that does not correspond to the authorized biometric feature, the second request and suspend determining whether biometric authentication criteria are met using the one or more biometric sensors in response to

According to some examples, a method is described, comprising: at an electronic device having one or more biometric sensors: receiving a first request to perform a first operation requiring authentication; In response to receiving the first request to perform a first action: determining whether first biometric authentication criteria are met using the one or more biometric sensors, the first biometric authentication criteria comprising: including a requirement that each type of biometric feature applied to perform the action is detected by the biometric sensors; in response to determining that the first biometric authentication criteria are met, performing a first action; and in accordance with a determination that the biometric authentication criteria are not met, withholding performing the first action; receiving, after performing the first operation, a second request to perform a second operation requiring authentication; and in response to receiving the second request: in accordance with a determination that the reauthentication criteria have been met, determining whether the second biometric authentication criteria are met using the one or more biometric sensors - a second biometric authentication the criteria include a requirement that each type of biometric feature applied to perform the second action is detected by the biometric sensors; and in accordance with a determination that the re-authentication criteria have not been met, perform a second action without performing biometric authentication, and withhold using the one or more biometric sensors to determine whether the second biometric authentication criteria are met. including the steps of

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, The one or more programs are configured to: receive a first request to perform a first operation requiring authentication; In response to receiving a first request to perform a first action: to determine whether first biometric authentication criteria are met using the one or more biometric sensors, the first biometric authentication criteria include: including a requirement that each type of biometric feature that is applied to perform is detected by biometric sensors; according to determining that the first biometric authentication criteria are met, perform a first action; and in accordance with a determination that the biometric authentication criteria are not met, withholding from performing the first action; receiving, after performing the first operation, a second request to perform a second operation requiring authentication; and in response to receiving the second request: according to a determination that the reauthentication criteria have been met, to determine whether second biometric authentication criteria are met using the one or more biometric sensors - a second biometric authentication criterion includes a requirement that each type of biometric feature applied to perform the second action is detected by the biometric sensors; and in accordance with a determination that the re-authentication criteria have not been met, perform a second action without performing biometric authentication, and withhold determining whether the second biometric authentication criteria are satisfied using the one or more biometric sensors. contains instructions for

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, and the one or more The programs are configured to: receive a first request to perform a first operation requiring authentication; In response to receiving a first request to perform a first action: to determine whether first biometric authentication criteria are met using the one or more biometric sensors, the first biometric authentication criteria include: including a requirement that each type of biometric feature that is applied to perform is detected by biometric sensors; according to determining that the first biometric authentication criteria are met, perform a first action; and in accordance with a determination that the biometric authentication criteria are not met, withholding from performing the first action; receiving, after performing the first operation, a second request to perform a second operation requiring authentication; and in response to receiving the second request: according to a determination that the reauthentication criteria have been met, to determine whether second biometric authentication criteria are met using the one or more biometric sensors - a second biometric authentication criterion includes a requirement that each type of biometric feature applied to perform the second action is detected by the biometric sensors; and in accordance with a determination that the re-authentication criteria have not been met, perform a second action without performing biometric authentication, and withhold determining whether the second biometric authentication criteria are satisfied using the one or more biometric sensors. contains instructions for

According to some examples, an electronic device is described, comprising: one or more biometric sensors; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs configured to: receive a first request to perform a first operation requiring authentication; In response to receiving a first request to perform a first action: to determine whether first biometric authentication criteria are met using the one or more biometric sensors, the first biometric authentication criteria include: including a requirement that each type of biometric feature that is applied to perform is detected by biometric sensors; according to determining that the first biometric authentication criteria are met, perform a first action; and in accordance with a determination that the biometric authentication criteria are not met, withholding from performing the first action; receiving, after performing the first operation, a second request to perform a second operation requiring authentication; and in response to receiving the second request: according to a determination that the reauthentication criteria have been met, to determine whether second biometric authentication criteria are met using the one or more biometric sensors - a second biometric authentication criterion includes a requirement that each type of biometric feature applied to perform the second action is detected by the biometric sensors; and in accordance with a determination that the re-authentication criteria have not been met, perform a second action without performing biometric authentication, and withhold determining whether the second biometric authentication criteria are satisfied using the one or more biometric sensors contains instructions for

According to some examples, an electronic device is described, comprising: one or more biometric sensors; means for receiving a first request to perform a first operation requiring authentication; In response to receiving a first request to perform a first action: to determine whether first biometric authentication criteria are met using the one or more biometric sensors, the first biometric authentication criteria include: including a requirement that each type of biometric feature that is applied to perform is detected by biometric sensors; according to determining that the first biometric authentication criteria are met, perform a first action; and in accordance with a determination that the biometric authentication criteria are not met, means for withholding performing the first action; means for receiving, after performing the first operation, a second request to perform a second operation requiring authentication; and in response to receiving the second request: according to a determination that the reauthentication criteria have been met, to determine whether second biometric authentication criteria are met using the one or more biometric sensors - a second biometric authentication criterion includes a requirement that each type of biometric feature applied to perform the second action is detected by the biometric sensors; and in accordance with a determination that the re-authentication criteria have not been met, perform a second action without performing biometric authentication, and withhold determining whether the second biometric authentication criteria are satisfied using the one or more biometric sensors. includes means for

According to some examples, a method is described, comprising at an electronic device having a display: receiving a request to display a first portion of respective content; and in response to the request to display the first portion of the respective content: displaying at least the first portion of the respective content on the display, each content including an element associated with the authentication operation; initiating biometric authentication upon determining that an element associated with the authentication operation meets visibility criteria; and in accordance with a determination that the element associated with the authentication operation does not meet the visibility criteria, withholding initiating the biometric authentication.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display, the one or more programs comprising: , for receiving a request to display a first portion of each content; and in response to the request to display the first portion of the respective content: to display at least the first portion of the respective content on the display, each content comprising an element associated with an authentication operation; in accordance with a determination that an element associated with the authentication operation meets visibility criteria, to initiate biometric authentication; and in accordance with a determination that an element associated with the authentication operation does not meet the visibility criteria, withhold instructions for withholding initiating the biometric authentication.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display, each of the one or more programs comprising: to receive a request to display a first portion of the content of ; and in response to the request to display the first portion of the respective content: to display at least the first portion of the respective content on the display, each content comprising an element associated with an authentication operation; in accordance with a determination that an element associated with the authentication operation meets visibility criteria, to initiate biometric authentication; and in accordance with a determination that an element associated with the authentication operation does not meet the visibility criteria, withhold instructions for withholding initiating the biometric authentication.

According to some examples, an electronic device is described, comprising: a display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs configured to: receive a request to display a first portion of each content; and in response to the request to display the first portion of the respective content: to display at least the first portion of the respective content on the display, each content comprising an element associated with an authentication operation; in accordance with a determination that an element associated with the authentication operation meets visibility criteria, to initiate biometric authentication; and in accordance with a determination that an element associated with the authentication operation does not meet the visibility criteria, withhold instructions for withholding initiating the biometric authentication.

According to some examples, an electronic device is described, comprising: a display; means for receiving a request to display a first portion of each content; and in response to the request to display the first portion of the respective content: to display at least the first portion of the respective content on the display, each content comprising an element associated with an authentication operation; in accordance with a determination that an element associated with the authentication operation meets visibility criteria, to initiate biometric authentication; and means for withholding initiating biometric authentication upon determining that the element associated with the authentication operation does not meet the visibility criteria.

According to some examples, a method is described, comprising: in an electronic device having a display and one or more biometric sensors: detecting a predefined action corresponding to a submit credential user interface having a submit credential user interface element step; and in response to detecting the predefined action: according to a determination that biometric authentication via the one or more biometric sensors is available, display on the display the one or more biometric features that meet the biometric authentication criteria. and displaying the credential submission user interface having a visual indication that presenting to the sensors will cause the credentials to be submitted via the credential submission user interface element.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. and the one or more programs are configured to: detect a predefined action corresponding to the submit credential user interface having a submit credential user interface element; and in response to detecting the predefined action: according to a determination that biometric authentication via the one or more biometric sensors is available, display, on the display, a biometric feature that meets the biometric authentication criteria to the one or more biometric sensors. Including instructions for displaying a credential submission user interface with a visual indication that presenting to the credentials will cause the credentials to be submitted via a credential submission user interface element.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, The one or more programs are configured to: detect a predefined action corresponding to a credential submission user interface having a credential submission user interface element; and in response to detecting the predefined action: according to a determination that biometric authentication via the one or more biometric sensors is available, display, on the display, a biometric feature that meets the biometric authentication criteria to the one or more biometric sensors. Including instructions for displaying a credential submission user interface with a visual indication that presenting to the credentials will cause the credentials to be submitted via a credential submission user interface element.

According to some examples, an electronic device is described, comprising: a display; one or more biometric sensors; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs are configured to: detect a predefined action corresponding to a credential submission user interface having a credential submission user interface element; ; and in response to detecting the predefined action: according to a determination that biometric authentication via the one or more biometric sensors is available, display, on the display, a biometric feature that meets the biometric authentication criteria to the one or more biometric sensors. Including instructions for displaying a credential submission user interface with a visual indication that presenting to the credentials will cause the credentials to be submitted via a credential submission user interface element.

According to some examples, an electronic device is described, comprising: a display; one or more biometric sensors; means for detecting a predefined action corresponding to the credential submission user interface having a credential submission user interface element; and in response to detecting the predefined action: according to a determination that biometric authentication via the one or more biometric sensors is available, display, on the display, a biometric feature that meets the biometric authentication criteria to the one or more biometric sensors. and means for displaying a credential submission user interface having a visual indication that presenting to the credentials will cause the credentials to be submitted via the credential submission user interface element.

According to some examples, a method is described, comprising, in an electronic device having a touch-sensitive display and one or more biometric sensors: on the touch-sensitive display, a credential input user interface having a plurality of character input keys. displaying; receiving, via the touch-sensitive display, a touch gesture input comprising movement of a contact on the touch-sensitive display during displaying the credential input user interface; and in response to receiving a touch gesture input comprising movement of the contact on the touch-sensitive display: in accordance with a determination that the one or more criteria of the first set are met, the one or more criteria of the first set are: including a requirement to be currently enabled on the electronic device, comprising attempting to biometrically authenticate a user of the electronic device based on the biometric information captured using the one or more biometric sensors.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising: one or more processors configured to be executed by one or more processors of an electronic device having a touch-sensitive display and one or more biometric sensors programs, the one or more programs configured to: display, on a touch-sensitive display, a credential input user interface having a plurality of character input keys; while displaying the credential input user interface, via the touch-sensitive display, for receiving a touch gesture input comprising movement of a contact on the touch-sensitive display; and in response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display: in accordance with a determination that the first set of one or more criteria are met, the first set of one or more criteria: including a requirement to be currently enabled on the device, including instructions for attempting to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors.

According to some examples, a transitory computer readable medium is described, comprising: one or more programs configured to be executed by one or more processors of an electronic device having a touch-sensitive display and one or more biometric sensors wherein the one or more programs are configured to: display, on the touch-sensitive display, a credential input user interface having a plurality of character input keys; while displaying the credential input user interface, via the touch-sensitive display, for receiving a touch gesture input comprising movement of a contact on the touch-sensitive display; and in response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display: in accordance with a determination that the first set of one or more criteria are met, the first set of one or more criteria: including a requirement to be currently enabled on the device, including instructions for attempting to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; touch-sensitive display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs for: displaying, on the touch-sensitive display, a credential input user interface having a plurality of character input keys; while displaying the credential input user interface, via the touch-sensitive display, for receiving a touch gesture input comprising movement of a contact on the touch-sensitive display; and in response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display: in accordance with a determination that the first set of one or more criteria are met, the first set of one or more criteria: including a requirement to be currently enabled on the device, including instructions for attempting to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; touch-sensitive display; means for displaying, on the touch-sensitive display, a credential input user interface having a plurality of character input keys; means for receiving, via the touch-sensitive display, a touch gesture input comprising movement of a contact on the touch-sensitive display while displaying the credential input user interface; and in response to receiving a touch gesture input comprising movement of a contact on the touch-sensitive display: in accordance with a determination that the first set of one or more criteria are met, the first set of one or more criteria: including a requirement to be currently enabled on the device, including means for attempting to biometrically authenticate a user of the electronic device based on the biometric information captured using the one or more biometric sensors.

According to some embodiments, a method is described, the method comprising: at an electronic device having a display and one or more input devices: receiving, via the one or more input devices, a request to perform an operation requiring authentication; and in response to the request to perform an action requiring authentication: according to a determination that the authentication is successful, performing the action; and according to a determination that the authentication is not successful and that the set of error condition criteria is met: displaying an indication of the error condition on the display, the indication comprising information regarding a cause of the error condition; and withholding performing the action.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, and , one or more programs, to receive, via one or more input devices, a request to perform an operation that requires authentication; and in response to the request to perform an operation requiring authentication: according to a determination that authentication is successful, to perform an operation; and according to a determination that the authentication is not successful and that the set of error condition criteria is met: for displaying an indication of the error condition on the display, the indication comprising information about a cause of the error condition; and instructions for suspending performing the operation.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, the one or more The above programs are configured, via one or more input devices, for receiving a request to perform an operation requiring authentication; and in response to the request to perform an operation requiring authentication: according to a determination that authentication is successful, to perform an operation; and according to a determination that the authentication is not successful and that the set of error condition criteria is met: for displaying an indication of the error condition on the display, the indication comprising information about a cause of the error condition; and instructions for suspending performing the operation.

According to some examples, an electronic device is described, comprising: one or more input devices; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs configured to: receive, via the one or more input devices, a request to perform an operation requiring authentication; and in response to the request to perform an operation requiring authentication: according to a determination that authentication is successful, to perform an operation; and according to a determination that the authentication is not successful and that the set of error condition criteria is met: for displaying an indication of the error condition on the display, the indication comprising information about a cause of the error condition; and instructions for suspending performing the operation.

According to some examples, an electronic device is described, comprising: one or more input devices; display; means for receiving, via one or more input devices, a request to perform an operation requiring authentication; and in response to the request to perform an operation requiring authentication: according to a determination that authentication is successful, to perform an operation; and according to a determination that the authentication is not successful and that the set of error condition criteria is met: for displaying an indication of the error condition on the display, the indication comprising information about a cause of the error condition; and means for withholding performing the action.

According to some examples, a method is described, in an electronic device having a biometric sensor and a display in a first portion of the electronic device: preventing the biometric sensor from obtaining biometric information about a user of the device detecting the presence of an error condition to and in response to detecting the presence of the error condition, displaying an error indication on the display, wherein the error indication is displayed at a location proximate to the first portion of the electronic device, wherein displaying the error indication comprises: in response to determining that the user interface of the electronic device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; and in response to determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying the error indication at a second location in the user interface proximate the first portion of the electronic device, wherein the first orientation comprises: is different from the second orientation.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium being configured to be executed by one or more processors of an electronic device having a biometric sensor and a display in a first portion of the electronic device. one or more programs configured to: detect the presence of an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; and in response to detecting the presence of the error condition, displaying an error indication on the display, the error indication being displayed at a location proximate to the first portion of the electronic device, and displaying the error indication comprises: in response to determining that the user interface of the device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; and in response to determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying the error indication at a second location in the user interface proximate the first portion of the electronic device, wherein the first orientation is different from the second orientation.

According to some examples, a transitory computer readable medium is described, comprising: one or more processors configured to be executed by one or more processors of an electronic device having a display and a biometric sensor in a first portion of the electronic device one or more programs for detecting the presence of an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; and in response to detecting the presence of the error condition, displaying an error indication on the display, the error indication being displayed at a location proximate to the first portion of the electronic device, and displaying the error indication comprises: in response to determining that the user interface of the device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; and in response to determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying the error indication at a second location in the user interface proximate the first portion of the electronic device, wherein the first orientation is different from the second orientation.

According to some examples, an electronic device is described, comprising: a biometric sensor in a first portion of the electronic device; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs: detecting the presence of an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device to do; and in response to detecting the presence of the error condition, displaying an error indication on the display, the error indication being displayed at a location proximate to the first portion of the electronic device, and displaying the error indication comprises: in response to determining that the user interface of the device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; and in response to determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying the error indication at a second location in the user interface proximate the first portion of the electronic device, wherein the first orientation is different from the second orientation.

According to some examples, an electronic device is described, comprising: a biometric sensor in a first portion of the electronic device; display; means for detecting the presence of an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; and in response to detecting the presence of the error condition, means for displaying an error indication on the display, wherein the error indication is displayed at a location proximate to the first portion of the electronic device, wherein displaying the error indication comprises: in response to determining that the user interface of the device is in a first orientation with respect to the biometric sensor, displaying an error indication at a first location in the user interface proximate the first portion of the electronic device; and in response to determining that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, displaying the error indication at a second location in the user interface proximate the first portion of the electronic device, wherein the first orientation is different from the second orientation.

According to some examples, a method is described, comprising: in an electronic device having a display and one or more biometric sensors: on the display, a biometric enrollment user interface for initiating biometric enrollment with one or more biometric sensors displaying; receiving, during displaying the biometric enrollment user interface, an input corresponding to a request to initiate biometric enrollment; and in response to receiving the input: in accordance with a determination that the orientation of the electronic device satisfies the set of enrollment criteria, initiating a process for registering the biometric feature with the one or more biometric sensors; and upon determining that the orientation of the electronic device does not satisfy the set of enrollment criteria, outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. and, the one or more programs are configured to: display, on the display, a biometric enrollment user interface for initiating biometric enrollment with one or more biometric sensors; while displaying the biometric enrollment user interface, for receiving an input corresponding to a request to initiate biometric enrollment; and in response to receiving the input: in accordance with a determination that the orientation of the electronic device satisfies the set of enrollment criteria, to initiate a process for registering the biometric feature with the one or more biometric sensors; and upon determining that the orientation of the electronic device does not satisfy the set of enrollment criteria, output one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

According to some examples, a transitory computer readable medium is described, the transitory computer readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, The one or more programs are configured to: display, on the display, a biometric enrollment user interface for initiating biometric enrollment with one or more biometric sensors; while displaying the biometric enrollment user interface, for receiving an input corresponding to a request to initiate biometric enrollment; and in response to receiving the input: in accordance with a determination that the orientation of the electronic device satisfies the set of enrollment criteria, to initiate a process for registering the biometric feature with the one or more biometric sensors; and upon determining that the orientation of the electronic device does not satisfy the set of enrollment criteria, output one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: on the display: a biometric enrollment user interface for initiating biometric enrollment with the one or more biometric sensors; for display; while displaying the biometric enrollment user interface, for receiving an input corresponding to a request to initiate biometric enrollment; and in response to receiving the input: in accordance with a determination that the orientation of the electronic device satisfies the set of enrollment criteria, to initiate a process for registering the biometric feature with the one or more biometric sensors; and upon determining that the orientation of the electronic device does not satisfy the set of enrollment criteria, output one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

According to some examples, an electronic device is described, comprising: one or more biometric sensors; display; means for displaying, on the display, a biometric enrollment user interface for initiating biometric enrollment with one or more biometric sensors; means for receiving, while displaying the biometric enrollment user interface, an input corresponding to a request to initiate biometric enrollment; and in response to receiving the input: in accordance with a determination that the orientation of the electronic device satisfies the set of enrollment criteria, to initiate a process for registering the biometric feature with the one or more biometric sensors; and in accordance with a determination that the orientation of the electronic device does not satisfy the set of enrollment criteria, means for outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are optionally included in a transitory computer readable storage medium or other computer program product configured for execution by one or more processors.

Accordingly, devices are provided with faster and more efficient methods and interfaces for implementing biometric authentication, thereby increasing the effectiveness, efficiency, and user satisfaction of such devices. These methods and interfaces optionally complement or replace other methods for implementing biometric authentication.

For a better understanding of the various examples described, reference should be made to the specific details for carrying out the invention below, with reference to the drawings below in which like reference numerals indicate corresponding parts throughout.
1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display, in accordance with some embodiments.
1B is a block diagram illustrating example components for event processing, in accordance with some embodiments.
1C is a block diagram illustrating example components for generating a tactile output, in accordance with some embodiments.
2 illustrates a portable multifunction device with a touch screen, in accordance with some embodiments.
3 is a block diagram of an exemplary multifunction device having a display and a touch-sensitive surface, in accordance with some embodiments.
4A illustrates an example user interface for a menu of applications on a portable multifunction device, in accordance with some embodiments.
4B illustrates an example user interface for a multifunction device having a touch-sensitive surface separate from a display, in accordance with some embodiments.
4C-4H illustrate example tactile output patterns having a particular waveform, in accordance with some embodiments.
5A illustrates a personal electronic device in accordance with some embodiments.
5B is a block diagram illustrating a personal electronic device in accordance with some embodiments.
5C-5D illustrate example components of a personal electronic device having a touch-sensitive display and intensity sensors, in accordance with some embodiments.
5E-5H illustrate example components and user interfaces of a personal electronic device, in accordance with some embodiments.
6 illustrates example devices connected via one or more communication channels, in accordance with some embodiments.
7A-7S illustrate example user interfaces for biometric enrollment process instructions, in accordance with some examples.
8A-8C are flow diagrams illustrating methods of biometric enrollment process instructions.
9A-9A illustrate example user interfaces for aligning a biometric feature for enrollment.
10A-10F are flow diagrams illustrating methods of aligning a biometric feature for enrollment.
11A-11O illustrate example user interfaces for registering a biometric feature.
12A and 12B are flow diagrams illustrating methods of registering a biometric feature.
13A-13R illustrate example user interfaces for providing hints during the biometric enrollment process.
14A-14C are flow diagrams illustrating methods of providing hints during a biometric enrollment process.
15A-15T illustrate example user interfaces for application-based biometric authentication.
16A-16E are flow diagrams illustrating methods of application-based biometric authentication.
17A-17AI illustrate example user interfaces for automatically populating biometric security fields.
18A-18D are flow diagrams illustrating methods of automatically populating biometric security fields.
19A-19AB illustrate example user interfaces for unlocking a device using biometric authentication.
20A-20F are flow diagrams illustrating methods of unlocking a device using biometric authentication.
21A-21AQ illustrate example user interfaces for retrying biometric authentication.
22A-22F are flowcharts illustrating methods of retrying biometric authentication.
23A-23Q illustrate example user interfaces for managing transmissions using biometric authentication.
24A-24BC illustrate example user interfaces for managing transmissions using biometric authentication.
25A-25C are flow diagrams illustrating methods of managing transmissions using biometric authentication.
26A-26A illustrate example user interfaces for providing interstitial user interfaces during biometric authentication.
27A-27E are flow diagrams illustrating methods of providing embedded user interfaces during biometric authentication.
28A-28AA illustrate example user interfaces for preventing retry of biometric authentication.
29A and 29B are flowcharts illustrating methods of preventing retry of biometric authentication.
30A-30A illustrate example user interfaces for cached biometric authentication.
31A and 31B are flow diagrams illustrating methods of cached biometric authentication.
32A-32W illustrate example user interfaces for automatically populating fillable fields based on visibility criteria.
33 is a flow diagram illustrating methods of automatically populating fillable fields based on visibility criteria.
34A-34N illustrate example user interfaces for automatic login using biometric authentication.
35 is a flowchart illustrating methods of automatic login using biometric authentication.
36A-36L illustrate example user interfaces for retrying biometric authentication in a credential input user interface, in accordance with some examples.
37A and 37B are flow diagrams illustrating a method for retrying biometric authentication in a credential input user interface using an electronic device, in accordance with some examples.
38A-38A illustrate example user interfaces for providing indications of error conditions during biometric authentication, in accordance with some examples.
39A and 39B are flow diagrams illustrating a method for providing indications of error conditions during biometric authentication, in accordance with some examples.
40A-40U illustrate example user interfaces for providing indications regarding a biometric sensor during biometric authentication, in accordance with some examples.
41A-41C are flow diagrams illustrating a method for providing indications regarding a biometric sensor during biometric authentication, in accordance with some examples.
42A-42P illustrate example user interfaces for orienting a device to enroll a biometric feature, in accordance with some examples.
43A-43C are flow diagrams illustrating a method for orienting a device to enroll a biometric feature, in accordance with some examples.

The following description sets forth exemplary methods, parameters, and the like. It should be appreciated, however, that this description is not intended as a limitation on the scope of the present disclosure, but is instead provided as a description of exemplary embodiments.

A need exists for electronic devices that provide efficient methods and interfaces for implementing biometric authentication of biometric features. For example, a need exists for electronic devices that provide a convenient and efficient method for registering one or more portions of a biometric feature. As another example, a need exists for electronic devices that provide a fast and intuitive technique for selectively accessing secure data in accordance with biometric authentication. As another example, a need exists for electronic devices that provide a quick and intuitive technique for enabling the functionality of a device in accordance with biometric authentication. Such techniques may reduce the cognitive burden of a user registering a biometric feature and/or biometrically authenticating with a device, thereby improving overall productivity. Additionally, such techniques may reduce processor and battery power that would otherwise be wasted with extra user inputs.

In the following, FIGS. 1A-1C , 2 , 3 , 4A, 4B, and 5A-5H provide descriptions of example devices for performing techniques for implementing biometric authentication. 6 illustrates example devices connected via one or more communication channels, in accordance with some embodiments. 7A-7S illustrate example user interfaces for biometric enrollment process instructions, in accordance with some embodiments. 8A-8C are flow diagrams illustrating methods of biometric enrollment process instructions. The user interfaces of FIGS. 7A-7S are used to illustrate the processes described below, including the processes of FIGS. 8A-8C . 9A-9A illustrate example user interfaces for aligning a biometric feature for enrollment. 10A-10F are flow diagrams illustrating methods of aligning a biometric feature for enrollment. The user interfaces of FIGS. 9A-9A are used to illustrate the processes described below, including the processes of FIGS. 10A-10F. 11A-11O illustrate example user interfaces for registering a biometric feature. 12A and 12B are flow diagrams illustrating methods of registering a biometric feature. The user interfaces of FIGS. 11A-11O are used to illustrate the processes described below, including the processes of FIGS. 12A and 12B . 13A-13R illustrate example user interfaces for providing hints during the biometric enrollment process. 14A-14C are flow diagrams illustrating methods of providing hints during a biometric enrollment process. The user interfaces of FIGS. 13A-13R are used to illustrate the processes described below, including the processes of FIGS. 14A-14C . 15A-15T illustrate example user interfaces for application-based biometric authentication. 16A-16E are flow diagrams illustrating methods of application-based biometric authentication. The user interfaces of FIGS. 15A-15T are used to illustrate the processes described below, including the processes of FIGS. 16A-16E . 17A-17AI illustrate example user interfaces for automatically populating biometric security fields. 18A-18D are flow diagrams illustrating methods of automatically populating biometric security fields. The user interfaces of FIGS. 17A-17A are used to illustrate the processes described below, including the processes of FIGS. 18A-18D . 19A-19AB illustrate example user interfaces for unlocking a device using biometric authentication. 20A-20F are flow diagrams illustrating methods of unlocking a device using biometric authentication. The user interfaces of FIGS. 19A-19AB are used to illustrate the processes described below, including the processes of FIGS. 20A-20F. 21A-21AQ illustrate example user interfaces for retrying biometric authentication. 22A-22F are flowcharts illustrating methods of retrying biometric authentication. The user interfaces of FIGS. 21A-21AQ are used to illustrate the processes described below, including the processes of FIGS. 22A-22F. 23A-23Q illustrate example user interfaces for managing transmissions using biometric authentication. 24A-24BC illustrate example user interfaces for managing transmissions using biometric authentication. 25A-25C are flow diagrams illustrating methods of managing transmissions using biometric authentication. The user interfaces of FIGS. 23A-23Q and 24A-24BC are used to illustrate the processes described below, including the processes of FIGS. 25A-25C. 26A-26A illustrate example user interfaces for providing embedded user interfaces during biometric authentication. 27A-27E are flow diagrams illustrating methods of providing embedded user interfaces during biometric authentication. The user interfaces of FIGS. 26A-26A are used to illustrate the processes described below, including the processes of FIGS. 27A-27E . 28A-28AA illustrate example user interfaces for preventing retry of biometric authentication. 29A and 29B are flowcharts illustrating methods of preventing retry of biometric authentication. The user interfaces of FIGS. 28A-28AA are used to illustrate the processes described below, including the processes of FIGS. 29A and 29B . 30A-30A illustrate example user interfaces for cached biometric authentication. 31A and 31B are flow diagrams illustrating methods of cached biometric authentication. The user interfaces of FIGS. 30A-30A are used to illustrate the processes described below, including the processes of FIGS. 31A and 31B . 32A-32W illustrate example user interfaces for automatically populating fillable fields based on visibility criteria. 33 is a flow diagram illustrating methods of automatically populating fillable fields based on visibility criteria. The user interfaces of FIGS. 32A-32W are used to illustrate the processes described below, including the processes of FIG. 33 . 34A-34N illustrate example user interfaces for automatic login using biometric authentication. 35 is a flowchart illustrating methods of automatic login using biometric authentication. The user interfaces of FIGS. 34A-34N are used to illustrate the processes described below, including the processes of FIG. 35 . 36A-36L illustrate example user interfaces for retrying biometric authentication in a credential input user interface. 37A and 37B are flow diagrams illustrating a method for retrying biometric authentication in a credential input user interface. The user interfaces of FIGS. 36A-36L are used to illustrate the processes described below, including the processes of FIGS. 37A and 37B . 38A-38A illustrate example user interfaces for providing indications of error conditions during biometric authentication. 39A and 39B are flow diagrams illustrating a method for providing indications of error conditions during biometric authentication. The user interfaces of FIGS. 38A-38A are used to illustrate the processes described below, including the processes of FIGS. 39A and 39B . 40A-40U illustrate example user interfaces for providing indications regarding a biometric sensor during biometric authentication. 41A-41C are flow diagrams illustrating a method for providing indications relating to a biometric sensor during biometric authentication. The user interfaces of FIGS. 40A-40U are used to illustrate the processes described below, including the processes of FIGS. 41A-41C . 42A-42P illustrate example user interfaces for orienting a device to enroll a biometric feature. 43A-43C are flow diagrams illustrating a method for orienting a device to enroll a biometric feature. The user interfaces of FIGS. 42A-42P are used to illustrate the processes described below, including the processes of FIGS. 43A-43C.

Although the following description uses terms such as "first", "second", etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch may be referred to as a second touch, and similarly, a second touch may be referred to as a first touch, without departing from the scope of the various embodiments described. The first touch and the second touch are both touches, but they are not the same touch.

The terminology used in the description of the variously described embodiments herein is for the purpose of describing the specific embodiments only, and is not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It is intended It will also be understood that the term “and/or” as used herein indicates and encompasses any and all possible combinations of one or more of the listed associated items. The terms “include,” “including,” “comprise,” and/or “comprising,” as used herein, refer to the recited features, integers, Specifies the presence of steps, steps, actions, elements, and/or components, but the presence of one or more other features, integers, steps, actions, elements, components, and/or groups thereof. Or it will be further understood that the addition is not excluded.

The term “if” is, optionally, depending on the context “when” or “upon” or “in response to determining” or “ interpreted to mean "in response to detecting". Similarly, the phrases “if determined” or “when [the stated condition or event] is detected” are, optionally, depending on the context, “in determining” or “in response to determining” or “[the stated condition or event]. ] to be construed to mean "on detection" or "in response to detecting [the stated condition or event]."

Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions such as PDA and/or music player functions. Illustrative embodiments of portable multifunction devices are limited to iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, CA. include without Other portable electronic devices such as laptop or tablet computers with touch-sensitive surfaces (eg, touch screen displays and/or touchpads) are optionally used. It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (eg, a touch screen display and/or a touchpad).

In the discussion below, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices such as a physical keyboard, mouse and/or joystick.

A device typically supports a variety of applications such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, gaming applications, phone applications, video conferencing applications, email applications, instant messaging applications, exercise support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and/or digital video player applications.

Various applications running on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface as well as corresponding information displayed on the device are optionally adjusted and/or changed from one application to the next and/or within an individual application. In this way, the universal physical architecture (such as a touch-sensitive surface) of the device supports a variety of applications, optionally with user interfaces that are intuitive and transparent to the user.

Attention is now directed to embodiments of portable devices having touch-sensitive displays. 1A is a block diagram illustrating a portable multifunction device 100 having a touch-sensitive display system 112 in accordance with some embodiments. Touch-sensitive display 112 is sometimes referred to as a “touch screen” for convenience, and is sometimes known or referred to as a “touch-sensitive display system”. Device 100 includes memory 102 (optionally including one or more computer-readable storage media), memory controller 122 , one or more processing units (CPUs) 120 , peripherals interface 118 , RF Circuitry 108 , audio circuitry 110 , speaker 111 , microphone 113 , input/output (I/O) subsystem 106 , other input control devices 116 , and external port 124 . includes Device 100 optionally includes one or more optical sensors 164 . Device 100 optionally includes one or more contact intensity sensors for detecting intensity of contacts on device 100 (eg, a touch-sensitive surface such as touch-sensitive display system 112 of device 100 ). 165). Device 100 optionally includes a touch-sensitive display system 112 of device 100 or a touchpad 355 of device 300 for generating tactile outputs on device 100 (eg, a touchpad 355 of device 100 ). one or more tactile output generators 167 (for generating tactile outputs on the same touch-sensitive surface). These components optionally communicate via one or more communication buses or signal lines 103 .

As used in the specification and claims, the term “strength” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (eg, finger contact) on the touch-sensitive surface, or touch-sensitive. Refers to a substitute (proxy) for the force or pressure of contact on a surface. The intensity of the contact has a range of values including at least four distinct values and more typically including hundreds (eg, at least 256) distinct values. The intensity of the contact is optionally determined (or measured) using various approaches, and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (eg, weighted average) to determine an estimated force of a contact. Similarly, a pressure-sensitive tip of the stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and/or changes thereto of the contact area detected on the touch-sensitive surface, the capacitance and/or changes thereto of the touch-sensitive surface in the vicinity of the contact, and/or the touch-sensitive in the vicinity of the contact The resistance and/or changes thereto of the surface are optionally used as a substitute for the force or pressure of contact on the touch-sensitive surface. In some implementations, the surrogate measurements for contact force or pressure are used directly to determine whether an intensity threshold has been exceeded (eg, the intensity threshold is described in units corresponding to the surrogate measurements). In some implementations, substitute measurements for contact force or pressure are converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (eg, the intensity threshold is pressure threshold measured in units of pressure). By using the strength of the contact as an attribute of the user input, the user, in some circumstances, may otherwise display affordances (eg, on a touch-sensitive display) and/or (eg, a touch-sensitive display, a touch-sensitive display). Additional device functionality not accessible by the user may be accessed on a reduced device having a limited footprint for receiving user input (via a surface, or physical/mechanical controls such as a knob or button) .

As used in the specification and claims, the term “tactile output” refers to a physical displacement of a device relative to its previous position, a component of the device (eg, a touch-sensitive surface) relative to another component of the device (eg, a housing). ), or the displacement of a component with respect to the center of mass of the device to be detected by the user using the user's tactile sense. For example, in situations where a device or component of a device is in contact with a touch-sensitive surface of a user (eg, a finger, palm, or other portion of a user's hand), the tactile output generated by the physical displacement may to be interpreted as a tactile sensation corresponding to a perceived change in the physical properties of a component of the device. For example, movement of a touch-sensitive surface (eg, a touch-sensitive display or track pad) is optionally interpreted by the user as a "down click" or "up click" of a physical actuator button. In some cases, the user will feel a tactile sensation such as a "down click" or "up click" even in the absence of movement of a physical actuator button associated with a touch-sensitive surface that is physically depressed (eg, displaced) by movement of the user. . As another example, movement of the touch-sensitive surface is optionally interpreted or sensed by the user as "roughness" of the touch-sensitive surface, even when there is no change in flatness of the touch-sensitive surface. Although these interpretations of touch by the user will be susceptible to the user's individualized sensory perception, there are many touch sensory perceptions common to the majority of users. Thus, when tactile output is described as corresponding to a user's specific sensory perception (eg, "up click", "down click", "roughness"), unless otherwise stated, the tactile output generated is typical (or average) corresponds to the physical displacement of the device or component thereof that will produce the described sensory perception for the user. Providing haptic feedback to a user using tactile outputs improves the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) and It makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some embodiments, the tactile output pattern determines characteristics of the tactile output, such as the amplitude of the tactile output, the shape of the moving waveform of the tactile output, the frequency of the tactile output, and/or the duration of the tactile output. specify

When tactile outputs having different tactile output patterns are generated by a device (eg, via one or more tactile output generators that move a movable mass to generate tactile outputs), the tactile outputs are It can evoke different haptic sensations when holding or touching. While the user's senses are based on user perception of tactile output, most users will be able to discern changes in the waveform, frequency, and amplitude of tactile outputs generated by the device. Accordingly, the waveform, frequency, and amplitude may be adjusted to indicate to the user that different operations have been performed. As such, a given environment (eg, a user interface including graphical features and objects, a simulated physical environment with virtual boundaries and virtual objects, a real physical environment with physical boundaries and physical objects, and/or any of the foregoing properties of objects (eg, size, material, weight, stiffness, smoothness, etc.) in a combination of those of behaviors (eg, oscillation, displacement, acceleration, rotation, extension, etc.); and/or tactile outputs having tactile output patterns designed, selected and/or engineered to simulate interactions (eg, collision, adhesion, repulsion, attraction, friction, etc.) , will provide users with useful feedback that reduces input errors and increases the efficiency of user operation of the device. Additionally, tactile outputs are optionally generated to respond to simulated physical properties, such as an input threshold or feedback not related to selection of an object. Such tactile outputs will, in some circumstances, provide users with useful feedback that reduces input errors and increases the efficiency of user operation of the device.

In some embodiments, a tactile output with a suitable tactile output pattern serves as a cue for the occurrence of an event of interest in a user interface or behind a scene within a device. Examples of events of interest include activation of an affordance (eg, a real or virtual button, or toggle switch) provided on a device or in a user interface, success or failure of a requested action, reaching or crossing a boundary in a user interface. , entering a new state, switching input focus between objects, activating a new mode, reaching or crossing an input threshold, detecting or recognizing a type of input or gesture, and the like. In some embodiments, tactile outputs are provided to serve as a warning or alert for an impending event or result that would occur if a redirection or interruption input was not detected in a timely manner. Tactile outputs may also, in other contexts, enrich the user experience, improve accessibility of the device for users with visual or motor neuron impairments or other accessibility needs, and/or enhance user interface and/or or to improve the efficiency and functionality of the device. The tactile outputs optionally involve audio outputs and/or visual user interface changes, which further enhance the user's experience when the user interacts with the user interface and/or device, the user interface and/or or to facilitate better transfer of information about the state of the device, reduce input errors and increase the efficiency of user operation of the device.

4C-4E illustrate one or more views for generating haptic feedback suitable for various purposes and in various scenarios, such as those described above and those described in connection with the user interfaces and methods discussed herein. Provides a set of sample tactile output patterns that can be used either as is or through transformations (eg, modulation, amplification, truncation, etc.), individually or in combination. This example of a palette of tactile outputs shows how a set of three waveforms and eight frequencies can be used to create an array of tactile output patterns. In addition to the tactile output patterns shown in this figure, each of these tactile output patterns is optionally shown in variants having, for example, gains of 1.0, 0.75, 0.5, and 0.25, respectively, FIG. 4F . Tactile output, as shown for FullTap 80 Hz, FullTap 200 Hz, MiniTap 80 Hz, MiniTap 200 Hz, MicroTap 80 Hz, and MicroTap 200 Hz in FIGS. By changing the gain value for the pattern, the amplitude is adjusted. 4F-4H, changing the gain of the tactile output pattern changes the amplitude of the pattern without changing the frequency of the pattern or changing the shape of the waveform. In some embodiments, changing the frequency of the tactile output pattern also results in a lower amplitude, which some tactile output generators are limited by how much force can be applied to the movable mass, and thus the waveform This is because higher frequency movements of the mass are constrained to lower amplitudes (e.g., 230 Hz, 270 Hz, and the peak amplitudes of the pull-tap at 300 Hz are lower than the amplitudes of the pull-tap at 80 Hz, 100 Hz, 125 Hz, and 200 Hz).

4c to 4h show tactile output patterns with specific waveforms. The waveform of the tactile output pattern represents the pattern of physical displacements relative to a neutral position (eg, x _zero ) versus time that the movable mass traverses to produce a tactile output having the tactile output pattern. For example, the first set of tactile output patterns shown in FIG. 4C (eg, "pull tap" tactile output patterns) each has an oscillation (eg, starting and ending in a neutral position and ending in a neutral position) having two complete cycles. oscillation that traverses the position 3 times). The second set of tactile output patterns shown in FIG. 4D (eg, the tactile output patterns of a “minitab”) each comprises an oscillation (eg, starting and ending in a neutral position and ending in a neutral position of 1) comprising one complete cycle. oscillation that crosses once). The third set of tactile output patterns shown in FIG. 4E (eg, the tactile output patterns of a “microtap”) each includes an oscillation (eg, starting and ending in a neutral position, and neutral oscillations that do not traverse positions). The waveform of the tactile output pattern also includes a start buffer and an end buffer indicating the gradual acceleration and deceleration of the movable mass at the beginning and end of the tactile output. The example waveforms shown in FIGS. 4C-4H include x _min and x _max values representing the maximum and minimum limits of movement of the movable mass. For larger electronic devices with larger movable masses, there may be larger or smaller minimum and maximum limits of movement of the mass. Although the examples shown in FIGS. 4C-4H describe the movement of a mass in one dimension, similar principles would also apply to the movement of a movable mass in two or three dimensions.

As shown in Figures 4C-4E, each tactile output pattern also has a corresponding characteristic frequency that affects the "pitch" of the haptic sensation, which haptic sensation generates from the tactile output with that characteristic frequency. is felt by In the case of a continuous tactile output, the characteristic frequency represents the number of cycles (eg, cycles per second) completed within a given period by the movable mass of the tactile output generator. In the case of a discrete tactile output, a separate output signal (eg, having 0.5, 1, or 2 cycles) is generated, and the characteristic frequency value is determined by how much the movable mass produces a tactile output having that characteristic frequency. Determine if you need to move quickly. 4C-4H , for each type of tactile output (eg, as defined by an individual waveform, such as a pull-tap, mini-tap, or micro-tap), the higher frequency value shifts faster movement(s) by the capable mass, and thus, generally, a shorter time to complete the tactile output (eg, time to complete the required number of cycle(s) for the individual tactile output + including start and end buffer times). For example, a pull-tap with a characteristic frequency of 80 Hz takes longer to complete than a pull-tap with a characteristic frequency of 100 Hz (eg, 28.3 ms versus 35.4 ms in FIG. 4C ). Also, for given frequencies, a tactile output that has more cycles of its waveform at an individual frequency takes longer to complete than a tactile output that has fewer cycles of its waveform at the same individual frequency. For example, a pull-tap at 150 Hz takes longer to complete than a mini-tap at 150 Hz (eg, 12.8 ms versus 19.4 ms), and a mini-tap at 150 Hz takes longer to complete than a micro-tap at 150 Hz. takes (eg, 9.4 ms versus 12.8 ms). However, for tactile output patterns with different frequencies, this rule may not apply (eg, tactile outputs with more cycles but higher frequency have fewer cycles but with lower frequency tactile outputs with lower frequency). may take less time to complete than outputs, and vice versa). For example, at 300 Hz, a full-tap takes as long as a mini-tap (eg, 9.9 ms).

4C-4E , the tactile output pattern also has a characteristic amplitude that affects the amount of energy contained in the tactile signal or the “strength” of the haptic sensation, which haptic sensation has its characteristic amplitude. can be felt by the user through a tactile output with In some embodiments, the characteristic amplitude of the tactile output pattern refers to an absolute or normalized value representing the maximum displacement of the movable mass from a neutral position when generating the tactile output. In some embodiments, the characteristic amplitude of the tactile output pattern is based on various conditions (eg, customized based on user interface situations and behaviors) and/or preconfigured metrics (eg, input-based metrics, and / or user interface based metrics), eg by a fixed or dynamically determined gain factor (eg a value of 0 to 1). In some embodiments, the input-based metric (eg, intensity change metric or input-velocity metric) is a characteristic of the input during the input that triggers generation of a tactile output (eg, a rate of change in intensity of a characteristic of a contact at a press input or a touch The speed of movement of the contact across the sensitive surface) is measured. In some embodiments, a user interface based metric (eg, a speed metric across a boundary) is a characteristic of a user interface element (eg, a hidden or visible boundary in the user interface) during a user interface change that triggers generation of a tactile output. Measure the speed of the element's movement across it). In some embodiments, the characteristic amplitude of the tactile output pattern may be modulated by an “envelope” and the peaks of adjacent cycles may have different amplitudes, wherein one of the waveforms shown above is a tactile The output is further modified by multiplication by a time-varying envelope parameter (eg, 0 to 1) to progressively adjust the amplitude of portions of the tactile output over time as the output is being generated.

Although specific frequencies, amplitudes and waveforms are shown in the sample tactile output patterns in FIGS. 4C-4E for illustrative purposes, tactile output patterns with other frequencies, amplitudes and waveforms may be used for similar purposes. can For example, waveforms with 0.5 to 4 cycles may be used. Other frequencies ranging from 60 Hz to 400 Hz may also be used. Table 1 provides examples of specific haptic feedback behaviors, configurations, and uses thereof.

Device 100 is only one example of a portable multifunction device, and device 100 may optionally have more or fewer components than shown, optionally combine two or more components, or optionally a component It should be understood that they have a different configuration or arrangement of the The various components illustrated in FIG. 1A are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and/or application-specific integrated circuits (ASICs).

Memory 102 optionally includes high-speed random access memory and, optionally, one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. non-volatile memory such as Memory controller 122 optionally controls access to memory 102 by other components of device 100 .

Peripheral interface 118 may be used to couple input and output peripherals of the device to CPU 120 and memory 102 . One or more processors 120 run or execute various software programs and/or sets of instructions stored in memory 102 to process data and to perform various functions for device 100 . In some embodiments, peripherals interface 118 , CPU 120 , and memory controller 122 are optionally implemented on a single chip, such as chip 104 . In some other embodiments, they are optionally implemented on separate chips.

Radio frequency (RF) circuitry 108 receives and transmits RF signals, also referred to as electromagnetic signals. RF circuitry 108 converts electrical signals to/from electromagnetic signals and communicates with communication networks and other communication devices via the electromagnetic signals. The RF circuitry 108 may optionally include, but is not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and the like. However, well-known circuitry for performing these functions is included. The RF circuitry 108 may optionally include networks such as the Internet, an intranet, and/or a wireless network, also referred to as the World Wide Web (WWW), such as a cellular telephone network, a wireless local area network (LAN) and/or a MAN (metropolitan area network), and communicates with other devices by wireless communication. The RF circuitry 108 optionally includes well-known circuitry for detecting near field communication (NFC) fields, eg, by a short-range communication radio. Wireless communication, optionally, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution (EV-DO), Data-Only), HSPA, HSPA+, DC-HSPDA (Dual-Cell HSPA), LTE (long term evolution), NFC (near field communication), W-CDMA (wideband code division multiple access), CDMA (code division multiple access) ), time division multiple access (TDMA), Bluetooth (Bluetooth), Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (eg, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n and/or IEEE 802.11ac), voice over Internet Protocol (VoIP), Wi-MAX, protocols for email (eg, Internet message access protocol (IMAP) and/or post office protocol (POP)), instant messaging (eg, extensible messaging (XMPP)) and presence protocol), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS), and/or Short Message Service (SMS), or communications not yet developed as of the filing date of this document. protocols, including any other suitable It uses any of a plurality of communication standards, protocols and technologies including, but not limited to, a communication protocol.

The audio circuitry 110 , the speaker 111 , and the microphone 113 provide an audio interface between the user and the device 100 . The audio circuit unit 110 receives audio data from the peripheral device interface 118 , converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111 . The speaker 111 converts the electrical signal into sound waves that humans can hear. The audio circuitry 110 also receives an electrical signal converted from sound waves by the microphone 113 . The audio circuitry 110 converts the electrical signal into audio data and transmits the audio data to the peripherals interface 118 for processing. Audio data is optionally fetched from and/or transmitted to memory 102 and/or RF circuitry 108 by peripherals interface 118 . In some embodiments, audio circuitry 110 also includes a headset jack (eg, 212 in FIG. 2 ). The headset jack is a connection between the audio circuitry 110 and detachable audio input/output peripherals, such as output-only headphones, or a headset that has both an output (eg, one or both ear headphones) and an input (eg, a microphone). Provides an interface.

I/O subsystem 106 couples input/output peripherals on device 100 , such as touch screen 112 and other input control devices 116 , to peripherals interface 118 . I/O subsystem 106 optionally includes display controller 156 , light sensor controller 158 , intensity sensor controller 159 , haptic feedback controller 161 , depth camera controller 169 , and other inputs or controls. one or more input controllers 160 for devices. One or more input controllers 160 receive/transmit electrical signals to/from other input control devices 116 . Other input control devices 116 optionally include physical buttons (eg, push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and the like. In some alternative embodiments, input controller(s) 160 is optionally coupled to (or not coupled to) any of a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more buttons (eg, 208 in FIG. 2 ) optionally include an up/down button for volume control of the speaker 111 and/or the microphone 113 . The one or more buttons optionally include a push button (eg, 206 in FIG. 2 ).

A quick press of the push button optionally initiates processes of using gestures on the touch screen to selectively unlock the touch screen 112, or to unlock the device, which on 23 December 2005 As described in U.S. Patent Application Serial No. 11/322,549, filed on the date of "Unlocking a Device by Performing Gestures on an Unlock Image" (U.S. Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. do. A longer press of the push button (eg, 206 ) selectively powers on or off the device 100 . The functionality of one or more buttons is, optionally, customizable. Touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. Display controller 156 receives and/or transmits electrical signals to/from touch screen 112 . Touch screen 112 displays a visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as “graphics”). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

Touch screen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and/or tactile contact. Touch screen 112 and display controller 156 (along with any associated modules and/or sets of instructions within memory 102) contact (and any movement or interruption of) contact on touch screen 112 . , and converts the detected contact into interaction with user interface objects (eg, one or more soft keys, icons, web pages or images) displayed on the touch screen 112 . In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

Touch screen 112 optionally uses liquid crystal display (LCD) technology, light emitting polymer display (LPD) technology, or light emitting diode (LED) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally provide one or more points of contact with the touch screen 112, or other proximity sensor arrays, as well as capacitive, resistive, infrared, and surface acoustic wave technologies. Detecting a contact and any movement or interruption thereof using any of a plurality of touch sensing technologies, currently known or later developed, including, but not limited to, other factors for determining. In an exemplary embodiment, a projected mutual capacitance sensing technology such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, CA is used.

The touch-sensitive display in some embodiments of the touch screen 112 may optionally be described in US Pat. , and/or the multi-touch sensitive touchpads described in US Patent Publication No. 2002/0015024A1, each of which is incorporated herein by reference in its entirety. However, touch screen 112 displays visual output from device 100 , whereas touch-sensitive touchpads do not provide visual output.

A touch-sensitive display in some embodiments of touch screen 112 is described in the following applications: (1) US Patent Application Serial No. 11/381,313, filed May 2, 2006, "Multipoint Touch Surface Controller"; (2) US Patent Application Serial No. 10/840,862, "Multipoint Touchscreen", filed May 6, 2004; (3) US Patent Application Serial No. 10/903,964, "Gestures For Touch Sensitive Input Devices," filed on July 30, 2004; (4) US Patent Application Serial No. 11/048,264, "Gestures For Touch Sensitive Input Devices," filed on January 31, 2005; (5) US Patent Application Serial No. 11/038,590, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices," filed on January 18, 2005; (6) US Patent Application Serial No. 11/228,758, "Virtual Input Device Placement On A Touch Screen User Interface", filed September 16, 2005; (7) US Patent Application Serial No. 11/228,700, "Operation Of A Computer With A Touch Screen Interface", filed September 16, 2005; (8) US Patent Application Serial No. 11/228,737, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard," filed September 16, 2005; and (9) US Patent Application Serial No. 11/367,749, "Multi-Functional Hand-Held Device", filed March 3, 2006. All of these applications are incorporated herein by reference in their entirety.

Touch screen 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi. The user, optionally, makes contact with the touch screen 112 using any suitable object or appendage, such as a stylus, finger, or the like. In some embodiments, the user interface is primarily designed to operate using finger-based contacts and gestures, which may be less precise than stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the device converts coarse finger-based input into precise pointer/cursor positions or commands for performing actions desired by the user.

In some embodiments, in addition to a touch screen, device 100 optionally includes a touchpad (not shown) for activating or deactivating certain functions. In some embodiments, the touch pad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output. The touch pad is, optionally, a touch-sensitive surface separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

Device 100 also includes a power system 162 for powering the various components. Power system 162 may optionally include a power management system, one or more power sources (eg, a battery, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator ( light emitting diodes (LEDs), for example), and any other components associated with the generation, management, and distribution of power within portable devices.

Device 100 also optionally includes one or more optical sensors 164 . 1A shows a light sensor coupled to a light sensor controller 158 in the I/O subsystem 106 . Optical sensor 164 optionally includes charge-coupled device (CCD) or complementary metal-oxide semiconductor (CMOS) phototransistors. The light sensor 164 receives light from the surrounding environment, projected through one or more lenses, and converts the light into data representing an image. In conjunction with imaging module 143 (also referred to as camera module), optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the back of the device 100 , opposite the touch screen display 112 on the front of the device, so that the touch screen display can be used as a viewfinder for still and/or video image acquisition. let there be In some embodiments, an optical sensor is positioned on the front of the device such that, optionally, an image of the user is obtained for the videoconference while the user views other videoconference participants on the touch screen display. In some embodiments, the position of the optical sensor 164 may be changed by the user (eg, by rotating the sensor and a lens within the device housing) so that a single optical sensor 164 can be used for video conferencing with a touch screen display. It is used for both still and/or video image acquisition.

Device 100 also optionally includes one or more contact intensity sensors 165 . 1A shows a contact intensity sensor coupled to an intensity sensor controller 159 in the I/O subsystem 106 . Contact intensity sensor 165 may optionally include one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (eg, sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface. The contact intensity sensor 165 receives contact intensity information (eg, pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is collocated with or proximate to a touch-sensitive surface (eg, touch-sensitive display system 112 ). In some embodiments, at least one contact intensity sensor is located on the back of the device 100 opposite the touch screen display 112 positioned on the front of the device 100 .

Device 100 also optionally includes one or more proximity sensors 166 . 1A shows a proximity sensor 166 coupled to a peripherals interface 118 . Alternatively, proximity sensor 166 is optionally coupled to input controller 160 in I/O subsystem 106 . Proximity sensor 166 is optionally described in U.S. Patent Applications Serial Nos. 11/241,839, “Proximity Detector In Handheld Device;” 11/240,788, "Proximity Detector In Handheld Device"; 11/620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11/586,862, "Automated Response To And Sensing Of User Activity In Portable Devices"; and 11/638,251, "Methods And Systems For Automatic Configuration Of Peripherals," which are incorporated herein by reference in their entirety. In some embodiments, the proximity sensor turns off and disables the touch screen 112 when the multifunction device is placed near the user's ear (eg, when the user is on a phone call).

Device 100 also optionally includes one or more tactile output generators 167 . 1A shows a tactile output generator coupled to a haptic feedback controller 161 in the I/O subsystem 106 . Tactile output generator 167 optionally generates one or more electroacoustic devices, such as speakers or other audio components, and/or a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output Electromechanical devices that convert energy into linear motion, such as a component (eg, a component that converts electrical signals into tactile outputs on the device). The contact intensity sensor 165 receives tactile feedback generation instructions from the haptic feedback module 133 to generate tactile outputs on the device 100 that can be sensed by a user of the device 100 . In some embodiments, the at least one tactile output generator is positioned with or proximate a touch-sensitive surface (eg, touch-sensitive display system 112 ), and optionally, vertically (eg, vertically) the touch-sensitive surface. , generate a tactile output by moving it in/out of the surface of the device 100 ) or laterally (eg, back and forth in the same plane as the surface of the device 100 ). In some embodiments, the at least one tactile output generator sensor is located on the back side of the device 100 opposite the touch screen display 112 located on the front side of the device 100 .

Device 100 also optionally includes one or more accelerometers 168 . 1A shows an accelerometer 168 coupled to a peripherals interface 118 . Alternatively, the accelerometer 168 is optionally coupled to an input controller 160 within the I/O subsystem 106 . Accelerometer 168 is optionally described in US Patent Publication Nos. 20050190059, "Acceleration-based Theft Detection System for Portable Electronic Devices," and US Patent Publication Nos. 2006017692, "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer. ", both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on the touch screen display in a portrait view or a landscape view based on analysis of data received from one or more accelerometers. Device 100 may optionally include, in addition to accelerometer(s) 168 , a magnetometer (not shown), and a GPS (eg, vertical or horizontal) for obtaining information regarding the position and orientation of device 100 (eg, longitudinal or transverse). or a GLONASS or other global navigation system) receiver (not shown).

In some embodiments, device 100 also includes (or is in communication with) one or more fingerprint sensors. One or more fingerprint sensors are coupled to the peripherals interface 118 . Alternatively, one or more fingerprint sensors are optionally coupled to input controller 160 within I/O subsystem 106 . However, in one general embodiment, fingerprint identification operations are performed on secure dedicated computing hardware (eg, one or more processors, memory and / or communication buses). As used herein, a fingerprint sensor is capable of distinguishing fingerprint features (sometimes referred to as “details”) of the ridges and valleys of the skin, such as those found on human fingers and toes. is the sensor. The fingerprint sensor may distinguish fingerprint features using any of a variety of techniques including, but not limited to, optical fingerprint imaging, ultrasonic fingerprint imaging, active capacitive fingerprint imaging, and passive capacitive fingerprint imaging. In addition to distinguishing fingerprint features in a fingerprint, in some embodiments, the one or more fingerprint sensors may track movement of the fingerprint features over time, whereby over time on the one or more fingerprint sensors It is possible to determine/characterize the movement of the fingerprint. The one or more fingerprint sensors may be separate from the touch-sensitive surface (eg, the touch-sensitive display system 112 ), although in some implementations the touch-sensitive surface (eg, the touch-sensitive display system 112 ) 112)) has a sufficiently high spatial resolution to detect fingerprint features formed by individual fingerprint ridges and is used as a fingerprint sensor in place of or in addition to one or more fingerprint sensors. In some embodiments, device 100 includes one or more orientation sensors used to determine an orientation of a finger or hand on or proximate to the device (eg, orientation of a finger over one or more fingerprint sensors). Includes set. Additionally, in some embodiments, a set of one or more orientation sensors are used in addition to or in place of a fingerprint sensor to detect rotation of a contact interacting with the device (eg, as described below) In one or more methods provided herein, instead of using a fingerprint sensor to detect rotation of a fingerprint/contact, a set of one or more orientation sensors detect rotation of a contact comprising a fingerprint, with or without detecting features of the fingerprint. used to detect).

In some embodiments, characteristics of fingerprints and a comparison between characteristics of detected fingerprints and characteristics of stored fingerprints to improve security of fingerprint data generated, stored, and processed by one or more fingerprint sensors. is performed by secure dedicated computing hardware (eg, one or more processors, memory, and/or communication buses) separate from processor(s) 120 . In some embodiments, characteristics of fingerprints, and comparison between characteristics of detected fingerprints and characteristics of enrolled fingerprints, are performed by processor(s) 120 using a fingerprint analysis module.

In some embodiments, during the enrollment process, the device (eg, a fingerprint analysis module or separate security module in communication with one or more fingerprint sensors) collects biometric information about the user's one or more fingerprints (eg, the user to identify the relative positions of a plurality of detailed feature points in the fingerprint of ). After the enrollment process is complete, the biometric information is stored on the device (eg, in the secure fingerprint module) for later use in authenticating the detected fingerprints. In some embodiments, the biometric information stored on the device excludes images of fingerprints and enables images of fingerprints to be restored so that images of fingerprints are not inadvertently made available if the security of the device is compromised. exclude information. In some embodiments, during the authentication process, the device (eg, a fingerprint analysis module or separate security module in communication with one or more fingerprint sensors) collects biometric information regarding a fingerprint detected on the one or more fingerprint sensors ( one by (eg, identifying the relative positions of a plurality of detailed feature points in a fingerprint detected on one or more fingerprint sensors) and comparing biometric information corresponding to the detected fingerprint with biometric information corresponding to the enrolled fingerprint(s). It is determined whether the finger input detected by the above fingerprint sensors includes a fingerprint matching the pre-registered fingerprint. In some embodiments, comparing the biometric information corresponding to the detected fingerprint to the biometric information corresponding to the enrolled fingerprint(s) determines the type and location of detailed feature points in the biometric information corresponding to the detected fingerprint. and comparing with the type and location of the detailed feature points in the biometric information corresponding to the enrolled fingerprints. However, the determination of whether the finger input includes a fingerprint that matches a pre-enrolled fingerprint enrolled in the device may optionally be performed using a number of well-known fingerprint authentication techniques for determining whether a detected fingerprint matches an enrolled fingerprint. It is performed using any of

Device 100 also optionally includes one or more depth camera sensors 175 . 1A shows a depth camera sensor coupled to a depth camera controller 169 in the I/O subsystem 106 . The depth camera sensor 175 receives data from the environment, which is projected through the sensor. Along with imaging module 143 (also referred to as camera module), depth camera sensor 175 is optionally used to determine a depth map of different portions of an image captured by imaging module 143 . In some embodiments, a depth camera sensor is located on the front of device 100 so that an image of the user with depth information is available for use by different functions of the device, such as video conferencing, so that the depth map It captures selfies with data and lets you authenticate the user of the device. In some embodiments, the position of the depth camera sensors 175 may be changed by the user (eg, by rotating a lens and sensor within the device housing) such that the depth camera sensors 175 work with the touch screen display. It is intended to be used for both video conferencing and still and/or video image acquisition.

In some embodiments, software components stored in memory 102 include operating system 126 , communication module (or set of instructions) 128 , contact/motion module (or set of instructions) 130 , graphics module ( or set of instructions) 132 , a text input module (or set of instructions) 134 , a GPS module (or set of instructions) 135 , and applications (or sets of instructions) 136 . . Furthermore, in some embodiments, the memory ( 102 in FIG. 1A or 370 in FIG. 3 ) stores device/global internal state 157 as shown in FIGS. 1A and 3 . The device/global internal state 157, if present, includes an active application state indicating which applications are currently active; a display state indicating which applications, views, or other information occupy the various areas of the touch screen display 112 ; sensor status, including information obtained from various sensors and input control devices 116 of the device; and location information regarding the location and/or posture of the device.

Operating system 126 (eg, an embedded operating system such as Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or VxWorks) performs general system tasks (eg, memory management, storage device control, power management, etc.) It includes various software components and/or drivers for controlling and managing the software, and facilitates communication between various hardware and software components.

The communication module 128 enables communication with other devices via one or more external ports 124 , and also provides various methods for processing data received by the RE circuitry 108 and/or external ports 124 . Includes software components. External port 124 (eg, Universal Serial Bus (USB), FIREWIRE, etc.) is configured to couple to other devices either directly or indirectly through a network (eg, Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (eg, 30-pin) connector that is the same as, similar to, and/or compatible with the 30-pin connector used in iPod® (trademark of Apple Inc.) devices.

Contact/motion module 130 optionally detects contact with touch screen 112 (in conjunction with display controller 156 ), and other touch-sensitive devices (eg, a touch pad or physical click wheel). . The contact/motion module 130 is configured to determine whether a contact has occurred (eg, to detect a finger-down event), the strength of the contact (eg, force or pressure of the contact, or the contact). determining whether there is movement of a contact to track movement across the touch-sensitive surface (e.g., one or more finger-dragging events); detecting), and determining whether the contact has ceased (eg, detecting a finger-up event or contact cessation) for performing various actions related to detection of a contact. Includes various software components. The contact/motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the point of contact represented by the set of contact data optionally determines a speed (magnitude), velocity (magnitude and direction), and/or acceleration (change in magnitude and/or direction) of the point of contact. includes doing These operations are, optionally, applied to single contacts (eg, one finger contacts) or to multiple simultaneous contacts (eg, "multi-touch"/multiple finger contacts). In some embodiments, contact/motion module 130 and display controller 156 detect a contact on the touch pad.

In some embodiments, contact/motion module 130 is a set of one or more intensity thresholds to determine whether an action was performed by a user (eg, to determine whether a user "clicked" on an icon). use In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (eg, the intensity thresholds are not determined by activation thresholds of specific physical actuators, but changing the physical hardware of the device 100 ) can be adjusted without). For example, the mouse "click" threshold of a trackpad or touch screen display may be set to any of a wide range of predefined threshold values without changing the trackpad or touch screen display hardware. Additionally, in some implementations, a user of the device (eg, by adjusting individual intensity thresholds and/or by adjusting a plurality of intensity thresholds at once with a system level click "intensity" parameter) may cause one or more of a set of intensity thresholds. are provided with software settings for adjusting the

The contact/motion module 130 optionally detects a gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (eg, different motions, timings, and/or intensities of detected contacts). Thus, the gesture is, optionally, detected by detecting a specific contact pattern. For example, detecting a finger tap gesture may include detecting a finger-down event followed by a finger-down event at the same (or substantially the same location) as the finger-down event (eg, at the location of the icon). and detecting an up (liftoff) event. As another example, detecting a finger swipe gesture on the touch-sensitive surface detects a finger-down event followed by one or more finger-dragging events, followed by a finger-up (lift-off) event. ) to detect the event.

The graphics module 132 renders and renders graphics on the touch screen 112 or other display, including components for changing the visual effect (eg, brightness, transparency, saturation, contrast, or other visual property) of the displayed graphic. It includes various well-known software components for display. As used herein, the term “graphic” includes without limitation text, web pages, icons (eg, user interface objects including soft keys), digital images, videos, animations, and the like. , including any object that can be displayed to the user.

In some embodiments, graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. Graphics module 132 receives one or more codes from applications, etc. that specify a graphic to be displayed, along with coordinate data and other graphic property data, if necessary, and then generates screen image data for output to display controller 156 . do.

The haptic feedback module 133 is used by the tactile output generator(s) 167 to generate tactile outputs at one or more locations on the device 100 in response to user interactions with the device 100 . It includes various software components for generating instructions.

The text input module 134 , optionally a component of the graphics module 132 , can be used for various applications (eg, contacts 137 , email 140 , IM 141 , browser 147 , and text input It provides soft keyboards for entering text into any other application).

The GPS module 135 determines the location of the device and uses this information for use in various applications (eg, to the phone 138 for use in location-based dialing; the camera 143 as photo/video metadata). and to applications that provide location-based services such as weather widgets, local yellow page widgets, and map/navigation widgets).

Applications 136 optionally include the following modules (or sets of instructions), or a subset or superset thereof:

연락처 모듈(137)(때때로 주소록 또는 연락처 목록으로 지칭됨);

Contacts module 137 (sometimes referred to as an address book or contact list);

전화 모듈(138);

phone module 138;

화상 회의 모듈(139);

video conferencing module 139;

이메일 클라이언트 모듈(140);

email client module 140;

인스턴트 메시징(IM) 모듈(141);

an instant messaging (IM) module 141;

운동 지원 모듈(142);

exercise support module 142;

정지 및/또는 비디오 이미지들을 위한 카메라 모듈(143);

a camera module 143 for still and/or video images;

이미지 관리 모듈(144);

image management module 144;

비디오 재생기 모듈;

video player module;

음악 재생기 모듈;

music player module;

브라우저 모듈(147);

browser module 147;

캘린더 모듈(148);

calendar module 148;

날씨 위젯(149-1), 주식 위젯(149-2), 계산기 위젯(149-3), 알람 시계 위젯(149-4), 사전 위젯(149-5), 및 사용자에 의해 얻어지는 다른 위젯들뿐 아니라 사용자-생성 위젯들(149-6) 중 하나 이상을 선택적으로 포함하는 위젯 모듈들(149);

Weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets obtained by the user only but also widget modules 149, optionally including one or more of user-created widgets 149-6;

사용자-생성 위젯들(149-6)을 만들기 위한 위젯 생성기 모듈(150);

a widget generator module 150 for creating user-created widgets 149-6;

검색 모듈(151);

search module 151;

비디오 재생기 모듈 및 음악 재생기 모듈을 통합하는 비디오 및 음악 재생기 모듈(152);

a video and music player module 152 incorporating a video player module and a music player module;

메모 모듈(153);

memo module 153;

지도 모듈(154); 및/또는

map module 154; and/or

온라인 비디오 모듈(155).

Online video module (155).

선택적으로 메모리(102) 내에 저장되는 다른 애플리케이션들(136)의 예들은 다른 워드 프로세싱 애플리케이션들, 다른 이미지 편집 애플리케이션들, 드로잉 애플리케이션들, 프레젠테이션 애플리케이션들, JAVA-인에이블형 애플리케이션들, 암호화, 디지털 저작권 관리, 음성 인식 및 음성 복제를 포함한다.

Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital rights. management, voice recognition and voice replication.

Along with touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 and text input module 134 , contacts module 137 may optionally include an address book or contact list ( For example, stored in the application internal state 192 of the contacts module 137 in the memory 102 or memory 370), which includes: adding the name(s) to the address book; thing; deleting name(s) from the address book; associating a name with a phone number(s), email address(es), physical address(es), or other information; associating an image with a name; sorting and sorting names; providing phone numbers or email addresses to initiate and/or facilitate communication by phone 138 , video conferencing module 139 , email 140 , or IM 141 , and the like.

RF circuitry 108 , audio circuitry 110 , speaker 111 , microphone 113 , touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 , and text In conjunction with the input module 134 , the phone module 138 optionally enters a sequence of characters corresponding to a phone number, accesses one or more phone numbers in the contacts module 137 , and modifies the entered phone number. It is used for calling, dialing individual phone numbers, having a conversation, and disconnecting or hanging up when the conversation is complete. As noted above, wireless communications optionally use any of a plurality of communication standards, protocols and technologies.

RF circuitry 108 , audio circuitry 110 , speaker 111 , microphone 113 , touch screen 112 , display controller 156 , optical sensor 164 , optical sensor controller 158 , contact/motion Together with the module 130 , the graphics module 132 , the text input module 134 , the contacts module 137 and the phone module 138 , the video conferencing module 139 communicates with the user according to user instructions. and executable instructions for initiating, conducting, and terminating a video conference between participants.

Along with RF circuitry 108 , touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 and text input module 134 , email client module 140 provides user instruction executable instructions for composing, sending, receiving, and managing email in response to Together with the image management module 144 , the email client module 140 greatly facilitates creating and sending emails with still or video images captured with the camera module 143 .

Along with RF circuitry 108 , touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 , and text input module 134 , instant messaging module 141 includes: Enter a sequence of characters corresponding to a message, modify previously entered characters (eg, Short Message Service (SMS) for phone-based instant messages) or Multimedia Message Service (Multimedia Message Service) , MMS) protocol, or using XMPP, SIMPLE or IMPS for internet-based instant messages), including executable instructions to send, receive instant messages, and view received instant messages). . In some embodiments, sent and/or received instant messages optionally include graphics, photos, audio files, video files and/or other attachments as supported by MMS and/or Enhanced Messaging Service (EMS). As used herein, “instant messaging” refers to phone-based messages (eg, messages sent using SMS or MMS) and Internet-based messages (eg, messages sent using XMPP, SIMPLE, or IMPS). ) refers to both.

RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154 , and in conjunction with the music player module, the exercise support module 142 may design exercises (eg, along with time, distance, and/or calorie expenditure goals); communicate with motion sensors (sports devices); receive motion sensor data; calibrate sensors used to monitor movement; select and play music for exercise; executable instructions to display, store, and transmit athletic data.

with touch screen 112 , display controller 156 , optical sensor(s) 164 , optical sensor controller 158 , contact/motion module 130 , graphics module 132 and image management module 144 . , the camera module 143 captures still images or video (including a video stream) and stores them in the memory 102 , modifies a characteristic of the still image or video, Contains executable instructions to delete a video.

Along with the touch screen 112 , the display controller 156 , the contact/motion module 130 , the graphics module 132 , the text input module 134 , and the camera module 143 , the image management module 144 is configured to perform static and and/or executable instructions to arrange, modify (eg, edit), or otherwise manipulate, label, delete, present (eg, in a digital slide show or album), and store video images .

Along with RF circuitry 108 , touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 and text input module 134 , browser module 147 is configured to: executable instructions to browse the Internet according to user instructions, including retrieving, linking to, receiving, and displaying files or portions thereof, as well as attachments and other files linked to web pages include those

RF circuitry 108 , touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 , text input module 134 , email client module 140 , and browser module ( In conjunction with 147 , calendar module 148 is an executable executable to create, display, modify, and store calendars and data associated with calendars (eg, calendar entries, to-do lists, etc.) according to user instructions. contains commands.

Widget modules, along with RF circuitry 108 , touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 , text input module 134 and browser module 147 . 149 is optionally downloaded and used by the user (eg, weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5), or mini-applications created by the user (eg, user-created widget 149-6). In some embodiments, the widget includes a Hypertext Markup Language (HTML) file, a Cascading Style Sheets (CSS) file, and a JavaScript file. In some embodiments, a widget includes an Extensible Markup Language (XML) file and a JavaScript file (eg, Yahoo! widgets).

A widget generator module, along with RF circuitry 108 , touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 , text input module 134 and browser module 147 . 150 is optionally used by the user to create widgets (eg, change a user-specified portion of a web page into a widget).

With touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 , and text input module 134 , search module 151 may provide one or more search criteria in accordance with user instructions. executable instructions to search text, music, sound, image, video, and/or other files in memory 102 that match fields (eg, one or more user-specific search terms).

With touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 , audio circuitry 110 , speaker 111 , RF circuitry 108 and browser module 147 . , video and music player module 152 provides executable instructions that enable a user to download and play recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and videos ( executable instructions to display, show, or otherwise play back (eg, on a touch screen 112 or on an externally connected display through an external port 124 ). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

Along with the touch screen 112 , the display controller 156 , the contact/motion module 130 , the graphics module 132 and the text input module 134 , the memo module 153 is configured to take notes, to do, according to user instructions. executable instructions to create and manage to-do lists and the like.

RF circuitry 108 , touch screen 112 , display controller 156 , contact/motion module 130 , graphics module 132 , text input module 134 , GPS module 135 , and browser module 147 . ), the map module 154 may optionally provide maps and data associated with the maps according to user instructions (eg, driving directions; data regarding shops and other points of interest at or near a particular location; and other location-based data).

Touch screen 112, display controller 156, contact/motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, Along with the email client module 140 and browser module 147 , the online video module 155 allows a user to access, browse online videos in one or more file formats, such as H.264, and (eg, streaming and receive (by download), play (eg, on a touch screen or on an externally connected display via external port 124 ), send an email with a link to a particular online video, and otherwise manage contains commands to In some embodiments, instant messaging module 141 rather than email client module 140 is used to send a link to a particular online video. For additional description of online video applications, see U.S. Provisional Patent Application Serial No. 60/936,562, "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," filed on June 20, 2007, and December 31, 2007. may be found in U.S. Patent Application Serial No. 11/968,067, filed on the date of "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," the contents of which are hereby incorporated by reference herein in their entirety. .

Each of the modules and applications identified above includes executable instructions for performing one or more of the functions described above and the methods described herein (eg, the computer-implemented methods and other information processing methods described herein). corresponding to a set of These modules (eg, sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. . For example, a video player module is optionally combined with a music player module into a single module (eg, video and music player module 152 in FIG. 1A ). In some embodiments, memory 102 optionally stores a subset of the modules and data structures identified above. In addition, the memory 102 optionally stores additional modules and data structures not described above.

In some embodiments, device 100 is a device in which operation of a predefined set of functions on the device is performed exclusively via a touch screen and/or touchpad. By using a touch screen and/or touchpad as the primary input control device for operation of device 100 , the number of physical input control devices (such as push buttons, dials, etc.) on device 100 is selectively reduced.

The predefined set of functions performed entirely via the touch screen and/or touch pad optionally include navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 to a main, home, or root menu from any user interface displayed on device 100 . In these embodiments, a “menu button” is implemented using a touch pad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touch pad.

1B is a block diagram illustrating example components for event processing, in accordance with some embodiments. In some embodiments, memory (102 in FIG. 1A or 370 in FIG. 3 ) includes event classifier 170 (eg, in operating system 126 ) and respective application 136 - 1 (eg, the application described above). (any of 137-151, 155, 380-390).

The event classifier 170 receives the event information, and determines an application 136 - 1 to which to forward the event information, and an application view 191 of the application 136 - 1 . The event sorter 170 includes an event monitor 171 and an event dispatcher module 174 . In some embodiments, application 136 - 1 includes an application internal state 192 representing the current application view(s) displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device/global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine which application(s) are currently active. It is used to determine the application views 191 to which the event information by the

In some embodiments, application internal state 192 is a user indicating resume information to be used when application 136 - 1 resumes execution, information being displayed by application 136 - 1 or ready to be displayed. Interface state information, a state queue to enable the user to return to a previous state or view of the application 136 - 1 , and a redo/undo queue of previous actions taken by the user. Include additional information, such as one or more.

The event monitor 171 receives event information from the peripheral interface 118 . The event information includes information about a subevent (eg, a user touch on the touch-sensitive display 112 as part of a multi-touch gesture). Peripheral interface 118 is from I/O subsystem 106 or sensors, such as proximity sensor 166 , accelerometer(s) 168 , and/or microphone 113 (via audio circuitry 110 ). Transmits the information it receives. Information that peripherals interface 118 receives from I/O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

In some embodiments, event monitor 171 sends requests to peripherals interface 118 at predetermined intervals. In response, peripherals interface 118 transmits event information. In other embodiments, peripherals interface 118 transmits event information only when there is a significant event (eg, receiving input exceeding a predetermined noise threshold and/or input for exceeding a predetermined duration). .

In some embodiments, the event classifier 170 also includes a hit view determination module 172 and/or an active event recognizer determination module 173 .

Hit view determination module 172 provides software procedures for determining where a subevent occurred within one or more views when touch-sensitive display 112 displays more than one view. Views are made up of controls and other elements that the user can see on the display.

Another aspect of a user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the individual application) for which touch is detected optionally correspond to program levels in the application's program or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as appropriate inputs is determined based, at least in part, on the hit view of the initial touch, optionally initiating a touch-based gesture. do.

The hit view determination module 172 receives information related to sub-events of the touch-based gesture. If the application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the subevent. In most situations, the hit view is the lowest level view in which the initiated subevent (eg, the first subevent in the sequence of subevents that forms the event or potential event) occurs. Once a hit view is identified by the hit view determination module 172 , the hit view typically receives all subevents related to the same touch or input source that caused it to be identified as the hit view.

The active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of subevents. In some embodiments, the active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of subevents. In other embodiments, the active event recognizer determination module 173 determines that all views including the physical location of the subevent are actively involved views, so that all actively involved views are specific to the subevents. It decides that it should receive the sequence. In other embodiments, even if the touch subevents are exclusively confined to the area associated with one particular view, the top views in the hierarchy will still remain as actively engaged views.

The event dispatcher module 174 dispatches event information to an event recognizer (eg, event recognizer 180 ). In embodiments that include an active event recognizer determination module 173 , the event dispatcher module 174 communicates event information to the event recognizer determined by the active event recognizer determination module 173 . In some embodiments, the event dispatcher module 174 stores event information in an event queue, where the event information is fetched by the respective event receiver 182 .

In some embodiments, operating system 126 includes event classifier 170 . Alternatively, application 136 - 1 includes event classifier 170 . In still other embodiments, event classifier 170 is a standalone module or is part of another module stored in memory 102 , such as contact/motion module 130 .

In some embodiments, application 136 - 1 includes a plurality of event handlers 190 and one or more application views 191 , each of which is a touch event occurring within a respective view of the application's user interface. Includes instructions for processing them. Each application view 191 of application 136 - 1 includes one or more event recognizers 180 . Typically, each application view 191 includes a plurality of event recognizers 180 . In other embodiments, one or more of the event recognizers 180 may be separate, such as a user interface kit (not shown) or a higher-level object from which the application 136 - 1 inherits methods and other properties. It is part of the module. In some embodiments, each event handler 190 is one of data updater 176 , object updater 177 , GUI updater 178 , and/or event data 179 received from event classifier 170 . includes more than Event handler 190 optionally uses or calls data updater 176 , object updater 177 , or GUI updater 178 to update application internal state 192 . Alternatively, one or more of the application views 191 include one or more respective event handlers 190 . Also, in some embodiments, one or more of data updater 176 , object updater 177 , and GUI updater 178 are included within respective application view 191 .

The individual event recognizer 180 receives event information (eg, event data 179 ) from the event classifier 170 and identifies an event from the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184 . In some embodiments, event recognizer 180 also includes at least a subset of metadata 183 and event delivery instructions 188 (optionally including subevent delivery instructions).

The event receiver 182 receives event information from the event classifier 170 . The event information includes information about a sub-event, for example, a touch or a touch movement. Depending on the subevent, the event information also includes additional information such as the location of the subevent. If the sub-event relates to motion of the touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the events include rotation of the device from one orientation to another (eg, from a portrait orientation to a landscape orientation, or vice versa), and the event information includes the current orientation of the device (also referred to as device pose). ) and corresponding information about

The event comparator 184 compares the event information to predefined event or subevent definitions, and based on the comparison, determines an event or subevent, or determines or updates the status of the event or subevent. In embodiments, event comparator 184 includes event definitions 186 . Event definitions 186 include definitions of events (eg, predefined sequences of sub-events), eg, Event 1 187-1, Event 2 187-2, and the like. In some embodiments, subevents within event 187 include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition for event 1 187 - 1 is a double tap on the displayed object. A double tap is, for example, a first touch (touch start) on a displayed object during a predetermined phase, a first liftoff (touch end) during a predetermined phase, a displayed object during a predetermined phase a second touch on the upper body (touch start), and a second liftoff (touch end) for a predetermined phase. In another example, the definition for event 2 187 - 2 is dragging on the displayed object. Dragging includes, for example, a touch (or contact) on the displayed object for a predetermined phase, movement of the touch across the touch-sensitive display 112 , and liftoff of the touch (touch termination). In some embodiments, the event also includes information about one or more associated event handlers 190 .

In some embodiments, event definition 187 includes a definition of an event for a respective user interface object. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a subevent. For example, in an application view in which three user interface objects are displayed on the touch-sensitive display 112 , when a touch is detected on the touch-sensitive display 112 , the event comparator 184 displays the three user interface objects A hit test is performed to determine which of these is associated with a touch (subevent). When each displayed object is associated with a respective event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, the event comparator 184 selects an event handler associated with the object and subevent that triggers the hit test.

In some embodiments, the definition for each event 187 also includes deferred actions of delaying delivery of event information until after it is determined whether the sequence of subevents corresponds to or does not correspond to an event type of the event recognizer. .

If the individual event recognizer 180 determines that the set of sub-events does not match any of the events in the event definitions 186 , then the individual event recognizer 180 determines that the event is impossible, event failed, or event is over. A state is entered, after which the individual event recognizer ignores subsequent subevents of the touch-based gesture. In this situation, other event recognizers that remain active for the hit view, if any, continue to track and process sub-events of the touch-based gesture in progress.

In some embodiments, an individual event recognizer 180 sets configurable attributes, flags, and/or lists that indicate how the event delivery system should perform subevent delivery to actively participating event recognizers. and metadata 183 with In some embodiments, metadata 183 includes configurable properties, flags, and/or lists that indicate how, or can interact with, event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and/or lists that indicate whether subevents are delivered to various levels in the view or program hierarchy.

In some embodiments, a respective event recognizer 180 activates an event handler 190 associated with an event when one or more specific subevents of the event are recognized. In some embodiments, the respective event recognizer 180 passes event information associated with the event to the event handler 190 . Activating the event handler 190 is separate from sending (and delayed sending) subevents to individual hit views. In some embodiments, event recognizer 180 sends a flag associated with the recognized event, and event handler 190 associated with the flag catches the flag and performs a predefined process.

In some embodiments, event delivery instructions 188 include subevent delivery instructions that deliver event information about a subevent without activating an event handler. Instead, subevent delivery instructions pass event information to event handlers associated with a series of subevents or to actively engaged views. Event handlers associated with a series of subevents or actively engaged views receive event information and perform a predetermined process.

In some embodiments, data updater 176 creates and updates data used in application 136 - 1 . For example, the data updater 176 updates a phone number used in the contact module 137 or stores a video file used in the video player module. In some embodiments, object updater 177 creates and updates objects used in application 136 - 1 . For example, the object updater 177 creates a new user interface object or updates the location of the user interface object. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information for display on a touch-sensitive display and sends it to graphics module 132 .

In some embodiments, event handler(s) 190 includes or accesses data updater 176 , object updater 177 , and GUI updater 178 . In some embodiments, data updater 176 , object updater 177 , and GUI updater 178 are included within a single module of individual application 136 - 1 or application view 191 . In other embodiments, they are included within two or more software modules.

1C is a block diagram illustrating a tactile output module in accordance with some embodiments. In some embodiments, I/O subsystem 106 (eg, haptic feedback controller 161 ( FIG. 1A ) and/or other input controller(s) 160 ( FIG. 1A )) may be configured as shown in FIG. 1C . It includes at least some of the example components. In some embodiments, peripherals interface 118 includes at least some of the example components shown in FIG. 1C .

In some embodiments, the tactile output module includes a haptic feedback module 133 . In some embodiments, the haptic feedback module 133 provides user interface feedback from software applications on the electronic device (eg, alerts and other notifications indicating the occurrence of events or performance of actions in user interfaces of the electronic device and Gathers and combines tactile outputs (feedback in response to user inputs corresponding to displayed user interfaces). The haptic feedback module 133 includes a waveform module 123 (for providing waveforms used to generate tactile outputs), a mixer 125 (for mixing waveforms, such as waveforms in different channels), Compressor 127 (for reducing or compressing the dynamic range of waveforms), low-pass filter 129 (for filtering high frequency signal components in the waveforms), and (for adjusting waveforms according to thermal conditions) ) thermal controller 131 . In some embodiments, the haptic feedback module 133 is included within the haptic feedback controller 161 ( FIG. 1A ). In some embodiments, a separate unit of haptic feedback module 133 (or a separate implementation of haptic feedback module 133 ) is also included within the audio controller (eg, audio circuitry 110 , FIG. 1A ) and used to generate audio signals. In some embodiments, a single haptic feedback module 133 is used to generate waveforms for tactile outputs and to generate audio signals.

In some embodiments, haptic feedback module 133 may also include trigger module 121 (eg, a software application, operating system, or other software modules). In some embodiments, trigger module 121 generates trigger signals to initiate generation of waveforms (eg, by waveform module 123 ). For example, the trigger module 121 generates trigger signals based on preset timing criteria. In some embodiments, the trigger module 121 receives trigger signals from outside of the haptic feedback module 133 (eg, in some embodiments, the haptic feedback module 133 is outside of the haptic feedback module 133 ) Receive trigger signals from a hardware input processing module 146 located in ), send trigger signals to a user interface element (eg, affordance in an application or application icon) or a hardware input device (eg, an intensity-sensitive touch screen, such as an intensity-sensitive touch screen). Software applications or other components within haptic feedback module 133 (eg, waveform module 123 ) that trigger actions (eg, using trigger module 121 ) based on activation of an input surface or home button) relayed by In some embodiments, the trigger module 121 also receives tactile feedback generation instructions (eg, from the haptic feedback module 133 of FIGS. 1A and 3 ). In some embodiments, the trigger module 121 (eg, from the haptic feedback module 133 of FIGS. 1A and 3 ) is the haptic feedback module 133 (or the trigger module 121 in the haptic feedback module 133 ). It generates trigger signals in response to receiving these tactile feedback commands.

Waveform module 123 receives trigger signals as input (eg, from trigger module 121 ), and in response to receiving the trigger signals, generates waveforms (eg, FIG. 4C and FIG. 4C and waveforms selected from a predefined set of waveforms designated for use by waveform module 123 , such as those described in more detail below with reference to FIG. 4D .

Mixer 125 receives waveforms as input (eg, from waveform module 123 ) and mixes the waveforms together. For example, when mixer 125 receives two or more waveforms (eg, a first waveform in a first channel, and a second waveform that at least partially overlaps with the first waveform in a second channel), The mixer 125 outputs a combined waveform corresponding to the summation of two or more waveforms. In some embodiments, the mixer 125 also converts the particular waveform(s) to one of two or more waveforms (eg, by increasing the scale of the particular waveform(s) and/or decreasing the scale of the rest of the waveforms). Modifies one or more of the two or more waveforms for emphasis relative to the rest. In some situations, mixer 125 selects one or more waveforms to remove from the combined waveform (eg, waveforms from more than three sources that have been requested to be output simultaneously by tactile output generator 167 are When present, the waveform from the oldest source is dropped).

Compressor 127 receives waveforms (eg, a combined waveform from mixer 125 ) as input and modifies the waveforms. In some embodiments, compressor 127 reduces waveforms (eg, according to the physical specifications of tactile output generators 167 of FIG. 1A or 357 of FIG. 3 ), such that a tactile corresponding waveform is causes the outputs to be reduced. In some embodiments, compressor 127 limits the waveforms, such as by forcing a predefined maximum amplitude for the waveforms. For example, compressor 127 reduces amplitudes of portions of waveforms that exceed a predefined amplitude threshold while maintaining amplitudes of portions of waveforms that do not exceed a predefined amplitude threshold. In some embodiments, compressor 127 reduces the dynamic range of the waveforms. In some embodiments, the compressor 127 dynamically reduces the dynamic range of the waveforms so that the combined waveforms meet the performance specifications of the tactile output generator 167 (eg, force and/or movable mass displacement limits). to be kept within

Low pass filter 129 receives waveforms (eg, compressed waveforms from compressor 127 ) as input, and filters (eg, smoothes) the waveforms (eg, removes high frequency signal components in the waveforms) or decrease). For example, in some cases, compressor 127, with compressed waveforms, exceeds performance specifications of tactile output generator 167 and/or tactile outputs when tactile outputs are generated according to the compressed waveforms. Includes extraneous signals (eg, high frequency signal components) that interfere with the generation of the outputs. Low pass filter 129 reduces or removes such extraneous signals in the waveforms.

Thermal controller 131 receives waveforms (eg, filtered waveforms from low pass filter 129 ) as input, and (eg, internal temperatures detected within device 100 , such as a haptic feedback controller ( Adjust the waveforms according to the thermal conditions of the device 100 (based on the temperature of 161 , and/or external temperatures detected by the device 100 ). For example, in some cases, the output of the haptic feedback controller 161 changes with temperature (eg, in response to receiving the same waveforms, the haptic feedback controller 161 causes the first generate a first tactile output when at a temperature, and the haptic feedback controller 161 generates a second tactile output when at a second temperature separate from the first temperature). For example, the magnitude (or amplitude) of the tactile outputs may vary with temperature. To reduce the effect of temperature changes, the waveforms are modified (eg, the amplitude of the waveforms is increased or decreased based on the temperature).

In some embodiments, the haptic feedback module 133 (eg, the trigger module 121 ) is coupled to the hardware input processing module 146 . In some embodiments, the other input controller(s) 160 in FIG. 1A includes a hardware input processing module 146 . In some embodiments, the hardware input processing module 146 is configured with a hardware input device 145 (eg, other input or control devices 116 in FIG. 1A , such as an intensity-sensitive input surface, such as an intensity-sensitive touch screen). or home button). In some embodiments, hardware input device 145 is any input device described herein, such as touch-sensitive display system 112 ( FIG. 1A ), keyboard/mouse 350 ( FIG. 3 ), touch pad. 355 ( FIG. 3 ), one of the other input or control devices 116 ( FIG. 1A ), or an intensity-sensitive home button. In some embodiments, the hardware input device 145 is not the touch-sensitive display system 112 ( FIG. 1A ), the keyboard/mouse 350 ( FIG. 3 ), or the touchpad 355 ( FIG. 3 ); It consists of a force-sensitive home button. In some embodiments, in response to inputs from a hardware input device 145 (eg, an intensity-sensitive home button or touch screen), the hardware input processing module 146 configures the user to satisfy predefined input criteria. One or more trigger signals are provided to the haptic feedback module 133 to indicate that an input corresponding to an input, eg, a “click” (eg, a “down click” or an “up click”) of the home button has been detected. In some embodiments, the haptic feedback module 133 provides waveforms corresponding to a “click” of the home button in response to an input corresponding to a “click” of the home button, simulating haptic feedback of pressing the physical home button. do.

In some embodiments, the tactile output module includes a haptic feedback controller 161 (eg, haptic feedback controller 161 in FIG. 1A ), which controls the generation of tactile outputs. In some embodiments, haptic feedback controller 161 is coupled to a plurality of tactile output generators and selects one or more tactile output generators of the plurality of tactile output generators to generate a waveform for generating tactile outputs. to the selected one or more tactile output generators. In some embodiments, haptic feedback controller 161 provides tactile output requests corresponding to activation of hardware input device 145 and tactile output requests corresponding to software events (eg, a haptic feedback module (eg, haptic feedback module) 133), and (eg, to prioritize tactile outputs corresponding to activation of hardware input device 145 over tactile outputs corresponding to software events) , by increasing the scale of the particular waveform(s) and/or decreasing the scale of the rest of the waveforms) to emphasize one or more of the two or more waveforms relative to the rest of the two or more waveforms. Modify the waveforms.

In some embodiments, as shown in FIG. 1C , the output of haptic feedback controller 161 is coupled to audio circuitry of device 100 (eg, audio circuitry 110 of FIG. 1A ) and sends audio signals to the device. (100) provided in the audio circuit section. In some embodiments, the haptic feedback controller 161 provides both the waveforms used to generate the tactile outputs and the audio signals used to provide the audio outputs in conjunction with the generation of the tactile outputs. In some embodiments, haptic feedback controller 161 modifies audio signals and/or waveforms (used to generate tactile outputs), thereby delaying audio signals and/or waveforms (eg, by delaying audio signals and/or waveforms). Let the outputs and tactile outputs be synchronized. In some embodiments, haptic feedback controller 161 includes a digital-to-analog converter used to convert digital waveforms into analog signals, which analog signals include amplifier 163 and/or tactile output generator 167 . ) is received by

In some embodiments, the haptic output module includes an amplifier 163 . In some embodiments, amplifier 163 receives waveforms (eg, from haptic feedback controller 161 ), amplifies the waveforms, and then converts the amplified waveforms to tactile output generator 167 (eg, tactile output). to the generators (any of 167 in FIG. 1A or 357 in FIG. 3). For example, the amplifier 163 converts the received waveforms to signal levels conforming to the physical specifications of the tactile output generator 167 (eg, the signals transmitted to the tactile output generator 167 , the haptic feedback controller ( amplify (with a voltage and/or current required by tactile output generator 167 to generate tactile outputs) to generate tactile outputs corresponding to the waveforms received from 161; to the output generator 167 . In response, tactile output generator 167 generates tactile outputs (eg, by shifting the movable mass back and forth in one or more dimensions relative to the neutral position of the movable mass).

In some embodiments, the tactile output module includes a sensor 169 , which is coupled to a tactile output generator 167 . The sensor 169 is the tactile output generator 167 or one or more components of the tactile output generator 167 (eg, one or more moving parts, such as a membrane used to generate the tactile outputs). Detect states or state changes (eg, mechanical position, physical displacement, and/or movement). In some embodiments, sensor 169 is a magnetic field sensor (eg, a Hall effect sensor) or other displacement and/or movement sensor. In some embodiments, sensor 169 provides information (eg, position, displacement, and/or movement of one or more components within tactile output generator 167 ) to haptic feedback controller 161 , and a tactile output In accordance with the information provided by the sensor 169 regarding the state of the generator 167 , the haptic feedback controller 161 generates waveforms output from the haptic feedback controller 161 (eg, optionally via the amplifier 163 , the tactile sense). waveforms sent to the redundancy output generator 167).

The discussion above regarding event handling of user touches on a touch-sensitive display also applies to other forms of user inputs for operating multifunction devices 100 having input devices, but all of which are initiated on touch screens. You have to understand that it is not. mouse movement and mouse button presses optionally coordinated with, for example, single or multiple keyboard presses or holds; contact movements, such as tap, drag, scroll, etc., on the touchpad; pen stylus inputs; movement of the device; verbal commands; detected eye movements; biometric inputs; and/or any combination thereof is optionally used as inputs corresponding to subevents defining the event to be recognized.

2 shows a portable multifunction device 100 having a touch screen 112 in accordance with some embodiments. The touch screen, optionally, displays one or more graphics within user interface (UI) 200 . In this embodiment, as well as other embodiments described below, the user may, for example, use one or more fingers 202 (not to scale in the figures) or one or more styluses 203 (in the figures to scale). It becomes possible to select one or more of the graphics by making a gesture on the graphic using (not shown). In some embodiments, selection of the one or more graphics occurs when the user ceases to contact the one or more graphics. In some embodiments, the gesture may optionally include one or more taps of a finger in contact with device 100 , one or more swipes (left to right, right to left, upwards and/or downwards) , and/or rolling (right to left, left to right, upward and/or downward). In some implementations or situations, if inadvertently contacted with a graphic, the graphic is not selected. For example, when the gesture corresponding to the selection is a tap, the swipe gesture to sweep over the application icon optionally does not select the corresponding application.

Device 100 also optionally includes one or more physical buttons, such as a “home” or menu button 204 . As described above, the menu button 204 is optionally used to navigate to any application 136 in the set of applications that are selectively running on the device 100 . Alternatively, in some embodiments, the menu button is implemented as a soft key in the GUI displayed on the touch screen 112 .

In some embodiments, device 100 includes touch screen 112 , menu button 204 , push button 206 to power on/off the device and lock the device, volume control button(s) 208 , a Subscriber Identity Module (SIM) card slot 210 , a headset jack 212 , and a docking/charging external port 124 . Push button 206 optionally powers on/off the device by pressing the button and holding the button depressed for a predefined time interval; lock the device by pressing the button and releasing the button before a predefined time interval elapses; Used to unlock a device or initiate an unlock process. In an alternative embodiment, device 100 also accepts verbal input for activation or deactivation of some functions via microphone 113 . Device 100 may also optionally include one or more contact intensity sensors 165 for detecting intensity of contacts on touch screen 112 and/or for generating tactile outputs for a user of device 100 . one or more tactile output generators 167 .

3 is a block diagram of an exemplary multifunction device having a display and a touch-sensitive surface, in accordance with some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (eg, home or industrial). controller). Device 300 typically includes one or more processing units (CPU) 310 , one or more network or other communication interfaces 360 , memory 370 , and one or more communication buses to interconnect these components ( 320). Communication buses 320 optionally include circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between them. Device 300 includes an input/output (I/O) interface 330 that includes a display 340 that is typically a touch screen display. I/O interface 330 is also optionally a keyboard and/or mouse (or other pointing device) 350 and touchpad 355 , tactile output for generating tactile outputs on device 300 . Generator 357 (eg, similar to tactile output generator(s) 167 described above with reference to FIG. 1A ), and sensors 359 (eg, contact intensity sensor(s) described above with reference to FIG. 1A ). ) ( 165 ); memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; optionally including non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU(s) 310 . In some embodiments, memory 370 includes programs, modules, and data structures similar to programs, modules, and data structures stored in memory 102 of portable multifunction device 100 ( FIG. 1A ). , or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100 . For example, memory 370 of device 300 may optionally include drawing module 380 , presentation module 382 , word processing module 384 , website creation module 386 , and disk authoring module 388 . ), and/or spreadsheet module 390 , while memory 102 of portable multifunction device 100 ( FIG. 1A ), optionally, does not store these modules.

Each of the previously identified elements in FIG. 3 is optionally stored in one or more of the aforementioned memory devices. Each of the modules identified above corresponds to a set of instructions for performing the functions described above. The modules or programs (eg, sets of instructions) identified above need not be implemented as separate software programs, procedures, or modules, and thus various subsets of these modules may be selectively combined in various embodiments in various embodiments. or otherwise rearranged. In some embodiments, memory 370 optionally stores a subset of the modules and data structures identified above. Also, memory 370 optionally stores additional modules and data structures not described above.

Attention is now directed to embodiments of user interfaces that are optionally implemented on, for example, portable multifunction device 100 .

4A illustrates an example user interface for a menu of applications on portable multifunction device 100 in accordance with some embodiments. Similar user interfaces are optionally implemented on device 300 . In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

셀룰러 및 Wi-Fi 신호들과 같은 무선 통신(들)을 위한 신호 세기 표시자(들)(402);

signal strength indicator(s) 402 for wireless communication(s), such as cellular and Wi-Fi signals;

시간(404);

time 404;

블루투스 표시자(405);

Bluetooth indicator 405;

배터리 상태 표시자(406);

battery status indicator 406 ;

다음과 같은, 빈번하게 사용되는 애플리케이션들에 대한 아이콘들을 갖는 트레이(408):

Tray 408 with icons for frequently used applications, such as:

° icon 416 for phone module 138 labeled “Call”, optionally including an indicator 414 of the number of missed calls or voicemail messages;

° icon 418 for email client module 140 labeled “Mail” optionally including an indicator 410 of the number of unread emails;

° icon 420 for browser module 147 labeled “Browser”; and

° Icon 422 for video and music player module 152 labeled “iPod”, also referred to as iPod (trademark of Apple Inc.) module 152; and

Icons for different applications, such as:

° Icon 424 for IM module 141 labeled "Message";

° icon 426 for calendar module 148 labeled “Calendar”;

° icon 428 for image management module 144 labeled “Photos”;

° icon 430 for camera module 143 labeled “camera”;

° Icon 432 for online video module 155 labeled “Online Video”;

° icon 434 for stock widget 149-2 labeled "stocks";

° icon 436 for map module 154 labeled “map”;

° icon 438 for weather widget 149-1 labeled "weather";

° icon 440 for alarm clock widget 149-4 labeled "Clock";

° icon 442 for exercise support module 142 labeled “exercise support”;

° icon 444 for notes module 153 labeled “Notes”; and

° Icon 446 for the Settings application or module, labeled “Settings,” that provides access to settings for device 100 and its various applications 136 .

It should be noted that the icon labels shown in FIG. 4A are merely exemplary. For example, icon 422 for video and music player module 152 is labeled “Music” or “Music Player”. Other labels are optionally used for various application icons. In some embodiments, the label for the respective application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label for a particular application icon is separate from the name of the application corresponding to the particular application icon.

FIG. 4B illustrates a device (eg, in FIG. 3 ) having a touch-sensitive surface 451 (eg, tablet or touchpad 355 in FIG. 3 ) separate from display 450 (eg, touch screen display 112 ). An example user interface on device 300 is shown. Device 300 may also optionally include one or more contact intensity sensors (eg, one or more of sensors 359 ) and/or device 300 for detecting intensity of contacts on touch-sensitive surface 451 . one or more tactile output generators 357 for generating tactile outputs for the user of

Although some of the examples that follow will be provided with reference to inputs on a touch screen display 112 (a touch-sensitive surface and display combined), in some embodiments, the device is separate from the display as shown in FIG. 4B . Detect inputs on a personal touch-sensitive surface. In some embodiments, the touch-sensitive surface (eg, 451 in FIG. 4B ) has a major axis (eg, 452 in FIG. 4B ) that corresponds to a major axis (eg, 453 in FIG. 4B ) on the display (eg, 450 ). According to these embodiments, the device communicates with the touch-sensitive surface 451 at locations corresponding to respective locations on the display (eg, in FIG. 4B , 460 corresponds to 468 and 462 corresponds to 470 ). Detect contacts (eg, 460 and 462 in FIG. 4B ). In this way, user inputs (eg, contacts 460 , 462 and their movements) detected by the device on the touch-sensitive surface (eg, 451 in FIG. 4B ) can be detected when the touch-sensitive surface is separate from the display. used to manipulate a user interface on the display (eg, 450 in FIG. 4B ) of the multifunction device by the device when . It should be understood that similar methods are, optionally, used with other user interfaces described herein.

Additionally, while the following examples are given primarily with reference to finger inputs (eg, finger contacts, finger tap gestures, finger swipe gestures), in some embodiments, one or more of the finger inputs are other input device It should be understood that input from (eg, mouse-based input or stylus input) is replaced. For example, a swipe gesture is optionally replaced with a mouse click (eg, instead of a contact) and subsequent movement of the cursor along the path of the swipe (eg, instead of movement of the contact). As another example, the tap gesture is optionally replaced with a mouse click while the cursor is positioned over the location of the tap gesture (eg, instead of ceasing to detect the contact following detection of the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are selectively used simultaneously, or mouse and finger contacts are selectively used concurrently.

5A shows an example personal electronic device 500 . Device 500 includes a body 502 . In some embodiments, device 500 may include some or all of the features described with respect to devices 100 , 300 (eg, FIGS. 1A-4B ). In some embodiments, device 500 has a touch-sensitive display screen 504 (hereinafter, touch screen 504 ). Alternatively or in addition to the touch screen 504 , the device 500 has a display and a touch-sensitive surface. Like devices 100 and 300 , in some embodiments touch screen 504 (or touch-sensitive surface) is, optionally, one for detecting the intensity of applied contacts (eg, touches). and more than an intensity sensor. One or more intensity sensors of touch screen 504 (or touch-sensitive surface) may provide output data representing the intensity of touches. The user interface of device 500 may respond to touches based on the intensity of the touches, meaning that touches of different intensities may invoke different user interface actions on device 500 .

Exemplary techniques for detecting and processing touch intensity are described, for example, in Related Applications: filed May 8, 2013 and entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application," International Patent Application No. PCT/US2013/040061 (published as WIPO Publication No. WO/2013/169849), and filed on November 11, 2013 and entitled "Device, Method, and Graphical User Interface" for Transitioning Between Touch Input to Display Output Relationships," International Patent Application No. PCT/US2013/069483 (published as WIPO Publication No. WO/2014/105276), each of which is incorporated herein by reference in its entirety.

In some embodiments, device 500 has one or more input mechanisms 506 , 508 . Input mechanisms 506 and 508 (if included) may be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. These attachment mechanisms (if included) allow device 500 to use, for example, a hat, glasses, earrings, necklace, shirt, jacket, bracelet, watch band, chain, trousers, belt, shoes, wallet , so that it can be attached to a backpack, etc. These attachment mechanisms allow device 500 to be worn by a user.

5B shows an example personal electronic device 500 . In some embodiments, device 500 may include some or all of the components described with respect to FIGS. 1A , 1B , and 3 . Device 500 has a bus 512 that operatively couples I/O section 514 with one or more computer processors 516 and memory 518 . The I/O section 514 may be connected to the display 504 , which may have a touch-sensitive component 522 , and, optionally, an intensity sensor 524 (eg, a contact intensity sensor). I/O section 514 also provides communication unit 530 for receiving application and operating system data, using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and/or other wireless communication techniques. can be connected with Device 500 may include input mechanisms 506 and/or 508 . The input mechanism 506 is optionally a rotatable input device or, for example, a depressible and rotatable input device. In some examples, the input mechanism 508 is, optionally, a button.

In some examples, the input mechanism 508 is, optionally, a microphone. The personal electronic device 500 may optionally include a GPS sensor 532 , an accelerometer 534 , a direction sensor 540 (eg, a compass), a gyroscope 536 , a motion sensor 538 , and/or their It includes various sensors, such as combinations, all of which may be operatively connected to the I/O section 514 .

Memory 518 of personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions, which may include, for example, one or more computer processors 516 . Causes computer processors to perform processes 800, 1000, 1200, 1400, 1600, 1800, 2000, 2200, 2500, 2700, 2900, 3100, 3300, 3500, 3700, 3900, 4100, 4300 (Fig. 8, 10, 12, 14, 16, 18, 20, 22, 25, 27, 29, 31, 33, 35, 37, 39, 41, 43), including the techniques described below. A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transitory computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic, optical, and/or semiconductor storage. Examples of such storage include persistent solid state memory such as flash, solid state drives, etc., as well as magnetic disks, CD, DVD, or optical disks based on Blu-ray technologies. The personal electronic device 500 is not limited to the components and configuration of FIG. 5B , and may include other or additional components in a number of configurations.

As used herein, the term “affordance” refers to a user interaction selectively displayed on a display screen of devices 100 , 300 , and/or 500 ( FIGS. 1A , 3 , and 5A and 5B ). Refers to a user-interactive graphical user interface object. For example, each of an image (eg, an icon), a button, and text (eg, a hyperlink) optionally constitutes an affordance.

As used herein, the term “focus selector” refers to an input element that represents the current portion of a user interface with which the user is interacting. In some implementations that include a cursor or other location marker, a touch-sensitive surface (eg, FIG. 3 ) while the cursor is over a particular user interface element (eg, a button, window, slider, or other user interface element) When an input (eg, a press input) is detected on the touchpad 355 of the or touch-sensitive surface 451 of FIG. 4B ), the cursor becomes a "focus selector" such that a particular user interface element is adjusted according to the detected input. function as Some implementations include a touch screen display (eg, touch-sensitive display system 112 of FIG. 1A or touch screen 112 of FIG. 4A ) that enables direct interaction with user interface elements on the touch screen display. In some cases, a particular user interface element is detected when an input (eg, a touch input) is detected on a touch screen display at the location of a particular user interface element (eg, a button, window, slider, or other user interface element). A contact detected on the touch screen functions as a “focus selector” to be adjusted according to the entered input. In some implementations, focus is moved to one of the user interfaces without movement of a corresponding cursor or contact or movement of a corresponding cursor on the touch screen display (eg, by using a tab key or an arrow key to move focus from one button to another). moved from one section of the user interface to another section of the user interface; In such implementations, the focus selector moves in response to movement of focus between different areas of the user interface. Irrespective of the particular form a focus selector has, a focus selector generally uses a user interface to convey the user's intended interaction with the user interface (eg, by indicating to the device an element of the user interface with which the user wants to interact). A user interface element (or contact on a touch screen display) controlled by For example, the position of a focus selector (eg, cursor, contact, or selection box) over each button while a press input is detected on a touch-sensitive surface (eg, a touchpad or touch screen) (eg, on the device's display) It will indicate that the user is about to activate the respective button (unlike other user interface elements shown).

As used in the specification and claims, the term “characteristic intensity” of a contact refers to a property of a contact based on one or more intensities of the contact. In some embodiments, the feature intensity is based on multiple intensity samples. The characteristic intensity is optionally determined by a predefined number of intensity samples, or (eg, after detecting the contact, before detecting lift off of the contact, before or after detecting the start of movement of the contact, A predetermined period of time (eg, before or after detecting an end of the contact, before or after detecting an increase in the intensity of the contact, and/or before or after detecting a decrease in the intensity of the contact) for the predefined event. 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 sec). The characteristic intensity of the contact is, optionally, a maximum value of the intensities of the contact, a mean value of the intensities of the contact, an average value of the intensities of the contact, a top 10 percentile value of the intensities of the contact. ), a value of half the maximum value of the intensities of the contact, a value of 90 percent of the maximum value of the intensities of the contact, and the like. In some embodiments, the duration of the contact is used to determine the feature intensity (eg, when the feature intensity is an average of the intensity of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action was performed by the user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, a result of a contact having a characteristic intensity that does not exceed a first threshold, a first action is performed, and a result of a contact having a characteristic intensity that exceeds a first intensity threshold but does not exceed a second intensity threshold, a second An action is performed, and as a result of the contact having a characteristic intensity above the second threshold, a third action is performed. In some embodiments, a comparison between the characteristic strength and one or more thresholds is used to determine whether to perform one or more actions (eg, to perform an individual action) rather than being used to determine whether to perform the first action or the second action. to decide whether or not to suspend performing an individual action).

5C illustrates detecting a plurality of contacts 552A-552E on a touch-sensitive display screen 504 using a plurality of intensity sensors 524A-524D. 5C further includes intensity diagrams showing current intensity measurements of intensity sensors 524A-524D for intensity units. In this example, the intensity measurements of intensity sensors 524A, 524D are each 9 intensity units, and the intensity measurements of intensity sensors 524B, 524C are each seven intensity units. In some implementations, the total intensity is the sum of the intensity measurements of the plurality of intensity sensors 524A-524D, which in this example is 32 intensity units. In some embodiments, each contact is assigned an individual intensity that is a fraction of the total intensity. 5D illustrates assigning a total intensity to contacts 552A-552E based on their respective distances from center of force 554 . In this example, contacts 552A, 552B, 552E are each assigned an intensity of the contact of 8 intensity units of the total intensity, and contacts 552C and 552D are each assigned an intensity of the contact of 4 intensity units of the total intensity, respectively. is allocated More generally, in some implementations, each contact j is assigned an individual intensity Ij that is a fraction of the total intensity A according to a predefined mathematical function Ij = Ao(Dj/ΣDi) and , where Dj is the distance of the individual contact j to the center of force, and ΣDi is the sum of the distances of all individual contacts to the center of force (eg, i=1 to the last). Operations described with reference to FIGS. 5C and 5D may be performed using an electronic device similar to or identical to device 100 , 300 , or 500 . In some embodiments, the characteristic intensity of the contact is based on one or more intensities of the contact. In some embodiments, intensity sensors are used to determine a single feature intensity (eg, a single feature intensity of a single contact). It should be noted that the intensity diagrams are not part of the displayed user interface and are included in FIGS. 5C and 5D to aid the reader.

In some embodiments, a portion of a gesture is identified to determine a characteristic strength. For example, the touch-sensitive surface optionally receives successive swipe contacts transitioning from the starting position to reach the ending position, at which point the intensity of the contact increases. In this example, the characteristic intensity of the contact at the end location is optionally based on only a portion of the successive swipe contacts (eg, only the portion of the swipe contact at the end location) rather than the entire swipe contact. In some embodiments, a smoothing algorithm is optionally applied to the intensities of the swipe contact prior to determining the characteristic intensity of the contact. For example, the smoothing algorithm may optionally include an unweighted sliding-average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and/or an exponential smoothing algorithm. include more than one. In some situations, these smoothing algorithms remove narrow spikes or dips in the intensities of the swipe contact to determine the characteristic intensity.

The intensity of the contact on the touch-sensitive surface is optionally characterized for one or more intensity thresholds, such as a touch-detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and/or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to the intensity at which the device will perform operations typically associated with clicking a button or track pad of a physical mouse. In some embodiments, the deep press intensity threshold corresponds to the intensity at which the device will perform operations that are different from those typically associated with clicking a button or track pad of a physical mouse. In some embodiments, when a contact is detected with a characteristic intensity below a light press intensity threshold (eg, and above a nominal contact detection intensity threshold, below which the contact is no longer detected), the device activates the light press intensity It will move the focus selector according to movement of the contact on the touch-sensitive surface without performing an action associated with the threshold or the deep press intensity threshold. In general, unless stated otherwise, these intensity thresholds are consistent between different sets of user interface drawings.

An increase in the characteristic intensity of a contact from an intensity below the light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in the characteristic intensity of a contact from an intensity below the deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a “deep press” input. An increase in the characteristic intensity of a contact from an intensity below the touch detection intensity threshold to an intensity between the touch detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting a contact on a touch surface. A decrease in the characteristic intensity of a contact from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting liftoff of the contact from the touch surface. In some embodiments, the touch detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

In some embodiments described herein, the one or more actions detect an individual press input performed with an individual contact (or plurality of contacts) or in response to detecting a gesture comprising the individual press input. and wherein the respective press input is detected based, at least in part, on detecting an increase in intensity of the contact (or plurality of contacts) above a press input intensity threshold. In some embodiments, the respective action is performed in response to detecting an increase in intensity of the respective contact above a press input intensity threshold (eg, a “down stroke” of the respective press input). In some embodiments, the press input comprises an increase in the intensity of the respective contact above the press input intensity threshold and a subsequent decrease in the intensity of the contact below the press input intensity threshold, wherein the respective action is an individual action below the press input intensity threshold. is performed in response to detecting a subsequent decrease in the intensity of the contact (eg, an “up stroke” of an individual press input).

5E-5H illustrate contact 562 from an intensity below the light press intensity threshold (eg, “IT _L ”) of FIG. 5E to an intensity above the deep press intensity threshold (eg, “IT _D ”) of FIG. 5H . Depicts detection of a gesture comprising a press input corresponding to an increase in intensity. On the displayed user interface 570 , which includes application icons 572A-572D displayed in a predefined area 574 , while the cursor 576 is displayed over the application icon 572B corresponding to App 2 , A gesture performed using contact 562 is detected on touch-sensitive surface 560 . In some embodiments, the gesture is detected on the touch-sensitive display 504 . Intensity sensors detect the intensity of contacts on touch-sensitive surface 560 . The device determines that the intensity of the contact 562 has peaked above a deep press intensity threshold (eg, “IT _D ”). Contact 562 is maintained on touch-sensitive surface 560 . In response to detection of the gesture, and according to contact 562 having an intensity that exceeds a deep press intensity threshold (eg, “IT _D ”) during the gesture, reduced scale representations of recently opened documents for App 2 ( 578A-578C) (eg, thumbnails) are displayed, as shown in FIGS. 5F-5H . In some embodiments, the intensity compared to one or more intensity thresholds is a characteristic intensity of the contact. It should be noted that the intensity diagram for contact 562 is not part of the displayed user interface and is included in FIGS. 5E-5H to aid the reader.

In some embodiments, the display of representations 578A-578C includes an animation. For example, as shown in FIG. 5F , representation 578A is initially displayed proximate to application icon 572B. As the animation progresses, representation 578A moves up and representation 578B is displayed proximate to application icon 572B, as shown in FIG. 5G . Then, as shown in FIG. 5H , representation 578A moves upward, representation 578B moves upward toward representation 578A, and representation 578C is displayed proximate to application icon 572B. Representations 578A-578C form an array over icon 572B. In some embodiments, as shown in FIGS. 5F and 5G , the animation progresses according to the intensity of contact 562 , wherein the intensity of contact 562 exceeds a deep press intensity threshold (eg, “IT _D ”). Representations 578A-578C appear and move upward as increasing towards. In some embodiments, the intensity on which the progress of the animation is based is a characteristic intensity of the contact. The operations described with reference to FIGS. 5E-5H may be performed using an electronic device similar to or identical to device 100 , 300 , or 500 .

In some embodiments, the device employs intensity hysteresis to avoid accidental inputs, sometimes referred to as “jitter”, where the device has a hysteresis intensity threshold ( For example, the hysteresis intensity threshold is an X intensity unit lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some suitable percentage of the press input intensity threshold). As such, in some embodiments, the press input comprises an increase in the intensity of the respective contact above the press input intensity threshold and a subsequent decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the press input intensity threshold, each The operation of is performed in response to detecting a subsequent decrease in intensity of the respective contact below the hysteresis intensity threshold (eg, an “up stroke” of the respective press input). Similarly, in some embodiments, the press input causes the device to increase the intensity of the contact from an intensity below the hysteresis intensity threshold to an intensity above the press input intensity threshold, and optionally, to an intensity below the hysteresis intensity threshold. Only when detecting a subsequent decrease in the intensity of the contact is detected, the respective action is performed in response to detecting a press input (eg, an increase in the intensity of the contact or a decrease in the intensity of the contact depending on the environment).

For convenience of description, descriptions of operations performed in response to a press input associated with a press input intensity threshold or in response to a gesture comprising a press input include, optionally, an increase in an intensity of a contact above a press input intensity threshold, a hysteresis intensity threshold an increase in the intensity of the contact from an intensity below the press input intensity threshold to an intensity above the press input intensity threshold, a decrease in the intensity of the contact below the press input intensity threshold, and/or an intensity of the contact below the hysteresis intensity threshold corresponding to the press input intensity threshold. Triggered in response to detecting either of the reductions. Further, in examples where the action is described as being performed in response to detecting a decrease in the intensity of the contact below the press input intensity threshold, the action is, optionally, less than a hysteresis intensity threshold corresponding to and lower than the press input intensity threshold. is performed in response to detecting a decrease in the intensity of the contact.

As used herein, “installed application” refers to a software application downloaded on an electronic device (eg, devices 100 , 300 , and/or 500 ), and to be launched (eg, opened on the device). ) to prepare. In some embodiments, the downloaded application becomes an application installed through an installation program that extracts program portions from the downloaded package and integrates the extracted portions with the operating system of the computer system.

As used herein, the terms “open application” or “running application” refer to a retained state (eg, as part of device/global internal state 157 and/or application internal state 192 ). Refers to a software application with information. The open or running application is optionally any of the following application types:

an active application currently displayed on the display screen of the device on which the application is being used;

a background application (or background process) that is not currently displayed, but in which one or more processes for the application are being processed by one or more processors; and

A suspended or hibernated application that is not running, but has state information that is stored in memory (volatile and nonvolatile, respectively) and can be used to resume execution of the application.

As used herein, the term “closed application” refers to software applications that have no retained state information (eg, no state information for closed applications is stored in the device's memory). Accordingly, closing the application includes stopping and/or removing the application processes for the application and removing state information for the application from the device's memory. In general, opening a second application while in the first application does not close the first application. When the second application is displayed and the first application stops being displayed, the first application becomes a background application.

Attention is now directed to embodiments of user interfaces (“UIs”) and associated processes implemented on an electronic device, such as portable multifunction device 100 , device 300 , or device 500 .

6 depicts example devices connected via one or more communication channels to engage in a transaction, in accordance with some embodiments. One or more example electronic devices (eg, devices 100 , 300 , 500 ) selectively detect input (eg, specific user input, NFC field) and optionally (eg, NFC using) to transmit payment information. The one or more electronic devices optionally include NFC hardware and are configured to be NFC-enabled.

Electronic devices (eg, devices 100 , 300 , 500 ) are optionally configured to store payment account information associated with each of one or more payment accounts. Payment account information may include, for example, the name of the person or company, billing address, login, password, account number, expiration date, security code, phone number, bank associated with the payment account (eg, issuing bank), and card network. contains one or more of the identifiers. In some examples, the payment account information includes an image, such as a photo of a payment card (eg, photographed by and/or received at the device). In some examples, the electronic devices receive user input that includes at least some payment account information (eg, receive a user-entered credit, debit, account, or gift card number and expiration date). In some examples, electronic devices detect at least some payment account information from an image (eg, of a payment card captured by a camera sensor of the device). In some examples, the electronic devices receive at least some payment account information from another device (eg, another user device or server). In some examples, the electronic device is from a server associated with the user or other service (eg, an app that rents or sells audio and/or video files) for which an account for the user device has previously purchased or identified payment account data. Receive payment account information.

In some embodiments, a payment account is added to an electronic device (eg, device 100 , 300 , 500 ) such that payment account information is securely stored on the electronic device. In some examples, after the user initiates such a process, the electronic device sends information about the payment account to a transaction-reconciliation server, which is then sent by the payment network for the account to ensure validity of the information. It communicates with an operating server (eg, a payment server). The electronic device is optionally configured to receive a script from the server that enables the electronic device to program payment information for the account onto the secure element.

In some embodiments, communication between electronic devices 100 , 300 , 500 facilitates transactions (eg, general or specific transactions). For example, the first electronic device (eg, 100 ) may act as a provisioning or management device, and may provide notifications of new or updated payment account data (eg, information about a new account, existing updated information about the account, and/or an alert related to an existing account) may be transmitted to the second electronic device (eg, 500 ). In another example, a first electronic device (eg, 100 ) may transmit data to a second electronic device, where the data reflects information regarding payment transactions facilitated at the first electronic device. The information optionally includes one or more of the payment amount, the account used, the time of purchase, and whether the default account has been changed. The second device (eg, 500 ) optionally uses such information to update the default payment account (eg, based on a learning algorithm or explicit user input).

Electronic devices (eg, 100 , 300 , 500 ) are configured to communicate with each other via any of a variety of networks. For example, devices communicate using a Bluetooth connection 608 (eg, including a traditional Bluetooth connection or Bluetooth Low Energy connection) or using a WiFi network 606 . Communication between user devices is optionally coordinated to reduce the likelihood of inappropriately sharing information across devices. For example, communication related to payment information requires that the communicating devices be paired (eg, associated with each other via explicit user interaction) or associated with the same user account.

In some embodiments, an electronic device (eg, 100 , 300 , 500 ) is used to communicate with a point-of-sale (POS) payment terminal 600 that is optionally NFC-enabled. . Communication optionally occurs using various communication channels and/or technologies. In some examples, the electronic device (eg, 100 , 300 , 500 ) communicates with the payment terminal 600 using the NFC channel 610 . In some examples, payment terminal 600 communicates with an electronic device (eg, 100 , 300 , 500 ) using a peer-to-peer NFC mode. The electronic device (eg, 100, 300, 500) optionally sends a signal including payment information for a payment account (eg, a default account, or an account selected for a specific transaction) to the payment terminal 600 is configured to be transmitted to

In some embodiments, conducting the transaction includes transmitting a signal comprising payment information for an account, such as a payment account. In some embodiments, conducting the transaction reconfigures the electronic device (eg, 100 , 300 , 500 ) to respond as a contactless payment card, such as an NFC-enabled contactless payment card, followed by a payment via NFC, such as a payment and transmitting the account credentials to the terminal 600 . In some embodiments, subsequent to sending the account's credentials via NFC, the electronic device reconfigures to not respond as a contactless payment card (eg, authenticates before being reconfigured to respond as a contactless payment card via NFC) required).

In some embodiments, generation and/or transmission of the signal is controlled by a secure element within the electronic device (eg, 100 , 300 , 500 ). The secure element, optionally, requires certain user input before releasing payment information. For example, the secure element may optionally detect that the electronic device is worn, detect a button press, detect input of a passcode, detect touch, (eg, received while interacting with an application) requires detection of selection of one or more options, detection of a fingerprint signature, detection of a voice or voice command, and/or detection of a gesture or movement (eg, rotation or acceleration). In some examples, if a communication channel (eg, NFC communication channel) with the other device (eg, payment terminal 600 ) is established within a defined period of time from detection of the input, the secure element is activated by the other device (eg, payment terminal 600 ). For example, the payment information to be transmitted to the payment terminal 600 is emitted. In some examples, the secure element is a hardware component that controls the release of secure information. In some examples, the secure element is a software component that controls the release of secure information.

In some embodiments, protocols related to transaction participation depend, for example, on device types. For example, conditions for generating and/or transmitting payment information may be different for a wearable device (eg, device 500 ) and a phone (eg, device 100 ). For example, a create and/or transmit condition for the wearable device includes detecting that a button has been pressed (eg, after security verification), whereas a corresponding condition for a phone does not require a button press and is Instead, it requires the detection of specific interactions with the application. In some examples, the condition for sending and/or emitting payment information includes receiving a particular input on each of the plurality of devices. For example, release of payment information may optionally result in detection of a fingerprint and/or passcode at a device (eg, device 100 ) and mechanical input on another device (eg, device 500 ). Requires detection of (eg, button press).

The payment terminal 600 optionally uses the payment information to generate a signal to send to the payment server 604 to determine whether the payment is authorized. Payment server 604 optionally includes any device or system configured to receive payment information associated with a payment account and determine whether a proposed purchase is authorized. In some examples, payment server 604 comprises a server of an issuing bank. The payment terminal 600 communicates with the payment server 604 directly or indirectly through one or more other devices or systems (eg, a server of an acquiring bank and/or a server of a card network).

Payment server 604 optionally uses at least a portion of the payment information to identify a user account from among a database of user accounts (eg, 602 ). For example, each user account includes payment information. The account is found, optionally by locating an account with specific payment information that matches that from the POS communication. In some instances, payment information provided does not match (eg, an expiration date does not correspond to a credit, debit or gift card number) or no account contains payment information matching that from the POS communication. , payment is refused.

In some embodiments, data for a user account may include one or more restrictions (eg, a line of credit); current or previous balances; the date, place and/or amount of the previous transaction; It further identifies account status (eg, active or frozen), and/or authorization instructions. In some examples, a payment server (eg, 604 ) uses such data to determine whether to authorize a payment. For example, the payment server may cause the account limit to be exceeded due to a purchase amount added to the current balance, if the account is frozen, if the amount of a previous transaction exceeds a threshold, or if the number or frequency of previous transactions exceeds the threshold. If it exceeds, payment will be refused.

In some embodiments, payment server 604 responds to POS payment terminal 600 with an indication as to whether the proposed purchase is authorized or rejected. In some examples, the POS payment terminal 600 sends a signal to the electronic device (eg, 100 , 300 , 500 ) to identify the result. For example, the POS payment terminal 600 may be configured to an electronic device (eg, 100, 300, 500) when a purchase is authorized (eg, via a transaction-coordination server that manages a transaction app on the user device). send the receipt to In some cases, the POS payment terminal 600 presents an output representing the result (eg, a visual or audio output). The payment may be sent to the merchant as part of the authorization process, or it may be sent later.

In some embodiments, the electronic device (eg, 100 , 300 , 500 ) participates in a transaction that is completed without involvement of the POS payment terminal 600 . For example, upon detecting that a mechanical input has been received, a secure element within the electronic device (eg, 100 , 300 , 500 ) releases payment information so that an application on the electronic device accesses the information (eg, and to send information to the server associated with the application).

In some embodiments, the electronic device (eg, 100 , 300 , 500 ) is in a locked or unlocked state. In the locked state, the electronic device is powered and operational, but prevented from performing a predefined set of actions in response to user input. The predefined set of operations optionally include navigation between user interfaces, activation or deactivation of a predefined set of functions, and activation or deactivation of specific applications. The locked state can be used to prevent unintended or unauthorized use of some functions of the electronic device or activation or deactivation of some functions on the electronic device. In the unlocked state, the electronic device 100 is powered and operational and is not prevented from performing at least some of a predefined set of operations that cannot be performed while in the locked state.

When a device is in a locked state, the device is said to be locked. In some embodiments, the device in the locked state optionally responds to a limited set of user inputs, including an input corresponding to an attempt to transition the device to an unlocked state or an input corresponding to powering down the device. respond

In some examples, the secure element (eg, 115 ) is a hardware component (eg, a secure microcontroller chip) configured to securely store data or an algorithm such that the securely stored data is accessible by the device without appropriate authentication information from a user of the device. don't do it Maintaining securely stored data in a secure element separate from other storage on the device means that data stored securely even if other storage locations on the device are compromised (eg, by malicious code or other attempts to corrupt information stored on the device). prevent access to In some examples, the secure element provides (or emits) payment information (eg, account number and/or transaction-specific dynamic security code). In some examples, the secure element performs user authentication (eg, fingerprint authentication; passcode authentication; when the device is in an unlocked state and, optionally, after the device is unlocked by providing authentication credentials to the device) Detecting a double-press of a hardware button while the raw device is still on the user's wrist, wherein the device's continued presence on the user's wrist means that the device is in contact with the user's skin. provide (or emit) payment information in response to receiving an authorization (as determined by periodically checking for For example, the device detects a fingerprint at a fingerprint sensor of the device (eg, a fingerprint sensor integrated into a button). The device determines whether the fingerprint matches the enrolled fingerprint. Upon determining that the fingerprint matches an enrolled fingerprint, the secure element provides (or emits) payment information. Upon determining that the fingerprint does not match the enrolled fingerprint, the secure element withholds providing (or emitting) payment information.

Attention is now directed to embodiments of user interfaces (“UIs”) and associated processes implemented on an electronic device, such as portable multifunction device 100 , device 300 , or device 500 .

7A-7S illustrate an example user for providing educational instructions for registering a biometric feature on an electronic device (eg, device 100 , device 300 , or device 500 ), in accordance with some examples. Interfaces are shown. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIG. 8 .

7A illustrates an electronic device 700 (eg, portable multifunction device 100 , device 300 , or device 500 ). In the illustrative example illustrated in FIGS. 7A-7S , the electronic device 700 is a smartphone. In other examples, electronic device 1500 may be a different type of electronic device, such as a wearable device (eg, smartwatch). The electronic device 700 has a display 702 , one or more input devices (eg, a touchscreen, a button, a microphone of the display 1502 ), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 703 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, one or more of the biometric sensors are disclosed in U.S. Application Serial No. 14/341,860, “Overlapping Pattern Projector,” filed Jul. 14, 2014, which is incorporated herein by reference in its entirety for any purpose. Biometric sensors (eg, facial recognition sensors), such as those described in Published Application No. 2016/0025993, and U.S. Application No. 13/810,451, "Scanning Projects and Image Capture Modules For 3D Mapping," U.S. Patent No. 9,098,931 am. In some examples, the electronic device includes a depth camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR flood light, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the object during capture of an image by a visible light camera and a depth camera (eg, an IR camera), the information from the visible light camera and the depth camera being the information of different parts of the object captured by the visible light camera. It is used to determine the depth map. In some examples, the lighting effects described herein use parallax information from two cameras (eg, two visible light cameras) for back-facing images and front-facing images (eg, selfie images). ) is displayed using depth information from the depth camera combined with image data from the visible light camera for In some examples, the same user interface is used when two visible light cameras are used to determine depth information and when a depth camera is used to determine depth information, dramatically to determine information used when creating lighting effects. It provides a consistent experience for users even when using different technologies. In some examples, while displaying a camera user interface with one of the lighting effects applied, the device detects selection of a camera switching affordance, maintains display of user interface controls for applying the lighting effect, and maintains the front-facing camera Back-facing cameras (eg, two visible light cameras spaced apart from each other) from front-facing cameras (eg, depth camera and visible light camera), replacing the display of their field of view with that of rear-facing cameras (or vice versa) ) (or vice versa).

7A , device 700 displays device setup user interface 702 on display 701 . In some examples, device setup user interface 702 is displayed when device 700 is first powered on by a user (eg, when a factory-sealed device is first powered on). . In some examples, device setup user interface 702 is displayed upon resetting device 700 to factory settings. The phone setup user interface 702 includes one or more prompts 704 . In the example of FIG. 7A , prompt 704 is plain text prompting the user to proceed with initial device setup (eg, language selection, authentication actions, etc.). Device setup interface 702 includes one or more affordances, such as continue affordance 706 and skip affordance 708 . In some examples, in response to detecting a user input corresponding to activation of skip affordance 708 , device 700 , optionally without setup of one or more features, is a primary user interface, such as the user interface of FIG. 4A . is displayed.

As illustrated in FIG. 7B , while displaying the setup interface 702 , the electronic device 700 detects activation (eg, selection) of the affordance 706 to continue. In some examples, the activation is a tap gesture 710 on the contact area 710 at the continue affordance 706 . In some examples where display 700 is a touch-sensitive display, activation of the continue affordance is a touch, swipe, or other gesture on the display surface in contact area 710 . In some examples where display 700 is not touch-sensitive, the user input is keyboard input or activation of continue affordance 706 by a focus selector (eg, a mouse cursor).

Continue In response to detecting activation of affordance 706 , the device displays face authentication instructions interface 712 as shown in FIG. 7C . In some examples, facial authentication setup interface 712 is displayed in response to completing a previous stage of the device setup user interface process, or in response to selecting a facial authentication enrollment option in the settings user interface. The facial authentication setup interface 712 includes one or more prompts 714 , a continue affordance 716 and a later affordance 718 . In the example of FIG. 7C , prompt 714 is plain text indicating that the user has the option to set up facial authentication instead of a numeric passcode. Facial authentication setup interface 712 also includes a graphical representation of the face (eg, biometric authentication glyph 720 ) displayed within framing element 722 . In the example of FIG. 7C , the framing element 722 is rectangular in shape surrounding the biometric authentication glyph 720 , such that only the corners of the rectangle are displayed. In some examples, the framing element is optionally a solid rectangle surrounding the glyph 720 or any other shape (eg, a circle or an ellipse). In some examples, the framing element 722, in combination with the additional features described below, helps indicate to the user how to properly position their face relative to the biometric sensor 703 .

Referring to FIG. 7D , device 700 detects activation (eg, selection) of affordance 716 to continue. In some examples, the activation is a tap gesture 724 at the continue affordance 716 . In some examples where display 701 is a touch-sensitive display, activation of the continue affordance is a touch, swipe, or other gesture on the display surface in contact area 724 . In some examples where display 701 is not touch-sensitive, the user input is keyboard input or activation of continue affordance 716 by a focus selector (eg, a mouse cursor).

In response to detecting selection of the Continue affordance 716 , the device 700 displays a prompt 726 (eg, prompts 726 for display of the prompt 714 ), as illustrated in FIG. 7E . replaced with). Additionally, the device replaces the display of the continue affordance 716 with the start affordance 728 . Continue Upon selection of affordance 716 , device 700 maintains (eg, continues to display) glyph 720 and framing element 722 .

Referring to FIG. 7F , device 700 detects activation (eg, selection) of start affordance 728 . In some examples, activation is tap gesture 730 at start affordance 7728 . Activation of start affordance 728 optionally indicates a user request to initiate a facial authentication registration (eg, setup) process.

7H-7Q , device 700 displays a facial authentication guide interface 732 in response to detecting selection of a starting affordance 728 . At the same time, the device displays an educational animation (eg, an instruction manual) that indicates to the user how to properly position and move his or her face relative to the biometric sensor 703 , such that the device 700 may collect sufficient biometric (eg, facial imaging) data necessary for secure (eg, biometric) authentication. Details of the tutorial interface and training animation are described below.

7G and 7H , device 700 changes the display of framing element 722 to become a single continuous framing element 723 surrounding glyph 720 . 7G , device 700 optionally rounds each corner of framing element 722 into a portion of a circle and merges and/or contracts the portions to form a continuous stream surrounding glyph 720 , as shown in FIG. 7G . Form a circle (eg, framing element 723 as shown in FIG. 7H ).

As shown in FIG. 7H , the device 700 simultaneously displays an education progress meter 734 proximate to and/or surrounding the glyph 720 . In the example of FIG. 7H , educational progress meter 734 is comprised of a set of progress elements (eg, progress scales 734a , 734b , 734c ) distributed evenly around glyph 720 . In the example of FIG. 7H , the progress scales 734a , 734b , 734c are equidistant from and extend radially outwardly from the glyph 720 , for example forming a circle about it. In some examples, these progression elements are optionally points, circles, line segments, or any other suitable discrete elements. In some examples, these progression elements are optionally arranged around the glyph 720 in a square, rectangular, oval, or any other suitable pattern.

While displaying the facial authentication tutorial interface 732 (eg, glyphs surrounded by framing elements 723 and training progress meter 734 ), device 700 may display the user's facial data, as shown in FIG. 7I . Start displaying an educational animation illustrating the process of registering. As will be described in greater detail below with reference to FIGS. 7I-7P , the device 700 implements the glyph 720 in corresponding forward and circular motions of the training progress meter 734 to emulate successful face authentication. ) to display the movement.

At the beginning of the educational animation, device 700 overlays orientation guide 736 on top of display of glyph 720 . In the example of FIG. 7I , orientation guide 736 is a pair of intersecting curves (eg, crosshairs) that extend from framing element 723 and glyph 720 so that they are away from the plane of the display. Make it appear bulging outward (eg in the simulated z-direction). In some examples, in combination with the circular framing element 723 , the arcs of the orientation guide 736 provide a three-dimensional appearance, as if it were located on the surface of a sphere, in an otherwise two-dimensional glyph 720 . to give In general, the educational animation maintains the orientation guide 736 in a fixed position relative to the center of the glyph 720 so that the orientation guide appears rotated or tilted with (eg, in the same direction as) the facial expression. . In some examples, the glyph 720 itself is a three-dimensional representation of a face, such as a three-dimensional line drawing with lines at simulated z-height. In such examples, orientation guide 736 is optionally omitted. In this case, when the facial expression is tilted in different directions, lines at different z-heights appear to move relative to each other based on the simulated parallax effect, giving the appearance of three-dimensional movement.

Device 700 displays movement (eg, rotation and/or tilt) of glyph 720 and orientation guide 736 in a first direction (eg, upward, downward, left, or right) for facial authentication instructions. Start an educational animation on interface 732 . In the example of FIG. 7I , glyph 720 and overlaid orientation guide 736 are tilted right with respect to a vertical axis extending from the plane of display 700 . Tilt glyph 720 in this manner optionally reveals a portion of the simulated face (eg, the left side of the face) and hides another portion of the simulated face (eg, the right side of the face), so that it is tilted or rotated in a particular direction. It additionally gives the appearance of a three-dimensional head.

As illustrated in FIG. 7I , device 700 changes their appearance as glyphs 720 (and/or orientation guides 736 ) are tilted towards a subset of the traveling elements. In particular, the progression elements within the meter portion 738 optionally stretch and/or change color from their initial state when the facial graphics are tilted towards them. This stretching and/or color change is optionally more pronounced as the glyphs 720 are further tilted in their direction. In some examples, the progression elements within the meter portion 738 are optionally and otherwise changed in appearance. For example, additionally and/or alternatively, the line thickness, number, or pattern of running elements is selectively varied. Changing the appearance of the progression elements in this way indicates to the user that the biometric sensor 703 is configured to capture image data of a corresponding portion of the face when oriented in that direction. While displaying the educational animation, the device 700 maintains the display progress elements (eg, elements of the meter portion 740 ) in an initial state for which the facial graphic has not yet been tilted. In the example of FIG. 7I , device 700 displays progress elements in an initial state as unfilled outlines.

In some examples, device 700 then rotates glyph 720 about a second axis parallel to the plane of the display, making the simulated face appear to be tilted upward or downward. In the example of FIG. 7J , the glyph 720 is tilted upward from its position in FIG. 7I , so that the simulated face appears to be facing upwards and to the right. While rotating the glyph 720 in this manner, the device 700 changes the appearance of the corresponding meter portion 740 , which was previously in an initial state, as shown in FIG. 7I . The device changes the appearance of the meter portion 740 (eg, by stretching the progress elements within this portion of the education progress meter and/or by changing its color) in the same manner as described above with respect to FIG. 7I . Simultaneously, device 700 transitions the progression elements in meter portion 738 to the second state, corresponding to the portion of the facial expression that was registered in FIG. 7I . The progression elements in the success state (eg, the progression elements in the meter portion 738 ) differ in shape, color, line width, etc. from the progression elements in the initial state. In the example of FIG. 7I , the progress elements in the success state are displayed with the same size and width as the progress elements in the initial state (eg, the progress elements in the meter portion 742 ), but the facial expression is already oriented in that direction. darkened and/or filled to indicate that

7K illustrates further tilting and/or rotation of the glyph 720 and orientation guide 736 until the simulated face appears to be looking upward. As described above, the device 700 changes its appearance (eg, stretches and/or changes color) as the glyphs 720 are oriented in the direction of the traveling elements within the meter portion 742 . At the same time, device 700 transitions the progression elements in meter portion 740 to a success state since the simulated face was previously there, but is no longer oriented in their direction. Progress elements within meter portion 738 remain in a success state. In general, the appearance of progression elements that have transitioned to a success state is not subsequently modified. In this manner, device 700 changes the appearance of elements within education progress meter 734 in response to displaying movement of glyph 720 .

In some examples, during an educational animation, device 700 optionally displays a full circular (eg, clockwise, counterclockwise) motion of the simulated face (eg, glyph 720 in FIG. 7I ). It continues to display the rotation and/or tilt of the glyph 720 (until it returns to the illustrated right tilted orientation). Likewise, device 700 progressively transitions glyphs 720 to a success state as they rotate past elements of education progress meter 734 , as described above. After displaying the simulated full rotation of the face, the device displays all progress elements of the training progress meter 734 with a success status, as shown in FIG. 7L . In some examples, device 700 stops displaying orientation guide 736 after the full rotation is displayed and returns glyph 720 to its initial position.

After all progress elements of training progress meter 724 have transitioned to a success state, device 700 sets progress meter 734 (eg, the progress meter itself) to an authentication success state, eg, a solid circle surrounding glyph 720 . transfer to Displaying the progress meter 724 with an authentication success status optionally indicates successful face authentication setup. 7L-7O , device 700 shortens each progress tick and merges them together into a continuous solid circle (eg, success status meter 744 ) that surrounds glyph 720 . Transitions the display of the individual progress scales of 734 to the authentication success state. In the example of FIGS. 7O and 7P , the circle moves through the glyph 720 until the radius of the success status meter 744 is substantially equal to the radius of the framing element 723 (eg, as shown in FIG. 7P ). shrink around the perimeter

7I-7Q , the facial authentication guide interface 732 also includes a starting affordance 746 that is optionally displayed throughout the facial authentication guidelines. In some examples, the starting affordance 746 is enabled for activation after the training animation is complete (eg, after the device 700 displays the training progress meter 734 with the authentication success status of FIG. 7Q ). In other examples, the start affordance 746 is enabled for activation at any time during display of the facial authentication instructions animation prior to completion of the training animation.

Referring now to FIG. 7Q , device 700 detects activation (eg, selection) of start affordance 746 . In some examples, the activation is a user input corresponding to a request to initiate face authentication setup. In response to detecting activation of the starting affordance 746 , the device 700 causes a display of the glyph 720 , an image of the user's face captured by the biometric sensor 703 as shown in FIG. 7R . 750) is replaced. In some examples, image 748 is a live preview of the field of view of biometric sensor 703 . In other examples, image 750 is a wire-frame representation of a user's face based on movement of the user's face in the field of view of the light sensors. Accordingly, image 750 changes (eg, continuously updated) as the position and orientation of the user's face with respect to the biometric sensor changes.

7R , device 700 also displays positioning element 752 around user image 750 . In some examples, positioning element 752 optionally has similar or identical visual properties to framing element 722 that was initially positioned surrounding glyph 720 in FIGS. 7C-7F . In some examples, the positioning element is displayed to highlight a predetermined portion of the display of the electronic device to indicate where the user should position his or her face relative to the biometric sensors for subsequent facial authentication setup. . In some examples, the positioning element has a shape (eg, a square) that at least partially partitions the predetermined display portion from other portions of the display. Device 700 also provides prompt 754 , prompting the user to move his/or her face relative to the light sensors so that user image 750 is visible inside positioning element 750 . Display text.

Referring now to FIG. 7S , in response to detecting that the user image 750 has been properly positioned within the positioning element 750 (eg, the user's face is properly aligned with the biometric sensor 703 ), the device 700 displays face authentication registration interface 756 . In the example of FIG. 7S , the face authentication registration interface 756 includes a progress meter 758 and a user image 760 . In some examples, registration interface 756 includes orientation guide 762 , ie, a set of curves (eg, crosshairs) that appear to extend out of the plane of the display. Progress meter 758 optionally has some or all of the features of training progress indicator 734 displayed during facial authentication tutorial animation. In the example of FIG. 7S , progress meter 758 also includes a set of progress elements (eg, progress scales 758a , 758b , 758c ) distributed around user 750 . Further description of alignment of a user's face with respect to light sensors can be found below with reference to FIGS. 9A-9A and 11A-11O .

8A-8C are flow diagrams illustrating a method for providing instructional instructions for registering a biometric feature on an electronic device, in accordance with some examples. Method 800 includes a device having a display, one or more input devices (eg, a touchscreen, microphone, camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 700). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, the method 800 provides an intuitive method for providing educational instructions for registering a biometric feature on an electronic device. This method reduces the user's cognitive burden of registering biometric features on the device, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to register a biometric feature faster and more efficiently saves power and increases the time between battery charges.

The device displays (802) a first user interface (eg, facial authentication setup interface 712) on the display. While displaying the first user interface, the device detects ( 806 ) the occurrence of a condition corresponding to the introduction of a biometric registration process for registering a biometric feature (eg, face, finger, eye, voice, etc.). In some examples, the occurrence of the condition is an input corresponding to a request to initiate a biometric enrollment process, such as ending a previous stage of the device setup user interface process or selecting a biometric enrollment option in a setup user interface. In some examples, the biometric feature is used for authentication in the device.

In response to detecting the occurrence of a condition corresponding to the introduction of the biometric enrollment process, the device displays ( 808 ) a biometric enrollment introduction interface (eg, facial authentication instructions interface 732 ). Displaying the biometric registration introduction interface includes a representation of the simulation of the biometric feature (eg, 720, a video of the biometric feature or animation of the biometric feature such as an animated face/head) and a simulated progress indicator (eg, and concurrently displaying (810) an education progress meter (734), a displayed element indicating progress of registration. In some examples, the simulated progress indicator is positioned proximate to the representation of the simulation of the biometric feature. In some examples, the simulated progress indicator is a plurality of progression elements (eg, progression elements 734a, 734b, 734c) selectively distributed around the simulation of the biometric feature, such as outward from the simulation of the biometric feature. and a set of graduation marks that extend (eg, extend radially) and form an elliptical shape, such as a circle.

In some examples, the representation of the simulation of the biometric feature is (eg, 720 ) a representation of a simulation of at least a portion of the face ( 812 ). In some examples, the representation is a representation of a simulation of a portion of a face. In some examples, the representation is a representation of a simulation of the entire face. In some examples, the simulation of the biometric feature is a representation of a generic face, such as a line drawing, including eyes, nose, and mouth. In some examples, the representation of the simulation of the biometric feature is a three-dimensional representation ( 814 ). For example, a simulated representation of a biometric feature is a three-dimensional rendered object. Alternatively, the educational animation is optionally, instead, a 2D animation.

In some examples, the simulation representation of the biometric feature is a line drawing (eg, a 3D representation of 720 ) with lines at different simulated z-heights ( 816 ). For example, when a line drawing of a face is tilted in different directions, lines at different simulated z-heights appear to move relative to each other based on the simulated parallax effect. In some examples, the biometric registration introduction interface is overlaid on the representation of the simulated biometric feature (eg, 720 ) and tilted in different directions as the representation of the simulated biometric feature is tilted in different directions. an orientation guide (eg, orientation guide 736 , a curve that curves backward in the simulated z-direction, as described in greater detail below with reference to method 1200 ) ( 820 ).

While displaying the biometric enrollment introduction interface, the device may be configured to move (eg, tilt and/or rotate) the representation of the simulation of the biometric feature and incrementally advance the progress indicator (eg, progress elements of the progress indicator are the biometric feature). (e.g., advancing and 720 of training progress indicator 734 shown in FIGS. movement of ) is displayed (824). Displaying an educational animation including movement of the simulated representation of the biometric feature and incremental advancement of the simulated progress indicator is first performed with appropriate Illustrating user inputs and thus helping the user intuitively recognize how to register their biometric features quickly and properly, the need for the device to display biometric enrollment interfaces (eg, 756) during this process It reduces the duration of which is and reduces the number of user inputs performed in such interfaces. Reducing the number and time of inputs required to perform the registration operation may improve the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device). and make the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device displays ( 826 ) movement that tilts the simulation of the biometric feature relative to the plane of the device's display. For example, movement of the representation of the simulation includes rotation of the representation of the simulation along an axis perpendicular to the plane of the display of the device. In some examples, the tilt of the biometric sensor and/or sensor with respect to the field of view defines a plane of the display. In another example, the device rotates the representation of the simulation of the biometric feature about a first axis (eg, an axis perpendicular to the display 700 ) and a second axis (eg, the display 700 ) different from the first axis. ) displays a movement that rotates the representation of the simulation of the biometric feature about an axis in the plane of ( 828 ). In some examples, the first axis is a vertical axis, such that movement of the representation is from left to right and/or right to left. In some examples, the first axis is perpendicular to the second axis. For example, the second axis may optionally be a horizontal axis, allowing movement of the representation to occur downwards and/or upwards. In some examples, the first axis is any axis other than an axis perpendicular to the display of the device (eg, the representation rotates in any direction), and the second axis is an axis perpendicular to the display of the device. In this example, the simulated head optionally moves in a circular pattern about a second axis. Displaying movement tilting the simulation of the biometric feature with respect to the plane of the display first illustrates the appropriate user inputs required for a subsequent biometric enrollment process (eg, method 1200 and/or 1400 ), so that the user Helping intuitively recognize a way to register their biometric features quickly and properly, reducing the duration a device needs to display biometric enrollment interfaces (eg, 756) during this process and using such interfaces Reduce the number of user inputs performed in Reducing the number and time of inputs required to perform the registration operation may improve the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device). and make the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, when displaying the educational animation, the device can optionally be configured to reveal a first portion of the representation (eg, a first side of 720 ) and not reveal a second portion of the representation (eg, a second different side of 720 ). Display ( 830 ) a representation of the simulation of the biometric feature at the first location. Subsequently, the device optionally displays a representation of the simulation of the biometric feature at a second location different from the first location to reveal a second portion of the representation and not to reveal the first portion of the representation. In an example where the biometric feature is a face, the simulated face is optionally tilted in a first direction to reveal a first portion of the simulated face, and then tilted in a second direction to reveal a second portion of the simulated face. lose Displaying the simulated biometric feature in a first orientation and subsequently displaying the simulated biometric feature in a second different orientation is first required for a subsequent biometric enrollment process (eg, methods 1200 and/or 1400 ). Illustrating appropriate user inputs, thereby helping the user intuitively recognize how to quickly and properly register their biometric features, the device will display biometric registration interfaces (eg, 756) during this process. It reduces the required duration and reduces the number of user inputs performed in such interfaces. Reducing the number and time of inputs required to perform the registration operation may improve the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device). and make the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device displays a simulated progress indicator (eg, 734 ) surrounding a representation of the simulation of the biometric feature (eg, 720 ). For example, the simulated progress indicator is displayed such that the simulated progress indicator surrounds (or substantially surrounds) part or all of the representation of the simulation of the biometric feature. In some examples, the simulated progress indicator centers the representation of the user's biometric feature. In some examples, displaying the simulated progress indicator includes a plurality of progression elements (eg, dots, circles, or line segments, eg, proximate to the representation of the simulation of the biometric feature (eg, facial graphic 720 )). and displaying ( 832 ) progress scales ( 734a , 734b , 734c ). In some examples, the progression elements are equidistant from the representation and/or extend radially outward from the representation. In some examples, the progression elements are arranged in a circular, square, rectangular, or oval pattern.

In some examples, upon displaying the incremental advancement of the simulated progress indicator, the device transitions ( 834 ) one or more progress elements of the plurality of progress elements from a first state to a second state different from the first state. For example, in a first state, the proceeding elements are optionally of a first color and/or of a first length, and in a second state, the proceeding elements are optionally of a second color and/or different from the first color of a second length different from the first length. In some examples, the progression elements are optionally and otherwise changed in appearance. For example, the progression elements are selectively varied in line thickness, number, pattern, and the like. Changing the display of portions of the simulated progress indicator allows the user to recognize that changes in the orientation of the simulated biometric feature illustrated in the educational animation are required to properly register his/or her biometric features. make it This first helps to illustrate the appropriate user inputs required for a subsequent biometric enrollment process (eg, method 1200 and/or 1400 ) so that the device will display biometric enrollment interfaces (eg, 756 ) during this process. It reduces the required duration and reduces the number of user inputs performed in such interfaces. Reducing the number and time of inputs required to perform the registration operation may improve the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device). and make the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the representation of the simulation of the biometric feature is a line drawing that includes at least a portion (eg, some or all) of a glyph (eg, success status progress meter 744 ) used to indicate successful biometric enrollment. is (836). In some examples, one or more progress elements of the simulated progress indicator are all updated to a second state (eg, green and elongated, or the state of meter portion 738 in FIG. 7J ) and not subsequently modified. In some examples, when each of the progress elements has been updated to the second state, the simulated progress indicator transitions to a success state (eg, a success state progress meter 744 ). In some examples, transitioning the simulated progress indicator to the success state includes transitioning the simulated progress indicator to a solid circle surrounding the representation of the simulation of the biometric feature.

After displaying at least a portion of the educational animation, the device detects ( 838 ) the occurrence of a condition corresponding to initiation of the biometric enrollment process. In some examples, the condition corresponding to initiation of the biometric enrollment process includes ( 840 ) selection of an affordance to initiate the biometric enrollment process. For example, a condition may be in an input (eg, in contact area 748 ) corresponding to a request to “start registration”, such as a “start registration” or a tap on a “next” affordance (eg, start affordance 746 ). user input) and, optionally, subsequent biometric features of the user to align with one or more biometric sensors. A more detailed description of the biometric enrollment process is described in greater detail herein with reference to method 900 . In some examples, the electronic device provides a tactile output and/or an audible output in response to selection of the affordance.

In response to detecting ( 842 ) the occurrence of a condition corresponding to initiation of the biometric enrollment process, the device is configured to respond to a representation of the simulation of the biometric feature in the biometric enrollment introduction interface (eg, facial authentication instructions interface 732 ). a representation of the user's biometric feature as determined by one or more biometric sensors of the device (eg, user image 750 , user's face, user's fingers, user's eyes, user's hand) is displayed (844). In some examples, the device optionally displays an enrollment progress user interface (eg, 756) after the representation of the user's biometric feature (eg, 750, 760) is aligned with one or more biometric sensors (eg, 703) do.

In some examples, the representation is a representation of a portion of the user's face (eg, a portion of the user image 750 ) ( 846 ). In some examples, the representation is a representation of the user's entire face. In some examples, the representation of the user's biometric feature is the user's representation specific to the user. For example, the user's representation is a wireframe or images of the user's face that match the contours of the user's face.

In some examples, the biometric enrollment user interface includes 848 an orientation guide (eg, orientation guide 736 , orientation guide 762 ) overlaid on a representation of the biometric feature (eg, user image 750 ) ). The orientation guide is optionally tilted as the biometric feature is tilted in different directions. Displaying the orientation guide moving with the user's biometric feature provides the user with feedback regarding the orientation of his or her biometric features relative to the device's biometric sensors in three-dimensional space, Allows a user to more quickly place his or her biometric features in appropriate orientations during a subsequent registration process (eg, method 1200 and/or method 1400 ). Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the representation (eg, 750) of the user's biometric feature is based (850) on image data captured by one or more cameras (eg, 703) of the electronic device. For example, the representation of the user's biometric feature is optionally based on successive images of the user captured by one or more cameras (eg, 703 ), or movement of the user's features in the field of view of the one or more cameras. It is a wire frame that In some examples, the representation of the biometric feature changes ( 852 ) as the orientation of the biometric feature with respect to one or more biometric sensors changes. Updating the orientation of the displayed representation of the biometric feature provides the user with feedback regarding the orientation of his or her biometric features relative to the device's biometric sensors so that the user can follow the registration process (eg, method during ( 1200 ) and/or method ( 1400 ) to more quickly place his or her biometric features in appropriate orientations. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In response to detecting the occurrence of a condition corresponding to the initiation of the biometric enrollment process, the device may also include a simulated progress indicator (eg, a biometric such as a plurality of progress elements distributed around the representation of the user's biometric feature). Display ( 854 ) a progress indicator (eg, 756 ) corresponding to a progress indicator having some or all of the features of the progress indicator displayed surrounding the simulation of the feature. In some examples, displaying the progress indicator includes maintaining display of the simulated progress indicator ( 856 ). For example, the simulated progress indicator returns to an initial state (eg, the state of progress elements 734a , 734b , 734c in FIG. 7H ) and is used to indicate incremental enrollment progress of the simulated biometric feature. used to indicate the user's incremental registration progress in the same or similar manner as Displaying a registration progress indicator corresponding to (eg, similar to) the simulated progress indicator allows the user to indicate changes in the orientation of the simulated biometric feature and corresponding advance of the simulated progress indicator illustrated during the educational animation. to quickly associate with the appropriate inputs required during a subsequent registration process (eg, method 1200 and/or 1400 ). This in turn allows the user to complete the enrollment process more quickly, reducing the duration the device needs to display biometric enrollment interfaces (eg, 756) during this process and the user input performed at those interfaces. reduce their number. Reducing the number and time of inputs required to perform the registration operation may improve the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device). and make the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device displays ( 858 ) a progress indicator (eg, 758 ) surrounding a representation (eg, 760 ) of the user's biometric feature. For example, the progress indicator optionally has some or all of the features of the progress indicator displayed surrounding the simulation of the biometric feature. These features optionally include a plurality of progression elements (eg, 758a, 758b, 758c) distributed around the representation of the user's biometric feature. For example, the progress indicator is displayed such that the progress indicator surrounds (or substantially surrounds) some or all of the representation of the user's biometric feature. In some examples, the progress indicator centers the presentation of the user's biometric feature.

In some examples, in response to detecting the occurrence of a condition corresponding to initiation of the biometric enrollment process, the device displays ( 860 ) a positioning element (eg, positioning element 752 ) on a display of the electronic device. . In some examples, the positioning element is displayed to highlight a predetermined portion (eg, 756 , 758 ) of the display of the electronic device. In some examples, the positioning element indicates where the user should position the representation (eg, 750 ) of the user's biometric feature for subsequent biometric feature registration. In some examples, the positioning element is an object that visually at least partially partitions first and second portions of the display (eg, display portion 756 and display portion 758 ). The positioning element is, in some examples, square-like in shape and is optionally segmented. Displaying a positioning element framing a particular portion of the digital viewfinder allows the user to ensure that the position and/or orientation of his or her biometric features within the field of view of the biometric sensor is followed by a biometric enrollment process (eg, a method (1200 and/or 1400)), allowing the user to more quickly place his or her biometric features in the proper orientation. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

Note that the details of the processes described above with respect to method 800 (eg, FIGS. 8A-8C ) are also applicable in a similar manner to the methods described below. For example, method 800 optionally includes one or more of the features of various methods described below with reference to methods 1000, 1200, 1400, 1600, 1800, 2000, 2200, 2500, 2700. do. For another example, the orientation guide described in method 1200 may be applied in connection with an educational animation displayed on a face authentication tutorial interface (eg, 732 ). For another example, one or more aspects of biometric enrollment described in method 1200 may be applied in connection with an enrollment interface (eg, 756 ). For another example, one or more aspects of the hints described in method 1400 may be applied to display of a facial authentication guide interface (eg, 732 ).

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 8A-8C are, optionally, implemented by the components shown in FIGS. 1A and 1B . For example, display operation 802 , detect operation 806 , display operation 810 , display operation 824 , detect operation 838 , display operation 844 , and display operation 854 can optionally , event classifier 170 , event recognizer 180 , and event handler 190 . Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates the event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

9A-9A illustrate educational instructions for registering a biometric feature on an electronic device (eg, device 100 , device 300 , device 500 , or device 700 ), in accordance with some examples. Example user interfaces are illustrated. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIG. 10 .

9A illustrates an electronic device 900 (eg, portable multifunction device 100 , device 300 , device 500 , or device 700 ). In the illustrative example illustrated in FIGS. 9A-9A , the electronic device 900 is a smartphone. In other examples, the electronic device 900 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 900 has a display 901 , one or more input devices (eg, a touchscreen of the display 901 , a button, a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 903 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the one or more biometric sensors 903 are one or more biometric sensors 703 . In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

As illustrated in FIG. 9A , device 900 displays a face authentication introduction interface 905 . In some examples, face authentication introduction interface 905 is similar to face authentication tutorial interface 732 described above with respect to FIG. 7S . As an example, the face authentication introduction interface 905 includes a face graphic 902 , which is optionally the same as or similar to the glyph 720 described above with respect to the face authentication tutorial interface 732 . Additionally or alternatively, device 900 also optionally displays a success status education progress meter 907 , which is optionally the same as or similar to success status training progress meter 744 in FIGS. 7P and 7Q . Do. The face authentication introduction interface 905 also includes a start button 904 (eg, a start affordance). As shown in FIG. 9A , device 900 detects activation (eg, selection) of start affordance 904 . For example, activation is optionally a user input at contact area 906 on starting affordance 904 . Such user input will, in some circumstances, correspond to a request to initiate face authentication setup (eg, start face registration).

In some examples, in response to detecting the user selection of the start button 904 , the device 900 displays a facial alignment interface 908 as shown in FIG. 9B . The facial alignment interface 908 includes a positioning element 910 , which, in some examples, is a framing circle or bracket that represents an alignment boundary. In some examples, positioning element 910 identifies an inner display portion 912 and an outer display portion 912 . In some examples, the electronic device determines that the user's biometric feature is properly aligned when positioned substantially within the interior display portion 912 in a predetermined manner. In some examples, positioning element 910 partitions inner display portion 912 from outer display portion 914 . Generally, when a user's face is positioned relative to the biometric sensor 903 such that a portion of the user's image is visible on the external display portion 914 , the user's face, in some situations, is properly aligned with the cameras. it won't be As such, the face alignment interface 908 also provides a text prompt 916 instructing the user to position his or her face inside the positioning element 910 (eg, within the interior display portion 812 ). ) is included.

Referring to FIG. 9C , in some examples, during the alignment process, the user positions the electronic device 900 substantially in front of the user's face 917 . In some examples, the user holds the device 900 at approximately the same height as his or her face, such that the face is in the field of view of the biometric sensor 903 .

As illustrated in FIG. 9D , once the user has initiated the alignment process, the device displays the facial alignment interface 908 (recall that the user optionally initiates the registration process by activating affordance 904 ). . The facial alignment interface 908 includes a digital viewfinder that presents a preview of the image data captured by the biometric sensor 903 . In some examples, the preview of image data is continuously updated (eg, as the field of view of these cameras changes (eg, when device 900 is moved or a user moves closer to/far from the cameras) , which changes over time) is a live preview. The digital viewfinder includes an image of a user's face 918 as well as a positioning element 910 that is superimposed on the cameras' field of view. As described above, the positioning element 910 partitions the inner display portion 912 from the surrounding outer display portion 914 . To provide additional visual separation between the inner display portion 912 (where the user facial image 918 is to be positioned) and the outer display portion 914, device 900, as shown in FIG. 9D , Visually obscures (eg, shades, darkens, or blurs) the outer display portion 914 .

In general, proper registration of a user's facial features for authentication requires that the user's face be positioned in a predetermined manner and/or be within a predetermined range of distances from the cameras of the device 900 . In some examples, alignment of the user's face with the cameras of device 900 requires that the user is neither too close to the device nor too far from the device. Accordingly, if the electronic device 900 determines that the user's face is too close or too far away, the electronic device will ask the user to position their face at an acceptable distance (eg, 20-40 mm) from the device 900 . Display a text prompt 920 instructing to do so within the face alignment interface 908 . In the example of FIG. 9D , device 900 detects that the user's face is too far from the cameras on the device (eg, user face image 918 is within positioning element 910 , but internal display portion 912 ) is not substantially filled). In some examples, the electronic device prompts the user to move his or her face closer to the device. In some examples, the device outputs one or more outputs, such as an audio output 922 (eg, a series of beeps or other audio output) and a tactile output 924 (eg, a series of vibrations or other tactile output). output) to notify the user of improper alignment. In some examples, the audio output 922 and/or the tactile output 924 has a size and repetition rate (eg, frequency) that varies based on the distance between the device 900 and the user's face. For example, the output frequency and/or magnitude is optionally increased as the user's face moves closer to an acceptable range of distances (eg, 20-40 mm) from the device. Conversely, the frequency and/or magnitude of the output is optionally reduced as the user's face moves further away from an acceptable range of distances. In this case, the device 900 , the frequency and/or magnitude of the audio output 922 and/or the tactile output 924 as it detects changes in the distance between the user's face and the biometric sensor 903 . continues to change (eg, update). In some examples, device 900 provides these outputs as long as the user's face is outside an acceptable range of distances from the device. In some examples, audio output 922 and tactile output 924 accompany corresponding visual output on display 700 . These ongoing audio, tactile and/or visual outputs optionally provide intuitive hints as to how the user correctly aligns his or her face with cameras, reducing the time required to perform successful face alignment. reduce

9E illustrates the face alignment interface 908 when the user's face is positioned closer to the device 900 (eg, a significant portion of the user's face image 918 is within the external display portion 914 ). In this case, the alignment interface 908 also includes a text prompt 920 instructing the user to position his or her face at an acceptable distance from the device 900 . In some examples, the electronic device instructs the user to move his or her face closer to the device. As described above with respect to FIG. 9D , device 900 may optionally generate an ongoing audio output 922 and/or tactile output ( 924) is created. In particular, device 900 changes the frequency and/or magnitude of these outputs as it detects changes in the distance between the user's face and the cameras.

9F illustrates the face alignment interface 908 when the user's face is positioned at an acceptable distance from the device 900 but is out of frame (eg, too far to the right or left). For example, face 918 is optionally positioned such that a substantial portion of face 918 lies outside of positioning element 910 within outer display portion 914 . In this case, device 900 may optionally instruct the user to position his or her face within positioning element 910 (eg, such that user image 918 is displayed within interior display area 912 ). displays a text prompt 926 on the sorting interface 908 .

9G-9L , in some examples, the electronic device 900 displays the facial alignment interface 908 in response to determining that the user's face is positioned outside a range of predetermined angles with respect to the electronic device. . As shown in FIG. 9G , the electronic device 900 is positioned at a low angle relative to the electronic device (eg, the electronic device) such that the electronic device cannot properly obtain (eg, capture biometric data). is aligned with the user's chin). Referring to FIG. 9H , in response to determining that the electronic device 900 is outside the range of predetermined angles, the electronic device 900 performs a facial alignment interface, such as an inner display portion 912 and an outer display portion 914 . Blur at least part of (908). In some examples, the electronic device instructs the user to position his or her face within positioning element 910 (eg, such that user image 918 is displayed within interior display area 912 and at an appropriate angle) A prompt 986 is additionally output. 9I and 9K , the user raises the device 900 until the electronic device is within a predetermined range of angles. As the user raises the electronic device, referring to FIGS. 9J and 9K , the electronic device 900 progressively reduces the blurring of the displayed elements. In this way, the electronic device indicates to the user that the angle of the electronic device with respect to the user is approaching an acceptable range of angles. In some examples, the electronic device is too high relative to the user such that the electronic device is not within a predetermined range of angles. Similar to the example described, the electronic device optionally reduces or increases the blurring of displayed objects as the electronic device is moved relative to the user.

In some examples, if the device detects that the alignment error persists for a predetermined amount of time, device 900 optionally configures accessibility option affordance 928 on face alignment interface 908 , as shown in FIG. 9G . ) is displayed. For example, device 900 may optionally include a user face at an acceptable distance from the device and/or within a positioning element at a predetermined time after it begins alignment (eg, after start button 904 is selected). If it does not detect the accessibility option affordance 928 is displayed. In some examples, the predetermined time is optionally 10 seconds, 15 seconds, 30 seconds, or any other suitable time. Similarly, device 900 optionally displays an accessibility option affordance after a predetermined number of failed registration attempts. As discussed in more detail below, device 900 optionally displays additional options or hints in response to detecting selection of accessibility option affordance 928 and/or initiates alternative face registration processes. do. In some examples, activation of accessibility option affordance 928 allows the user to proceed with biometric enrollment without first correcting for alignment error.

In general, the quality of facial feature registration for the facial authentication methods described herein depends, at least in part, on the lighting conditions in which the user's facial data is captured. For example, strong backlighting or direct exposure of the user's face will, in some circumstances, adversely affect the quality of the registration. Referring now to FIG. 9H , in response to detecting adverse lighting conditions, device 900 optionally displays on alignment interface 908 a text prompt 930 indicating adverse lighting to the user. Text prompt 930 optionally accompanied by audio, visual and/or tactile output 932 . Output 932 is optionally identical to output 922 and/or 924 described with respect to the alignment errors discussed above. In some examples, the outputs are error-specific; Accordingly, output 932 may optionally be a different audio, visual, and/or tactile output than outputs 922 , 924 .

In general, the quality of facial feature registration also depends in part on the angle at which the user's face is oriented relative to one or more cameras of device 900 (eg, biometric sensor 903 ). In particular, the one or more optical sensors of the device 900 should be able to capture image data of the user's face at a specific angle or within a predetermined range of angles. Even if the user's face is within the acceptable range of distances described above, facial authentication registration may be adversely affected if device 900 is positioned too far above or below the user's face. Accordingly, in some examples, device 900 requires that the user's face be positioned within a predetermined range of angles with respect to one or more of its cameras upon detecting successful alignment conditions.

In some examples, the device 900 , the image displayed in the digital viewfinder of the alignment interface 808 , in response to detecting that the user's face is outside this predetermined range of angles with respect to the biometric sensor 903 . Blur the data. In some examples, the amount of blur optionally depends on a difference between a detected angle of elevation of the user's face relative to the camera and one or more threshold angles bounding a predetermined range of angles. For example, device 900 blurs the preview image to a greater extent the higher or lower the device 900 is positioned relative to the user's face. When device 900 detects a change in elevation that brings its cameras into closer alignment with the user's face, it optionally reduces the amount of blur as the elevation changes (eg, with a continuous gradient). . In some examples, the preview image is not blurred when the elevation angle between the device 900 and the user's face is actively changing (eg, the user is moving the device 900 relative to his or her face). The blur may optionally indicate that the angle between the user's face and one or more of its cameras was outside a predetermined range of angles for a set period of time (eg, 1 second, 2 seconds, 5 seconds, or any suitable period of time). ) is delayed until a decision is made. In some examples, only a portion of the preview image (eg, external display portion 914 ) is blurred, while in other examples the entire preview image is optionally blurred. Blurring the preview image in this way optionally prompts the user to more quickly position the device 900 at a desired angle with respect to his or her face, reducing the time spent during the alignment process. In some examples, device 900 optionally issues a tactile and/or output to inform the user that his or her face is positioned at a suitable angle relative to biometric sensor 903 .

In FIG. 9N , the user's face is properly positioned relative to the biometric sensor 903 . In this case, face 918 is displayed substantially within alignment element 910 and inner display portion 912 . 9N , face 918 also occupies a significant portion of interior display portion 912 , indicating that the user's face is within a threshold range of distances from device 900 . In response to detecting a face that meets the alignment criteria described above, device 900 issues an audio output 934 and a tactile output 936 to indicate successful alignment of the user's face with the cameras. In general, outputs 934 , 936 are different from outputs 922 , 924 , 932 issued in response to detecting alignment errors. In some examples, device 900 captures and stores one or more images of a user's face upon successful alignment with cameras.

In some examples, after detecting successful alignment, device 900 visually highlights inner display portion 912 in which face 918 is displayed. In the example of FIG. 9P , the device 900 continues to display the portion of the digital viewfinder preview on the inner display portion 914 (eg, inside the positioning element 910 ) while the outer portion of the digital viewfinder preview. Further obscuring the external display portion 914 by further blurring or blacking the image in In some examples, device 900 further visually highlights the content of interior display portion 912 by enlarging or zooming in on an image within interior display portion 912 .

In some examples, the device further emphasizes the interior display portion 912 by changing the appearance of the positioning element 910 . In particular, the device 900 may optionally "round" the corners of the alignment element as shown in FIG. 9P and/or make the corners of the alignment element 910 as shown in FIG. 9Q face 918. Changes the appearance of the alignment element by merging it into a surrounding circular positioning element 941 .

Referring now to the example of FIG. 9R , in response to detecting that the user's face is oriented such that the alignment criteria described above are met, device 900 displays a face registration interface 938 (eg, alignment interface 908 ). ) by replacing the display of the face registration interface 938) to initiate the face authentication registration process. In some examples, face registration interface 938 has similar or the same visual characteristics as face authentication registration interface 756 described above with respect to FIG. 7S or registration interface 1104 described below with respect to FIG. 11A . In the example of FIG. 9R , face registration interface 938 includes a user face image 939 displayed within positioning element 941 . In the example of FIG. 9R , user facial image 939 is a live preview of image data captured by biometric sensor 903 . The face registration interface 938 also optionally includes a registration progress meter 940 surrounding the user face image 939 and the positioning element 941 . As described above with respect to FIGS. 7S and 11A-11H , registration progress meter 940 includes progress elements that extend radially outward from user face image 939 and, in some examples, surround it in a circular pattern. (eg, 940a, 940b, and 940c). The face registration interface 938 optionally includes an orientation guide 942 . In some examples, the orientation guide includes a set of curves (eg, crosshairs) that appear to extend out of the plane of the display 901 in a virtual z-dimension, intersecting above the center of the user's face image 939 . In some examples, the orientation guide provides a sense of a three-dimensional orientation of the user's face even though the facial image 939 is two-dimensional. In this case, the orientation guide 942 assists the user in the face registration process by making more visually apparent the rotation and/or tilt of the user's head relative to the device 900 . The face registration interface 938 also includes a text prompt 944 that optionally instructs the user to begin tilting their head, eg, in a circle, to perform registration.

Generally, once the registration process is initiated, the quality of registration is reduced if the device 900 moves too much relative to the user's face (eg, while the user moves slowly and rotates/tilts his or her face, the device must remain stationary). In the example of FIG. 9S , device 900 detects excessive movement of the user's one or more cameras with respect to the face. This excess movement is optionally a significant change in the position and/or orientation of the user's face relative to the device 900 consistent with the movement of the device itself, which prevents reliable alignment and/or registration. In response, device 900 displays registration interface 938 a visual prompt 946 instructing the user to reduce movement of the device (eg, prompting the user to keep the device stationary during the registration process). issued on the Device 900 also optionally simultaneously generates visual and/or audible output 948 . In some examples, movement of the device itself is measured by accelerometer 168 rather than biometric sensor 903 . The movement of the device is also optionally measured by a magnetometer, an inertial measurement unit, or the like of the device 900 .

Successful registration typically requires that alignment of the user's face with respect to the cameras on device 900 be maintained throughout the registration process. Accordingly, in some examples, device 900 optionally ends the face registration process if more than one alignment errors are detected during registration. In some examples, if, during the enrollment process, device 900 detects one or more alignment errors, the electronic device terminates the enrollment process (eg, stops displaying face enrollment interface 938 ), and optionally the device initiates (eg, transitions to) an alignment process that displays alignment interface 908 - 2 . In the examples of FIGS. 9T and 9U , alignment interface 908 - 2 and components thereof optionally have similar or identical visual properties as initial alignment interface 908 described above with respect to FIGS. 9B-9O . In the example of FIGS. 9T and 9U , device 900 has determined that the user's face is out of frame and, as a result, device 900 is internal, out of place compared to the successful alignment shown in FIG. Display the user face image 918 - 2 in the display portion 912 - 2 . In some examples, the device outputs an indication of an alignment error, such as a text prompt 950 indicating that the user face image 918 - 2 is not properly aligned within the positioning element 910 . This example is merely illustrative. In some examples, the alignment error is optionally a failure to meet any of the other alignment criteria discussed above (eg, distance from device, orientation angle, adverse lighting, etc.). In such a case, the text prompt 950 instructs the user to move the device and/or their face to an acceptable range of distances or to correct the orientation angle. In some other examples, the alignment error is optionally different from the above criteria such that a small change in alignment will not cause the device to terminate the face registration process. In response to detecting the one or more alignment errors, the device reveals the portion of the image preview displayed on the outer display portion 914 - 2 and displays the positioning element 910 - 2 , as shown in FIG. 9U . Visually de-emphasize the display portion 912-2. For example, device 900 illuminates or unblurs the preview image in external display portion 914 - 2 to help the user realign their face relative to biometric sensor 903 . In the example of FIG. 9U , de-emphasizing inner display portion 912 - 2 indicates that a significant portion of user facial image 918 - 2 is positioned within outer display portion 914 - 2 , positioning element 910 - 2 . It reveals that it is positioned outside of .

In some examples, device 900 again detects that the user's face is properly aligned with biometric sensor 903 . In response, device 900 outputs audio output 934-2 and/or tactile output 936-2 indicating successful alignment. In some examples, audio output 934-2 and tactile output 934-6 have properties similar to audio output 934 and tactile output 936, respectively, as described with reference to FIG. 9O , respectively. . In some examples, device 900 then resumes the registration process. For example, device 900 may display interior portion 912-2 and facial image ( 918-2) is emphasized. In some examples, device 900 resumes the registration process at the point at which the electronic device detected an alignment error (eg, face registration interface 938 may display an advanced registration progress meter to the same state as when an alignment error was detected) 940)).

In some examples, if the device does not detect that the proper alignment has been established (eg, re-established) within a predetermined period of time, the device 900 responds to an accessibility option affordance 928-2, as shown in FIG. 9V . ) is displayed. In some examples, accessibility options provide an option to proceed with the registration process without all alignment conditions being met, as described below. In some examples, the accessibility options provide an option to set up biometric (eg, face) authentication with partial registration only (eg, scan of only a portion of the user's face).

In response to detecting activation (eg, selection) of accessibility option button 928 - 2 (eg, by tap gesture 952 ), the device activates accessibility registration interface 954 , as illustrated in FIG. 9W , ) is displayed. One or more features of accessibility registration interface 954 have similar or identical visual characteristics as corresponding features of registration interface 938 . For example, in FIG. 9W , face registration interface 954 includes user face image 939 - 2 displayed within positioning element 941 - 2 . In some examples, user facial image 939 - 2 is a live preview of image data captured by biometric sensor 903 - 2 . Accessibility registration interface 954 also optionally includes registration progress meter 940-2 surrounding positioning element 941-2 and user face image 939-2. 7S and 11A-11H , registration progress meter 940 - 2 extends radially outward from user face image 939 - 2 and in some instances surrounds it in a circular pattern. is composed of a set of progression elements (eg, 940-2a, 940-2b, and 940-2c). Accessibility registration interface 954 optionally includes an orientation guide 942-2. In some examples, the orientation guide includes a set of curves (eg, crosshairs) that appear to extend out of the plane of display 901 in a virtual z-dimension, intersecting over the center of user facial image 939 - 2 . do. Like face registration interface 938 , accessibility interface 954 optionally includes a text prompt (eg, prompt 956 ) that provides written instructions for successfully completing the registration process. In some examples, the accessibility registration interface 954 also includes a completion affordance 956, the activation of which causes the user to complete the registration process and proceed to set up facial authentication using only partial scans of their facial features. do. In some examples, partial scandal serves a user with a condition that, in some circumstances, prohibits the user from tilting his or her head in all directions other than the one required for registration.

In response to activation (eg, selection) of completion affordance 956 (eg, by user input 958 shown in FIG. 9X ), the device displays face registration confirmation interface 960 , illustrated in FIG. 9Y . . The face registration confirmation interface includes, in the example of FIG. 9Y , a face image 939 - 3 with visual characteristics similar to the user face image 939 - 2 . Facial image 939 - 3 is optionally surrounded by registration progress meter 962 displayed in the successful authentication status described above with respect to FIGS. 7P and 7Q . The facial registration confirmation interface also includes a partial scan registration affordance 964 that allows the user to register the collected facial data for use in device authentication. The facial registration confirmation interface 960 also includes a back affordance 966 that allows the user to navigate back to the accessibility registration interface 954 .

As illustrated in FIG. 9Z , the device detects a user input 968 corresponding to an activation (eg, selection) of an affordance 966 back. In response to detecting the user input, device 900 displays (eg, for a second time) the accessibility registration interface 954 . While displaying the accessibility registration interface 954 , the device 900 detects movement (eg, rotation and/or tilt) of the user's face relative to the biometric sensor 903 . 9AA , device 900 detects that the user's face has been tilted in a particular direction (eg, downward and/or to the right towards meter portion 970 ). As described in further detail below with respect to FIGS. 11B-11H , device 900 updates user face image 939 - 2 based on the detected movement, and the user's head moves in three-dimensional space. Updates the position of orientation guide 942-2 to indicate it has been tilted and/or rotated. In response to detecting movement of the user's face, device 900 captures image data of a portion of the user's face (eg, the left side of the face), and captures image data of a corresponding portion of registration progress meter 940 - 2 (eg, the left side of the face). , changing the appearance of the meter portion 970) at the same time. In some examples, device 900 may display a meter portion ( 970) and/or change its color. In some examples, device 900 maintains display (eg, does not change the appearance) of meter portion 972 because meter portion 972 corresponds to a facial orientation that has not yet been registered.

As illustrated in FIG. 9A , in some examples, device 900 detects a change in orientation of the user's face relative to its one or more cameras (eg, the user's face is tilted upward), and accordingly, the user Update face image 939-2 and orientation guide 942-2. As an example, since the image data in the facial orientation corresponding to the meter portion 972 has been successfully registered, the device 900 may generate the meter portion ( 972) to the “registered” state (eg, by changing or shading the line width and/or color of the progress elements). 9A , device 900 again detects activation (eg, selection) of completion affordance 956 (eg, by user input 958 - 2 ).

In response to detecting activation of completion affordance 956 , device 900 returns to displaying face registration confirmation interface 960 as shown in FIG. 9A . Because the portion of the user's face has been successfully registered, device 900 displays registration success indicator 974 , eg, proximate to user face image 939 - 3 . In the example of FIG. 9A , the registration success indicator 974 indicates the orientations of the user's face that have been successfully registered. In some examples, registration success indicator 974 is a circular bar. Thus, in some examples, the registration success indicator 974 indicates (eg, located at) locations where the registration progress meter transitioned to a successful state during registration.

In some examples, partial scan registration affordance 964 is selectable because accessibility registration interface 960 allows a user to set up facial authentication with only partial registration of their facial features. As shown in FIG. 9A , device 900 detects activation (eg, selection) of partial scan registration affordance 964 (eg, by user input 976 ). In response to detecting activation of partial scan registration affordance 964 , device 900 displays registration completion interface 978 , illustrated in FIG. 9A . The registration complete interface 978 includes a text prompt 980 that indicates to the user that the registration process has been completed and facial authentication has been securely set up. The registration completion interface 978 optionally includes a generic facial graphic 982 in a location previously occupied by the user facial image 939-3. In some examples, the registration completion interface 978 also includes a completion affordance, the activation of which causes the electronic device to finish face authentication setup.

10 is a flow diagram illustrating a method for aligning a biometric feature on a display of an electronic device, in accordance with some examples. Method 1000 includes a device having a display, one or more input devices (eg, a touchscreen, microphone, camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection, such as a 4G LTE connection). For example, 100, 300, 500, 900). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 1000 provides an intuitive method for aligning biometric features on a display of an electronic device. This method reduces the user's cognitive burden of registering biometric features on the device, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to register a biometric feature faster and more efficiently saves power and increases the time between battery charges.

The device displays ( 1002 ) a first user interface (eg, 905 ) on the display. For example, the first user interface is optionally a registration introductory user interface as described above with respect to method 700 .

While displaying the first user interface, the device detects ( 1004 ) the occurrence of a condition corresponding to initiating a biometric registration process for registering each type of biometric feature (eg, 917 ). For example, the occurrence of the condition is optionally an input (eg, 906 on start affordance 904 ) corresponding to a request to “start registration”.

In response to detecting the occurrence of a condition corresponding to initiating the biometric enrollment process (eg, a user input selecting initiation of enrollment), the device captures, on the display, by one or more cameras (eg, 903 ). Display ( 1006 ) a digital viewfinder (eg, display portions 912 , 914 ) containing a preview of the image data (eg, user face image 918 ). In some examples, the preview of the image data includes a first portion of the field of view of the one or more cameras (eg, an outer portion of the field of view 914 ) and a second portion of the field of view of the one or more cameras (eg, an interior portion of the field of view 912 ). covers In some examples, the second portion of the field of view (eg, 914 ) is the portion of the field of view that surrounds (or partially surrounds) the first portion (eg, 912 ) of the field of view ( 1008 ). In some examples, the inner portion of the field of view is optionally divided from the outer portion by an alignment element (eg, positioning element 910 ). In some examples, the preview of image data optionally changes over time as content in the field of view of one or more cameras (eg, 903 ) changes. Displaying a preview of the image captured by the biometric sensors provides the user with feedback regarding the position and orientation of his or her biometric features relative to the biometric sensors of the device, so that the user can of biometric features can be properly aligned with sensors more quickly and efficiently. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the device, along with the preview of the image data, is configured with an alignment element (eg, positioning) indicating the portion of the preview (eg, 912 ) where the user's face (eg, 918 ) should be positioned in order to proceed with biometric enrollment. Element 910) is simultaneously displayed (1010). For example, the alignment element may optionally include framing brackets displayed in a central portion of the preview image (eg, 912 ) to prompt the user to move the device or their face toward alignment with the central portion of the preview image; It is a framing circle. Displaying the alignment element framing a particular portion of the digital viewfinder provides the user with feedback regarding the position of his or her biometric features relative to the portion of the field of view of the biometric sensor corresponding to proper alignment of the biometric feature. to provide. This in turn enables the user to properly position his or her biometric features relative to the sensors more quickly and efficiently. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, after initiating the biometric enrollment process 1012 , the device detects in the field of view of one or more cameras (eg, 903 ) each type of biometric feature (eg, 917 ) that meets the alignment criteria It is determined whether or not (1014). Determining whether a user's biometric features are properly aligned with biometric sensors is achieved during enrollment by ensuring that image data corresponding to specific portions and/or orientations of the biometric feature is captured (e.g., a method improve the quality of subsequent biometric registrations (according to s 1200 and/or 1400 ). This in turn improves the device's ability to match the user's biometric characteristics with data captured during biometric authentication at the device. Performing an optimized operation when a set of conditions are met without requiring additional user input (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, in response to detecting ( 1016 ) each type of biometric feature (eg, 917 ) that meets the alignment criteria, the device generates a first type of tactile output (eg, 934 , 936 , 934 - ) 2, 936-2, eg, a tactile output is an output corresponding to a successful alignment (1018). Issuing a tactile output upon detecting that the biometric feature is properly aligned with the biometric sensors provides the user with a biometric throughout a subsequent biometric enrollment process (eg, methods 1200 and/or 1400 ). Provides feedback to the user indicative of successful alignment, prompting the feature to remain in its alignment. Providing the user with improved tactile feedback improves the operability of the device (eg, by helping the user provide appropriate inputs during biometric enrollment and reducing user errors when operating/interacting with the device) and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, in response to detecting ( 1016 ) each type of biometric feature that meets the alignment criteria, the device stores ( 1020 ) image data corresponding to the biometric feature (eg, 917 ). In some examples, upon successful alignment, the device captures data associated with the biometric feature. Storing the biometric (eg, image) data in response to detecting successful alignment of the biometric feature allows the device to automatically capture the referenced data during a subsequent biometric authorization attempt. Performing an optimized operation when a set of conditions are met without requiring additional user input (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the alignment criteria include a requirement that at least a portion of the biometric feature (eg, 917 ) is within a first portion (eg, internal display portion ( 912 , 912 - 2 ) of the one or more cameras). (1024). For example, in some examples, the electronic device determines whether the image data includes data corresponding to the biometric feature that satisfies alignment criteria. In some examples, the alignment criteria include lighting condition criteria ( 1050 ). In some examples, the alignment criteria include a requirement that lighting conditions of the electronic device include (eg, by 903) that at least a first threshold amount of light is detected and/or less than or equal to a second threshold amount of light is detected, the biometric feature Requires appropriate to capture image data during registration.

In some examples, the alignment criteria include a requirement that a portion of the biometric feature (eg, a portion of 917 ) is oriented relative to the electronic device in a predetermined manner ( 1052 ). In examples where the biometric feature is the user's face, the alignment criteria optionally meet the requirement that the user's gaze is facing at least one of one or more cameras (eg, 903 ) of the electronic device or a display (eg, 901 ) of the electronic device. include In some examples, a requirement that a portion of a biometric feature (eg, a portion of a user's facial image 918 ) is oriented relative to the electronic device in a predetermined manner is such that the biometric feature (eg, 917 ) is one or more biometric sensors. The requirement to be located within a critical angle (eg, elevation angle) with respect to the poles (eg 903 ). In some examples, the alignment criteria are such that the biometric feature (eg, 917 ) can be pre-installed such that the biometric sensors can capture biometric data corresponding to the biometric feature at a specific angle or within a range of angles. require to be positioned relative to the biometric sensors (eg, 903 ) in a determined manner. In some examples, the device may, for example, based on the extent to which a biometric feature (eg, 917 ) is outside a predefined range of angles with respect to one or more biometric sensors (eg, 903 ): Dim the display of the electronic device (eg, display portions 912 and/or 914 ).

In some examples, alignment criteria include a requirement that the biometric feature (eg, 917 ) is within a first threshold distance from one or more biometric sensors (eg, 903 ) (eg, the biometric feature is too far from the biometric sensors) not far) 1042, and a requirement that the biometric feature is not within a second threshold distance from the one or more biometric sensors (eg, the biometric feature is not too close to the biometric sensors) 1026 ).

In some examples, while the biometric feature (eg, 917 ) is at a first distance from the electronic device that is not within a predetermined range of distances from the electronic device, the device is activated by one or more cameras (eg, 903 ). , detect ( 1044 ) a change in the distance of the biometric feature (eg, 917 ) from the first distance to a second distance from the electronic device that is not within a predetermined range of distances from the electronic device. In response to detecting a change in distance, the device generates an output (eg, a value of an output characteristic (eg, magnitude or amplitude, or frequency or repetition rate) that changes based on the distance of the biometric feature from a predetermined range of distances). , generate ( 1046 ) audio, tactile and/or visual outputs ( 922 , 924 ). In some examples, the electronic device generates an in-progress audio output ( eg 924 (eg a series of beeps). For example, the rate of beeping is selectively increased. Conversely, the frequency of the audio output (eg, 922 ) is optionally reduced as the distance between the biometric feature and the electronic device moves further from the target distance (or range of distances) from the electronic device. For example, the rate of beeping is selectively reduced. In some examples, similar feedback with tactile outputs (eg, output 924 ) or visual outputs is generated. Publishing an audio, tactile, and/or visual output that varies based on the distance between the biometric feature and the device is his or her biometric for a range of distances from the biometric sensors corresponding to proper alignment. Provides ongoing feedback to the user regarding the location of the measurement features. This in turn reduces the time the alignment interfaces are displayed and reduces the number of user inputs required during the alignment process. Thus, providing the user with improved audio, tactile and/or visual feedback may be beneficial to the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device). It improves operability and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

After initiating the biometric enrollment process, according to a determination 1022 that each type of biometric feature (eg, 917 ) that meets the alignment criteria has been detected in the field of view of one or more cameras (eg, 903 ), the device is a first portion of the field of view of the one or more cameras (eg, inner display portion 912 in FIG. 9J ) relative to a second portion of the field of view of the one or more cameras (eg, external display portion 914 in FIG. 9J ). Emphasize (e.g., darken, obscure, and/or darken a second portion of the field of view without obscuring, obscuring, and/or blacking a first portion of the field of view of one or more cameras 1028) . For example, alignment criteria include a requirement that a user's face (eg, 917 ) is aligned with a camera (eg, 903 ) in a predetermined alignment, or a user's eyes are aligned with a camera (eg, 903) in a predetermined alignment. Providing a visual effect that highlights a portion of the display upon detecting successful alignment of the user's biometric features with biometric sensors allows the user to determine that the current location of his or her biometric features (eg, , which is optimal for a subsequent biometric enrollment process (according to methods 1200 and/or 1400 ). Providing improved visual feedback when a set of conditions are met without requiring additional user input (eg, helps the user to provide appropriate inputs when actuating/interacting with the device and reduces user errors) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device dims ( 1030 ) a portion of the digital viewfinder that corresponds to a second portion (eg, 914 in FIG. 9J ) of the one or more cameras (eg, 903 ). Darkening in this manner includes lowering or dimming the portion of the digital viewfinder corresponding to the second portion of the field of view.

In some examples, the device stops displaying ( 1032 ) the portion of the digital viewfinder that corresponds to the second portion of the field of view of the one or more cameras (eg, second display portion 914 ). For example, ceasing to display the portion of the viewfinder corresponding to the second portion of the field of view may include blacking out the second portion of the field of view and/or replacing the display of the second portion of the field of view with a display of other content. includes doing

In some examples, the device magnifies ( 1034 ) the display of a first portion of the field of view of the one or more cameras on the display (eg, inner display portion 912 ). In some examples, enlarging the display of the first portion includes enlarging the display of some or all of the first portion of the field of view. In some examples, enlarging the display of the first portion of the field of view includes zooming in on the first portion of the field of view. In some examples, emphasizing a first portion (eg, 912 ) of the one or more cameras' field of view relative to a second portion (eg, 914 ) of the one or more cameras reduces or hides some or all of the first portion. include that In some examples, the device reduces the first portion before enlarging the display of the first portion (eg, to provide a zoom in and zoom out effect) and/or zooms out the first portion after enlarging the display of the first portion make it

In some examples, the device modifies ( 1036 ) an alignment element (eg, 910 ). For example, in some examples, modifying the alignment element includes removing the alignment element. In some examples, modifying the alignment element includes changing the shape and/or color of the alignment element (eg, from 910 to 910-2 in FIGS. 9J and 9K ). For example, the device modifies ( 1038 ) the shape of the alignment element from the first shape to the second shape. In some examples, the first shape is substantially rectangular and the second shape is substantially circular ( 1040 ). Alternatively, the first shape and/or the second shape are optionally part of any other shape or predetermined shape. In some examples, the predetermined shape is optionally a segmented shape, such as a segmented rectangle (eg, a rectangle missing a portion of one or more sides).

In some examples, after emphasizing a first portion (eg, 912 ) of the one or more cameras (eg, 903 ) relative to a second portion (eg, 914 ) of field of view, the device meets the alignment criteria detect ( 1054 ) that each type of biometric feature (eg, 917 ) is no longer detected in the field of view of one or more cameras. In response to detecting that each type of biometric feature that meets the alignment criteria is no longer detected in the field of view of the one or more cameras, the device outputs an indication of an alignment error (eg, 950 ). For example, in the case of correctable errors, the device identifies the error and prompts the user to correct the error. In case of uncorrectable errors, the device only identifies the error. Errors are identified by text and tactile output (eg, 950, 924, 925). In some examples, errors are identified using audible outputs, such as those provided for accessibility purposes. In some examples, the criteria for detecting that the biometric feature is no longer detected in the field of view of the one or more cameras are the same as the criteria for determining that the biometric feature meets the alignment criteria. In some examples, the alignment criteria are different from criteria for detecting that the biometric feature is no longer detected in the field of view of the one or more cameras (eg, once the biometric feature is aligned with the one or more cameras, the biometric feature is , the device may be moved slightly out of alignment without terminating the biometric enrollment process and outputting an indication of an alignment error). Outputting an indication that the user's biometric feature is no longer aligned with the biometric sensor allows the user to quickly indicate that the position and/or orientation of his or her biometric feature has deviated from a previously established alignment. Provide recognizable feedback. Such feedback prompts the user to quickly reposition his or her biometric feature to re-establish proper alignment with the biometric sensor, thereby reducing the time alignment user interfaces are displayed, and such alignment user interface reduce the number of inputs required in the fields and improve the quality of biometric feature registration. Thus, providing the user with improved audio, tactile and/or visual feedback may be beneficial to the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device). It improves operability and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, outputting the indication of the alignment error includes outputting ( 1056 ) a second type of tactile output (eg, 951 ). For example, a tactile output is an output corresponding to a successful loss of alignment. In some examples, the tactile outputs are error-specific, and in some instances an audible output is additionally or alternatively provided.

In some examples, outputting the indication of the alignment error deemphasizes a first portion (eg, 912-2) of the one or more cameras' field of view relative to a second portion (eg, 914-2) of the one or more cameras' field of view. (1058).

For example, the device optionally illuminates, unblurs, and/or reveals a second portion of the field of view relative to a first portion of the field of view of the one or more cameras. In some examples, the electronic device illuminates and unblurs the second portion of the field of view to deemphasize the first portion relative to the second portion. In some examples, if a biometric feature (eg, 917 ) aligns successfully after receiving an alignment error, the device resumes the biometric enrollment process from where it was prior to outputting an indication of the alignment error ( For example, registration progress up to the point when an alignment error was detected is preserved). In some examples, a progress indicator (eg, 940 ) that indicated enrollment progress disappears when an indication of an alignment error is output, but is displayed again when the biometric feature is properly aligned with one or more biometric sensors (eg, 940-2). In some cases, when the progress indicator is displayed again, it includes an indication of the progress made in registering the biometric feature prior to outputting an indication of the alignment error. Providing the visual effect of de-emphasizing a portion of the display upon detecting an alignment error allows the user to quickly recognize that the position and/or orientation of his or her biometric features deviate from a previously established alignment. make it aware This feedback prompts the user to quickly reposition his or her biometric feature to re-establish proper alignment with the biometric sensor, which reduces the time alignment user interfaces are displayed, and the alignment user It reduces the number of inputs required at the interfaces and improves the quality of subsequent biometric feature registration (eg, according to methods 1200 and/or 1400 ). Providing improved visual feedback when a set of conditions are met without requiring additional user input (eg, helps the user to provide appropriate inputs when actuating/interacting with the device and reduces user errors) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, upon determining that the alignment error is a first type of alignment error (eg, the biometric feature is too far from or too close to the electronic device) 1062 , the device is configured to correct the first type of alignment error. Outputs (eg, displays) a prompt (eg, 920 ) to move the biometric feature to ( 1064 ). For example, the device prompts the user to move closer to or further away from the electronic device, respectively.

In some examples, upon determining that the alignment error is a second type of alignment error (eg, the biometric feature is outside the first portion of the field of view) 1062 , the device is configured to correct for the second type of alignment error, the biometric Outputs (eg, displays) a prompt (eg, 950 ) to move the feature ( 1064 ). For example, the device prompts the user to move the biometric feature into the first portion of the field of view. In this case, the device withholds ( 1068 ) outputting a prompt (eg, 926 ) to move the biometric feature to correct for the first type of alignment error. In some examples, the second portion of the field of view (eg, 914-2) is corrected (eg, blurred) in response to determining that the alignment error is a second type of alignment error.

For example, a first type of alignment error is that a portion of a biometric feature (eg, a portion of 917 shown at 918-2, 939) is oriented outside a first portion of a field of view (eg, 912, 912-2). will (1074). In this case, the device outputs ( 1076 ) a prompt (eg, 950 ) to move a portion of the biometric feature into the first portion of the field of view to prompt the user to correct an alignment error of the first type. Providing a prompt with instructions on how to correct alignment errors allows the user to quickly recognize how to reposition his or her biometric features to re-establish proper alignment and proceed with the registration process. provide feedback. This in turn reduces the time the device displays the alignment interfaces, and reduces the number of user inputs required at those alignment interfaces. Providing improved visual feedback when a set of conditions have been met improves the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In another example, a first type of alignment error is that a distance between a portion of a biometric feature (eg, 917 ) and one or more biometric sensors (eg, 903 ) is within a threshold distance (eg, biometric feature) Boo is too close to one or more biometric sensors) (1078). In this case, the device outputs ( 1080 ) a prompt (eg, 920 ) to move the biometric feature away from the electronic device to prompt the user to correct an alignment error of the first type.

In another example, a first type of alignment error is that a distance between a portion of a biometric feature (eg, 917 ) and one or more biometric sensors (eg, 903 ) exceeds a threshold distance (eg, biometrics) feature is too far away from one or more biometric sensors) (1082). In this case, the device outputs ( 1084 ) a prompt (eg, 920 ) to move the biometric feature closer to the electronic device to prompt the user to correct for the first type of alignment error.

In another example, the first type of alignment error is such that the angle of the biometric feature (eg, 917 ) with respect to the one or more biometric sensors (eg, 903 ) is within a predefined range for the one or more biometric sensors (eg, 903 ). It is outside the angles (eg elevation angles). For example, the biometric feature is, in some situations, too high. In another example, one or more biometric sensors are, in some situations, too low. In this case, the device outputs a prompt to move the biometric feature to adjust the angle (eg, elevation) of the biometric feature relative to the one or more biometric sensors.

In some examples, upon determining 1086 that the error condition of the first type persists for a threshold period of time, the device is configured with an accessibility interface (eg, 908 ) that enables the user to proceed with biometric enrollment without correcting the error condition. ) is displayed (1088). For example, in some examples, the device does not move the biometric feature (eg, 917 ) relative to the device so that the error condition is corrected, or without tilting the biometric feature to capture images of a different side of the biometric feature. Allows the user to proceed with biometric registration. In some examples, the device enables the user to proceed with biometric enrollment in this manner if the biometric feature is improperly aligned for a predetermined amount of time and/or in response to a predetermined number of unsuccessful requests.

In some examples, after outputting the alignment error, upon determining that each type of biometric feature (eg, 917 ) that meets the alignment criteria has been detected in the field of view of one or more cameras (eg, 903 ), the device: Re-emphasize ( 1070 ) a first portion of the one or more cameras' field of view (eg, 912 - 2 ) relative to a second (eg, 914 - 2 ) portion of the one or more cameras' field of view. For example, optimally, the device does not darken, obscure, and/or darken a first portion (eg, 912-2) of the one or more cameras' field of view, and/or a second portion (eg, 912-2) of the field of view of the one or more cameras ( For example, 914-2) is darkened, blurred and/or blackened.

In some examples, after outputting the alignment error and upon determining that each type of biometric feature (eg, 917 ) that meets the alignment criteria has been detected in the field of view of one or more cameras (eg, 903 ), the device outputs ( 1072 ) a tactile output (eg, 936 ) of a first type. However, in some examples, the device outputs a third type of tactile output that is different from the first type and the second type.

In accordance with a determination that each type of biometric feature (eg, 917 ) that meets the alignment criteria has not been detected in the field of view of the one or more cameras (eg, the user's face or eyes have not been detected with a predetermined alignment); The device does not emphasize the first portion (eg, 912, 912-2) of the one or more cameras (eg, 903) relative to the second portion (eg, 914, 914-2) of the one or more cameras (eg, 903) Maintain display of the digital viewfinder (1090).

In some examples, the device detects ( 1092 ) a change in orientation and/or position of a biometric feature (eg, 917 ) relative to one or more biometric sensors (eg, 903 ). For example, the device optionally detects a change in position, a change in orientation, or both an orientation and a change in position.

In some examples, in response to detecting ( 1094 ) a change in orientation and/or position of a biometric feature (eg, 917 ) relative to one or more biometric sensors (eg, 903 ), and device movement criteria are met Upon determining that the device has been moved (eg, the device is physically moving beyond a threshold amount in a way that prevents reliable alignment/registration), the device prompts (eg, 946, 948, visual , a tactile or audible alarm) is output (1096). In some examples, the device detects reduced movement of the device, and in response to detecting the reduced movement of the device, the device stops outputting the prompt. In some examples, movement of the device is determined based on one or more biometric sensors (eg, 903 ). For example, a change in the orientation and/or position of the biometric feature relative to the one or more biometric sensors may be associated with movement of the device about the biometric feature rather than movement of the biometric feature relative to the one or more biometric sensors. match In some examples, movement of the device is determined based on one or more orientation sensors of the device, such as an accelerometer (eg, 168 ), magnetometer, inertial measurement unit, etc., separate from the one or more biometric sensors.

In some examples, while the biometric feature (eg, 917 ) is within a first portion (eg, 912 ) of the field of view of the one or more biometric sensors (eg, 903 ) and is within a threshold distance of the one or more biometric sensors (eg, 903 ), and upon determining that the biometric feature is within a predefined range of angles (eg, elevation angles for one or more biometric sensors), the device (eg, with reference to method 1200 and FIGS. 11A-11E ) Display a registration progress indicator (eg, 940 ) for registration of the biometric feature (as described in more detail). Displaying the registration progress indicator may optionally include a first portion of the one or more cameras' field of view (eg, 912 , 912 - 2) involves emphasizing first. Displaying a progress indicator during registration in this way encourages the user to look at the display of the electronic device during registration, improving the ability to detect when the gaze is towards the display and thus whether the user is paying attention to the device. make it Encouraging the user to view the display of the electronic device improves the operability of the device and enhances the user- It makes the device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, upon determining that the biometric feature (eg, 917 ) is outside a predefined range of angles (eg, elevation angles for one or more biometric sensors 903 ), the device performs a preview of the image data obscure (eg, blur, darken, or desaturate) at least a portion of (eg, display portions 912 , 912 - 2 , 914 and/or 914 - 2 ). In some examples, the device is configured such that a portion of the preview of image data is unambiguous (eg, the biometric feature is delay obscuring the portion of the preview of the image data (for at least a predetermined period of time, such as 1 second, 2 seconds, or 5 seconds) after detecting that it is within the first portion of the field of view and within a threshold distance of the one or more biometric sensors make it In some examples, the obscuring is delayed as long as the angle of the biometric feature is changing. In some examples, the obscuring is delayed until the angle of the biometric feature has been continuously outside the predefined range of angles for at least a predetermined period of time. In some examples, only a portion of the preview (eg, 912 or 914, 912-2 or 914-2) is obscured. In some examples, the entire preview (eg, 912 and 914, 912-2 and 914-2) is obscured. Obscuring the digital viewfinder when biometric sensors are positioned too high above or too low below the user's biometric feature allows the user to quickly recognize that his or her biometric feature is out of alignment. make it aware This then prompts the user to change the elevation angle between the device and his or her biometric feature until proper alignment is established. Providing improved visual feedback when a set of conditions have been met improves the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, while a portion of the preview of image data (eg, 912 or 914 ) is obscured, the device determines the angle of the biometric feature (eg, 917 ) with respect to one or more biometric sensors (eg, 903 ). detect change. In response to detecting a change in angle of the biometric feature with respect to the one or more biometric sensors, and wherein the change in angle does not move the biometric feature to a predefined range of angles, the biometric feature moves to a predefined range. Upon determining to move closer to the angles of , the device continues to obscure the portion of the preview of the image data (eg, 912 or 914, 912-2 or 914-2) while still obscuring the portion of the preview of the image data. decrease the amount. In some examples, the amount by which the ambiguity of the portion of the preview of the image data is reduced depends on an amount of change in the angle of the biometric feature relative to the one or more biometric sensors (eg, the biometric feature moves more toward the one or more biometric sensors). The more it moves, the greater the decrease in the amount of ambiguity). Upon determining that the change in angle moves the biometric feature to a predefined range of angles, the device stops obscuring the portion of the preview of the image data. In some examples, when a change in the angle of the biometric feature moves the biometric feature to a predefined range of angles, the device notifies the user that the angle of the biometric feature is within the predefined range of angles. tactile and/or audio output (eg, 934, 936) for Reducing the ambiguity of the digital viewfinder as the user's biometric feature moves closer to a predefined angular range allows the user to quickly recognize a set of positions corresponding to successful alignment of the biometric feature. This then prompts the user to change the elevation angle between the device and his or her biometric feature until proper alignment is established. Providing improved visual feedback when a set of conditions have been met improves the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, in response to detecting a change in the angle of the biometric feature (eg, 917 ) with respect to the one or more biometric sensors (eg, 903 ), the change in angle causes the biometric feature to a predefined range. Upon determining to move further away from the angles of , the device increases the amount of ambiguity of the portion of the preview of the image data (eg, 912 or 914, 912-2 or 914-2). In some examples, the amount by which the ambiguity of the portion of the preview of the image data is increased depends on the amount of change in the angle of the biometric feature relative to the one or more biometric sensors (eg, the biometric feature is more sensitive to the one or more biometric sensors). The farther you move, the greater the increase in the amount of ambiguity).

In some examples, obscuring includes blurring a preview of the image data, and reducing the amount of ambiguity of a portion of the preview of image data (eg, by reducing a blur radius or other blur parameter) includes blurring a preview of the image data. Including reducing the amount of blurring. In some examples, increasing the amount of ambiguity of the portion of the preview of image data includes increasing a blur radius or other blur parameter.

Note that the details of the processes described above with respect to the method 1000 (eg, FIGS. 10A-10F ) are also applicable in a similar manner to the methods described below. For example, method 1000 may optionally include one or more of the features of various methods described below with reference to methods 800, 1200, 1400, 1600, 1800, 2000, 2200, 2400, 2700. do. For example, a registration process as described in method 1200 may be applied in connection with a face registration interface (eg, 954 ). For another example, hints as described in method 1400 may be applied in connection with a registration progress meter (eg, 940 ). For another example, accessibility features as described in method 1400 may be applied instead of, or in combination with, accessibility options (eg, 928-2). For the sake of brevity, these details are not repeated below.

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 9A-9I are, optionally, implemented by the components shown in FIGS. 1A and 1B . For example, display operation 1002 , detect operation 1004 , display operation 1006 , highlight operation 1028 , and hold operation 1090 optionally include event classifier 170 , event recognizer 180 . , and the event handler 190 . Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

Now, an exemplary user interface for registering a biometric feature on an electronic device (eg, device 100 , device 300 , device 500 , device 700 , or device 900 ), according to some examples. Attention is drawn to FIGS. 11A-11L , which illustrate these. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIG. 12 .

11A illustrates an electronic device 1100 (eg, portable multifunction device 100 , device 300 , device 500 , device 700 , or device 900 ). In the illustrative example illustrated in FIGS. 11A-11L , the electronic device 1100 is a smartphone. In other examples, electronic device 1100 may be a different type of electronic device, such as a wearable device (eg, smartwatch). The electronic device 1100 has a display 1102 , one or more input devices (eg, a touchscreen of the display 1102 , a button, a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 1103 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the one or more biometric sensors 1103 are one or more biometric sensors 703 . In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

11A , device 1100 displays face registration user interface 1104 on display 1102 . In some examples, face registration user interface 1104 is displayed after device 1100 detects successful alignment of the user's face with respect to its one or more cameras, as described above with respect to FIGS. 9A-9A . . The face registration interface 1104 includes a user face image 1106 . In some examples, user facial image 1106 is an image of a user captured by one or more cameras on device 1100 . For example, user facial image 1106 may optionally be a live view of image data (eg, a digital viewfinder) captured by one or more cameras that is continuously updated as the camera's field of view and/or contents of the field of view change. it's a preview In some examples, the background content is removed such that only the user's face is visible in the facial image 1106 . The face registration interface also optionally includes an orientation guide 1108 superimposed on (eg, overlaid on) the user face image 1106 . 7I-7K , orientation guide 1108 optionally extends in a virtual z-dimension (eg, along an axis perpendicular to the plane of the display) and is above the center of user facial image 100 . It is a set of intersecting curves. Accordingly, the curves of the orientation guide 1108 appear to bulge outward with respect to the plane of the display 1102, giving a feeling of the position of the user's head in three-dimensional space.

The face registration user interface 1104 also includes a registration progress meter 1110 . Registration progress meter 1110 includes a set of display elements (eg, progress elements 1110a , 1110b , 1110c ) arranged around user face image 1106 and orientation guide 1108 . In the example of FIG. 11A , the progression elements are a set of lines extending radially outward from the user face image 1106 arranged in a circular pattern. In some examples, the progression elements 1110a , 1110b , 1110c , etc. indicate the orientation of the user's face required to register the corresponding facial features. For example, the progression elements within the upper portion of the registration meter 1110 may optionally cause one or more cameras on the device 1100 to capture image data of the underside of the user's face when the user's head is tilted upwards. Do - move, fill, stretch and/or change color. This process is described in more detail below. In the example of FIG. 9A , device 1110 displays progress elements in registration progress meter 1110 as unregistered (eg, the progress elements are grayed out).

The face registration interface 1104 also includes a text prompt 1112 instructing the user to move (eg, rotate and/or tilt) their head in a circular motion during the registration process. In some examples, text prompt 1112 optionally involves a tactile and/or audible prompt depending on device settings and/or user selections. In some examples, device 1112 displays text prompt 1112 on registration interface 1104 via a face registration process.

11B , device 1100 detects movement of the user's face relative to its one or more cameras. Movement of the user's face is optionally a rotational and/or tilting motion relative to device 1100 . In response, device 1100 continues to update (eg, display movement of) user face image 1106 to reflect the change in orientation of the user's face. In some examples, orientation guide 1108 tracks (eg, moves with) movement of user's facial image 1106 to visually highlight tilting and rotational movements of the user's face in three dimensions. For example, a center (eg, an intersection) of orientation guide 1108 is optionally positioned at a center point on user face image 1106 and moves with it. In some examples, device 1100 also adjusts the curvature of the lines comprising orientation guide 1108 to give the appearance of three-dimensional rotation (eg, with respect to an axis perpendicular to display 1100 ). In some examples, device 1100 highlights orientation guide 1108 while it moves (eg, while the orientation of the user's face is changing). For example, device 1100 optionally darkens orientation guide 1108 while it moves and/or displays a fading trail as it tracks movement of the user's face. In this case, device 1100 optionally reduces this emphasis on orientation guide 1108 relative to user face image 1106 when the user's face is not moving.

11B , in response to detecting that the user's face is oriented towards the progress meter portion 1114 (eg, image data captured by the biometric sensor 1103 is an angular view of the user's face), as shown in FIG. 11B . (in accordance with a determination to include an angular view), device 1110 updates the display of the progress elements in meter portion 1114 to a “Registering” state by changing the appearance of the progress elements in meter portion 1114 . For example, device 1100 optionally enlarges and/or changes the color of progress elements within meter portion 1114 while the user's face is oriented towards meter portion 1114 . In some examples, device 1100 stretches progress scales and changes their color from gray to blue when updating progress elements to a “Registering” state. Changing the display of the progression elements to the “Registering” state in this way indicates that the device 1100 is capturing facial imaging data for an angular view corresponding to the current orientation of the user's face (eg, is registering). ) is indicated. In the example of FIG. 11B , the device 1100 maintains the progress elements in the meter portion 1116 unregistered to indicate that the user has not yet orientated their face towards the meter portion 1116 . In some examples, the display of the meter portion 1114 is updated in this manner only when the user's face is rotated sufficiently towards the meter portion 1114 (eg, the user's face is rotated by at least a threshold amount or a threshold angle). do.

In some examples, the registration progress meter consists of a set of progress meter portions, such as meter portions 1114 and 1116 . In some examples, each progress meter portion includes a predetermined number of progress elements (eg, 3, 5, or 8 progress elements) associated with each portion.

In some examples, as illustrated in FIG. 11C , device 1110 detects a small rotation and/or tilt of the user's face and updates the digital viewfinder including user face graphic 1106 . For example, the user's face is tilted downward and begins to rotate to the right. However, in the example of FIG. 11C , the user's face is still oriented towards the progress meter portion 1114 . As a result, the device 1100 continues to display the progress elements of the meter portion 1114 in a Registering state even if the user begins to rotate and/or tilt their head downward and to the right. In this case, the device 1100 also maintains a display of the progression elements proximate the meter portion 1114 because the user's head has not been rotated sufficiently to trigger registration of the corresponding orientations.

11D , device 1110 detects that the user's face has been rotated and/or tilted toward meter portion 1118 . In the example of FIG. 11D , the user's face continues the movement illustrated in FIG. 11C , tilting downward and rotating to the right through its initial position in FIG. 11A (eg, the user's face is move so that it is not oriented towards the other parts). In response to detecting a change in facial orientation, device 1100 moves orientation guide 1108 to track movement of user facial image 1106 in the digital viewfinder. Upon determining that the user's face is oriented toward the meter portion 1118 (eg, the image data captured by the biometric sensor 1103 includes a second angular view of the user's face), the device 1100 may: Updates the progress elements in the meter portion 1118 to the “Registering” state described above. For example, device 1100 stretches progress graduations within meter portion 1118 and changes their color. In some examples, device 1100 only activates the meter portion if the corresponding portion of the user's face has not been previously registered (eg, if progress elements in meter portion 1118 are in a grayed out state, “unregistered”). Update the display at 1118 . In some examples, device 1100 (eg, to provide an additional indication of the orientation of the user's face relative to biometric sensor 1103) is a meter regardless of whether a corresponding portion of the user's face has been previously registered. Update the display of portion 1118 .

In the example of FIG. 11D , device 1100 also indicates that the user's face is no longer oriented toward progress meter portion 1114 (because the user's face is currently oriented towards meter portion 1118 ). detect In response, device 1100 changes the appearance of the progress elements in meter portion 1114 back to the “registered” state. In the example of FIG. 11D , device 1100 updates the display of progress scales in portion 1114 from the extended “Registering” state by again shortening the progress scales and changing their color. For example, progress elements in a "registered" state are the same length and/or size as progress elements in a "unregistered" state, but with a corresponding portion of the user's face (eg, FIG. 11B ) as described above with respect to FIG. The angular view captured in 11b) is displayed in green to indicate that it has been successfully registered.

In the example of FIG. 11D , device 1100 maintains the progression elements in meter portion 1116 unregistered to indicate that the user has not yet orientated their face towards meter portion 1116 .

11E-11H illustrate the face registration interface 1104 as the user rotates and/or tilts their face in a counterclockwise motion through a series of orientations associated with the right side of the registration progress meter 1110 . Starting with the progress meter portion 1118 , the device 1100 rotates based on the orientation of the user's face (eg, in response to detecting that the user's face is oriented towards a corresponding portion of the progress meter 1110 ). It sequentially changes the progress elements in the path to the "Registering" state described above. Once the user's face has been rotated past these progression elements (eg, in response to detecting that the user's face is no longer oriented toward corresponding portions of the progress meter 1110 ), the device 1100 may: Updates the progress elements to the "registered" state to indicate successful registration of the corresponding parts of the face of . This process is described in more detail below. In some examples, the visual characteristics of the progression elements in the “Registering” state are based on the rate at which the user's facial orientation changes. For example, the device 1100 may modify the colors of the proceeding elements in the "Registering" state in a first manner when the user's face is rotating at the first speed, and the user's face is slower and/or faster Modify the color of these progression elements in a second way if they are rotating.

11E , the device 1100 indicates that the user's face has been rotated in a counterclockwise manner with respect to the biometric sensor 1103 (eg, the user's face is up relative to its position in FIG. 11D ). rotate and/or tilt to the left). As described above, device 1100 continuously updates user face image 1106 to reflect changes in orientation and moves orientation guide 1108 to track movement of user face image 1106 in the digital viewfinder. move it As the user's face is rotated upward, the device 1100 (eg, by stretching the one or more progression elements and/or changing its color as described above) causes one or more progression elements (eg, in the meter portion 1116 ) to , 1116a) update the display to "Registration Status". As illustrated by the position of the user face image 1106 in FIG. 11E , rotation moves the user's face past an orientation corresponding to one or more progression elements (eg, 1118a ) within the meter portion 1118 (eg, 1118a ). get away from him) In response to detecting that the user's face is no longer in this orientation, device 1100 displays a display of one or more progression elements (including 1118a) to indicate successful registration of these portions as described above as “registered”. " update status. In the example of FIG. 11E , device 1100 maintains one or more elements (eg, 1118b ) of progress meter portion 1118 in a “registering” state, in which the user's face has not yet been rotated out of a corresponding orientation. because it didn't Likewise, device 1100 also continues to display one or more progression elements (eg, 1116b ) within meter portion 1116 in an initial “unregistered” state, where the user's face has not yet been positioned in the corresponding orientation. Because.

11F illustrates the face registration interface 1104 as counterclockwise rotation of the user's face relative to its position in FIG. 11E continues. Again, device 1100 continues to update user facial image 1106 to reflect the change in orientation, and moves orientation guide 1108 to track movement of user facial image 1106 in the digital viewfinder. Rotation moves the user's face in an orientation corresponding to progress meter portion 1116 , as illustrated by the position of user face image 1106 in FIG. 11F . In response to detecting the user's face in this orientation, device 1110 (eg, by stretching and/or changing the color of one or more progression elements, as described above), device 1110 one or more progression elements in meter portion 1116 . Changes the display of the devices (eg, 1116b ) from the “not registered” state to the “registered” state. As shown by the position of the user face image 1106 in FIG. 11F , the rotation also moves the user's face past an orientation that corresponds to the remaining elements (eg, 1118b ) of the progress meter portion 1118 (eg, 1118b ). get away from him) In response to detecting that the user's face is no longer in this orientation, device 1100 updates the display of these progression elements (including 1118b) to the "registered" state described above, so that meter portion 1118b indicates successful registration of an angular view of the user's face corresponding to . In the example of FIG. 11F , device 1100 also continues to display the progression elements within meter portion 1120 in the initial “unregistered” state described above because the user's face has not yet been positioned in the corresponding orientation. .

11G illustrates the face registration interface 1104 as counterclockwise rotation of the user's face relative to its position in FIG. 11F continues. Again, device 1100 continues to update user facial image 1106 to reflect the change in orientation, and moves orientation guide 1108 to track movement of user facial image 1106 in the digital viewfinder. As illustrated by the position of user face image 1106 in FIG. 11G , rotation moves the user's face in an orientation corresponding to progress meter portion 1120 . In response to detecting the user's face in this orientation, device 1110 displays a display of progression elements within meter portion 1120 (eg, by stretching one or more progression elements and/or changing their color as described above). is changed from "unregistered" status to "registered" status. Rotation also moves the user's face past (eg, out of) an orientation corresponding to progress meter portion 1116 , as shown by the position of user face image 1106 in FIG. 11G . In response to detecting that the user's face is no longer in this orientation, device 1100 updates the display of progress elements within meter portion 1116 to a “registered” state, corresponding to meter portion 1116 . Indicates successful registration of an angular view of the user's face. In the example of FIG. 11G , device 1100 continues to display the progression elements within meter portion 1122 in an initial “unregistered” state, as the user's face has not yet been positioned in the corresponding orientation.

11H illustrates the face registration interface 1104 as counterclockwise rotation of the user's face relative to its position in FIG. 11G continues. Again, device 1100 continues to update user facial image 1106 to reflect the change in orientation, and moves orientation guide 1108 to track movement of user facial image 1106 in the digital viewfinder. Rotation moves the user's face in an orientation corresponding to progress meter portion 1122 , as illustrated by the position of user face image 1106 in FIG. 11H . In response to detecting the user's face in this orientation, device 1110 displays a display of progression elements within meter portion 1122 (eg, by stretching one or more progression elements and/or changing their color as described above). is changed from "unregistered" status to "registered" status. In some examples, although corresponding facial features have already been registered (eg, to provide a further indication of the orientation of the user's face relative to biometric sensor 1703 ), such orientation causes device 1100 to , cause the display of one or more progression elements in meter portion 1114 to change from the “registered” state shown in FIGS. 11D-11G back to the “registering” state based on the orientation of the user's face. In this case, device 1100 returns these elements of progress meter portion 1114 back to the “registered” state in response to detecting that the user's face is no longer oriented in that direction. As illustrated by the position of user face image 1106 in FIG. 11H , rotation also moves the user's face past (eg, out of) an orientation corresponding to progress meter portion 1120 . In response to detecting that the user's face is no longer in this orientation, device 1100 updates the display of progress elements within meter portion 1120 to a “registered” state, corresponding to meter portion 1120 . Indicates successful registration of an angular view of the user's face. In the example of FIG. 11G , device 1100 initially “unregisters” the remaining progress elements of registered meter 1110 (eg, progress elements that are not within meter portions 1114 , 1116 , 1118 , 1120 , or 1122 ). " status, because the user's face has not yet been positioned in the corresponding orientation.

Registration and/or scanning of the user's facial features may occur until all elements of the registration progress meter 1110 have transitioned to the registered state (eg, the image data of all corresponding angular views of the user's face is not detected by the biometric sensor ( 1103)) in this way. For example, registration proceeds until the user's face returns to an orientation corresponding to the meter portion 1118 via counterclockwise rotation.

Displaying and updating the progress indicator during registration in this way encourages the user to look at the display of device 1100 during registration to detect when the gaze is facing the display and thus whether the user is paying attention to the device. improve the ability to Encouraging the user to view the display of the device 1100 improves the operability of the device (eg, by ensuring that the user's gaze is facing the display and thereby ensuring that the user's biometric features are properly registered) and It makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

It should be understood that the examples of FIGS. 11D-11H are illustrative only. In particular, registration of the user's facial features may begin at any portion of the progress meter 1110 (eg, meter portion 1114 ). Similarly, the angular views of the user's face corresponding to each meter portion or progression element may be registered in any order (eg, via clockwise rotation).

11I illustrates the face registration interface 1104 after image data of all corresponding angular views of the user's face has been captured by the biometric sensor 1103 . In the example of FIG. 11I , device 1100 transitioned the display of all progress elements within registration meter 1110 to the “registered” state (eg, during the registration process described above with respect to FIGS. 11B-11H ). For example, device 1100 changes the color of the progress element to green to indicate successful registration. In the example of FIG. 11I , device 1100 displays text prompt 1124 indicating that the first scan of the user's facial features is complete. In some examples, device 1110 issues an audio and/or tactile notification 1126 , providing additional indication that the first scan is complete. In some examples, the audio and/or tactile output indicative of successful registration of the user's facial features is the same audio and/or tactile output used to indicate successful facial authentication at device 1100 . In the example of FIG. 11I , device 1100 continues to display user face image 1106 . In some examples, the user face image 1106 is still part of the live preview of the digital viewfinder. In other examples, device 1100 displays a single (eg, still) user image captured during the enrollment process. In the example of FIG. 11I , device 1100 stops displaying orientation guide 1108 once the scan is complete.

11J and 11K , in some examples, device 1100 displays an animation that transitions the display of enrollment progress meter 1110 to success status meter 1128 shown in FIG. 11K . For example, device 1100 reduces the length of each progress tick mark and merges the display of the previous individual progress elements into a continuous circle, as illustrated in FIG. 11J . In the example of FIG. 11K , after displaying the animation, the device 1100 displays the scan complete interface 1130 . The scan complete interface 1130 includes a user face image 1132 and a success status meter 1128 . In the example of FIG. 11K , user facial image 1132 is blurred, fading, darkened, or otherwise obscured to indicate that additional image data is no longer being collected as part of the facial scan. In some examples, the success status meter 1128 is a solid, continuous green circle surrounding the user face image 1132 that provides a visual indication that the first scan is complete. To provide additional visual notification, scan completion interface 1130 also includes text prompt 1134 (eg, a completion message). The scan complete interface 1130 also includes an affordance 1136 to continue. In some examples, while displaying registration completion interface 1130 , device 1100 detects activation (eg, selection) of affordance 1136 to continue (eg, via user input 1137 ). In some examples where the display is touch-sensitive, the user input 1337 is substantially a tap, swipe, or other gesture on the display surface for affordance 1136 to continue. In other examples, activation of the continue affordance 1136 is keyboard input or activation of the affordance by a focus selector (eg, a mouse cursor).

In some examples, after completion of the registration process described above with respect to FIGS. 11B-11G , a second iteration of face registration is performed. 11L , in response to detecting activation of the continue affordance 1136 , the device 1100 displays a second face registration interface 1138 . In the example of FIG. 11L , the second facial registration indicator includes a second user face image 1140 and a second registration progress meter 1142 . In some examples, the second user facial image 1140 is a representation of the field of view of the biometric sensor 1103 with a visual processing similar to the user facial image 1106 (eg, the second user facial image 1140 is a digital view). is a live preview of the image data captured by the biometric sensor 1103 displayed as a finder). In some examples, device 1100 displays second orientation guide 1144 superimposed on (eg, overlaid on) second user facial image 1140 . In the example of FIG. 11L , the second orientation guide 1144 has a similar visual treatment as the orientation guide 1108 (eg, the second orientation guide 1144 extends out of the plane of the display 1102 in the virtual z dimension). contains a number of visible curves). In some examples, the second registration progress meter 1142 is configured with a set of progress elements (eg, 1142a , 1142b , 1142c ) spaced around the second user face image 1140 . In some examples, portions of second enrollment progress meter 1142 (eg, meter portions 1146 , 1148 ) are optionally selected from specific orientations or portions of the user's face with respect to biometric sensor 1103 . respond to In some examples, some or all of the meter portions optionally include a greater number of progress elements than respective portions of registration progress meter 1110 . As an example, each portion of the second progress meter 1142 corresponds to a facial orientation or angular view of the user's face, identical to corresponding portions of the progress meter 1140 (eg, the meter portion 1146 is shown in FIG. corresponds to the same facial orientation as meter portion 1114 in FIGS. 11B-11H ). In some examples, upon display of the second registration interface 1138 , the device 1100 sets the visual state of the progress elements in the registration progress meter 1142 to the “not registered” state described above (eg, the first registration scan) The registration progress from ) is reset). In the example of FIG. 11L , the second face registration interface also includes a text prompt 1150 instructing the user to move (eg, rotate and/or tilt) their head in a circular motion during the second registration process. .

In some examples, as the second iteration of face registration is performed, the device 1110 responsive to a change in the orientation of the user's face with respect to the biometric sensor 1103 , a second user facial image 1140 , a second Update the display of the progress meter 1142 , and the orientation guide 1144 . For example, the user repeats the same (or similar) motion of his or her face as was performed in the registration of the first iteration, and the device 1100 performs the same (or similar) motion of his or her face as described above with respect to FIGS. 11B-11H ( or in a similar manner) update the display of these elements of the second user interface 1138 .

11M illustrates the second face registration interface 1128 after registration of the second iteration is complete (eg, after image data of various angular views of the user's face has been captured by the biometric sensor 1103 ). . In the example of FIG. 11M , device 1100 has transitioned the display of all progress elements in second registration meter 1142 to the “registered” state described above. For example, the color of each progress element was changed to green to indicate successful registration. In the example of FIG. 11M , device 1100 displays text prompt 1152 indicating that a second scan of the user's facial features is complete. In some examples, device 1110 issues an audio and/or tactile notification 1154 , providing additional indication that the second scan is complete. In some examples, the audio and/or tactile notification 1154 is the same as the tactile notification 1126 issued to indicate the completion of the first scan. In some examples, the audio and/or tactile output indicative of a successful second scan of the user's facial features is the same as the audio and/or tactile output used to indicate successful facial authentication at the device. In the example of FIG. 11M , the device 1100 continues to display the second user face image 1140 . In some examples, the second user face image 1140 is part of a live preview of the digital viewfinder. In other examples, device 1100 displays a single (eg, still) user image captured during the enrollment process. In the example of FIG. 11M , device 1100 stops displaying second orientation guide 1144 once the scan is complete.

In the example of FIG. 11N , after issuing a notification indicating completion of the second scan, device 1100 displays second scan complete interface 1156 . The second scan complete interface 1156 includes a user face image 1158 and a second success status meter 1160 . In the example of FIG. 11N , user facial image 1158 is blurred, faded, darkened, or otherwise obscured to indicate that additional image data is no longer being collected as part of the second facial scan. In some examples, the second success status meter 1160 is a solid line surrounding the user face image 1158 that provides a visual indication that the first scan is complete (eg, similar to the success status meter 1128 ). , is a continuous green circle. To provide an additional visual notification, the second scan complete interface 1156 also includes a text prompt 1162 (eg, a second scan complete message). The second scan complete interface 1156 also includes an affordance 1164 to continue. In some examples, while displaying second scan complete interface 1156 , device 1100 detects activation (eg, selection) of affordance 1164 to continue (eg, via user input 1165 ). In some examples where display 1102 is touch-sensitive, activation is substantially a tap, swipe, or other gesture on the display surface for affordance 1164 to continue. In other examples, activation of the continue affordance 1164 is keyboard input or activation of the affordance by a focus selector (eg, a mouse cursor). In the example of FIG. 11N , user facial image 1158 is blurred, faded, darkened, or otherwise obscured to indicate that additional image data is no longer being collected during the second facial scan.

In the example of FIG. 11O , in response to detecting activation of the continuing affordance 1164 , the device 1100 displays the registration complete interface 1166 . As shown in FIG. 11O , the registration complete interface 1166 includes a biometric authentication glyph 1168 . For example, the biometric authentication glyph is optionally a line drawing of all or part of a face (eg, a stylized face graphic). In the example of FIG. 11O , registration complete interface 1166 also includes a text prompt 1170 indicating that the registration process is complete and facial authentication at the device is set up and/or enabled. In some examples, the registration completion interface 1166 also includes a completion affordance 1172 , the activation of which causes the device 1100 to finish face authentication setup. In some examples, the registration completion interface 1166 does not include the face image 1158 .

12A and 12B are flow diagrams illustrating a method for registering a biometric feature of a user on an electronic device, in accordance with some examples. Method 1200 includes a device having a display, one or more input devices (eg, a touchscreen, a microphone, a camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection, such as a 4G LTE connection). For example, 100, 300, 500, 1100). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 1200 provides an intuitive method for registering a biometric feature of a user on an electronic device. This method reduces the user's cognitive burden of registering biometric features on the device, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to register a biometric feature faster and more efficiently saves power and increases the time between battery charges.

The device displays 1202 a biometric enrollment interface (eg, 1104 ) on the display. Displaying the biometric enrollment interface includes displaying ( 1204 ) a representation of the biometric feature (eg, 1106 ). For example, the representation of the biometric feature may optionally be a face, fingerprint, iris, handprint, or other physical feature that may be used to distinguish one person from another in the field of view of one or more cameras of the device. A representation of a biometric feature (eg, a representation of a head of a user of the device). The representation of the biometric feature includes a user's head positioned based on alignment of the biometric feature to one or more biometric sensors (eg, 1103 ) of the device (eg, a user's head positioned in the field of view of one or more of the cameras). has an orientation determined based on the camera data).

In some examples, the device displays ( 1206 ) a digital viewfinder (eg, a live preview of image data including 1106 ) that includes a representation of the field of view of one or more cameras (eg, 1103 ). For example, in some examples, the device displays a live preview of image data captured by one or more cameras. In some examples, the representation of the field of view of one or more cameras has background content removed. The background is optionally determined based on depth information captured by one or more cameras (eg, removing background content optionally includes removing or simply vignetting any background) . In some examples, the device does not perform any background removal.

Displaying the biometric registration interface may also include a first progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122, first position on the display relative to the representation (eg, 1106) of the biometric feature). A first set of objects (eg, 1110a, 1110b and 1110c, or 1116a and 1116b, or 1118a and 1118b) spaced around a representation of the biometric feature, such as a set of graduation marks, and a representation of the biometric feature A second progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122, eg, 1114, 1116, 1118, 1120, or 1122, around the representation of the biometric feature, such as a second set of graduation marks, at a second location on the display for (eg, 1106 ). concurrently displaying 1208 a progress indicator (eg, 1110) including a second set of spaced apart objects (eg, 1110a, 1110b and 1110c, or 1116a and 1116b, or 1118a and 1118b); . A representation of the biometric feature (eg, 1106 ) is displayed between the first location and the second location on the display. Displaying a progress indicator during registration in this way encourages the user to look at the display of the electronic device during registration, improving the ability to detect when the gaze is towards the display and thus whether the user is paying attention to the device. make it Encouraging the user to view the display of the electronic device improves the operability of the device and enhances the user- It makes the device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the progress indicator includes a plurality of progress indicator portions (eg, 1114, 1116, 1118, 1120, 1122, each progress indicator portion comprising one or more progress elements (eg, 1110a, 1110b, 1110c, 1116a, 1116b, 1118a, 1118b) (1210). In some examples, the plurality of progress indicator portions includes a first progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122) and a second progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122), wherein the plurality of progress indicator portions surround at least a portion of the representation (eg, 1106) of the biometric feature. In some examples, one or more of the plurality of progress indicator portions includes 1212 a plurality of respective progress elements (eg, 1110a, 1110b, 1110c, 1118a, 1118b). In some examples, the progress indicator optionally includes a set of one or more display elements (eg, 1110a, 1110b, 1110c, 1116a, 1116b, 1118a, 1118b) arranged around the representation (eg, 1106) of the biometric feature. do. For example, these display elements are optionally a circle of radially extending lines (“scales”) representing the progression of registration lines around the user's face. The lines optionally indicate a direction in which each change in orientation of the biometric feature is sufficient for registration of the biometric feature (eg, pointing upward to move the upper lines, even though the lower part of the biometric feature is being scanned). In some examples, the first set of lines correspond to a first progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122) and the second set of lines correspond to a second progress indicator portion (eg, 1114) , 1116, 1118, 1120, or 1122). For example, a predetermined number (eg, eight) of tick marks is associated with each portion of the progress indicator.

In some examples, the first progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122) may be configured such that the biometric feature (eg, the user's face) is the first progress indicator portion (eg, 1114, 1116). , 1118 , 1120 , or 1122 indicates a registration status of a first portion of a biometric feature detected by (eg, visible to) one or more biometric sensors (eg, 1103 ) when turned toward ( 1214 ) . For example, the upper right portion of the progress indicator (eg, 1120 ) changes appearance when the user's face is turned to the upper right portion of the device to register the lower left portion of the user's face. Likewise, in some examples, the second progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122) may be configured such that the biometric feature (eg, the user's face) is the first progress indicator portion (eg, 1114). , 1116 , 1118 , 1120 , or 1122 , different from the first portion of the biometric feature detected by (eg, visible to) one or more biometric sensors (eg, 1103 ) when turned toward ( , 1116 , 1118 , 1120 , or 1122 ) indicates the registration status of the second portion of the measurement feature. For example, the lower right portion (eg, 1118 ) of the progress indicator changes in appearance when the user's face is turned to the lower left portion of the device to register the upper right portion of the user's face.

In some examples, displaying 1202 of the biometric enrollment interface (eg, 1104 ) further includes displaying a prompt (eg, 1112 ) to move the biometric feature. In some examples, the displayed prompt is optionally accompanied by a tactile and/or audible prompt. In some examples, the types of responses are provided based on settings of the electronic device and/or manually controlled by the user. Providing a prompt with instructions on how to properly move the biometric feature reduces the time required to complete the registration process by providing the user with feedback that allows them to quickly recognize and execute the required movements. . Thus, providing an improved visual prompt regarding the appropriate inputs required for biometric enrollment (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device displays a prompt (eg, 1108 ) indicating the direction of movement. In some examples, the prompt is an orientation guide (eg, 1108 ) overlaid on the biometric enrollment interface (eg, 1104 ). In some examples, the prompt is overlaid on the representation (eg, 1106 ) of the biometric feature. In some examples, the device overlays a three-dimensional object (eg, 1108 ) on a representation (eg, 1106 ) of the biometric feature. For example, the three-dimensional object is optionally an arc that moves as the user's head is rotated and extends in the virtual z-dimension. In some examples, the three-dimensional object (eg, 1108 ) includes a plurality of arcs (eg, two arcs that intersect each other at a point in front of the user's face) extending in the virtual z-dimension. In some examples, a three-dimensional object (eg, 1108 ) is highlighted when the user is moving (eg, the three-dimensional object darkens or displays a fading trace as it moves with movement of the biometric feature), which It emphasizes the three-dimensional object when it is moving, and reduces the emphasis on the three-dimensional object compared to the representation of the biometric feature when the biometric feature is not moving.

While simultaneously displaying a representation (eg, 1106 ) and a progress indicator (eg, 1110 ) of the biometric feature, the device detects a change in orientation of the biometric feature relative to one or more biometric sensors (eg, 1103 ) (1216).

In some examples, in response to detecting a change in orientation of the biometric feature with respect to one or more biometric sensors 1218 , the device changes the orientation of the biometric feature with respect to one or more biometric sensors (eg, 1103 ). Rotate the prompt (eg, 1108 ) according to the change. In some examples, rotating the prompt includes rotating the three-dimensional object (eg, 1108 ), at least in part, to a virtual z-dimension of the display. Rotating the orientation guide overlaid on the representation of the biometric feature provides the user with feedback regarding the orientation of his or her biometric features relative to the device's biometric sensors in three-dimensional space, allowing the user to Allows for faster placement of his or her biometric features through the required orientation range during the registration process. Thus, providing the user with improved visual feedback regarding the orientation of the biometric feature may be beneficial to the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device). It improves operability and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, in response to detecting a change in the orientation of the biometric feature with respect to the one or more biometric sensors, the device according to a change in the orientation of the biometric feature with respect to the one or more biometric sensors (eg, 1103 ) Update ( 1220 ) the representation (eg, 1106 ) of the biometric feature. For example, in some examples, the orientation of the representation (eg, 1106 ) of the biometric feature is changed regardless of whether enrollment criteria are met. In some examples, the orientation of the representation (eg, 1106 ) of the biometric feature is changed only if the enrollment criteria are met. Updating the orientation of the displayed representation of the biometric feature provides the user with feedback regarding the orientation of his or her biometric features with respect to the device's biometric sensors, such that the user is required to perform a range of orientations during the registration process. allows for faster movement of biometric features. Thus, providing the user with improved visual feedback regarding the orientation of the biometric feature may be beneficial to the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device). It improves operability and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

Upon determining that the change in orientation of the biometric feature meets enrollment criteria for the first portion of the biometric feature corresponding to the first progress indicator portion (eg, 1114 , 1116 , 1118 ), the device configures the first progress indication Update ( 1222 ) one or more visual properties of the ruler portion. For example, determining the change in orientation of the biometric feature that meets the enrollment criteria may optionally include determining that the image data based on determining to include data corresponding to a first angular view of the user's face from a bottom perspective. Updating the visual state of the portion of the progress meter corresponding to the current orientation of the biometric feature allows the user to recognize that the portion of the biometric feature is properly oriented for registration. This in turn indicates to the user how to change the orientation of the biometric feature to register different portions corresponding to different respective portions of the progress meter, thereby reducing the time required to complete the registration process. Thus, providing the user with improved visual feedback regarding the registration status of the biometric feature may be beneficial to the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the enrollment criteria for the first portion of the biometric feature corresponding to the first progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) include: and the requirement to be oriented relative to one or more biometric sensors (eg, 1103 ) in a manner (eg, the user's face is looking towards the first progress indicator portion).

In some examples, the registration criteria for a first portion of the biometric feature corresponding to the first progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) is that the first portion of the biometric feature is not registered. including the requirement that

In some examples, the enrollment criteria for a first portion of a biometric feature corresponding to a first progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) include: includes a requirement that the orientation is changed (eg, rotated) by at least a threshold amount for the biometric sensors (eg, 1103 ) ( 1224 ). In some examples, registration of the first portion of the biometric feature causes the biometric feature to move (rotate) to a degree sufficient to allow the first portion to be properly captured by one or more biometric sensors (eg, 1103 ). demand that

In some examples, updating the one or more visual characteristics of the first progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) may include: in a first manner based on a registration status of the first portion of the biometric feature. (eg, color) updating one or more visual characteristics of the first progress indicator portion, and in a second manner (eg, based on the alignment of the biometric feature to one or more biometric sensors (eg, 1103 ) of the device) , the size or length of the progress elements) updating one or more visual characteristics of the first progress indicator portion. For example, a first progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) changes from black to green when a portion of the biometric feature corresponding to the first progress indicator portion has been registered, One or more lines (eg, 1110a, 1110b, 1110c) corresponding to the first progress indicator portion when the portion of the biometric feature corresponding to 1 progress indicator portion faces the one or more biometric sensors (eg 1103) , 1116a, 1116b, 1118a, 1118b) are elongated. In some examples, updating the one or more visual characteristics of the first progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) in a second manner may result in the one or more biometric sensors (eg, 1103 ) based on the direction of change in the orientation of the biometric feature for In some examples, updating in the second manner is additionally or alternatively performed based on a rate of change of orientation of the biometric feature with respect to the one or more biometric sensors. Changing the portion of the progress meter corresponding to the current orientation of the biometric feature from the first visual state to the second visual state allows the user to quickly recognize that the portion of the biometric feature is properly oriented for registration. This may in turn indicate to the user how to change the orientation of the biometric feature to register other portions corresponding to different respective portions of the progress meter, which reduces the time required to complete the registration process. Thus, providing the user with improved visual feedback regarding the registration status of the biometric feature may be beneficial to the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device determines whether the first progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122) is based on a rate of change of orientation of the biometric feature with respect to one or more biometric sensors (eg, 1103). Update one or more visual properties. In some examples, updating the one or more visual characteristics in this manner includes modifying the color of the first progress indicator portion based on a rate of change of orientation of the biometric feature.

In some examples, the first progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) is, in each order, a plurality of display elements (eg, 1110a, 1110b, 1110c, 1114a, 1116a, 1116b, 1118a ) , 1118b). Upon determining that the change in orientation of the biometric feature with respect to the one or more biometric sensors (eg, 1103 ) is a change in a first direction (eg, clockwise rotation), the device is optionally configured to: Change the appearance of the display elements starting from (eg, starting at 1118a). For example, the device optionally begins stretching lines in the first progress indicator portion starting from the first side of each sequence and moving to the second side of each sequence (to 1114a). Upon determining that the change in orientation of the biometric feature with respect to the one or more biometric sensors is a change in a second direction (eg, counterclockwise rotation), the device optionally is different from the first end of each sequence; Starting from the second end of each sequence (eg, starting with 1114a) changes the appearance of the display elements (eg, 1110a, 1110b, 1110c, 1114a, 1116a, 1116b, 1118a, 1118b). For example, the device optionally extends lines in the first progress indicator portion starting from the second side of each sequence and moving to the first side of each sequence (eg, to 1118a). In some examples, a similar approach is taken when changing the appearance of a second progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) or other progress indicator portions.

In some examples, the device transfers one or more visual characteristics of the first progress indicator (eg, 1114, 1116, 1118, 1120, or 1122) from the first state (eg, “not registered”) to the first progress indicator portion Update to a second status (eg, “Registering”) indicating that the registration criteria are met. For example, the device may display display elements within a portion of the progress indicator at which the biometric feature is currently oriented (eg, 1114 ), such as the portion of the progress indicator toward which the user's face is facing (eg, orientation of 1106 in FIG. 11B ). Enlarge, enlarge or change its color.

In some examples, after updating one or more visual characteristics of the first progress indicator portion, the device optionally determines that the biometric feature is attached to the first progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122). Detect a change in orientation of the biometric feature relative to the one or more biometric sensors such that it no longer meets registration criteria for the first portion of the corresponding biometric feature. In response to detecting a change in orientation of the biometric feature with respect to the one or more biometric sensors, the device optionally sets one or more visual characteristics of the first progress indicator portion to a second state (eg, “enrolling”). From , update 1226 to a third state (eg, “registered”) indicating that the first portion of the biometric feature has been enrolled but no longer meets the enrollment criteria. For example, the device may optionally change the appearance (eg, color or size) of the progress indicator portions again when the user's face moves away from them, and optionally change the first portion of the progress indicator (eg, 1114a ) again. , transitions from the “tilted” appearance to the registered appearance when the user orients the biometric feature away from that portion of the progress indicator (eg, orientation of 1106 in FIG. 11D ). One visual characteristic (eg, color) of the progress indicator may optionally be indicative of registration status (eg, blue for “tilted”, green for “registered”, gray for “not registered”), while Another visual characteristic (eg, the length of the lines) indicates the orientation direction of the biometric feature. Progress optionally advances around the progress indicator (eg, 1110 ) based on the speed and direction of the change in tilt. For example, progress indicator lines (eg, 1110a, 1110b, 1110c, 1114a, 1116a, 1116b, 1118a, 1118b) may optionally be bulged and/or biometric based on the speed and direction of movement of the biometric feature. It changes color based on the speed and direction of movement of the measurement feature. Changing the portion of the progress meter corresponding to the current orientation of the biometric feature from the second visual state to the third visual state allows the user to quickly recognize that the portion of the biometric feature has been successfully registered. This also indicates to the user that they no longer need to move the biometric feature to that orientation during the enrollment process, which draws the user's attention to registering other portions of the biometric feature, which is necessary to complete the enrollment process. reduce the time Thus, providing the user with improved visual feedback regarding the registration status of the biometric feature may be beneficial to the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In accordance with a determination that the change in orientation of the biometric feature meets enrollment criteria for a second portion of the biometric feature corresponding to the second progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ), the device updates ( 1228 ) one or more visual characteristics of the second progress indicator portion. For example, determining the change in orientation of the biometric feature that meets the enrollment criteria can optionally include determining whether the image data is at a second different perspective (eg, a left perspective of the face, such as when the user's face is tilted to the right). ) to include data from the user's face corresponding to a second different angular view of the user's face from In some examples, updating the visual characteristics of the second progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) is optionally described above with respect to updating the visual characteristics of the first progress indicator portion. some or all of the steps described. Updating the visual state of the second portion of the progress meter corresponding to the current orientation of the biometric feature allows the user to recognize that the second portion of the biometric feature is properly oriented for registration. This in turn indicates to the user how to change the orientation of the biometric feature to register different portions corresponding to different respective portions of the progress meter, thereby reducing the time required to complete the registration process. Thus, providing the user with improved visual feedback regarding the registration status of the biometric feature may be beneficial to the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, upon determining that registration completion criteria are met (eg, all portions of the biometric feature have been registered, 1110 of FIG. 11E ), the device indicates (eg, 1124 , 1126 ) that registration of the biometric feature is complete. ) is output.

For example, the device optionally updates one or more visual characteristics of the progress indicator (eg, 1110 ) (eg, a plurality of progress indicator display elements (eg, 1110a, 1110b, 1110c, 1114a, 1116a, 1116b, 1118a, 1118b) are merged into a continuous shape such as a circle). In some examples, prior to detecting a change in orientation of the biometric feature relative to the one or more biometric sensors, a first progress indicator portion (eg, 1114, 1116, 1118, 1120, or 1122) and a second progress indicator Portions (eg, 1114 , 1116 , 1118 , 1120 , or 1122 ) are visually distinct. In this case, updating the one or more visual characteristics of the progress indicator includes visually merging the first progress indicator portion and the second progress indicator portion.

In some examples, the device modifies the representation (eg, 1106 , 1132 ) of the biometric feature. In some examples, the representation of the biometric feature is blurred, faded, darkened, and/or faded to indicate that additional information about the biometric feature is no longer being collected as part of the enrollment process; otherwise ambiguous.

In some examples, the device displays a confirmation affordance (eg, 1136 , 1164 ), and selection of the confirmation affordance causes the electronic device to display a completion interface (eg, 1166 ). In some examples, the device displays a simulation (eg, 1168 ) of the representation of the biometric feature. In some examples, the simulation of the representation of the biometric feature is two-dimensional. In some examples, the simulation of the representation of the biometric feature is three-dimensional.

In some examples, the device outputs an indication (eg, 1126, 1154, 1122, 1162, 1170) (eg, a tactile output) that the registration procedure is complete. In some examples, the device outputs a tactile output (eg, 1126 , 1154 ) indicating successful registration of the biometric feature. In some examples, the tactile output indicative of successful registration of the biometric feature is the same tactile output used to indicate successful authentication by the biometric feature.

In some examples, after outputting an indication that registration of the biometric feature is complete, the device displays a second biometric enrollment interface (eg, 1138 ). In some examples, after completion of the first registration, registration of the second iteration is performed. Registration of this second iteration is optionally performed in response to selection of an affordance (eg, 1136 ). Performing a second scan of the user's biometric features causes the device to capture additional biometric data corresponding to different orientations or positions of the biometric feature that may not have been recorded during registration of the first iteration. . Thus, performing a second scan of the user's biometric features allows for more efficient and/or secure biometric authentication at the device (eg, when the user activates and/or interacts with the device) It improves the operability of the device (by helping to provide inputs and reducing user errors) and makes the user-device interface more efficient, which in addition enables the user to use the device more quickly and efficiently, thereby reducing the power of the device. Reduce usage and improve battery life.

In the second biometric enrollment interface, the device displays a second representation 1140 of the biometric feature. The second representation of the biometric feature optionally has an orientation determined based on alignment of the biometric feature to one or more biometric sensors (eg, 1103 ) of the device. In some examples, the second representation of the biometric feature is a representation of the field of view of one or more cameras that has a visual processing similar to the first representation (eg, 1106 ) of the biometric feature.

At the second biometric enrollment interface, the device configures a third progress indicator portion (eg, around the representation of the biometric feature, such as 1146 ) at a first location on the display relative to the representation of the second biometric feature (eg, 1140 ). a first set of objects spaced apart from each other), and a fourth progress indicator portion at a second location on the display for a second representation of the biometric feature (eg, 1140 ) (eg, a representation of the biometric feature, such as 1148 ). concurrently display a second progress indicator (eg, 1142 ) including a second set of objects spaced around the perimeter. The second representation of the biometric feature is displayed between the third location and the fourth location on the display. In some examples, the third progress indicator portion corresponds to the same portion of the biometric feature as the first progress indicator portion (eg, 1114 ). In some examples, the fourth progress indicator portion corresponds to the same portion of the biometric feature as the second progress indicator portion (eg, 1118 ).

In some examples, the registration status of the first progress indicator portion (eg, 1114 , 1116 , 1118 , 1120 or 1122 ) does not correspond to the registration status of the third progress indicator portion (eg, 1146 or 1148 ).

In some examples, the first progress indicator portion of the progress indicator includes a first number of progress elements (eg, 1114a ) and the third progress indicator portion of the second progress indicator is different from the first number (eg, 1114a ). , greater than , a second number of progression elements (eg, 1142a, 1142b, 1142c). In some examples, a plurality (or all) of progress indicator portions (eg, 1146 , 1148 ) within a second progress indicator (eg, 1142 ) may include a corresponding progress indicator (eg, 1110 ) in a first progress indicator (eg, 1110 ). It includes more progression elements than portions (eg, 1114 , 1118 ).

In some examples, while simultaneously displaying a second representation (eg, 1140 ) and a second progress indicator (eg, 1142 ) of the biometric feature, the device is configured to perform biometric measurements on one or more biometric sensors (eg, 1103 ). A second change in orientation of the feature is detected. responsive to detecting a second change in orientation of the biometric feature with respect to the one or more biometric sensors, and in accordance with determining that the change in orientation of the biometric feature meets enrollment criteria for the first portion of the biometric feature , the device updates one or more visual characteristics of the third progress indicator portion (eg, 1146 or 1148 ). In accordance with a determination that the change in orientation of the biometric feature meets enrollment criteria for the second portion of the biometric feature, the device updates one or more visual characteristics of the fourth progress indicator portion (eg, 1146 or 1148 ). For example, to advance through the second enrollment step of the enrollment process, the user may register changes in the orientation of the biometric feature that was used to enroll the biometric feature in the first enrollment step of the enrollment process to the second enrollment of the enrollment process. Repeat step by step. Accordingly, updating the visual characteristics of the third and fourth progress indicator portions optionally includes those described above with respect to the first and second progress indicator portions (eg, 1114 , 1116 , 1118 , 1120 or 1122 ). steps similar to those of

In some examples, after detecting a second change in orientation of the biometric feature with respect to one or more biometric sensors (eg, 1103 ) and upon determining that a second set of enrollment completion criteria are met (eg, biometrics) all portions of the feature have been registered), the device outputs a second indication (eg, 1162 , 1163 ) that registration of the biometric feature is complete. In some examples, registration does not actually occur; Rather, the process is visually emulated. In some examples, the second indication is a visual, audible, and/or tactile output (eg, 1163 ) indicating that registration of the biometric feature is complete. In some examples, the second indication is the same as the indication (eg, 1126 ) provided in accordance with a determination that the first set of registration completion criteria are met.

Note that the details of the processes described above with respect to method 1200 (eg, FIGS. 12A and 12B ) are also applicable in a similar manner to the methods described herein. For example, method 1200 may optionally include one or more of the characteristics of various methods described herein with reference to methods 800, 1000, 1400, 1600, 1800, 2000, 2200, 2500, 2700. include For example, a face registration confirmation interface as described in method 1000 may be applied in connection with a face registration user interface (eg, 1104 ). For another example, hints as described in method 1400 may be applied in connection with a face registration user interface (eg, 1104 ). For another example, transitioning a progress meter as described in method 800 may be applied in connection with a registration progress meter (eg, 1110 ). For the sake of brevity, these details are not repeated below.

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 12A and 12B are, optionally, implemented by the components shown in FIGS. 1A and 1B . For example, display operation 1202 , display operation 1208 , detect operation 1216 , update operation 1222 , and update operation 1224 optionally include event classifier 170 , event recognizer 180 . , and the event handler 190 . Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

13A-13R are on an electronic device (eg, device 100 , device 300 , device 500 , device 700 , device 900 , or device 1100 ), according to some examples. Illustrated example user interfaces for registering a biometric feature. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIG. 14 .

13A illustrates an electronic device 1300 (eg, portable multifunction device 100 , device 300 , device 500 , device 700 , device 900 , or device 1100 ). In the illustrative example illustrated in FIGS. 13A-13R , the electronic device 1300 is a smartphone. In other examples, electronic device 1300 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 1300 has a display 1302 , one or more input devices (eg, a touchscreen of the display 1302 , a button, a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 903 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the one or more biometric sensors 1303 are one or more biometric sensors 703 . In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

As illustrated in FIG. 13A , device 1300 displays face registration user interface 1304 on display 1302 . In some examples, the face registration user interface 1304 is displayed after the device 1300 detects successful alignment of the user's face with respect to its one or more cameras, as described above with respect to FIGS. 9A-9Y . . In some examples, face registration interface 1304 has similar visual characteristics to face registration interface 1104 described above with respect to FIG. 11A . The face registration interface 1304 includes a user face image 1306 . In some examples, user facial image 1306 is an image of the user captured by one or more cameras on device 1300 (eg, biometric sensor 1303 ). For example, user face image 1306 may optionally be a live view of image data (eg, a digital viewfinder) captured by one or more cameras that is continuously updated as the camera's field of view and/or contents of the field of view change. it's a preview In some examples, the background content is removed such that only the user's face is visible in the facial image 1306 . The face registration interface 1304 also includes an orientation guide 1308 superimposed on (eg, overlaid on) the user face image 1106 . 7I-7K , orientation guide 1308 optionally extends in a virtual z-dimension (eg, along an axis perpendicular to the plane of the display) and is above the center of user facial image 1306 . A set of intersecting curves (eg, crosshairs). Accordingly, the curves of the orientation guide 1308 optionally appear to bulge outward with respect to the plane of the display 1302, giving a feeling of the position of the user's head in three-dimensional space.

The face registration user interface 1304 includes a registration progress meter 1310 . Registration progress meter 1310 includes a set of display elements (eg, progress elements 1310a , 1310b , 1310c ) arranged around user face image 1306 and orientation guide 1308 . In the example of FIG. 13A , the progression elements are a set of lines arranged in a circular pattern and extending radially outward from the user face image 1306 . In some examples, the progression elements 1310a , 1310b , 1310c , etc. indicate the orientation of the user's face required to register the corresponding facial features. For example, the progression elements within the upper portion of the registration meter 1310 may optionally cause one or more cameras on the device 1300 to capture image data of the underside of the user's face when the user's head is tilted upwards. Do - move (eg, in the manner of FIGS. 11B-11H ), fill in, stretch, and/or change color. In the example of FIG. 13A , device 1310 displays progress elements in registration progress meter 1310 as unregistered (eg, the progress elements are grayed out).

In the example of FIG. 13A , the face registration interface 1304 instructs the user to begin moving their face relative to the device to advance the registration progress meter 1310 (eg, to register their facial features). and a text prompt 1312 . In some examples, device 1300 displays text prompt 1312 before any portion of the user's face is registered.

While displaying the face registration interface 1304 , the device 1300 detects criteria (eg, hints) for displaying registration prompts. In some examples, the registration prompt criteria include a requirement that the user's face has moved less than a first threshold amount in a predetermined period of time, as determined by the biometric sensor 1303 .

In some examples, in response to detecting that these registration hint criteria are met, device 1300 displays an audio hint enabling interface 1314 as shown in FIGS. 13B and 13C . In the example of FIG. 13B , the hint enable interface 1314 includes a text prompt 1316 informing the user of the option to enable or disable audio hints. Accordingly, in some examples, the hint enablement interface 1314 includes a YES affordance 1318 and a NO affordance 1320 . In some examples, in response to activation (eg, selection) of the no affordance 1320 , the device 1300 again displays the face registration interface 1304 , allowing the user to do so without the prompts and/or hints described below. Proceed with registration of his or her facial features. However, in the example of FIG. 13C , device 1300 detects activation (eg, selection) of yes affordance 1310 . In some examples, the activation is a user input (eg, a tap or swipe gesture) in the contact area 1322 .

In response to detecting activation of example affordance 1320 , device 1300 displays hint-enabled registration interface 1324 , eg, as illustrated in the example of FIG. 13D . In some examples, hint-enabled registration interface 1324 or one or more of the prompts described below may indicate whether the user has enabled audio hints or not (eg, that the user's face has not moved sufficiently in a predetermined period of time). ) is displayed in response to detecting that In the example of FIG. 13D , hint-enabled registration interface 1324 includes user face image 1326 having visual characteristics similar to or identical to user face image 1306 . For example, in some examples, user facial image 1326 is an image of the user captured by one or more cameras on device 1300 (eg, biometric sensor 1303 ). For example, user facial image 1326 may optionally include image data (eg, digital viewfinder) captured by biometric sensor 1303 that is continuously updated as the camera's field of view and/or contents of the field of view change. is a live preview of In some examples, hint-enabled registration interface 1324 includes a visual movement prompt 1328 that is optionally overlaid (eg, overlaid) on user face image 1326 . In the example of FIG. 13D , the visual movement prompt 1328 indicates that the user must move (eg, rotate and/or tilt) his or her face in order to register a corresponding portion (eg, angular view) of the face. Contains an arrow element indicating the requested direction. In some examples, the visual movement prompt 1328 is partially transparent such that the underlying user face image 1326 is also visible. In the example of FIG. 13D , the arrow element of the visual movement prompt 1328 prompts the user to move their face to the right (eg, towards the right portion of the registration progress meter 1330 to register an angular view of the left side of the user's face). ) to move (eg, rotate, tilt, or turn).

In some examples, device 1300 displays text prompt 1332 that provides the user with written instructions matching visual navigation prompt 1328 . In the example of FIG. 13D , text prompt 1332 provides the user with written instructions to turn their head to the right (eg, in the same direction as indicated by the arrow element in visual prompt 1328 ). In some examples, device 1300 also issues audio output 1334 corresponding to visual navigation prompt 1328 and/or text prompt 1328 . For example, when the screen reader function is enabled, the audio output 1334 is a verbal description of the requested movement (eg, an audible mention of the text prompt 1332 ). In some examples, audio output 1334 is issued instead of or in addition to visual navigation prompt 1328 and/or text prompt 1332 . In some examples, device 1300 also issues a tactile output 1336 (eg, vibration) (eg, instead of or in addition to audio output 1334 ). In some examples, audio output 1334 and/or tactile output 1336 coincide with movement (eg, animation) of visual movement prompt 1328 , as described in more detail below.

In some examples, device 1300 displays an animation of visual movement prompt 1328 to provide an additional indication of the requested movement. 13D and 13E , device 1300 transitions the display of the arrow element of visual prompt 1328 in the requested direction of movement (eg, to the right). In some examples, visual prompt 1328 also includes one or more lines (eg, arcs) extending over a central portion of user facial image 1326 . In some examples, these lines appear to extend out of the plane of the display 1302 in a virtual z-dimension (eg, perpendicular to the display). In the examples of FIGS. 13D and 13E , device 1300 rotates an arc in the requested movement direction (eg, to the right) to provide a visual demonstration of the requested movement in three dimensions accompanying movement of the arrow element. make it In some examples, while displaying the animation of the visual movement prompt 1328 , the device 1300 continues to display the text prompt 1332 . In some examples, device 1300 is configured to, while displaying animation, audio output 1334 and/or tactile output 1336 - such that the outputs correspond to movement of the arrow and/or arc element of visual prompt 1328 to - is issued.

In some examples, while displaying the visual movement prompt 1328 and/or the text prompt 1332 , the device 1300 may (eg, for a second time) the orientation of the user's face relative to the biometric sensor 1303 . It detects that it has not changed for this predetermined amount of time. In response, device 1300 issues a tactile output (eg, tactile output 1338 shown in FIG. 13E ). In some examples, tactile output 1338 is generated as an error to indicate that face registration has stopped (eg, because the user has not moved his or her face for a predetermined amount of time).

In the example of FIG. 13F , in response to detecting that the orientation of the user's face has not changed for a predetermined amount of time, the device 1300 performs a second set of prompting the user to move his or her face in a different direction. Display the registration hints of In the example of FIG. 13F , device 1300 displays a second visual movement prompt 1340 . The second visual movement prompt 1340 has similar visual characteristics to the visual movement prompt 1328 , but corresponds to a second requested direction of movement (eg, up instead of to the right) that is different than the visual prompt 1328 . For example, the second visual movement prompt 1340 includes a second arrow element that points in a different direction (eg, upward instead of to the right) than the arrow element of the visual movement prompt 1328 . Additionally, in some examples, the second visual movement prompt 1340 includes an arc element similar to the arc element of the visual prompt 1328 , which is the requested second prompt as described below with respect to FIGS. 13F and 13G . It is used to provide a visual proof of the direction of movement.

In some examples, the second set of registration hints includes a text prompt 1342 that provides the user with written instructions matching the visual navigation prompt 1340 . In the example of FIG. 13F , text prompt 1342 provides the user with written instructions to tilt their head upward (eg, in a second direction indicated by the arrow element of second visual prompt 1340 ). In the example of FIG. 13F , device 1300 also issues an audio output 1344 corresponding to a second visual navigation prompt 1340 and/or a text prompt 1342 . For example, when the screen reader function is enabled, the audio output 1344 is a verbal description of the requested movement (eg, an audible mention of the text prompt 1342 ). In some examples, device 1300 issues a tactile output 1346 (eg, vibration) (eg, instead of or in addition to audio output 1334 ).

13F and 13G , in some examples, device 1300 displays an animation of visual movement prompt 1340 to provide an additional indication of the second requested direction of movement. 13F and 13G , the device 1300 transitions the display of the arrow element of the second visual prompt 1340 in the second requested direction of movement (eg, upward). In the examples of FIGS. 13F and 13G , the animation is also in a second requested direction of movement (eg, upward into the plane of the display) to provide a visual demonstration of the requested movement in three dimensions accompanying movement of the arrow element. ) rotate the arc element of the second visual prompt 1340 . In some examples, while displaying the animation of the visual movement prompt 1340 , the device 1300 continues to display the text prompt 1340 . In some examples, device 1300 is configured to, while displaying animation, audio output 1344 and/or tactile output 1346 , such that these outputs correspond to movement of the arrow and/or arc element of visual prompt 1340 . - is issued.

Referring now to FIG. 13H , the device 1300 is configured to change the orientation of the user's face relative to the biometric sensor 1303 (eg, the user moves his or her face upwards, ie, in the second requested direction of movement). tilted or tilted) is detected. In response to detecting the change in orientation, the device displays (eg, for a second time) the face registration interface 1304 , described above with respect to FIG. 13A . In the example of FIG. 13H , device 1300 updated (eg, displayed movement of) user face image 1306 to reflect the change in orientation of the user's face. In some examples, orientation guide 1308 tracks (eg, moves with) movement of user's facial image 1306 to visually highlight tilting and rotational movements of the user's face in three dimensions. For example, a center (eg, an intersection) of orientation guide 1308 is optionally positioned at a center point on user face image 1306 and moves with it. In some examples, device 1300 also adjusts the curvature of the lines comprising orientation guide 1308 to give the appearance of three-dimensional rotation (eg, upward into the plane of the display). In some examples, device 1100 highlights orientation guide 1108 while it moves (eg, while the orientation of the user's face is changing). For example, device 1300 may optionally darken orientation guide 1308 while it moves and/or displays fading traces as it tracks movement of the user's face. In this case, device 1300 optionally reduces this emphasis on orientation guide 1308 relative to user face image 1306 when the user's face is not moving.

13G , in response to detecting that the user's face is oriented towards the progress meter portion 1348 (eg, a set of one or more progress elements such as 1310a, 1310b, 1310c), the device ( 1300 updates the display of the progress elements in the meter portion 1348 to a “Registering” state by changing the appearance of the progress elements in the meter portion 1348 . For example, device 1300 optionally enlarges and/or changes the color of progress elements within meter portion 1348 while the user's face is oriented towards meter portion 1348 . In some examples, device 1300 stretches progress scales and changes their color from gray to blue when updating progress elements to a “Registering” state. In some examples, changing the display of progress elements to a “Registering” state in this way indicates that the device 1300 is capturing facial imaging data for an angular view corresponding to the current orientation of the user's face (eg, , are registered). In the example of FIG. 13G , device 1300 maintains progress elements in progress meter 1310 (eg, progress elements that are not part of meter portion 1348 ) unregistered (eg, grayed out) by , indicating that the device 1300 has not yet detected the user's face in orientations corresponding to those progression elements. In some examples, the display of the meter portion 1348 is updated in this manner only when the user's face is rotated sufficiently toward the meter portion 1348 (eg, the user's face is rotated by at least a threshold amount or a threshold angle). do.

Referring now to the example of FIG. 13I , the device 1300 determines that the user's face is no longer in the orientation corresponding to the meter portion 1348 (eg, the user has tilted their head downward back to the neutral position) ) is detected. In response, device 1300 changes the appearance of the progress elements in meter portion 1348 back to the “registered” state. In the example of FIG. 13I , device 1300 updates the display of progress graduations in portion 1348 from the extended “Registering” state by again shortening the progress graduations and changing their color. For example, progress elements in a "registered" state may be the same length and/or size as progress elements in a "unregistered" state, but with a corresponding portion of the user's face (eg, FIG. 11J ) as described above with respect to FIG. The angle view captured in 13j) is displayed in green to indicate that it has been successfully registered. In the example of FIG. 13J , device 1300 maintains other progress elements in enrollment progress meter 1310 as unregistered, indicating that the device has not yet detected the user's face in an orientation corresponding to those progress elements. . In response to detecting a change in facial orientation, device 1300 also moves orientation guide 1308 such that it tracks movement of user facial image 1306 in the digital viewfinder.

Referring now to the example of FIG. 13J , after detecting the change in orientation shown in FIG. 13I , the device is configured to: (eg, for a second time) the orientation of the user's face relative to the biometric sensor 1303 for a predetermined period of time It detects that it has not changed during In response, device 1300 displays hint-enabled registration interface 1350 . In some examples, hint-enabled registration interface 1350 is automatically displayed. In some examples, hint-enabled registration interface 1350 is responsive to detecting activation (eg, selection) of an affordance (eg, similar to yes affordance 1318 on hint enable interface 1314 ). is displayed. In some examples, hint-enabled registration interface 1350 and its components (eg, user facial expression 1352 , registration progress meter 1354 , visual navigation prompt 1356 , and text prompt 1358 ) It has the same visual characteristics as described above with respect to hint enable interface 1324 in FIG. 13D . However, in the example of FIG. 13J , device 1300 displays progress elements within meter portion 1360 of registration progress meter 1354 in a “registered” state, which is a face corresponding to the same portion of progress meter 1330 . This is because the orientation has already been registered (eg, in the manner of FIG. 13H ).

In the example of FIGS. 13J and 13K , device 1300 displays an animation of visual movement prompt 1356 prompting the user to move his or her face to an orientation that has not yet been registered. For example, the animation of the visual prompt 1356 prompts the user to move his or her face in a first requested direction (eg, to the right). The animation of the visual movement prompt 1356 has similar or identical characteristics to the animation of the visual movement prompt 1328 described above with respect to FIGS. 13D and 13E . For example, the device 1300 transitions the display of the arrow element of the visual prompt 1356 in the requested direction of movement (eg, to the right) corresponding to a face orientation that has not yet been registered. In the examples of FIGS. 13J and 13K , the animation also provides a visual prompt 1356 in the requested movement direction (eg, to the right) to provide a visual demonstration of the requested movement in three dimensions accompanying movement of the arrow element. Rotate the arc element of In some examples, while displaying the animation of the visual movement prompt 1356 , the device 1300 continues to display a text prompt 1358 , which provides a written description of the requested movement. In some examples, device 1300 is configured to, while displaying animation, audio output 1362 and/or tactile output 1364 - such that these outputs correspond to movement of the arrow and/or arc element of visual prompt 1340 . to - is issued.

Referring to the example of FIG. 13L , device 1300 has detected that the orientation of the user's face with respect to biometric sensor 1303 has not changed for a predetermined amount of time (eg, during a third time period). In the example of FIG. 13L , in response to detecting little to no change in the orientation of the user's face, device 1300 displays accessibility registration interface 1368 . In some examples, the accessibility registration interface includes a user face image 1370 , which optionally has similar or identical characteristics to the user face image 1308 . In particular, user facial image 1370 is optionally a live preview of image data captured by biometric sensor 1303 . In the example of FIG. 13L , accessibility registration interface 1368 includes registration progress meter 1372 , which is optionally displayed surrounding user face image 1370 . In some examples, the display of the meter portion 1370 is (eg, while the device 1300 displayed the registration interface 1304 or hint-enabled registration interfaces 1324 and/or 1350 during a previous stage of registration) Indicating previously registered orientations and/or portions of the user's face. For example, device 1300 displays progress elements within portion 1374 of progress meter 1370 (which corresponds to meter portions 1348 and/or 1360 ). In the example of FIG. 13L , the accessibility registration interface 1368 also includes an accessibility option affordance 1378 . In some examples, activation of accessibility option affordance 1378 allows the user to set up biometric (eg, facial) authentication with partial scan only (eg, after registering only a subset of facial orientations or portions to be registered during the full scan). make it

In the example of FIG. 13M , device 1300 detects activation (eg, selection) of accessibility option affordance 1378 (eg, by user input 1380 ). In response to detecting activation of accessibility option affordance 1378 , device 1300 displays completion affordance 1382 on the accessibility registration interface as illustrated in FIG. 13N . In some examples, activation of the completion affordance causes the device to proceed using only a partial scan of their facial features.

In the example of FIG. 13O , device 1300 detects activation (eg, selection) of completion affordance 1382 via user input 1384 . In response to detecting activation of the completion affordance, device 1300 displays partial scan acknowledgment interface 1386 as illustrated in FIG. 13P . The partial scan acknowledgment interface includes a user face image 1387 , which optionally has some or all of the visual characteristics of the user face image 1370 . Because the portion of the user's face has been successfully registered, device 1300 also displays registration success indicator 1388 , eg, proximate to and/or surrounding user face image 1387 . In the example of FIG. 13P , partial scan acknowledgment interface 1386 includes text prompt 1389 that provides a written indication that image data corresponding to at least a portion of the user's face has been successfully captured and registered. In the example of FIG. 13P , device 1300 displays registration completion affordance 1390 .

In the example of FIG. 13Q , device 1300 detects activation (eg, selection) of registration completion affordance 1390 via user input 1392 . In some examples, in response to detecting activation of the registration completion affordance, device 1300 registers image data of one or more angular views (eg, orientations) of the user's face captured during the registration process described above. Optionally, device 1300 issues tactile output 1393 to acknowledge completion of the registration process. In some examples, tactile output 1393 is the same tactile output that is issued in response to a successful biometric application at device 1300 . In the example of FIG. 13Q , device 1300 replaces the display of success indicator 1388 with partial enrollment indicator 1391 proximate face image 1387 , which visually displays orientations of the successfully enrolled user's face. is indicated by In some examples, the size (eg, arc length) and location of the partial registration indicator 1391 correspond to portions of the progress meter (eg, 1310 , 1354 , 1372 ) that transitioned to a “registered” state during registration. In the example of FIG. 13Q , device 1300 displays partial registration indicator 1391 at a location similar to meter portion 1374 to indicate that one or more facial orientations corresponding to meter portion 1374 have been successfully registered. do.

In the example of FIG. 13R , in response to detecting activation (eg, selection) of the registration completion affordance 1390 (eg, by user input 1392 ), the device 1300 displays the registration completion interface 1394 . do. As shown in FIG. 13R , the registration completion interface 1394 includes a biometric authentication glyph 1395 . For example, biometric authentication glyph 1395 is optionally a line drawing of all or part of a face (eg, a stylized face graphic). In the example of FIG. 13R , registration complete interface 1394 also includes a text prompt 1396 indicating that the registration process is complete and facial authentication at the device is set up and/or enabled. In some examples, registration completion interface 1394 also includes completion affordance 1397 , the activation of which causes device 1300 to complete face authentication setup. In some examples, registration completion interface 1394 does not include face image 1387 .

14 is a flow diagram illustrating a method for providing hints for effectively registering a biometric feature on an electronic device, in accordance with some examples. Method 1400 includes a device having a display, one or more input devices (eg, a touchscreen, a microphone, a camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 1300). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 1400 provides an intuitive method for providing hints for effectively registering a biometric feature on an electronic device. This method reduces the user's cognitive burden of registering biometric features on the device, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to register a biometric feature faster and more efficiently saves power and increases the time between battery charges.

The device may be configured to, on the display, provide a biometric feature for registering a biometric feature (eg, a user's face, fingerprint, iris, palm print, or other physical biometric feature that may be used to distinguish one person from another). A registration user interface (eg, 1304, 1324) is displayed (1402). Displaying the biometric enrollment user interface includes displaying a representation of the biometric feature (eg, 1306 , 1326 , a representation of a head of a user of the device). The appearance of the representation of the biometric feature changes ( 1404 ) as the orientation of the biometric feature with respect to one or more biometric sensors (eg, 1303 ) changes. For example, the orientation of the biometric feature with respect to the one or more biometric sensors can optionally be determined by alignment of the user's face in image data captured by the one or more cameras (eg, in the field of view of one or more of the cameras). camera data including the user's head being positioned). Displaying a preview of the image captured by the biometric sensors provides the user with feedback regarding the position and orientation of his or her biometric features relative to the biometric sensors of the device, so that the user can It allows him or her to properly align his or her biometric features with the sensors more quickly and efficiently to properly register them. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

While displaying the biometric enrollment user interface, the device detects ( 1406 ) that enrollment prompt criteria have been met with respect to one or more portions of the biometric feature.

In some examples, the registration prompt criteria include a requirement that the biometric feature moves less than a first threshold amount for at least a first threshold period (as determined by the one or more biometric sensors) ( 1408 ). Automatically enabling registration hints after detecting little to no movement of the user's biometric feature reduces the time required to complete the registration process, which in order to quickly and automatically perform the required movements. This is because the troubled user receives instructions on how to proceed with the registration process. Performing an optimized set of actions when a set of conditions are met without requiring additional user input (eg, helping the user to provide appropriate inputs when operating/interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. .

In response to detecting that the registration prompt criteria have been met with respect to one or more portions of the biometric feature, the device may perform a respective prompt to move the biometric feature in a respective manner (eg, 1328, 1332, 1334, 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346 (eg, visual, audible, and/or tactile prompts) are output (1410). Each prompt is selected ( 1412 ) based on a registration status of one or more portions of the biometric feature (eg, whether the first portion and/or the second portion of the biometric feature has been registered). In particular, upon determining that the enrollment prompt criteria have been met with respect to a first portion of the biometric feature that can be enrolled by moving the biometric feature in a first manner, the device prompts to move the biometric feature in a first manner. (eg, 1328, 1332, 1334, 1336) is output (1424). In accordance with a determination that registration prompt criteria have been met with respect to a second portion of the biometric feature that can be enrolled by moving the biometric feature in a second manner different from the first manner, outputting a respective prompt is configured in the second manner outputting 1426 a prompt (eg, 1340 , 1342 , 1344 , 1346 ) to move the biometric feature to Providing visual and/or audible prompts to move the biometric feature in a particular direction allows the user to quickly and intuitively realize a manner of positioning the biometric feature so that the corresponding portion can be registered. These prompts allow the user to move the biometric feature through a range of orientations required for the enrollment process, faster and more efficiently than they would otherwise. Accordingly, providing improved visual and/or audible feedback with instructions for appropriate movements of a biometric feature (eg, assisting a user in providing appropriate inputs when actuating and/or interacting with a device) It improves the operability of the device (by reducing user errors) and makes the user-device interface more efficient, which additionally reduces the device's power usage and battery life by enabling the user to use the device more quickly and efficiently. to improve

In some examples, upon determining that the audible prompt criteria are met (eg, determining whether a screen reader function of the device is enabled), the device (eg, in lieu of or in addition to one or more visual prompts) Outputs an audible prompt (eg, 1334 ) to move the biometric feature in one way. In some examples, upon determining that the audible prompt criteria are not met, the device provides the user with an option to enable audible prompts for biometric enrollment. For example, the device displays an affordance (eg, 1318 ), which, when selected by a user, describes steps for causing audible prompts to be enabled, or for enabling audible prompts for biometric enrollment. audio prompts (eg, 1334, 1344). Providing audible instructions to move the biometric feature in a particular direction allows a user to quickly and intuitively realize how to position the biometric feature so that the corresponding part can be registered. These prompts allow the user to move the biometric feature through the series of orientations required for the enrollment process, faster and more efficiently than they would otherwise. Thus, providing improved auditory feedback with instructions for appropriate movements of a biometric feature helps the user to provide appropriate inputs (eg, when operating/interacting with a device) and reduces user errors. ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device configures each prompt (eg, 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346, eg, visual, audible, and/or tactile prompt). For example, each prompt optionally indicates 1422 that the user should begin tilting their head to begin the registration process.

In some examples, the device configures each prompt (eg, 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346, eg, visual, auditory, and/or tactile) after at least a portion of the biometric feature is registered. enemy prompt). For example, the prompt optionally indicates that the user must continue tilting their head to continue the registration process. Automatically issuing prompts to move the biometric feature in the second direction after the user moves the biometric feature in the first direction reflects how the user continues to move the biometric feature to proceed with the enrollment process. to understand quickly and intuitively. Helping the user understand how to sequence the required movement of the biometric feature reduces the time required to complete registration of the biometric feature. Thus, performing an optimized set of actions when a set of conditions are met without requiring additional user input (eg, assisting the user in providing appropriate inputs when actuating/interacting with the device and allowing the user to By reducing mistakes), it improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and shortens the battery life by enabling the user to use the device more quickly and efficiently. improve

In some examples, the device outputs a tactile output (eg, 1336 , 1346 ). In some examples, the tactile output is accompanied by an auditory output (eg, 1334 , 1344 ). In some examples, the tactile output and/or audio output is generated to coincide with movement of the visual prompt (eg, 1328 , 1340 ). For example, the tactile outputs optionally correspond to movement of an arrow or arc (eg, arrow element and arc element at 1328 and/or 1340 ) in a direction in which the user is being prompted to move the biometric feature. .

In some examples, each prompt includes a tactile output (eg, 1338 , 1366 ) used to indicate failed biometric authentication by the device. For example, a tactile output generated as an error when biometric enrollment is aborted due to a failure to change the orientation of a biometric feature with respect to one or more biometric sensors can be a tactile output used to indicate failed biometric authentication. Same as output.

In some examples, the device overlays a visual prompt (eg, 1328 , 1340 , 1356 ) on the representation of the biometric feature. For example, the visual prompt is optionally an arrow indicating the respective manner (direction) to move the biometric feature (such as up, down, left, right, at a diagonal angle between those directions). In some examples, the visual prompt is partially transparent. Displaying a visual prompt, such as an arrow element, in the requested direction of movement allows the user to quickly understand how to move the biometric feature so that the portion of the feature corresponding to the requested direction can be properly registered. This allows the user to perform the requested movement more quickly and efficiently, reducing the time required by the registration process. Thus, providing an improved visual prompt that illustrates appropriate movements of a biometric feature can be achieved by helping a user provide appropriate inputs and reducing user errors when actuating/interacting with the device (eg, by helping the user to provide appropriate inputs). It improves operability and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device prompts an animated prompt to move the biometric feature in a respective manner (eg, 1328, 1340, or 1328, 1340 described in connection with FIGS. 13D and 13E, 13F and 13G, or 13J and 13K, or animation of 1356) is displayed (1414). For example, the device optionally displays an animation prompting movement in a first manner relative to the first portion of the biometric feature (eg, the animation of 1328 shown in FIGS. 13D and 13E ), the biometric feature Display an animation (eg, the animation of 1340 in FIGS. 13F and 13G ) prompting movement in a second manner with respect to the second portion of the portion. In some examples, displaying the animated prompt includes displaying ( 1416 ) an arrow element (eg, an arrow element of 1328 , 1340 , or 1356 ) indicating each manner of moving the biometric feature. Displaying an animation that intuitively illustrates the requested direction of movement allows the user to quickly understand how to move the biometric feature so that the portion of the feature corresponding to the requested direction can be properly registered. This allows the user to perform the requested movement more quickly and efficiently, reducing the time required by the registration process. Thus, providing improved visual feedback with intuitive examples of appropriate movements of a biometric feature (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the device outputs ( 1420 ) at least one of a tactile output (eg, 1336 , 1346 , 1364 ) or an auditory output (eg, 1334 , 1344 , or 1362 ) corresponding to the animation. For example, the animation optionally zooms in and out of the biometric feature. Alternatively and/or additionally, one or more elements of the registration user interface (eg, 1324 , 1350 ) optionally temporarily change state. In general, the tactile output is synchronized with the animation. Providing tactile and/or audio outputs accompanying a visual illustration of the requested movement allows the user to quickly understand how to move the biometric feature so that the portion of the feature corresponding to the requested orientation can be properly registered. do. This allows the user to perform the requested movement more quickly and efficiently, reducing the time required by the registration process. Thus, providing improved tactile and/or audible feedback accompanying animation may be beneficial to a device (eg, by helping a user provide appropriate inputs and reducing user errors when actuating and/or interacting with a device) It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the first manner of movement comprises rotation about an axis parallel to the display (eg, in the plane of the display 1302 ) and the second manner of movement comprises rotation about an axis parallel to the display. include In this case, the animation prompt (eg, the animation of 1328, 1340, or 1356 described in connection with FIGS. 13D and 13E, 13F and 13G, or 13J and 13K) is centered on an axis parallel to the display. and a simulated rotation of a user interface element (eg, an arc element of 1328 , 1340 , or 1356 ) ( 1418 ). For example, if the user is being prompted to rotate the biometric feature in a clockwise direction about an axis parallel to the display, the animation optionally includes movement of the user interface element in a clockwise direction about an axis parallel to the display do. Similarly, if the user is being prompted to rotate the biometric feature counterclockwise about an axis parallel to the display, the animation optionally includes movement of the user interface element in a counterclockwise direction about an axis parallel to the display do. Displaying the simulated rotation of the orientation element to illustrate the requested movement allows the user to quickly understand how to move the biometric feature so that the portion of the feature corresponding to the requested orientation can be properly registered. This allows the user to perform the requested movement more quickly and efficiently, reducing the time required by the registration process. Thus, providing improved visual feedback with intuitive examples of appropriate movements of a biometric feature (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the biometric enrollment user interface is overlaid on the representation (eg, 1306 ) of the biometric feature (eg, as described above with reference to method 1200 ) and the representation of the biometric feature in different directions and an orientation guide (eg, 1308 ) that tilts in different directions as it tilts. In this example, in accordance with a determination that registration prompt criteria have been met with respect to a first portion of a biometric feature that can be enrolled by moving the biometric feature in a first manner, an animated prompt (eg, FIGS. 13D and 13E or FIGS. 13J and the animation of 1328 or 1356 described in connection with FIG. 13K ) shows movement of a portion of the orientation guide (eg, the vertical component of 1308 ) in a direction that the orientation guide would have moved if the biometric feature had moved in the first manner. includes Displaying and/or rotating the orientation guide overlaid on the representation of the biometric feature provides the user with feedback regarding the orientation of his or her biometric features relative to the device's biometric sensors in three-dimensional space. This allows the user to more quickly move the biometric feature through the required orientation range during the registration process. Thus, providing the user with improved visual feedback regarding the orientation of the biometric feature may be beneficial to the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device). It improves operability and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

Likewise, in accordance with a determination that registration prompt criteria have been met with respect to a second portion of the biometric feature that can be enrolled by moving the biometric feature in a second manner, an animated prompt (eg, described with respect to FIGS. 13F and 13G ) 1340) includes movement of the portion of the orientation guide in a direction that the orientation guide would have moved if the biometric feature had moved in the second manner. In some examples, the orientation guide includes a first portion (eg, a horizontal component of 1308, eg, a first arc) and a second portion (eg, a horizontal component of 1308, eg, a second arc that intersects the first arc). and the animation prompt (e.g., the animation of 1340 shown in FIGS. 13F and 13G ) moves the first portion of the orientation guide without moving the second portion, or moves the second portion without moving the first portion. includes moving. In some examples, when the first portion of the orientation guide is moving, the second portion stops being displayed. Similarly, if the second part is moving, the first part stops being displayed. In some examples, if registration is required for a portion of a biometric feature that is not visible when the feature is tilted up, down, left, or right, the animation moves diagonally, prompting the user to display the biometric feature in the diagonal direction. prompts you to tilt to .

In some examples, after outputting each prompt to move the biometric feature in a respective manner (eg, 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346), and detecting movement of the biometric feature In response to doing so, the device registers each portion of the biometric feature. Optionally, the device updates the progress indicator (eg, 1310 , 1330 ) as described in method 1200 . While registering each portion of the biometric feature, the device optionally stops providing prompts. Updating the progress indicator during registration in this way encourages the user to look at the display of the electronic device during registration, improving the ability to detect when the gaze is towards the display and thus whether the user is paying attention to the device. make it Encouraging the user to view the display of the electronic device improves the operability of the device and enhances the user- It makes the device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, after registering each portion of the biometric feature, the device determines that registration prompt criteria have been met with respect to the one or more portions of the biometric feature. In response to determining that enrollment prompt criteria have been met with respect to one or more portions of the biometric feature (eg, the user stops responding during enrollment for a threshold period of time), the device configures the biometric feature for which enrollment prompt criteria were met. output a different respective prompt (eg, 1356 , 1358 , 1362 , 1364 ) to move the biometric feature in a respective manner determined based on one or more portions of the portion. For example, the device begins to prompt the user to change the orientation of the biometric feature relative to one or more biometric sensors to register portions of the biometric feature that have not yet been registered. In some examples, the prompts have similar characteristics to the other prompts described above. In some examples, the prompts proceed in a manner similar to the prompts described above. In some examples, a first prompt (eg, 1356, 1358, 1362, 1364) is provided in a first direction after a first period of time with little or no movement of the biometric feature relative to the one or more biometric sensors; a second prompt is provided in a second direction after a second period of time (longer than the first period) with little or no movement of the biometric feature relative to the above biometric sensors; An option is provided (eg, 1382 , 1390 ) to complete the biometric registration without registering all portions of the biometric feature after a third period of time (longer than the first period) with little or no movement of the portion. Automatically providing prompts to move the biometric feature in a different direction after detecting little to no movement of the biometric feature is a first step by providing instructions on how to proceed with the enrollment process quickly and automatically. Assist users who are struggling or unable to perform a movement in a direction. Performing an optimized set of actions when a set of conditions are met without requiring additional user input (eg, helping the user to provide appropriate inputs when operating/interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. .

In some examples, after outputting each prompt to move the biometric feature in a respective manner (eg, 1328, 1332, 1334, 1336, 1340, 1342, 1344, 1346, 1356, 1358, 1362, 1364), Upon determining that the accessibility prompt criteria have been met, the device displays an option (eg, 1378 ) to proceed with registration without further changes in the orientation of the biometric feature with respect to one or more biometric sensors (eg, 1303 ) do (1428). The accessibility prompt criteria include a requirement that the orientation of the biometric feature with respect to the one or more biometric sensors changed less than a predetermined amount during each time period ( 1430 ). For example, the user's biometric feature has not been detected as moving for a threshold period of time after providing the second prompt (eg, 1340 , 1342 , 1344 , 1346 ). In this case, an accessibility affordance (eg, 1378) is displayed and the user optionally selects an accessibility affordance (eg, 1380). In other words, the user may authorize the use of biometric feature authentication for views of the biometric feature from an orientation range that is smaller than the available orientation range. In some examples, each period is greater than the second period. For example, after a delay of little or no movement of the biometric feature relative to one or more biometric sensors (eg, 1303 ), the device first causes movement of the biometric feature in a first direction (eg, 1328, 1332, 1334, 1336); Then, after a delay with little or no movement, the device prompts (eg, using 1340, 1342, 1344, 1346) movement of the biometric feature in the second direction; Then, after an additional delay with little or no movement, the device provides an option (eg, 1378 ) to proceed with registration without further movement of the biometric feature relative to the one or more biometric sensors. In some examples, the accessibility prompt (eg, 1378 ) is displayed after a sufficient amount of the biometric feature has been captured to ensure secure authentication by at least a portion of the biometric feature (eg, one angle of the face is captured Upon registration and registration, a user with limited mobility may select the accessibility option to register the biometric feature using only the registered angles).

In some examples, the device detects selection of the option to proceed with enrollment without further changes in the orientation of the biometric feature relative to the one or more biometric sensors ( 1432 ). For example, in some examples, the device receives a user input (eg, 1382 ) indicating a selection (eg, 1380 ) of an affordance of an accessibility interface (eg, 1368 ) to confirm registration of biometric data. In response to detecting ( 1434 ) selection of an option to proceed with enrollment without further changes in the orientation of the biometric feature with respect to the one or more biometric sensors, the device suspends one or more steps in biometric enrollment (eg, , skipped) (1436). For example, the device may display a second biometric enrollment user interface (eg, second enrollment interface 1138 in FIG. 11H ) to be displayed in a standard enrollment process in which the biometric feature changes orientation as prompted by the device. (eg, there is no second registration flow when the user registers via the accessibility interface, as described with respect to the method of 1200 ).

In some examples, in response to selecting 1434 the option to proceed with registration without further changes in the orientation of the biometric feature with respect to the one or more biometric sensors, the device determines which portions of the biometric feature have been enrolled. Display ( 1438 ) an indication (eg, 1391 and 1389 ) that registration of the biometric feature containing the information is complete. In some examples, the device, when selected, displays an affordance (eg, 1390 ) confirming partial registration of the biometric feature.

In some examples, in response to detecting selection of the option to proceed with enrollment without further changes in orientation of the biometric feature with respect to the one or more biometric sensors, the device configures the biometric feature once the biometric feature has been enrolled. Outputs a tactile output (eg, 1393 ) used to indicate successful biometric authentication by the department. For example, the tactile output generated when biometric enrollment is complete is optionally the same tactile output used to indicate successful authentication with the biometric feature.

Note that the details of the processes described above with respect to method 1400 (eg, FIGS. 14A and 14B ) are also applicable in a similar manner to the methods described herein. For example, method 1400 may optionally include one or more of the characteristics of various methods described herein with reference to methods 800, 1000, 1200, 1600, 1800, 2000, 2200, 2500, 2700. include For example, the accessibility interface described in method 1000 may be applied in connection with an accessibility registration interface (eg, 1368 ). For another example, an orientation guide as described in method 1200 may be applied in connection with an orientation guide (eg, 1308 ). For the sake of brevity, these details are not repeated below.

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 14A and 14B are, optionally, implemented by the components shown in FIGS. 1A and 1B . For example, display operation 1402 , detect operation 1406 , output operation 1408 , output operation 1412 , and output operation 1414 optionally include event classifier 170 , event recognizer 180 . , and the event handler 190 . Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

15A-15T illustrate example user interfaces for biometric authentication, in accordance with some examples. As described in more detail below, the illustrative examples of user interfaces illustrated in FIGS. 15A-15T are used to illustrate the processes described below, including those of FIGS. 16A-16E .

15A illustrates an electronic device 1500 (eg, portable multifunction device 100 , device 300 , or device 500 ). In the illustrative example illustrated in FIGS. 15A-15T , the electronic device 1500 is a smartphone. In other examples, electronic device 1500 may be a different type of electronic device, such as a wearable device (eg, smartwatch). The electronic device 1500 has a display 1502 , one or more input devices (eg, a touchscreen of the display 1502 , a button 1504 , a microphone (not shown)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 1503 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the one or more biometric sensors 1503 are one or more biometric sensors 703 . In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 15A , the electronic device 1500 displays, on the display 1502 , an application interface 1506 that includes a login affordance 1508 . In the example of FIG. 15A , the application is a browser that, in the browser's interface, displays a website (eg, onlinestore.com). In FIG. 15B , while displaying application interface 1506 , electronic device 1500 detects activation of login affordance 1508 . As shown, the activation is a tap gesture 1510 on the login affordance 1508 .

In FIG. 15C , in response to detecting activation of login affordance 1508 , electronic device 1500 initiates biometric authentication. In some examples, initiating biometric authentication includes obtaining (eg, capturing with one or more biometric sensors) data corresponding to at least a portion of the user's biometric feature (eg, the user's face). includes In FIG. 15C , initiating biometric authentication further includes displaying a biometric authentication interface 1512 having biometric authentication glyphs 1514 . In the example of FIG. 15C , biometric authentication glyph 1514 is a simulation of a representation of a biometric feature (eg, face). As can be seen in FIG. 15C , the biometric authentication interface 1512 is overlaid on at least a portion of the application interface 1506 . In some examples, the biometric authentication interface is an operating system level interface (eg, an interface created by the operating system of the device), and the application interface 1506 is an application level interface (eg, a third party separate from the operating system of the device) A user interface created by a child application).

In some examples, the electronic device 1500 initiates biometric authentication in response to activation of a login affordance of the application, while in other examples, the electronic device 1500 responds to loading the application and/or application interface 1506 . to initiate (eg, start automatically) biometric authentication. The application interface is displayed, for example, in response to loading the application (eg, by selecting an icon associated with the application on the home screen of the electronic device 1500 ).

In some examples, including the example of FIG. 15C , the biometric authentication interface is partially translucent. In some examples, the display (eg, visual characteristic) of biometric authentication interface 1512 is based on application interface 1506 . As an example, the one or more colors of the biometric authentication interface 1512 are based on one or more colors of the application interface 1506 . Referring to FIG. 15C , the electronic device 1500 displays an application interface 1506 having a first color scheme, and the biometric authentication interface 1512 is displayed based on the first color scheme (eg, a first color). displayed using colors that contrast with the formulation). 15D , the electronic device 1500 displays an application interface 1507 having a second color scheme different from the first color scheme, and the biometric authentication interface 1512 is displayed based on the color scheme. . Displaying the biometric authentication interface 1512 in this manner allows it to be readily recognized and viewed by a user when the biometric authentication interface 1512 is overlaid on the application interface.

In response to initiating the biometric authentication, the electronic device 1500 captures and processes (eg, analyzes) the biometric data so that, based on the biometric data, the biometric feature (or a portion thereof) is biometrically measured. Determine whether authentication criteria are satisfied (eg, determine whether the biometric data matches the biometric template, within a threshold). In some examples, in response to obtaining the biometric data, the electronic device 1500 displays a biometric authentication animation, which includes, for example, changing the size of a biometric authentication glyph. In some examples, while the electronic device is processing the biometric data, the electronic device displays one or more biometric authentication glyphs and/or biometric authentication animations to indicate that the biometric data is being processed (eg, replace the display of biometric authentication glyphs 1514 with them).

For example, in FIG. 15E , the electronic device displays biometric authentication glyphs 1514 in response to initiating biometric authentication. 15F and 15G , once the electronic device 1500 has obtained biometric data (eg, has obtained sufficient biometric data), the electronic device 1500 displays biometric authentication glyphs (1515 of FIG. 15F ). , 1516 of FIG. 15G , wherein biometric authentication glyph 1514 is replaced by (eg, transitioned to) biometric authentication glyph 1517 ( FIG. 15H ). serves as a part of Referring to FIG. 15H , the electronic device 1500 displays the biometric authentication glyph 1517 to indicate that biometric data is being processed. In some examples, biometric authentication glyph 1517 includes a plurality of rings that rotate in a sphere, eg, while displayed.

In FIG. 15I , the electronic device 1500 determines that the biometric feature satisfies the biometric authentication criteria. In response, the electronic device displays a biometric authentication glyph 1518 in the biometric authentication interface 1512 indicating that the biometric authentication was successful (eg, replacing the display of the biometric authentication glyph 1517 with it) do). Additionally or alternatively, the electronic device outputs a tactile output 1520 indicating that the biometric authentication was successful. After indicating that the biometric authentication was successful, the electronic device 1500 provides authentication information to the application indicating that the biometric feature met the biometric authentication criteria and, consequently, the biometric authentication was successful.

As shown in FIG. 15J , in response to the electronic device 1500 providing authentication information indicating that the biometric feature meets biometric authentication criteria, the application displays the main interface 1522 (eg, the application replace the display of interface 1506 with it). Referring to FIG. 15K , after a predetermined time, the electronic device 1500 stops displaying the biometric authentication interface. Thereafter, the user optionally uses the application (eg, using a username and password for an account associated with the application) as if the user were directly authenticated with the application. In some examples, the electronic device 1500 stops displaying the biometric authentication interface 1512 after a predetermined time after the biometric authentication is complete. In other examples, the electronic device 1500 performs an action such as the application displaying an interface (eg, the main interface 1522 ) and stops displaying the biometric authentication interface 1512 after a predetermined time. .

Alternatively, in FIG. 15L , the electronic device 1500 determines (eg, after displaying the biometric authentication glyph 1517 of FIG. 15G ) that the biometric feature does not satisfy the biometric authentication criteria. In response, the electronic device displays a biometric authentication glyph, such as biometric authentication glyph 1519, within the biometric authentication interface 1512 to indicate that the biometric authentication was unsuccessful (eg, failed). eg, replacing the display of biometric authentication glyphs 1517 with them). In some examples, biometric authentication glyph 1519 is associated with a biometric authentication failure animation. 15L and 15M , in some examples, in response to an unsuccessful biometric authentication, the electronic device 1500 simulates a “head shake” effect and indicates that the biometric authentication was unsuccessful. Displays a biometric authentication failure animation in which the biometric authentication glyph 1519 moves (eg, rotates) side-to-side to indicate. Optionally, the electronic device 1500 outputs a tactile output 1526 indicating that the biometric authentication was not successful. In some examples, tactile output 1526 is the same as tactile output 1520 . In some examples, tactile output 1526 is different from tactile output 1520 . In some examples, the tactile output 1526 is synchronized with the biometric authentication failure animation.

15N and 15O show that, in response to an unsuccessful biometric authentication (as determined with respect to FIG. 15E ), the electronic device 1500 displays the biometric authentication glyph 1514 within the biometric authentication interface 1512 . It illustrates an alternative biometric failure animation that displays (eg, replaces the display of biometric authentication glyph 1517 ( FIG. 15H ) with it). In some examples, during display of the biometric authentication failure animation, the electronic device moves the biometric authentication interface 1512 on the display 1502 . In some examples, the electronic device 1500 moves the biometric authentication interface 1512 left and right to simulate a “shake” effect and indicate that the biometric authentication was unsuccessful. In some examples, the electronic device moves only the biometric authentication glyph 1514 and not the biometric authentication interface 1512 . In other examples, additional or alternative glyphs are used in the biometric authentication failure animation.

As illustrated in FIG. 15P , in some examples, after displaying one or more biometric authentication failure animations, the electronic device displays a biometric authentication interface 1512 having a biometric authentication glyph 1514 . In this manner, the electronic device displays the initial biometric authentication glyph 1514 once more to indicate that the electronic device 1500 is enabled to perform further biometric authentication. In some examples, the electronic device performs a further iteration of the biometric authentication, at least as described in connection with FIGS. 15E-15N .

Referring to FIG. 15Q , in some examples, in response to an unsuccessful biometric authentication, the electronic device 1500 displays a failing interface 1540 (eg, replacing the display of the biometric authentication interface 1512 with it) do). In some examples, displaying the failure interface 1540 includes maintaining display of the biometric authentication interface 1512 . In some examples, the failure interface 1540 includes a biometric authentication glyph 1514 , an alternative authentication affordance 1544 , a retry affordance 1546 , and a revocation affordance 1548 . In some examples, activation of the cancellation affordance 1548 causes the electronic device 1500 to stop displaying the failure interface 1540 .

Referring to FIG. 15R , in some examples, in response to activation of a retry affordance 1546 , such as a tap gesture 1550 , the electronic device 1500 performs another iteration of the biometric authentication. In some examples, electronic device 1500 may display one or more biometric authentication glyphs (eg, 1515 - 1517 ) and/or biometric authentication animation within failure interface 1540 to indicate progress and/or result of biometric authentication. display them Referring to FIG. 15S , in some examples, the electronic device performs biometric authentication only if a threshold number (eg, five) of failed biometric authentication attempts have not been made. In some examples, upon reaching a threshold number of failed biometric authentication attempts, the electronic device 1500 displays an indication 1560 that the threshold number has been reached and consequently biometric authentication is not available (eg, replace the display of the biometric authentication glyph 1514 with it).

In some examples, in response to activation of alternative authentication affordance 1544 , such as tap gesture 1552 , electronic device 1500 displays an alternative authentication interface 1562 (eg, of failure interface 1540 ). to replace the display), whereby the user authenticates using an alternative form of authentication (eg, fingerprint authentication, password authentication) other than authentication associated with the biometric feature. As illustrated in FIG. 15T , the user optionally authenticates by entering the appropriate credentials into the username field 1564 and password field 1566 respectively. In some examples, failure interface 1540 is an operating system level interface that allows a user to be authenticated with an operating system of electronic device 1500 , and alternative authentication interface 1562 is an application level interface that allows a user to authenticate with an application.

16A-16E are flow diagrams illustrating a method for managing peer-to-peer transmissions using an electronic device, in accordance with some examples. Method 1600 includes a device having a display, one or more input devices (eg, touchscreen, microphone, camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection, such as a 4G LTE connection). For example, 100, 300, 500, 1500). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric feature by the one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 1600 provides an intuitive method for managing authentication of biometric features. This method reduces the user's cognitive burden on managing authentication of biometric features, thereby creating a more efficient human-machine interface and intuitive user experience. For battery-operated computing devices, enabling a user to more quickly and more efficiently manage authentication of biometric features saves power and increases the time between battery charges.

Prior to displaying the application interface (eg, 1506 ) and the biometric authentication interface (eg, 1512 ), the electronic device (eg, 100 , 300 , 500 , 1500 ) opens the application (eg, a browser as discussed with respect to FIG. 15A ). application) is loaded (1602). In some examples, the application interface (eg, 1506 ) is not initially installed on the electronic device (eg, 100 , 300 , 500 , 1500 ) and/or operates on the electronic device (eg, 100 , 300 , 500 , 1500 ). An interface to a third-party application that is not provided by the manufacturer of the system or the manufacturer of the device. In some examples, the biometric authentication interface (eg, 1512 ) is an operating system generated asset that is not under the control of an application that corresponds to (eg, creates) the application interface (eg, 1506 ).

An electronic device (eg, 100, 300, 500, 1500) displays, on a display (eg, 1502), an application interface (eg, 1506) corresponding to the application and an electronic device (eg, 100, 300, 500, 1500) of the electronic device (eg, 100, 300, 500, 1500). Simultaneously display ( 1604 ) a biometric authentication interface (eg, 1512 ) controlled by the operating system. Simultaneously displaying the application interface and the biometric authentication interface allows the user to quickly recognize that the biometric authentication requested is related to the application corresponding to the application interface, and further, the user may unintentionally use the application to By helping to avoid executing an action and at the same time making the user aware that authentication is required before the action can be performed, it gives the user more control of the device. Providing additional control of the device in this way without cluttering the UI with additional displayed controls helps the user to provide appropriate inputs and reduces user errors (eg, when operating/interacting with the device) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, a biometric authentication interface (eg, 1512 ) is displayed ( 1606 ) over a portion of an application interface (eg, 1506 ). In some examples, the biometric authentication interface (eg, 1512 ) is not displayed over all of the application interface (eg, 1506 ), and at least a portion of the application interface (eg, 1506 ) remains displayed without being overlaid. In some examples, the biometric authentication interface (eg, 1512 ) is at least partially translucent. In some examples, the biometric authentication interface (eg, 1512 ) is at least partially translucent (or transparent) such that the application interface (eg, 1506 ) is at least partially visible through the biometric authentication interface (eg, 1512 ). In some examples, the biometric authentication interface (eg, 1512 ) obscures the underlying content such that the appearance of the biometric authentication interface (eg, 1512 ) is based on a portion of the blurred content below the biometric authentication interface (eg, 1512 ) to do it In some examples, a biometric authentication interface (eg, 1512 ) is displayed ( 1608 ) in response to loading the application. In some examples, the biometric authentication interface (eg, 1512 ) allows a user to load (eg, initiate or resume execution of) an application on an electronic device (eg, 100, 300, 500, 1500). displayed in response to In some examples, the biometric authentication interface (eg, 1512 ) is loaded after the application is displayed. In some examples, the biometric authentication interface (eg, 1512 ) and the application interface (eg, 1506 ) are displayed concurrently. In some examples, a biometric authentication interface (eg, 1512 ) is displayed ( 1610 ) in response to detecting a user interaction with an application interface (eg, 1506 ) that corresponds to a request to access content that requires authentication. In some examples, the request for authentication is selection of an authentication affordance (eg, 1508 ) or performance of a gesture. In some examples, the application interface (eg, 1506 ) includes an authentication affordance 1506 (eg, a login affordance).

While displaying the biometric authentication interface (eg, 1512 ), prior to obtaining biometric data corresponding to at least a portion of the biometric feature, the electronic device (eg, 100 , 300 , 500 , 1500 ) may use one or more biometric sensors ready to use (eg, 1503). In some examples, in response to the display of the login affordance (eg, 1508 ), the electronic device (eg, 100 , 300 , 500 , 1500 ) prepares (eg, prepares) to use one or more biometric sensors. In some examples, preparing the one or more biometric sensors (eg, 1503 ) for use can cause the sensors (eg, 1503 ) to move from a low power state (eg, a non-powered state or a sleep state) to a low latency state (eg, a partial state). power state or full power state, pre-warmed state). In this way, the electronic device (eg, 100, 300, 500, 1500) optionally reduces the time required to perform biometric authentication when displaying the biometric authentication interface (eg, 1512). In some examples, when the one or more biometric sensors (eg, 1503 ) is in a low power state, it takes a first time to attempt biometric authentication using the one or more biometric sensors, the one or more biometric sensors When (eg, 1503 ) is in a low latency state, it takes a second time less than the first time to attempt biometric authentication using one or more biometric sensors (eg, 1503 ). While displaying the biometric authentication interface (eg, 1512 ), the electronic device (eg, 100 , 300 , 500 , 1500 ) corresponds to at least a portion of the biometric feature from one or more biometric sensors (eg, 1503 ). to obtain biometric data (1612). In some examples, the biometric feature is a face, and the biometric data is data corresponding to a portion of the face.

In response to obtaining, from the one or more biometric sensors, biometric data corresponding to at least a portion of the biometric feature, the electronic device (eg, 100 , 300 , 500 , 1500 ), based on the biometric data, A determination is made whether at least a portion of the measurement feature satisfies biometric authentication criteria ( 1614 ). Determining, based on the obtained biometric data, whether at least a portion of the biometric feature satisfies the biometric authentication criteria is a fast and efficient authentication process that allows the user to easily provide an authentication operation and proceed with it with minimal input makes it possible Reducing the number of inputs needed to perform an operation improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) -Make the device interface more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the electronic device (eg, 100, 300, 500, 1500) is a face (eg, 100, 300, 500, 1500) to which the user's face or fingerprint is applied for use in biometric authentication on the device (eg, 100, 300, 500, 1500). ) and/or stored information about the fingerprint(s). In some examples, determining, based on the biometric data, whether at least a portion of the biometric feature satisfies the biometric authentication criteria includes displaying ( 1616 ) the biometric authentication analysis animation. In some examples, the biometric authentication animation includes displaying a sequence of interface objects (eg, 1514, 1515, 1516, 1517, 1518, 1519) (eg, glyphs). A first interface object (eg, 1514) indicates that biometric authentication has been initiated, and a second interface object (eg, 1517) indicates that a device (eg, 100, 300, 500, 1500) is processing biometric data. , the third interface object (eg, 1518, 1519) indicates whether the biometric authentication succeeded or failed. In some examples, a first interface object (eg, 1514 ) is substantially square in shape and a second interface object (eg, 1517 ) is substantially circular in shape. In some examples, displaying the biometric authentication analysis animation includes rotating one or more rings about an interface object (eg, 1517 , eg, biometric authentication glyph) of the biometric authentication animation. In some examples, the one or more rings are rotated while the device (eg, 100 , 300 , 500 , 1500 ) is processing the biometric data to determine whether the biometric data meets biometric authentication criteria. Rotation of the rings optionally simulates rotation of the rings about a sphere. In some examples, once the device (eg, 100 , 300 , 500 , 1500 ) has finished processing the biometric data, one or more rings are overlaid with each other to prove processing is complete. In some examples, displaying the biometric authentication analysis animation includes an animated object (eg, 1514, 1515) on a platter (eg, 1512) having an appearance based on underlying content (eg, 1506, 1507, 1522). , 1516, 1517, 1518, 1519). In some examples, as the appearance of the animated object changes, the appearance of the platter changes. In some examples, when the animated object gets darker, the platter gets darker, and when the applied object gets lighter, the platter gets lighter. In some examples, the appearance of the platter is an animated object (e.g., 1514, 1515, 1516, 1517, 1518, 1519) change as the appearance changes. In some examples, the one or more colors of the biometric authentication analysis animation are based on one or more colors of the application interface (eg, 1506 ). In some examples, the colors of the animation are selected based on one or more colors of an application interface (eg, 1506 , 1507 , 1522 ) or other interface associated with the application. The colors are optionally derived based, for example, on the colors used for the controls and/or icons of the application. In this way, the animation is optionally visually harmonized with the application interface (eg, 1506, 1507, 1522) to provide a more robust user experience. In some examples, prior to displaying the biometric authentication analysis animation, the electronic device (eg, 100 , 300 , 500 , 1500 ) uses data corresponding to the application interface (eg, 1506 ) or color scheme of the application interface (eg, 1506 ). determine one or more colors of the animation based on the analysis of In some examples, further in response to obtaining, from one or more biometric sensors (eg, 1503 ), biometric data corresponding to at least a portion of the biometric feature, the electronic device (eg, 100, 300, 500, 1500) changes the size of the interface object (eg, 1514) (eg, biometric authentication glyph) of the biometric authentication interface (eg, 1512) from the first size to the second size, and the interface object (eg, 1514) change the size of from the second size to the first size. In some examples, once the biometric data has been captured by the one or more biometric sensors (eg, 1503 ), the interface object (eg, 1514 ) (eg, biometric authentication glyph) is increased from an initial size and subsequently an initial size. Return to to create a "bounce" effect.

Based on the biometric data, upon determining that at least a portion of the biometric feature satisfies the biometric authentication criteria ( 1636 ), the electronic device (eg, 100 , 300 , 500 , 1500 ): one or more portions of the biometric feature Authentication information indicating that the biometric authentication criteria have been satisfied with respect to the data is provided to the application ( 1620 ). Providing authentication information to an application upon a determination that at least a portion of the biometric feature meets biometric authentication criteria improves the security of the device and reduces the number of fraudulent transfers that may occur. Improving device security and reducing the number of fraudulent transmissions improves the operability of the device (eg, by reducing fraud when operating/interacting with the device) and makes the user-device interface more secure.

In some examples, the authentication information is provided by the operating system to the application creating the application interface (eg, 1506 ). In some examples, further, after providing authentication information to the application, according to a determination that, based on the biometric data, at least a portion of the biometric feature satisfies biometric authentication criteria, the electronic device (eg, 100, 300, 500 , 1500 maintain 1624 display of the biometric authentication interface (eg, 1512 ) for a predetermined amount of time. In some examples, further, based on the biometric data, upon determining that at least a portion of the biometric feature meets biometric authentication criteria, the electronic device (eg, 100 , 300 , 500 , 1500 ): Display ( 1622 ) a biometric authentication success animation comprising a first representation (eg, 1518 ) of a simulation of the biometric feature indicating that at least a portion of the copy satisfies the biometric authentication criteria.

In some examples, in response to successful biometric authentication, the device (eg, 100 , 300 , 500 , 1500 ) displays an animation including an interface object (eg, 1518 ) indicating that the biometric authentication was successful. In some examples, further, based on the biometric data, upon determining that at least a portion of the biometric feature meets biometric authentication criteria, the electronic device (eg, 100 , 300 , 500 , 1500 ): and provide a success tactile output (eg, 1520 ) indicating that at least a portion of the portion satisfies the biometric authentication criteria. Displaying an animation indicating that the biometric authentication was successful can provide the user with visual feedback of the action being performed and allow the user to quickly recognize that the action was successful. Providing the user with improved visual feedback (e.g., providing feedback indicative of input that will cause the device to produce the intended result when actuating/interacting with the device prevents the user from achieving the intended result) help and reduce user errors) improve the operability of the device and make the user-device interface more efficient, which additionally reduces the power usage of the device and reduces the battery by enabling the user to use the device more quickly and efficiently. improve lifespan

After maintaining display of the biometric authentication interface (eg, 1512 ) for a predetermined amount of time, the electronic device (eg, 100 , 300 , 500 , 1500 ) stops displaying the biometric authentication interface (eg, 1512 ) (eg, 1512 ). 1626). In some examples, the application receives an indication of authentication before the device (eg, 100 , 300 , 500 , 1500 ) stops displaying the biometric authentication interface (eg, 1512 ); This allows the application to provide (eg, display) the application's interface (eg, 1522 ), such as a “main application” interface or a post login interface, prior to transitioning from the biometric authentication interface (eg, 1512 ). do) do. In some examples, the biometric authentication interface (eg, 1512 ) ceases to be displayed after a predetermined time after authenticating. In some examples, the biometric authentication interface (eg, 1512 ) stops being displayed (eg, unlocks the user interface (eg, 1522 ) after a predetermined time after the application performs an action in accordance with the biometric authentication) displayed).

Based on the biometric data, upon determining ( 1628 ) that at least a portion of the biometric feature does not satisfy the biometric authentication criteria, the electronic device (eg, 100 , 300 , 500 , 1500 ) determines that at least a portion of the biometric feature Display ( 1630 ) a biometric authentication failure animation that includes a second representation (eg, 1519 ) of a simulation of the biometric feature indicating that the biometric authentication criteria are not met. Displaying the biometric authentication failure animation in accordance with a determination that at least a portion of the biometric feature does not satisfy the biometric authentication criteria provides the user with visual feedback of a failure or error in the operation being performed and allows the user to determine if the operation was successful. You can quickly recognize that you haven't. Providing the user with improved visual feedback (e.g., providing feedback indicative of input that will cause the device to produce the intended result when actuating/interacting with the device prevents the user from achieving the intended result) help and reduce user errors) improve the operability of the device and make the user-device interface more efficient, which additionally reduces the power usage of the device and reduces the battery by enabling the user to use the device more quickly and efficiently. improve lifespan

In some examples, in response to the unsuccessful biometric authentication, the device (eg, 100 , 300 , 500 , 1500 ) displays an animation including an interface object (eg, 1519 ) indicating that the biometric authentication was unsuccessful do. In response to an unsuccessful biometric authentication, displaying an animation comprising an interface object indicating that the biometric authentication was unsuccessful provides the user with visual feedback of a failure or error in the operation being performed and allows the user to confirm that the operation is not successful. You can quickly recognize that you have not been successful. Providing the user with improved visual feedback may include helping the user achieve the intended result (eg, by providing feedback indicative of input that will cause the device to produce the intended result when actuating/interacting with the device) help and reduce user errors) improve the operability of the device and make the user-device interface more efficient, which additionally reduces the power usage of the device and reduces the battery by enabling the user to use the device more quickly and efficiently. improve lifespan

In some examples, during animation, an interface object (eg, 1519 ) moves (eg, tilts and/or shifts) in a predetermined manner (eg, left and right) to indicate failure. In some examples, the device (eg, 100, 300, 500, 1500) generates a tactile output (eg, 1526) or a sequence of tactile outputs corresponding to the biometric authentication failure animation (eg, the tactile outputs are biometric A simulation of the measurement feature is created as it moves back and forth). Outputting the tactile output or sequence of tactile outputs corresponding to the biometric authentication failure animation further informs the user that authentication was unsuccessful, and promptly indicates that authentication is still required for the user to perform the action. make it identifiable. Providing the user with improved tactile feedback improves the operability of the device and makes the user-device interface more efficient, which additionally enables the user to use the device more quickly and efficiently, thereby reducing the power of the device. Reduce usage and improve battery life.

In some examples, the second representation (eg, 1519 ) of the simulation of the biometric feature is a three-dimensional object. Displaying the three-dimensional object as a second representation of the simulation of the biometric feature provides the user with easily recognizable visual feedback regarding the state of the operation (eg, whether the transfer was successful or unsuccessful), and the object In addition, because it is three-dimensional, it makes it easier for the user to recognize the object. Providing the user with improved visual feedback (eg, by improving the readability of user interface elements to the user while the device is in natural viewing angles, so that the user provides appropriate inputs when operating/interacting with the device) It improves the operability of the device and makes the user-device interface more efficient (by helping to reduce user errors), which additionally reduces the power usage of the device by enabling the user to use the device more quickly and efficiently. and improve battery life.

In some examples, the second representation (eg, 1519 ) is a three-dimensional face performing a head shake. In some examples, displaying the biometric authentication failure animation includes rotation of the second representation (eg, 1519 ) in a first direction about an axis parallel to the display and an axis parallel to the display (eg, 1502 ). alternating between rotations in a second direction about the center. In some examples, displaying the biometric authentication failure animation includes highlighting a boundary of the biometric authentication interface (eg, 1512 ) relative to the application interface (eg, 1506 ). In some examples, the biometric authentication interface (eg, 1512 ), or a boundary thereof, is collapsed and/or retracted to create a visual “bounce” effect. In some examples, further, based on the biometric data, upon determining that at least a portion of the biometric feature does not satisfy biometric authentication criteria, the electronic device (eg, 100 , 300 , 500 , 1500 ): It provides a different tactile output (eg, 1526) of failure than the output (eg, 1520). In some examples, further, based on the biometric data, upon determining that at least a portion of the biometric feature does not satisfy the biometric authentication criteria, the electronic device (eg, 100 , 300 , 500 , 1500 ) causes the failure interface ( For example, display ( 1632 ) 1540 . In some examples, the failure interface (eg, 1540 ) includes a visual indication that the biometric authentication has failed. In some examples, when biometric authentication fails, the application interface (eg, 1506 ) is not changed (eg, the application remains on the login interface (eg, 1506 ) or the authentication user interface). In some examples, when the biometric authentication fails, the application user interface (eg, 1506 ) is changed to indicate the failure of the biometric authentication. In some examples, the failure interface (eg, 1540) includes (1634) a retry affordance (eg, 1546). In some examples, the failure interface (eg, 1540) includes a cancellation affordance (eg, 1548) (1636). In some examples, the failing interface (eg, 1540) includes (1638) an alternative authentication affordance (eg, 1544).

The electronic device (eg, 100 , 300 , 500 , 1500 ) receives ( 1640 ) an input (eg, 1550 ) corresponding to a selection of a retry affordance (eg, 1546 ). In response to receiving an input (eg, 1550 ) corresponding to a selection of a retry affordance (eg, 1546 ), the electronic device (eg, 100 , 300 , 500 , 1500 ) activates one or more biometric sensors (eg, From 1503 , second biometric data corresponding to at least a portion of a second biometric feature is obtained ( 1642 ). In some examples, the second biometric feature (eg, face) is the same biometric feature as the biometric feature from which the initial biometric data was obtained. In some instances where the second biometric feature is the same biometric feature, the portion of the second biometric feature is a different portion of the same biometric feature from which the initial biometric data was obtained. In some examples, a portion is the same portion of the same biometric feature. In some examples, the second biometric feature is a different biometric feature than the initial biometric feature.

After obtaining the second biometric data corresponding to the at least a portion of the second biometric feature, based on the second biometric data, in determining that the at least a portion of the second biometric feature satisfies the second biometric authentication criteria Accordingly, the electronic device (eg, 100 , 300 , 500 , 1500 ) provides the application with second authentication information indicating that second biometric authentication criteria have been satisfied with respect to one or more portions of the second biometric feature. (1646). In some examples, the second biometric authentication criteria are the same as the initial biometric authentication criteria. In some examples, the second biometric authentication criteria are different from the initial biometric authentication criteria. In some examples, the second authentication information is the same as the authentication information. In some examples, the second authentication information is different from the authentication information. In some examples, the authentication information is provided by the operating system to the application creating the application interface (eg, 1506 ).

The electronic device (eg, 100 , 300 , 500 , 1500 ) receives an input corresponding to selection of a cancellation affordance ( 1646 ). In response to receiving an input corresponding to selection of a revocation affordance, the electronic device (eg, 100 , 300 , 500 , 1500 ) stops displaying the biometric authentication interface (eg, 1512 ) ( 1648 ). In some examples, selection of the revocation affordance releases the failure interface (eg, 1540 ) while maintaining the application interface (eg, 1506 ). In some examples, selection of the revocation affordance also causes the electronic device (eg, 100 , 300 , 500 , 1500 ) to provide information to the application indicating that the first and/or second biometric authentication criteria have not been met .

The electronic device (eg, 100 , 300 , 500 , 1500 ) receives ( 1650 ) an input (eg, 1548 ) corresponding to selection of an alternative authentication affordance (eg, 1544 ). Providing an alternative authentication affordance (eg, to provide an alternative method for providing authentication alternatively to or in addition to biometric authentication) may be one where current authentication methods have not succeeded or will continue to fail. In this case, it allows the user to easily provide authentication for actions using different authentication methods. Providing additional control options (eg, for providing authentication) in this way without cluttering the UI with additional displayed controls allows the user to make appropriate inputs (eg, when operating/interacting with the device). It improves the operability of the device and makes the user-device interface more efficient (by helping to provide and reducing user errors), which additionally reduces the power usage of the device by enabling the user to use the device more quickly and efficiently. Reduce and improve battery life.

In response to receiving an input (eg, 1548 ) corresponding to selection of an alternative authentication affordance (eg, 1544 ), the electronic device (eg, 100 , 300 , 500 , 1500 ) sends an alternative authentication interface (eg, 1562 ) is displayed (1652). In some examples, the alternative authentication interface (eg, 1562 ) is a non-biometric authentication interface (eg, 1512 ). In some examples, an alternative authentication interface (eg, 1562 ) allows a user to authenticate using a password and/or passcode. In some examples, the application determines which form of authentication is accepted by the alternative authentication interface (eg, 1562 ). In some examples, one or more preferences of the application determine what form of authentication is accepted by the application. In some examples, the alternative authentication affordance (eg, 1562 ) includes more than a predefined number of consecutive failures of biometric authentication (eg, 2 failed authentication attempts, 3 failed authentication attempts, 4 failed authentication failures). ) in response to the failure interface (eg, 1540 ). In some examples, the alternative authentication interface (eg, 1562 ) is an application level authentication interface ( 1654 ). In some examples, in response to receiving an input corresponding to selection of an alternative authentication affordance (eg, 1544 ), the electronic device (eg, 100 , 300 , 500 , 1500 ) activates a biometric authentication interface (eg, 1512 ) Stop displaying (1656). In some examples, selection of the alternative authentication affordance (eg, 1544) causes the device (eg, 100, 300, 500, 1500) to stop displaying the alternative authentication affordance (eg, 1544) and at the application level. transition to an alternative authentication interface (eg, 1562) that works. Accordingly, the user is optionally authenticated with the application using credentials associated with the application (eg, the user optionally logs in using a username and password for the application). In some examples, the application level alternative authentication interface (eg, 1562 ) optionally includes an affordance to re-initiate biometric authentication. This will in turn cause the electronic device (eg, 100, 300, 500, 1500) to display the biometric authentication interface (eg, 1512) again and authenticate at the system or operating system level.

Note that the details of the processes described above with respect to method 1600 (eg, FIGS. 16A-16E ) are also applicable in a similar manner to other methods described. For example, method 1600 may optionally include one or more of the features of various methods described herein with reference to methods 800, 1000, 1200, 1400, 1800, 2000, 2200, 2500, 2700. include For example, the registered biometric data described in method 1200 may be used to perform biometric authentication, such as the biometric authentication described with reference to FIGS. 15E-15I . For another example, a biometric authentication interface as described in method 1800 may be used to implement a biometric authentication interface (eg, 1512 ). For the sake of brevity, these details are not repeated below.

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 16A-16E are, optionally, implemented by the components shown in FIGS. 1A and 1B . For example, provide operation 1620 and maintain operation 1624 are optionally implemented by event classifier 170 , event recognizer 180 , and event handler 190 . Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

17A-17J illustrate example user interfaces for biometric authentication, in accordance with some examples. As described in more detail below, the illustrative example of the user interfaces illustrated in FIGS. 17A-17J is used to illustrate the processes described below, including the processes of FIGS. 18A-18D .

17A illustrates an electronic device 1700 (eg, portable multifunction device 100 , device 300 , or device 500 ). In the illustrative example illustrated in FIGS. 17A-17J , the electronic device 1700 is a smartphone. In other examples, electronic device 1700 may be a different type of electronic device, such as a wearable device (eg, smartwatch). The electronic device 1700 has a display 1702 , one or more input devices (eg, a touchscreen of the display 1702 , a button 1704 , a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 1703 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the one or more biometric sensors 1703 are one or more biometric sensors 703 . In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 17A , the electronic device 1700 displays, on the display 1702 , the landing page interface of the application including the login affordance 1706 . As can be seen in FIG. 17A , the application is a browser or mobile application, and the interface corresponds to a website (onlinestore.com). While displaying the landing page interface, the electronic device 1700 detects activation of the login affordance 1706 . 17A , activation is a tap gesture 1708 on a login affordance 1706 .

In FIG. 17B , in response to detecting the tap gesture 1708 on the login affordance 1706 , the electronic device 1700 displays a non-secure data fillable field 1710 (labeled “username”), a secure data populated Displays the application interface of the application including an enable field 1712 (labeled “Password”), and a submission affordance 1714 (eg, replaces the display of the landing page interface with it). The electronic device further displays a biometric authentication glyph (eg, an icon) within the secure data fillable field 1712 . As will be described in further detail, the biometric authentication glyph indicates that the secure data fillable field 1712 is associated with secure data and/or that biometric authentication is required to automatically populate the secure data fillable field 1712 . indicates that

While displaying the application interface, the electronic device 1700 detects a request to automatically populate the non-secure data fillable field 1710 . For example, as shown in FIG. 17B , a request to automatically populate the insecure data fillable field 1710 is a tap gesture 1718 indicating selection of the insecure data fillable field 1710 .

In FIG. 17C , in response to detecting a request to automatically populate the non-secure data fillable field 1710 , the electronic device 1700 activates a keyboard, such as a software keyboard, and/or a keypad and auto-fill affordance 1722 . Display the containing input interface 1720 (eg, overlay on the application interface). While displaying input interface 1720 , electronic device 1700 detects activation of auto-fill affordance 1722 . For example, as shown in FIG. 17A , activation is a tap gesture 1724 on auto-fill affordance 1722 .

17D , in response to detecting the tap gesture 1724 , the electronic device displays a plurality of candidate input affordances 1725 for automatically populating the insecure data fillable field 1710 (eg, auto-fill affordances). (replaces 1722 and/or one or more other affordances of input interface 1720). In the illustrated example, fillable field 1710 is associated with a user name. Thus, in some examples, each of the candidate input affordances 1725 serves as a reference for a respective candidate username.

While displaying the candidate input affordances 1725 of the input interface 1720 , the electronic device detects activation of one candidate input affordance 1725 . For example, as shown in FIG. 17D , activation is a tap gesture 1726 on one candidate input affordance 1725 . In FIG. 17E , in response to detecting the tap gesture 1726 , the electronic device 1700 automatically populates the insecure data fillable field with the candidate input 1728 corresponding to the activated candidate input affordance 1725 .

As described, in response to detecting the tap gesture 1724 , the electronic device provides (eg, displays) candidate input affordances corresponding to respective candidate inputs. In some examples, in response to detecting the tap gesture 1724 , the electronic device determines whether multiple candidate inputs are available. If so, the electronic device 1700 provides the candidate input affordances as described. Any number of candidate input affordances are optionally provided in this manner. If not (eg, when only a single candidate input is available), the electronic device optionally automatically fills in the insecure data fillable field 1710 without providing candidate inputs.

Referring to FIG. 17F , while displaying the application interface, the electronic device 1700 detects a request to automatically populate the secure data fillable field 1712 . For example, a request to automatically populate the secure data fillable field 1712 is a tap gesture 1730 indicating selection of the secure data fillable field 1712 .

In FIG. 17G , in response to detecting a request to automatically populate the secure data fillable field 1712 , the electronic device 1700 initiates biometric authentication. In some examples, initiating biometric authentication includes obtaining data corresponding to a biometric characteristic of the user (eg, capturing with one or more biometric sensors). In some examples, initiating biometric authentication further includes displaying biometric authentication interface 1732 having biometric authentication glyphs 1734 . The biometric authentication glyph 1734 is in some examples a simulation of a representation of a biometric feature. The biometric authentication interface 1732 is overlaid on at least a portion of the application interface in some examples.

Referring to FIG. 17H , in response to obtaining the data, the electronic device processes the biometric data to determine whether the biometric feature satisfies biometric authentication criteria, eg, based on the biometric data. (eg, determine whether the biometric data matches the biometric template, within a threshold). While the electronic device processes the biometric data, the electronic device optionally displays a biometric authentication glyph 1738 within the biometric authentication interface 1732 indicating that biometric data is being processed (eg, biometric authentication). replace the display of the glyph 1734 with it).

In FIG. 17I , the electronic device 1700 determines that the biometric feature satisfies the biometric authentication criteria. In response, the electronic device displays a biometric authentication glyph 1740 in the biometric authentication interface 1732 indicating that the biometric authentication was successful (eg, replacing the display of the biometric authentication glyph 1738 with it) do). Additionally or alternatively, the electronic device outputs a tactile output 1742 indicating that the biometric authentication was successful. After indicating that the biometric authentication is successful, the electronic device automatically populates the secure data fillable field with the appropriate password 1743 , as shown in FIG. 17J . In some examples, the electronic device further automatically fills in a second fillable field, such as insecure fillable field 1710 (eg, with username 1728 ), in response to successful biometric authentication. It will be appreciated that any number and/or type of fillable fields may optionally be automatically populated in response to successful biometric authentication.

While displaying the application interface with automatically populated fillable fields 1710 , 1720 , the electronic device detects activation of the submission affordance 1714 . For example, as shown in FIG. 17J , activation is a tap gesture 1744 on submit affordance 1714 . In response, the user is optionally authenticated with the application, and the electronic device optionally presents a home interface, such as home interface 1782 of FIG. 17S , further referenced below.

Alternatively, in FIG. 17K , the electronic device 1700 determines that the biometric feature does not satisfy the biometric authentication criteria. In response, the electronic device displays a biometric authentication glyph 1746 in the biometric authentication interface 1732 indicating that the biometric authentication was unsuccessful (eg, failed) (eg, the biometric authentication glyph 1738 ). ) to replace the display of it). Optionally, the electronic device outputs a tactile output 1750 indicating that the biometric authentication was not successful. In some examples, tactile output 1750 is the same as tactile output 1742 . In some examples, tactile output 1750 is different from tactile output 1742 . After indicating that the biometric authentication was unsuccessful, the electronic device stops displaying the biometric authentication interface, as illustrated in FIG. 17L .

In some examples, biometric authentication interface 1732 includes an animation and/or one or more of the biometric authentication glyphs of biometric authentication interface 1732 are animated. As an example, biometric authentication glyph 1738 includes rings with a spherical rotation and/or biometric authentication glyph 1746 moves left and right to simulate a “shake” movement.

Referring to FIG. 17M , in some examples, further, in response to an unsuccessful biometric authentication, electronic device 1700 displays a failure interface, such as failure interface 1752 . Failure interfaces include biometric authentication glyphs 1754 , alternative authentication affordances 1756 , retry affordances 1758 , and revocation affordances 1760 . In some examples, activation of the retry affordance 1758 causes the electronic device to re-initiate biometric authentication, as described above. In some examples, the electronic device performs biometric authentication only if a threshold number of failed biometric authentication attempts have not been made. In some examples, activation of the cancellation affordance causes the electronic device 1700 to stop displaying the failure interface 1752 .

Referring to FIG. 17N , in response to activation of an alternative authentication affordance 1756 , such as a tap gesture 1762 , the electronic device 1700 displays an alternative authentication interface 1766 ( FIG. 17O ) (eg, replaces the display of the failure interface 1752 with it), whereby the user can use alternative forms of authentication in addition to authentication associated with a biometric feature (eg, fingerprint authentication, password authentication, passcode authentication, pattern authentication, wherein a pattern Authenticate using a selection of a plurality of items in a predefined pattern or movement of a contact or other input in a predefined pattern). As shown in FIG. 17O , the user optionally touches a fingerprint sensor 1764 of the electronic device with a finger to authenticate.

17P illustrates another example failure interface 1766 including an alternative authentication affordance 1770 . Referring to FIG. 17Q , while displaying the failure interface 1766 , the electronic device 1766 detects activation of the alternative authentication affordance 1770 . By way of example, activation is a tap gesture 1776 on login affordance 1770 . In response to detecting the tap gesture 1776 , the electronic device 1700 displays an alternative authentication interface 1778 . In some examples, alternative authentication interface 1778 is a password (or passcode) interface that allows a user to provide a password (or passcode) to authenticate.

In FIG. 17R , in response to authentication (eg, alternative authentication), the secure data fillable field is automatically populated with a password 1743 and, optionally, the non-secure data fillable field is automatically populated with a user name 1728 . . In this way, the user can optionally build an auto-fill function despite unsuccessful biometric authentication. While displaying the application interface with automatically populated fillable fields 1710 , 1720 , the electronic device detects activation of the submission affordance 1714 . By way of example, activation is tap gesture 1780 on submit affordance 1714 . In response, the user is optionally authenticated with the application, and the electronic device optionally presents a home interface, such as home interface 1782 of FIG. 17S .

In FIG. 17T , the electronic device 1700 displays, on the display 1702 , an application interface 1784 that includes a secure data fillable field 1786 . In response to a request to automatically populate the secure data fillable field 1786 (eg, selection of the secure data fillable field 1786 ), the electronic device 1700 generates an auto-populate affordance 1790 , as illustrated. and display an input interface 1788 including

While displaying the auto-fill affordance 1790 of the input interface 1788 , the electronic device 1700 detects activation of the auto-fill affordance 1790 . For example, as shown in FIG. 17U , activation is a tap gesture 1792 on auto-fill affordance 1792 .

17V-17X , in response to detecting the tap gesture 1792 , the electronic device 1700 initiates biometric authentication, as determined based on biometric data corresponding to the biometric feature. Determine whether at least a portion of the biometric feature, such as, satisfies at least the biometric authentication criteria, described with reference to FIGS. 17G-17I .

In FIG. 17Z , in response to successful biometric authentication, the electronic device 1700 provides a candidate selection interface 1794 that includes a plurality of candidate input affordances 1792 for automatically populating the secure data fillable field 1786 . (eg, replace the display of biometric authentication interface 1732 with it). In some examples, candidate selection interface 1794 is displayed without a keyboard. In the illustrated example, fillable field 1786 is associated with credit cards (eg, fillable field 1786 is flagged as associated with financial transactions). Thus, in some examples, each of the candidate input affordances 1792 serves as a reference for a respective credit card (eg, a credit card number and/or one or more other respective candidate values associated with the credit card).

While displaying the candidate input affordances 1792 , the electronic device 1700 detects activation of one candidate input affordance 1792 . For example, as shown in FIG. 17Z , activation is a tap gesture 1795 on one candidate input affordance 1792 . In FIG. 17Z , in response to detecting the tap gesture 1795 , the electronic device 1700 automatically populates the secure data fillable field with the candidate input 1796 corresponding to the activated candidate input affordance 1792 .

While displaying the application interface 1784 with the fillable field 1786 automatically filled in, the electronic device detects activation of the submission affordance 1798 . By way of example, activation is tap gesture 1702A on submit affordance 1798 . In response, the automatically filled credit card is optionally submitted using the application, eg, for authentication or payment purposes.

Although description is herein made with respect to performing biometric authentication prior to providing candidate input affordances when automatically populating secure data fillable fields, it is understood that in some examples, candidate input affordances are provided prior to biometric authentication. will be understood Referring to FIG. 17AA , for example, in response to a request to automatically populate the secure data fillable field 1786 , the electronic device 1700 displays an input interface comprising a plurality of candidate input affordances 1704A. do. Each of the candidate inputs 1704A is in some examples a reference to (eg, a representation of) a candidate input value.

As illustrated in FIG. 17A , while displaying an input interface including a plurality of candidate input affordances 1704A, the electronic device detects activation of one candidate input affordance 1704A. As an example, activation is a tap gesture 1706A on one candidate input affordance 1704A. 17A-17E , in response, the electronic device performs biometric authentication as described. In FIG. 17A , the electronic device 1700 has determined that the biometric authentication was successful and automatically populates the secure data fillable field 1786 with the selected candidate input corresponding to the selected candidate input affordance 1704A.

In FIG. 17Ag , the electronic device instead determines that the biometric authentication was unsuccessful. In response, the electronic device 1700 stops displaying the biometric authentication interface, as illustrated in FIG. 17A .

As noted above, the illustrative example of the user interfaces illustrated in FIGS. 17A-17A , described above, is related to the illustrative example of the user interfaces illustrated in FIGS. 18A-18A, described below. Accordingly, the processes described above with respect to the example user interfaces illustrated in FIGS. 17A-17A and the processes described below with respect to the exemplary user interfaces illustrated with FIGS. 18A-18A . , 100, 300, 500, 700) are very similar processes that similarly involve initiating and managing transmissions.

18A-18D are flow diagrams illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. Method 1800 includes a device having a display, one or more input devices (eg, a touchscreen, microphone, camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 1700). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric feature by the one or more biometric sensors. Some operations of method 1800 are selectively combined, orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 1800 provides an intuitive method for performing authentication of biometric features. This method reduces the cognitive burden on the user for performing authentication of biometric features, thereby creating a more efficient human-machine interface and intuitive user experience. For battery-operated computing devices, enabling a user to more quickly and more efficiently manage authentication of biometric features saves power and increases the time between battery charges.

In some examples, the electronic device (eg, 100 , 300 , 500 , 1700 ) detects selection of a fillable field (eg, 1710 , 1712 , 1786 ) ( 1802 ). In some examples, in response to detecting selection of the fillable field (eg, 1710, 1712, 1786), the electronic device (eg, 100, 300, 500, 1700) transmits the fillable field (eg, 1710, 1712, Display ( 1804 ) an input interface (eg, 1720 , 1788 ) including a plurality of user interface objects (eg, 1725 , 1793 , 1704A) corresponding to candidate inputs for 1786 ).

In some examples, prior to receiving a request (eg, 1718, 1724, 1726, 1730, 1792, 1795, 1706A) to automatically populate at least one fillable field (eg, 1710, 1712, 1786), the electronic device ( For example, 100, 300, 500, 1700 receives a selection (eg, 1718, 1730) of a fillable field (eg, 1710, 1712, 1786). In some examples, selection (eg, 1718, 1730) of a fillable field (eg, 1710, 1712, 1786) results in a fillable field (eg, 1710, 1730) displayed within an application interface using an input device such as a mouse or button. 1712, 1786). In some examples, in response to selection of a fillable field (e.g., 1710, 1712, 1786), the electronic device (e.g., 100, 300, 500, 1700) displays an auto-fill affordance (e.g., 1722, 1790) (e.g., 1722, 1790). 1806). In some examples, an auto-fill affordance (eg, 1722 , 1790 ) is displayed in combination with a keyboard (or keypad).

In some examples, the electronic device (eg, 100 , 300 , 500 , 1700 ) displays ( 1808 ) an application interface that includes a fillable field (eg, 1710 , 1712 , 1786 ) on the display. Displaying the application interface including fillable fields provides the user with visual feedback indicating that input may be made to a particular area of the application interface. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, displaying, on a display (eg, 1702 ), an application interface that includes a fillable field (eg, 1710 , 1712 , 1786 ) may indicate that the fillable field (eg, 1712 , 1786 ) is of a second type. and displaying 1810 a fillable field (eg, 1712 , 1786 ) as associated with the data using a first visual processing ( 1810 ). Displaying a fillable field using a particular visual treatment (eg, a first visual treatment) as the fillable field is associated with a particular type of data (eg, a second type) indicates that the fillable field is associated with a particular data type. It provides visual feedback that allows users to quickly and easily recognize that Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the second type of data includes data that requires authentication to be auto-populated, such as payment information, passwords, and/or user names. In some examples, the first visual treatment is a visual effect, such as a particular color scheme, highlighting, or animation. In some examples, the first visual treatment includes a first color scheme, such as a pattern of one or more colors. In some examples, the first visual processing includes a biometric authentication interface object (eg, 1716 ) associated with (eg, within or adjacent to) the fillable field (eg, 1712 , 1786 ).

In some examples, the electronic device (eg, 100, 300, 500, 1700) displays a biometric authentication glyph (eg, 1716) or icon in or near fields (eg, 1712, 1786) associated with biometric authentication. display, which is not displayed in or near fields not associated with biometric authentication (eg, 1710 ). Displaying a biometric authentication glyph or icon in or near fields associated with biometric authentication and not displaying a biometric glyph or icon in or near fields not associated with biometric authentication indicates which fields It provides easily recognizable visual feedback regarding which fields are related to and require biometric authentication and which fields are neither relevant nor required for biometric authentication. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, displaying, on the display, an application interface that includes a fillable field may include, as the fillable field (eg, 1710 ) is associated with a first type of data, the fillable field (eg, 1710 ) and displaying 1812 using a second visual processing different from the first visual processing. In some examples, the first type of data includes data that does not require authentication to be auto-populated, such as contact information including name, address, phone number, zip code, and the like. In some examples, the second visual processing is the absence of the first visual processing. In some examples, the electronic device (e.g., 100, 300, 500, 1700) sets a fillable field (e.g., 1712, 1786) to a different color, biometric authentication glyph (e.g., 1716), and/or a fillable field (e.g., 1716) For example, 1712 , 1786 ) are optionally highlighted with text indicating that they are automatically populated in response to successful biometric authentication. In some examples, the second visual treatment includes a second color scheme that is different from the first color scheme. Thus, in some examples, the electronic device (eg, 100, 300, 500, 1700) compares fields associated with biometric authentication (eg, 1712, 1786) to fields not associated with biometric authentication (eg, 1710). ) and display using a different color.

In some examples, displaying, on the display, an application interface that includes a fillable field (eg, 1710 , 1712 , 1786 ) includes displaying a webpage that includes a fillable field (eg, 1710 , 1712 , 1786 ). (1814). In some examples, the application interface further includes a submission affordance (eg, 1714, 1798) associated with the fillable field (eg, 1710, 1712, 1786).

In some examples, while displaying the application interface, the electronic device (eg, 100, 300, 500, 1700) may request (eg, automatically fill in a fillable field (eg, 1710 , 1712 , 1786 ) of the application interface (eg, 1718, 1724, 1726, 1730, 1792, 1795, 1706A) is received (1816). In some examples, the request is a selection (eg, 1724, 1792) of an auto-fill affordance (eg, 1722, 1790), a selection of a field (eg, 1718, 1730), a selection of candidate text input (eg, 1726, 1795, 1706A) ), loading a webpage, or any combination thereof. In some examples, receiving a request to automatically populate at least one fillable field (eg, 1710 , 1712 , 1786 ) of an application interface may include: , receiving 1818 a selection of auto-fill affordances (eg, 1722 , 1790 ) displayed on 1702 . In some examples, in response to a selection (eg, 1710, 1712, 1786) of a field (eg, 1710, 1712, 1786), the electronic device (eg, 100, 300, 500, 1700) displays a fillable field (eg, 1710) . In response to selecting the affordance, the electronic device (eg, 100 , 300 , 500 , 1700 ) initiates biometric authentication. In some examples, receiving a request to automatically populate at least one fillable field (eg, 1710 , 1712 , 1786 ) of an application interface may include selecting (eg, 1710 , 1712 , 1786 ) of a fillable field (eg, 1710 , 1712 , 1786 ). and receiving 1820 , 1718 , 1730 .

In some examples, in response to selection of a fillable field (eg, 1710 , 1712 , 1786 ), the electronic device (eg, 100 , 300 , 500 , 1700 ) does not display an input interface (eg, 1720 , 1788 ) and a biometric device (eg, 1720 , 1788 ) Initiate measurement authentication. Initiating biometric authentication in response to selection of a fillable field without displaying an input interface allows a user to initiate biometric authentication quickly and efficiently with minimal input. Reducing the number of inputs needed to perform an operation improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) -Make the device interface more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, an input interface (eg, 1720 , 1788 ) is displayed in response to selection of a first type of fields (eg, 1786 ) (eg, a credit card field) and a second type of fields (eg, 1712 ) ) (eg, password field) is not displayed in response to selection. In some examples, receiving a request to automatically populate at least one fillable field (eg, 1710 , 1712 , 1786 ) of the application interface includes a reference (eg, 1725 ) corresponding to a candidate input associated with the second type of data. , 1793, 1704A); receiving 1822 a selection (eg, 1726, 1795, 1706A). In some examples, the electronic device (eg, 100, 300, 500, 1700) may use one or more candidate inputs that may be used (eg, upon selection) to automatically populate a fillable field (eg, 1710, 1712, 1786). One or more references corresponding to (eg, 1725, 1793, 1704A) are provided. In some examples, the reference is, for example, a reference to a credit card (eg, “CC1”) or a reference to a password (“Facebook password”). In some examples, the reference is the candidate itself (eg, an email address such as “test@test.com”). In some examples, the selection (eg, 1726, 1795, 1706A) of a reference (eg, 1725, 1793, 1704A) to the candidate input is a selection of affordance of the software keyboard. In some examples, the keyboard is a keypad. In some examples, receiving the request to automatically fill in at least one fillable field of the application interface includes selecting 1824 of the fillable field of the webpage. In some examples, receiving a request to automatically populate a fillable field of an application interface may include selecting (eg, 1725, 1793, 1704A) a user interface object (eg, 1725 , 1793 , 1704A) corresponding to each candidate input of a plurality of candidate inputs. , 1726 , 1795 , 1706A). In some examples, in response to selection of the fillable field, the electronic device (eg, 100, 300, 500, 1700) provides candidate inputs (eg, 1725, 1793, 1704A) for selection by the user. Thereafter, the electronic device (eg, 100, 300, 500, 1700) proceeds with biometric authentication. In some examples, the electronic device (eg, 100, 300, 500, 1700) identifies all fillable fields (eg, 1710, 1712, 1786) and/or fields (eg, 1710) when the application interface is loaded. , 1712, 1786) determine candidate inputs for one or more fields. In some examples, autopopulating in this way reduces the number of inputs required to automatically populate a fillable field (eg, 1710 , 1712 , 1786 ). In some examples, the request to automatically populate the fillable field (eg, 1710 , 1712 , 1786 ) is based on detection of loading a webpage that includes the fillable field (eg, 1710 , 1712 , 1786 ).

In some examples, in response to receiving ( 1828 ) a request to automatically populate a fillable field (eg, 1710 , 1712 , 1786 ) of an application interface, a fillable field (eg, 1710 , 1712 , 1786 ) of the application interface Upon determining that is associated with the first type of data, the electronic device (eg, 100, 300, 500, 1700) automatically populates the fillable fields (eg, 1710, 1712, 1786) with the first type of data (eg, 1830). Automatically populating a fillable field with a particular type of data (eg, a first type of data) in accordance with a determination that the fillable field of the application interface is associated with a particular type of data (eg, a first type of data) comprises: avoids having to manually enter data into fillable fields in the application interface. Reducing the number of inputs needed to perform an operation improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) -Make the device interface more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the first type of data includes insecure or unsecured (eg, biometrically unsecured) data. In some examples, the insecure data is the user's given name, nickname, publicly available phone number, or preference associated with a particular field (eg, shoe size for a shoe size field). In some examples, automatically populating a fillable field (eg, 1710, 1712, 1786) may further authenticate the field in response to a request (eg, 1718, 1724, 1726, 1730, 1792, 1795, 1706A). Populating with data accessible to or stored by an electronic device (eg, 100, 300, 500, 1700) without requiring (eg, additional biometric authentication) including populating.

In some examples, further, in response to a request to automatically populate the fillable field (eg, 1710, 1712, 1786) of the application interface, the fillable field (eg, 1710, 1712, 1786) of the application is of the second type Upon determining ( 1832 ) that the data is associated with the data of the electronic device, while acquiring (eg, during at least a portion of the acquisition process) data corresponding to the biometric feature, from one or more biometric sensors (eg, 1703 ), the electronic device (eg, 100, 300, 500, 1700) displays ( 1834 ) a biometric authentication interface (eg, 1732 ). Displaying the biometric authentication interface in accordance with a determination that the fillable field of the application is associated with a particular type of data (eg, of a second type of data) includes: In this case, it improves device security by requiring security verification measures. Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life.

In some examples, the second type of data is secure data (eg, biometric security data). In some examples, secure data includes password information, credit card information, non-public user information such as an unlisted phone number, or medical information. In some examples, the electronic device (eg, 100 , 300 , 500 , 1700 ) displays a biometric authentication interface (eg, 1732 ) while performing biometric authentication. In some examples, the biometric authentication interface is displayed over at least a portion of the application interface. In some examples, displaying the biometric authentication interface includes displaying a biometric authentication animation. In some examples, the biometric authentication animation includes an initial animation (eg, display of a first biometric authentication glyph (eg, 1734 )), a processing animation (eg, rotating rings indicating that biometric data is being processed), and success. Either animation or failure animation. In some examples, the failure animation is the same as the initial animation. These features are described in greater detail above with reference to FIGS. 15A-15T . In some examples, the biometric authentication interface includes ( 1836 ) a representation of a simulation of the biometric feature (eg, 1734 , 1738 , 1740 , 1746 ). In some examples, the biometric authentication interface includes a representation (eg, 1734 , 1738 , 1740 , 1746 ) of a simulation of the biometric feature representing the status of the biometric authentication sequence. In some examples, the biometric feature is a face and the representation (eg, 1734 , 1738 , 1740 , 1746 ) is a simulation of a face.

In some examples, further, in response to a request to automatically populate the fillable field and in response to determining that the fillable field of the application is associated with the second type of data, the electronic device (eg, 100, 300, 500, 1700) ) determines whether multiple candidate inputs (eg, associated with the second type of data) are stored on the electronic device (eg, 100 , 300 , 500 , 1700 ). Further, in some examples, according to a determination that multiple candidate inputs (eg, 1793 , 1704A) associated with the second type of data are stored on the electronic device (eg, 100 , 300 , 500 , 1700 ), the electronic A device (eg, 100 , 300 , 500 , 1700 ) displays a number of candidates. Further, in some examples, the electronic device (eg, 100 , 300 , 500 , 1700 ) receives a selection of one candidate input of a plurality of displayed candidate inputs. Further, in some examples, in response to receiving the selection (eg, 1704A) of the candidate input, the electronic device (eg, 100, 300, 500, 1700) is configured to: , obtain data corresponding to at least a portion of the biometric feature. In some examples, automatically populating the fillable field (eg, 1712, 1786) with the second type of data includes automatically populating the fillable field (eg, 1712, 1786) with a selected candidate input (eg, 1704A) include In some examples, the electronic device (eg, 100, 300, 500, 1700) determines whether multiple candidate inputs are stored on the electronic device (eg, 100, 300, 500, 1700) prior to performing biometric authentication. to decide In some examples, once the user has selected a candidate input (eg, 1704A), the electronic device (eg, 100, 300, 500, 1700) performs biometric authentication.

In some examples, further determining based on data obtained from one or more biometric sensors corresponding to the biometric feature and in response to a request to automatically populate a fillable field (eg, 1710 , 1712 , 1786 ) Upon determining ( 1838 ) that at least a portion of the biometric feature, which becomes the biometric feature, satisfies the biometric authentication criteria, the electronic device (eg, 100, 300, 500, 1700) displays a fillable field (eg, 1710 , 1712 , 1786 ). Automatically populate with data of the second type (1840). Automatically populating the fillable field with a particular type (eg, a second type) of data in accordance with a determination that at least a portion of the biometric feature satisfies the biometric authentication criteria includes: a user manually entering data into the fillable field avoid doing what needs to be done. Reducing the number of inputs needed to perform an operation improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) -Make the device interface more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, if biometric authentication is successful, the electronic device (eg, 100 , 300 , 500 , 1700 ) automatically populates the fillable field (eg, 1712 , 1786 ) with information in response to the request. Automatically populating the fillable field avoids the user having to manually enter data into the fillable field. Reducing the number of inputs needed to perform an operation improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) -Make the device interface more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, in response to receiving a request (eg, 1718, 1724, 1726, 1730, 1795, 1706A) to automatically populate a fillable field (eg, 1712, 1786) of an application interface, the electronic device (eg, 100 , 300 , 500 , 1700 obtain, from the one or more biometric sensors, data corresponding to at least a portion of the biometric feature. In some examples, data obtained from one or more biometric sensors is obtained prior to receiving a request to automatically populate a fillable field of an application interface. In some examples, data obtained from one or more biometric sensors is obtained in response to receiving a request to automatically populate a fillable field (eg, 1712 , 1786 ) of an application interface. In some examples, data obtained from one or more biometric sensors (eg, 1703 ) is obtained upon determining that a fillable field (eg, 1712 , 1786 ) of an application is associated with a second type of data. In some examples, the electronic device (eg, 100 , 300 , 500 , 1700 ) responds to a request to automatically fill in a fillable field, without displaying an input interface (eg, 1720 ) (eg, a keyboard or keypad). Fill in fillable fields (eg, 1712, 1786) automatically. In some examples, the one or more biometric sensors (eg, 1703 ) include a camera (eg, an IR camera or a thermographic camera). In some examples, data obtained from one or more biometric sensors (eg, 1703 ) corresponding to a biometric feature includes biometric data obtained using a camera. In some examples, the biometric feature is a face. In some examples, data obtained from one or more biometric sensors (eg, 1703 ) corresponding to a biometric feature includes biometric data associated with a portion of a face, wherein the biometric authentication criteria include: includes a requirement that biometric data associated with a face matches biometric data associated with an authorized face in order to be satisfied.

In some examples, upon determining that the electronic device (eg, 100 , 300 , 500 , 1700 ) has accessed a single candidate value of a second type for filling in a fillable field (eg, 1712 , 1786 ), the electronic device (eg, 100 , 300 , 500 , 1700 ) 100, 300, 500, 1700 automatically populates the fillable fields (eg, 1712, 1786) with data of the second type. In some examples, upon determining that the electronic device (eg, 100 , 300 , 500 , 1700 ) has accessed a plurality of candidate values of a second type for automatically populating a fillable field (eg, 1712 , 1786 ), the electronic device (eg, 100, 300, 500, 1700) displays representations of a plurality of multiple candidate values. In some examples, the candidate values are stored directly on the device and/or from another electronic device (eg, 100, 300, 500, 1700) that is otherwise connected to the electronic device (eg, 100, 300, 500, 1700). (eg, 100, 300, 500, 1700). In some examples, while displaying representations (eg, 1725 , 1793 , 1704A) of a plurality of multiple candidate values, the electronic device (eg, 100 , 300 , 500 , 1700 ) generates a respective candidate value of the plurality of candidate values. receive a selection (e.g., 1726, 1795, 1706A) of a representation of (e.g., 1725, 1793, 1704A), and, in some examples, automatically populate the fillable field (e.g., 1712, 1786) with the respective candidate value. In some examples, the electronic device (eg, 100, 300, 500, 1700) determines whether the electronic device (eg, 100, 300, 500, 1700) has accessed multiple instances of the second type of data. . In some examples, in response to successful biometric authentication, the electronic device (eg, 100 , 300 , 500 , 1700 ) sends, eg, multiple candidate inputs (eg, candidate credit cards) of biometric security data. Determines whether it is stored on this device or not. If so, the electronic device (eg, 100 , 300 , 500 , 1700 ) presents (eg, displays) each of the candidates (eg, 1725 , 1793 , 1704A) to the user. In response to a user selection (eg, 1726, 1795, 1706A) of one of the candidates (eg, 1725, 1793, 1704A), the electronic device (eg, 100, 300, 500, 1700) uses the selected candidate to field (eg 1712, 1786) is automatically filled in.

In some examples, according to a determination based on data obtained from one or more biometric sensors that at least a portion of the biometric feature does not satisfy biometric authentication criteria, the electronic device (eg, 100, 300, 500, 1700) reserves (1842) automatically populating the fillable fields (eg, 1712, 1786) with data of the second type. Withholding automatically populating a field using a selected candidate in accordance with a determination that at least a portion of the biometric feature does not satisfy the biometric authentication criteria provides visual feedback by allowing the user to recognize that authentication was unsuccessful, and , additionally provides improved device security by withholding automatically filling in fillable fields without successful authentication. Providing the user with improved visual feedback (eg, by improving the readability of user interface elements to the user while the device is in natural viewing angles, so that the user provides appropriate inputs when operating/interacting with the device) It improves the operability of the device and makes the user-device interface more efficient (by helping to reduce user errors), which additionally reduces the power usage of the device by enabling the user to use the device more quickly and efficiently. and improve battery life. In addition, improving the security measures of the device improves the operability of the device by preventing unauthorized access to content and operations, and additionally, improving the device's operability by enabling the user to use the device more efficiently. Reduces power usage and improves battery life.

In some examples, according to a determination based on data obtained from one or more biometric sensors that at least a portion of the biometric feature does not satisfy biometric authentication criteria, the electronic device (eg, 100, 300, 500, 1700) displays ( 1844 ) an indication that at least a portion of the biometric feature does not satisfy the biometric authentication criteria. Displaying an indication that at least a portion of the biometric feature did not meet the biometric authentication criteria provides visual feedback by allowing the user to quickly recognize that authentication was unsuccessful. Providing the user with improved visual feedback (eg, by improving the readability of user interface elements to the user while the device is in natural viewing angles, so that the user provides appropriate inputs when operating/interacting with the device) and reduce user errors) improve the operability of the device and make the user-device interface more efficient, which additionally reduces the power usage of the device by enabling the user to use the device more quickly and efficiently. and improve battery life. In some examples, in response to the failed biometric authentication, the electronic device (eg, 100 , 300 , 500 , 1700 ) provides an indication of the failure. In some examples, the electronic device (eg, 100 , 300 , 500 , 1700 ) indicates “biometric feature not recognized” or “biometric authentication inactive” when a threshold number of biometric attempts is reached. displays a message indicating In some examples, after failure, the electronic device (eg, 100, 300, 500, 1700) removes any biometric authentication interface displayed over the application interface and/or increases the biometric authentication retry affordance (eg, 1758). Display (eg, within a fillable field (eg, 1712 )), selection of which reattempts the biometric authentication. In some examples, in response to determining that at least a portion of the biometric feature does not satisfy the biometric authentication criteria, the device may include data (eg, username, password, passcode, Displays a keypad or keyboard for entering contact information, credit card information, etc.).

In some examples, according to a determination based on data obtained from one or more biometric sensors that at least a portion of the biometric feature does not satisfy biometric authentication criteria, the electronic device (eg, 100, 300, 500, 1700) stops displaying the biometric authentication interface. In some examples, after a failed biometric authentication, the electronic device (eg, 100 , 300 , 500 , 1700 ) stops displaying the biometric authentication. As a result, the electronic device (eg, 100 , 300 , 500 , 1700 ) resumes display of an application interface, such as the application's login interface (eg, 1714 ).

In some examples, according to a determination based on data obtained from one or more biometric sensors that at least a portion of the biometric feature does not satisfy biometric authentication criteria, the electronic device (eg, 100, 300, 500, 1700) displays an input interface (eg, 1720 ). In some examples, the input interface (eg, 1720 ) includes a keypad or keyboard that includes character entry keys for entering a password or passcode.

In some examples, upon determining that biometric authentication is not available, the electronic device (eg, 100 , 300 , 500 , 1700 ) prompts the user for an alternative form of authentication. Prompting the user for an alternative form of authentication upon a determination that biometric authentication is not available allows the user to easily provide authentication for actions using different authentication methods. Providing additional control options (eg, for providing authentication) in this way without cluttering the UI with additional displayed controls allows the user to make appropriate inputs (eg, when operating/interacting with the device). It improves the operability of the device and makes the user-device interface more efficient (by helping to provide and reducing user errors), which additionally reduces the power usage of the device by enabling the user to use the device more quickly and efficiently. Reduce and improve battery life.

In some examples, because a threshold number of unsuccessful biometric authentication attempts has been reached since the last successful authentication with the device, or because the biometric sensor is not sensitive to heat, cold, lighting (eg, causing the device to detect characteristics of the biometric feature) The biometric authentication fails because there is not enough light or too much light), or because it cannot be used due to other environmental conditions. In some examples, after prompting the user for an alternative form of authentication (eg, a passcode, password, or other form of biometric authentication, such as a fingerprint), the electronic device (eg, 100, 300, 500, 1700) Receive an alternative form of authentication. In some examples, further, after prompting the user for the alternative form of authentication, and in response to receiving the alternate form of authentication, the alternate form of authentication is authorized authentication information (eg, a previously stored fingerprint; Upon determining that it matches a password, or passcode), the electronic device (eg, 100 , 300 , 500 , 1700 ) automatically fills in the fillable fields (eg, 1712 , 1786 ). In some examples, further, after prompting the user for the alternative form of authentication, and further, in response to receiving the alternative form of authentication, that the alternative form of authentication does not match the authorized authentication information. In accordance with the determination, the electronic device (eg, 100 , 300 , 500 , 1700 ) suspends automatically populating the fillable field (eg, 1712 , 1786 ).

In some examples, after responding to a request to automatically fill in a fillable field of the application interface, the electronic device (eg, 100 , 300 , 500 , 1700 ) receives a subsequent request to load the webpage. In some examples, further in response to a request to automatically populate a fillable field (eg, 1710 , 1712 , 1786 ) of an application interface, in response to a subsequent request to load a webpage, a subsequent prompt to load the webpage Upon determining that the request meets authentication retry criteria, the electronic device (eg, 100 , 300 , 500 , 1700 ) automatically populates a fillable field (eg, 1710 , 1712 , 1786 ) in the application interface for biometric authentication try In some examples, further, after responding to a request to automatically populate a fillable field (eg, 1710 , 1712 , 1786 ) of the application interface, and further in response to a subsequent request to load the webpage, the webpage Upon determining that a subsequent request to load does not satisfy the authentication retry criteria, the electronic device (eg, 100, 300, 500, 1700) automatically fills in the fillable field (eg, 1710, 1712, 1786) in the application interface. Withhold biometric authentication attempts to fill in. In some examples, loading the webpage conditionally triggers autopopulation based on predetermined criteria. For example, loading a webpage is handled as a request to automatically fill in fillable fields in the webpage the first time the webpage is loaded, but the webpage is processed within a predetermined amount of time (eg, 5 minutes, 1 hour). , or within 1 day) the second time the webpage is loaded the second time it is loaded. In some examples, the authentication retry criteria include at least one of a requirement that the webpage did not load within a predetermined time or a requirement that the webpage did not load during the same session. In some examples, the requirement is that the loading is a first instance of loading within a predetermined time and/or that the loading is a first instance of loading within a session.

In some examples, after automatically populating a fillable field (eg, 1710 , 1712 , 1786 ) with a first type of data or a second type of data, the electronic device (eg, 100 , 300 , 500 , 1700 ) submits the submission affordance (eg, 1714, 1798) receive a selection. In some examples, in response to receiving the selection of the submission affordance, the electronic device (eg, 100 , 300 , 500 , 1700 ) stops displaying the application interface. In some examples, further, in response to receiving the selection of the submission affordance, the electronic device (eg, 100 , 300 , 500 , 1700 ) displays a second interface (eg, 1782 ) generated by the application. In some examples, displaying the second interface includes replacing the login user interface of the application with a user interface of the application that includes the protected information (eg, 1782 ).

Note that the details of the processes described above with respect to method 1200 (eg, FIGS. 18A-18D ) are also applicable in a similar manner to the methods described herein. For example, method 1800 may optionally include one or more of the characteristics of various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700. include For example, the registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with FIGS. 17G-17K . For another example, one or more implantable interfaces as described in methods 2000 , 2700 are optionally displayed in response to receiving input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 18A-18D are, optionally, implemented by the components shown in FIGS. 1A and 1B . For example, display operation 1808 , receive operation 1816 , and auto-populate operation 1830 are optionally implemented by event classifier 170 , event recognizer 180 , and event handler 190 . Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

19A-19AB illustrate example user interfaces for biometric authentication, in accordance with some examples. As described in more detail below, the illustrative example of the user interfaces illustrated in FIGS. 19A-19AB is used to illustrate the processes described below, including the processes of FIGS. 20A-20F .

19A illustrates an electronic device 1900 (eg, portable multifunction device 100 , device 300 , or device 500 ). In the illustrative example illustrated in FIGS. 19A-19A , the electronic device 1900 is a smartphone. In other examples, the electronic device 1900 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 1900 has a display 1902 , one or more input devices (eg, a touchscreen of the display 1902 , a button 1904 , a microphone (not displayed)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 1903 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the one or more biometric sensors 1903 are one or more biometric sensors 703 . In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

19A , the electronic device wakes from a low power (eg, display-off) state. As illustrated, in some examples, the electronic device 1900 wakes in response to a lift gesture 1906 performed by the user. 19B-19D , in response to lift gesture 1906 , electronic device 1900 transitions from a low power state to a moderate power state (eg, display-dimmed). For example, in FIG. 19B , the display 1902 of the electronic device 1900 is disabled, and in response to the lift gesture 1906 , the electronic device 1900 displays a predetermined value as shown in FIGS. 19C and 19D . Gradually increase the brightness of the display 1902 over a period of time. In some examples, the brightness of display 1902 is increased according to a function, such as a linear function. In some examples, when biometric authentication (eg, facial recognition authentication) is enabled, the device is locked immediately when a hardware button (eg, sleep/wake button) is pressed, and in some examples, the device puts it into a sleep mode It is locked every time it transitions.

19C and 19D , in some examples, the electronic device is locked while transitioning to and/or operating in an intermediate power state (eg, the display is on but not at full operating brightness) Display the interface 1910 . The locked interface includes, for example, a locked status indicator 1912 and, optionally, one or more notifications 1914 . As shown, notification 1914 is a message notification associated with the messaging application indicating that the electronic device has received a new message from a contact (“John Appleseed”) stored on the electronic device. In some examples, the intermediate power state is a locked state. Thus, while operating at moderate power states, the electronic device 1900 operates in a secure manner. As an example, while operating at a moderate power state, the electronic device does not display the content of the message associated with notification 1914 . In some examples, the locked state further corresponds to restrictions on access to other data (including other applications) and/or restrictions on permission inputs.

In some examples, the electronic device 1900 further displays a flashlight affordance 1907 and a camera affordance 1908 . In some examples, activation of flashlight affordance 1907 causes the electronic device to load a flashlight application. In some examples, activation of camera affordance 1908 causes electronic device 1900 to load a camera application.

In some examples, after transitioning to (eg, in response to) the intermediate power state, the electronic device 1900 initiates biometric authentication (eg, facial recognition authentication). In some examples, initiating biometric authentication includes obtaining (eg, capturing with one or more biometric sensors) data corresponding to at least a portion of a biometric feature of the user. In some examples, when a (user's) face is detected, the biometric authentication confirms (user's) attention and intent to unlock by detecting that the user has eyes open and is facing the device.

19E-19G , when the electronic device 1900 determines that the biometric authentication is successful, the electronic device transitions from a medium power state to a high power state (eg, the display is not dimmed). For example, in FIG. 19D , the display of electronic device 1900 is in an intermediate power state, and in response to successful biometric authentication, electronic device 1900 may previously Gradually increase the brightness of the display 1902 over the determined period of time. In some examples, the brightness of display 1902 is increased according to a function, such as a linear function.

In some examples, during transition from the moderate power state to the high power state, the electronic device 1900 displays the unlocked interface 1920 . In some examples, while displaying unlocked interface 1920 , the electronic device displays an animation indicating that the electronic device is transitioning to a high power state. 19E-19G , during the transition, the electronic device displays an animation in which the locked status indicator 1912 transitions to the unlocked status indicator 1922 ( FIG. 19G ). In some examples, displaying the animation includes displacing and/or increasing the size of the locked status indicator 1912 to display the unlocked status indicator 1913 ( FIG. 19E ), and unlocking. raising and rotating a latch of the unlocked status indicator to display the unlocked status indicators ( 1921 in FIG. 19F , 1922 in FIG. 19G ), respectively. In some examples, the degree of blurring of one or more objects of locked state interface 1910 and/or unlocked state interface 1920 changes during animation. In some examples, the electronic device 1900 further outputs a tactile output 1926 during or in response to the transition to the high power state ( FIG. 19G ).

In some examples, the high power state is an unlocked state. Thus, while operating in a high power state, the electronic device 1900 operates in an insecure manner (eg, secure data is accessible to an authenticated user). As an example, as illustrated in FIG. 19G , while operating in a high power state, the electronic device displays the content of a message associated with notification 1914 .

In some examples, biometric authentication (eg, facial recognition authentication) augments its stored mathematical expression over time to improve unlock performance and keep up with natural changes in the user's face and appearance. In some examples, upon successful unlock, the biometric authentication optionally uses a mathematical expression - if its quality is sufficient - that is newly computed for a finite number of additional unlocks before the data is discarded. In some examples, the biometric authentication fails to recognize the user, but the match quality is higher than a predetermined threshold and the failure immediately (eg, by the user entering an alternative authentication (eg, passcode, password, pattern, fingerprint)) Upon tracking (within a predefined threshold time), the device takes another capture of the biometric data (eg, via one or more cameras or other biometric sensors capturing facial recognition data) and converts it into a newly calculated mathematical expression. augments its registered biometric authentication (eg, facial recognition authentication) data. In some examples, this new biometric authentication (eg, facial recognition authentication) data is optionally discarded after a finite number of unlocks and when the user stops matching against it. These augmentation processes allow biometric authentication (eg, facial recognition authentication) to follow dramatic changes in a user's facial hair or makeup use, while minimizing false acceptance.

19E-19G , if the electronic device 1900 determines that the biometric authentication was unsuccessful, the electronic device 1900 does not transition to a high power state and, in some examples, remains at a moderate power state. do. In some examples, the electronic device 1900 remains locked while the electronic device 1900 is maintained at an intermediate power state. To indicate that the biometric authentication has failed, the electronic device 1900 indicates a locked status, eg, by alternating the location of the locked status indicator 1912 between two locations on the locked status interface 1910 . The shake of the ruler 1912 is simulated. In some examples, the electronic device 1900 further outputs a tactile output 1918 to indicate that the biometric authentication was unsuccessful.

As described, while in the intermediate power state, the electronic device 1900 is in a locked state, and as a result, secure data on the electronic device is not accessible while the electronic device is in the intermediate power state. As an example, in FIG. 19I , the electronic device detects user input 1930 near an edge of display 1902 . 19I-19K , user input 1930 is, in some examples, a swipe gesture that is a request to access a home screen interface of electronic device 1900 . However, since the electronic device 1900 is at moderate power and locked state, in response to the swipe gesture, the electronic device 1900 slides the locked state interface 1910 in an upward direction to the alternative authentication interface 1932 . ), whereby the user is authenticated using an alternative form of authentication (eg, password authentication) other than authentication associated with the biometric feature. The alternative authentication interface 1932 includes a locked status indicator 1934 and a prompt 1936 that prompts the user to enter a valid passcode to unlock the electronic device 1900 (and optionally , which results in a transition to a high-power state).

In some examples, an alternative form of authentication (eg, passcode, password, or pattern) is required to unlock the device in certain circumstances. In some examples, an alternative form of authentication is required if the device has just been turned on or restarted. In some examples, an alternative form of authentication is required if the device has not been unlocked for more than a predetermined amount of time (eg, 48 hours). In some examples, the alternate form of authentication is required if the alternate form of authentication has not been used to unlock the device within a predetermined amount of time (eg, 156 hours). In some examples, the alternative form of authentication is a predetermined form of authentication that has not been used to unlock the device for a predetermined amount of time (eg, 6.5 days) and has passed biometric authentication (eg, facial recognition authentication) for a predetermined amount of time (eg, 6.5 days). Required if not used to unlock the device within a period of time (eg, last 4 hours). In some examples, an alternative form of authentication is required when the device receives a remote lock command. In some examples, an alternative form of authentication is required after 5 unsuccessful attempts to match a face (via facial recognition authentication) on the device. In some examples, an alternative form of authentication is required after initiating a power off/emergency SOS on the device and then canceling the power off/emergency SOS.

19L and 19M , in response, at least in part, to a tap gesture 1938 ( FIG. 19L ) and, optionally, one or more other inputs indicating additional alphanumeric digits of a valid passcode, electronic device 1900 A valid passcode (or password) is received by 19N , once a valid passcode has been received, the electronic device is unlocked and displays the home screen interface 1933 (eg, replaces the display of the alternative authentication interface with it).

19O-19R , the device is operating in a high power (eg, unlocked) state and receives an input that is a request to access secure data on the electronic device 1900 . As an example, as shown in FIG. 19O , the electronic device 1900 is operating in a high power state, and as illustrated in FIG. 19P , a swipe gesture is a request to access the home screen interface of the electronic device 1900 . 1944) is received. As further illustrated in FIGS. 19P-19R , in response to swipe gesture 1944 , electronic device 1900 slides unlocked status interface 1920 in an upward direction to display home screen interface 1946 . Display (eg, reveal).

19S-19U illustrate various ways in which an electronic device transitions from a high power (eg, unlocked state) to a locked state, such as a moderate power state or a low power state. In FIG. 19S , while displaying unlocked status interface 1920 (as described at least with respect to FIG. 19G ), electronic device 1900 receives activation of unlocked status indicator 1922 . Activation of unlocked screen indicator 1922 is a tap gesture 1948 in some examples. 19V , in response to activation of the unlocked status indicator 1922 , the electronic device transitions to an intermediate power state, optionally displays the locked status indicator 1912 and/or A tactile output 1952 is provided. In some examples, during the transition to the medium power state, the electronic device displays an animation indicating that the electronic device 1900 is transitioning to the medium power state (or low power state).

19T , while displaying the home screen interface 1946 and while in the high power unlocked state, the electronic device 1900 receives activation of the button 1904 . Activation of button 1904 is, in some examples, a press and/or press of button 1904 . In response to activation of button 1904 , the electronic device transitions to a low power state (eg, as described at least with reference to FIG. 19B ). 19U , while displaying home screen interface 1946 , electronic device 1900 receives activation of unlocked screen indicator 1950 of home screen interface 1946 . Activation of unlocked screen indicator 1922 is a tap gesture 1950 in some examples. In response to activation of unlocked status indicator 1922 , the electronic device transitions to an intermediate power state and, optionally, displays locked status indicator 1910 ( FIG. 19V ).

In FIG. 19W , electronic device 1900 displays device settings interface 1954 . The device settings interface includes a gaze enable setting 1955, which, when enabled, requires the user to be looking at the device for successful biometric authentication. When the setting is disabled, biometric authentication may be successful even if an authorized user is not looking at the device. Device settings interface 1954 further includes enable biometric authentication setting 1956 , which, when enabled, enables biometric authentication on electronic device 1900 . When the enable biometric authentication setting 1956 is disabled, biometric authentication is not available on the electronic device 1900 .

For example, in FIG. 19W , the electronic device 1900 receives activation of the enable biometric authentication setting 1956 . Activation of the enable biometric authentication setting 1956 is a tap gesture 1958 in some examples. Because biometric authentication enable setting 1956 is enabled as shown in FIG. 19W , biometric authentication enable setting 1956 is enabled in response to tap gesture 1958 , as shown in FIG. 19X . is disabled In some examples, as a result, any request to access secure data on electronic device 1900 requires the user to authenticate using an alternative form of authentication. As an example, referring to FIGS. 19Y and 19Z , the electronic device 1900 detects a user input 1930 near an edge of the display 1902 . 19I-19K , user input 1930 is, in some examples, a swipe gesture that is a request to access a home screen interface of electronic device 1900 . 19AA , because the enable biometric authentication setting 1956 is disabled, the electronic device 1900, in response to the swipe gesture 1930 , slides the locked state interface 1910 in an upward direction. to display (eg, reveal) an alternative authentication interface 1932 , whereby a user can provide a passcode to unlock the electronic device 1900 .

In some examples, one or more elements displayed by electronic device 1900 are based on context. As illustrated in FIG. 19A , for example, the locked status indicator displayed by the electronic device is, in some cases, based on the location and/or type of the electronic device 1900 .

20A-20F are flow diagrams illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. Method 2000 includes a device having a display, one or more input devices (eg, a touchscreen, microphone, camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection, such as a 4G LTE connection) For example, 100, 300, 500, 1900). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric feature by the one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 2000 provides an intuitive method for performing authentication of biometric features. This method reduces the cognitive burden on the user for performing authentication of biometric features, thereby creating a more efficient human-machine interface and intuitive user experience. For battery-operated computing devices, enabling a user to more quickly and more efficiently manage authentication of biometric features saves power and increases the time between battery charges.

In some examples, prior to detecting that the device wake criteria have been met, the electronic device performs a biometric enrollment process. In some examples, during biometric registration, the device required that the face being enrolled include facial characteristics representative of the face viewing the electronic device during registration of the face in order to proceed with biometric registration of the face. In some examples, the device outputs tactile, audio, and/or visual alerts during registration if the face is not looking at the electronic device during registration.

In some examples, the electronic device (eg, 100 , 300 , 500 , 1900 ) detects that device wake criteria have been met ( 2002 ). In some examples, in response to detecting that the device wake criteria have been met, the electronic device transitions the electronic device from a first visual state (eg, a low power state) to a second visual state (eg, a medium power state). (2004). Transitioning from a first visual state (eg, a low power state) to a second visual state (eg, a moderate power state) in response to detecting that the device wake criteria have been met includes: the user manually providing one or more inputs avoiding providing one or more inputs to transition the device from the first state to the second state. Performing an action (automatically) when a set of conditions are met without requiring additional user input helps the user to provide appropriate inputs (e.g., when actuating/interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. .

In some examples, upon pressing a button (eg, 1904 ), and/or displaying a notification (eg, 1914 ), the wake criteria are met when the electronic device is lifted. In some examples, the first visual state is a display-off state, or a state in which the display of the electronic device is at 10% of the maximum brightness state. In some examples, the second visual state is a display brightness state that is higher than the first visual state (eg, 10% when the display is off in the first state; 20% when the display is at 10% in the first state) . In some examples, the second visual state includes ( 2006 ) a first introductory screen (eg, 1910 ) displayed at a first brightness. In some examples, while in the second visual state, the electronic device displays ( 2010 ) a fourth user interface object (eg, 1912 ) representing the visual state of the electronic device. In some examples, while in the second visual state, the electronic device displays ( 2012 ) a fifth user interface object (eg, 1912 ) representing the visual state of the electronic device. In some examples, access to sensitive data such as one or more features of the electronic device (eg, a display (eg, 1902), one or more biometric sensors (eg, 1903), a microphone, content of applications and messages; The ability to perform destructive actions, such as deleting communications or photos, and the ability to perform communication operations, such as sending a new message and sharing content stored on the device) is the ability of the electronic device to perform a first visual state. is disabled (eg, powered off or operating with reduced functionality) (eg, while the device is in a locked state) ( 2008 ). In some examples, transitioning to the second visual state includes enabling one or more disabled functions of the electronic device. In some examples, transitioning to the second visual state includes putting the device into a state in which one or more disabled components of the electronic device are enabled. In some examples, enabling one or more disabled functions includes enabling a display (eg, 1902 ), one or more biometric sensors (eg, 1903 ), and/or a microphone of the electronic device.

In some examples, after transitioning the device to the second visual state ( 2014 ), upon determining whether the biometric authentication criteria have been met, in accordance with a determination that a selectable option (eg, 1955 ) of the electronic device is enabled, the electronic The device uses the first set of criteria as biometric authentication criteria. When determining whether the biometric authentication criteria have been met, using the first set of criteria as biometric authentication criteria in accordance with a determination that a selectable option (eg, 1955 ) of the device is enabled may require a user with minimal input Makes it easy to provide authentication information to the device. Performing an action (automatically) when a set of conditions are met without requiring additional user input helps the user to provide appropriate inputs (e.g., when actuating/interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. .

In some examples, the first set of criteria includes a requirement that the user's face was looking at the display of the electronic device (eg, when determining whether to unlock the device and/or transition from the second visual state to the third visual state). includes In some examples, further, after transitioning the device to the second visual state, upon determining whether the biometric authentication criteria have been met, upon determining that the selectable option of the electronic device is not enabled, the electronic device is configured to: The set of criteria is used as biometric authentication criteria. In some examples, the second set of criteria includes a requirement that the user's face was looking at the display of the electronic device (eg, when determining whether to unlock the device and/or transition from the second visual state to the third visual state). does not include In some situations, the user may use the gaze detection requirement ( For example, 1955) is enabled.

In some examples, after transitioning to the second state, the electronic device determines ( 2016 ) whether biometric capture criteria are met by one or more biometric sensors. In some examples, the electronic device determines whether a biometric feature is present in the field of view of, for example, one or more biometric sensors. In some examples, determining whether the biometric capture criteria are met includes transitioning to a second visual state and determining whether the biometric capture criteria are met after a first predetermined time ( 2018 ). In some examples, the electronic device detects the biometric feature immediately after transitioning to the second state. In some examples, the electronic device detects the biometric feature after a period of time transitioning to the second state. In some examples, upon determining that the biometric capture criteria are met, the electronic device provides ( 2020 ) biometric data associated with the biometric feature by one or more biometric sensors. In some examples, once the electronic device has transitioned to the second visual state (recall that one or more biometric sensors are enabled prior to or during this transition), the electronic device uses the enabled one or more biometric sensors. to capture biometric data.

In some examples, upon determining that biometric authentication criteria have been met based on biometric data provided by one or more biometric sensors (eg, a biometric feature such as a face is authenticated by the device), the electronic device: , transitions (2022) the electronic device from the second visual state to a third visual state (eg, a high power state). Move the device from a second visual state (eg, a moderate power state) to a third visual state (eg, a high power state) according to a determination that biometric authentication criteria have been met based on the biometric data provided by the one or more biometric sensors. state) avoids the user providing one or more inputs to transition the device from the second state to the third state by manually providing the one or more inputs. Performing an action (automatically) when a set of conditions are met without requiring additional user input helps the user to provide appropriate inputs (e.g., when actuating/interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. .

In some examples, while the electronic device is in the third visual state, the display of the electronic device is turned on at a second relatively high brightness. In some examples, the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state ( 2024 ). In some examples, during transitions from the first visual state to the second visual state, and from the second visual state to the third visual state, the display is displayed from an off state to a low brightness, and finally, in response to authentication, a high Brightness continues to brighten. In some examples, the transition to the second visual state transitions to a particular brightness, and the transition from the second visual state to the third visual state transitions starting from the particular brightness. In some examples, each increment is according to the same function. In some examples, transitioning to the second visual state includes enlarging at least each user interface element (eg, 1912 ) displayed in the first visual state, and transitioning to the third visual state includes: further enlarging elements (eg, 1912, 1913, 1921). In some examples, the second visual state indicates that the device is in a locked state and the third visual state indicates that the device is in an unlocked state.

In some examples, further in accordance with a determination that biometric authentication criteria have been met based on biometric data provided by the one or more biometric sensors, the electronic device includes a fifth user interface object (eg, 1912 ) Display the unlock animation ( 2026 ). displaying an unlock animation comprising a user interface object (eg, a fifth user interface object 1912 ) in accordance with a determination that biometric authentication criteria have been met based on the biometric data provided by the one or more biometric sensors. This provides visual feedback by allowing the user to quickly recognize that authentication was successful and that the device has been unlocked accordingly. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the fifth user interface object is a lock. In some examples, the unlock animation is based on a context of the electronic device, such as location or type. In some examples, the fifth user interface object (eg, 1912 , 1922 ) has a first (eg, locked) state when the electronic device is in the second visual state, and a second when the electronic device is in the third visual state. has a (eg, unlocked) state ( 2028 ). In some examples, the visual state element transitions 2030 from the first state to the second state during the unlock animation (an animation comprising 1912 , 1913 , 1921 , 1922 ). In some examples, to prove that the biometric authentication was successful, the electronic device displays an animation (an animation including 1912 , 1913 , 1921 , 1922 ) in which the lock is unlocked.

In some examples, the third visual state includes ( 2032 ) a second introductory screen at a second brightness that is higher than the first brightness. In some examples, the first introductory screen (eg, 1910 ) and the second introductory screen (eg, 1920 ) are the same screen except for the degree of brightness of each screen.

In some examples, transitioning from the second visual state to the third visual state includes resizing (eg, increasing) a first user interface object (eg, 1912 ) displayed on a display of the electronic device. do (2034). In some examples, the electronic device resizes all of the displayed user interface objects. In some examples, the electronic device resizes fewer than all of the displayed user interface elements. In some examples, the first user interface object (eg, 1912 ) is a lock icon, and resizing the first user interface object includes increasing the size of the first user interface object ( 2036 ) . In some examples, transitioning from the second visual state to the third visual state includes changing the degree of blurring of the second user interface object displayed on the display of the electronic device. In some examples, one or more blur parameters, such as blur radius and/or blur size, of one or more displayed user interface objects (eg, the desktop) are increased and/or decreased. In some examples, the blur parameters of all user interface objects are changed. In some examples, blur parameters of fewer than all of the user interface objects are changed. In some examples, the first user interface object and the second user interface object are the same element. In some examples, transitioning from the second visual state to the third visual state includes translating the position of the third user interface object displayed on the display of the electronic device from the first position to the second position (eg, shifting the position). to move; to shift position without rotating). In some examples, the lock icon is moved closer to the edge of the display of the electronic devices prior to or during the unlock animation. In some examples, transitioning the device from the second visual state to the third visual state includes outputting a tactile output (eg, 1926 ). In some examples, the electronic device outputs a tactile output indicating that the biometric authentication criteria have been met while displaying the unlock animation.

In some examples, the third visual state corresponds to an unlocked state ( 2038 ). In some examples, while in the third visual state (eg, while the device is unlocked), the electronic device receives ( 2040 ) a lock input (eg, 1948 , press of button 1904 , 1952 ). In some examples, the lock input is a press of a button (eg, 1904), such as a hardware button, or selection of an affordance (eg, 1922, 1950) indicating an intention to lock the electronic device. Further, while in the third visual state, in response to receiving the lock input, the electronic device transitions ( 2042 ) from the third visual state to the locked state. In some examples, the device is locked in response to one or more specific inputs.

In some examples, while in the locked state, the device performs one or more operations available in the unlocked state (eg, displaying the home screen, displaying the content of notifications, launching applications) , sending communications) is prevented. While in the locked state, preventing the device from performing one or more operations available in the unlocked state is that certain functions or actions are not performed on the device when the device is in the locked state as opposed to being in the unlocked state. It improves device security by prohibiting it from being performed. Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life.

In some examples, the electronic device displays ( 2044 ) a lock animation that includes a sixth user interface object (eg, 1912 , 1922 ) indicating a visual state of the electronic device. Displaying a lock animation including a particular user interface object (eg, a sixth user interface object 1912 , 1922 ) provides visual feedback by allowing the user to quickly recognize that the device is in a locked state. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, the sixth user interface object is a lock. In some examples, the sixth user interface object has a first appearance (eg, an open lock) when the electronic device is in a third visual state, and a second appearance (eg, a closed lock) when the electronic device is in a locked state. have (2046). In some examples, the sixth user interface object transitions ( 2048 ) from the first appearance to the second appearance during the lock animation. In some examples, to prove that the electronic device is locked, the electronic device displays an animation of the lock being locked. In some examples, transitioning the device from the third visual state to the locked state includes outputting 2050 a tactile output (eg, 1952 ). In some examples, the tactile output comprises a single tap. In some examples, the tactile output includes multiple taps. In some examples, the tactile output is timed to synchronize with the animation of a sixth user interface object moving back and forth (eg, a lock shaking back and forth). In some examples, displaying the lock animation includes displaying the current time. In some examples, the electronic device displays a time when transitioning to a locked state.

In some examples, the biometric authentication criteria include a requirement that the user was looking at the display of the electronic device with a face that matches one or more authorized faces. Including the requirement that the user was looking at the display of the electronic device with a face that matches one or more authorized faces for the biometric authentication criteria allows authentication to be successful only by (faces of) authorized users of the device. This improves device security. Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life. In some examples, unlocking the electronic device requires that the user be looking at the electronic device.

In some examples, upon determining that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors ( 2052 ), the electronic device maintains the electronic device in a second visual state ( 2054 ). ). Maintaining the device in a second visual state upon a determination that biometric authentication criteria have not been met based on biometric data provided by the one or more biometric sensors requires the device to authenticate without meeting the appropriate authentication criteria. Device security is improved by prohibiting the transition to the current state. Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life.

In some examples, if the biometric feature is not authenticated, the display of the device does not further brighten as it responds to authentication of the biometric feature. In some examples, an explicit request (eg, 1930) for the device to unlock the device (eg, a swipe gesture from a lower portion of the device, a press of the home button, or content not available when the device is in a locked state) When the biometric authentication criteria are not met before receiving the user (other input indicating that he/she wants to view and/or interact with the Display an unlock interface (eg, 1932 ) while attempting to authenticate the user via the same one or more forms of authentication. Examples of authenticating a user in response to a request to unlock a device through different forms of authentication are described in greater detail with reference to FIGS. 26A-26A . In some examples, further in accordance with a determination that the biometric authentication criteria have not been met based on the biometric data provided by the one or more biometric sensors, the electronic device determines the location of the fourth user interface object (eg, 1912 ) Alternating ( 2056 ) between the first and second positions. In some examples, to prove that the biometric authentication failed, the electronic device shakes the lock icon displayed in the introduction interface. In some examples, a tactile output (eg, 1918 ) is provided in combination with a shaking lock icon. In some examples, no tactile output is provided.

In some examples, while the device is in an unlocked state, the electronic device detects that a lock condition has been met. In some examples, in response to detecting that the lock condition has been met, the lock condition is an explicit lock input (eg, 1922 , pressing of button 1904 , 1952 ) (eg, pressing the power button, tapping the lock icon) etc.), the electronic device transitions the device from the unlocked state to the locked state and outputs a respective lock indication (eg, 1912 ). In some examples, each lock indication includes a visual, audio, and/or tactile output indicating that the device has transitioned from an unlocked state to a locked state. In some examples, further, in response to detecting that the lock condition has been met, in response to determining that the lock condition is an implicit lock condition (eg, covering of a proximity sensor, long period of not receiving input, etc.), the electronic device: Transitions the device from the unlocked state to the locked state without outputting each lock indication.

In some examples, after detecting that the device wake criteria have been met, the electronic device detects a request to display a biometric authentication setup interface. In some examples, the request to display the biometric authentication settings interface is a switch from an edge of the display to display a control panel user interface comprising a plurality of controls, including a control associated with enabling or disabling biometric authentication. a swipe, a long press of one or more hardware buttons causing the device to display a settings user interface comprising one or more controls, including a control associated with enabling or disabling biometric authentication, or enabling or disabling biometric authentication and navigation through one or more menus in the settings app to a set of controls associated with biometric authentication including one or more controls including a control associated with enabling. In some examples, in response to a request to display a biometric authentication settings interface, the electronic device displays a biometric authentication settings interface (eg, 1954 ). In some examples, while displaying the biometric authentication settings interface, the electronic device receives a first user input (eg, 1958 ) corresponding to a request to disable biometric authentication. In some examples, in response to receiving the first user input, the electronic device disables biometric authentication. In some examples, while biometric authentication is disabled and while the device is in a locked state, the electronic device receives a request to unlock the device. In some examples, in response to receiving the request to unlock the device, the electronic device prompts for authentication using a different form of authentication than biometric authentication (eg, “pass to unlock” as shown in FIG. 19AA ). ENTER PASSCODE TO UNLOCK"). In some examples, the different form of authentication is a passcode, password, fingerprint, or the like.

In some examples, upon transitioning to the second visual state and determining that the biometric capture criteria are not met after the first predetermined time, the electronic device causes the first predetermined time to elapse and the biometric after a second predetermined time. Determine whether capture criteria are met. In some examples, the delays between attempts to detect the biometric feature are getting longer. In some examples, once the biometric authentication attempt threshold is reached, biometric authentication is disabled.

Note that the details of the processes described above with respect to method 1200 (eg, FIGS. 20A-20F ) are also applicable in a similar manner to the methods described herein. For example, method 2000 may optionally include one or more of the characteristics of various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 1800, 2200, 2500, 2700. include For example, the registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with FIGS. 19A-19H . For another example, one or more implantable interfaces described in methods 2700 are optionally displayed in response to receiving an input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 20A-20F are, optionally, implemented by the components shown in FIGS. 1A and 1B . For example, detection operation 2002 , transition operation 2004 , and transition operation 2022 are optionally implemented by event classifier 170 , event recognizer 180 , and event handler 190 . Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

21A-21AQ illustrate example user interfaces for biometric authentication, in accordance with some examples. As described in more detail below, the illustrative examples of user interfaces illustrated in FIGS. 21A-21AQ are used to illustrate the processes described below, including those of FIGS. 22A-22F.

21A illustrates electronic device 2100 (eg, portable multifunction device 100 , device 300 , or device 500 ). In the illustrative example illustrated in FIGS. 21A-21AQ , the electronic device 2100 is a smartphone. In other examples, electronic device 1500 may be a different type of electronic device, such as a wearable device (eg, smartwatch). The electronic device 2100 has a display 2102 , one or more input devices (eg, a touchscreen of the display 2102 , a button 2104 , a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 2103 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the one or more biometric sensors 2103 are one or more biometric sensors 703 . In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

21A to 21C , the electronic device 2100 performs biometric authentication with a user of the electronic device 2100 . Referring to FIG. 21A , the electronic device 2100 is in a locked state. As illustrated, in some examples, while in the locked state, the display 2102 of the electronic device 2100 is disabled. In other examples, while in the locked state, the display 2102 of the electronic device 2100 is enabled, and the electronic device 2100 displays a locked state interface (eg, that indicates that the electronic device 2100 is in the locked state). and display the locked state interface 2110 of FIG. 21C). While device 2100 is in the locked state, the electronic device initiates biometric authentication. In FIG. 21B , the electronic device 2100 initiates biometric authentication in response to detecting a wake condition (eg, the user moves the device in a predetermined manner). The electronic device performs biometric authentication in response to any number of wake conditions including, but not limited to, movement (eg, lifting) of the device, pressing a button on the device, or touching the display 2102 . It will be understood that the initiation

In some examples, initiating biometric authentication includes obtaining data corresponding to at least a portion of a biometric feature of the user (eg, capturing with one or more biometric sensors 2103 ). In response to initiating biometric authentication, electronic device 1500 may, for example, obtain (eg, capture) and process (eg, analyze) biometric data, based on the biometric data, Determine whether the measurement feature (or portion thereof) satisfies biometric authentication criteria (eg, determines whether the biometric data matches, within a threshold, the biometric template). In some examples, biometric authentication requires the user to be looking at the device during biometric authentication. Accordingly, as illustrated in FIG. 21B , the user's gaze 2106 is towards the electronic device when the user lifts the device 2100 .

In FIG. 21C , the electronic device 2100, in response to the wake condition, displays a locked status interface 2110 that includes a locked status indicator 2112 . In some examples, while displaying locked state interface 2110 , electronic device 2100 further displays flashlight affordance 2107 and camera affordance 2108 . In some examples, activation of flashlight affordance 2107 causes the electronic device to load a flashlight application. In some examples, activation of camera affordance 2108 causes electronic device 2100 to load a camera application.

In FIG. 21D , the electronic device 2100 determines that the biometric authentication was successful and, in response, displays the unlocked status interface 2120 . In some examples, display of unlocked status interface 2120 includes display of an unlock animation, as described with reference to FIGS. 19D-19G . While displaying the unlocked status interface 2120 , the electronic device 2100 further displays (eg, maintains its display) a flashlight affordance 2107 and a camera affordance 2108 . In some examples, the electronic device 2100 outputs a tactile output 2126 in response to determining that the biometric authentication is successful.

In FIG. 21E , the electronic device 2100 determines that the biometric authentication was not successful. In response, the electronic device 2100 maintains the display of the locked state interface 2110 . In some examples, the electronic device displays a shake animation in which the locked status indicator 2112 is moved left and right to simulate a “shake” effect to indicate that the biometric authentication was unsuccessful. The electronic device 2100 further outputs a tactile output 2118 to indicate that the biometric authentication was not successful.

In some examples, one or more operations accessible during display of locked state interface 2110 do not require authentication, such that one or more operations may be performed while the electronic device is in a locked state. As an example, loading the flashlight application in response to activation of the flashlight affordance 2107 does not require authentication. As another example, referring to FIG. 21F , in some examples, the electronic device 2100 detects activation of the camera affordance 2108 while in a locked state. As shown, activation of camera affordance 2108 is a tap gesture 2130 on camera affordance 2108 . 21G , in response to detecting activation of camera affordance 2108 , electronic device 2100 displays, on display 2102 , a camera application interface 2132 associated with the camera application (eg, a locked state). replaces the display of interface 2110).

Referring to FIG. 21H , in some examples, while displaying unlocked status interface 2120 , electronic device 2100 may indicate that the device is unlocked and/or of a predetermined type of input (eg, a swipe gesture) displays a prompt 2124 indicating that providing will allow the user to access secure content, such as a home screen interface (eg, home screen interface 2129 in FIG. 21I ). For example, as illustrated, electronic device 2100 detects user input 2128 , eg, near an edge of display 2102 . User input 2128 is, in some examples, a swipe gesture that is a request to access a home screen interface of electronic device 2100, and in response to swipe input 2128, the electronic device displays the home screen interface ( 2129) (eg, replace the display of unlocked interface 2120 with it). In some examples, displaying the home screen interface 2129 includes sliding the unlocked status interface 2120 in an upward direction to the home screen interface 2129, as similarly described with reference to FIGS. 19P-19R . displaying (eg, revealing) the

In FIG. 21J , the electronic device is in a locked state, eg, in response to a failed biometric authentication (as described with reference to FIGS. 21A-21C and 21E ), and a locked state interface while in the locked state, for example. (2110) is displayed. While displaying the locked state interface 2110 , the electronic device 2100 enables the user to authenticate with the electronic device 2100 that the device is locked and/or providing an input of a predetermined type (eg, a swipe gesture) Display a prompt 2133 indicating that you want to (and unlock him). For example, as illustrated, electronic device 2100 detects user input 2134 , eg, near an edge of display 2102 . User input 2134 is, in some examples, a swipe gesture that is a request to access a home screen interface of electronic device 2100 . Because the device is in a locked state (eg, the user is not authenticated with the electronic device 2100 ), the electronic device activates the alternative authentication interface 2140 in response to the swipe input 2128 , shown in FIG. 21K . Display (eg, replace the display of locked interface 2120 with it). In some examples, the alternative authentication interface 2140 includes a locked status indicator 2142 indicating that the electronic device 2100 is in a locked state.

21K-21M , electronic device 2100 performs biometric authentication while displaying alternative authentication interface 2140 . In particular, while displaying the alternative authentication interface 2140 , the electronic device 2100 detects and/or obtains biometric data of the face. The electronic device 2100 then processes the biometric data to determine whether the biometric data satisfies the biometric authentication criteria. As shown in FIG. 21L , electronic device 2100 displays biometric authentication processing glyph 2144 (eg, of locked status indicator 2142 ) to indicate that the electronic device is processing biometric data. replace the display with it). In FIG. 21M , the electronic device 2100 determines that the biometric authentication performed during display of the alternative authentication interface 2140 is successful. Consequently, the electronic device 2100 displays the biometric authentication success glyph 2146 to indicate that the biometric authentication was successful (eg, replaces the display of the biometric authentication processing glyph 2144 with it). . In some examples, electronic device 2100 further completes progress of the passcode progress indicator and, optionally, provides tactile output 2141 to indicate successful biometric authentication.

Alternatively, with reference to FIGS. 21N-21P , the user authenticates with the electronic device 2100 by entering a passcode during display of the alternative authentication interface 2140 . As shown in FIGS. 21 , the electronic device 2100 displays an alternative authentication interface 2140 , at least in part in response to the tap gesture 2148 , as shown in FIG. 21O , including a passcode, and Optionally, receives one or more other inputs representing additional alphanumeric digits of the passcode. In FIG. 21P , the electronic device 2100 determines that the passcode is valid and, in response, displays a notification 2150 indicating that the passcode was valid and the user is authenticated with the electronic device 2100 .

In some examples, in response to input of a valid passcode, electronic device 2100 selectively stores and/or updates biometric data. For example, in response to input of a valid passcode, electronic device 2100 obtains biometric data (eg, facial biometric data) and compares the biometric data to biometric data stored in the electronic device. In some examples, if the obtained biometric data is sufficiently similar to the stored biometric data, the electronic device stores the obtained biometric data and/or updates the previously stored biometric data to improve biometric authentication. In FIG. 21P , the electronic device determines that the biometric data obtained in response to the input of the valid passcode is sufficiently similar to the stored biometric data. In response, the electronic device stores the obtained biometric data and/or updates the stored biometric data, and displays an indication 2152 that the biometric data has been updated. In this manner, electronic device 2100 provides adaptive biometric authentication.

As described with reference to FIGS. 21A-21C , in some examples, the electronic device 2100 performs biometric authentication in response to a wake condition. In some examples, the electronic device receives a request to access secure content (eg, content that requires authentication to access), such as a swipe gesture requesting access to a home screen, before biometric authentication is complete. do. Accordingly, with reference to FIGS. 21Q-21S , in response to receiving a request to access secure content, electronic device 2100 displays embedded interfaces to indicate that the electronic device has not yet completed biometric authentication. . In FIG. 21Q , the electronic device displays an embeddable interface 2154 that includes a biometric authentication glyph 2160 indicating initiation of biometric authentication and an alternative authentication affordance 2156 . Activation of alternative authentication affordance 2156 causes the electronic device to display an alternative authentication interface (eg, alternative authentication interface 2140 in FIG. 21K ) (eg, replacing the display of implantable interface 2154 with it) do) do. Biometric authentication glyph 2160 is, in some examples, a simulation of a representation of a biometric feature.

Once the electronic device 2100 has obtained biometric data in response to initiating biometric authentication, the electronic device processes the biometric data, as described. In some examples, while the electronic device is processing the biometric data, the electronic device displays the biometric authentication glyph 2162 to indicate that the biometric data is being processed (eg, the biometric authentication glyph 2160 ). 's display is replaced by it). In some examples, biometric authentication glyph 2162 includes a plurality of rings that rotate in a sphere, eg, while displayed.

In FIG. 21S , the electronic device 2100 determines that the biometric data meets biometric authentication criteria. In response, the electronic device 2100 displays a biometric authentication glyph 2163 in the embeddable interface 2154 indicating that the biometric authentication was successful (eg, a display of the biometric authentication glyph 2162 with it). replace). In some examples, the electronic device stops displaying the alternative authentication affordance 2156 . Additionally or alternatively, the electronic device displays the unlocked status indicator 2122 (eg, replaces the display of the locked status indicator 2161 with it) and/or indicates that the biometric authentication was successful. A tactile output 2164 is output.

As described, in some cases, the electronic device receives a request to access secure content before biometric authentication is complete. In some examples, the electronic device receives the request after the electronic device begins processing the biometric data but before completing the biometric authentication. In such a case, the electronic device optionally displays the embedded interface 2154 with the biometric authentication glyph 2162 , omitting first displaying the biometric authentication glyph 2160 .

In some examples, one or more functions of the electronic device are optionally enabled based on whether the user is viewing the electronic device 2100 . 21T - 21Y , in some examples, some functions are disabled when the user is not looking at the electronic device 2100 and are enabled when the user is looking at the electronic device 2100 . In FIG. 21T , the user's gaze 2165 is not toward the electronic device 2100 . In response to determining that the gaze 2165 is not facing the electronic device 2100 , the electronic device 2100 displays respective functions associated with the flashlight affordance 2107 and the camera affordance 2108 , as shown in FIG. 21U . disable them While functions associated with flashlight affordance 2107 and camera affordance 2108 are disabled (eg, while the user is not looking at device 2100 ), the electronic device receives activation of camera affordance 2108 . As shown, activation is a tap gesture 2166 on camera affordance 2108 . Because the function associated with that affordance is disabled, the electronic device withholds responding to the tap gesture 2166 (eg, withholds loading the camera application).

In FIG. 21V , the user's gaze 2168 is facing the electronic device. In response to determining that the gaze 2168 is facing the electronic device 2100 , the electronic device 2100 performs respective functions associated with the flashlight affordance 2107 and the camera affordance 2108 , as shown in FIG. 21W . enable In FIG. 21X , electronic device 2100 detects activation of camera affordance 2108 . As shown, activation is a tap gesture 2170 on camera affordance 2108 . In response to activation of camera affordance 2108 , the electronic device displays, on display 2102 , a camera application interface 2132 associated with the camera application ( FIG. 21Y ) (eg, display of locked state interface 2110 ). replace).

Referring to FIG. 21Z , in some examples, the electronic device 2100, while in a locked state, displays a locked state interface 2110 that includes a notification affordance 2174 . As described, in response to the wake condition, the electronic device initiates biometric authentication. While displaying the locked state interface 2110 and prior to completing biometric authentication, the electronic device 2100 receives a request to access secure content. For example, in FIG. 21AA , electronic device 2100 detects activation of notification affordance 2174 . As shown, activation of notification affordance 2174 is a tap gesture 2176 .

Referring to FIG. 21A , in response to activation of the notification affordance 2174 , the electronic device 2100 performs an implantable biometric authentication interface 2178 having a biometric authentication progress indicator 2182 and an alternative authentication affordance 2180 . ) (eg, replace the display of locked state interface 2110 with it). In some examples, biometric authentication progress indicator 2182 includes a biometric authentication glyph, such as biometric authentication glyph 2183 , indicating progress of biometric authentication. In some examples, the biometric authentication progress indicator further identifies secure content associated with a request to access secure content (eg, “messages”). Activation of the alternative authentication affordance 2180 causes the electronic device to display an alternative authentication interface, examples of which are further described below.

While displaying the embedded biometric authentication interface 2178 , the electronic device 2178 continues to perform biometric authentication initiated in response to the wake condition. In some examples, initiating biometric authentication includes obtaining data corresponding to a biometric characteristic of the user (eg, capturing with one or more biometric sensors). Referring to FIG. 21A , in response to obtaining the data, the electronic device processes the biometric data to determine whether the biometric feature satisfies biometric authentication criteria, eg, based on the biometric data. (eg, determine whether the biometric data matches the biometric template, within a threshold). While electronic device 2100 processes biometric data, electronic device 2100 optionally displays biometric authentication glyphs 2184 within implantable biometric authentication interface 2178 indicating that biometric data is being processed. (eg, replace the display of biometric authentication glyph 2183 with it).

In FIG. 21A , the electronic device 2100 determines that the biometric feature satisfies the biometric authentication criteria. In response, the electronic device displays a biometric authentication glyph 2185 in the embedded biometric authentication interface 2178 indicating that the biometric authentication was successful (eg, a display of the biometric authentication glyph 2184 thereon) replace). Additionally or alternatively, the electronic device displays the unlocked status indicator 2122 (eg, replaces the display of the locked status indicator 2112 with it) and/or indicates that the biometric authentication was successful. A tactile output 2164 is output.

21A and 21A , in response to determining that biometric authentication is successful, electronic device 2100 displays messaging application interface 2194 (eg, of implantable biometric authentication interface 2178 ). replace the display with it). In some examples, displaying the messaging application interface 2194 includes sliding the biometric authentication interface 2178 in an upward direction to close the messaging application interface 2194, as similarly described with reference to FIGS. 19P-19R . displaying (eg, revealing).

21ag-21ai describe an alternative manner of display in which biometric authentication progress is displayed. As described with reference to FIG. 21AA (and as shown in FIG. 21AG ), the electronic device 2100, while displaying the locked state interface 2110, prompts to access secure content prior to completing the biometric authentication. receive a request The request is activation 2176 of notification affordance 2174 in some examples. In response to activation 2176 of notification affordance 2174 , the electronic device maintains display of locked state interface 2110 . Additionally, as shown in FIG. 21A , electronic device 2100 displays biometric authentication glyph 2184 to indicate that biometric data is being processed (eg, display of locked status indicator 2110 ). replaced by it). In FIG. 21AI , the electronic device determines that the biometric authentication is successful, and in response, displays the unlocked status indicator 2122 (eg, replaces the display of the biometric authentication glyph 2184 with it) . Optionally, the electronic device 2100 further outputs a tactile output 2193 indicating that the biometric authentication is successful. In some examples, as the electronic device transitions to an unlocked state in response to determining that the biometric authentication is successful, the electronic device 2100 displays a notification affordance 2175 (eg, a notification affordance 2174 ). 's display is replaced with it). In some examples, notification affordance 2174 identifies secure content (eg, “John Appleseed … meeting where…”).

In FIG. 21aj , in response to processing the biometric data (as described with reference to FIG. 21A ), the electronic device determines that the biometric authentication is not successful. In response, electronic device 2100 displays biometric authentication glyph 2189 in biometric authentication interface 2178 indicating that biometric authentication was unsuccessful (eg, display of biometric authentication glyph 2184 ). is replaced by it). Additionally or alternatively, the electronic device alternates the position of the locked status indicator 2112 to simulate a “shake effect” to indicate that the biometric authentication was unsuccessful, and/or the biometric authentication was unsuccessful. A tactile output 2193 indicating

While displaying the implantable biometric authentication interface 2178 , the electronic device detects activation of the alternative authentication affordance 2180 . Activation of the alternative authentication affordance 2108 is a tap gesture 2192 in some examples. Referring to FIG. 21AK , in response to activation of the alternative authentication affordance 2180 , the electronic device displays the alternative authentication affordance 2198 . In some examples, alternative authentication affordance 2198 includes an indicator 2199 identifying secure content associated with a request to access secure content (eg, “messages”).

21A and 21A , in response, at least in part, to a tap gesture 2102A ( FIG. 21L ) and, optionally, one or more other inputs indicating additional alphanumeric digits of a valid passcode, the electronic device 2100 A valid passcode (or password) is received by 21N and 21O , once a valid passcode has been received, the electronic device is unlocked and displays the messaging application interface 2194 (eg, the display of the alternative authentication interface 2198 with it replace). In some examples, displaying the messaging application interface 2194 may include sliding the alternative authentication interface 2198 in an upward direction to activate the messaging application interface 2194, as similarly described with reference to FIGS. 19P-19R . displaying (eg, revealing).

In some examples, in response to determining that the biometric authentication was not successful, the electronic device further determines that a threshold number of biometric authentication attempts has been reached. Accordingly, as shown in FIG. 21AP , the electronic device 2100 uses the biometric authentication progress indicator 2182 to indicate that a threshold has been reached (“facial authentication is temporarily disabled”). 21AK , while displaying the implantable biometric authentication interface 2178, the electronic device detects activation of the alternative authentication affordance 2180, and in response to activation of the alternative authentication affordance 2180, Display an alternative authentication affordance 2198 . 21Aq , when the electronic device determines that a threshold number of biometric authentication attempts has been reached, an indicator 2199 indicates that biometric authentication is re-enabled in response to input of a valid passcode. Identify ("ENTER PASSCODE TO RE-ENABLE FACE AUTHENTICATION").

22A-22F are flow diagrams illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. Method 2200 includes a device having a display, one or more input devices (eg, a touchscreen, microphone, camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection, such as a 4G LTE connection). For example, 100, 300, 500, 2100). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric feature by the one or more biometric sensors. Some operations of the method 2200 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 2200 provides an intuitive method for performing authentication of biometric features. This method reduces the cognitive burden on the user for performing authentication of biometric features, thereby creating a more efficient human-machine interface and intuitive user experience. For battery-operated computing devices, enabling a user to more quickly and more efficiently manage authentication of biometric features saves power and increases the time between battery charges.

In some examples, while the device is in a locked state, the electronic device (eg, 2100 ) receives ( 2202 ) a request to perform an operation that does not require authentication. In some examples, in response to a request to perform an operation that does not require authentication, the electronic device performs the operation without waiting for authentication. Performing an operation that does not require authentication without waiting for authentication allows for faster access to the operation without the user having to provide additional input (eg, an input instructing the device to proceed). Performing an action (automatically) when a set of conditions are met without requiring additional user input helps the user to provide appropriate inputs (e.g., when actuating/interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. .

In some examples, a request to perform an operation that does not require authentication may include a request to enable a camera of an electronic device (eg, 2130 ) and/or a camera user interface (eg, a camera user interface to capture images and/or videos with the device) , 2132 ), and accessing camera functions of the device. In some examples, an operation that does not require authentication includes one or more restricted features that are restricted without successful authentication (eg, sharing captured photos or video, capturing during previous use of the camera application while the device was unlocked). displaying an application user interface that includes the photos or videos that were taken), wherein the device attempts biometric authentication while displaying the application user interface. Displaying an application user interface that includes one or more restricted features that are restricted without successful authentication provides visual feedback by allowing the user to quickly see which features are currently restricted on the application without proper authentication. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. If biometric authentication is successful while displaying the application user interface, the restricted features are enabled, and if the biometric authentication is unsuccessful, the restricted features remain disabled (eg, the user can Prevent sharing photos or videos, viewing photos or video captured during previous use of the camera application while the device was unlocked, and, optionally, authentication in response to an attempt to use any of the restricted features is prompted to provide).

In some examples, while the electronic device is in a locked state, the electronic device provides, on the touch-sensitive display (eg, 2102 ), one or more affordances (eg, 2107 , 2108 ) for performing operations for which authentication is not required. (e.g., to access a camera function of a device, such as displaying a flashlight affordance to enable an illuminated flashlight operating mode on the device and/or a camera user interface for capturing images and/or videos with the device. camera affordance).

In some examples, while displaying one or more affordances for performing operations for which authentication is not required, the electronic device provides an affordance (eg, 2107, 2108) of each of the one or more affordances for performing operations for which authentication is not required. to detect the activation (eg, 2130) of In some examples, in response to detecting activation of each of the one or more affordances for performing operations for which authentication is not required, determining that the face was looking at the display of the electronic device when activation of the respective affordance was detected In accordance with (eg, determining that there is a face within the field of view of one or more cameras or one or more biometric sensors of the device having facial characteristics indicative of the face viewing the electronic device), the electronic device performs an action associated with each affordance. do. Performing the action associated with each affordance in accordance with a determination that a face (eg, of a user) was looking at the display of the device includes performing the action when the device detects that the user is looking at the device (eg, when the user is looking at the device). Taking no action when not looking at the device (which optionally indicates that affordance was unintentionally chosen) reduces the device's power usage and improves battery life.

In some examples, if a flashlight affordance (eg, 2107 ) is activated while the face is looking at the display of the electronic device, the electronic device enables an illuminated flashlight operating mode on the device and/or the face When a camera affordance (eg, 2108) is activated while viewing the display, the electronic device accesses the device's camera functionality, such as displaying a camera user interface for capturing images and/or videos with the device. In some examples, determining that the face was not looking at the display of the electronic device when activation of the respective affordance was detected (eg, no face was detected, or a face was detected but one or more cameras or one or more biometrics of the device) Upon determining that there is a face in the view of the sensors with facial characteristics indicative of a face turning away from the electronic device), the electronic device withholds performance of the action associated with the respective affordance. In some examples, if a flashlight affordance is activated while the face is not looking at the display of the electronic device, the electronic device withholds enabling an illuminated flashlight operating mode on the device and/or the face is on the display of the electronic device If the camera affordance is activated while not viewing, the electronic device withholds access to the device's camera function, such as displaying a camera user interface for capturing images and/or videos with the device.

In some examples, while the electronic device is in a locked state, the electronic device is subject to a condition associated with performing a biometric authentication check using the biometric sensor without explicit input from the user requesting biometric authentication (eg, a user elevates device 2100 to the position shown in FIG. 21B). In some examples, a condition associated with performing a biometric authentication check using a biometric sensor without explicit input from the user requesting biometric authentication may include raising the device and/or a display wake button (eg, 2104). ), including pressing

In some examples, the one or more biometric sensors are a contactless biometric sensor (eg, 2103 ) configured to capture biometric data associated with biometric features located within a predetermined range of distances from the contactless biometric sensor (eg, 2103 ). 2103) (eg, a facial recognition sensor) (2204). In some examples, the biometric sensor comprises a camera. In some examples, the biometric sensor comprises a light projector (eg, an IR light projection or structured light projector).

In some examples, the device is restricted from performing more than a predefined number of biometric authentication checks without successful authentication ( 2206 ). Restricting a device from performing more than a predefined number of biometric authentication checks without successful authentication improves device security by limiting fraudulent authentication attempts on the device. Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life.

In some examples, successful authentication includes successful authentication via biometric authentication, or any other form of authentication, such as using a passcode, password or pattern. In some examples, the device performs at least one biometric authentication check for use in response to detecting a request to perform less than a predefined number of biometric authentication checks in response to detecting the condition to perform a respective action. Book confirmation. In some examples, the electronic device tracks a number of failed authentication attempts, such as a number of failed sequential unsuccessful attempts without intervening successful authentication (eg, biometric authentication, or other authentication such as password authentication). In some such examples, if the maximum number of failed attempts is reached, the device does not perform biometric authentication until a successful non-biometric authentication is received. In some examples, the request to perform an action requiring authentication after reaching the maximum number of failed biometric authentication checks results in display of an alternative authentication user interface (eg, password, passcode, pattern, or other authentication interface). trigger

In some examples, while a display (eg, 2102 ) of the electronic device is disabled, the electronic device detects a display wake condition ( 2208 ). In some examples, the display wake condition is a movement of the device in a predefined manner, such as movement of the device above a threshold amount, movement of the device in an orientation associated with waking the device, activation of a display wake button, or a touch response. Includes gestures such as taps on the shape surface.

In some examples, in response to detecting the condition, the electronic device performs a first biometric authentication check ( 2210 ). Performing a biometric authentication check in response to detecting a condition (eg, a wake condition) allows a user to provide authentication information to a device quickly and efficiently and with minimal input in response to a wake condition being detected. Performing an action (automatically) when a set of conditions are met without requiring additional user input helps the user to provide appropriate inputs (e.g., when actuating/interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. .

In some examples, performing the first biometric authentication check includes capturing 2212 first biometric data using one or more biometric sensors. In some examples, the electronic device initiates a first biometric authentication procedure comprising capturing first biometric data using one or more biometric sensors. In some examples, performing the first biometric authentication check includes after capturing the first biometric data 2214 (eg, in response to capturing the first biometric data or in response to a request to unlock the device). ), in accordance with a determination that the first biometric data satisfies the biometric authentication criteria, the electronic device transitions the device from the locked state to the unlocked state ( 2216 ). Transitioning the device from the locked state to the unlocked state according to a determination that the first biometric data satisfies the biometric authentication criteria may be accomplished by unlocking the device if the authentication process is successful (however, in some examples, the authentication succeeds). It improves device security (by preventing the device from being unlocked if not). Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life.

In some examples, the electronic device determines whether the first biometric data meets biometric authentication criteria. In some examples, the biometric authentication criteria include a criterion satisfied when the first biometric data matches biometric data (eg, facial feature data, fingerprint data, iris data) corresponding to an authorized user. In some examples, while in the unlocked state and prior to detecting the request to perform the respective operation, the electronic device, according to prompt criteria, responds to instructions to provide a request to perform the respective operation. A prompt (eg, visual, audio, or tactile output) is output (2218). In some examples, the device is in an unlocked state after detecting an authorized user's face. In some examples, the electronic device displays instructions (eg, 2124 ) to “swipe up” to access the home screen (eg, 2129 ). In some examples, the prompt criteria include a requirement that the user's gaze (eg, 2168 ) is facing the electronic device ( 2220 ). In some examples, the prompt criteria include ( 2222 ) a requirement that the device detects facial characteristics indicative of a face looking at the electronic device for at least a predetermined amount of time (eg, detecting that the user's gaze is facing the electronic device).

In some examples, upon determining that the first biometric data does not satisfy the biometric authentication criteria, the electronic device maintains the device in a locked state ( 2224 ). Maintaining the device in a locked state upon a determination that the first biometric data does not satisfy the biometric authentication criteria improves device security by preventing unauthorized and/or unauthorized access to the device. Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life. In some examples, if the biometric data corresponding to the biometric feature does not match the biometric authentication template, the device remains locked in response to the failed authentication.

In some examples, after performing the first biometric authentication check, the electronic device detects, via the device, a request (eg, 2134 , 2176 ) to perform a respective operation without receiving additional authentication information from the user (eg, 2134 , 2176 ). 2226). In some examples, detecting, via the device, a request to perform each operation without receiving additional authentication information from the user, includes a request to display content that is not available for display when the electronic device is in a locked state. and detecting (2228). In some examples, the user input is an input that requires access to secure data, such as a home screen or an application that presents secure data. In some examples, the request to perform each action includes a swipe gesture on the device, a swipe gesture from an edge of the device (eg, 2134 ), or a press of a home button. In some examples, the request to perform each operation includes a selection (eg, 2176 ) of a notification (eg, a request to perform each operation includes a notification and a long look, such as an application corresponding to the notification or a long look). a request to display associated additional information); A swipe gesture (eg, the request to perform each operation is an upward swipe on the display of the electronic device; in some examples, the request to perform each operation is an upward swipe starting from an edge of the display of the electronic device. In some examples, the swipe is, inter alia, a request to display the home screen of the electronic device); movement of the electronic device in a predetermined manner (eg, the request to perform each operation includes lifting the electronic device); and a selection of an affordance (eg, the request to perform each operation includes a selection of an affordance displayed by the electronic device including a “lock” affordance displayed when the electronic device is in a locked state). includes (2230).

In some examples, while performing the first biometric authentication check, the electronic device receives ( 2232 ) a second request (eg, 2134 ) to perform a second operation without receiving additional authentication information from the user. In some examples, the second request is a swipe gesture, selection of a notification, or the like. In some examples, in response to receiving ( 2234 ) the second request to perform the second action, a second request to perform the second action is received after determining that the first biometric data does not satisfy the biometric authentication criteria Upon determining that it is, the electronic device displays ( 2236 ) a second alternative authentication interface (eg, 2140 ). In some examples, the second alternative authentication interface is a passcode, password, pattern, or fingerprint authentication user interface and is displayed without performing the second action if the biometric authentication has failed at least once. In some examples, according to a determination that a second request to perform a second action has been received prior to evaluating the first biometric data (eg, prior to determining whether the first biometric data satisfies biometric authentication criteria) , the electronic device displays ( 2238 ) a biometric authentication indicator (eg, 2156 , 2162 ) including an indication that biometric authentication is being attempted without displaying a second alternative authentication interface. In some examples, the second alternative authentication interface is a passcode, password, pattern, or fingerprint authentication user interface and is not displayed and the second action is not performed if the device did not have time to complete the first biometric authentication attempt . In some examples, if the user swipe up while the electronic device is performing the first iteration of biometric authentication, the electronic device displays an embeddable interface (eg, 2154 ) in which the processing status of the biometric authentication appears. In some examples, in response to receiving the second request to perform the second action, according to a determination that the second request to perform the second action was received after determining that the first biometric data satisfies biometric authentication criteria , the electronic device performs the second operation without displaying an alternative authentication interface (eg, a passcode, password, pattern, or fingerprint authentication user interface is displayed if biometric authentication fails at least once). In some examples, in response to receiving the second request to perform the second action, the biometric authentication indication displayed according to a determination that a second request to perform the second action was received prior to evaluating the first biometric data. A ruler (eg, 2182 ) includes an indication of an application associated with the notification. In some examples, if the user selects a notification while the device is performing the first biometric authentication check, the device presents an application associated with the notification. As an example, if the user selects a message notification, the device may be associated with a messaging application, such as "Biometric Authentication for Messages" or "Face ID for Messages". display the indication.

In some examples, in response to detecting the request to perform the respective operation ( 2240 ), in accordance with a determination that the respective operation does not require authentication, the electronic device performs ( 2242 ) the respective operation. Performing each operation without successful authentication in accordance with a determination that each operation does not require authentication allows the user to access the operation more quickly without having to provide additional input (eg, an input instructing the device to proceed). do. Performing an action (automatically) when a set of conditions are met without requiring additional user input helps the user to provide appropriate inputs (e.g., when actuating/interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. . In some examples, if the operation does not require authentication, the electronic device performs the operation regardless of whether the device is in a locked or unlocked state. In some examples, the device does not verify authentication if each operation does not require authentication, such as use of a camera or making an emergency call.

In some examples, upon determining that each operation requires authentication and the device is in an unlocked state, the electronic device performs ( 2244 ) each operation. When the device is in an unlocked state, performing each operation in accordance with a determination that each operation requires authentication is an operation without the user having to provide additional input (eg, an input instructing the device to proceed). provide faster access to Performing an action (automatically) when a set of conditions are met without requiring additional user input helps the user to provide appropriate inputs (e.g., when actuating/interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. .

In some examples, upon determining 2246 that each operation requires authentication and that the device is in a locked state, the electronic device scans the one or more biometric sensors without explicit input from the user requesting a second biometric authentication confirmation. to capture second biometric data (2248). Capturing the second biometric data without explicit input from the user each requesting authentication and requesting a second biometric authentication confirmation in accordance with a determination that the device is in the locked state, while the device is in the locked state It improves device security by requiring successful authentication and thus preventing unauthorized and/or unauthorized access to the device. Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life.

In some examples, after capturing the second biometric data, the electronic device performs a second biometric authentication check ( 2250 ). In some examples, the first biometric data and the second biometric data are compared to the same set of biometric criteria. In some examples, the first and second biometric data are compared to a respective set of biometric criteria. In some examples, performing the second biometric authentication check includes performing 2252 a respective operation in accordance with a determination that the second biometric data satisfies the biometric authentication criteria. In some examples, the electronic device optionally further transitions the device from a locked state to an unlocked state. In some examples, performing the second biometric authentication check includes, in accordance with a determination that the second biometric data does not satisfy the biometric authentication criteria, withholding performance of the respective operation (and optionally locking the device) maintain state) 2254 . In some examples, withholding performance of the respective operation includes maintaining 2256 the device in a locked state. In some examples, withholding performance of the respective operation includes displaying 2258 an alternative authentication user interface (eg, 2140 , 2198 ). In some examples, the alternative authentication interface is a passcode, password, pattern or fingerprint authentication user interface. In some examples, while displaying the alternative authentication user interface, the electronic device detects an alternative authentication attempt (eg, input of a passcode comprising tap gesture 2102A) corresponding to the alternative authentication user interface. In some examples, the alternative authentication challenge corresponding to the alternative authentication user interface is an input passcode, input password, input pattern, or fingerprint detected on the fingerprint sensor. In some examples, in response to detecting an alternative authentication attempt corresponding to the alternative authentication user interface, the authentication attempt is successful (eg, the provided authentication information includes a stored passcode, a stored password, a stored pattern, or a stored fingerprint information and matching the same stored authentication information) biometric data corresponding to an alternate authentication attempt (eg, the last character of a passcode or biometric captured during or shortly after an authentication attempt, such as when a submit password button is selected) In accordance with a determination that the measurement data or the second biometric data) meets the first similarity criteria for the stored biometric data corresponding to an authorized user of the device, the electronic device performs the respective operation. In some examples, the electronic device stores additional information based on the biometric data corresponding to the alternative authentication challenge as biometric data that can be used in future biometric authentication attempts to identify an authorized user of the device. In some examples, the electronic device learns changes to the user's face for use in authenticating the user in future authentication attempts. In some examples, further, in response to detecting an alternative authentication attempt corresponding to the alternative authentication user interface, the authentication attempt was successful and the biometric data corresponding to the alternative authentication challenge corresponds to an authorized user of the device. Upon determining that the stored biometric data meets the first similarity criteria for the stored biometric data, the electronic device may cause the electronic device to modify information (eg, biometric template) used in future biometric authentication attempts to identify an authorized user of the device. output (eg, visual, audio, and/or tactile output) indicating that the In some examples, the electronic device displays an indication that the biometric data has been updated to better recognize the user's face.

In some examples, the authentication attempt is successful (eg, the provided authentication information matches stored authentication information, such as a stored passcode, stored password, stored pattern, or stored fingerprint information) and biometric data corresponding to the alternative authentication attempt ( biometric data or second biometric data) captured during or immediately after an authentication attempt is in progress, such as when the last character of a passcode or submit password button is selected, for example In accordance with a determination that the first similarity criteria for the stored biometric data are not met, the electronic device performs a respective operation. Performing each action in accordance with a determination that the authentication attempt is successful and that biometric data corresponding to the alternative authentication challenge does not meet the first similarity criteria for the stored biometric data comprises: It provides the user with an alternative method to access operations (eg, locked operations) of the device that require successful authentication when not corresponding to the data. Providing additional control options with additional displayed controls improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) -Make the device interface more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the electronic device does not store additional information based on the biometric data corresponding to the alternative authentication attempt as biometric data that can be used in future biometric authentication attempts to identify an authorized user of the device. . In some examples, in response to detecting an alternative authentication attempt corresponding to an alternative authentication user interface, in response to a determination that the authentication attempt is not successful (eg, the provided authentication information may include a stored passcode, a stored password, a stored pattern, or (does not match stored authentication information that matches stored authentication information, such as stored fingerprint information), the electronic device withholds performing the respective operation and sends additional information based on biometric data corresponding to the alternative authentication attempt to the device does not store as biometric data that can be used in future biometric authentication attempts to identify an authorized user of

In some examples, in response to detecting the request to perform each operation and upon determining that each operation requires authentication and the device is in a locked state, the electronic device displays an alternative authentication interface. Providing an alternative authentication interface (eg, to provide an alternative method for providing authentication alternatively to or in addition to biometric authentication) may be a problem for which current authentication methods have not succeeded or continue to be unsuccessful. In this case, it allows the user to easily provide authentication for actions using different authentication methods. Providing additional control options (eg, for providing authentication) in this way without cluttering the UI with additional displayed controls allows the user to make appropriate inputs (eg, when operating/interacting with the device). It improves the operability of the device and makes the user-device interface more efficient (by helping to provide and reducing user errors), which additionally reduces the power usage of the device by enabling the user to use the device more quickly and efficiently. Reduce and improve battery life.

In some examples, in response to the user requesting access to secure data after the failure of the first iteration of biometric authentication, the electronic device configures an alternative authentication interface (eg, 2140, 2198), such as a password or passcode interface. ) is displayed. In response to the user requesting access to secure data after failure of the biometric authentication of the first iteration, displaying an authentication interface, such as a password or passcode interface, indicates successful authentication when the biometric data is unsuccessful. It provides the user with a quick alternative way to access the operations (eg, locked operations) of the device that requires it. Providing additional control options with additional displayed controls improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) -Make the device interface more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the alternative authentication interface is displayed after an additional time delay and/or after an additional biometric authentication attempt has failed (eg, as described in greater detail with reference to FIGS. 26A-26A ). In some examples, the biometric authentication criteria include a requirement that authentication using the alternative authentication interface has not yet begun for the biometric authentication criteria to be met ( 2260 ). In some examples, at least partially attempt (eg, in response to) biometric authentication while displaying the alternative authentication user interface: in accordance with a determination that the biometric authentication was successful and authentication using the alternative authentication interface did not begin. , the electronic device performs each operation; Upon a determination that authentication using the alternative authentication interface has begun (eg, a determination that at least a partial credential, such as a partial passcode, pattern, or password, has been received using the alternative authentication interface), the electronic device is biometrically Refrain from performing each operation based on authentication. In some examples, the electronic device waits to perform the second biometric authentication until the user finishes providing the passcode. In some examples, the device delays displaying the alternative authentication user interface until after the second biometric authentication check has failed (eg, as described in more detail with reference to FIGS. 26A-26A ), and the device A third biometric authentication check is performed after the authentic authentication user interface is displayed.

In some examples, a second biometric authentication check is performed 2262 while displaying an alternative authentication interface (eg, 2140 ). Performing the second biometric authentication check while displaying the alternative authentication interface may, in some examples, include operating the device by completing the second biometric authentication check prior to completion of the user providing the manual alternative authentication input. performance, thereby making the user-device interface more efficient.

In some examples, the alternative authentication interface is a passcode, password, pattern or fingerprint authentication user interface. In some examples, performing at least a portion of the second biometric authentication confirmation includes performing at least a portion of the second biometric authentication confirmation while displaying the alternative authentication interface. In some examples, biometric authentication is performed during passcode entry. In some examples, the biometric authentication UI is displayed on the passcode input interface (eg, biometric progress indicators 2142 , 2144 , 2146 ).

In some examples, while displaying an alternative authentication user interface (eg, passcode, password, pattern, or fingerprint authentication user interface), the electronic device determines that biometric authentication criteria have been met. In some examples, in response to determining that the biometric authentication criteria have been met, the electronic device performs a respective action. Performing each action in response to determining that the biometric authentication criteria have been met while displaying the alternative authentication user interface may, in some examples, include performing a second action prior to completion of the user providing the manual alternative authentication input. Completing biometric authentication checks improves the operability of the device, thereby making the user-device interface more efficient. In some examples, the biometric authentication criteria include a requirement that the user has not entered at least a portion of the credential using an alternative authentication interface. In some examples, the biometric authentication criteria include a requirement that the user has not entered at least a portion of the credential using an alternative authentication interface. In some examples, if the user has already started entering an alternative form of authentication, such as a passcode, password, pattern, or fingerprint, the respective action is not performed in case of successful biometric authentication.

In some examples, in response to detecting the request to perform each operation and upon determining that each operation requires authentication and the device is in a locked state, the electronic device provides an option to proceed with an alternative form of authentication. displays an authentication indication for biometric authentication (eg, a progress indicator or other indication that biometric authentication is being attempted) without displaying the . In some examples, the electronic device displays an authentication indication for biometric authentication without displaying the alternative authentication interface and/or without displaying a selectable option to display the alternate authentication interface. In some examples, while attempting biometric authentication in response to a request to perform each action, the device provides options for an alternative form of authentication to indicate to the user that the biometric authentication has not yet failed. withhold (eg, as described in more detail with reference to FIGS. 26A-26A ).

In some examples, while the device is in an unlocked state, the electronic device prompts to store additional information for use in biometric authentication (eg, in a biometric enrollment user interface in a system preference user interface or a device settings user interface). receive a request In some examples, in response to a request to store additional information for use in biometric authentication, the electronic device captures third biometric data. In some examples, further, in response to a request to store additional information for use in biometric authentication, the third biometric data sets second similarity criteria to the stored biometric data corresponding to an authorized user of the device. Upon determining that it does, the electronic device stores additional information based on the third biometric data that can be used in future biometric authentication attempts to identify an authorized user of the device. storing additional information based on the third biometric data that may be used in future biometric authentication attempts to identify an authorized user of the device while the device is in the unlocked state (eg, and the device is in the locked state prohibiting such operation while in existence) improves device security, preventing fraudulent attempts and/or unauthorized attempts to stored biometric authentication data on the device, thereby gaining future access to the device . Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life.

In some examples, the electronic device learns changes to the user's face for use in authenticating the user in future authentication attempts. In some examples, the second similarity criteria require that the similarity between the third biometric data and the stored biometric data be less than required by the first similarity criteria. In some examples, when the device is in an unlocked state and in the biometric data enrollment user interface, the device learns biometric features that are detected when alternative authentication is successfully provided after biometric authentication fails. and receive additional biometric data corresponding to the biometric feature that is more different from the currently enrolled biometric features than when it is being read. In some examples, upon determining that the third biometric data does not meet second similarity criteria for stored biometric data corresponding to an authorized user of the device, the electronic device is configured to: store additional information based on the third biometric data that can be used in future biometric authentication attempts. In some examples, the electronic device learns changes to the user's face for use in authenticating the user in future authentication attempts.

Note that the details of the processes described above with respect to method 1200 (eg, FIGS. 22A-22F ) are also applicable in a similar manner to the methods described herein. For example, method 2200 may optionally include one or more of the characteristics of various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 1800, 2000, 2500, 2700. include For example, the registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with FIGS. 21C-21E . For another example, one or more implantable interfaces as described in methods 2000 , 2700 are optionally displayed in response to receiving input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 22A-22F are optionally implemented by the components shown in FIGS. 1A and 1B . For example, detect operation 2202 , perform operation 2210 , capture operation 2212 , transition operation 2216 , hold operation 2224 , detect operation 2226 , perform operation 2250 , and hold operation ( 2254 , optionally implemented by event classifier 170 , event recognizer 180 , and event handler 190 . Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

23A-23Q illustrate example user interfaces for managing biometric authentication, in accordance with some examples. As described in more detail below, the illustrative example of the user interfaces illustrated in FIGS. 23A-23Q is related to the illustrative example of the user interfaces illustrated in FIGS. 24A-24BC , which is then followed by FIGS. 25A-24B . It is used to illustrate the processes described below, including the processes of 25c.

23A illustrates an electronic device 2300 (eg, portable multifunction device 100 , device 300 , or device 500 ). In the illustrative example illustrated in FIGS. 23A-23Q , the electronic device 2300 is a smartphone. In other examples, the electronic device 2300 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 2300 has a display 2302 , one or more input devices (eg, a touchscreen of the display 2302 , a button 2304 , a microphone (not displayed)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 2303 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the one or more biometric sensors 2303 are one or more biometric sensors 703 . In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 23A , electronic device 2300 displays photo gallery user interface 2310 on display 2302 . In some examples, photo gallery user interface 2310 slides into the display from the edge of the display (eg, slides up from the bottom edge of the display), replacing the display of the previous interface, application, and/or virtual keyboard. In some examples, photo gallery user interface 2310 slides up in response to a request to open a photo gallery application. In some examples, photo gallery user interface 2310 slides up in response to a request to send photos to a participant in a conversation in a messaging application.

In some examples, as shown in FIG. 23A , photo gallery user interface 2310 may provide a plurality of selectable Includes preview images. In some examples, as also shown in FIG. 23A , the plurality of selectable preview images are selected based on time (eg, the date the picture was taken) and/or based on location (eg, where the picture was taken). are organized For example, a plurality of selectable preview images 2312A-2312F shown under header 2312 correspond to photos taken on April 30 in Cupertino, CA, USA, and shown under header 2314 The plurality of selectable preview images 2314A to 2314C correspond to photos taken yesterday in San Francisco, California, USA.

In some examples, upon launching the photo gallery application, the electronic device 2300 displays selectable preview images of the photo gallery user interface 2310 that can be selected (to be sent). For example, the plurality of selectable preview images includes selectable preview images 2314-2314C. As shown in FIG. 23A , a plurality of selectable preview images 2314A-2314C may be selected by a user for transmission to a participant via one or more applications, such as a messaging application or an email application.

In FIG. 23B , while displaying a photo gallery user interface 2310 with selectable preview images 2314A-2314C (corresponding to photos selected for transmission), the electronic device 2300 is configured to: Detects user activation 2301 of a transmit affordance 2316 (eg, a button) to initiate transmission of photos corresponding to images 2314A, 2314B. For example, user activation 2301 is a tap gesture on transmit affordance 2316 .

23C , in response to detecting activation of transmit affordance 2316 , electronic device 2300 provides prompt 2318 . As illustrated in FIG. 23C , in some examples, prompt 2318 instructs the user to provide one or more activations of button 2304 , such as a double press of button 2304 . In some examples, prompt 2318 is highlighted relative to one or more other displayed objects. Emphasizing the prompt in this manner includes, for example, darkening, blurring, and/or otherwise obscuring one or more portions of the photo gallery user gallery 2310 .

As also illustrated in FIG. 23C , further, in response to detecting activation of the transmit affordance 2316 , the electronic device 2300 configures an application selection interface comprising a plurality of application affordances 2320A - 2320H ( 2320) is displayed. In some examples, each of application affordances 2320A - 2320H is configured to transmit images (to a different device other than electronic device 2300 ), such as images corresponding to selectable preview images 2314A - 2314C. Corresponds to the applications that can be used.

In some examples, button 2304 has a fixed position relative to display 2302 and/or one or more other components of electronic device 2300 . In some examples, prompt 2318 is also displayed in a fixed location relative to display 2302 and/or one or more other components of the electronic device. In this manner, prompt 2318 is displayed at a predetermined location relative to button 2304 .

In FIG. 23D , electronic device 2300 detects user activation 2306 of button 2304 while displaying prompt 2318 (which is optionally overlaid over photo gallery user interface). In some examples, as shown in FIG. 23D , the user activation is a double press of button 2304 . In some examples, the double press of the button 2304 includes a first press of the button and a second press of the button that occur within a predetermined amount of time (eg, 1 second).

In response to detecting one or more activations of button 2304 , electronic device 2300 initiates biometric authentication (eg, facial recognition authentication) for a biometric feature (eg, face) of the user. As illustrated in FIG. 23E , in some examples, upon initiation of biometric authentication, a biometric authentication interface 2322 is provided (eg, displayed on display 2302 ). In some examples, the biometric authentication interface is overlaid over an application interface, such as photo gallery user interface 2310 , during biometric authentication. In some examples, biometric authentication includes simulation of a representation of a biometric feature, such as glyph 2324 . Further, in response to one or more activations of button 2304 , one or more biometric sensors 2303 of electronic device 2300 , such as one or more cameras or a facial recognition sensor (eg, one or more biometric sensors) (contained in 2303) is activated.

In some examples, once the one or more biometric sensors 2303 are activated, the electronic device 2300 obtains (eg, captures) biometric data corresponding to a biometric feature associated with the user. In some examples, the biometric feature captures biometric data using one or more biometric sensors 2303 of the electronic device (and/or biometric sensors of one or more cameras). Optionally, a light emitting device such as an IR floodlight or structured light projector is used to help illuminate the biometric feature. In other examples, the electronic device receives biometric data from another device.

In some examples, once the electronic device 2300 has obtained the biometric data, the electronic device processes (eg, analyzes) the biometric data to determine whether the biometric authentication is successful. In some examples, such determining includes determining whether the biometric data matches a biometric template associated with the user. The biometric template is optionally stored on the electronic device 2300 .

In some examples, while processing biometric data, as illustrated in FIG. 23F , biometric authentication interface 2322 may be configured to, eg, as described with reference to FIGS. 17A-17A , biometric authentication interface. to display one or more rotating rings 2326, indicating that biometric data is being processed by the electronic device. In some examples, the one or more rotating rings 2326 replace the glyph 2324 in the biometric authentication interface.

If the electronic device 2300 determines that the biometric authentication is successful (eg, the biometric data matches a biometric template associated with the user), then the electronic device has a function (eg, sending an image) disabled. transitions to the state in which the function is enabled. As an example, successful biometric authentication enables the electronic device to transmit (eg, share) images, such as images corresponding to selectable preview images 2314A-2314C. In some examples, the electronic device further indicates that the biometric authentication was successful, eg, by displaying a simulation of the representation of the biometric feature in the biometric authentication interface. 23G , in some examples, the biometric authentication interface 2322 includes a glyph 2328 indicating (to the user) that the biometric authentication was successful. In some examples, the glyph 2328 replaces one or more rotating rings 2326 within the biometric authentication interface 2322 .

Referring to FIG. 23H , after image transfer is enabled on electronic device 2300 in response to successful biometric authentication and while displaying application selection interface 2320 , the electronic device (to launch a corresponding application) ) detects user activation 2305 of the application affordance. For example, the activated affordance is the application affordance 2320A. Activation of the application affordance 2320A triggers an application 2330 (eg, a messaging application) corresponding to the application affordance 2320A and/or causes the electronic device to (eg, an application ) to transmit images corresponding to the selectable preview images 2314A to 2314C using the application 2330 .

If the electronic device 2300 determines that the biometric authentication was unsuccessful (eg, the biometric data does not match a biometric template associated with the user), then the electronic device switches between states (eg, prevents transmission of images). The same state is maintained without transitioning from a state in which a function such as applying is disabled to a state in which the function is enabled). In some examples, the electronic device further indicates (to the user) that the biometric authentication was unsuccessful, eg, by displaying a simulation of the representation of the biometric feature in the biometric authentication interface. 23J , in some examples, the biometric authentication interface 2322 includes a glyph 2332 indicating that the biometric authentication was unsuccessful. Glyph 2332 indicates, for example, that the biometric feature was not recognized by the electronic device.

In FIG. 23K , after image transfer is not enabled on electronic device 2300 in response to unsuccessful biometric authentication and while displaying application selection interface 2320 , the electronic device is the user of application affordance 2320A. Detect activation 2307 . In some examples, as shown in FIG. 23L , in response to detecting activation of an application affordance 2320A of the application selection user interface 2320 , the electronic device 2300 activates an alternative authentication affordance 2334 (eg, password affordance, passcode affordance). In some examples, while displaying the alternative authentication affordance 2334 , the electronic device detects a user activation 2309 of the alternative authentication affordance 2334 . Activation of the alternative authentication affordance results in the display of an alternative authentication interface 2336 (eg, a password interface, a passcode interface), as shown in FIG. 23M .

In some examples, the electronic device 2300 performs biometric authentication during display of the alternative authentication interface 2336 . In some examples, the electronic device obtains and processes the biometric data to determine whether the obtained biometric data matches a biometric template associated with the user. As such, in some examples, the alternative authentication interface 2336 enables simulation of a representation of a biometric feature, such as a glyph 2338 (eg, corresponding to a glyph 2324 ), as shown in FIG. 23M . include In some examples, alternative authentication interface 2336 may include one or more rotating rings 2340 (eg, as shown in FIG. 23N , and described with reference to FIGS. 17A-17AI , for example). (corresponding to one or more rotating rings 2326 ), indicating that biometric data is being processed by the electronic device. In some examples, the one or more rotating rings 2340 replace the glyph 2338 in the alternative authentication interface.

If the electronic device 2300 determines that the biometric authentication was unsuccessful (eg, the biometric data does not match a biometric template associated with the user), then the electronic device may disable the function (eg, sending an image). remains in the state of being In some examples, the electronic device further indicates that the biometric authentication was unsuccessful, eg, by displaying a simulation of the representation of the biometric feature in the alternative authentication interface 2336 . As shown in FIG. 23O , in some examples, the alternative authentication interface 2336 includes a glyph 2342 (eg, corresponding to the glyph 2328 ) indicating (to the user) that the biometric authentication was unsuccessful. do. In some examples, the glyph 2342 replaces one or more rotating rings 2340 in the alternative authentication interface.

In some examples, in addition to or instead of biometric authentication, electronic device 2300 performs passcode authentication during display of alternative authentication interface 2336 . Accordingly, the electronic device receives and processes the passcode data to determine whether the received passcode data matches a registered passcode associated with the user. As such, in some examples, alternative authentication interface 2336 includes an indication of a received passcode input, such as passcode indication 2344 , as shown in FIG. 23P .

As previously discussed, when the electronic device 2300 determines that the biometric authentication and/or passcode authentication is successful, the electronic device enables the function (eg, sending an image) from a disabled state. Transitions to the enabled state. For example, as shown in FIG. 23Q , successful biometric authentication and/or passcode authentication may result in the electronic device, via an application 2330 (eg, a messaging application), selectable preview images 2314A-2314C. to transmit (eg, share) images, such as images corresponding to

As mentioned above, the illustrative example of the user interfaces illustrated in FIGS. 23A-23Q described above relates to the illustrative example of the user interfaces illustrated in FIGS. 24A-24BC described below. Accordingly, the processes described above in connection with the example user interfaces illustrated in FIGS. 23A-23Q and the processes described below in connection with the example user interfaces illustrated in FIGS. 24A-24BC may include an electronic device (eg, , 100, 300, 500, 2300, or 2400) will be understood to be very similar processes that similarly involve initiating and administering biometric authentication.

24A-24BC illustrate example user interfaces for managing biometric authentication, in accordance with some examples. The user interfaces of these figures are used to illustrate the processes described below, including the processes of FIGS. 25A-25C.

24A illustrates an electronic device 2400 (eg, portable multifunction device 100 , device 300 , or device 500 ). In the illustrative example illustrated in FIGS. 24A-24BC , the electronic device 2400 is a smartphone. In other examples, the electronic device 2400 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 2400 has a display 2402 , one or more input devices (eg, a touchscreen of the display 2402 , a button 2404 , a microphone (not displayed)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 2403 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 24A , electronic device 2400 displays instructional user interface 2410 on display 2402 . In some examples, instructional user interface 2410 slides from the edge of the display into the display (eg, slides up from the bottom edge of the display), replacing the previous interface, application, and/or display of the virtual keyboard. In some examples, tutorial user interface 2410 slides up in response to a request to proceed with a payment transaction (eg, with a different device, such as a transaction terminal).

In some examples, as shown in FIG. 24A , instructional user interface 2410 displays text indicating to the user that an input (eg, a double press of button 2404 ) may be performed to proceed with a payment transaction. (2410A). In some examples, as also shown in FIG. 24A , instructional user interface 2410 informs (to the user) that an input (eg, a double press of button 2404 ) can be performed to proceed with a payment transaction. and a graphical representation 2410B, corresponding to the textual representation 2410A.

In some examples, in response to detecting user activation of an affordance (eg, “continue” affordance) on instructional user interface 2410 , electronic device 2400 displays display 2402 , as shown in FIG. 24B . above, the currently selected payment account for use in the payment transaction, overlaid by a prompt 2416 instructing the user to provide one or more activations of the button 2404 (eg, a double press of the button 2404 ). Display a payment user interface 2412 including a representation of 2414 . In some examples, prompt 2416 is highlighted relative to one or more other displayed objects (on payment user interface 2412 ). Emphasizing the prompt in this manner includes, for example, obscuring, blurring, and/or otherwise obscuring one or more portions of payment user interface 2412 .

In some examples, the position of button 2404 requested by prompt 2416 to be activated (eg, to proceed with a payment transaction) is highlighted by dynamic indication 2418 . For example, as illustrated by the transition from FIG. 24B to FIG. 24C , the dynamic indication 2418 can be displayed by continuously changing its size (eg, becoming wider and more By continuously alternating between narrowing, or otherwise continuously resizing), it highlights the location of button 2404 on the device, thereby making it easier for the user to find the button corresponding to the request of prompt 2416 . make it possible

In FIG. 24D , while displaying prompt 2416 , electronic device 2400 detects activation 2401 of button 2404 . In some examples, as shown in FIG. 24D , activation is a double press of button 2404 . In some examples, the double press of the button 2404 includes a first press of the button and a second press of the button that occur within a predetermined amount of time (eg, 1 second).

In response to one or more activations of button 2404 , electronic device 2400 , as shown in FIG. 24E , prompts prompt 2416 overlaid on payment user interface 2412 (and any corresponding of the prompts). highlight) and display of dynamic indication 2418, and initiate biometric authentication (eg, facial recognition) for the user's biometric feature (eg, face), as shown in FIG. 24F . In some examples, the biometric feature is at least a portion of a face (eg, a user's face), and the biometric authentication involves facial recognition of at least a portion of (user's) face.

As illustrated in FIG. 24F , in some examples, upon initiation of biometric authentication, a biometric authentication interface 2420 is provided. In some examples, the biometric authentication interface is overlaid over payment user interface 2412 during biometric authentication. In some examples, biometric authentication includes simulation of a representation of a biometric feature, such as glyph 2422 . Additionally, in response to one or more activations of button 2404 , one or more biometric sensors of electronic device 2400 , such as one or more cameras or a facial recognition sensor (eg, one or more biometric sensors 2403 ) included) is activated. In some examples, the electronic device displays the biometric authentication interface 2420 in a central area of the display and displays (eg, by displacing or moving upwards) a representation of the payment account 2414 in the upper portion of the display.

In some examples, once the one or more biometric sensors are activated, the electronic device 2400 obtains (eg, captures) biometric data corresponding to a biometric feature associated with the user. In some examples, the biometric feature captures biometric data using one or more biometric sensors 2403 (and/or biometric sensors of one or more cameras) of the electronic device. Optionally, a light emitting device such as an IR floodlight or structured light projector is used to help illuminate the biometric feature. In other examples, the electronic device receives biometric data from another device.

In some examples, once the electronic device 2400 has obtained the biometric data, the electronic device processes (eg, analyzes) the biometric data to determine whether the biometric authentication is successful. In some examples, such determining includes determining whether the biometric data matches a biometric template associated with the user. The biometric template is optionally stored on the electronic device 2400 .

In some examples, as illustrated in FIG. 24G , the biometric authentication interface 2420 may be configured to display one or more rotating rings 2424 using, for example, the biometric authentication interface so that the biometric data is transferred to the electronic device. indicates that it is being processed by In some examples, the one or more rotating rings 2424 replace the glyph 2422 in the biometric authentication interface.

If the electronic device 2400 determines that the biometric authentication is successful (eg, the biometric data matches a biometric template associated with the user), the electronic device functions (eg, authorization to transmit payment credentials) ) transitions from a first state in which the function is disabled to a second state in which the function is enabled. In some examples, the first state is a state in which the secure element of the device is disabled from emitting secure data (eg, payment credentials of a payment account provisioned on the device), and the second state is a state in which the secure element is disabled It is enabled to emit secure data.

In some examples, successful biometric authentication authorizes the electronic device to transmit account credentials in connection with a payment transaction. In some examples, the electronic device further indicates (to the user) that the biometric authentication was successful, eg, by displaying a simulation of the representation of the biometric feature in the biometric authentication interface. 24H , in some examples, the biometric authentication interface 2420 includes a glyph 2426 indicating (to the user) that the biometric authentication was successful. In some examples, the glyph 2426 replaces one or more rotating rings 2424 within the biometric authentication interface.

In FIG. 24I , subsequent to the electronic device 2400 determining that the biometric authentication was successful, the electronic device provides authorization to proceed with the payment transaction using the currently selected payment account (eg, payment account 2414 ). indicates (to the user) that a payment transaction can be initiated accordingly. In some examples, electronic device 2400 displays textual representation 2428A and/or graphical representation 2428B to indicate that a payment transaction may be initiated. In some examples, textual representation 2428A and/or graphical representation 2428B replaces biometric authentication interface 2420 on payment user interface 2412 , as shown in FIG. 24I . In some examples, graphical representation 2428B replaces glyph 2426 in payment user interface 2412 .

In FIG. 24J , while displaying payment user interface 2412 with payment account 2414 selected and authorized for use in a payment transaction, electronic device 2400 is (eg, via the device's wireless transmitting radio) A second device 2430 (eg, a transaction terminal) different from the electronic device is detected. In response to detecting the second device (eg, a transaction terminal), the electronic device 2400 transmits payment credentials associated with the payment account 2414 to the second device (eg, via a wireless transmitting radio of the device) to the second device. to complete the payment transaction.

In some examples, after successfully transmitting the payment credentials to the second device 2430 , the electronic device 2400 , as shown in FIG. 24K , to indicate (to the user) that the payment transaction has been successfully completed. Updates textual representation 2428A (eg, with “Payment Completed”) and/or graphical representation 2428B (eg, with a check mark) in payment user interface 2412 .

In some examples, prior to using payment account 2414 to conduct a payment transaction with a second device (eg, a transaction terminal), a different payment account may be selected for use in the transaction. In some examples, as shown in FIG. 24L , the electronic device 2400 uses payment accounts (eg, payments) that are different from the currently selected payment account 2414 within the payment user interface 2412 (eg, in a lower area of the interface). one or more representations of accounts 2432A-2432C). In some examples, as shown in FIG. 24L , the electronic device 2400 enables a user selection (eg, payment account 2432A) of one of the one or more payment accounts that is different from the payment account 2414 (eg, payment account 2432A). 2406) (eg, a tap gesture).

In some examples, when the second device is a transaction terminal in a store, in order to authorize an in-store payment using biometric authentication (eg, facial recognition authentication), the user first ) (by double-clicking the sleep/wake button) to confirm your intent to pay. In some examples, the user then authenticates using biometric authentication (eg, facial recognition authentication) before placing the device in the vicinity of the second device (eg, transaction terminal). In some examples, if the user wants to select a different payment method after biometric authentication (eg, facial recognition authentication), the device prompts the user to re-authenticate with biometric authentication, but if the user clicks a hardware button (eg, button 2404) to activate (eg, double-click the sleep/wake button again).

In some examples, upon user selection 2406 of payment account 2432A, as shown in FIG. 24M , the representation of payment account 2432A slides up within payment user interface 2412 , and payment account 2414 , as shown in FIG. 24M . ) slides down within payment user interface 2412 . In some examples, as shown in FIG. 24N , the representation of payment account 2432A slides up within payment user interface 2412 to a position that was previously occupied by the representation of payment account 2414 and thereby pays indicate to the user that account 2432A is now selected for use in a payment transaction), a representation of payment account 2414, to join one or more representations of payment accounts different from the currently selected payment account; 2412) slide down within. Once the currently selected payment account has been switched from payment account 2414 to payment account 2432A, the device proceeds with a payment transaction using payment account 2432A (eg, as described with reference to FIG. 24J ) to transact the transaction. can be completed

In some examples, the technique described with reference to FIGS. 24B-24N is such that, as shown in FIG. 24O , the electronic device 2400 is on the display 2402 , with an application 2434 different from the pointing user interface 2410 . While displaying (eg, a messaging application) may be initiated (eg, as initiated by activation 2401 according to prompt 2416 ). For example, FIG. 24O illustrates an electronic device 2400 displaying an application 2434 (eg, a messaging application) on a display 2402 . While displaying application 2434 , electronic device 2400 receives a user activation (eg, double-tap 2405 ) of button 2404 . In response to receiving the user activation, the electronic device proceeds with the technique described with reference to FIGS. 24B-24N , thereby biometric authentication to proceed with a payment transaction (eg, with a second device different from the electronic device). to acquire

In some examples, the technique described with reference to FIGS. 24B-24N can be performed (eg, at prompt 2416 ) while display 2402 of electronic device 2400 is in an off state, as shown in FIG. 24P . may be initiated by activation 2401 in response or by activation 2405 while application 2434 is displayed). While display 2402 is in an off state, electronic device 2400 receives a user activation (eg, double-tap 2407 ) of button 2404 . In response to receiving the user activation, the electronic device proceeds with the technique described with reference to FIGS. 24B-24N , thereby biometric authentication to proceed with a payment transaction (eg, with a second device different from the electronic device). to acquire

24Q illustrates an electronic device 2400 having a display 2402 in an off state. While the display 2402 is in the off state, the electronic device detects the second device 2430 (eg, a transaction terminal) (eg, via the device's wireless communication radio). In some examples, in response to detecting the second device 2430 while the display 2402 is in an off state, the electronic device 2400 is displayed on the display 2402 to proceed with the payment transaction (eg, FIG. prompt 2416 and payment user interface 2412 (as illustrated at 24b).

If the electronic device 2400 determines that the biometric authentication was unsuccessful (eg, the biometric data does not match the biometric template associated with the user), the device does not transition from the first state to the second state. , in some examples, the electronic device remains in the first state (eg, authorization to proceed with the payment transaction remains disabled). In some examples, the electronic device further indicates that the biometric authentication was unsuccessful, eg, by displaying a simulation of the representation of the biometric feature in the biometric authentication interface 2420 . 24R , in some examples, biometric authentication interface 2420 includes a glyph 2436 indicating that biometric authentication was unsuccessful. Glyph 2436 indicates, for example, that the biometric feature was not recognized by the electronic device. In some examples, in addition to the glyph 2436 in the biometric authentication interface 2420 , the electronic device 2400 further indicates (to the user) that the biometric authentication was unsuccessful, a tactile output 2438 (eg, a haptic). feedback) is generated.

In some examples, the glyph 2436 further moves (eg, horizontally or vertically) within the area of the biometric authentication interface 2420 to further indicate (to the user) that the biometric authentication was unsuccessful. do. For example, as shown in the transition from FIG. 24R to FIGS. 24S-24T , the glyph 2436 slides back and forth in the horizontal direction for a predetermined period of time (eg, 3 seconds) (eg, repeats a continuous horizontal sliding movement). box). In some examples, the device continues to generate tactile output 2438 (eg, haptic feedback) for the duration of movement of glyph 2436 within biometric authentication interface 2420 . In some examples, tactile output 2438 is synchronized with movement of glyph 2436 .

In some examples, as shown in FIG. 24U , while displaying a glyph 2436 within biometric authentication interface 2420 indicating to the user that biometric authentication was unsuccessful, electronic device 2400 (eg, biometric authentication) An alternative authentication affordance 2440 for providing alternative (eg, passcode, password) authentication in addition to or in lieu of measurement authentication is provided within payment user interface 2412 (eg, under biometric authentication interface 2420 ). e) to display, and proceed with the payment transaction. In some examples, while displaying an alternative authentication affordance 2440 for providing alternative authentication, as shown in FIG. 24V , the electronic device detects a user selection 2411 of affordance (eg, a tap gesture) .

24W , in response to detecting a user selection of affordance 2440 , electronic device 2400 displays an alternative authentication interface 2442 on display 2402 . In some examples, electronic device 2400 performs biometric authentication during display of alternative authentication interface 2442 . In some examples, the electronic device obtains and processes the biometric data to determine whether the obtained biometric data matches a biometric template associated with the user. As such, in some examples, alternative authentication interface 2442 allows simulation of a representation of a biometric feature, such as glyph 2444 (eg, corresponding to glyph 2422 ), as shown in FIG. 24W . include In some examples, alternative authentication interface 2442 may be configured by displaying one or more rotating rings 2446 (eg, corresponding to one or more rotating rings 2424 ), for example, as shown in FIG. 24X . , indicates that the biometric data is being processed by the electronic device. In some examples, one or more rotating rings 2446 replace glyph 2444 in the alternative authentication interface.

If the electronic device 2400 determines that the biometric authentication is successful (eg, the biometric data matches a biometric template associated with the user), the device functions (eg, authorizes to transmit payment credentials) It transitions from this first state in which it is disabled to a second state in which the function is enabled. In some examples, successful biometric authentication enables the electronic device to transmit payment credentials (eg, associated with payment account 2414 ) to, for example, a transaction terminal. In some examples, the electronic device further indicates that the biometric authentication was successful, eg, by displaying a simulation of the representation of the biometric feature in the alternative authentication interface 2442 . 23Y , in some examples, alternative authentication interface 2442 includes a glyph 2448 (eg, corresponding to glyph 2426 ) indicating (to the user) that the biometric authentication was successful. . In some examples, the glyph 2448 replaces one or more rotating rings 2446 in the alternative authentication interface.

In some examples, in addition to or instead of biometric authentication, electronic device 2400 performs passcode authentication during display of alternative authentication interface 2442 . Accordingly, the electronic device receives and processes the passcode data to determine whether the received passcode data matches a registered passcode associated with the user. As such, in some examples, alternative authentication interface 2442 includes an indication of a received passcode input, such as passcode indication 2450 , as shown in FIG. 23Y .

In FIG. 24Z , subsequent to the electronic device 2400 determining that the biometric authentication (and/or alternative authentication, such as passcode authentication) was successful, the electronic device transfers to the currently selected payment account (eg, payment account 2414 ). )) to indicate (to the user) that authorization has been provided to proceed with a payment transaction and thus a payment transaction (eg, with a transaction terminal) can be initiated. In some examples, electronic device 2400 may display textual representation 2452A (eg, corresponding to textual representation 2428A) and/or graphical representation 2452B (eg, graphical representation) to indicate that a payment transaction may be initiated. 2428B)).

24AA illustrates an electronic device 2400 displaying an alternative authentication interface 2442 similar to the alternative authentication interface of FIG. 24W on a display. As in FIG. 24W , electronic device 2400 performs biometric authentication during display of alternative authentication interface 2442 . Accordingly, the electronic device obtains and processes the biometric data to determine whether the obtained biometric data matches a biometric template associated with the user. As such, the alternative authentication interface 2442 includes a glyph 2444 that indicates to the user that biometric data has been obtained (or is being obtained). In FIG. 24Ab , as in FIG. 24X , an alternative authentication interface 2442 indicates that biometric data is being processed by the electronic device, eg, by displaying one or more rotating rings 2446 .

If the electronic device 2400 determines that the biometric authentication was unsuccessful (eg, the biometric data does not match a biometric template associated with the user), the electronic device functions (eg, to transmit payment credentials). suspends (thus not allowing the device to proceed with a payment transaction) from a first state in which it is disabled to a second state in which its functionality is enabled. In some examples, the electronic device 2400 further indicates (to the user) that the biometric authentication was unsuccessful, eg, by displaying a simulation of the representation of the biometric feature in the alternative authentication interface 2442 . 23A , in some examples, alternative authentication interface 2442 includes a glyph 2454 (eg, corresponding to glyph 2436 ) indicating (to the user) that the biometric authentication was unsuccessful. do.

24Ad illustrates electronic device 2400 displaying alternative authentication interface 2442 on display 2402 after unsuccessful biometric authentication. The electronic device displays (eg, via glyph 2454 ) an indication that the biometric authentication was unsuccessful. In some examples, after unsuccessful biometric authentication, as shown in FIG. 24A , the electronic device 2400 displays an alternative authentication interface 2442 (eg, as described with reference to FIGS. 24B-24J ). ) receive one or more activations of button 2404 (eg, a double press of button 2404 ) to restart the biometric authentication process. Accordingly, upon failure of the biometric authentication and/or alternative authentication process, the user may retry the process via one or more activations of button 2404 . In some examples, if the biometric authentication process is not successfully attempted on a predetermined number of consecutive attempts, or is not successfully attempted on a predetermined number of consecutive attempts within a predetermined period of time, One or more activations (eg, a double press of button 2404 ) no longer enables restarting of the biometric authentication process (eg, as described with reference to FIGS. 24B-24J ).

In FIG. 24af , electronic device 2400 detects a second device 2430 (eg, a transaction terminal) while displaying an alternative authentication interface 2442 (eg, via the device's wireless communication radio). . In some examples, in response to detecting the second device 2430 while displaying the alternative authentication interface, the electronic device 2400 prompts to proceed with the payment transaction (eg, a prompt as illustrated in FIG. 24B ) 2416) and display the payment user interface.

24Ag is an authorization to initiate a transaction (eg, after biometric authentication and/or an alternative authentication such as passcode authentication has been successfully provided) using a currently selected payment account (eg, payment account 2414 ) and displays It illustrates an electronic device 2400 displaying a payment user interface 2412 on 2402 . In some examples, payment user interface 2412 includes menu tab 2456 (eg, next to a lower edge of the display, in a lower area of the interface), as shown in FIG. 24Ag. In some examples, the electronic device detects a sliding gesture 2415 (eg, in an upward direction) of the menu tap 2456 . For example, sliding gesture 2415 corresponds to a touch-and-slide gesture (in an upward direction) of menu tap 2456 .

In some examples, sliding gesture 2415 on menu tab 2456 expands the menu tab (eg, over payment user interface 2412 ), as shown in FIG. 24A . Once expanded, menu tab 2456 includes one or more application affordances (eg, application affordances 2456A-2456D) that are accessible from the menu tab and correspond to applications installed on the device. For example, menu tab 2456 may include a first application affordance 2456A corresponding to a messaging application, a second application affordance 2456B corresponding to a voice call application, and a third application affordance 2456C corresponding to an email application. , and a fourth application affordance 2456D corresponding to the browsing application. In some examples, only first party applications (controlled only by the device's operating system) may be included in menu tab 2456 .

24ai illustrates an electronic device 2400 detecting a sliding gesture 2415 while the gesture is sliding in a downward direction on the display (and thus collapsing the expanded menu bar). As a result of the sliding gesture 2415 of the menu bar 2456 in the downward direction, the menu bar returns to its original size and position (eg, at the bottom of the payment user interface 2412 ), as shown in FIG. 24aj . Reduces (or folds back into it). Once the menu bar is fully collapsed, the payment user interface is fully visible on the display again.

24ak illustrates an electronic device 2400 displaying a webpage 2458 of a browsing application on a display 2402 . For example, webpage 2458 is a checkout page of an item 2460 that the user wants to purchase, and includes a purchase affordance 2462 for proceeding with a purchase of the item. In some examples, as shown in FIG. 24AK , the electronic device detects a user activation 2417 of a purchase affordance 2462 .

In some examples, upon detecting user activation of purchase affordance 2462 , electronic device 2400 displays payment sheet interface 2464 on display 2402 , as shown in FIG. 24A . In some examples, payment sheet interface 2464 overlays (in part) the browsing application and includes biometric authentication interface 2420 . In some examples, as also shown in FIG. 24A , in addition to the payment sheet interface, the device further performs one or more activations (eg, double-pressing button 2404 ) to proceed with providing authorization for a purchase. displays a prompt 2466 (eg, corresponding to prompt 2416 ) indicating (to the user) to provide

In some examples, payment sheet interface 2464 may provide one or more details (eg, payment account, shipping method, billing address, shipping address, contact information) pertaining to the proposed transaction, as shown in FIG. 24A . include In some examples, the one or more details include the selected payment account. In some examples, the user may change the selected payment account to a different payment account by selecting the details area 2464A (a region therein or an icon therein) corresponding to the selected payment account. In some examples, the one or more details include a selected shipping method. In some examples, the user may change the selected shipping method to a different shipping method by selecting the details area 2464B (the area therein or an icon therein) corresponding to the selected shipping method. In some examples, the one or more details include a selected address (eg, billing address, shipping address). In some examples, the user may change the selected address to a different address by selecting the details area 2464C (a region therein or an icon therein) corresponding to the selected address. In some examples, the one or more details include selected contact information (eg, email, phone number). In some examples, the user may change the selected contact information to a different contact information by selecting the details area 2464D (a region therein or an icon therein) corresponding to the selected contact information.

24A , after displaying the payment sheet interface 2464 and prompt 2466 over the webpage 2458 of the browsing application, the electronic device 2400 sends an input corresponding to the request of the prompt 2466 (e.g., a button ( 2404) is detected. In some examples, upon receiving an input corresponding to the request of prompt 2466 (eg, a double press of button 2404 ), a glyph within biometric authentication interface 2420 displayed within payment sheet interface 2464 . 2468 (eg, corresponding to glyph 2422) is provided. Additionally, in response to the input, one or more biometric sensors, such as one or more cameras, or a facial recognition sensor (eg, included among the one or more biometric sensors 2403 ) of the electronic device 2400 are activated.

In some examples, once the one or more biometric sensors are activated, the electronic device 2400 obtains (eg, captures) biometric data corresponding to a biometric feature associated with the user. In some examples, the biometric feature captures biometric data using one or more biometric sensors 2403 (and/or one or more cameras) of the electronic device. Optionally, a light emitting device such as an IR floodlight or structured light projector is used to help illuminate the biometric feature. In other examples, the electronic device receives biometric data from another device.

In some examples, once the electronic device 2400 has obtained the biometric data, the electronic device processes (eg, analyzes) the biometric data to determine whether the biometric authentication is successful. In some examples, such determining includes determining whether the biometric data matches a biometric template associated with the user. The biometric template is optionally stored on the electronic device 2400 .

In some examples, as illustrated in FIG. 24Ao , the biometric authentication interface 2420 within the payment sheet interface 2464 may include, for example, one or more rotating rings 2470 (eg, using a biometric authentication interface). (corresponding to one or more rotating rings 2424 ), indicating that biometric data is being processed by the electronic device. In some examples, the one or more rotating rings 2470 replace the glyph 2468 in the biometric authentication interface.

If the electronic device 2400 determines that the biometric authentication is successful (eg, the biometric data matches a biometric template associated with the user), the electronic device functions (eg, payment credentials for use in a payment transaction). ) transitions from a first state in which it is disabled to a second state in which the function is enabled. As such, if biometric authentication is successful, the device (eg, to make a purchase of item 2460 ) generates payment credentials (eg, associated with payment account 2472 ) for use in a payment transaction (eg, to make a purchase of item 2460 ). It is in a state in which it is authorized to be transmitted (to a transaction terminal, to an external server). In some examples, the electronic device further displays a glyph 2474 (eg, corresponding to glyph 2426 ) indicating (to the user) that the biometric authentication was successful, eg, as shown in FIG. 24AP , for example, as shown in FIG. 24AP . This indicates that the biometric authentication was successful. In some examples, the glyph 2474 replaces one or more rotating rings 2470 within the biometric authentication interface.

In some examples, in response to determining that the biometric authentication was successful, the electronic device 2400 processes the payment transaction (eg, transmits payment credentials to an external device, such as an external server, indicating that the credentials were successfully received). receive a response indicating that from the external device). In some examples, as shown in FIG. 24Aq , the electronic device 2400 also provides a processing indication (eg, having a similar or identical pattern to the one or more rings 2470 ) indicating (to the user) that a payment transaction is being processed. 2476 is displayed in the payment sheet interface 2464 . In some examples, once processing of the transaction is complete, electronic device 2400 displays processing indication 2476 complete indication 2467 (eg, it is a check mark to indicate completion), as shown in FIG. 24A . ), thereby indicating (to the user) that the payment transaction was successfully completed (and item 2460 was successfully purchased).

In some examples, to make a payment within an application or on the web (eg, webpage 2458 ), the electronic device allows the user to activate (eg, press a sleep/wake button) a hardware button (eg, button 2404 ). Confirm intent to pay (by double-clicking), and then authenticate using biometric authentication (eg, facial recognition authentication) to authorize payment. In some examples, if the payment transaction is not completed within a predetermined time threshold (eg, 30 seconds) that activates a hardware button (eg, 2404 , (eg, double-clicks a sleep/wake button)), the device prompts the user to return to the hardware Activating a button (eg, button 2404) (eg, double-clicking the sleep/wake button) requires reconfirming the intent to pay.

24A illustrates an electronic device 2480 (eg, a laptop computer) displaying a webpage 2484 (eg, similar to webpage 2458) of a browsing application on a display 2482 . For example, webpage 2484 is a checkout page of items 2486 that the user wishes to purchase. In some examples, the webpage 2484 of the browsing application provides a purchase affordance to provide authorization to proceed with a purchase of an item using a different device than the electronic device 2480 (eg, using the electronic device 2400 ). (2488).

In some examples, user activation of purchase affordance 2480 on electronic device 2480 causes electronic device 2400 to display remote payment user interface 2490 , as shown in FIG. 24A . In some examples, remote payment user interface 2490 provides a (graphical) representation 2492 of a device (eg, electronic device 2480 ) that is requesting remote authentication to proceed with a payment transaction, for use in a payment transaction. an indication 2494 of the currently selected payment account, and one or more activations (eg, double-tap) of the button 2404 for the user to proceed with providing authentication (eg, biometric authentication) for the payment transaction. prompt 2496 (eg, corresponding to prompt 2416) requesting that In some examples, as also shown in FIG. 24A , prompt 2496 is highlighted relative to one or more other displayed objects (eg, relative to indication 2492 of electronic device 2480 ). Emphasizing the prompt in this manner includes, for example, obscuring, blurring, and/or otherwise obscuring one or more portions of the remote payment user interface 2490 .

In some examples, the indication 2494 of a payment account currently selected for use in a payment transaction includes an affordance 2494A. In some examples, as shown in FIG. 24au , electronic device 2400 detects user activation 2421 (eg, a tap gesture) of affordance 2494A. In some examples, in response to detecting a user selection of affordance 2494A, electronic device 2400 is provisioned on (and thereto) within remote payment user interface 2490 , as shown in FIG. 24A . displays representations of one or more payment accounts (eg, payment account 2494 , payment account 2498 ) available for use in a payment transaction accordingly. In some examples, as also shown in FIG. 24AV , the representation of the currently selected payment account also includes an indication 2494B (eg, a check mark) indicating (to the user) that it corresponds to the currently selected account.

In FIG. 24Aw , while displaying representations of payment accounts (eg, payment account 2494 , payment account 2498 ) provisioned on the electronic device within remote payment user interface 2490 , electronic device 2400 is currently Detects user selection 2423 of a payment account (eg, payment account 2498 ) that is different from the selected payment account (eg, payment account 2494 ). In response to detecting user selection 2423 of payment account 2498 , electronic device 2400 removes representations of available payment accounts from remote payment user interface 2490 , as shown in FIG. 24ax . , displays payment account 2498 (instead of payment account 2494 ) as the currently selected payment account for use in the payment transaction.

24Ax , after replacing payment account 2494 with payment account 2498 , electronic device 2400 activates one or more activations of button 2404 corresponding to the request of prompt 2496 ( 2425) (eg, double-click). 24Ay , in response to detecting one or more activations 2425 of button 2404 , electronic device 2400 displays biometric authentication interface 2420 within remote payment user interface 2490 . In some examples, the electronic device further displays the glyph 2499 (eg, corresponding to the glyph 2422 ) within the biometric authentication interface 2420 displayed within the remote payment user interface 2490 . Additionally, in response to the input, one or more biometric sensors, such as one or more cameras, or a facial recognition sensor (eg, included among the one or more biometric sensors 2403 ) of the electronic device 2400 are activated.

In some examples, once the one or more biometric sensors are activated, the electronic device 2400 obtains (eg, captures) biometric data corresponding to a biometric feature associated with the user. In some examples, the biometric feature captures biometric data using one or more biometric sensors 2403 (and/or one or more cameras) of the electronic device. Optionally, a light emitting device such as an IR floodlight or structured light projector is used to help illuminate the biometric feature. In other examples, the electronic device receives biometric data from another device.

In some examples, once the electronic device 2400 has obtained the biometric data, the electronic device processes (eg, analyzes) the biometric data to determine whether the biometric authentication is successful. In some examples, such determining includes determining whether the biometric data matches a biometric template associated with the user. The biometric template is optionally stored on the electronic device 2400 .

In some examples, as illustrated in FIG. 24A-Z , biometric authentication interface 2420 within remote payment user interface 2490 may include, for example, one or more rotating rings 2497 (eg, using a biometric authentication interface). , corresponding to one or more rotating rings 2424 ), indicating that the biometric data is being processed by the electronic device. In some examples, one or more rotating rings 2497 replace glyph 2499 in the biometric authentication interface.

If the electronic device 2400 determines that the biometric authentication is successful (eg, the biometric data matches a biometric template associated with the user), the electronic device functions (eg, payment credentials for use in a payment transaction). ) transitions from a first state in which it is disabled to a second state in which the function is enabled. As such, if biometric authentication is successful, the device (eg, to make a purchase of item 2486 ) generates payment credentials (eg, associated with payment account 2498 ) for use in a payment transaction (eg, to make a purchase of item 2486 ). It is in a state in which it is authorized to be transmitted (to a transaction terminal, to an external server). In some examples, the electronic device further displays a glyph 2495 (eg, corresponding to glyph 2426 ) indicating (to the user) that the biometric authentication was successful, eg, as shown in FIG. 24B , for example, as shown in FIG. 24B . This indicates that the biometric authentication was successful. In some examples, the glyph 2495 replaces one or more rotating rings 2497 within the biometric authentication interface 2420 of the remote payment user interface 2490 .

In some examples, in response to determining that the biometric authentication was successful, the electronic device 2400 processes the payment transaction (eg, transmits payment credentials to an external device, such as an external server, indicating that the credentials were successfully received). receive a response indicating that from the external device). In some examples, as shown in FIG. 24BB , the electronic device 2400 also provides a processing indication (eg, having a similar or identical pattern to the one or more rings 2497 ) indicating (to the user) that a payment transaction is being processed. 2493 is displayed within the remote payment user interface 2490 . In some examples, once processing of the transaction is complete, electronic device 2400 displays processing indication 2493 completed indication 2491 (eg, it is a check mark to indicate completion), as shown in FIG. 24BC . ), thereby indicating (to the user) that the payment transaction was successfully completed (and item 2486 was successfully purchased).

25A-25C are flow diagrams illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. Method 2500 includes a device having a display, one or more input devices (eg, touchscreen, microphone, camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection, such as a 4G LTE connection). For example, 100, 300, 500, 1900). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric feature by the one or more biometric sensors. Some operations of the method 2000 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 2500 provides an intuitive method for managing biometric authentication. This method reduces the cognitive burden on the user for managing biometric authentication, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to manage biometric authentication faster and more efficiently saves power and increases the time between battery charges.

In some examples, the electronic device (eg, 2300 , 2400 ) receives, from a second device, a request to proceed with an action, wherein the request includes information associated with one or more options selected at the second device ( 2502 ) . In some examples, the electronic device receives a request to proceed with the transaction and further receives information from the second device regarding details of the transaction. In some examples, the action involves a transaction. In some examples, prior to receiving a user input corresponding to a request to participate in a transaction, the electronic device receives, from a second device, an input corresponding to the transaction, wherein the input includes one or more details of the transaction; Displays one or more transaction details associated with the transaction along with a request for authorization to proceed with the transaction.

The electronic device (eg, 2300 , 2400 ) activates one or more activations (eg, a hardware button) of a button (eg, 2304 , 2404 ) while the electronic device is in a first state in which a respective function of the device is disabled. or a double press of a button, such as a mechanical button, a double press of button 2304 or button 2404) is detected (2508). In some examples, each function is associated with a financial transaction, such as payment for a product or service. In some examples, if the feature is disabled, the device cannot participate in the transaction.

In some examples, each function of the electronic device (eg, 2300 , 2400 ) is participation in a transaction ( 2510 ). In some examples, participating in the transaction includes transmission of secure data from the electronic device. In some examples, the secure data is financial data. In some examples, the transaction additionally or alternatively includes the transmission of insecure data. In some examples, the information enabling a device to participate in a transaction is stored in a secure element (eg, a physically and/or logically separate memory that stores the credentials in such a way that they are prevented from being maliciously accessed). stored securely. In some examples, the electronic device is not enabled to participate in a transaction (eg, a financial transaction, such as payment for a product or service) when in the first state. In some examples, when the device is in the first state, information that enables the device to participate in a transaction is not accessible at the device outside of the secure element (eg, payment credentials are not available for use in a wireless payment transaction). not available for use).

In some examples, each function of the electronic device (eg, 2300 , 2400 ) is a function for providing information associated with an action via the short-range communication radio of the electronic device ( 2512 ). In some examples, the electronic device is configured such that the display (eg, 2302 , 2402 ), biometric sensor(s) (eg, 2303 , 2403 ), and/or one or more other components of the device are in an inactive state while inactive. is in a state In some examples, since each function of the device is to provide information (eg, payment information) associated with an action (eg, transaction) via the device's near-field communication radio (eg, NFC transmitter), the electronic device It is not configured to participate in transactions when in the first state. For example, the device may operate until authorization is provided by the user to provide payment information, such as a double click of a hardware button (eg, 2304, 2404) received with biometric or passcode/password authentication, for example. It does not respond to requests for payment information with payment information.

In some examples, one or more activations of a button (eg, 2304 , 2404 ) may cause a display of the electronic device (eg, 2300 , 2400 ) to be off or a user interface not related to payment (eg, a lock screen user interface, a plurality of A cover sheet user interface that includes recent notifications, a home screen user interface that includes application icons for a plurality of different applications and optionally one or more widgets, or a payment such as an email application, phone application, messaging application, or camera application. Occurs (2514) at least in part while displaying (an application user interface for an application that is not an application).

In some examples, while the display of the electronic device (eg, 2300 , 2400 ) is off or displays a user interface that is not related to payment, the electronic device (eg, in a situation where the user does not intend to provide payment information) not configured to transmit payment information to the payment terminal (eg, 2430 ) in response to a request for payment information (to prevent payment information from being inadvertently provided). In some examples, in at least some situations when the display of the device is turned off or displaying a user interface not related to payment, the electronic device listens for requests for payment information, informs the user that payment information has been requested, and provides payment to the user. It responds to at least some requests for payment information by displaying a payment user interface (eg, a virtual wallet) that prompts to provide authorization to provide the information.

In some examples, the one or more activations of the (hardware) button includes a double press of the button (eg, a first press and a second press of the button within a predetermined period of time) ( 2516 ). In some examples, a hardware button (eg, 2304 , 2404 ) is located on a side of an electronic device (eg, 2300 , 2400 ). In some examples, the hardware button is a mechanical button. In some examples, activation of the button without a second activation of the button within a predetermined period of time performs a different function (eg, turning the display of the device on or off). In some examples, different activation of a button (eg, long press of the button for different durations) causes a different function (eg, powering off the device or entering a user interface to invoke a virtual assistant) to occur.

In some examples, one or more activations of a (hardware) button (eg, 2304 , 2404 ) are detected ( 2518 ) while a first application is active on the electronic device. In some examples, detecting one or more activations of the button occurs 2520 while displaying a tutorial interface (eg, 2410 ). In some examples, the electronic device (eg, 2300 , 2400 ) does not display a tutorial interface, but rather displays a biometric authentication interface (eg, 2322 , 2420 ) and performs biometric authentication. Performing biometric authentication (as opposed to other forms of authentication, such as password authentication, for example) makes it faster and easier (e.g., without any input and within a shorter period). Reducing the number of inputs needed to perform an operation improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) -Make the device interface more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the button (eg, 2304, 2404) has a fixed position relative to the display of the electronic device (eg, 2300, 2400) (eg, the button is not a purely software button). In some examples, the button is a hardware button, such as a mechanical button or a solid state button. In some examples, the button is a switch or any other type of toggle. In some examples, the button has a fixed position with respect to the electronic device, particularly with respect to the display of the electronic device, such that the electronic device can display prompts based on the position of the button.

In some examples, the button (eg, 2304 , 2404 ) is a mechanical button (eg, a hardware button such as a push button). In some examples, the button is not a software button, such as a button on a touchscreen of an electronic device (eg, 2300 , 2400 ). In some examples, the button is a solid state button. In some examples, the button is a solid state button that operates according to capacitive and/or resistive touch and/or responds to changes in the strength of the input without having a mechanical switch depressed to activate the button, and instead, Monitors whether the intensity of s exceeds an intensity threshold corresponding to activation of the solid-state button.

In some examples, prior to detecting ( 2508 ) one or more activations of a button (eg, 2304 , 2404 ), the electronic device (eg, 2300 , 2400 ) prompts (eg, 2318 ) requesting that one or more activations of the button be provided. , 2416 (eg, by displaying on a display) ( 2504 ). In some examples, the electronic device prompts the user by displaying “DOUBLE CLICK FOR PAY.” In some examples, the prompt is displayed on a display (eg, 2302 , 2404 ) of the electronic device. In some examples, the prompt is displayed adjacent to the button. In some examples, the prompt is an audible and/or tactile prompt. In some examples, the prompt is displayed when the device is displaying the transaction user interface but not receiving any indication that the transaction terminal is nearby and is requesting transaction credentials (eg, requesting payment information). A prompt is displayed to provide one or more activations of the button before the device is placed in the NFC field of the NFC reader). In some examples, prior to outputting the prompt, the electronic device displays a tutorial interface that includes an affordance.

In some examples, outputting a prompt (eg, 2318 , 2416 ) occurs in response to selection of an affordance. In some examples, an instructional interface (eg, 2410 ) is displayed the first time the user attempts to implement each function without providing one or more activations of the button. In some examples, the tutorial interface is animated at a location based on the location of the button (eg, 2304, 2404) on the device (eg, the animation is adjacent to or proximate to the button on the device, the user interface in a direction in which the button can be pressed) including movement of objects).

In some examples, outputting a prompt (eg, 2318 , 2416 ) to the user to provide one or more activations of a button is a prompt relative to one or more elements displayed on a display of an electronic device (eg, 2300 , 2400 ). It involves emphasizing (2506). In some examples, emphasizing the prompt includes dimming, dimming, and/or ceasing to display at least a portion of the display of the electronic device. In some examples, emphasizing the prompt includes illuminating the prompt, flashing the prompt, or otherwise drawing attention to the prompt. In some examples, emphasizing the prompt relative to one or more elements displayed on a display of the electronic device includes blurring the one or more elements. In some examples, all elements displayed on the display (eg, 2302 , 2402 ) (except for prompts) are blurred. In some examples, only elements adjacent to the prompt are blurred. In some examples, emphasizing the prompt relative to one or more elements displayed on a display of the electronic device includes dimming the display of the one or more elements. In some examples, all elements displayed on the display (except prompts) are dimmed. In some examples, only elements adjacent to the prompt are dimmed. Dimming in this manner optionally includes reducing brightness and/or darkening the displayed colors.

In some examples, outputting the prompt (eg, 2318 , 2416 ) occurs in response to detecting an external signal of a predetermined type. In some examples, the electronic device (eg, 2300 , 2400 ) detects a signal, such as an NFC field from an NFC reader, such as a payment terminal (eg, 2430 ), and the device sends payment credentials to the NFC reader for transmission Prompts the user to provide input to initiate the biometric authentication process to authorize to make available.

In some examples, outputting the prompt (eg, 2318 , 2416 ) includes displaying an educational interface that includes a prompt element adjacent the button. In some examples, the electronic device (eg, 2300, 2400) prompts to provide one or more activations of a button (eg, 2304, 2404) via an interface where a prompt is displayed near the location of the button and/or indicates the location of the button. Prompt the user. In some examples, the educational interface does not provide one or more activations necessary to initiate biometric authentication such that the user has attempted to implement each function of the electronic device, but causes the electronic device to be enabled to implement each function. displayed if not.

In some examples, the electronic device (eg, 2300, 2400) prompts, on the display, to provide one or more activations of a button (eg, 2304, 2404) in a first location in a biometric authentication interface (eg, 2322, 2420). Display a prompt. Outputting a prompt requesting that one or more activations of the button be provided provides the user with feedback regarding the current state of the device and visual feedback indicating what steps the user must take to proceed with a particular function using the device. is provided to the user. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the electronic device (eg, 2300 , 2400 ) detects activation (eg, selection) of an affordance of a first application (eg, activation of affordance of an application requesting a transaction for a good or service). In some examples, the first application is a communication application. In some examples, the device displays details of the transaction and one or more of an affordance to initiate the transaction and a prompt to trigger biometric authentication. In some examples, details of the transaction are optionally modified prior to detection of the biometric feature or prior to activation of affordance after biometric authentication is triggered via a user input (eg, double-tap).

In some examples, in response to detecting activation of the affordance of the first application ( 2522 ), the electronic device (eg, 2300 , 2400 ) provides information associated with an action from the first application to the second application (eg, send). In some examples, the action from the first application to the second application involves a transaction. In some examples, prior to receiving a user input corresponding to a request to participate in a transaction, the electronic device detects activation of an affordance of a first application, and in response to detecting activation of an affordance of the first application, the first Provides information about the transaction from the application to the second application, and proceeds with the transaction by using the second application.

In some examples, the electronic device also displays, on a display (eg, 2302 , 2402 ) transaction information (eg, separate from the first application and not shared with the first application, such as a credit card number, billing address, etc.) concurrently display a second prompt to provide at least a portion of information associated with the action in a first location (in a payment user interface comprising more like a button than

In some examples, prior to receiving activation of a button (eg, 2304 , 2404 ), the details of the transaction are limited to a particular portion of the display such that a prompt to provide activation of the button may be displayed proximate to the button. Restricting the details of the transaction to a specific portion of the display so that the prompt can be displayed proximate the relevant button provides the user with visual feedback that allows the user to more quickly and easily follow the prompt's request. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the details are limited to a specific height of the display. In some examples, if there is more information than can be displayed in the available area below the second prompt, the information associated with the action displays additional information that was hidden (eg, from the screen) before the scrollable area was scrolled. displayed in a scrollable area that scrolls in response to user inputs for display. In some examples, providing information about the transaction from the first application to the second application includes providing information that could be displayed in the available area and additional information that was hidden.

In some examples, after displaying the prompt (eg, 2318 , 2416 ), the electronic device (eg, 2300 , 2400 ) transmits the representation of the user credential from a second location on the display (eg, 2302 , 2402 ) to a first on the display (eg, 2302 , 2402 ). move to position In some examples, the representation of the user credential covers a prompt (eg, double click) that the user credential presses a button (eg, 2304, 2404) and/or includes a biometric authentication glyph (eg, 2324, 2422). moved to reveal In some examples, moving the representation of the user credential from the second location to the first location causes displaying the biometric authentication glyph in the portion of the display that was occupied by the user credential when the user credential was displayed at the second location. includes doing

In response to detecting one or more activations of the button ( 2522 ), the electronic device (eg, 2300 , 2400 ) is configured to: one or more biometric sensors (eg, 2303 , 2403 ) separate from the button (eg, 2304 , 2404 ) ) to capture the biometric data (2524). In some examples, in response to a double press of the hardware button, the device receives biometric data, such as data about the user's face. In some examples, the one or more biometric sensors include a facial recognition sensor, and the biometric data corresponds to at least a portion of the face.

In some examples, capturing the biometric data includes capturing the biometric data using a camera. In some examples, biometric data is captured using a camera and/or a facial recognition sensor (eg, 2303 , 2403 ). In some examples, a camera is used to ensure that the user is looking at the device, and a facial recognition sensor is used to authenticate the user's face.

In some examples, capturing biometric data with one or more biometric sensors includes activating one or more biometric sensors (eg, 2303 , 2403 ) for a second predetermined period of time. For example, in response to pressing a button (eg, 2304 , 2404 ), the electronic device (eg, 2300 , 2400 ) activates one or more biometric sensors (eg, 2303 , 2403 ), such as a facial recognition sensor or camera. activate (eg, transition the biometric sensors from an inactive state to an active state), and capture biometric data using the activated one or more biometric sensors. In some examples, the activated one or more biometric sensors are activated for a period of time, and if biometric data is not captured for a period of time, the biometric authentication process fails. In some examples, the second predetermined period of time begins when one or more activations of the button are detected. In some examples, the period of time is initiated when the button is pressed. In some examples, capturing biometric data in this manner includes illuminating the biometric feature and capturing data corresponding to the illumination. In some examples, the biometric feature is illuminated using an IR floodlight or structured light projector.

In some examples, in response to detecting ( 2522 ) one or more activations of the button, the electronic device (eg, 2300 , 2400 ) also includes a biometric representation of the user credential that is restricted from being used without appropriate biometric authentication. Display ( 2526 ) a measurement authentication interface (eg, 2322 , 2420 ). In some examples, the biometric authentication interface may include an authentication glyph (eg, 2324, 2422) and/or one or more representations of user credentials (eg, an image of a credit card, an image of a bank account, an image of a business card) images representing data to be used by the function of the electronic device, such as Providing the authentication glyphs provides the user with easily visible and recognizable visual feedback regarding the current status or progress of the authentication process. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, the function performs a transaction using the represented data. In some examples, biometric authentication is performed for a particular credential, which credential is highlighted relative to other credentials. In some examples, the biometric authentication interface (eg, 2322, 2420) includes an animation (eg, a card carousel).

Upon determining that the biometric data satisfies the biometric authentication criteria (eg, the biometric criteria match a biometric template stored on the device), the electronic device (eg, 2300 , 2400 ) determines that each function of the device is Transition to a second state where it is enabled (2528). In some examples, if the device is enabled, the device can participate in the transaction. In some examples, the electronic device determines whether the biometric data meets biometric authentication criteria. Limiting a device's ability to participate in a transaction to when the device is enabled (to participate in a transaction) helps users avoid unintentionally executing transactions and at the same time provides enhanced device security, give users more control of the device. Providing additional control of the device without cluttering the UI with additional displayed controls (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) the device It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (eg, 2300 , 2400 ) is enabled to participate in a transaction when in the second state. In some examples, when the device is in the second state, information that enables the device to participate in a transaction is made temporarily accessible by the secure element at the device external to the secure element (eg, payment credentials are available for use in wireless payment transactions).

In some examples, after transitioning to the second state, the electronic device (eg, 2300 , 2400 ) maintains ( 2530 ) the device in the second state for a first predetermined period of time (eg, 60 seconds). In some examples, the functionality of the electronic device is also enabled upon change of user credentials (eg, as a result of a card switch). In some examples, the first predetermined period of time begins when one or more activations of the button are detected (eg, when the button is pressed). In some examples, after transitioning to the second state, the electronic device transitions ( 2532 ) from the second state to the first state after a first predetermined period of time has elapsed. In some examples, after transitioning to the second state, the electronic device uses a respective function of the electronic device to perform an information-based action (eg, transmit credentials to a remote server to process the transaction). (2534). In some examples, the electronic device proceeds the transaction using the credentials provided in the request. In some examples, the credentials are provided to a remote server to process the transaction. In some examples, the electronic device causes display, at the other device, of an indication indicating whether authentication was successful. In some examples, the electronic device causes display, at another device (eg, another device or a second device), of an indication indicating whether the transaction was successful. In some examples, the prompt is output while details of the transaction are displayed.

In some examples, while the device is in the second state, the electronic device (eg, 2300 , 2400 ) detects ( 2536 ) a user input corresponding to a request to exit the first application. In some examples, in response to detecting the user input corresponding to the request to exit the first application, the electronic device exits the first application and transitions to the first state ( 2538 ). In some examples, when the device is enabled to participate in a transaction, terminating an application in which input that was received caused the device to be enabled to participate in the transaction causes the device to cease being enabled to participate in the transaction. . In some examples, when a device is authorized to provide payment credentials for a payment transaction in a wallet application and the device is switched from the wallet application to a different application, the device is authorized to provide payment credentials (eg, using biometric authentication). ) disables the ability to provide payment credentials until re-authorized by the user. Accordingly, unintentional transmission of payment information is prevented by disabling transmission of payment information when the device is not displaying a user interface indicating that the device is configured to provide payment credentials.

Upon determining that the biometric data does not satisfy the biometric authentication criteria (eg, the biometric data does not match a biometric template stored on the device), the electronic device (eg, 2300 , 2400 ) maintains the first state. do ( 2540 ), and display on the display an indication that the biometric authentication has failed ( 2540 ). Maintaining a first state (eg, a state in which the device is not authorized to proceed with a transaction) when authentication fails provides the user with enhanced control and security of the device. Providing additional control and improved security of the device without cluttering the UI with additional displayed controls (eg, helping the user to provide appropriate inputs when operating and/or interacting with the device and avoiding user mistakes) by reducing the device's operability and making the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently. .

In some examples, the electronic device (eg, 2300 , 2400 ) also displays 2542 an alternative authentication affordance (eg, 2334 , 2440 ). In some examples, the alternative authentication affordance, when selected, causes the electronic device to provide an alternative form of authentication (eg, a non-biometric form of authentication), such as when the user enters a password, passcode, or pattern. It is an affordance to display a capable interface (eg, 2336, 2442). In some examples, successful authentication via alternative authentication causes the electronic device to transition to the second state. In some examples, a first failure results in display of a “TRY AGAIN” affordance, and a second failure results in display of an alternative authentication affordance (eg, 2336, 2442) such as a “passcode” affordance. do. In some examples, the electronic device receives a user input, such as a double press of a button. In some examples, upon reaching a threshold number of biometric authentication attempts, the electronic device indicates that the affordance for entering a passcode (or password) and, optionally, biometric authentication is not available and/or has reached the threshold number. Display an indication (eg, “passcode required to enable FaceID”).

In some examples, after determining that the biometric data does not satisfy the biometric authentication criteria (eg, while displaying an alternative authentication interface or alternative authentication affordance), the electronic device (eg, 2300 , 2400 ) performs the alternative authentication A selection of affordances (eg, 2334, 2440) is detected (2544). In some examples, in response to detecting the selection of an alternative authentication affordance, the electronic device (eg, 2300 , 2400 ), in response to the selection of the affordance, displays, on a display, an alternative authentication interface, such as a password or passcode interface. (eg, 2336, 2442) is displayed (2546).

In some examples, the electronic device (eg, 2300 , 2400 ) also captures ( 2548 ) second biometric data with one or more biometric sensors (eg, 2303 , 2403 ). In some examples, upon determining that the second biometric data meets the biometric authentication criteria, the electronic device transitions to the second state ( 2550 ). In some examples, in response to selecting the affordance, the electronic device performs a second iteration of biometric authentication.

In some examples, biometric authentication is performed during display of or transition to an alternative authentication interface (eg, 2336 , 2442 ). In some examples, the alternative authentication interface includes a display of a biometric authentication glyph sequence that allows the user to be notified that biometric authentication is occurring. In some instances, successful biometric authentication avoids the need for alternative authentication. As a result, the electronic device (eg, 2300 , 2400 ) stops displaying the alternative authentication interface (eg, 2336 , 2442 ) and proceeds as if the user was successfully authenticated on the first attempt.

In some examples, upon determining that the second biometric data does not satisfy the biometric authentication criteria, the electronic device (eg, 2300 , 2400 ) maintains the first state and displays the alternative on the display (eg, 2302 , 2402 ). Display (2552) an authentication interface (eg, 2336, 2442). In some examples, upon failure, display of the alternative authentication interface is maintained for the user to optionally provide alternative authentication. Maintaining display of an alternative authentication interface so that (on failure) the user can provide alternative authentication provides the user with a plurality of different ways to provide authentication (for a particular operation performed by the device) This gives the user more control of the device. Providing additional control of the device without cluttering the UI with additional displayed controls (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) the device It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (eg, 2300 , 2400 ) detects ( 2554 ) each user input corresponding to a request to retry biometric authentication. In some examples, the electronic device detects a user input, such as a button press or movement of the electronic device (eg, raising and/or lowering the device) or selection of an alternative authentication affordance (eg, 2334, 2440). In some examples, the user input corresponding to the request to retry biometric authentication includes one or more activations of the button. In some examples, the user input includes one or more activations of the button used to initiate the biometric authentication of the first iteration. In some examples, the user input corresponding to the request to retry biometric authentication includes movement of the electronic device. In some examples, the predetermined type of user input is an input different from activation of a button. In some examples, the predetermined type of user input is raising and/or lowering the electronic device (eg, the electronic device is lowered near another electronic device, such as an NFC-compatible device, and raised back to eye level of the user). ).

In some examples, in response to detecting a user input corresponding to a request to retry biometric authentication, the electronic device (eg, 2300 , 2400 ) captures third biometric data with one or more biometric sensors ( 2556). In some examples, in response to the user input, the device performs an additional iteration of biometric authentication. In some examples, upon determining that the third biometric data satisfies the biometric authentication criteria, the electronic device transitions ( 2558 ) to a second state in which a respective function of the device is enabled. In some examples, upon determining that the third biometric data does not satisfy the biometric authentication criteria, the electronic device maintains the first state (and optionally displays, on the display, an indication that the biometric authentication failed do) (2560).

In some examples, the electronic device (eg, 2300 , 2400 ) detects one or more other activations of a button (eg, 2304 , 2404 ). In some examples, upon determining that the biometric capture criteria are met, the electronic device sends the second biometric data to one or more biometric sensors (eg, 2303, 2403) separate from the button (eg, 2304, 2404). Capture. In some examples, upon determining that the biometric capture criteria are not met, the electronic device withholds capturing the second biometric data. In some examples, the number of biometric authentication attempts is limited to a predetermined number (eg, 5). In some examples, this number is reset in response to successful authentication. In some examples, this number is reset after a set time.

Note that the details of the processes described above with respect to method 1200 (eg, FIGS. 25A-25C ) are also applicable in a similar manner to the methods described herein. For example, method 2500 may optionally include one or more of the characteristics of various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 1800, 2000, 2200, 2700. include For example, the registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with FIGS. 24F and 24G . For another example, one or more implantable interfaces as described in methods 2000 , 2700 are optionally displayed in response to receiving input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 25A-25C are, optionally, implemented by the components shown in FIGS. 1A and 1B . For example, detect operation 2508 , transition operation 2528 , and hold operation 2540 are optionally implemented by event classifier 170 , event recognizer 180 , and event handler 190 . Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

26A-26A illustrate example user interfaces for biometric authentication, in accordance with some examples. As described in more detail below, the illustrative example of the user interfaces illustrated in FIGS. 26A-26A is used to illustrate the processes described below, including the processes of FIGS. 27A-27E .

26A illustrates an electronic device 2600 (eg, portable multifunction device 100 , device 300 , or device 500 ). In the illustrative example illustrated in FIGS. 26A-26A , the electronic device 1900 is a smartphone. In other examples, electronic device 1500 may be a different type of electronic device, such as a wearable device (eg, smartwatch). The electronic device 1900 has a display 2602 , one or more input devices (eg, a touchscreen of the display 2602 , a button 2604 , a microphone (not displayed)), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the electronic device includes one or more biometric sensors (eg, biometric sensor 2603 ), optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the one or more biometric sensors 2603 are one or more biometric sensors 703 . In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 26A , the electronic device, while in the unlocked state, displays an unlocked interface 2606 . The unlocked interface 2606 includes a notification affordance 2608 and an unlocked status indicator 2610 . In some examples, because the electronic device 2600 is in an unlocked state, the notification affordance 2608 includes an indication of secure content associated with the notification affordance 2608 . For example, as shown, a notification affordance is associated with a messaging application and includes at least a portion of a message received by the electronic device.

26B - 26D , while displaying unlocked interface 2606 , electronic device 2100 detects user input 2612 ( FIG. 26B ), for example near an edge of display 2602 . do. User input 2612 is, in some examples, a swipe gesture that is a request to access a home screen interface of electronic device 2600, and in response to swipe input 2612, the electronic device displays the home screen interface ( 2614) (eg, replace the display of unlocked interface 2606 with it). In some examples, displaying the home screen interface 2129 includes sliding the unlocked interface 2606 in an upward direction to display the home screen interface 2614 , as similarly described with reference to FIGS. 19P-19R . displaying (eg, revealing).

In FIG. 26E , the electronic device, while in the unlocked state, displays an unlocked interface 2606 . The unlocked interface 2606 includes a notification affordance 2608 and an unlocked status indicator 2610 . In some examples, because the electronic device 2600 is in an unlocked state, the notification affordance 2608 includes an indication of secure content associated with the notification affordance 2608 . For example, as shown, a notification affordance is associated with a messaging application and includes at least a portion of a message received by the electronic device.

While displaying the unlocked interface 2606 , the electronic device detects activation of the notification affordance 2608 . Activation of notification affordance 2608 is a tap gesture 2615 in some examples. In response to activating the notification affordance 2608 , the electronic device displays the messaging application interface 2616 of FIG. 26G (eg, replaces the display of the unlocked interface 2606 with it). 21F and 21G , in some examples, displaying the messaging application interface 2616 may cause the unlocked interface 2606 in an upward direction, as similarly described with reference to FIGS. 19P-19R , in an upward direction. sliding to display (eg, reveal) the messaging application interface 2616 .

In FIG. 26H , the electronic device, while in the locked state, displays a locked interface 2620 . The locked interface 2620 includes a notification affordance 2622 and a locked status indicator 2624 . In some examples, because electronic device 2600 is in a locked state, notification affordance 2622 does not include an indication of secure content associated with notification affordance 2622 .

26I-26K , while displaying locked interface 2620 , electronic device 2600 detects user input 2628 ( FIG. 26I ), for example near an edge of display 2602 . User input 2628 is, in some examples, a swipe gesture that is a request to access the home screen interface of electronic device 2600 . In some examples, electronic device 2600 performs user input 2628 prior to completing initial biometric authentication (eg, biometric authentication performed in response to a wake condition, as described with reference to FIGS. 21A-21C ). receive Accordingly, in response to the swipe input 2628 , the electronic device displays the embedded interface 2630 of FIG. 26K (eg, locked interface 2620 ) to indicate that the electronic device has not yet completed biometric authentication. 's display is replaced with it). In some examples, displaying insertable interface 2630 includes sliding lockable interface 2620 in an upward direction to display insertable interface 2630 (eg, as similarly described with reference to FIGS. 19P-19R ). , revealing). Insertable interface 2630 includes a locked status indicator 2624 in some examples.

Alternatively, in some examples, the electronic device determines that a threshold number (eg, 5) of biometric authentication attempts has been reached. Thereafter, in response to user input 2628 , electronic device 2600 displays embeddable interface 2632 . The embeddable interface includes a biometric authentication enable indicator to indicate that biometric authentication is disabled (eg, because the number of attempts has been reached). The embedded interface 2632 further includes alternative authentication affordances 2636 and 2638 . Activation of the alternative authentication affordance 2636 causes the electronic device to display a first alternative authentication interface, such as a fingerprint authentication interface, and activation of the alternative authentication affordance 2638 causes the electronic device to display a passcode authentication interface display a second alternative authentication interface, such as

In some examples, while displaying the implantable interface 2630 , the electronic device detects biometric data (eg, facial biometric data) and, in response, performs biometric authentication. Referring to FIG. 26M , the electronic device 2600 displays a biometric progress indicator 2625 to indicate that biometric data is being processed.

26N , the electronic device 2600 determines that the biometric authentication is successful. In response, the electronic device 2600 displays an unlocked status indicator 2626 and optionally outputs a tactile output 2640 . After indicating that the biometric authentication was successful (eg, after a predetermined time), the electronic device displays the home screen interface 2614 of FIG. 26P (eg, replaces the display of the implantable interface 2630 with it) . 21O and 21P , in some examples, displaying the home screen interface 2614 includes sliding the home screen interface 2614 , as similarly described with reference to FIGS. 19P-19R . do.

Alternatively, in FIG. 26Q , the electronic device 2600 determines that the biometric authentication was not successful. In response, the electronic device 2600 alternates the position of the locked status indicator 2627 to simulate a “shake” effect. The electronic device 2600 further outputs a tactile output 2644 to indicate that the biometric authentication was not successful. In some examples, tactile output 2644 is the same as tactile output 2640 . In some examples, tactile output 2644 is different from tactile output 2640 . In some examples, in response to determining that the biometric authentication was unsuccessful, the electronic device displays an alternative authentication affordance 2642 .

Referring to FIG. 26R , the electronic device receives activation of the locked status indicator 2624 . In some examples, activation of the locked status indicator is a tap gesture 2650 on the locked status indicator 2624 . In response, electronic device 2600 initiates biometric authentication, as shown in FIG. 26S . In some examples, initiating biometric authentication includes obtaining data corresponding to at least a portion of the biometric feature (eg, capturing with one or more biometric sensors 2603 ), and processing the biometric data. to determine whether the biometric feature (or a portion thereof) satisfies biometric authentication criteria (eg, determining whether the biometric data matches, within a threshold, the biometric template) do. While processing the biometric data, the electronic device displays the biometric progress indicator 2625 (eg, of the locked status indicator 2624 ), indicating that the electronic device 2600 is processing the biometric data. replace the display with it). If the electronic device 2600 determines that the biometric authentication is successful, the electronic device indicates success, as described in connection with FIGS. 26N-26P .

In FIG. 26T , the electronic device 2600 determines that biometric authentication (eg, as described with reference to FIG. 26S ) was unsuccessful and, in response, positions the locked status indicator to simulate a “shake” effect. Alternate, output tactile output 2652 , and display alternative authentication affordance 2642 .

In FIG. 26U , the electronic device detects activation of an alternative authentication affordance 2642 . In some examples, activation of the alternative authentication affordance is a tap gesture 2654 on the alternative authentication affordance 2642 . Referring to FIG. 26V , in response to activation of the alternative authentication affordance 2642 , the electronic device displays the alternative authentication interface 2656 (eg, replacing the display of the implantable interface 2630 with it), which By this, the user authenticates with the electronic device upon input of a valid passcode (or password).

26W-26Y , in some examples where the electronic device fails to detect the biometric feature for a predetermined amount of time, the electronic device displays one or more interfaces and/or enters a low power state. In FIG. 26W , the electronic device displays the embedded interface 2630 (recall that the electronic device displays the embedded interface 2630 in response to a request for secure content received prior to completion of the biometric authentication). If, for a predetermined amount of time, the electronic device 2600 does not detect the biometric feature, the electronic device displays an alternative authentication interface 2657 (eg, replaces the display of the implantable interface 2630 with it). In some examples, alternative authentication interface 2657 includes an indicator instructing the user to provide an alternative authentication, such as a passcode. In other examples, as shown in FIG. 26X , the alternative authentication interface 2657 does not include an indicator instructing the user to provide alternative authentication.

If, during display of the alternative authentication interface 2657 , the biometric feature is not detected for a predetermined amount of time, and no alternative authentication is provided, the electronic device 2600 enters a low power state ( eg display-disabled state).

If, during display of the alternative authentication interface 2657 , the biometric feature is detected, the electronic device 2600 performs biometric authentication, as described. 26Z , the electronic device displays a biometric progress indicator 2625 to indicate that the electronic device is processing biometric data (eg, a display of a locked status indicator 2624 that replaced with). 26AA , the electronic device 2600 determines that the biometric authentication is successful. In response, the electronic device displays the unlocked status indicator 2610 (replacing the display of the biometric progress indicator 2625 with it) and, optionally, tactilely to indicate that the biometric authentication is successful. The enemy output 2658 is output. In some examples, electronic device 2600 subsequently displays home screen interface 2614 , as shown in FIG. 26A .

26A-26A , if, during display of the alternative authentication interface 2657, biometric authentication fails, and at least a portion of the alternative authentication is provided, the electronic device 2600 does not provide a tactile output. Indicates that the biometric authentication was not successful. As shown in FIG. 26A , the electronic device, while performing biometric authentication (as indicated by biometric progress indicator 2625 ), performs an alternative via user input (eg, a tap gesture) 2660 . Receive a portion of the authentication (eg, passcode). In FIG. 26Ad , the electronic device determines that the biometric authentication was unsuccessful and, in response, displays a locked status indicator 2627 and further alternates the position of the locked status indicator to simulate a “shake” effect. . In some examples, the electronic device 2600 does not output a tactile output, and further maintains display of the alternative authentication interface 2657 , as shown in FIG. 26A .

In FIG. 26af , electronic device 2600, while in a locked state, displays locked interface 2620 . As described, the locked interface 2620 includes a notification affordance 2622 and a locked status indicator 2624 . In some examples, the electronic device receives a request for secure content (eg, a message associated with notification affordance 2622 ) on the electronic device. The electronic device 2600 detects activation of the notification affordance 2622 , for example. In some examples, activation of notification affordance 2622 is tap gesture 2662 .

In some examples, activation of notification affordance 2622 is received prior to completion of biometric authentication. Accordingly, as shown in FIG. 26Ag , in response to activation of the notification affordance 2622 , the electronic device 2600 displays an embeddable interface 2629 that includes a biometric indicator 2666 . Biometric indicator 2666 identifies secure content associated with the received request for secure content in some examples.

As shown in FIG. 26A , if, while displaying the implantable interface 2629 , the electronic device 2600 does not detect the biometric feature, the electronic device displays an alternative authentication affordance 2668 . In some examples, activation of alternative authentication affordance 2668 causes the electronic device to display an alternative authentication interface (eg, alternative authentication interface 2657 in FIG. 26X ).

If, during display of the alternative authentication interface, the biometric feature is not detected for a predetermined amount of time, and no alternative authentication is provided, the electronic device 2600 enters a low power state (eg, display -transition to disabled state).

As described in connection with FIG. 26A , the electronic device displays an alternative authentication affordance 2668 if the biometric feature is not detected. In some examples, the biometric feature is detected after display of the alternative authentication affordance 2668 and in response, the electronic device performs biometric authentication, as described above. 26aj , to indicate that biometric data is being processed, electronic device 2600 displays biometric progress indicator 2625 . In FIG. 26ak , the electronic device 2600 determines that the biometric authentication is successful. In response, the electronic device 2600 displays an unlocked status indicator 2610 and optionally provides a tactile output 2670 to indicate that the biometric authentication was successful. In some examples, electronic device 2600 subsequently displays messaging application interface 2616 , as shown in FIG. 26Am. 26A and 26A , in some examples, displaying the messaging application interface 2616 can be accomplished by sliding the embedding interface 2629 in an upward direction, as similarly described with reference to FIGS. 19P-19R , in an upward direction. and displaying (eg, revealing) the messaging application interface 2616 .

In FIG. 26A , the electronic device 2600 displays an embedded interface 2629 with an alternative authentication affordance 2668 . While displaying the embedded interface 2629 , the electronic device detects activation of the alternative authentication affordance 2668 . In some examples, activation of the alternative authentication affordance 2668 is a tap gesture 2674 on the alternative authentication affordance 2668 .

Referring to FIG. 26Ao , in response to activation of the alternative authentication affordance 2668 , the electronic device 2600 displays the alternative authentication interface 2631 . In some examples, alternative authentication interface 2631 identifies the requested secure content (“ENTER PASSCODE FOR MESSAGES”).

Referring to FIGS. 26A and 26A , at least in part, in response to a tap gesture 2076 ( FIG. 26A ) and, optionally, one or more other inputs indicating additional alphanumeric digits of a valid passcode, electronic device 2600 A valid passcode (or password) is received by 26A and 26A , once a valid passcode has been received, the electronic device is unlocked and displays the messaging application interface 2616 (eg, the display of the alternative authentication interface 2631 with it) replace). In some examples, displaying the messaging application interface 2616 may include sliding the alternative authentication interface 2631 in an upward direction to enable the messaging application interface 2616, as similarly described with reference to FIGS. 19P-19R . displaying (eg, revealing).

27A-27E are flow diagrams illustrating a method for performing biometric authentication using an electronic device, in accordance with some examples. Method 2700 includes a device having a display, one or more input devices (eg, touchscreen, microphone, camera), and a wireless communication radio (eg, a Bluetooth connection, a WiFi connection, a mobile broadband connection such as a 4G LTE connection). For example, 100, 300, 500, 2600). In some examples, the display is a touch-sensitive display. In some examples, the display is not a touch-sensitive display. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In some examples, the device includes one or more biometric sensors, optionally including a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further comprises a light emitting device, such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric feature by the one or more biometric sensors. Some operations of method 2700 are selectively combined, orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 2700 provides an intuitive method for performing biometric authentication. This method reduces the user's cognitive burden for authenticating biometric features, thereby creating a more efficient human-machine interface and intuitive user experience. For battery-operated computing devices, enabling a user to perform authentication of biometric features faster and more efficiently saves power and increases the time between battery charges.

In some examples, while the electronic device (eg, 2700 ) is in a locked state where the device is not authorized to perform the respective operation, the electronic device displays a first graphical indication (eg, 2624 ) indicating that the device is in the locked state (eg, 2624 ) (eg, a closed lock icon). Displaying the first graphical indication indicating that the device is in a locked state provides the user with an easily available indication of the state of the device. The user is then informed of which functions of the device are enabled and/or available, thereby (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device) ) makes the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, while the device is in an unlocked state in which the device is authorized to perform the respective operation, the electronic device displays a second graphical indication (eg, , 2610 (eg, an open lock icon). Displaying a second graphical indication indicating that the device is in an unlocked state provides the user with an easily available indication of the state of the device. The user is then informed of which functions of the device are enabled and/or available, thereby (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device) ) makes the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the first graphical representation and the second graphical representation are displayed at respective locations in the user interface (eg, 2606 , 2620 ) (eg, near a substantially upper center of the display 2602 ).

In some examples, the electronic device detects a request to perform a respective operation requiring authentication ( 2702 ). In some examples, the request to perform each action that requires authentication includes a request (eg, 2612 ) to display a home screen (eg, 2614 ) having a plurality of open application icons that, when selected, open corresponding applications; or a request to display an application user interface corresponding to the selected notification. In some examples, the request to perform each action includes a home input (eg, 2612 ). In some examples, the home input is a selection of a home button or a home gesture, such as an upward swipe from each edge of the display, such as a button on the display. In some examples, the request to perform each action includes a selection (eg, 2615 ) of a notification (eg, 2608 ). In some examples, the selection of the notification is a tap, long press, hard press, or swipe on the notification user interface object. In some examples, each action includes displaying a home screen that includes a plurality of application icons for opening different applications. In some examples, the plurality of application icons for opening different applications are application icons that, when selected, cause a corresponding application to open. In some examples, the home screen also includes one or more widgets, system status indicators, device controls, and the like. In some examples, each action includes displaying an application user interface (eg, 2616 ) for an application corresponding to the notification. In some examples, the application interface includes information specifically related to the notification (eg, the notification is a notification of an electronic communication, and the application user interface includes a notification or representation of the electronic communication).

In response to detecting the request to perform a respective operation requiring authentication (2704), in accordance with a determination that the device is unlocked, the electronic device performs the respective operation (2706). Further, upon determining that the device is locked and that the first form of authentication is available for use ( 2708 ), the electronic device, on a display (eg, 2602 ), displays, on a display (eg, 2602 ), one or more to use the second form of authentication Display ( 2712 ) an authentication indicator (eg, 2625 ) for the first form of authentication without displaying affordances (eg, 2636 , 2638 ). Displaying the authentication indicator without displaying affordances for using the second form of authentication provides the user with an intuitive interface withholding the device from providing additional options while biometric authentication is being performed. Providing an intuitive interface in this way improves the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) and avoids the user attempting alternative authentication prior to completion of measurement authentication) and makes the user-device interface more efficient, which additionally reduces the power usage of the device by enabling the user to use the device more quickly and efficiently. Reduce and improve battery life.

In some examples, the authentication indicator is a visual indication that a first form of authentication is being attempted by the device, such as text describing the first form of authentication (eg, password, passcode, fingerprint, or other form of authentication) or graphic elements. In some examples, the first form of authentication is a form of biometric authentication (eg, a contactless form of biometric authentication such as facial recognition or iris recognition) based on data obtained by one or more biometric sensors ( 2710 ). In some examples, the authentication indicator includes information indicating that the device is attempting to use the first form of authentication ( 2714 ). In some examples, the authentication indicator includes a graphical or textual description indicating that facial biometric authentication is available, such as “Face ID” or “Face ID to open Messages.” In some examples, the authentication indicator is displayed with an option to revoke authentication. In some examples, the authentication indicator is displayed with an option to display emergency information (eg, emergency call user interface and/or emergency medical information) without unlocking the device. In some examples, the authentication indicator includes information of the progress of the attempt in the first form of authentication ( 2716 ), such as a progress indicator as described in more detail with respect to FIGS. 11A-11O .

In some examples, while displaying the authentication indicator for the first form of authentication without displaying affordances for using the second form of authentication, the electronic device may Process the data (2718). In some examples, each from one or more biometric sensors processed while displaying a biometric authentication indicator for a first form of biometric authentication without displaying one or more affordances for using the second form of authentication At least a portion of the data was obtained ( 2720 ) by the one or more biometric sensors prior to displaying an authentication indicator for the first form of authentication. In some examples, each from one or more biometric sensors processed while displaying a biometric authentication indicator for a first form of biometric authentication without displaying one or more affordances for using the second form of authentication At least a portion of the data was obtained ( 2722 ) by the one or more biometric sensors after displaying an authentication indicator for the first form of authentication.

In some examples, after processing 2724 respective data from the one or more biometric sensors, a determination is made that each data from the one or more biometric sensors matches biometric information applied to perform a respective operation. According to (eg, the device detects the applied face in each biometric data), the electronic device performs the respective operation ( 2726 ). Performing each action in response to determining that respective data from one or more biometric sensors matches biometric information that is applied to perform the respective action requires, in some instances, the user to manually authenticate It improves the operability of the device by allowing it to authenticate with the device without it, thereby making the user-device interface more efficient.

In some examples, further, after processing each data from the one or more biometric sensors, upon determining that the respective data does not match the biometric information applied to perform the respective operation (eg, the device detecting no face or a face that does not match the authorized faces) 2728, the electronic device is configured to: Display ( 2730 ) one or more affordances (eg, 2636 , 2638 ) for using authentication. Displaying one or more affordances for using a second form of authentication that was not displayed prior to processing respective data from the one or more biometric sensors may be useful for a device requiring successful authentication when the biometric data is unsuccessful. Provides the user with a quick alternative way to access operations (eg, locked operations). Providing additional control options with additional displayed controls improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) -Make the device interface more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, the one or more affordances include displaying a “use passcode” button, a “use password” button, or a keypad/keyboard for entering a passcode/password. In some examples, the one or more affordances for using the second form of authentication are determined after each delay in which an authentication indicator for the first form of authentication is displayed without displaying one or more affordances for using the second form of authentication. is displayed on

In some examples, displaying the one or more affordances is, in accordance with a determination that a biometric feature corresponding to the first form of authentication is detected by the one or more biometric sensors, after a first period of time has elapsed (eg, an indication of authentication) displaying one or more affordances for using the second form of authentication (since the self is displayed); and after a second period of time has elapsed (eg, since the authentication indicator was displayed) according to a determination that no biometric feature corresponding to the first form of authentication is detected by the one or more biometric sensors; and displaying one or more affordances for using the authentication of . In some examples, the second period of time is different from (eg, longer or shorter than) the first period of time.

In some examples, displaying the one or more affordances is in accordance with a determination that a biometric feature that can be used in the first form of authentication but does not match the authorized biometric features is detected, authenticating using the second form of authentication. displaying a user interface (eg, 2656) for a second form of authentication (eg, a sequence of characters for authentication (eg, a password or passcode) concurrently with respective instructions to provide one or more inputs to Displaying a plurality of character entry keys (eg, a keyboard or keypad) for input (eg, displaying instructions to enter a sequence of characters for authentication using one or more character entry keys (eg, a passcode) The keypad is displayed with the commands "Enter passcode to unlock")); and in accordance with a determination that no biometric feature corresponding to the first form of authentication has been detected by the one or more biometric sensors, provide one or more inputs to authenticate using the second form of authentication. displaying a user interface (eg, 2657) for a second form of authentication without displaying keyboard or keypad)). In some examples, the user interface for the second form of authentication is displayed without displaying respective instructions for entering a sequence of characters for authentication using one or more character entry keys (eg, a passcode keypad is Enter passcode to unlock" is displayed without the commands). In some examples, the plurality of text input keys are each instruction to initially input a sequence of characters for authentication (eg, while the device is attempting to use the first form of authentication) using the one or more text input keys. are displayed without , and then when using the first form of authentication fails, the device displays explicit instructions to use one or more character input keys to enter a sequence of characters for authentication.

In some examples, displaying the one or more affordances includes entering a plurality of characters for entering a sequence of characters for authentication (eg, a password or passcode) in accordance with a determination that the request to perform each operation comprises a home input. displaying keys (eg, keyboard or keypad); and in accordance with a determination that the request to perform each action includes selection of a notification, a plurality of character input keys (eg, keyboard or and displaying a passcode affordance that results in display of the keypad). In some examples, passcode affordance is responsive to one or more other types of inputs with limited activation in response to tap inputs and including additional input requirements in addition to touch input. In some examples, the one or more additional input requirements include a requirement that the input is a hard press input (eg, a requirement that the input reaches a characteristic intensity that exceeds a respective intensity threshold), a requirement that the input is a long press input (eg, that the input is a , a requirement that the input comprises a contact that remains on the touch-sensitive surface for a predetermined amount of time without moving more than a predetermined distance), and/or a requirement that the input is a swipe input (eg, that the input is a swipe input in each direction). the requirement to include movement of the contact in excess of a threshold amount of movement of Limiting activation in response to tap inputs in this way avoids spurious (eg, accidental and/or unintentional) activation of a passcode affordance, providing improved control and usability of the electronic device, thereby It reduces user errors when operating/interacting with the device, which additionally reduces power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, after displaying one or more affordances for using the second form of authentication that was not displayed prior to processing respective data from the one or more biometric sensors, the request to perform the respective action Upon determining to include, the electronic device performs a first delay period before ceasing (eg, turning off the display) from displaying (eg, turning off the display) the one or more affordances for using the second form of authentication (automatically, without further user input). while waiting for further input; Upon determining that the request to perform each operation includes selection of a notification, the electronic device stops displaying one or more affordances for using the second form of authentication (automatically, without further user input). Waits for further input for a second delay period before (eg, turning off the display). In some examples, the second delay period is different from (eg, shorter or longer than) the first delay period.

In some examples, while the device is locked and the first form of authentication is available for use, the electronic device attempts 2732 biometric authentication using the first form of authentication. In some examples, in response to a request to perform a respective operation, in response to an attempt to use the second form of authentication, or in response to an input requesting authentication, such as lifting the device, a button on the device (eg, 2604) ), tapping the lock icon on the device, or tapping the touch-sensitive display of the device, a first form of authentication is available for use and/or the device is locked. In some examples, while attempting biometric authentication using the first form of authentication, the electronic device changes its appearance to a progress indicator (eg, progress) to indicate progress toward biometric authentication using the first form of authentication. as indicated by indicators 2624 and/or 2625) (2734). In some examples, the electronic progress indicator is an icon or progress bar that changes from a “face detection” icon or animation to a “face analysis” icon or animation. In some examples, while attempting biometric authentication using the first form of authentication, the device replaces the first graphical indication with a progress indicator. In some examples, after completing the attempt in the first form of authentication, upon determining that the authentication was unsuccessful, the electronic device replaces the progress indicator with a first graphical indication (eg, a closed lock icon); Upon determining that the authentication was successful, the electronic device replaces the progress indicator with a second graphical indication (eg, an open lock icon).

In some examples, after attempting 2736 biometric authentication using the first form of authentication, in accordance with a determination that the biometric authentication using the first form of authentication is successful, the electronic device performs successful authentication using the first form of authentication update the progress indicator in a first manner (eg, display a check mark or an open lock icon) to indicate (and, optionally, perform each action) 2738 ; and/or generate a second haptic output indicative of authentication success (eg, it is different from the first haptic output indicative of authentication failure) (eg, a single tap).

In some examples, after attempting biometric authentication using the first form of authentication, biometric authentication using the first form of authentication may be used in the first form of authentication but does not match the authorized biometric features. Upon determining to detect the measurement feature, the electronic device updates the progress indicator in a second manner to indicate an unsuccessful authentication (eg, shake the lock icon or face icon from side to side to indicate that authentication has failed). (2740). In some examples, the second manner of updating the progress indicator is different from the first manner of updating the progress indicator ( 2742 ). In some examples, the electronic device generates a first haptic output (eg, a triple tap) indicating an authentication failure.

In some examples, after attempting biometric authentication using the first form of authentication, upon determining that the biometric authentication using the first form of authentication does not detect a biometric feature that can be used in the first form of authentication, The electronic device updates the progress indicator in a third manner different from the first manner and the second manner (eg, displays a closed lock icon without shaking the lock icon from side to side to indicate that authentication has failed) 2744 .

In some examples, after attempting biometric authentication using the first form of authentication, upon determining that the biometric authentication using the first form of authentication does not detect a biometric feature that can be used in the first form of authentication, The electronic device displays a graphical indication that successful authentication did not occur without generating a tactile output. In some examples, the device does not generate a first tactile output or other tactile output indicative of authentication failure because the device did not recognize any biometric feature that could be used for the first form of authentication.

In some examples, after attempting biometric authentication using the first form of authentication for a first time, the electronic device enters a plurality of character input keys (eg, a password or passcode) for entering a sequence of characters for authentication (eg, a password or passcode). a user interface (eg, 2654 ) for a second form of authentication including a keyboard or keypad). Additionally, the electronic device attempts biometric authentication using the first form of authentication for a second time while displaying the user interface for the second form of authentication. Further, in accordance with a determination that the biometric authentication using the first form of authentication is successful, the electronic device performs a respective operation (and optionally, a first to indicate successful authentication using the first form of authentication) in a way (eg, by displaying a check mark or an open lock icon (eg, 2610 )) updates the progress indicator). Additionally, prior to receiving an input for entering less than a threshold number of characters (eg, less than 1, 2, 3, 4, or 5 characters) via one or more of the plurality of character input keys, In accordance with a determination that biometric authentication using the first form of authentication detects a biometric feature that can be used in the first form of authentication but does not match the authorized biometric features, the electronic device performs a respective action and generates a first tactile output (eg, a triple tap) indicating an authentication failure (and optionally displays a graphical indication that no successful authentication has occurred). Additionally, after receiving an input for entering at least a threshold number of characters (eg, less than 1, 2, 3, 4, or 5 characters) via one or more of the plurality of character input keys, In accordance with a determination that biometric authentication using the first form of authentication detects a biometric feature that can be used in the first form of authentication but does not match the authorized biometric features, the electronic device performs a respective action and display a graphical indication (eg, a closed lock icon) that successful authentication did not occur without producing a tactile output.

In some examples, in response to detecting a request to perform a respective operation requiring authentication, the device is locked (eg, when a request to perform the respective operation is received) and a first form of biometric authentication is used Upon determining that it is not available to perform, the electronic device may provide one or more affordances to use the second form of authentication (eg, a passcode or password input user interface, or a second form of biometric authentication, such as fingerprint authentication). ) is displayed (2746). In some examples, the first form of authentication is not available for use ( 2748 ) because it has been disabled. In some examples, the first form of authentication disables the first form of biometric authentication due to more than a threshold number of failed biometric authentication attempts using the first form of biometric authentication, due to a restart of the device, or It is not available for use due to a user request to do so. In some examples, the first form of authentication is disabled in response to a user input to the emergency options user interface without selecting an option corresponding to a request to access additional information at the device (eg, the user exceeds a threshold time trigger the display of the emergency options user interface by simultaneously pressing two or more buttons during Select the option to cancel the display of ). In some examples, the first form of authentication is disabled in response to a user selection of an option to disable the first form of biometric authentication (eg, via a biometric authentication setting in a settings user interface). In some examples, the first form of authentication is determined by current environmental and/or device conditions where operation of the one or more biometric sensors reduces the ability of the one or more biometric sensors to operate within predefined parameters. Because it is limited, it is not available for use (2750). In some examples, the device is too hot, the device is too cold, there is too much light in the environment of the device, too little light in the environment of the device, and/or the battery of the device is insufficient to drive the one or more biometric sensors. Not sufficiently charged.

In some examples, the electronic device detects a first input (eg, 2650 ) (eg, a tap input) at a location corresponding to each location in the user interface. In some examples, in response to detecting the first input at a location corresponding to each location in the user interface, in response to determining that the device is in a locked state (eg, a tap input was detected on a closed lock icon), the electronic The device attempts a first form of authentication. Attempting the first form of authentication in response to detecting the first input at a location corresponding to each location in the user interface and in accordance with a determination that the device is in a locked state may include: and convenient features, thereby making the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device detects a second input (eg, a tap input) at a location corresponding to each location in the user interface. In some examples, in response to detecting the second input at a location corresponding to each location in the user interface, in response to determining that the device is in an unlocked state (eg, a tap input was detected on an open lock icon) , the electronic device transitions the device from an unlocked state to a locked state. In some examples, each location is on a cover sheet user interface that is displayed when the device screen is initially turned on, and a second graphical indication (eg, an open lock icon) is displayed on the cover sheet while the device is still in an unlocked state. While the user interface is displayed when displayed on the device, a first graphical indication (eg, a lock icon) is displayed when the cover sheet user interface is displayed on the device while the device is in a locked state.

Note that the details of the processes described above with respect to method 1200 (eg, FIGS. 27A-27E ) are also applicable in a similar manner to the methods described herein. For example, method 2700 may optionally include one or more of the characteristics of various methods described herein with reference to methods 800, 1000, 1200, 1400, 1600, 1800, 2000, 2200, 2500. include For example, the registered biometric data described in method 1200 may be used to perform biometric authentication as described in connection with FIGS. 26L-26N. For another example, one or more implantable interfaces as described in methods 2000 , 2700 are optionally displayed in response to receiving input prior to completion of the biometric authentication process. For brevity, these details are not repeated herein.

Operations in the information processing methods described above may optionally perform one or more functional modules within an information processing apparatus, such as general-purpose processors or application-specific chips (eg, as described in connection with FIGS. 1A , 3 , and 5A ). It is implemented by driving Additionally, the operations described above with reference to FIGS. 27A-27E are, optionally, implemented by the components shown in FIGS. 1A and 1B . For example, detect operation 2702 , perform operation 2706 , display operation 2712 , and display operation 2746 are optionally performed by event classifier 170 , event recognizer 180 , and event handler 190 . is implemented Event monitor 171 in event classifier 170 detects a contact on touch-sensitive surface 604 , and event dispatcher module 174 communicates event information to application 136 - 1 . The respective event recognizer 180 of the application 136 - 1 compares the event information to the respective event definition 186 , wherein a first contact at a first location on the touch-sensitive surface corresponds to selection of an object on the user interface. Determines whether it corresponds to the same predefined event or sub-event. When a respective predefined event or subevent is detected, the event recognizer 180 activates an event handler 190 associated with the detection of the event or subevent. Event handler 190 optionally uses or calls data updater 176 or object updater 177 to update application internal state 192 . In some examples, event handler 190 accesses respective GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components shown in FIGS. 1A and 1B .

28A-28AA illustrate example user interfaces for preventing retry of biometric authentication, in accordance with some examples. As described in more detail below, the illustrative examples of the user interfaces illustrated in FIGS. 28A-28AA are used to illustrate the processes described below, including the processes of FIGS. 29A and 29B .

28A illustrates an electronic device 2800 (eg, portable multifunction device 100 , device 300 , device 500 , or device 1700 ). In the illustrative examples illustrated in FIGS. 28A-28AA , the electronic device 2800 is a smartphone. In other examples, the electronic device 2800 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). Electronic device 2800 includes a display 2802 , one or more input devices (eg, a touchscreen and microphone of display 2802 ), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 28A , the electronic device includes a biometric sensor 2803 . In some examples, the biometric sensor is one or more biometric sensors that may include a camera such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 2803 is biometric sensor 703 . In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 28A , the electronic device 2800 displays the user interface 2804 of the application on the display 2802 . The application is a mobile browser application, and the user interface 2804 corresponds to a website (onlinestore.com). In FIG. 28B , electronic device 2800 detects tap gesture 2806 on login affordance 2808 . Electronic device 2800 identifies tap gesture 2806 as a request to load login user interface 2810 (shown in FIG. 28C ). The electronic device 2800 also displays the tap gesture 2806 in the fillable fields within the login user interface 2810 , namely the username field 2812 and the password field 2814 , in the credential information (eg, by the user Identifies it as a request to be automatically filled in with a username and password that allows successful login to the account. The request to auto-populate requires biometric authentication to proceed with auto-populating the fillable fields. In some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submit affordance (eg, 2860 in FIG. 28Z ) to submit credentials and log in.

28C , in response to tap gesture 2806 (eg, a request to automatically fill in fillable fields), electronic device 2800 uses biometric sensor 2803 to determine if certain biometric authentication criteria have been met. decide whether The electronic device 2800 captures and processes (eg, analyzes) biometric data from the biometric sensor 2803 so that, based on the biometric data, the biometric feature (or a portion thereof) is a biometric authentication criterion. are satisfied (eg, determine whether the biometric data matches the biometric template, within a threshold). The biometric sensor 2803 is contactless, such that the sensor is configured to perform biometric authentication without physical input from the user (eg, without any further gestures after tap gesture 2806 ). As a result, the electronic device 2800 initiates biometric authentication using the biometric sensor 2803 without having to receive an explicit request from the user to initiate biometric authentication.

Performing biometric authentication includes displaying biometric authentication interface 2816 having biometric authentication glyphs 2818 . The biometric authentication glyph 2818 is a simulation of a representation of a biometric feature (eg, a face). 28C , the biometric authentication interface 2816 is overlaid on at least a portion of the login user interface 2810 . The biometric authentication interface 2816 is, optionally, an operating system level interface (eg, an interface created by the operating system of the device), and the login user interface 2810 is an application level interface (eg, with the operating system of the device). A user interface created by a separate third-party application). In some examples, the displayed biometric authentication interface is approximately centered along a horizontal and/or vertical axis as in FIGS. 28B-28E . In some examples, the electronic device 2800 displays a biometric authentication interface at the top, bottom, side, or corner of the display 2802 . For example, the electronic device 2800 displays a biometric authentication interface near the top of the display 2802 , such as in FIG. 30A . In some examples, the electronic device 3000 does not display the biometric authentication interface while biometric authentication is being performed.

28D and 28E , electronic device 2800 displays a biometric authentication animation including biometric authentication glyphs 2820 in FIG. 28D and biometric authentication glyphs 2822 in FIG. 28E , which glyphs are The biometric sensor 2803 serves as part of an animation that attempts to acquire biometric data.

28F , a determination is made that biometric authentication has failed (eg, biometric authentication criteria have not been met). As a result, electronic device 2800 withholds automatically filling in username field 2812 and password field 2814 . Additionally, the electronic device 2800 does not display an indication to the user that the user should retry the biometric authentication. In some examples, a determination is made that biometric authentication is successful (eg, biometric authentication criteria have been met). Consequently, in such examples, electronic device 2800 automatically populates username field 2812 and password field 2814 .

In FIG. 28G , electronic device 2800 detects tap gesture 2824 on reload affordance 2826 after determining that biometric authentication has failed. Electronic device 2800 identifies tap gesture 2824 as a request to reload login user interface 2810 . Electronic device 2800 may also request tap gesture 2824 to automatically populate one or more fillable fields within login user interface 2810 (eg, username field 2812 and password field 2814 ). identified as As previously described, the request to auto-populate requires biometric authentication to proceed with auto-populating the fillable fields.

In response to a request to automatically populate the fillable fields, a determination is made that the failure of the biometric authentication in FIG. 28F was due to failure to detect the presence of a face for a predetermined amount of time. As a result, the electronic device 2800 performs biometric authentication again using the biometric sensor 2803 , as shown in FIG. 28H . Electronic device 2800 automatically re-performs biometric authentication without the user having to provide input to initiate authentication.

28H and 28I , the electronic device 2800 performs biometric authentication, which includes displaying a biometric authentication interface and biometric authentication glyphs, as described with respect to FIGS. 28C and 28D . Once the electronic device 2800 has obtained biometric data (eg, has obtained sufficient biometric data), the electronic device transitions to displaying the biometric authentication glyph 2828 . The electronic device 2800 displays the biometric authentication glyph 2828 to indicate that biometric data is being processed. In some examples, biometric authentication glyph 2828 includes a plurality of rings that rotate in a sphere, eg, while displayed.

28K , a determination is made that the biometric authentication failed again. As a result, the electronic device 2800 displays the failed biometric authentication interface 2830 with the failed biometric authentication glyph 2832 . As a result, electronic device 2800 withholds automatically filling in username field 2812 and password field 2814 . In some examples, a determination is made that the biometric authentication is successful. Consequently, in such examples, electronic device 2800 automatically populates username field 2812 and password field 2814 .

28L , electronic device 2800 detects tap gesture 2824 on reload affordance 2826 after determining that biometric authentication has failed a second time. Electronic device 2800 identifies tap gesture 2826 as a request to reload login user interface 2810 . Electronic device 2800 may also request tap gesture 2826 to automatically fill in one or more fillable fields within login user interface 2810 (eg, username field 2812 and password field 2814 ). identified as As previously described, the request to auto-populate requires biometric authentication to proceed with auto-populating the fillable fields.

In response to a request to automatically populate the fillable fields, a determination is made that the failure of the biometric authentication in FIG. 28K was due to detecting a face that did not match the authorized face (eg, the biometric data was , does not match the biometric template). As a result, the electronic device 2800 suspends performing biometric authentication, as illustrated by FIG. 28M .

In FIG. 28N , electronic device 2800 detects tap gesture 2834 on username field 2812 after withholding performing biometric authentication in response to tap gesture 2826 . As a result, electronic device 2800 displays cursor 2836 within username field 2812 , and also displays virtual keyboard 2838 and password affordance 2840 , as shown in FIG. 28O . In FIG. 28P , electronic device 2800 detects tap gesture 2842 on password affordance 2840 . Consequently, the electronic device 2800 displays a list of candidate input affordances (eg, 2844 , 2846 , 2848 ), as shown in FIG. 28Q . In some examples, in response to detecting the tap gesture 2834 on the username field 2812 , the electronic device 2800 displays an affordance labeled “usernames” instead of the password affordance 2840 . do.

In FIG. 28R , electronic device 2800 detects tap gesture 2850 on candidate input affordance 2848 (labeled “JJ_APPLESEED@EMAIL.COM”). Electronic device 2800 identifies tap gesture 2850 as a request to automatically populate username field 2812 and password field 2814 with credential information corresponding to candidate input affordance 2848 . Such requests to auto-populate fillable fields are a different type of request to auto-populate than those resulting from a request to load or reload the login user interface 2810 . A request to autofill via a request to load the login user interface is an implicit request because the request to autofill is performed as part of the request to load the login user interface. In contrast, the request to autofill in FIG. 28R is an explicit request by the user to automatically populate username field 2812 and password field 2814 with credential information corresponding to candidate input affordance 2848 . am. In response to a request to automatically populate the fillable fields via the explicit request in FIG. 28R , the electronic device 2800 initiates biometric authentication, as shown in FIG. 28S .

28S-28U , electronic device 2800 performs biometric authentication, which includes displaying a biometric authentication interface and biometric authentication glyphs, as described with respect to FIGS. 28H-28J .

28V , a determination is made that the biometric authentication is successful. Consequently, the electronic device 2800 displays a successful biometric authentication glyph 2852 indicating that the biometric authentication was successful.

In FIG. 28W , since the biometric authentication was successful, the electronic device 2800 automatically populates the username field 2812 and the password field 2814 with credential information corresponding to the candidate input affordance 2848 . In some examples, a determination is made that biometric authentication has failed. Consequently, in such examples, the electronic device 2800 suspends automatically populating the username field 2812 and the password field 2814 with credential information. In some examples, upon failure of biometric authentication, electronic device 2800 displays failure interface 2854 in FIG. 28X , as described in connection with FIG. 17M . Alternatively, the electronic device 2800 may display the failure interface 2856 in FIG. 28Y , as described with respect to FIG. 15S . Failed interface 2854 may be displayed when the user has not reached the maximum number of failed biometric authentication attempts (eg, the maximum number of failed attempts without intervening successful authentication attempts). When the maximum number of failed biometric authentication attempts is reached, a failure interface 2856 may be displayed instead.

After the electronic device 2800 automatically fills in the username field 2812 and the password field 2814 in FIG. 28W, the electronic device performs a tap gesture on the submit affordance 2860, as illustrated by FIG. 28Z. 2858) is detected. Electronic device 2800 identifies tap gesture 2858 as a request to submit credential information in username field 2812 and password field 2814 for user authentication. Upon successful user authentication, electronic device 2800 provides access to limited content within user interface 2862 of FIG. 28AA (eg, content that can only be viewed when the user is logged in).

29A and 29B are flow diagrams illustrating a method for re-performing biometric authentication after an initial unsuccessful biometric authentication attempt using an electronic device, in accordance with some examples. Method 2900 includes one or more biometric sensors (eg, 2803 ) (eg, a fingerprint sensor, a non-contact biometric sensor (eg, a biometric sensor that does not require physical contact, such as a thermal or optical facial recognition sensor), an iris scanner) (eg, 100, 300, 500, 1700, 2800). In some examples, the one or more biometric sensors (eg, 2803 ) include one or more cameras. The electronic device (eg, 100, 300, 500, 1700, 2800) optionally includes a display (eg, 2802). In some examples, the display (eg, 2802 ) is a touch-sensitive display. In some examples, the display (eg, 2802 ) is not a touch-sensitive display.

Some operations of the method 2900 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted. As described below, method 2900 provides an intuitive method for performing biometric authentication again after an initial unsuccessful biometric authentication attempt. This method reduces the user's cognitive burden of authenticating on the electronic device, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to authenticate faster and more efficiently saves power and increases the time between battery charges.

The electronic device (eg, 100, 300, 500, 1700, 2800) receives a first request (eg, 2806) to perform each operation that requires authentication (eg, auto-fill, unlock the device, make a payment) do (2902). In some examples, the first request (eg, 2806 ) is associated with performance of a respective operation. In some examples, the first request (eg, 2806) is also a request to perform a second operation different from the respective operation (eg, a request to display a webpage (eg, 2810) or load content that requires authentication) )am. In some examples, the second operation does not require authentication.

According to some examples, the first request (eg, 2806 ) is also a request to perform an operation that does not require biometric authentication. In response to receiving the first request (eg, 2806 ), the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) performs an operation that does not require biometric authentication.

According to some examples, the first request (eg, 2806 ) is a request to open a webpage (eg, 2810 ).

In response to receiving ( 2904 ) the first request (eg, 2806 ) to perform a respective operation, the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) passes from block 2906 to block 2910 . proceed

The electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) uses one or more biometric sensors (eg, 2803 ) to determine whether biometric authentication criteria are met, wherein the biometric authentication criteria are each includes a requirement that each type of biometric feature (eg, face or fingerprint) that is authorized to perform the operation of is detected by biometric sensors (eg, 2803 ) ( 2906 ). In some examples, biometric authentication criteria include a requirement that an authorized biometric feature is detected by one or more biometric sensors (eg, 2803 ).

In accordance with a determination that the biometric authentication criteria are met, the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) performs a respective operation ( 2908 ).

In accordance with a determination that the biometric authentication criteria are not met ( 2910 ), the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) refrains from performing the respective operation ( 2912 ). Withholding (or performing) each action based on not meeting biometric authentication criteria may provide security and prevent unauthorized users from initiating sensitive actions. Providing improved security improves the operability of the device (eg, by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the performance of restricted operations to the power of the device. Reduce usage and improve battery life.

According to some examples, further, in response to receiving ( 2904 ) the first request (eg, 2806 ) to perform the respective operation ( 2904 ) and in response to determining ( 2910 ) that the biometric authentication criteria are not met, the electronic device ( For example, 100 , 300 , 500 , 1700 , 2800 indicates, on the display (eg, 2802 ), to retry authentication using one or more biometric sensors (eg, 2803 ) (eg, biometric authentication to the user). withholds displaying (2914) the visually presented commands prompting to retry the . In some examples, the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) also withholds displaying an indication of re-requesting the respective operation.

According to some examples, determining whether the biometric authentication criteria are met is determined based on data obtained from one or more biometric sensors (eg, 2803 ) corresponding to the biometric feature. and determining whether at least a portion satisfies biometric authentication criteria. In some examples, when the request (eg, 2806 ) is also a request to perform a second operation that is different from the respective operation without requiring authentication, the second operation is performed even in accordance with a determination that the biometric authentication criteria are not met. is also performed For example, a first request (eg, 2806 ) (eg, input of a URL address) may include a user name and/or password of each action that requires authentication (eg, a webpage (eg, 2810 ) associated with the URL address). is a request to perform a second operation (eg, display of a web page (eg, 2810 ) associated with a URL address) that does not require authentication). Even when the biometric authentication criteria are not met, performing the second operation not requiring authentication may provide feedback on the request to the user even when the biometric security operation is not performed. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

Subsequent to determining that biometric authentication criteria have not been met in response to receiving the first request (eg, 2806) (eg, no face was detected or a face that was detected does not match an authorized face); The electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) receives ( 2916 ) a second request (eg, 2824 ) to perform a respective operation. In some examples, the non-user request to reload a webpage (eg, 2810 ) is not a request associated with retrying biometric authentication.

In response to receiving ( 2918 ) a second request (eg, 2824 ) to perform a respective operation, the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) goes to blocks 2920 and 2922 . proceed

In accordance with a determination that biometric authentication criteria have not been met in response to the first request (eg, 2806) due to the failure of one or more biometric sensors (eg, 2803) to detect the presence of a respective type of biometric feature, The electronic device determines ( 2920 ) whether biometric authentication criteria are met in response to the second request (eg, 2824 ) using the one or more biometric sensors (eg, 2803 ). Performing biometric authentication again when a previous authentication failure was due to failure to detect the presence of a biometric feature requires no need for additional inputs to the user and to clutter the user interface with additional displayed controls Provides the ability to retry authentication without Providing the ability to retry authentication without additional input and without confusing the UI with additional displayed controls (eg, helps the user provide appropriate inputs when operating/interacting with the device and helping the user By reducing mistakes), it improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and shortens the battery life by enabling the user to use the device more quickly and efficiently. improve

In some examples, the biometric feature is a face, and data from biometric sensors (eg, 2803 ) does not include data indicating that a face was detected. In some examples, a determination that the biometric authentication criteria have not been met in response to the first request (eg, 2806 ) may be determined by one or more biometric sensors (eg, 2803 ) of each type of biometric feature for a predetermined time. Occurs when the presence cannot be detected.

According to some examples, the biometric authentication criteria are not met in response to the first request (eg, 2806 ) due to the failure of one or more biometric sensors (eg, 2803 ) to detect the presence of the respective type of biometric feature. The determination that the one or more biometric sensors (eg, 2803) has not occurred is determined in advance at least a predetermined time after a determination that the biometric authentication criteria have not been met in response to the first request (eg, 2806 ) due to failing to detect the presence of the respective type of biometric feature during the determined time.

In response to the first request (eg, 2806 ) the biometric authentication criteria are set due to one or more biometric sensors (eg, 2803 ) detecting a respective type of biometric feature that does not correspond to an applied biometric feature. Upon a determination that it has not been satisfied (eg, the face that was detected does not match the authorized face), the electronic device (eg, 100, 300, 500, 1700, 2800) responds to the second request (eg, 2824) Withholds determining whether biometric authentication criteria are met using one or more biometric sensors (eg, 2803 ) (eg, the device responsive to reloading a webpage (eg, 2810 ) to authenticate biometric authentication does not retry automatically) (2922). In some examples, withholding from performing the biometric authentication again further includes withholding from performing the action that is performed when the biometric authentication criteria are met. Withholding retrying biometric authentication when a previous authentication failure was due to detecting an unauthorized biometric feature improves security and allows multiple resource-intensive retries of users who are likely to be unauthorized. reduce their cases. Providing improved security improves the operability of the device (eg, by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the performance of restricted operations to the power of the device. Reduce usage and improve battery life.

According to some examples, subsequent to determining that biometric authentication criteria have not been met in response to receiving the first request (eg, 2806 ), the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) receiving a third request (eg, 2850 ) to perform an action (eg, tapping a secure password field and selecting a password to auto-populate; tapping a non-secure username field and selecting a username to auto-fill), wherein The third request is a different type of request than the first request (eg 2806) and the second request (eg 2824) (eg, the third request is different from the one used to make the first request and the second request) made using a selection of affordances, wherein a third type of request is also not a request to perform a second action (eg, loading a webpage), whereas the first request and the second request are also to perform a second action. requests). In response to receiving the third request (eg, 2850) to perform the respective operation, the electronic device (eg, 100, 300, 500, 1700, 2800) responds to the third request (eg, 2850) one or more Use biometric sensors (eg, 2803) to determine whether biometric authentication criteria are met (eg, regardless of why biometric authentication criteria were not met in response to a first request (eg, 2806)) For example, the biometric authentication criteria may be caused by one or more biometric sensors detecting a respective type of biometric feature that does not correspond to an applied biometric feature, or one or more biometric sensors detecting a respective type of biometric feature. determine whether biometric authentication criteria are met using one or more biometric sensors (irrespective of whether or not they are not met due to failure to detect the presence of wealth). Irrespective of the reason for a previous authentication failure, performing biometric authentication again after receiving a different type of request (eg, an explicit request) provides the user with the ability to explicitly request re-authentication, Provides additional control options for the user. Providing the user with additional control options improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device). making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, further, in response to receiving a second request (eg, 2824 ) to perform a respective operation and in response to determining that biometric authentication is not available (eg, maximum number of failed biometric authentications) Attempts reached, attempts since the last successful authentication have exceeded a predefined number of allowed attempts), the electronic device (eg 100, 300, 500, 1700, 2800) provides an alternative form of authentication (eg, Prompt (eg, 2854, 2856) for a non-biometric form of authentication such as a password or passcode. Providing a prompt for an alternative authentication when biometric authentication is no longer available (eg, displaying a notification) provides the user with feedback regarding the current state of the device and what is needed to authenticate. Indicative feedback is provided to the user. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, the electronic device (eg, 100, 300, 500, 1700, 2800) imposes a respective limit on the number of unsuccessful biometric authentication attempts allowed before an alternative form of authentication is required. . The electronic device (eg, 100, 300, 500, 1700, 2800) prompts to perform each operation after a predetermined number of requests to perform (eg, within a threshold period) result in failed biometric authentication attempts. In response to the requests, stop using the one or more biometric sensors (eg, 2803 ) to determine whether biometric authentication criteria are met, wherein a predefined number of requests is less than a respective limit.

In some examples, in response to detecting each request to perform the respective operation, the device (eg, 100 , 300 , 500 , 1700 , 2800 ) is configured to: Determines whether it caused measurement authentication attempts. Upon determining that the predetermined number of requests to perform each operation resulted in failed biometric authentication attempts, the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) withholds attempting biometric authentication. Upon determining that the predetermined number of requests to perform each operation did not result in failed biometric authentication attempts, the electronic device (eg, 100, 300, 500, 1700, 2800) proceeds with an additional biometric authentication attempt.

In some examples, the number of biometric authentication attempts or retries that may be made (eg, that may be made without success) is a predetermined number of unsuccessful attempts before alternative authentication (eg, password or passcode) is required. Limited. In such examples, the electronic device (eg, 100, 300, 500, 1700, 2800) is configured to not exceed a predetermined number of allowable attempts (eg, failing to detect the presence of each type of biometric feature). suspends retrying biometric authentication after a predetermined number of attempts, even under conditions in which biometric authentication is otherwise attempted). Cessation of use of the biometric sensor (eg, withholding biometric authentication) after repeated requests before the allowed number of attempts has been exhausted may cause the user to request repeated requests (eg, repeat the same type of ), avoiding consuming the allowed number of attempts upon request, preserving at least one attempt for requests for other operations requiring biometric authentication. Preserving at least one attempt improves the operability of the device (eg, by avoiding exhaustion of authentication attempts for repeated similar requests) and makes the user-device interface more efficient, which additionally It reduces the device's power usage and improves battery life by enabling faster and more efficient use of the device.

According to some examples, determining whether biometric authentication criteria are met using one or more biometric sensors (eg, 2803 ) in response to the second request (eg, 2824 ) comprises a second request to perform the respective operation, according to some examples. 2 Occurs automatically (eg, without the need for input from the user) in response to receiving the request (eg, 2824 ).

According to some examples, the one or more biometric sensors (eg, 2803) include contactless biometric sensors (eg, 2803) configured to perform biometric authentication without physical contact from a user (eg, an infrared camera, a visible light camera, or combinations thereof).

According to some examples, in response to the second request (eg, 2824 ) and in response to a determination that biometric authentication criteria are met in response to the second request (eg, 2824 ), the electronic device (eg, 100 , 300 , 500 , 1700 and 2800 perform respective operations (eg, operations comprising auto-filling, accessing data, unlocking the device, and/or making a payment).

According to some examples, each operation is to automatically populate one or more fillable fields (eg, 2812 , 2814 ) with credential information (eg, credit card information or login information). In some examples, credit card information includes information associated with payment account information (eg, credit card, bank account, or payment service information). In some examples, login information includes information necessary to log in to an application, account, or website (eg, 2862 ). Automatically populating credential information upon request and successful authentication provides the user with the ability to populate credentials without requiring additional inputs (in addition to the request). Performing an action when a set of conditions are met without requiring additional user input (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) a device It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, each operation includes providing access to restricted content (eg, logging into a webpage (eg, 2862 ), displaying a list of passwords associated with the user, displaying credit card information). will be.

According to some examples, each operation is to transition the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) from a locked state to an unlocked state. In some examples, transitioning the electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) to an unlocked state includes a display (eg, 2802 ) of the electronic device, one or more biometric sensors (eg, 2803 ) , and/or enabling a microphone.

According to some examples, each operation is to enable an electronic device (eg, 100 , 300 , 500 , 1700 , 2800 ) to participate in a transaction (eg, a financial transaction such as payment for a product or service).

According to some examples, while determining whether biometric authentication criteria are met using one or more biometric sensors (eg, 2803), the electronic device (eg, 100, 300, 500, 1700, 2800) displays a (eg, 2802 ) displays an indication that biometric authentication is being performed (eg, small indicators are displayed on top, bottom, side, or corners). In some examples, no indicator is displayed during biometric authentication. In some examples, the electronic device (eg, 100, 300, 500, 1700, 2800) uses one or more biometric sensors (eg, 2803) to determine whether biometric authentication criteria are met, while Withholds displaying an indication that measurement authentication is being performed. In some examples, the biometric authentication criteria are not met in response to the first request (eg, 2806 ) due to the failure of one or more biometric sensors (eg, 2803 ) to detect the presence of the respective type of biometric feature. In case a first visual indication (eg, 2822 ) is displayed. In some examples, in response to the first request (eg, 2806 ) one or more biometric sensors (eg, 2803 ) detect a biometric feature of each type that does not correspond to an applied biometric feature A second visual indication (eg, 2832 ) (eg, the same as or different from the first visual indication) is displayed if the measurement authentication criteria are not met. In some examples, a third visual indication (eg, 2852 ) (eg, a third visual indication different from the first visual indication and/or the second visual indication) is displayed when the biometric authentication criteria are met.

Note that the details of the processes described above with respect to method 2900 (eg, FIGS. 29A and 29B ) are also applicable in a similar manner to the methods described below and above. For example, method 2900 may optionally include characteristics of various methods described above with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700, 3100, 3300, 3500. includes one or more of For example, enrolled biometric data described in method 1200 may be used to perform biometric authentication as described in connection with method 2900 . As a further example, authentication caching of method 3100 may be based on successful authentication performed in accordance with re-performed biometric authentication as described with respect to method 2900 . For the sake of brevity, these details are not repeated below.

30A-30A illustrate example user interfaces for cached biometric authentication, in accordance with some examples. As described in more detail below, the illustrative examples of the user interfaces illustrated in FIGS. 30A-30A are used to illustrate the processes described below, including the processes of FIGS. 31A and 31B .

30A illustrates an electronic device 3000 (eg, portable multifunction device 100 , device 300 , device 500 , or device 1700 ). In the illustrative examples illustrated in FIGS. 30A-30A , the electronic device 3000 is a smartphone. In other examples, the electronic device 3000 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 3000 includes a display 3002 , one or more input devices (eg, a touchscreen of the display 3002 , a button 3004 , and a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 30A , the electronic device includes a biometric sensor 3003 . In some examples, the biometric sensor is one or more biometric sensors that may include a camera such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 3003 is biometric sensor 703 . In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 30A , the electronic device 3000 displays the user interface 3006 of the application on the display 3002 . The application is a mobile browser application, and the interface corresponds to a website (online.com). In some examples, the website online.com is the root domain of the online.com domain. The electronic device 3000 detects a tap gesture 3008 on the login affordance 3010 . Electronic device 3000 identifies tap gesture 3008 as a request to load login user interface 3012 (shown in FIG. 30B ). The user interface 3012 is the web page id.online.com. In some examples, id.online.com is a subdomain of the online.com domain that requires successful authentication before access to restricted content is granted. Electronic device 3000 also identifies tap gesture 3008 as a request to automatically fill in fillable fields within login user interface 3012 , namely username field 3014 and password field 3016 . . The request to auto-populate requires biometric authentication to proceed with auto-populating the fillable fields. In some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submission affordance (eg, 3030 , 3046 ) to submit credentials and log in.

In FIG. 30B , in response to tap gesture 3008 (eg, a request to automatically fill in fillable fields), electronic device 3000 uses biometric sensor 3003 to determine if predetermined biometric authentication criteria have been met. decide whether The electronic device 3000 captures and processes (eg, analyzes) biometric data from the biometric sensor 3003 so that, based on the biometric data, the biometric feature (or a portion thereof) is a biometric authentication criterion. are satisfied (eg, determine whether the biometric data matches the biometric template, within a threshold). Biometric sensor 3003 is contactless, such that the sensor is configured to perform biometric authentication without physical input from the user (eg, without any further gestures after tap gesture 3008 ). Consequently, the electronic device 3000 initiates biometric authentication using the biometric sensor 3003 without having to receive an explicit request from the user to initiate biometric authentication.

Performing biometric authentication includes displaying a biometric authentication interface 3018 having a biometric authentication glyph 3020 . The biometric authentication glyph 3020 is a simulation of a representation of a biometric feature (eg, a face). 30B , the biometric authentication interface 3018 is overlaid on at least a portion of the login user interface 3012 . Biometric authentication interface 3018 is, optionally, an operating system level interface (eg, an interface created by the device's operating system), and login user interface 3012 is an application level interface (eg, with the device's operating system). A user interface created by a separate third-party application).

In FIG. 30C , the electronic device 3000 displays a portion of a biometric authentication animation that includes a biometric authentication glyph 3022 , which is a portion of an animation in which the biometric sensor 3003 obtains biometric data. serves as a In some examples, the animation of which glyphs 3020 , 3022 are part indicates that the electronic device is attempting to identify a biometric feature of a particular type (eg, identify a face). Once the electronic device 3000 has obtained biometric data (eg, has obtained sufficient biometric data), the electronic device 3000 displays biometric authentication glyphs 3024 , as shown in FIG. 30D . transfer to The electronic device 3000 displays the biometric authentication glyph 3024 to indicate that biometric data is being processed. In some examples, biometric authentication glyph 3024 includes a plurality of rings that rotate in a sphere, eg, while displayed.

In FIG. 30E , a determination is made that the biometric authentication is successful. Consequently, the electronic device 3000 displays a successful biometric authentication glyph 3026 indicating that the biometric authentication was successful.

In FIG. 30F , because the biometric authentication was successful, the electronic device 3000 fills the username field 3014 and the password field 3016 with credential information (eg, the username that enables the user to successfully log in to the account). and password) are automatically filled in. The electronic device 3000 automatically fills in the fields while the device is in an unlocked state. In some examples, a determination is made that biometric authentication has failed (eg, biometric authentication criteria have not been met). Consequently, in such examples, the electronic device 3000 suspends automatically populating one or more fillable fields (eg, the username field 3014 and the password field 3016 ).

In FIG. 30G , electronic device 3000 detects tap gesture 3028 on submit affordance 3030 . In response to detecting the tap gesture 3028 , the electronic device 3000 submits credential information in a username field 3014 and a password field 3016 for user authentication. Upon successful user authentication, electronic device 3000 provides access to limited content within account user interface 3032 of FIG. 30H (eg, content that can only be viewed when the user is logged in).

In FIG. 30I , the electronic device 3000 detects a tap gesture 3034 on a shop affordance 3036 . Electronic device 3000 identifies tap gesture 3034 as a request to load login user interface 3038 (shown in FIG. 30J ). The user interface 3038 is the web page shop.online.com. In some examples, shop.online.com is a subdomain of the online.com domain that requires successful authentication before access to restricted content is granted. In some examples, such as the example of FIG. 30J , the subdomain shop.online.com is one or more other subdomains of the online.com domain, such as the subdomain id.online.com, discussed in relation to FIGS. 30B-30I . Requires authentication separate from that required by domains. Electronic device 3000 also requests tap gesture 3034 to automatically populate one or more fillable fields within login user interface 3038 (eg, username field 3040 and password field 3042 ). identified as As previously described, in some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submission affordance (eg, 3030, 3046) to submit credentials and log in. .

In response to a request to automatically populate the fillable fields, a determination is made that the cached authentication is available for use from the successful authentication that occurred in FIG. 30E . As a result, the electronic device 3000 suspends performing biometric authentication again and proceeds to automatically fill in the user name field 3040 and the password field 3042 , as shown in FIG. 30J . The electronic device 3000 automatically populates the fields regardless of whether the biometric sensor 3003 detects a biometric feature (eg, a face or a finger). In FIG. 30K , electronic device 3000 detects tap gesture 3044 on submit affordance 3046 . In response to detecting the tap gesture 3044 , the electronic device 3000 submits credential information in a username field 3040 and a password field 3042 for user authentication. Upon successful user authentication, the electronic device 3000 provides access to limited content within the store user interface 3048 of FIG. 301 (eg, content that can only be viewed when the user is logged in).

Alternatively, in response to a request to automatically populate the fillable fields, a determination is made that cached authentication is not available for use. 30N-30V illustrate various examples of making cached authentication unavailable for use by electronic device 3000 , as described below. 30W-30Y illustrate that biometric authentication should be performed when cached authentication is not available for use, as described below.

In FIG. 30M , electronic device 3000 displays store user interface 3048 and detects tap gesture 3050 on link affordance 3052 . In response to detecting the tap gesture 3050 , the electronic device 3000 displays an account user interface 3032 , as shown in FIG. 30N .

30N and 30O show an example of making cached authentication unavailable for use by electronic device 3000 . In FIG. 30N , electronic device 3000 detects an input (eg, a single press) by finger 3054 at home button 3056 . In response to detecting the input, the electronic device 3000 displays a home screen 3058 , as shown in FIG. 30O , and causes an application having an account user interface 3032 to enter an inactive state (eg, a pending state). , a dormant state, a background state, and/or a non-active state). The application will receive a request to automatically populate the fillable fields in the login user interface 3012 (eg, FIG. 30F ) and to automatically populate the fillable fields in the login user interface 3038 (eg, FIG. 30J ). If there is inactivity for more than a threshold amount of time (eg, 2 minutes 40 seconds) between times, the cached authentication is not available for use by the electronic device 3000 .

30P-30T illustrate an example of making cached authentication unavailable for use by electronic device 3000 . In FIG. 30P , electronic device 3000 detects an input (eg, a double press) by finger 3054 at home button 3056 . In response to detecting the input, the electronic device 3000 displays a recently used apps view 3060 , as shown in FIG. 30Q . 30R and 30S , electronic device 3000 detects swipe gesture 3062 , which causes an application having account user interface 3032 to close (eg, exit). As a result, the electronic device 3000 displays the recently used apps view 3060 , which no longer includes an application having an account user interface 3032 , as illustrated by FIG. 30T . Once the application receives a request to automatically populate the fillable fields in the login user interface 3012 (eg, FIG. 30F ) and when the fillable fields in the login user interface 3038 (eg, FIG. 30J ) are automatically filled in. If closed in between, the cached authentication is not available for use by the electronic device 3000 .

30U and 30V show an example of making cached authentication unavailable for use by electronic device 3000 . In FIG. 30U , electronic device 3000 detects an input (eg, a single press) by finger 3064 at button 3004 . In response to detecting the input, the electronic device 3000 transitions the device from an unlocked state to a locked state. Transitioning the device to the locked state includes disabling (eg, disabling) the display 3002 , one or more biometric sensors 3003 , and/or a microphone of the electronic device 3000 . In FIG. 30V , electronic device 3000 is in a locked state and displays nothing on display 3002 . Once the electronic device 3000 automatically fills in the fillable fields in the login user interface 3012 (eg, FIG. 30F ) and automatically fills in the fillable fields in the login user interface 3038 (eg, FIG. 30J ). transitions to a locked state between when the request is received, the cached authentication is not available for use by the electronic device 3000 .

In FIG. 30W , the electronic device 3000 displays the events discussed in connection with FIGS. 30U and 30V after the cached authentication is no longer available (eg, FIGS. 30N and 30O , 30P-30T, or 30U and 30V ). after one or more of the sequences), display the account user interface 3032 . The electronic device 3000 detects a tap gesture 3034 on the shop affordance 3036 . Electronic device 3000 identifies tap gesture 3034 as a request to load login user interface 3038 (shown in FIG. 30X ). Electronic device 3000 also requests tap gesture 3034 to automatically populate one or more fillable fields within login user interface 3038 (eg, username field 3040 and password field 3042 ). identified as As previously described, in some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submit affordance to submit credentials and log in.

In response to a request to automatically populate one or more fillable fields, a determination is made that the cached authentication is not available for use by the electronic device 3000 . In FIG. 30Y , electronic device 3000 performs biometric authentication again using one or more biometric sensors 3003 . Biometric authentication occurs automatically in response to receiving a request to automatically fill in fillable fields so that no intermediate input from the user is required to initiate biometric authentication. If biometric authentication is successful (eg, biometric authentication criteria are met), the electronic device automatically fills in the fillable fields. If the biometric authentication is not successful (eg, biometric authentication criteria are not met), the electronic device 3000 withholds automatically filling in the fillable fields.

In Fig. 30z, the user is not logged in, and a user interface similar to Fig. 30a is presented. The electronic device 3000 displays the user interface 3006 of the application on the display 3002 . The electronic device 3000 detects a tap gesture 3008 on the login affordance 3010 . Electronic device 3000 identifies tap gesture 3008 as a request to load login user interface 3012 (shown in FIG. 30AA ). The electronic device 3000 also requests the tap gesture 3008 to automatically populate one or more fillable fields within the login user interface 3012 (eg, the username field 3014 and the password field 3016 ). identified as The request to auto-populate requires biometric authentication to proceed with auto-populating the fillable fields. As previously described, in some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submit affordance to submit credentials and log in.

In FIG. 30AA , in response to a request to automatically fill in fillable fields, the electronic device 3000 uses the biometric sensor 3003 to determine whether predetermined biometric authentication criteria have been met. The biometric sensor 3003 is contactless, allowing the sensor to be configured to perform biometric authentication without physical input from a user. Consequently, the electronic device 3000 initiates biometric authentication using the biometric sensor 3003 without having to receive an explicit request from the user to initiate biometric authentication. Biometric authentication is not successful (eg, biometric authentication criteria are not met). As a result, the electronic device 3000 displays the failure interface 3066 in FIG. 30Ab upon failed biometric authentication, as described with respect to FIG. 17M . Failure interface 3066 may be displayed when the user has not reached the maximum number of failed biometric authentication attempts.

In FIG. 30A , the electronic device 3000 detects a tap gesture 3068 on the cancel affordance 3070 . In response to detecting the tap gesture 3068 , the electronic device 3000 displays a login user interface 3012 (shown in FIG. 30A ). In FIG. 30A , in response to detecting selection of the username field 3014 , the electronic device 3000 displays a cursor 3072 within the username field 3014 , and also displays a virtual keyboard 3074 . The electronic device 3000 receives input for entering one or more characters corresponding to the credential information in the user name field 3014 and the password field 3016 . In FIG. 30A , the electronic device 3000 detects a tap gesture 3028 on a submit affordance 3030 . Consequently, the electronic device 3000 submits credential information in the user name field 3014 and the password field 3016 for user authentication. Upon successful user authentication, electronic device 3000 provides access to limited content within account user interface 3032 of FIG. 30AF (eg, content that can only be viewed when the user is logged in).

In FIG. 30Ag , the electronic device 3000 detects a tap gesture 3034 on the shop affordance 3036 . Electronic device 3000 identifies tap gesture 3034 as a request to load login user interface 3038 (shown in FIG. 30Ah). Electronic device 3000 also requests tap gesture 3034 to automatically populate one or more fillable fields within login user interface 3038 (eg, username field 3040 and password field 3042 ). identified as As previously described, in some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submit affordance to submit credentials and log in.

In response to a request to automatically populate one or more fillable fields, a determination is made that the cached authentication is not available for use by the electronic device 3000 . In FIG. 30A , the electronic device 3000 performs biometric authentication using the biometric sensor 3003 . Biometric authentication occurs automatically in response to receiving a request to automatically fill in fillable fields so that no intermediate input from the user is required to initiate biometric authentication.

In FIG. 30ai , a determination is made that biometric authentication is successful (eg, biometric authentication criteria are met). Consequently, the electronic device 3000 displays the biometric authentication interface 3018 with a successful biometric authentication glyph 3026 indicating that the biometric authentication was successful. Upon successful biometric authentication, electronic device 3000 automatically fills in username field 3040 and password field 3042 with credential information, as shown in FIG. 30aj .

In FIG. 30aj , electronic device 3000 detects tap gesture 3044 on submit affordance 3046 . In response to detecting the tap gesture 3044 , the electronic device 3000 submits credential information in a username field 3040 and a password field 3042 for user authentication. Upon successful user authentication, electronic device 3000 provides access to limited content within store user interface 3048 of FIG. 30AK (eg, content that can only be viewed when the user is logged in).

In some examples, the electronic device 3000 displays a biometric authentication interface with a biometric authentication glyph indicating that biometric authentication is being performed. In some examples, the displayed biometric authentication interface is approximately centered along a horizontal and/or vertical axis as in FIGS. 30B-30E . In other examples, the electronic device 3000 displays a biometric authentication interface at the top, bottom, side, or corner of the display 3002 . For example, electronic device 3000 displays biometric authentication interface 3076 near the top of display 3002 , as shown in FIG. 30A . In some examples, the electronic device 3000 does not display the biometric authentication interface while biometric authentication is being performed.

31A and 31B are flow diagrams illustrating a method for determining using an electronic device whether biometric re-authentication is required or cached authentication is available for use, in accordance with some examples. Method 3100 includes one or more biometric sensors (eg, 3003 ) (eg, a fingerprint sensor, a non-contact biometric sensor (eg, a biometric sensor that does not require physical contact, such as a thermal or optical facial recognition sensor), an iris scanner) (eg 100, 300, 500, 1700, 3000). In some examples, the one or more biometric sensors (eg, 3003 ) include one or more cameras. The electronic device (eg, 100 , 300 , 500 , 1700 , 3000 ) optionally includes a display (eg, 3002 ). In some examples, the display (eg, 3002 ) is a touch-sensitive display. In some examples, the display (eg, 3002 ) is not a touch-sensitive display.

Some operations of the method 3100 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted. As described below, method 3100 provides an intuitive method for determining whether biometric re-authentication is required or if cached authentication is available for use. This method reduces the user's cognitive burden of authenticating on the electronic device, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to authenticate faster and more efficiently saves power and increases the time between battery charges.

The electronic device (eg, 100, 300, 500, 1700, 3000) makes a first request (eg, 3008) to perform a first operation that requires authentication (eg, selects a password to be automatically filled in, unlocks the device, pays (below) is received (3102).

In response to receiving ( 3104 ) a first request (eg, 3008 ) to perform a first operation, the electronic device (eg, 100 , 300 , 500 , 1700 , 3000 ) passes from block 3106 to block 3110 . proceed

The electronic device (eg, 100 , 300 , 500 , 1700 , 3000 ) determines ( 3106 ) whether first biometric authentication criteria are met using one or more biometric sensors (eg, 3003 ). The first biometric authentication criteria include a requirement that each type of biometric feature (eg, face or fingerprint) that is authorized to perform the first operation is detected by the biometric sensors (eg, 3003 ).

Upon determining that the first biometric authentication criteria are met (eg, at least a portion of the biometric feature is determined based on data obtained from one or more biometric sensors (eg, 3003 ) corresponding to the biometric feature When the biometric authentication criteria are satisfied (eg, the face that was detected matches the authorized face), the electronic device (eg, 100, 300, 500, 1700, 3000) performs a first operation 3108 . Performing the first action upon request and successful authentication provides the user with the ability to perform the first action without requiring additional inputs (other than the request). Performing an action when a set of conditions are met without requiring additional user input (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) a device It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In accordance with a determination that the biometric authentication criteria are not met, the electronic device (eg, 100 , 300 , 500 , 1700 , 3000 ) withholds ( 3110 ) performing the first operation. Withholding (or performing) each action based on not meeting biometric authentication criteria may provide security and prevent unauthorized users from initiating sensitive actions. Providing improved security improves the operability of the device (eg, by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the performance of restricted operations to the power of the device. Reduce usage and improve battery life.

After performing the first operation, the electronic device (eg, 100, 300, 500, 1700, 3000) makes a second request (eg, an operation identical to or different from the first operation) to perform a second operation requiring authentication (eg, an operation identical to or different from the first operation). For example, 3034 (eg, select a password to be automatically filled in, unlock the device, make a payment) is received ( 3112 ).

In response to receiving 3114 the second request (eg, 3034 ), the electronic device (eg, 100 , 300 , 500 , 1700 , 3000 ) proceeds to blocks 3116 and 3118 .

Upon a determination that the reauthentication criteria have been met (eg, cached authentication is not allowed for the second operation or cached authentication is not available for use), the electronic device (eg, 100, 300, 500, 1700) , 3000) determines ( 3116 ) whether second biometric authentication criteria are met using one or more biometric sensors (eg, 3003 ). The second biometric authentication criteria include a requirement that each type of biometric feature (eg, face or fingerprint) that is authorized to perform the second action is detected by the biometric sensors (eg, 3003 ). In some examples, the first and second biometric authentication criteria are the same. In some examples, the first and second biometric authentication criteria are different. Performing biometric authentication when cached authentication is not available provides security and can prevent unauthorized users from initiating sensitive operations. Providing improved security improves the operability of the device (eg, by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the performance of restricted operations to the power of the device. Reduce usage and improve battery life.

Upon determining that the reauthentication criteria have not been met (eg, cached authentication is available for use), the electronic device (eg, 100, 300, 500, 1700, 3000) performs a second action without performing biometric authentication. and withhold ( 3118 ) determining whether second biometric authentication criteria are met using one or more biometric sensors (eg, 3003 ). Performing the second action upon request without requiring re-authentication provides the user with the ability to perform the action without requiring additional inputs (other than the request). Performing an action when a set of conditions are met without requiring additional user input or re-authentication helps the user to provide appropriate inputs (eg, when actuating/interacting with a device) and reduces user errors ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the device's power usage and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, the first action and the second action occur while the electronic device (eg, 100 , 300 , 500 , 1700 , 3000 ) is in an unlocked state. In some examples, determining whether the second biometric authentication criteria are met using one or more biometric sensors (eg, 3003 ) causes the electronic device (eg, 100 , 300 , 500 , 1700 , 3000 ) to lock. Occurs while in the unlocked state. Performing biometric authentication while the device is in an unlocked state enables the device to provide feedback by displaying an indication of the progress of the biometric authentication. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

According to some examples, in response to receiving the second request (eg, 3034 ) and upon determining that the second biometric authentication criteria are not met, the electronic device (eg, 100 , 300 , 500 , 1700 , 3000 ): suspend performing the second operation.

According to some examples, performing the second action may include: each type of biometric feature that is applied to perform the second action in response to receiving the second request (eg, 3034 ) includes biometric sensors (eg, 3003), regardless of whether it is detected by

According to some examples, the first action is to log on to a first web domain (eg, 3028), and the second operation is to log on to a second web domain corresponding to the first web domain (eg, 3044). In some examples, the second web domain is the same as the first web domain. In some examples, the second web domain is a subdomain of the first web domain.

According to some examples, the reauthentication criteria determine that the device (eg, 100, 300, 500, 1700, 3000) is in a locked state between when the first operation is performed and when the second request (eg, 3034) is received. (e.g., when the device remains unlocked between when the first operation is performed and when the second request is received) re-authentication criteria are not met and biometric authentication is not required again).

According to some examples, the first action is performed in the application, and the reauthentication criteria indicate that the application has been closed (eg, terminated) between when the first operation is performed and when the second request (eg, 3034 ) is received. ) requirements (eg, cached authentication is not available for use) (eg, reauthentication criteria when the application remains open between when the first operation is performed and when the second request is received) are not met and biometric authentication is not required again).

According to some examples, the reauthentication criteria are such that the application is inactive (eg, inactive for more than a threshold time (eg, 2 minutes and 40 seconds) between when the first action is performed and when the second request (eg, 3034 ) is received). , in a pending state, dormant state, background state, not active state) (eg, cached authentication is not available for use) (eg, when the first operation is performed and the second request The reauthentication criteria are not met and biometric authentication is not required again when the application remains active between when this is received).

According to some examples, determining whether the second biometric authentication criteria are met using the one or more biometric sensors (eg, 3003 ) comprises a second request to perform a second action requiring authentication (eg, 3034) (eg, without the need for intermediate input from the user).

According to some examples, one or more biometric sensors (eg, 3003 ) are contactless biometric sensors (eg, infrared camera, visible light camera, or combinations thereof) configured to perform biometric authentication without physical contact from a user. ) (eg, one or more biometric sensors (eg, 3003 ) may perform biometric authentication without physical input (eg, touch or button press) from a user).

According to some examples, while determining whether first or second biometric authentication criteria are met using one or more biometric sensors (eg, 3003 ), the electronic device (eg, 100, 300, 500, 1700, 3000 displays, on display (eg, 3002 ), an indication (eg, 3076 ) that biometric authentication is being performed (eg, small indicators are displayed at the top, bottom, side, or corners). Displaying a small indicator away from the center of the display provides the user with an indication of the progress of the biometric authentication without distracting the user and obstructing or confusing the display, thereby providing improved visual feedback during authentication. do. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, no indicator is displayed during biometric authentication. In some examples, the electronic device (eg, 100, 300, 500, 1700, 3000) uses one or more biometric sensors (eg, 3003) to determine whether biometric authentication criteria are met, while Withholds displaying an indication that measurement authentication is being performed.

Note that the details of the processes described above with respect to method 3100 (eg, FIGS. 31A and 31B ) are also applicable in a similar manner to the methods described below and above. For example, method 3100 may optionally include characteristics of various methods described above with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700, 2900, 3300, 3500. includes one or more of For example, enrolled biometric data described in method 1200 may be used to perform biometric authentication as described in connection with method 3100 . As a further example, the visibility criteria of method 3300 may be used in conjunction with method 3100 to control when biometric authentication should be performed (or again performed). For the sake of brevity, these details are not repeated below.

32A-32W illustrate example user interfaces for automatically populating fillable fields based on visibility criteria, in accordance with some examples. As described in more detail below, the illustrative examples of the user interfaces illustrated in FIGS. 32A-32W are used to illustrate the processes described below, including the processes of FIG. 33 .

32A illustrates an electronic device 3200 (eg, portable multifunction device 100 , device 300 , or device 500 ). In the illustrative examples illustrated in FIGS. 32A-32W , the electronic device 3200 is a smartphone. In other examples, the electronic device 3200 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 3200 includes a display 3202 , one or more input devices (eg, a touchscreen and a microphone of the display 3202 ), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 32A , the electronic device includes a biometric sensor 3203 . In some examples, the biometric sensor is one or more biometric sensors that may include a camera such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 3203 is biometric sensor 703 . In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 32A , the electronic device 3200 displays the user interface 3204 of the application on the display 3202 . The application is a mobile browser application, and the interface corresponds to a website (airline.com). 32B-32D , the electronic device 3200 does not initiate biometric authentication because the login user interface did not meet certain visibility criteria. For example, the visibility criteria may include whether a threshold amount of one or more fillable fields (eg, corresponding to credential information) is displayed within a viewable area of the user interface.

32B and 32C , the electronic device 3200 detects a scroll gesture 3206 of upward motion. In response to detecting the scroll gesture 3206 , the electronic device 3200 causes the user interface 3204 to scroll down. In FIG. 32D , following scroll gesture 3206 , electronic device 3200 displays a scrolled user interface 3208 . Electronic device 3200 still did not initiate biometric authentication due to a determination that the visibility criteria were not met.

In FIG. 32E , the electronic device 3200 detects a tap gesture 3210 on the hidden menu affordance 3212 . In response to detecting the tap gesture 3210 , the electronic device 3200 displays a hidden menu 3214 that includes one or more fillable fields (eg, user name), as shown in FIG. 32F . field 3216 and password field 3218). The electronic device 3200 displays a hidden menu 3214 , which is overlaid on the scrolled user interface 3208 such that the covered portion of the scrolled user interface 3208 is no longer displayed. A determination is made as to whether the fillable fields meet predetermined visibility criteria.

If it is determined that the fillable fields meet certain visibility criteria, the electronic device 3200 may replace the fillable fields in the hidden menu 3214 with credential information (eg, a user name that allows the user to successfully log in to the account). and password) to be automatically filled in. The request to auto-populate requires biometric authentication to proceed with auto-populating the fillable fields. In some examples, the request also includes a request to automatically log in the user so that the user does not have to tap a submit affordance (eg, submit affordance 3232 in FIG. 32L ) to submit credentials and log in.

32G , upon determining that the one or more fillable fields meet predetermined visibility criteria, the electronic device 3200 uses the biometric sensor 3203 to determine whether the predefined biometric authentication criteria have been met. The electronic device 3200 captures and processes (eg, analyzes) biometric data from the biometric sensor 3203 so that, based on the biometric data, the biometric feature (or a portion thereof) is a biometric authentication criterion. are satisfied (eg, determine whether the biometric data matches the biometric template, within a threshold). Biometric authentication occurs automatically once a determination is made that the fillable fields meet the visibility criteria. The biometric sensor 3203 is contactless, allowing the sensor to be configured to perform biometric authentication without physical contact from the user. Consequently, the electronic device 3200 initiates biometric authentication using the biometric sensor 3203 without receiving an explicit request from the user to initiate biometric authentication. In some examples, initiating biometric authentication includes detecting contact with one or more fingerprint sensors, and determining whether the contact meets predetermined fingerprint authentication criteria (eg, secure element 115 and determine whether the fingerprint matches an enrolled fingerprint, as discussed above in relation to; methods 1600 , 1800 , 2200 , and the fingerprint matches stored information as discussed above in connection with FIGS. 17O-21 . to determine whether or not In some examples, determining whether the fingerprint matches an enrolled fingerprint is according to one or more of the methods discussed in US Patent Application Publication No. 2015/0146945 (eg, in paragraphs [0119]-[0121]) is carried out US Patent Application Publication No. 2015/0146945 is incorporated herein by reference, specifically with regard to its disclosure of methods of determining whether a fingerprint matches an enrolled fingerprint.

Alternatively, a determination may be made that one or more fillable fields do not meet certain visibility criteria. If the fillable fields do not meet the visibility criteria, the electronic device 3200 withholds initiating biometric authentication.

Performing biometric authentication includes displaying a biometric authentication interface 3220 having a biometric authentication glyph 3222 . The biometric authentication glyph 3222 is a simulation of a representation of a biometric feature (eg, a face). 32G , the biometric authentication interface 3220 is overlaid on at least a portion of the hidden menu 3214 . Biometric authentication interface 3220 is, optionally, an operating system level interface (eg, an interface created by the device's operating system), and hidden menu 3214 is an application level interface (eg, separate from the device's operating system). A user interface created by a private third-party application). In some examples, the displayed biometric authentication interface is approximately centered along a horizontal and/or vertical axis as in FIGS. 32G-32J . In some examples, the electronic device 3200 displays a biometric authentication interface at the top, bottom, side, or corner of the display 3202 . For example, the electronic device 3200 displays a biometric authentication interface near the top of the display 3202 , such as in FIG. 30A . In some examples, the electronic device 3200 does not display the biometric authentication interface while biometric authentication is being performed.

In FIG. 32H , the electronic device 3200 displays a portion of a biometric authentication animation that includes a biometric authentication glyph 3224 , which is a portion of an animation in which the biometric sensor 3203 obtains biometric data. serves as a Once the electronic device 3200 has obtained biometric data (eg, has obtained sufficient biometric data), the electronic device 3200 is configured to display biometric authentication glyphs 3226 , as shown in FIG. 32I . transfer to The electronic device 3200 displays the biometric authentication glyph 3226 to indicate that the biometric data is being processed. In some examples, biometric authentication glyph 3226 includes a plurality of rings that rotate in a sphere, eg, while displayed.

32J , a determination is made that the biometric authentication is successful. As a result, the electronic device 3200 displays a successful biometric authentication glyph 3228 indicating that the biometric authentication was successful.

In FIG. 32K , because the biometric authentication was successful, the electronic device 3200 fills in one or more fillable fields (eg, the username field 3216 and the password field 3218 ) with the credential information (eg, the user's account automatically filled in with your login information (such as username and password) to allow you to successfully log in to In some examples, the electronic device 3200 automatically populates the fillable fields with credit card information (eg, information associated with payment account information).

Alternatively, a determination may be made that the biometric authentication criteria have not been met. If the biometric authentication fails, the electronic device 3200 withholds automatically filling in one or more fillable fields with credential information (eg, login information or credit card information). Withholding automatically populating the one or more fillable fields optionally includes displaying a failure interface, such as failure interface 2854 in FIG. 28X or failure interface 2856 in FIG. 28Y.

In FIG. 32L , the electronic device detects a tap gesture 3230 on a submit affordance 3232 . In response to detecting the tap gesture 3230 , the electronic device 3200 submits credential information in a username field 3216 and a password field 3218 for user authentication. Upon successful authentication, electronic device 3200 provides access to limited content within member user interface 3234 of FIG. 32M (eg, content that can only be viewed when a user is logged in).

32N-32W illustrate various scenarios in which certain visibility criteria were not initially met, and then, following user input, the visibility criteria were met.

In FIG. 32N , the electronic device 3200 displays the user interface 3236 of the application on the display 3202 . The application is a mobile browser application, and the interface corresponds to a website (restaurant.com). User interface 3236 includes one or more fillable fields (eg, username field 3238 and password field 3240 ). The fillable fields are displayed within the viewable area of the user interface 3236 with a size that is less than a threshold size (eg, a threshold size that must be met or exceeded to meet certain visibility criteria).

In FIG. 32O , while displaying user interface 3236 , electronic device 3200 detects zoom gesture 3242 . In response to detecting the zoom gesture 3242 , the electronic device 3200 displays an enlarged user interface 3244 , as shown in FIG. 32P . The expanded user interface 3244 includes an expanded user name field 3246 and an expanded password field 3248 . A determination is made that the zoom gesture 3242 did not cause the fillable fields to meet predetermined visibility criteria. For example, fillable fields are still displayed at a size that is less than a threshold size within the viewable area of the enlarged user interface 3244 . Upon determining that the visibility criteria are still not met, the electronic device 3200 withholds initiating biometric authentication.

In FIG. 32Q , while displaying the enlarged user interface 3244 , the electronic device 3200 detects a zoom gesture 3250 . In response to detecting the zoom gesture 3250 , the electronic device 3200 displays an enlarged user interface 3252 , as shown in FIG. 32R . The expanded user interface 3252 includes an expanded user name field 3254 and an expanded password field 3256 . A determination is made that zoom gesture 3250 caused the fillable fields to meet visibility criteria. For example, fillable fields are now displayed at a size greater than or equal to a threshold size within the viewable area of the enlarged user interface 3252 . Upon determining that the visibility criteria are met, the electronic device 3200 initiates biometric authentication and displays the biometric authentication interface 3220 with the biometric authentication glyph 3222 , as described in connection with FIG. 32G . do.

In FIG. 32S , the electronic device 3200 displays the user interface 3258 of the application on the display 3202 . The application is a mobile browser application, and the interface corresponds to a website (newsfeed.com). User interface 3258 is a user interface area corresponding to a portion of an electronic document (eg, an HTML document). The electronic document includes one or more fillable fields outside the visible area of user interface 3258 (eg, username field 3268 and password field 3270 in FIG. 32W ).

In FIG. 32T , while displaying the user interface 3258 , the electronic device 3200 detects a scroll gesture 3260 of upward motion. In response to detecting the scroll gesture 3260 , the electronic device 3200 causes the user interface 3258 to scroll down. In FIG. 32U , following scroll gesture 3260 , electronic device 3200 displays a scrolled user interface 3262 , which displays a portion of one or more fillable fields (eg, username field 3268 ). includes doing A determination is made that the scroll gesture 3260 did not cause one or more fillable fields to meet predetermined visibility criteria. For example, the visibility criteria include whether a threshold amount of one or more fillable fields is displayed within the viewable area of the scrolled user interface 3262 . Upon determining that the visibility criteria are still not met, the electronic device 3200 withholds initiating biometric authentication.

In FIG. 32V , while displaying the scrolled user interface 3262 , the electronic device 3200 detects a scroll gesture 3264 . In response to detecting the scroll gesture 3264 , the electronic device 3200 causes the scrolled user interface 3262 to further scroll down. In FIG. 32W , following scroll gesture 3264 , electronic device 3200 displays scrolled user interface 3266 , which includes one or more fillable fields (eg, username field 3268 and password field) 3270))). A determination is made that the scroll gesture 3264 caused the fillable fields to meet visibility criteria. For example, a threshold amount of one or more fillable fields is now displayed within the viewable area of the scrolled user interface 3262 . Upon determining that the visibility criteria are met, the electronic device 3200 initiates biometric authentication and displays the biometric authentication interface 3220 with the biometric authentication glyph 3222 , as described in connection with FIG. 32G . do.

33 is a flow diagram illustrating a method for determining when to perform an authentication operation using an electronic device, in accordance with some examples. Method 3300 is performed at a device (eg, 100 , 300 , 500 , 1700 , 3200 ) having a display (eg, 3202 ). In some examples, the display (eg, 3202 ) is a touch-sensitive display. In some examples, the display (eg, 3202 ) is not a touch-sensitive display.

Some operations of the method 3300 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted. As described below, method 3300 provides an intuitive method for determining when to perform an authentication operation. This method reduces the cognitive burden of the user for performing the authentication operation, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to authenticate faster and more efficiently saves power and increases the time between battery charges.

The electronic device (eg, 100, 300, 500, 1700, 3200) requests (eg, 3210) (eg, loads a webpage) to display a first portion (eg, 3214) of each content (eg, 3208) , a request to scroll the webpage and zoom the webpage) is received (3302).

In response to a request (eg, 3210) to display (eg, 3210) a first portion (eg, 3214) of each content (eg, 3208), the electronic device (eg, 100, 300, 500, 1700, 3200) blocks Proceed to block 3306 through block 3310 .

The electronic device (eg, 100 , 300 , 500 , 1700 , 3200 ) displays on a display (eg, 3202 ) at least a first portion (eg, 3214 ) of each content (eg, 3208 ) (eg, user-interactive) Display ( 3306 ) a region of an electronic document (eg, an HTML document) having elements. Each content (eg, 3208) optionally includes an element (eg, 3216, 3218) associated with an authentication operation (eg, one or more fillable fields, such as a credit card entry field, username and password fields for logging into the service) containing login user interface elements).

Upon a determination that an element (eg, 3216 , 3218 ) associated with an authentication operation meets visibility criteria (eg, an element associated with an authentication operation is entirely outside the viewable area of the content, and at least a threshold amount of the element associated with the authentication operation , such that an element associated with an authentication action is displayed at a size less than a threshold size within the visible area of the content, and/or an element associated with the action is contained within a collapsed menu area or other hidden element. contained within a portion of content that is hidden from view (e.g., at least a portion of one or more fillable fields are displayed, one or more fillable fields are fully displayed, and/or one or more fillable fields are greater than a threshold size) , the electronic device (eg, 100, 300, 500, 1700, 3200) initiates 3308 biometric authentication (eg, as described with reference to FIGS. 17G and 17H ). In some examples, the region corresponds to a portion of an electronic document (eg, an HTML document), and the one or more fillable fields include one or more of the electronic document having a property that causes one or more elements of the electronic document to be rendered in a visible state. Elements (eg, HTML elements with a "style.display" property of "inline"). Initiating biometric authentication upon meeting the visibility criteria provides the user with the ability to perform biometric authentication without requiring additional inputs (in addition to the input by which the visibility criteria are met). Performing biometric authentication when a set of conditions are met without requiring additional user input (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

Upon determining that the element associated with the authentication operation (eg, 3216 , 3218 ) does not meet the visibility criteria (eg, the element associated with the authentication operation is displayed entirely within the viewable area of the content, and at least a threshold amount of the element associated with the authentication operation is displayed within the visible area of , an element associated with an authentication operation is displayed at a size exceeding a threshold size within the visible area of the content, and/or an element associated with the operation is contained within a collapsed menu area or other hidden element; (such as included within a portion of the content that is not otherwise hidden from view), the electronic device (eg, 100, 300, 500, 1700, 3200) withholds (3310) initiating biometric authentication. Withholding from initiating biometric authentication based on not meeting visibility criteria prevents biometric authentication from occurring when the user does not intend for the device to initiate biometric authentication. Preventing unintentional biometric authentication improves the operability of the device (eg, by limiting unauthorized access) and makes the user-device interface more efficient, which in addition, limits the performance of restricted operations to the device reduce power consumption and improve battery life.

According to some examples, a first portion (eg, 3214 ) of each content (eg, 3208 ) is displayed without displaying a second portion of each content (eg, 3202 ) on a display (eg, 3202 ). In some examples, the second portion is displayed prior to displaying the first portion.

According to some examples, biometric authentication is performed automatically (eg, without requiring intermediate input to initiate biometric authentication) upon determining that an element (eg, 3216 , 3218 ) associated with an authentication operation meets visibility criteria. Occurs.

According to some examples, while displaying the first portion (eg, 3236, 3258) of each content, the electronic device (eg, 100, 300, 500, 1700, 3200) receives an input (eg, 3242, 3250, 3260, 3264) (eg, zoom, scroll, display menus). In response to detecting the input (eg, 3250 , 3264 ) and in accordance with a determination that the input causes an element associated with the authentication operation (eg, 3246 , 3248 , 3268 , 3270 ) to meet visibility criteria, the electronic device (eg, , 100, 300, 500, 1700, 3200) initiate biometric authentication. Initiating biometric authentication in response to input and upon meeting visibility criteria provides the user with the ability to perform biometric authentication without requiring additional inputs (in addition to the input by which the visibility criteria are met). Performing biometric authentication when a set of conditions are met without requiring additional user input (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In response to detecting the input (eg, 3242 , 3260 ) and in accordance with a determination that the input does not cause an element associated with the authentication operation (eg, 3238 , 3240 , 3268 , 3270 ) to meet visibility criteria, the electronic device ( For example, 100, 300, 500, 1700, 3200) withhold initiating biometric authentication. In some examples, an input (eg, 3210, 3242, 3250, 3260, 3264) (eg, selection of affordance, request to resize) is an element associated with an authentication operation (eg, 3216, 3218, 3246, 3248, 3268, 3270) ), causing the element to transition from not meeting visibility criteria to meeting visibility criteria. Withholding from initiating biometric authentication based on not meeting visibility criteria prevents biometric authentication from occurring when the user does not intend for the device to initiate biometric authentication. Preventing unintentional biometric authentication improves the operability of the device (eg, by limiting unauthorized access) and makes the user-device interface more efficient, which in addition, limits the performance of restricted operations to the device reduce power consumption and improve battery life.

According to some examples, the input (eg, 3242 , 3250 ) is a request to perform a zoom operation, and the visibility criteria indicate that the element 3238 , 3240 , 3246 , 3248 , 3254 , 3256 associated with the authentication operation is greater than a threshold size. It includes the requirement to have a size.

According to some examples, the input 3260 , 3264 is a request to perform a scroll operation, and the visibility criteria indicate that at least a predetermined amount of the element 3268 , 3270 associated with the authentication operation is displayed on the display (eg, 3202 ). include requirements.

According to some examples, the input (eg, 3210 ) is a request to perform a hidden interface region display operation (eg, a request to display a hidden menu or other hidden interface region) and the visibility criteria are an element associated with the authentication operation (eg, 3216, 3218) are not designated for display in the hidden interface area.

According to some examples, the electronic device (eg, 100 , 300 , 500 , 1700 , 3200 ) further comprises one or more biometric sensors (eg 3203 ), and initiating biometric authentication comprises one or more biometric sensors (eg, 3203 ). and initiating biometric authentication using sensors (eg, 3203 ).

According to some examples, the one or more biometric sensors (eg, 3203 ) are one or more contactless biometric sensors (eg, infrared camera, visible light camera, or their configured to perform biometric authentication without physical contact from a user) combinations) (eg, one or more biometric sensors (eg, 3203 ) can perform biometric authentication without physical input (eg, touch or button press) from a user). Initiating biometric authentication occurs without receiving an explicit request to initiate biometric authentication.

According to some examples, the one or more biometric sensors (eg, 3203 ) include one or more facial recognition sensors. Initiating biometric authentication includes determining whether facial authentication criteria have been met using one or more facial recognition sensors (eg, as described with respect to FIGS. 23D-23F ).

According to some examples, the one or more biometric sensors (eg, 3203 ) include one or more fingerprint sensors. Initiating biometric authentication includes detecting contact with one or more fingerprint sensors, and determining whether the contact meets fingerprint authentication criteria (eg, a fingerprint matches an enrolled or authorized fingerprint). include

Initiating biometric authentication, according to some examples, includes displaying, on a display (eg, 3202 ), a progress indicator (eg, 3222 , 3224 , 3226 , 3228 ) indicating a status of the biometric authentication process. . In some examples, the progress indicator is a simulated progress indicator (eg, some of the features of the progress indicator displayed surrounding the simulation of the biometric feature, such as a plurality of progress elements distributed around the representation of the user's biometric feature. or progress indicator with all). In some examples, a small progress indicator is displayed on the top, bottom, side, or corner. Displaying a small indicator away from the center of the display provides the user with an indication of the progress of the biometric authentication without distracting the user and obstructing or confusing the display, thereby providing improved visual feedback during authentication. do. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, no indicator is displayed during biometric authentication. In some examples, no progress indicator is displayed during biometric authentication. In some examples, the electronic device (eg, 100 , 300 , 500 , 1700 , 3200 ) refrains from displaying a progress indicator indicating the status of the biometric authentication process.

According to some examples, an element associated with an authentication operation is a fillable field (eg, 3216, 3218, 3254, 3256, 3268, 3270) (eg, a user name, password, credential, or payment information input field). In response to initiating biometric authentication and upon determining that the biometric authentication criteria have been met, the electronic device (eg, 100, 300, 500, 1700, 3200) generates a fillable field (eg, 3216, 3218, 3254, Automatically populates 3256, 3268, 3270 with credential information (e.g., fields such as username, password, credit card information or other sensitive information, electronic device (e.g., 100, 300, 500, 1700, 3200) Populated with data accessible by or stored by an electronic device (eg, 100, 300, 500, 1700, 3200). In response to initiating biometric authentication and upon determining that biometric authentication criteria have not been met, the electronic device (eg, 100, 300, 500, 1700, 3200) displays a fillable field (eg, 3216, 3218, 3254, 3256, 3268, 3270) are automatically populated with credential information.

According to some examples, in response to initiating biometric authentication and upon determining that biometric authentication criteria have been met, the electronic device (eg, 100, 300, 500, 1700, 3200) provides access to restricted content (eg, Logging into a webpage (eg, 3234 ), displaying a list of passwords associated with the user, displaying credit card information). In response to initiating the biometric authentication and upon determining that the biometric authentication criteria have not been met, the electronic device (eg, 100 , 300 , 500 , 1700 , 3200 ) withholds providing access to the restricted content.

According to some examples, the credential information includes login information (eg, information required to log in to an application, account, or website).

According to some examples, the credential information includes information associated with payment account information (eg, credit card, bank account, or payment service information).

Note that the details of the processes described above with respect to method 3300 (eg, FIG. 33 ) are also applicable in a similar manner to the methods described below and above. For example, method 3300 may optionally include characteristics of various methods described above with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700, 2900, 3100, 3500. includes one or more of For example, enrolled biometric data described in method 1200 may be used to perform biometric authentication as described in connection with method 3300 . As a further example, the reauthentication criteria of method 3100 may be used in conjunction with method 3300 to control when biometric authentication should be performed (or re-performed). For the sake of brevity, these details are not repeated below.

34A-34N illustrate example user interfaces for automatic login using biometric authentication, in accordance with some examples. As described in more detail below, the illustrative examples of the user interfaces illustrated in FIGS. 34A-34N are used to illustrate the processes described below, including the processes of FIG. 35 .

34A illustrates an electronic device 3400 (eg, portable multifunction device 100 , device 300 , device 500 , or device 1700 ). In the illustrative examples illustrated in FIGS. 34A-34N , the electronic device 3400 is a smartphone. In other examples, the electronic device 3400 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). Electronic device 3400 includes a display 3402 , one or more input devices (eg, a touchscreen and microphone of display 3402 ), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 34A , the electronic device includes a biometric sensor 3403 . In some examples, the biometric sensor is one or more biometric sensors that may include a camera such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the biometric sensor is a depth camera or device 100 having one or more features and/or functions of a depth camera as described with respect to device 700 and certain examples of biometric sensor 703 . ) is the depth camera 175 . In some examples, the biometric sensor 3403 is a depth used with the visible light camera to determine a depth map of different portions of the object captured by the visible light camera, as described above with respect to the biometric sensor 703 . it's a camera

As can be seen in FIG. 34A , the electronic device 3400 also includes a fingerprint sensor 3414 (eg, a biometric sensor) incorporated into the button. In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In some examples, electronic device 3400 includes devices 100, 300, 500, 700, 900, 1100, 1300, 1500, 1700, 1900, 2100, 2300, 2400, 2600, 2800, 3000, 3200, 3600, 3800 , 4000, 4200) may share one or more features, elements, and/or components, each of which may share one or more features, elements, and/or components of another of those devices. (eg, device 700 may include components of device 3200, and vice versa). For example, biometric sensor 3403 may be biometric sensor 903 , or biometric sensor 1103 may be biometric sensor 1303 . For another example, the button-integrated fingerprint sensor 3414 can be the fingerprint sensor 1764 . For another example, display 3402 may be display 1302 , or display 1502 may be display 2102 .

Before displaying the login user interface 3404 in FIG. 34A , the electronic device 3400 detects a request to load the login user interface 3404 . In response to detecting the request, a determination is made as to whether biometric authentication using the fingerprint sensor 3414 is available. Upon determining that biometric authentication is available, electronic device 3400 enters credential information in submission affordance 3420 (eg, upon selection, in one or more fillable fields (eg, username field or password field)). Displays a login user interface 3404 with a prompt 3406 (“SCAN FINGER TO LOGIN”) located within the submitting affordance. Prompt 3406 prompts the user to: Placing their finger on 3414 submits credential information (eg, a username and password that allows the user to successfully log in to the account) via the username field 3408 and the password field 3410 . Additionally, the username field 3408 is pre-populated with a default username (eg, jj_appleseed@email.com), as shown in Figure 34A. In some examples, the username field is a username not pre-filled

In FIG. 34B , while displaying login user interface 3404 , electronic device 3400 detects finger 3412 using fingerprint sensor 3414 . In response to detecting the finger 3412 , a determination is made that the finger meets certain biometric authentication criteria (eg, the fingerprint matches an enrolled fingerprint). Upon successful authentication, in FIG. 34C , the electronic device 3400 automatically enters credential information in the username field 3408 and/or the password field 3410 and submits the credential information for user authentication (see FIG. submit that information, eg, without requiring further input from the user). Upon successful user authentication, the electronic device 3400 provides access to limited content within the account user interface 3416 of FIG. 34D (eg, content that can only be viewed when the user is logged in).

Alternatively, if a determination is made that the finger does not meet the predetermined biometric authentication criteria, the electronic device 3400 withholds entering and submitting the credential information, and as shown in FIG. 34E , the failure interface ( 3418) is displayed. Failure interface 3418 may be displayed when the user has reached the maximum number of failed biometric authentication attempts. When the maximum number of failed biometric authentication attempts is reached, the fingerprint sensor 3414 is not available for biometric authentication.

34F illustrates a login displayed when biometric authentication using fingerprint sensor 3414 is not available (eg, when such authentication is disabled via a user-selectable setting or when a maximum number of attempts has been exceeded). User interface 3404 - 1 is illustrated. In response to detecting the request to display a login user interface, a determination is made that biometric authentication using fingerprint sensor 3414 is not available. Upon such determination, electronic device 3400 displays login user interface 3404 - 1 without prompt 3406 . Electronic device 3400 displays submission affordance 3420 - 1 in its original, unmodified state, where text 3422 (“LOGIN”) is displayed within submission affordance 3420 - 1 .

In some examples, the electronic device 3400 does not immediately display the prompt 3406 in response to a request to load the login user interface. Instead, the electronic device 3400 displays a prompt 3406 after receiving a selection of a fillable field for entering text. In FIG. 34G , electronic device 3400 initially displays login user interface 3404 - 1 without prompt 3406 . The electronic device 3400 detects a tap gesture 3424 on the password field 3410 . In response to detecting the tap gesture 3424 , the electronic device 3400 displays a virtual keyboard 3426 (eg, a keyboard for entering one or more characters) and a password field 3410 , as shown in FIG. 34H . displays a cursor 3428 in Additionally, in response to the tap gesture 3424 , the electronic device 3400 displays a login user interface 3404 having a prompt 3406 located within the submission affordance 3420 .

In FIG. 34I , electronic device 3400 receives an input corresponding to input of one or more characters (eg, character 3430 ) via virtual keyboard 3426 . In response to receiving the input of text 3430 , electronic device 3400 again displays login user interface 3404 - 1 without prompt 3406 . Electronic device 3400 displays submission affordance 3420 - 1 in its original, unmodified state, where text 3422 is displayed within submission affordance 3420 - 1 .

In FIG. 34J , after receiving input via virtual keyboard 3426 , electronic device 3400 detects tap gesture 3432 on submit affordance 3420 - 1 . In response to detecting the tap gesture 3432 , the electronic device 3400 submits one or more characters in the username field 3408 and the password field 3410 for user authentication. Upon successful user authentication, electronic device 3400 provides access to limited content within account user interface 3416 of FIG. 34K (eg, content that can only be viewed when the user is logged in).

In some examples, successful user authentication via fingerprint authentication (as described in connection with FIGS. 34A-D ) results in some result (eg, access to a restricted application, webpage, or account). In some examples, successful user authentication by typing and submitting credential information (as described in connection with FIGS. 34F-34K ) produces the same result (eg, access to a restricted application, webpage, or account). cause

34L illustrates that prompt 3406 may be displayed in other locations on the login user interface and some elements discussed with respect to interfaces 3404 and 3404-1 may be omitted. In FIG. 34L , in response to detecting a request to display a login user interface and if biometric authentication is available, the electronic device 3400 indicates that a prompt 3406 is displayed within the password field 3410 and submits affordance (eg, , 3420 and 3420 - 1 display a non-displayed login user interface 3404 - 2 .

In FIG. 34M , while displaying login user interface 3404 - 2 , electronic device 3400 detects finger 3412 using fingerprint sensor 3414 . In response to detecting the finger 3412 , a determination is made that the finger meets certain biometric authentication criteria (eg, the fingerprint matches an enrolled fingerprint). Upon successful authentication, electronic device 3400 automatically submits credential information for user authentication. Upon successful user authentication, the electronic device 3400 provides access to restricted content (eg, content that can only be viewed when the user is logged in).

Alternatively, if a determination is made that the finger does not meet certain biometric authentication criteria (eg, the fingerprint does not match an enrolled fingerprint), the electronic device 3400 withholds submitting the credential information. Additionally, upon failed biometric authentication, electronic device 3400 displays login user interface 3404 - 1 that includes previously hidden submission affordances (eg, 3420 , 3420 - 1 ) (shown in FIG. 34N ). do. Additionally, upon failed biometric authentication, electronic device 3400 prompts the user for manual entry by displaying cursor 28 within a fillable field, such as password field 3410 .

35 is a flow diagram illustrating a method for indicating the availability of biometric authentication using an electronic device, in accordance with some examples. Method 3500 may include physical contact, such as a display (eg, 3402) and one or more biometric sensors (eg, 3403, 3414) (eg, a fingerprint sensor, a contactless biometric sensor (eg, a thermal or optical facial recognition sensor) biometric sensors not required), iris scanners) (eg, 100, 300, 500, 1700, 3400). In some examples, the one or more biometric sensors (eg, 3403 ) include one or more cameras. In some examples, the display (eg, 3402 ) is a touch-sensitive display. In some examples, the display (eg, 3402 ) is not a touch-sensitive display.

Some operations of method 3500 are selectively combined, orders of some operations are selectively changed, and some operations are optionally omitted. As described below, method 3500 provides an intuitive method for indicating the availability of biometric authentication. This method reduces the cognitive burden on the user of determining the availability of biometric authentication, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to more quickly and more efficiently identify the availability of biometric authentication saves power and increases the time between battery charges.

An electronic device (eg, 100, 300, 500, 1700, 3400) has a credential submission (eg, login) user interface element (eg, 3408, 3410) (eg, a fillable field such as a user name or password) with Detect 3502 a predefined action (eg, a request to load and/or display the user interface, selection of a particular element of the user interface) corresponding to the credential submission (eg, login) user interface (eg, 3404 ) .

In response to detecting the predefined action 3504 , the electronic device (eg, 100 , 300 , 500 , 1700 , 3400 ) proceeds from block 3506 to block 3516 .

In response to detecting the predefined action 3504 and in response to determining 3506 that biometric authentication (eg, touch ID, face ID) via one or more biometric sensors (eg, 3403, 3414) is available ( 3506 ). ), the electronic device (eg, 100, 300, 500, 1700, 3400) displays, on a display (eg, 3402 ), a biometric feature (eg, 3412 ) that meets biometric authentication criteria one or more biometric sensors Submit credential (eg, 3406) with a visual indication (eg, 3406) that presenting to s (eg, 3403, 3414) will cause the credentials to be submitted via a credential submission user interface element (eg, 3408, 3410) For example, a login) user interface (eg, 3404) is displayed (3508).

In some examples, the credential submission user interface is generated based on an electronic document (eg, an HTML document), and the credential submission user interface element is an input element (eg, a login button) for submitting the credentials. In some examples, when biometric authentication is available, the electronic device (eg, 100, 300, 500, 1700, 3400) sets the credential input element to a first state (eg, default state, biometric authentication is not available). Rather than rendering and displaying a biometric authentication element (eg, instructions for providing the required biometric authentication input (eg, fingerprint) instead of a credential submission user interface element) Display. Displaying a prompt to the user indicating that placing their finger on the sensor will automatically cause logging in provides the user with feedback regarding the current state of the device (eg, biometric authentication is available); Provide users with feedback indicating efficient options for logging in. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, in response to detecting the predefined action 3504 and in response to determining 3506 that biometric authentication via one or more biometric sensors (eg, 3403 , 3414 ) is available, the electronic device (e.g., 100, 300, 500, 1700, 3400) withholds (e.g., does not display a login button) displaying the credential submission affordance (e.g., 3420) on the display (e.g., 3402) 3516 . Omitting the display of the login button encourages the user to seek an efficient way to log in, thereby providing improved feedback. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, in response to detecting the predefined action ( 3504 ) and in response to determining that biometric authentication via one or more biometric sensors (eg, 3403 , 3414 ) is not available ( 3510 ), the electronic A device (eg, 100 , 300 , 500 , 1700 , 3400 ) may use a submit credential (eg, login) user interface (eg, 3404-) without displaying a visual indication (eg, 3406 ) on a display (eg, 3402 ). 1) is displayed (3512). Withholding the display of the prompt to log in via biometric authentication provides feedback to the user regarding the current state of the device as it indicates to the user that login via biometric authentication is not available. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, further, in response to detecting the predefined action ( 3504 ) and in response to determining that biometric authentication via one or more biometric sensors (eg, 3403 , 3414 ) is not available ( 3510 ), ), the electronic device (eg, 100, 300, 500, 1700, 3400) is touch-activated that is associated with a credential submission affordance (eg, 3420) (eg, one or more fillable fields) on a display (eg, 3402). login button) (3514). Receiving an input (eg, 3432 ) corresponding to selection of a credential submission affordance (eg, 3420 ) causes credentials to be submitted via a credential submission user interface element (eg, 3408 , 3410 ) (eg, 3408 , 3410 ). , allowing credentials to be submitted without using biometric authentication).

According to some examples, while displaying the credential submission user interface (eg, 3404), the electronic device (eg, 100, 300, 500, 1700, 3400) may include one or more biometric sensors (eg, 3403, 3414) , each type of biometric feature (eg, 3412 ) is detected. In response to detecting each type of biometric feature (eg, 3412 ) and in accordance with a determination that the biometric feature (eg, 3412 ) meets biometric authentication criteria, the electronic device (eg, 100 , 300 ) , 500 , 1700 , 3400 submits credentials (eg, successful authentication results in submitting credentials) via a credential submission user interface element (eg, 3408 , 3410 ). In response to detecting each type of biometric feature (eg, 3412 ) and in accordance with a determination that the biometric feature (eg, 3412 ) does not satisfy biometric authentication criteria, the electronic device (eg, 100, 300 , 500 , 1700 , 3400 withhold submitting credentials via a credential submission user interface element (eg, 3408 , 3410 ). Withholding submission of credentials based on not meeting biometric authentication criteria may provide security and prevent unauthorized users from initiating sensitive operations. Providing improved security improves the operability of the device (eg, by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the performance of restricted operations to the power of the device. Reduce usage and improve battery life.

According to some examples, the credential submission user interface element (eg, 3408 , 3410 ) includes one or more fillable fields.

According to some examples, displaying the credential submission user interface (eg, 3404 , 3404-1 , 3404-2) is pre-loaded with credentials to be submitted via the credential submission user interface element (eg, 3408 , 3410 ). and displaying a populated (eg, pre-populated default username) credential submission user interface element. Pre-populating the default username gives the user the ability to log in using fewer inputs. Performing an operation with a reduced number of inputs improves the operability of the device and reduces user-errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and reduces user- It makes the device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, the electronic device (eg, 100 , 300 , 500 , 1700 , 3400 ) receives a selection of a fillable field (eg, 3408 , 3410 ) of one or more fillable fields. In response to receiving the selection of the fillable field, the electronic device (eg, 100 , 300 , 500 , 1700 , 3400 ) displays a text input interface (eg, 3426 ) (eg, password or pass on the display (eg, 3402 )) a keypad or keyboard) including character input keys for entering a code.

According to some examples, the electronic device (eg, 100 , 300 , 500 , 1700 , 3400 ) enters one or more characters (eg, via text entry keys) via a character input interface (eg, 3426 ) in a fillable field. Receive an input (eg, 3430) corresponding to . In some examples, the text input interface includes text input keys. Subsequent to receiving the input, the electronic device (eg, 100 , 300 , 500 , 1700 , 3400 ) receives a selection of a second credential submission affordance (eg, 3420 ) (eg, a login button). In response to receiving the selection of the second credential submission affordance, the electronic device (eg, 100, 300, 500, 1700, 3400) enters one or more characters in the fillable field (eg, 3408, 3410) for credential verification. submit them

According to some examples, presenting a biometric feature (eg, 3412 ) that satisfies biometric authentication criteria to one or more biometric sensors (eg, 3403 , 3414 ) causes credentials to cause the credential submission user interface A visual indication (eg, 3406 ) that it will be submitted via an element (eg, 3408 , 3410 ) is a fillable field (eg, 3410 ) of one or more fillable fields (eg, username field, password field). is displayed on Displaying a prompt to the user indicating that placing their finger on the sensor will automatically cause logging in provides the user with feedback regarding the current state of the device (eg, biometric authentication is available); Provide users with feedback indicating efficient options for logging in. Displaying a prompt in the password field may provide feedback on an action to be performed upon successful authentication (eg, automatically populating the password field). Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

According to some examples, the predefined action is to display (eg, load a credential submission user interface) a credential submission interface (eg, 3404, 3404-1, 3404-2) on a display (eg, 3402). , a request to scroll the submit credential user interface into view, zoom in the submit credential user interface, reveal the submit credential user interface from hidden user interface elements). In some examples, the predefined action, which is a request to display a credential submission interface, may also be a first portion of each content, as described with respect to method 3300 (eg, at 3302 of method 3300 ). is a request to display

According to some examples, a predefined action is detected while displaying the credential submission interface (eg, 3404, 3404-1), and the predefined action is an input to a portion of the credential submission user interface (eg, 3424) (eg, user input on a credential submission user interface (eg, a tab) or user input on a fillable field such as a username field or password field).

According to some examples, upon submission of one or more characters in a fillable field (eg, 3408 , 3410 ) for credential verification and in response to receiving a selection of a second credential submission affordance (eg, 3420 ), electronic A device (eg, 100 , 300 , 500 , 1700 , 3400 ) provides a first result. Upon submission of credentials via a credential submission user interface element (eg, 3408, 3410) and via one or more biometric sensors (eg, 3403, 3414), a biometric feature (eg, 3412) detected is a biometric In response to determining that the measurement authentication criteria are met, the electronic device (eg, 100 , 300 , 500 , 1700 , 3400 ) provides a first result. In some examples, submitting (eg, successfully submitting) credentials (eg, valid credentials) via a password or passcode entered via a credential submission user interface element may include biometric authentication. results in the same result (eg, access to a restricted application, webpage, or account) as successful authentication through

Note that the details of the processes described above with respect to method 3500 (eg, FIG. 33 ) are also applicable in a similar manner to methods described below and above. For example, method 3500 may optionally include characteristics of various methods described above with reference to methods 800, 1000, 1200, 1400, 1600, 2000, 2200, 2500, 2700, 2900, 3100, 3300. includes one or more of For example, enrolled biometric data described in method 1200 may be used to perform biometric authentication as described in connection with method 3500 . As a further example, the reauthentication criteria of method 3100 may be used in conjunction with method 3500 to control when biometrics are available. For the sake of brevity, these details are not repeated below.

In some examples (eg, in some examples of methods 1600 , 1800 , 2000 , 2200 , 2900 , 3100 , 3300 , 3500 ), the electronic device performs brute force attempts (which ignore security). of biometric authentication attempts that may be made before biometric authentication is disabled (eg, until successful authentication occurs through alternative means), thereby providing improved security and conserving device resources. Limit the number allowed. In some such examples, ceasing use of the biometric sensor (eg, withholding further biometric authentication retries) before the allowed/limited number of attempts has been exhausted may cause the user to request repeated requests (eg, , by avoiding expending the allowed number of attempts on repeated requests of the same type), thereby making requests for other operations requiring biometric authentication (eg, requests for other more important operations). At least one attempt for Preserving at least one attempt improves the operability of the device (eg, by avoiding exhaustion of authentication attempts for repeated similar requests) and makes the user-device interface more efficient, which additionally It reduces the device's power usage and improves battery life by enabling faster and more efficient use of the device. Additionally, preserving at least one biometric authentication attempt may reduce the number of instances where a user has to provide alternative non-biometric authentication (eg, such as password or passcode authentication), which in turn may: This may facilitate the use of more secure (eg, more complex) passwords/passcodes, which will allow the user to frequently use such passwords/passcodes when biometric authentication is disabled due to exhaustion of allowed attempts. This is because using more secure passwords/passcodes is not discouraged by necessity. Facilitating the use of more secure passwords/passcodes improves the operability of the device by reducing the risk of unauthorized access.

36A-36L illustrate example user interfaces for retrying biometric authentication in a credential input user interface, in accordance with some examples. The user interfaces of these figures are used to illustrate the processes described below, including the processes of FIGS. 37A and 37B.

36A illustrates an electronic device 3600 (eg, portable multifunction device 100 , device 300 , device 500 ). In the illustrative examples illustrated in FIGS. 36A-36L , the electronic device 3600 is a smartphone. In other examples, electronic device 3600 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 3600 includes a display 3602 , one or more input devices (eg, a touchscreen of the display 3002 , a button 3604 , and a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 36A , the electronic device includes a biometric sensor 3603 . In some examples, the biometric sensor is one or more biometric sensors that may include a camera such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 3603 is biometric sensor 703 . In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 36A , electronic device 3600 displays a locked state user interface (UI) 3606 that includes a lock icon 3608 that provides an indication to the user that the electronic device 3600 is in a locked state. Because the electronic device 3600 is in the locked state, the user cannot view the restricted content of the notification 3610A (eg, a message from John Appleseed).

In FIG. 36B , the user wants to unlock the electronic device 3600 to access restricted content on the device (eg, messages from John Appleseed, home screen 3628 in FIG. 36L , most recently used applications). . Unlocking the device requires successful authentication of the user. To request unlocking of the device, the user performs an upward swipe starting from within area 3612A, which is a predefined area adjacent the lower edge of display 3602 .

While displaying the locked state UI 3606 , the electronic device 3600 receives an input 3614A (eg, an upward swipe). While displaying locked UI 3606 , electronic device 3600 requires an upward swipe to begin from within area 3612A to trigger a request to unlock the device. In response to receiving input 3614A, electronic device 3600 determines whether input 3614A originates from within region 3612A.

Upon detecting input 3614A (eg, an input starting within region 3612A), electronic device 3600 initiates biometric authentication and determines whether biometric authentication is currently enabled (or used) on the device. available for use). Biometric authentication may be unavailable for a variety of reasons, including, for example, that biometric authentication has failed more than a predetermined number of times (eg, 5, 10, 15) since the last successful authentication by the device. there is.

In some examples, instead of receiving input 3614A, electronic device 3600 receives any one of inputs 3614B-3614E (eg, swipe inputs that travel a similar distance to input 3614A). receive As with input 3614A, each of inputs 3614B-3614E is an upward swipe. In some examples, because input 3614B also begins within region 3614A, electronic device 3600 treats input 3614A and input 3614B as equal (eg, electronic device 3600 is two have the same response to inputs). Conversely, in some examples, the response of electronic device 3600 to inputs 3614C - 3614E is different from the response to inputs 3614A, 3614B. Specifically, in some examples, in response to receiving any one of inputs 3614C - 3614E, electronic device 3600 does not initiate biometric authentication, as described below with respect to FIG. 36C . does not Instead, the electronic device 3600 , as shown in FIG. 36K , (eg, by scrolling a portion of the wake screen user interface (eg, 3606 ) to display one or more notifications that were not previously visible on the display - where display one or more notifications (eg, 3610A-3610E) (eg, unread notifications) while maintaining the device in a locked state (the amount of scrolling is optionally determined based on the speed or magnitude of movement of the contact).

In FIG. 36C , in response to input 3614 and upon determining that biometric authentication is currently enabled, electronic device 3600 attempts to biometrically authenticate the user (eg, using biometric sensor 3603 ). attempts to match the obtained user's face information with the stored authorized credentials). While attempting to biometrically authenticate the user, electronic device 3600 displays embedded interface 3616 with authentication glyphs 3618 (eg, replaces the display of locked UI 3606 with it). An authentication glyph 3618 comprising a plurality of rings rotating about an axis parallel to the display to appear to rotate off the z-axis of the device provides an indication to the user that biometric authentication is being performed.

While attempting to biometrically authenticate the user, the electronic device 3600 uses the biometric sensor 3603 to determine whether certain biometric authentication criteria have been met. More specifically, the electronic device 3600 captures and processes (eg, analyzes) biometric data from the biometric sensor 3603 so that, based on the biometric data, the biometric feature (or a portion thereof) is Determine whether biometric authentication criteria are satisfied (eg, determine whether biometric data matches, within a threshold, a biometric template (eg, stored authorized credentials). After initiating the biometric authentication, the electronic device 3600 determines that the biometric authentication has failed (eg, the biometric data from the biometric sensor 3603 does not match the stored authorized credentials).

In FIG. 36D , upon determining that the biometric authentication has failed, the electronic device 3600 displays an animation of the lock icon 3608 alternating between different positions to simulate a “shake” effect. This “shake” animation provides an indication to the user that the electronic device 3600 was unable to biometrically authenticate the user.

36E , further, in response to determining that the biometric authentication has failed, the electronic device 3600 displays a passcode input UI 3620 (eg, a display of the implantable interface 3616 ). instead), which provides an alternative (eg, non-biometric) method of authenticating a user at the electronic device 3600 . The passcode input UI 3620 includes a lock icon 3608 and a plurality of input keys for entering (or writing in) a password or passcode. The passcode entry UI 3620 also prompts the user to swipe up to retry biometric authentication or to enter a passcode (or password) to authenticate the user (eg, non-biometrically). , prompt 3622A. The electronic device 3600 displays a prompt 3622A upon determining that biometric authentication is currently enabled on the device. Additionally, upon determining that biometric authentication is currently enabled, electronic device 3600 displays an unlock indication 3624, from which the user can initiate an upward swipe to retry biometric authentication. 3602) provides an indication of the approximate location of the image.

In FIG. 36E , the user is about to retry biometric authentication rather than entering a password or passcode to authenticate. While displaying passcode input UI 3620 , electronic device 3600 receives input 3614C, starting outside area 3612A of FIG. 36B . Nevertheless, input 3614C triggers retrying the biometric authentication, as input 3614C originates from within region 3612B. In particular, area 3612B is larger than area 3612A, where parameters for where the upward swipe should begin to initiate biometric authentication are compared to the locked state UI 3606 , the passcode input UI 3620 . ) is relaxed for

In some examples, instead of receiving input 3614C, the electronic device receives any one of inputs 3614A, 3614B, 3614D, 3614E. In some examples, given the relaxed parameters for passcode input UI 3620 , everything other than input 3614E will trigger retrying the biometric authentication. In some examples, in response to receiving the input 3614E, the electronic device 3600 determines that the input 3614E does not originate from within the region 3612B, and in response, does not retry the biometric authentication .

In FIG. 36F , in response to receiving input 3614C, electronic device 3600 determines that input 3614 originates from within region 3612B. Upon determining that input 3614 originates from within region 3612B, electronic device 3600 reattempts biometric authentication. While retrying the biometric authentication, the electronic device 3600 displays the authentication glyph 3618 (eg, replaces the display of the lock icon 3608 with it). Authentication glyph 3618 provides an indication to the user that biometric authentication is being performed.

While retrying the biometric authentication, the electronic device 3600 determines that the biometric authentication is successful (eg, biometric data obtained using the biometric sensor 3603 matches the stored authorized credentials). ).

36G and 36H , upon determining that the biometric authentication is successful, the electronic device 3600 transitions from the locked state to the unlocked state. Electronic device 3600 provides an indication of this transition by displaying an animation of lock icon 3608 transitioning to unlock icon 3626 of FIG. 36H , which transitions electronic device 3600 to an unlocked state. provide an indication that Additionally, upon determining that the biometric authentication is successful and after displaying the unlock icon 3626 , the electronic device 3600 provides access to the restricted content. For example, electronic device 3600 may display home screen 3628 of FIG. 36L or a most recently used application (eg, a user interface of a most recently used application (eg, messaging application interface 2616 of FIG. 26G )). is displayed.

In some examples, instead of determining that the biometric authentication failed in FIG. 36C , the electronic device 3600 determines that the biometric authentication was successful. In some examples, upon determining that the biometric authentication is successful, the electronic device 3600 transitions to an unlocked state and displays an unlock icon 3626 , as described above with respect to FIGS. 36G and 36H . . Additionally, in some examples, upon determining that the biometric authentication is successful and after displaying the unlock icon of FIG. 36H , the electronic device 3600 displays the home screen 3628 . (Home screen 3628 may include some or all of the features of home screen interface 2614 of FIG. 26D .) In some examples, upon determining that the biometric authentication is successful and an unlock icon 3626 . After displaying , the electronic device 3600 displays the most recently used application (eg, the messaging application interface 2616 of FIG. 26G ).

In some examples, instead of determining that biometric authentication is enabled on the device as described above with respect to FIGS. 36B and 36C , the electronic device 3600 (eg, biometric authentication by the user (manually) determine that biometric authentication is not currently enabled (because it has been disabled or because a predetermined biometric authentication was attempted without success). In some examples, upon determining that biometric authentication is not currently enabled, electronic device 3600 displays prompt 3622B of FIG. 36I instead of prompt 3622A of FIG. 36E . In contrast to prompt 3622A, prompt 3622B only prompts the user to enter a passcode (or password) to authenticate the user without prompting the user to swipe to retry biometric authentication. do. Additionally, in some examples, upon determining that biometric authentication is not currently enabled, the electronic device 3600 does not display the unlock indication 3624 , as shown in FIG. 36I . As discussed above, the unlock indication 3624 provides an indication of the approximate location on the display 3602 from which the user can initiate an upward swipe to retry the biometric authentication. In some examples, the electronic device 3600 does not display the unlock indication 3624 because biometric authentication is not currently enabled.

In some examples, instead of determining that the biometric authentication was successful in FIG. 36F , the electronic device 3600 determines that the biometric authentication failed. In some examples, upon determining that the biometric authentication has failed, the electronic device 3600 (instead of displaying a transition to an unlocked state as described above with respect to FIGS. 36G and 36H ) effects a "shake" effect. Display animation of lock icon 3608 alternating between different positions to simulate . As noted above, this “shake” animation provides an indication to the user that the electronic device 3600 was unable to biometrically authenticate the user.

37A and 37B are flow diagrams illustrating a method for retrying biometric authentication in a credential input user interface using an electronic device, in accordance with some examples. Method 3700 includes a touch-sensitive display (eg, 3602 ) and one or more biometric sensors (eg, 3603 ) (eg, a first biometric sensor of a device having a plurality of biometric sensors) (eg, a fingerprint sensor; Electronic devices (eg, 100, 300, 500, 3600) with contactless biometric sensors (eg, biometric sensors that do not require physical contact, such as thermal or optical facial recognition sensors), iris scanners). In some examples, the one or more biometric sensors include one or more cameras. Some operations of the method 3700 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 3700 provides an intuitive method for retrying biometric authentication in a credential input user interface using an electronic device. This method reduces the user's cognitive burden of retrying biometric authentication, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to retry biometric authentication faster and more efficiently saves power and increases the time between battery charges.

An electronic device (eg, 100 , 300 , 500 , 3600 ) configures, on a touch-sensitive display (eg, 3602 ), a credential input (eg, passcode, password, pattern) user interface (eg, passcode, password, pattern) having a plurality of character input keys For example, 3620 is displayed ( 3706 ). In some examples, the credential input user interface includes a virtual keypad or a virtual keyboard. In some examples, the virtual keypad or virtual keyboard includes a plurality of character input keys. In some examples, while displaying the credential input user interface (eg, 3620 ), the electronic device receives an input corresponding to one or more of the plurality of character input keys. In some examples, in response to (or subsequent to) receiving an input corresponding to the plurality of character input keys, the electronic device is configured such that the received input corresponds to applied credentials (eg, a stored passcode or password) Upon a determination that it does (or matches), it transitions from a locked state (eg, corresponding to 3606) to an unlocked state (eg, corresponding to 3628).

While displaying the credential input user interface (eg, 3620), the electronic device, via the touch-sensitive display (eg, 3602), provides a touch gesture input (eg, 3614A, 3614B) (eg, a swipe at a predefined location) is received ( 3708 ).

In response to receiving ( 3712 ) a touch gesture input comprising movement of a contact on the touch-sensitive display and in accordance with a determination that the first set of one or more criteria are met - the first set of one or more criteria are: including the requirement to be currently enabled on this electronic device, the electronic device attempts to biometrically authenticate a user of the electronic device based on the biometric information captured using the one or more biometric sensors ( 3714 ). In some examples, the one or more criteria of the first set include only one criterion. In some examples, biometric authentication may be disabled (or not enabled on the electronic device) when one or more of the following conditions are met: The electronic device is successfully turned on or being restarted. not certified; The electronic device has not been unlocked for more than a predetermined time (eg, 48 hours); the passcode was not used to unlock the device for more than a predetermined time (eg, 156 hours); no biometric authentication using biometric features (eg, face, fingerprint) was used to unlock the device for more than a predetermined time (eg, 4 hours); The electronic device has received a remote lock command; biometric authentication has failed more than a predetermined number of times (eg, 5, 10, 15) since the last successful authentication with the device; and the electronic device has received a power off and/or emergency SOS command. In some examples, the touch gesture input is a request to unlock the electronic device 3600 . Providing the user the ability to retry biometric authentication by performing a touch gesture input in the credential input user interface provides additional control of the device's operability without cluttering the UI with additional displayed controls. to improve Providing this capability improves the operability of the device (eg, by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device) and makes the user-device interface more efficient. This additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, in response to receiving 3712 a touch gesture input comprising movement of a contact on the touch-sensitive display and (eg, because biometric authentication is not currently enabled on the device) the first set of one or more Upon determining that the criteria are not met, the electronic device withholds attempting to biometrically authenticate a user of the electronic device based on the biometric information captured using one or more biometric sensors (eg, 3603 ). 3716). Withholding an attempt to biometrically authenticate a user when biometric authentication is not enabled improves the security of the device by preventing fraudulent use of the device.

In some examples, displaying the credential input user interface (eg, 3620 ) may include a request to perform an operation that requires authentication (eg, a request to unlock an electronic device (eg, 3614A, 3614B) (eg, of the display) receiving an edge (eg, a swipe starting from an edge (eg, a lower edge) or from within a predefined area (eg, a lower portion) of the display)), and biometric information captured using one or more biometric sensors Occurs in response to failing to biometrically authenticate a user of the electronic device based on 3702 . In some examples, the electronic device (eg, 100 , 300 , 500 , 3600 ) is configured such that biometric information captured using one or more biometric sensors can be used to obtain authorized credentials (eg, authenticated for use in biometric authentication). Biometrically authenticating a user of an electronic device fails when it does not correspond (or match) the biometric feature (eg, stored information about a face, fingerprint). Displaying the credential input user interface when a set of conditions are met provides the user the ability to authenticate via an alternative method without requiring the user to explicitly request that the credential input user interface be displayed. Performing an action when a set of conditions are met without requiring additional user input (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) a device It improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the request (eg, 3614A, 3614B) to perform an action that requires authentication is a second touch gesture input (eg, an edge (eg, lower edge) of the display) that includes movement of a contact on the touch-sensitive display. Swipe starting from or from within a predefined area (eg, 3612A) (eg, lower portion) of the display ( 3704 ). In some examples, the set of one or more criteria indicates that a touch gesture input originates in a first area of the display (eg, 3612A) (eg, an area along the lower edge of the display) and in a second area of the display (eg, of the display). includes the requirement to end in (or proceed through) the region along the lower edge (eg, the region above 3612A).

In some examples, upon determining that the one or more criteria of the second set are met, wherein the one or more criteria of the second set include a requirement that biometric authentication is currently enabled on the electronic device, a credential input user interface ( For example, displaying 3620 may include, on the touch-sensitive display (eg, 3602 ) an indication (eg, 3622A) (eg, text) to perform a gesture on the touch-sensitive display to attempt to biometrically authenticate the user. , graphics, icons). In some examples, upon determining that the one or more criteria of the second set are not met, the electronic device withholds displaying an indication to perform a gesture on the touch-sensitive display to attempt to biometrically authenticate the user. In some examples, the one or more criteria of the second set are the same as the one or more criteria of the first set. In some examples, the one or more criteria of the second set include only one criterion. Displaying an indication to perform a gesture when biometric authentication is available provides the user with feedback about the current state of the device (eg, biometric authentication is available) and prompts the user to perform the gesture associated with the indication. prompt In addition, not displaying an indication to perform a gesture when biometric authentication is not available also provides feedback to the user about the current state of the device (eg, biometric authentication is not available). Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life.

In some examples, upon determining that the third set of one or more criteria are met, the third set of one or more criteria comprising a requirement that biometric authentication is currently enabled on the electronic device, a credential input user interface ( For example, displaying 3620 may include, on a touch-sensitive display (eg, 3602 ), a user interface element (eg, 3624 ) (eg, a graphical element) adjacent an edge of the touch-sensitive display (eg, a lower edge of the display). , a horizontal bar, home affordance, an indication of where the user must swipe to attempt biometric authentication). In some examples, the one or more criteria of the third set are the same as the one or more criteria of the first set. In some examples, the one or more criteria of the third set include only one criterion. In some examples, upon determining that the one or more criteria of the third set are not met, the electronic device (eg, 100 , 300 , 500 , 3600 ) refrains from displaying the user interface element. In some examples, the set of one or more criteria indicates that a touch gesture input originates in a first area of the display (eg, 3612A) (eg, an area along the lower edge of the display) and in a second area of the display (eg, of the display). includes the requirement to end at (or proceed through) the area above the area along the lower edge. In some examples, the user interface element (eg, 3624 ) is displayed at a location corresponding to (eg, within) the first area of the display. Displaying a user interface element adjacent the edge of the display when biometric authentication is available provides the user with feedback regarding the current state of the device and how the user may request to unlock the device. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, while attempting to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors, the electronic device (eg, 100 , 300 , 500 , 3600 ) Display, on the responsive display, an animation (eg, 3618 ) having one or more moving elements indicating that biometric authentication is occurring (eg, an animation including one or more rings moving on the display (eg, graphical icon)) is displayed). In some examples, the animation provides an indication that biometric information is being processed. In some examples, the animation includes rings that rotate about an object (eg, a sphere). In some examples, the sphere is visible. In some examples, the sphere is not visible. Displaying one or more moving elements indicating that biometric authentication is occurring provides feedback to the user regarding the current state of the device (eg, biometric authentication is being performed) and that the user does not need to take any action at this time. provides Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, displaying the animation having one or more moving elements includes transitioning from the animation having one or more moving elements to a lock icon (eg, 3608 ) (eg, an icon indicating a locked state). In some examples, biometric information captured using one or more biometric sensors and after transitioning from an animation having one or more moving elements (eg, 3618 ) to a lock icon is applied to authorized credentials (eg, to biometric authentication). Upon determining that it corresponds (eg, matches) the stored information regarding the biometric feature (eg, face, fingerprint) being applied for use, the electronic device transitions from the locked state to the unlocked state. In some examples, transitioning the electronic device from a locked state to an unlocked state includes displaying an animation of the lock icon transitioning to an unlock icon (eg, 3626 ) (eg, an icon indicating an unlocked state). do. In some examples, after transitioning from an animation with one or more moving elements to a lock icon and using one or more biometric sensors to determine that the captured biometric information does not correspond to (eg, does not match) the authorized credentials. Accordingly, the electronic device displays, on the touch-sensitive display (eg, 3602 ), an animation having a lock icon (eg, 3608 ) alternating between a first position and a second position, the second position being the first position. different from In some examples, the animation with the lock icon is an animation of the lock icon that shakes (eg, rotates side to side, back and forth). In some examples, the electronic device displays an animation accompanying the lock icon to indicate that the biometric authentication has failed. In some examples, a tactile output is provided in combination with a shaking lock icon. In some examples, no tactile output is provided. In some examples, upon determining that the biometric information captured using the one or more biometric sensors does not correspond or match the authorization credentials, the electronic device (eg, 100 , 300 , 500 , 3600 ) keep locked. Displaying the animation of the lock icon transitioning to the unlock icon may inform the user of the current state of the device (eg, biometric authentication successful, device unlocked, user can now access restricted content) provide feedback on In addition, displaying the animation of the shaking lock icon provides feedback to the user regarding the current state of the device (eg, biometric authentication has failed) and prompts the user to take further action. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, touch gesture input comprising movement of a contact on the touch-sensitive display originates from a location that is distal (eg, not substantially near) an edge of the touch-sensitive display (eg, a lower edge of the display). do (3710). In some examples, a location further away from the edge of the touch-sensitive display (eg, 3602 ) includes a location closer to the center of the display than the edge. In some examples, a location remote from an edge of the touch-sensitive display includes a location that exceeds a threshold distance from an edge of the display (or is outside a predefined area (eg, 3612A)). In some examples, the threshold distance (or predefined area) is used on the wake screen to determine whether to release the wake screen when a swipe input starts away from the edge of the display and less than the threshold distance. In some examples, the threshold distance (or predefined area (eg, 3612A)) is when the swipe input begins beyond the threshold distance away from the edge of the display (or outside the predefined area (eg, 3612A)) Used to perform different actions on the wake screen, such as scrolling the content on the wake screen (eg, 3610A-3610E). In some examples, parameters for where the touch gesture input should start are relaxed for the credential input user interface (eg, 3620 ). Relaxing parameters in the credential input user interface for where touch gesture input should start improves the operability of the device by allowing less precise gestures to initiate biometric authentication. The parameters are relaxed because the user has already communicated a desire to initiate biometric authentication. Consequently, in the credential input user interface, there is less risk that the user does not intend to initiate biometric authentication. Allowing a less precise gesture to initiate biometric authentication after the user has already communicated a desire to initiate biometric authentication improves the operability of the device and makes the user-device interface more efficient, which additionally has limited operation By limiting their performance, the device's power usage is reduced and battery life is improved.

In some examples, in response to receiving a touch gesture input (eg, 3614C-3614E) comprising movement of a contact on the touch-sensitive display starting from a location remote from an edge of the touch-sensitive display and one or more biometric sensors that biometric information captured using ) according to the determination, the electronic device transitions from the locked state to the unlocked state ( 3718 ). In some examples, transitioning the electronic device to an unlocked state includes an unlocked user interface (eg, a user interface that indicates an unlocked state, such as a home screen (eg, 3628 ) or a most recently used application). including displaying

In some examples, prior to displaying the credential input user interface, the electronic device (eg, 100 , 300 , 500 , 3600 ) displays a lock user interface (eg, 3606 ) (eg, 3606 ) on the touch-sensitive display (eg, 3602 ). A user interface, a wake screen, a lock screen) indicating the locked state of the electronic device is displayed. In some examples, the lock user interface is different from the credential input user interface (eg, 3620 ). In some examples, while displaying the lock user interface, the electronic device receives, via the touch-sensitive display (eg, 3602 ), a touch gesture input (eg, 3614A, 3614B) (eg, an upward swipe) having an initiation position. do. In response to receiving the touch gesture input having the starting position and in accordance with a determination that the fourth set of one or more criteria are met, the fourth set of one or more criteria is that the starting position of the touch gesture input is substantially the touch-sensitive display including the requirement that the electronic device be located near the edge of (eg, within a predefined area (eg, 3612A), within a predefined distance from the edge; closer to the edge than the center of the display), the electronic device is biometric authentication to start In some examples, the one or more criteria of the fourth set include only one criterion. In some examples, initiating biometric authentication includes attempting to biometrically authenticate a user of the electronic device based on biometric information captured using one or more biometric sensors. In some examples, in response to receiving the touch gesture input having the starting position and upon determining that the one or more criteria of the fourth set are not met, the electronic device withholds initiating biometric authentication.

Note that the details of the processes described above with respect to method 3700 (eg, FIGS. 37A and 37B ) are also applicable in a similar manner to the methods described below. For example, method 3900 , method 4100 , and/or method 4300 optionally includes one or more of the features of the various methods described above with respect to method 3700 . For example, the processes for retrying biometric authentication, as described above with respect to method 3700 , may include biometric authentication to authorize payment for goods, as described with respect to method 4100 . It can be used to retry. Similarly, a process for retrying biometric authentication may be used to retry biometric authentication in the processes described with respect to method 3900 . For the sake of brevity, these details are not repeated below.

38A-38A illustrate example user interfaces for providing indications of error conditions during biometric authentication, in accordance with some examples. The user interfaces of these figures are used to illustrate the processes described below, including those of FIGS. 39A and 39B .

38A illustrates an electronic device 3800 (eg, portable multifunction device 100 , device 300 , device 500 ). In the illustrative examples illustrated in FIGS. 38A-38A , the electronic device 3800 is a smartphone. In other examples, the electronic device 3600 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 3600 includes a display 3802 , one or more input devices (eg, a touchscreen of the display 3802 , a button 3804 , and a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 38A , the electronic device includes a biometric sensor 3803 . In some examples, the biometric sensor is one or more biometric sensors that may include a camera such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 3803 is biometric sensor 703 . In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 38A , the user learns from notification 3808 that she has received a message from John Appleseed. The user wants to view the restricted content of the notification 3808 (eg, a message from John Appleseed), but cannot do so because the electronic device 3800 is currently in a locked state. The electronic device 3800 displays a locked state user interface (UI) with a lock icon 3806 that provides an indication that the electronic device 3800 is in a locked state. Viewing the restricted content of notification 3808 indicates that successful authentication (eg, information (or data) regarding a biometric characteristic obtained using biometric sensor 3803 corresponds to stored authorized credentials (or matching). to decide) is required. To view the limited content of the notification 3808 , the user lifts (or raises) the electronic device 3800 (eg, from a substantially horizontal orientation to an orientation of the device as shown in the user's hand in FIG. 38A ). Electronic device 3800 detects a change in orientation of electronic device 3800 and, in response, initiates biometric authentication. In some examples, after initiating biometric authentication, electronic device 3800 determines that biometric authentication is successful. In some examples, upon determining that the biometric authentication is successful, the electronic device 3800 transitions from the locked state to the unlocked state, and displays the restricted content of the notification 3808 .

After initiating biometric authentication (eg, prior to successful authentication), electronic device 3800 determines whether a face is detected by biometric sensor 3803 . In FIG. 38B , upon determining that a face is detected, the electronic device 3803 displays an authentication glyph 3810 comprising a plurality of rings rotating in a sphere. Authentication glyph 3810 provides an indication that biometric authentication is being performed. In some examples, electronic device 3800 displays an animation of lock icon 3806 morphing to authentication glyph 3810 . In some examples, upon determining that no face is detected using biometric sensor 3803 , electronic device 3803 remains locked and does not display authentication glyph 3810 .

After detecting the presence of the face, the electronic device 3800 determines that the authentication was unsuccessful due to a failure to obtain sufficient information about the user's face using the biometric sensor 3803 . Specifically, as shown by FIG. 38B , the biometric sensor 3803 is positioned outside the allowable distance range 3812 (eg, beyond a maximum threshold range) to obtain sufficient information about the user's face. cause failure Upon determining that the biometric authentication was unsuccessful because the user's face is outside the allowable distance range 3812 , the electronic device 3800 keeps the device locked and does not display the restricted content of the notification 3808 . does not In some examples, the electronic device 3800, upon determining that the authentication is unsuccessful and an error condition does not exist, holds the device in a locked state and does not display the restricted content of the notification 3808 . In some examples, authentication is not successful (eg, due to the captured biometric information not matching an authorized biometric information profile (eg, stored authorized credentials)) and an error condition does not exist (eg, Upon determining that there are no conditions preventing capture of sufficient biometric information), the electronic device 3800 remains locked and automatically re-attempts the biometric authentication. In some examples, while retrying the biometric authentication, the electronic device 3800 continues to display the authentication glyph 3810 in FIG. 38B .

As shown in FIGS. 38C-38G , upon determining that the biometric authentication was unsuccessful because the user's face is outside the acceptable distance range 3812 , the electronic device 3800 displays an error indication 3814A displays an animation of the authentication glyph 3810 morphed to an error indication 3814A to replace the display of the authentication glyph 3810 . In FIG. 38G , electronic device 3800 displays error indication 3814A, which prompts the user to take action to correct the error condition underlying error indication 3814A. Specifically, the error indication 3814A prompts the user to move her face closer to the biometric sensor 3803 . The error indication 3814A also suggests to the user that the user's face is too far from the biometric sensor 3803 , which is the cause of the error indication 3814A. As long as the user's face is outside the allowable distance range 3812 , the electronic device 3800 will continue to determine that the error indication 3814A exists. Upon determining that the error indication 3814A still exists, the electronic device 3800 does not attempt to retry the biometric authentication. Note that the electronic device 3800 displays the error indication 3814A at a location that matches the location of the lock icon 3806 in FIG. 38A . Additionally, the electronic device 3800 may configure the portion of the display 3802 adjacent the biometric sensor 3803 to indicate to the user that the error indication 3814A is associated with (or corresponds to) the biometric sensor 3803 . displays an error indication 3814A on the

After being prompted to correct the error indication 3814A, as shown in FIG. 38H , the user moves her face closer to the biometric sensor 3803 so that the user's face is within an acceptable distance range 3812 , as shown in FIG. 38H . . In FIG. 38H , the electronic device determines that the error indication 3814A is no longer present. Upon determining that the error indication 3814A is no longer present, the electronic device 3800 enables biometric authentication on the device and automatically re-attempts the biometric authentication using the biometric sensor 3803 .

In response to automatically retrying the biometric authentication, the electronic device 3800 causes a shimmer effect (eg, an error) to indicate that the electronic device 3800 is attempting to biometrically authenticate the user again. Display an error indication 3814A having one or more portions of the indication moved left and right to animate the error indication to create the effect that the error indication appears to flash. 38H-38L show animations of error indication 3814A with a shimmer effect. In some examples, instead of displaying the error indication 3814A with a shimmer effect, the electronic device 3800 displays an authentication glyph ( 3810) (eg, replace the display of error indication 3814A with it). Accordingly, in some examples, electronic device 3800 displays an animation of authentication glyph 3814A morphed to lock icon 3806 instead of error indication 3814A morphed to lock icon 3806 .

In FIG. 38L , after retrying biometric authentication, electronic device 3800 successfully biometrically authenticates the user. In response to successful biometric authentication, electronic device 3800 transitions the device from a locked state to an unlocked state. During the transition from the locked state to the unlocked state, the electronic device 3800 displays an animation of an error indication 3814A that morphs to a lock icon 3806 , as shown in FIGS. 38L-N . After displaying the animation of the error indication 3814A morphing to the lock icon 3806 , the electronic device 3800 displays the lock icon 3806 transitioning to the unlock icon 3816 , as shown in FIGS. 38N and 38O . ) to display the animation. The unlock icon 3816 provides an indication that the electronic device 3800 is in an unlocked state. Additionally, as shown in FIG. 38O , the electronic device 3800 displays the restricted content of the notification 3808 (eg, “Hey, is our meeting still on?”) in response to the biometric authentication being successful.

In FIG. 38P , instead of determining that the user's face is outside the allowable distance range 3812 as discussed above with respect to FIG. 38B , the electronic device 3800 determines that biometric authentication is not available on the device. . Upon determining that biometric authentication is not available, electronic device 3800 displays error indication 3814B in FIG. 38P , which provides an indication that biometric authentication is not currently available on the device. Biometric authentication may be unavailable for a variety of reasons, including that biometric authentication has failed more than a predefined number of times (eg, 5, 10, 15) since the last successful authentication.

Due to the unavailability of biometric authentication, the user must use an alternative method to authenticate the user. For example, the user may authenticate by entering a passcode in the electronic device 3800 . While displaying error indication 3814B in FIG. 38P , electronic device 3800 receives input 3820 in error indication 3814B.

In FIG. 38Q , in response to receiving input 3820 in error indication 3814B, electronic device 3800 displays a passcode input UI having a plurality of input affordances for entering a passcode (or password) ( 3822A).

In some examples, instead of determining that authentication was successful as a result of retrying the biometric authentication, the electronic device 3800 determines that authentication was unsuccessful, as discussed above with respect to FIGS. 38L-38O . In some examples, upon determining that authentication was unsuccessful, the electronic device 3800 remains locked and the lock icon 3806 in FIG. 38R alternates between different positions to simulate a “shake” effect. Display animation. The shake animation provides an indication to the user that the biometric authentication has failed and the electronic device 3800 remains locked.

After determining that authentication was unsuccessful, the user may perform an action at the electronic device 3800 to trigger retrying the biometric authentication. In FIG. 38S , the user triggers retrying the biometric authentication by swiping upwards starting from an area near the lower edge of the display 3802 . The electronic device 3800 receives the input 3824 and, in response, reattempts the biometric authentication. In some examples, after retrying the biometric authentication, the electronic device 3800 determines that the authentication is successful. In some examples, upon determining that authentication is successful as a result of retrying the biometric authentication, the electronic device 3800 transitions from the locked state to the unlocked state.

38S and 38T , the electronic device, in response to input 3824 , determines that authentication was unsuccessful as a result of retrying the biometric authentication. Upon determining that authentication was unsuccessful as a result of retrying the biometric authentication, the electronic device 3800 displays the passcode input UI 3822B in FIG. 38T . As described in connection with the processes in FIG. 37 , the user may retry biometric authentication in passcode input UI 3822B again by performing an upward swipe (eg, input 3826 ). (Passcode input UI 3822B includes some or all of the features of passcode input UI 3620, including relaxed parameters for where an upward swipe should begin to initiate biometric authentication. .)

In FIG. 38U , the electronic device determines that the authentication is successful as a result of retrying the biometric authentication in the passcode input UI 3822B. Upon determining that authentication is successful, the electronic device transitions from the locked state to the unlocked state, as shown in FIGS. 38U-38W . In some examples, in FIG. 38U , the electronic device determines that authentication is not successful as a result of retrying the biometric authentication in passcode input UI 3822B. In some examples, upon making this determination, the electronic device remains locked.

38X-38A illustrate various error conditions that electronic device 3800 may detect while attempting to biometrically authenticate a user. Instead of displaying error indication 3814A as described above with respect to FIG. 38G , electronic device 3800 displays any one of the error indications described below (eg, error indication 3814C-3814I). can do. 38X-38A also indicate that the electronic device 3800 takes action to correct the detected error condition so that it can retry biometrically authenticating the user (eg, error indications 3814C-3814I). ) shows an electronic device 3800 coaching a user.

In FIG. 38X , the user's face is positioned too close to the biometric sensor 3803 . Consequently, the electronic device 3800 determines that the user's face is positioned outside the allowable distance range 3812 (eg, below the minimum threshold range). Upon determining that the user's face is positioned outside the allowable distance range 3812 , the electronic device 3800 displays an error indication 3814C, which tells the user that her face is positioned further away from the biometric sensor 3803 . Prompt to move. Error indication 3814C also provides an indication of the cause of the error condition (eg, an indication that the user's face is too close to biometric sensor 3803 ).

In FIG. 38Y , the user's hand is covering the biometric sensor 3803 . Consequently, the electronic device 3800 determines that the object (eg, the user's hand) is covering the biometric sensor 3803 such that the sensor cannot obtain any information about the user's face. Upon determining that the object is covering the biometric sensor 3803 , the electronic device 3800 displays an error indication 3814D, which prompts the user to move her hand away from the biometric sensor 3803 . do. Error indication 3814D also provides an indication of the cause of the error condition (eg, an indication that biometric sensor 3803 is covered).

In FIG. 38Z , the user is not looking at the electronic device 3800 . Consequently, the electronic device 3800 determines that the user's eyes are not looking at the device. Upon determining that the user's eyes are not looking at the device, the electronic device 3800 displays an error indication 3814E, which prompts the user to view the device to correct the error condition. Error indication 3814E also provides an indication of the cause of the error condition (eg, an indication that the user is not viewing the device).

In FIG. 38AA , the user's face is within field of view 3828 , but the user is wearing a hat. As a result, the electronic device 3800 determines that a portion of the user's face is hidden (or obscured). For example, the electronic device 3800 obtains partial information about the user's face using the biometric sensor 3803 , where the partial information is less than a threshold amount needed for comparison with stored authorized credentials. Upon determining that a portion of the user's cavern is hidden, the electronic device 3800 displays an error indication 3814F, which prompts the user to remove the hat. Error indication 3814F also provides an indication of the cause of the error condition (eg, an indication that a portion of the user's face is hidden).

In FIG. 38A , the user's face is outside the field of view 3828 of the biometric sensor 3803 . Consequently, the electronic device 3800 determines that the user's face is outside the field of view 3828 of the biometric sensor 3803 . In some examples, the user's face is out of view 3828 when more than a threshold portion of the face is out of view. In some examples, the user's face is outside the field of view 3828 when no face is detected within the field of view. Upon determining that the user's face is outside the field of view 3828 , the electronic device 3800 displays an error indication 3814G, which prompts the user to move her face into the field of view 3828 . Error indication 3814G also provides an indication of the cause of the error condition (eg, indication 3814G that the user's face is out of view).

In FIG. 38A , the user's face is within field of view 3828 , but turned away from biometric sensor 3803 . Consequently, the electronic device 3800 determines that the user's face is turned away from the biometric sensor 3803 . Upon determining that the user's face is turned away from the biometric sensor 3803 , the electronic device 3800 displays an error indication 3814H, which prompts the user to turn her face toward the sensor. Error indication 3814H also provides an indication of the cause of the error condition (eg, an indication that the user's face is turned away from biometric sensor 3803 ).

In FIG. 38Ad , the user's face is positioned approximately within an acceptable distance range of the field of view and biometric sensor 3803 . However, the lighting conditions of the environment in which the user is located are not suitable for performing biometric authentication. Specifically, the amount of light is too large, which prevents it from performing biometric authentication. Consequently, the electronic device 3800 determines (eg, via one or more ambient light sensors) that the amount of light exceeds a predefined threshold. Upon determining that the amount of light exceeds the threshold, the electronic device 3800 displays an error indication 3814I, which prompts the user to look for improved lighting conditions with a lower amount of light. Error indication 3814I also provides an indication of the cause of the error condition (eg, an indication that the light conditions are not suitable for performing biometric authentication).

39A and 39B are flow diagrams illustrating a method for providing indications of error conditions during biometric authentication, in accordance with some examples. The method 3900 includes an electronic device (e.g., 100, 300, 500, 3800). In some examples, the electronic device includes one or more biometric sensors (eg, a fingerprint sensor, a non-contact biometric sensor (eg, a biometric sensor that does not require physical contact, such as a thermal or optical facial recognition sensor), an iris scanner). include In some examples, the one or more biometric sensors include one or more cameras. Some operations of the method 3900 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 3900 provides an intuitive method for providing indications of error conditions during biometric authentication. This method reduces the cognitive burden on the user for performing biometric authentication, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to perform biometric authentication faster and more efficiently saves power and increases the time between battery charges.

An electronic device (eg, 100 , 300 , 500 , 3800 ) authenticates (eg, biometric authentication) via one or more input devices (eg, an accelerometer (eg, 168 , a touchscreen of a display (eg, 3802 )). Receives a request to perform an operation requesting (3902). In some examples, the request to perform an action that requires authentication includes a request to unlock the device (eg, swipe at a predefined location). In some examples, the request is triggered by lifting the device from a substantially horizontal position.

In response to a request to perform an operation requiring authentication (eg, biometric authentication) ( 3904 ) and in accordance with a determination that the authentication (eg, biometric authentication) is successful, the electronic device performs an operation ( 3906 ). In some examples, user input (eg, data obtained from one or more biometric sensors corresponding to a biometric feature (eg, face, finger) of the user, a passcode) is applied to a credential (eg, an enrolled fingerprint) , face, or passcode) corresponds to (eg, matches) authentication is successful. In some examples, the user input corresponds to the authorized credential when the user input matches the authorized credential.

In response to a request to perform 3904 an operation that requires authentication (eg, biometric authentication) and that authentication (eg, biometric authentication) is not successful and a set of error condition criteria is met (eg, an error condition exists) In accordance with the determination 3908 , the electronic device (eg, 100 , 300 , 500 , 3800 ) displays an indication of an error condition (eg, of a set of error condition criteria) on a display (eg, 3802 ) (eg, 3814A through 3814I) and (3916) suspend performing the operation (3916). The indication includes information regarding the cause of the error condition (3912). In some examples, user input (eg, data obtained from one or more biometric sensors corresponding to a biometric feature (eg, face, finger) of the user, a passcode) is applied to a credential (eg, an enrolled fingerprint) , face, or passcode), authentication is not successful. In some examples, the user input does not correspond to the authorized credential when the user input does not match the authorized credential. In some examples, the set of error condition criteria includes only one criterion. Displaying the indication of the error condition provides feedback to the user regarding the current state of the device (eg, the error condition is preventing successful biometric authentication) and allows the user to take further action to correct the error condition. prompt that Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In addition, suspending performing an action when biometric authentication has failed and an error condition is detected improves security and in the case of multiple resource-intensive retries of biometric authentication that are likely to fail due to an error condition reduce them Providing improved security improves the operability of the device (eg, by limiting unauthorized access) and makes the user-device interface more efficient, which additionally limits the performance of restricted operations to the power of the device. Reduce usage and improve battery life.

In some examples, in response to a request to perform an operation requiring authentication ( 3904 ) and in accordance with a determination that authentication (eg, biometric authentication) is not successful and that the set of error condition criteria is not met ( 3926 ), the electronic device (eg, 100, 300, 500, 3800) withholds displaying ( 3928 ) an indication of the error condition on the display (eg, 3802 ), and withholds performing the action ( 3930 ).

In some examples, the indication of the error condition (eg, 3814A-3814I) is an indication (eg, a visual indication (eg, graphical or textual) of a user action that may be performed to correct the error condition (eg, for a subsequent authentication attempt). )) (3914). In some examples, the indication of the user action indicates how to correct the error condition for a subsequent authentication attempt. Displaying an indication of a user action that can be performed to correct the error condition provides the user with feedback on what course of action to take so that the user can be biometrically authenticated in a subsequent authentication attempt. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, no indicator is displayed during biometric authentication.

In some examples, the indication of the error condition (eg, 3814A-3814I) includes information regarding the cause of the error condition (eg, an indication, visual indication (eg, graphic or text) of a user action and/or device condition). Displaying an indication of the cause of the error condition provides feedback to the user as to what course of action to take so that the user can be biometrically authenticated in a subsequent authentication attempt. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, no indicator is displayed during biometric authentication.

In some examples, the set of error condition criteria indicates that a biometric feature (eg, fingerprint, face) of a first type (eg, a type corresponding to applied biometric features) is one or more biometric sensors of the electronic device. (eg, 3803) to be met when detected. In some examples, an indication of an error condition (eg, 3814A-3814I) is not displayed if a potentially valid biometric feature was not detected (eg, indicating that the user is not currently associated with the device). Withholding to display an indication of an error condition when no biometric features are detected is potentially confusing to the user, as it is unlikely that the user would have intended to perform biometric authentication if no biometric features were detected. to prevent causing Thus, withholding displaying an indication in such a scenario makes the user-device interface more efficient (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) This additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, upon determining that the authentication (eg, biometric authentication) is successful, the electronic device (eg, 100 , 300 , 500 , 3800 ) displays an indication of an error condition (eg, 3814A through 3802 ) on a display (eg, 3802 ) 3814I) is suspended.

In some examples, subsequent to displaying an indication of an error condition (eg, 3814A-3814I) and upon determining that the set of error condition criteria continues to be met, the electronic device (eg, 100, 300, 500, 3800): , withholds (and optionally, disables further attempts in biometric authentication) from attempting biometric authentication on the electronic device (eg, the biometric authentication function operates on the device while a set of error conditions are met) not available) (3918). In some examples, subsequent to displaying the indication of the error condition and upon determining that the set of error condition criteria is no longer met, the electronic device enables retrying the biometric authentication on the electronic device (eg, The error condition no longer exists (eg, it has been corrected (eg, due to the user taking an action to correct the error condition)) 3922 . Automatically retrying biometric authentication when a set of error condition criteria is no longer met allows a user to quickly attempt to biometrically authenticate themselves without requiring the user to explicitly request biometric authentication. do. Performing an optimized operation when a set of conditions are met without requiring additional user input (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) ) improves the operability of the device and makes the user-device interface more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, subsequent to displaying the indication of the error condition and in response to determining that the set of error condition criteria is no longer met, the electronic device reattempts authentication (eg, biometric authentication) (eg, authentication) retries automatically) (3924). In some examples, retrying authentication includes attempting to match biometric information obtained by one or more biometric sensors with authorized credentials (eg, stored data that was authorized for use in biometric authentication). include that In some examples, determining that the error condition is not met occurs subsequent to (eg, in response to) receiving the input to correct the error condition. In some examples, retrying the authentication occurs (or only occurs) in accordance with a determination that the error condition is not met due to detecting user input that causes the error condition to not be met.

In some examples, subsequent to determining that the set of error condition criteria is no longer met (eg, detecting that the error condition has been corrected), the electronic device (eg, 100 , 300 , 500 , 3800 ) sends one or more input The devices receive an input (eg, 3824 , 3826 ) corresponding to a request to retry authentication. In some examples, the input is a touch gesture input (eg, tap, swipe (eg, upward swipe)) or activation of a hardware button (eg, power button). In some examples, in response to receiving an input corresponding to a request to retry authentication, the electronic device retryes (eg, automatically retrys authentication) authentication (eg, biometric authentication). In some examples, retrying authentication includes attempting to match biometric information obtained by one or more biometric sensors with authorized credentials (eg, stored data that was authorized for use in biometric authentication). include that In some examples, retrying authentication includes obtaining data of a biometric feature (eg, face, fingerprint) of the user using one or more biometric sensors.

In some examples, displaying the indication of the error condition (eg, 3814A-3814I) includes an animation (eg, shimmering) indicating that an attempt to authenticate is in progress. In some examples, attempting to authenticate includes attempting to detect biometric information using one or more biometric sensors. Displaying a shimmering animation indicating that an authentication attempt is in progress provides the user with feedback about the current state of the device and that no further action is required at this time. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, no indicator is displayed during biometric authentication.

In some examples, subsequent to (or in response to) receiving a request to perform an action requiring authentication and prior to displaying an indication of an error condition (eg, 3814A-3814I), the electronic device (eg, 100, 300) , 500, 3800) perform authentication. In some examples, while performing authentication, electronic device 3800 is displayed on a display (eg, 3802 ) where the electronic device accesses a biometric feature using one or more biometric sensors (eg, 3803 ) of the electronic device. A first indication (e.g., 3810, 3814A-3814I) that information regarding is displayed. In some examples, displaying the indication of the error condition includes replacing the display of the first indication with a display of the indication of the error condition. Displaying an indication that biometric authentication is occurring provides the user with feedback regarding the current state of the device (eg, biometric authentication is being performed) and that the user does not need to take any action at this time. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, while performing authentication, the electronic device (eg, 100, 300, 500, 3800) displays on the display (eg, 3802) a first lock icon (eg, 3806) (eg, a locked state of the electronic device) and a first animation transitioning from the first lock icon to the first display. In some examples, subsequent to displaying the indication of the error condition (eg, and upon determining that authentication is successful) and subsequent to displaying the first animation, the electronic device displays an error on a display (eg, 3802 ). Display a second animation transitioning from the indication of the condition to an unlock icon (eg, 3816 ) (eg, an icon indicating a locked state of the electronic device). In some examples, the first animation and the second animation represent morphing from one object to the next. In some examples, the second animation includes displaying the first lock icon subsequent to the indication of the error condition and prior to the unlock icon.

In some examples, subsequent to displaying the indication of the error condition, the electronic device is displayed on the display (eg, 3802 ) from the indication of the error condition to a second lock icon (eg, 3806 ), or when the electronic device a second lock icon (e.g., from a second indication (e.g., 3810, 3814A-3814I) (e.g., rings rotating about a sphere) that one or more biometric sensors are being used to obtain information regarding the biometric feature Displays an animation transitioning to an icon representing the locked state of the electronic device). In some examples, the second lock icon is a first lock icon. In some examples, the second indication is the first indication.

In some examples, while retrying authentication and subsequent to displaying the indication of the error condition and upon determining that there is no error condition, the electronic device is configured to display on the display, the electronic device using one or more biometric sensors of the electronic device. a third indication (e.g., 3810, 3814A-3814I) (e.g., rings rotating about a sphere, shimmering user interface objects, wherein the user interface object is an error condition) display). In some examples, the third indication is the first indication.

In some examples, prior to displaying the indication of the error condition, the electronic device (eg, 100 , 300 , 500 , 3800 ) displays on the display (eg, 3802 ) a third lock icon (eg, 3806 ) at a location on the display (eg, 3806 ) ) (eg, an icon indicating a locked state of the electronic device). In some examples, the indication of the error condition (eg, 3814A-3814I) is displayed proximate to (eg, near, adjacent to, at, within a predetermined distance from) the location on the display. In some examples, the third lock icon is a first lock icon and/or a second lock icon.

In some examples, when the electronic device is in a locked state while receiving a request to perform an operation requiring authentication and upon determining that authentication is successful, the electronic device (eg, 100 , 300 , 500 , 3800 ) is placed in a locked state transitions from to the unlocked state. In some examples, the action that requires authentication is transitioning the electronic device from a locked state to an unlocked state. In some examples, when the electronic device is in a locked state while receiving a request to perform an operation requiring authentication and upon determining that authentication is not successful, the electronic device remains locked. Keeping the device locked when authentication is unsuccessful improves device security by preventing unauthorized and/or unauthorized access to the device. Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life.

In some examples, the electronic device (eg, 100 , 300 , 500 , 3800 ) is locked when the electronic device is in a locked state while receiving a request to perform an operation requiring authentication and upon determining that authentication is not successful. Maintain state and retry authentication (eg, biometric authentication) (eg, automatically retry authentication). In some examples, retrying authentication includes attempting to obtain information regarding a biometric feature (eg, face, fingerprint) using one or more biometric sensors of the electronic device. In some examples, retrying authentication includes attempting to match biometric information obtained by one or more biometric sensors with authorized credentials (eg, stored data that was authorized for use in biometric authentication). include that In some examples, after retrying authentication and upon a determination that authentication resulting from retrying authentication is successful, the electronic device transitions from the locked state to the unlocked state. In some examples, after retrying authentication and upon a determination that authentication resulting from retrying authentication is not successful, the electronic device remains locked.

In some examples, subsequent to (or in response to) receiving a request to perform an action requiring authentication, the electronic device (eg, 100, 300, 500, 3800) attempts authentication (eg, biometric authentication). do. In some examples, while attempting authentication, the electronic device displays on a display (eg, 3802 ) information regarding a biometric feature (eg, face, fingerprint) for which the electronic device uses one or more biometric sensors of the electronic device. Display a third indication (eg, 3810, 3814A-3814I) (eg, rings rotating about a sphere) that it is acquiring In some examples, the indication is a scanning animation. In some examples, the third indication is the first indication and/or the second indication. In some examples, while retrying authentication, the electronic device maintains display of the third indication on a display (eg, 3802 ).

In some examples, upon a determination that authentication resulting from retrying authentication is unsuccessful, the electronic device displays on a display (eg, 3802 ) a lock icon (eg, alternating between a first position and a second position) 3806) (eg, an icon indicating a locked state of the electronic device), wherein the second location is different from the first location. In some examples, the animation with the lock icon is an animation of the lock icon that shakes (eg, rotates side to side, back and forth). In some examples, the electronic device displays an animation accompanying the lock icon to indicate that the biometric authentication has failed. In some examples, a tactile output is provided in combination with a shaking lock icon. In some examples, no tactile output is provided. In some examples, upon determining that the biometric information captured using the one or more biometric sensors does not correspond or match the authorization credentials, the electronic device (eg, 100 , 300 , 500 , 3800 ) keep locked. Displaying the animation of the shaking lock icon provides feedback to the user regarding the current state of the device (eg, biometric authentication has failed) and prompts the user to take further action. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (eg, 100, 300, 500, 3800) includes a biometric sensor (eg, 3803), and the set of error condition criteria includes one or more of the following error condition criteria:

생체측정 센서로부터의 생체측정 특징부의 거리는 제1 미리결정된 임계 거리를 초과하거나(예컨대, 생체측정 특징부(예컨대, 얼굴)가 생체측정 센서로부터 너무 멀리 있음) 또는 거리 범위(예컨대, 3812)의 최대치를 초과한다. 일부 예들에서, 제1 미리결정된 임계치 또는 거리 범위의 최대치를 초과하는 것은, 생체측정 센서에 의해 획득된 생체측정 특징부에 관한 정보의 감소된 정확도 또는 열화와 높은 상관 관계가 있다. 일부 예들에서, 사용자는 사용자의 얼굴을 생체측정 센서에 더 가깝게 이동시킴으로써 이러한 에러 조건을 보정할 수 있다.

The distance of the biometric feature from the biometric sensor exceeds a first predetermined threshold distance (eg, the biometric feature (eg, face) is too far from the biometric sensor) or a maximum of a range of distance (eg, 3812 ) exceed In some examples, exceeding the first predetermined threshold or maximum of the distance range is highly correlated with reduced accuracy or degradation of information about the biometric feature obtained by the biometric sensor. In some examples, the user may correct this error condition by moving the user's face closer to the biometric sensor.

생체측정 센서로부터의 생체측정 특징부의 거리는 제2 미리결정된 임계 거리 미만이거나(예컨대, 생체측정 특징부(예컨대, 얼굴)가 생체측정 센서에 너무 가까이 있음) 또는 거리 범위(예컨대, 3812)의 최소치 미만으로 떨어진다. 일부 예들에서, 제2 미리결정된 임계치 또는 거리 범위의 최소치 미만으로 떨어지는 것은, 생체측정 센서에 의해 획득된 생체측정 특징부에 관한 정보의 감소된 정확도 또는 열화와 높은 상관 관계가 있다. 일부 예들에서, 사용자는 사용자의 얼굴을 생체측정 센서로부터 더 멀리 이동시킴으로써 이러한 에러 조건을 보정할 수 있다.

The distance of the biometric feature from the biometric sensor is less than a second predetermined threshold distance (eg, the biometric feature (eg, face) is too close to the biometric sensor) or less than a minimum of a distance range (eg, 3812 ). falls to In some examples, falling below the second predetermined threshold or minimum of the distance range is highly correlated with reduced accuracy or degradation of information about the biometric feature obtained by the biometric sensor. In some examples, the user may correct this error condition by moving the user's face further away from the biometric sensor.

생체측정 센서(예컨대, 3803)는 가려져(예컨대, 부분적으로 가려져, 완전히 가려져, 센서의 동작을 억제하기에 충분한 정도로 가려져) 있다(예컨대, 전자 디바이스와 상호작용하는 동안, 사용자의 일부분(예컨대, 손)에 의해 가려짐). 일부 예들에서, 사용자는 사용자의 손을 생체측정 센서로부터 멀리 이동시킴으로써 이러한 에러 조건을 보정할 수 있다.

A biometric sensor (eg, 3803 ) is obscured (eg, partially obscured, fully obscured, obscured to an extent sufficient to inhibit operation of the sensor) (eg, a portion of a user (eg, a hand) while interacting with an electronic device. ) obscured by). In some examples, the user may correct this error condition by moving the user's hand away from the biometric sensor.

검출된 생체측정 특징부의 하위부분(예컨대, 검출된 얼굴의 눈)이 생체측정 센서를 향해 배향되어 있지 않다(예컨대, 하나 이상의 눈이 전자 디바이스(예컨대, 생체측정 센서)에 초점을 맞추고 있지 않다). 일부 예들에서, 사용자는 사용자가 눈을 뜨거나 전자 디바이스(예컨대, 생체측정 센서)를 바라봄으로써 이러한 에러 조건을 보정할 수 있다.

The subportion of the detected biometric feature (eg, the eyes of the detected face) is not oriented towards the biometric sensor (eg, one or more eyes are not focused on the electronic device (eg, the biometric sensor)) . In some examples, the user may correct this error condition by opening the user's eyes or looking at the electronic device (eg, biometric sensor).

검출된 생체측정 특징부의 적어도 일부분이 가려져(예컨대, 부분적으로 가려져, 완전히 가려져, 생체측정 특징부에 관한 불완전한 정보를 야기하기에 충분한 정도로 가려져) 있다. 일부 예들에서, 사용자는, 사용자의 얼굴을 차단하고 있는 액세서리(예컨대, 선글라스) 또는 의류(예컨대, 스카프, 모자)를 제거함으로써 이러한 에러 조건을 보정할 수 있다.

At least a portion of the detected biometric feature is occluded (eg, partially occluded, completely occluded, occluded to a degree sufficient to result in incomplete information regarding the biometric feature). In some examples, the user may correct this error condition by removing an accessory (eg, sunglasses) or clothing (eg, scarf, hat) that is blocking the user's face.

어떠한 생체측정 특징부도 생체측정 센서의 시야(예컨대, 3828) 내에서 검출되지 않는다.

No biometric features are detected within the field of view (eg, 3828 ) of the biometric sensor.

검출된 생체측정 특징부의 포즈(pose)(예컨대, 생체측정 센서와 관련한 배향)가 임계 범위를 초과한다(예컨대, 생체측정 특징부(예컨대, 얼굴)가 생체측정 센서로부터 멀리 돌려져 있다). 일부 예들에서, 임계 범위를 초과하는 것은, 생체측정 센서에 의해 획득된 생체측정 특징부에 관한 정보의 감소된 정확도 또는 열화와 높은 상관 관계가 있다. 일부 예들에서, 사용자는 사용자의 얼굴을 전자 디바이스(예컨대, 생체측정 센서)를 향해 돌림으로써 이러한 에러 조건을 보정할 수 있다.

The pose of the detected biometric feature (eg, orientation with respect to the biometric sensor) exceeds a threshold range (eg, the biometric feature (eg, face) is turned away from the biometric sensor). In some examples, exceeding the threshold range is highly correlated with reduced accuracy or degradation of information about the biometric feature obtained by the biometric sensor. In some examples, the user may correct this error condition by turning the user's face towards the electronic device (eg, biometric sensor).

전자 디바이스는 (예컨대, 하나 이상의 주변 광 센서들을 통해) 미리결정된 광 임계치를 초과하는 광량(예컨대, 주변 광)을 검출한다(예컨대, 미리결정된 광 임계치를 초과하는 것은 생체측정 센서에 의해 획득된 생체측정 특징부에 관한 정보의 감소된 정확도 또는 열화와 높은 상관 관계가 있다). 일부 예들에서, 사용자는, 태양을 향해 사용자의 등을 돌려서 전자 디바이스에 의해 검출된 광량을 줄이거나 또는 더 적은 주변 광을 갖는 새로운 위치(예컨대, 실내)로 이동함으로써 이러한 에러 조건을 보정할 수 있다.

The electronic device detects (eg, via one or more ambient light sensors) an amount of light (eg, ambient light) that exceeds a predetermined light threshold (eg, exceeding the predetermined light threshold is a biometric obtained by the biometric sensor). highly correlated with reduced accuracy or degradation of information about the measurement features). In some examples, the user may correct this error condition by turning the user's back toward the sun to reduce the amount of light detected by the electronic device or by moving to a new location (eg, indoors) with less ambient light. .

In some examples, the set of error condition criteria may be a first subset of the error conditions listed above. For example, the first subset may indicate that a distance of the biometric feature exceeds a first predetermined threshold distance, that a distance of the biometric feature is less than a second predetermined threshold distance, that the biometric feature is a biometric sensor one or more error condition criteria selected from the group consisting of being out of view of, and the pose of the biometric feature exceeds a threshold range. The first subset focuses on guiding the user to correct error conditions involving orientation and/or positioning of the face. As a further example, the second subset may include one or more error condition criteria selected from the group consisting of that the biometric sensor is obscured, and that no biometric features are detected within the field of view of the biometric sensor. The second subset focuses on guiding the user to correct error conditions in which the biometric sensor cannot obtain any information about the user's biometric features. For another example, the third subset can include one or more error condition criteria selected from the group consisting of a pose of the detected biometric feature exceeds a threshold range and that the biometric sensor is obscured. A third subset focuses on error conditions that are likely to occur for devices of a given form factor/size (eg, a tablet device (eg, an iPad)).

In some examples, an electronic device (eg, 100 , 300 , 500 , 3800 ) includes a biometric sensor (eg, 3803 ) in a portion (eg, location) (eg, a portion that is not on a display) of the electronic device. In some examples, in response to a request to perform an action requiring authentication, the electronic device is placed on a display (eg, 3802 ) proximate to (eg, adjacent to, proximate to, at a predetermined distance from, a portion of the electronic device) within), display a progress indicator (eg, 3814A-3814I) including an indication of an error condition. Displaying a progress indicator near the biometric sensor provides the user with feedback about the association of the biometric sensor with processes occurring in the device (eg, attempted authentication). Specifically, the user notices the biometric sensor during biometric authentication, such that the user is less likely to perform an action that interferes with the biometric sensor, or alternatively, the user is prompted to take a corrective action. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the indication of the error condition (eg, 3814B) includes an indication that biometric authentication is not currently enabled on the electronic device in accordance with a determination that biometric authentication is not currently enabled on the electronic device. In some examples, biometric authentication may be disabled (or not enabled on the electronic device) when one or more of the following conditions are met: The electronic device is successfully turned on or being restarted. not certified; The electronic device has not been unlocked for more than a predetermined time (eg, 48 hours); the passcode was not used to unlock the device for more than a predetermined time (eg, 156 hours); no biometric authentication using a biometric feature (eg, face, fingerprint) was used to unlock the device for more than a predetermined time (eg, 4 hours); The electronic device has received a remote lock command; biometric authentication has failed more than a predetermined number of times (eg, 5, 10, 15) since the last successful authentication with the device; The electronic device has received a power off and/or emergency SOS command; Then, an explicit request by the user to disable biometric authentication was detected. Displaying an indication that biometric authentication is not currently enabled provides the user with feedback of the current state of the device and prompts the user to seek alternative methods to authenticate themselves. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the indication that biometric authentication is not currently enabled includes an affordance (eg, 3814B) (eg, the indication is affordance). In some examples, the electronic device (eg, 100 , 300 , 500 , 3800 ) receives an input corresponding to an affordance (eg, 3820 ), and in response to receiving an input corresponding to the affordance, the electronic device (eg, 100 ) , 300 , 500 , 3800 displays, on a display (eg, 3802 ), a credential input user interface (eg, 3822A) having a plurality of character input keys. In some examples, the credential input user interface includes a virtual keypad or a virtual keyboard. In some examples, the virtual keypad or virtual keyboard includes a plurality of character input keys.

In some examples, the electronic device (eg, 100 , 300 , 500 , 3800 ) detects a condition that triggers an attempt to authenticate (eg, biometric authentication). In some examples, the request to perform an action that requires authentication includes a request to unlock the device (eg, swipe at a predefined location). In some examples, in response to detecting a condition that triggers attempting authentication (eg, biometric authentication) and while the condition is available for detection by the one or more biometric sensors ( For example, a face is detected in the field of view of one or more face detection sensors, such as a depth camera) an alert generated by the device (eg, 3808) without user input to the device (eg, based on satisfaction of criteria other than detection of the user input) ), the electronic device generates a fifth indication (eg, 3810 ) that the electronic device is obtaining information regarding the biometric feature using one or more biometric sensors of the electronic device (eg, the sphere rings that rotate around the center). In some examples, the condition is such that the biometric feature is not available for detection by the one or more biometric sensors (eg, no face is detected in the field of view of one or more face detection sensors, such as a depth camera) ( In response to a determination that the electronic device responds to an alert generated by the device without user input to the device (eg, based on satisfaction of criteria other than detection of user input), the electronic device determines that the electronic device uses one or more biometric sensors of the electronic device. to withhold displaying a fifth indication (eg, rings rotating about a sphere) that information regarding the biometric feature is being obtained. In some examples, the condition is a user input to the device (eg, a request not associated with a notification; a touch gesture input (eg, a tap, swipe (eg, 3824) (eg, upward swipe)) or a hardware button (eg, power Upon determining that the electronic device corresponds to a request that is a button) or activation of sensor data indicating movement (eg, lifting) of the device), the electronic device determines that the electronic device uses one or more biometric sensors of the electronic device (eg, and display a fifth indication that the biometric feature is obtaining information about the biometric feature (regardless of whether the biometric feature is available for detection by one or more biometric sensors). Withholding display of an indication when no face is detected avoids potentially confusing the user, as it is unlikely that the user would intend to initiate biometric authentication if no biometric features were detected. . Thus, withholding displaying an indication in such a scenario makes the user-device interface more efficient (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) This additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

Note that the details of the processes described above with respect to method 3900 (eg, FIGS. 39A and 39B ) are also applicable in a similar manner to the methods described below/above. For example, method 3700 , method 4100 , and/or method 4300 optionally includes one or more of the features of the various methods described above with respect to method 3900 . For example, error indications (eg, 3814A - 3814I) as described with respect to method 3900 may be generated during biometric authentication performed in processes described with respect to method 3700 and method 4100 . may be used to provide indications of error conditions. For the sake of brevity, these details are not repeated below.

40A-40U illustrate example user interfaces for providing indications regarding a biometric sensor during biometric authentication, in accordance with some examples. The user interfaces of these figures are used to illustrate the processes described below, including those of FIGS. 41A-41C.

40A illustrates an electronic device 4000 (eg, portable multifunction device 100 , device 300 , device 500 ). In the illustrative examples illustrated in FIGS. 40A-40U , the electronic device 4000 is a tablet computer. In other examples, the electronic device 4000 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). The electronic device 4000 includes a display 4002 , one or more input devices (eg, a touchscreen of the display 4002 , a button 4004 , and a microphone), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 40A , the electronic device includes a biometric sensor 4003 . In some examples, the biometric sensor is one or more biometric sensors that may include a camera such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 4003 is biometric sensor 703 . In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 40A , the user wants to purchase products using payment information stored on the electronic device 4000 . As shown in FIG. 40A , the electronic device 4000 is in a split screen (eg, multitasking) mode. While in the split screen mode, the electronic device 4000 draws an app store user interface (UI) 4006 in the left area 4007 of the display 4002 and a browser UI in the right area 4009 of the display 4002 ( 4008) at the same time. While simultaneously displaying the app store UI 4006 and the browser UI 4008 , the electronic device 4000 receives an input 4010 at a purchase affordance 4012 .

In FIG. 40B , in response to receiving input 4010 in purchase affordance 4012 , electronic device 4000 selects the applications being displayed in left area 4007 and right area 4009 of display 4002 . swap Specifically, the electronic device 4000 displays the browser UI 4008 in the left area 4007 and the app store UI 4006 in the right area 4009 . The electronic device 4000 swaps applications to place the application associated with the merchandise being purchased in an area closer to the biometric sensor 4003 . By placing the browser UI 4008 in the left area 4007 , the electronic device 4000 provides the user with an indication of the location of the biometric sensor 4003 , which prompts the user before authorizing payment to purchase the goods. used to authenticate. As shown in FIG. 40B , swapping applications also places the application associated with the goods being purchased in an area closer to button 4004 . In some examples, when button 4004 and biometric sensor 4003 are not in close proximity (eg, on the same side), electronic device 4000 swaps applications, if necessary, to the product being purchased Place the applications associated with them in an area closer to the biometric sensor 4003 . In some examples, when button 4004 and biometric sensor 4003 are not in close proximity (eg, on the same side), electronic device 4000 swaps applications, if necessary, to the product being purchased Place the applications associated with them in an area closer to the button 4004 .

Additionally, as shown in FIG. 40B , in response to receiving the input 4010 in the purchase affordance 4012 , the electronic device 4000 darkens the browser UI 4008 while the app store UI 4006 ) to a greater degree than that of the browser UI 4008 . By making the browser UI 4008 less dark than the app store UI 4006 , the electronic device 4000 indicates to the user which application is associated with the payment sheet interface 4014 and which products the user wants to purchase.

Moreover, in response to receiving the input 4010 in the purchase affordance 4012 , the electronic device 4000 displays a payment sheet interface 4014 having information regarding the products being purchased, and provides the user with information about the products being purchased. Simultaneously displays a prompt 4016 prompting to double-click the button 4004 to initiate the process for authorizing the payment. Additionally, in response to receiving the input 4010 in the purchase affordance 4012 , the electronic device 4000 displays a dynamic indication 4018 to highlight the location of the button 4004 . While displaying payment sheet interface 4014 , the electronic device receives input 4020 at button 4004 (eg, a double press of button 4004 ). In some examples, prompt 4016 includes some or all of the features of prompt 2416 . In some examples, dynamic representation 4018 includes some or all of the features of dynamic representation 2418 . In some examples, payment sheet interface 1014 includes the name of the application to which it corresponds (eg, the name of the application with which the user initiated the process to authorize payment).

In FIG. 40C , in response to receiving input 4020 at button 4004 , electronic device 4000 initiates a process for authorizing payment for goods. Authorizing payment for goods requires successfully authenticating the user. Consequently, in response to receiving the input 4020 , the electronic device 4000 initiates biometric authentication using the biometric sensor 4003 . After initiating biometric authentication, electronic device 4000 displays face glyph 4022 , which electronic device 4000 is attempting to biometrically authenticate the user (eg, biometric sensor 4003 ). is being used to obtain biometric information about the user). In some examples, face glyph 4022 includes some or all of the features of glyph 2468 of FIG. 24F . In some examples, in response to receiving the input 4020 at the button 4004 , the electronic device causes the face glyph 4022 to be moved from the location of the prompt 4016 to the face glyph 4022 , as shown in FIG. 40C . ) to display the moving animation. In some examples, the animation is such that the face glyph 4022 appears to slide out of the prompt 4016 .

In FIG. 40D , after displaying the face glyph 4022 , the electronic device transitions to displaying the authentication glyph 4024 , where the electronic device 4000 is attempting to biometrically authenticate the user (eg, biometrics). It continues to attempt to obtain the measurement information, attempting to match the obtained information with the stored authorized credentials). Authentication glyph 4024 includes a plurality of rings rotating in a spherical shape. In some examples, authentication glyph 4024 includes some or all of the features of one or more rings 2470 of FIG. 24G .

While displaying the authentication glyph 4024 , the electronic device 4000 detects that an error condition exists (eg, a condition that prevents the biometric sensor 4003 from obtaining sufficient information about the user's face). Specifically, the electronic device 4000 detects that the biometric sensor 4003 is covered by a physical object (eg, a user's hand). In some examples, the electronic device 4000 may obtain sufficient information about the user's face without detecting an error condition. In some examples, after obtaining sufficient information about the user's face, and while displaying the authentication glyph 4024 , the electronic device 4000 determines whether the obtained information satisfies biometric authentication criteria ( For example, determine whether the obtained biometric information matches, within a threshold, a biometric template associated with the user (eg, stored authorized credentials). In some examples, upon determining that biometric authentication is successful (eg, biometric authentication criteria are satisfied), electronic device 4000 transitions to an unlocked state.

In FIG. 40E , in response to detecting that an error condition exists, the electronic device 4000 displays an error indication 4026 at a location at the top of the display 4002 (eg, relative to ground, to the user). ) is displayed. Error indication 4026 provides an indication of a currently existing error condition. Additionally, in response to detecting that an error condition exists, the electronic device 4000 displays an error icon 4028 at a location of the display 4002 adjacent the biometric sensor 4003 , thereby causing the biometric Provides an indication of the location of the sensor 4003 . By providing an indication of the location of the biometric sensor 4003 , the error icon 4028 indicates to the user the cause of the error condition. In some examples, in response to detecting that an error condition exists, the electronic device 4000 displays an error indication 4026 at a location proximate the biometric sensor 4003 . In some examples, the error indication 4026 includes some or all of the features of the error indication 3814A, including a shimmer effect.

40F , further, in response to detecting that an error condition exists, the electronic device 4000 displays the payment sheet interface 4014 closer to the biometric sensor 4003 from its initial position in FIG. 40E . Display an animation of moving to position at 40f.

. By moving the payment sheet interface towards the biometric sensor 4003 , the electronic device 4000 indicates to the user the location of the biometric sensor 4003 as well as the presence of the error icon 4028 (and thus , suggesting to the user the cause of the error condition).

In some examples, the error icon 4028 is displayed at a different location on the display 4002 depending on the positioning of the user's hand on the display 4002 . 40F , the user's hand is covering a portion of the display 4002 adjacent the biometric sensor 4003 . While the user's hand is in contact with the display 4002 , the electronic device 4000 detects an input as a result of the contact from the user's hand. In response to detecting this input, the electronic device 4000 displays an error icon 4028 at a location where no input is detected. As another example, in FIG. 40G , the user's hand covers a smaller portion of the display 4002 than the user's hand in FIG. 40F . In some examples, in response to detecting input of the user's hand in FIG. 40G , the electronic device 4000 displays an error icon 4028 at a location different from the location in FIG. 40F , where in FIG. 40G , The location is closer to the biometric sensor 4003 than in FIG. 40F . As another example, in FIG. 40H , the user's hand is covering much of the upper left side of the display 4002 . In some examples, in response to detecting the input of the user's hand in FIG. 40H , electronic device 4000 displays error icon 4028 at a different location than the locations in FIGS. 40F and 40G . Specifically, in some examples, the electronic device 4000 places the error icon 4028 at a location proximate (or substantially near) the biometric sensor 4003 if it is not at a location where input of the user's hand is detected. Display.

In FIG. 40I , the user puts her hand away so that the hand no longer covers the biometric sensor 4003 . While displaying the error icon 4028 and the error icon 4028 , the electronic device 4000 detects that the error condition no longer exists.

In FIG. 40J , in response to detecting that the error condition no longer exists, the electronic device 4000 automatically re-attempts the biometric authentication. While retrying the biometric authentication, the electronic device 4000 displays the authentication glyph 4024 . While displaying the authentication glyph 4024 , the electronic device 4000 attempts to biometrically authenticate the user. Specifically, the electronic device 4000 obtains information about the user's face using the biometric sensor 4003 , and determines whether biometric authentication is successful (eg, whether the obtained information matches stored authorized credentials). ) to determine whether

While retrying the biometric authentication, the electronic device 4000 determines that the biometric authentication is successful. In FIG. 40K , upon determining that the biometric authentication was successful, the electronic device 4000 displays a success glyph 4030 , which provides an indication that the biometric authentication was successful. In some examples, success glyph 4030 includes some or all of the features of glyph 2474 .

401 , further in response to determining that the biometric authentication was successful, the electronic device 4000 displays a processing indicator 4032 , which provides an indication that a payment transaction is being processed (eg, the electronic device) 4000 is transmitting payment information (eg, credentials) to authorize payment to an external device (eg, server). In some examples, processing indicator 4032 has some or all of the features of processing indicator 2476 .

In FIG. 40M , upon receiving an indication that the payment has been completed (eg, has been authorized), the electronic device 4000 displays a completed indication 4034 , which provides an indication that the payment is complete. In some examples, the completed indication 4034 has some or all of the features of the completed indication 2478 of FIG. 24A .

40N-40S illustrate a technique for displaying the error indicator 4026 and the error icon 4028 when the error indicator 4026 and the error icon 4028 should be displayed in approximately the same location. In FIG. 40N , the user wants to unlock the device to access restricted content (eg, home screen, most recently used application). 40N shows the electronic device 4000 in a portrait orientation with respect to the ground, where the user is covering the biometric sensor 4003 with her hand. Additionally, the electronic device 4000 displays a locked state UI 4036 having a lock icon 4038 . Lock icon 4038 provides an indication that electronic device 4000 is in a locked state.

While displaying the locked state UI 4036 , the electronic device 4000 receives a request to unlock the device. For example, electronic device 4000 detects that a user lifts the device from a substantially horizontal position.

In FIG. 40O , in response to receiving the request to unlock the device, the electronic device 4000 attempts to biometrically authenticate the user. While attempting to biometrically authenticate the user, electronic device 4000 displays authentication glyph 4024 . Additionally, while attempting to biometrically authenticate the user, the electronic device 4000 may indicate that an error condition exists (eg, a condition that prevents the biometric sensor 4003 from obtaining sufficient information about the user's face). detect that Specifically, the electronic device 4000 detects that the biometric sensor 4003 is covered by a physical object (eg, a user's hand).

In FIG. 40P , in response to detecting that an error condition exists, the electronic device 4000 displays an error at the location of the display 4002 proximate the biometric sensor 4003 (eg, on top of the display 4002 ). Display icon 4028 . Further, in response to detecting that an error condition exists, the electronic device 4000 determines that the error indication 4026 should be displayed at approximately the same location as the error icon 4028 . Upon determining that the error indication 4026 should be displayed at approximately the same location, the electronic device 4000 does not immediately display the error indication 4028, as described below with respect to FIGS. 40Q and 40R; Instead, it displays the error indicator 4026 as part of an animation that transitions from the error icon 4028 to the lock icon 4038 for the error indicator 4026 .

In FIG. 40Q , after displaying error icon 4028 , electronic device 4000 displays error indication 4026 (eg, replacing the display of error icon 4028 with it), as discussed above Likewise, it provides an indication of the cause of the error condition.

While displaying the error indication 4026 , the user removes her hand from the biometric sensor 4003 so that it no longer covers the biometric sensor 4003 . In response to detecting that the error condition no longer exists, the electronic device 4000 automatically re-attempts the biometric authentication.

40R and 40S , upon determining that authentication is successful as a result of retrying the biometric authentication, the electronic device 4000 transitions from the locked state to the unlocked state. Specifically, the electronic device 4000 displays an animation of the lock icon 4038 transitioning to the unlock icon 4040 (eg, replacing the display of the error indication 4026 with it), which prompts the user to the electronic device 4000 . (4000) provides an indication that it has transitioned to the unlocked state. In some examples, instead of successful biometric authentication, electronic device 4000 determines that authentication is not successful as a result of retrying biometric authentication. In some examples, upon determining that authentication is unsuccessful, electronic device 4000 displays a passcode entry UI having an affordance that, when activated, triggers retrying biometric authentication. In some examples, while retrying the biometric authentication, the electronic device 4000 dims all portions of the display 4002 except for a user interface associated with retrying the biometric authentication.

40T illustrates a technique for displaying an error icon 4028 when the error icon 4028 should be displayed at approximately the same location as one of the notifications being displayed (eg, 4044A-4044D). In some examples, the user desires to view limited content of one or more of the notifications displayed (eg, 4044A-4044D) while the electronic device 4000 is in a locked state. As shown in FIG. 40T , the user is covering the biometric sensor 4003 with her hand when the electronic device is in a portrait orientation, where the biometric sensor 4003 is positioned near the bottom of the device. In some examples, while attempting to biometrically authenticate the user to access the restricted content of notifications, the electronic device 4000 displays an error condition as a result of the user covering the biometric sensor 4003 with her hand. detect that it exists. In response to detecting that an error condition exists, the electronic device 4000 determines that the error icon 4028 should be displayed at approximately the same location as the notification of one of the notifications (eg, 4044A-4044D). In making this determination, and in response to detecting that an error condition exists, the electronic device 4000 displays the UI element 4042 (eg, background) concurrently with the error icon 4028 to display the error icon 4028 ) to provide a background to overlay the display of. As shown in FIG. 40T , UI element 4042 is opaque, such that a notification (eg, 4042D) overlaid with error icon 4028 is not visible to the user. In some examples, UI element 4042 is transparent, such that a notification overlaid with error icon 4028 is visible to the user.

40T also illustrates a technique for hiding the unlock indicator 4044 of FIG. 40U when the error icon 4028 should be displayed in approximately the same location as the unlock indicator 4044 . In some examples, the electronic device 4000 displays an unlock indication 4044 , which provides an indication of the approximate location on the display 4002 from which the user may initiate an upward swipe to initiate biometric authentication. . In some examples, while displaying unlock indication 4044 , electronic device 4000 detects that an error condition exists as a result of the user covering biometric sensor 4003 with her hand. In some examples, in response to detecting that an error condition exists, the electronic device 4000 determines that the error icon 4028 should be displayed at approximately the same location as the unlock indication 4044 . In some examples, upon making this determination, and in response to detecting that an error condition exists, the electronic device 4000 stops displaying the unlock indication 4044 , and the unlock indication 4044 displays Display the error icon 4028 in approximately the same location as it was.

While displaying the error icon 4028 , the electronic device 4000 detects that the error condition no longer exists (eg, because the user has removed her hand from the biometric sensor 4003 ). As shown in FIG. 40U , the user has removed her hand from the biometric sensor 4003 . In FIG. 40U , upon detecting that the error condition no longer exists, the electronic device 4000 stops displaying the error icon 4028 and re-appears the unlock indication 4044 at the location where it was previously displayed. Display.

41A-41C are flow diagrams illustrating a method for providing indications regarding a biometric sensor during biometric authentication, in accordance with some examples. The method 4100 includes a display (eg, 4002 ) and a biometric sensor (eg, 4003 ) (eg, a second portion of a device having a plurality of biometric sensors) in a first portion (eg, a portion that is not part of the display) of an electronic device. 1 Electronic device (e.g., 100; 300, 500, 4000). In some examples, the biometric sensor includes one or more cameras. Some operations of the method 4100 are selectively combined, the orders of some operations are selectively changed, and some operations are optionally omitted.

As described below, method 4100 provides an intuitive method for providing indications regarding a biometric sensor during biometric authentication. This method reduces the cognitive burden on the user for performing biometric authentication, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to perform biometric authentication faster and more efficiently saves power and increases the time between battery charges.

An electronic device (eg, 100, 300, 500, 4000) may be subject to an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device (eg, a non-contact biometric sensor such as a thermal or optical facial recognition sensor). is obscured (e.g., partially obscured, fully obscured, obscured to a degree sufficient to inhibit operation of the sensor) (e.g., by a portion of the user (e.g., a hand) while interacting with an electronic device) occlusion) is detected ( 4102 ) (eg, in response to a request to perform an action requiring authentication).

In response to detecting the presence of an error condition ( 4104 ), the electronic device (eg, 100 , 300 , 500 , 4000 ) displays, on a display (eg, 4002 ), an error indication (eg, 4028 ) (eg, a graphical icon ) is displayed. In some examples, the error indication includes text (eg, indicating that the sensor is obscured). In some examples, the error indication does not include text. An error indication is displayed ( 4106 ) at a location proximate to the first portion of the electronic device. In some examples, the location is at or near the portion of the display that is closest to the location of the biometric sensor (eg, 4003 ). Displaying the error indication provides feedback to the user regarding the current state of the device (eg, that the error condition is preventing successful biometric authentication) and prompts the user to take further action to correct the error condition . Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. Displaying an error indication near the biometric sensor provides feedback to the user about the association of the biometric sensor with a process (eg, attempted authentication) occurring on the device. Specifically, the user notices the biometric sensor during biometric authentication, such that the user is less likely to perform an action that interferes with the biometric sensor, or alternatively, the user is prompted to take a corrective action. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the error indication (eg, 4028 ) includes a biometric sensor occlusion icon and a reticle, and the error indication provides an indication that the biometric sensor is occluded ( 4108 ). (ISE, an error indication is associated with an electronic device that performs biometric authentication (eg, using a biometric sensor to obtain biometric information about a biometric feature (eg, face, fingerprint)). Providing an indication that the sensor is obscured provides the user with feedback regarding the current state of the device (eg, the biometric sensor is obscured) and prompts the user to take further action to correct the error condition. Thus, providing improved feedback with instructions for appropriate movements of the biometric feature (eg, by helping the user provide appropriate inputs and reducing user errors when actuating/interacting with the device) It improves the operability of the device and makes the user-device interface more efficient, which further reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In response to determining 4110 that the user interface of the electronic device is in a first orientation with respect to the biometric sensor, the electronic device (eg, 100, 300, 500, 4000) is placed proximate (eg, adjacent to) the first portion of the electronic device. , near it, and within its predetermined distance) display the error indication at a first location in the user interface.

In response to determining 4112 that the user interface of the electronic device is in a second orientation with respect to the biometric sensor, the electronic device (eg, 100, 300, 500, 4000) is placed proximate (eg, adjacent to) the first portion of the electronic device. , near and within a predetermined distance thereof) display an error indication (eg, 4028 ) at a second location in the user interface, wherein the first orientation is different from the second orientation.

In some examples, while attempting 4114 to obtain biometric information using a biometric sensor (eg, 4003 ), the electronic device (eg, 100 , 300 , 500 , 4000 ) is displayed on a display (eg, 4002 ). Display ( 4116 ) a first progress indicator (eg, 4024 , 4026 , 4038 , 4040 ). In some examples, the first progress indicator provides an indication of a current state of the electronic device (eg, locked state, unlocked state, performing biometric authentication, error state, error condition). In some examples, upon a determination that a user interface (eg, 4006 , 4008 ) of the electronic device is in a third orientation with respect to the biometric sensor, the user interface in the third orientation has a first top side ( 4118 ); The electronic device displays a first progress indicator proximate to (eg, adjacent to, near, within a predetermined distance thereof) a first upper side of the user interface in the third orientation. In some examples, upon determining that the user interface of the electronic device is in a fourth orientation with respect to the biometric sensor - the user interface in the fourth orientation has a second top side - ( 4120 ), the electronic device in the fourth orientation display a first progress indicator proximate (eg, adjacent to, near, within a predetermined distance thereof) to a second upper side of the user interface of the , the third orientation being different from the fourth orientation. In some examples, the first progress indicator is displayed on the display at a location closest to or proximate to the biometric sensor (eg, adjacent thereto, within its predetermined distance). Displaying the first progress indicator near the top of the display regardless of orientation ensures that the user is more likely to perceive the provided feedback to the user (eg, the progress indicator). Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, no indicator is displayed during biometric authentication.

In some examples, the electronic device (eg, 100, 300, 500, 4000) displays, on the display (eg, 4002), a second progress indicator (eg, 4024, 4026, 4038, 4040) of the electronic device . In some examples, the second progress indicator provides an indication of a current state of the electronic device (eg, locked state, unlocked state, performing biometric authentication, error state). In some examples, the first progress indicator is a second progress indicator. In some examples, the second progress indicator includes a first portion (eg, an indication that the electronic device is performing biometric authentication using a biometric sensor (eg, 4024 ) (eg, rotating rings)) and the first portion; is a different second portion (eg, an indication of an error condition or error condition (eg, 4026), an indication of the current locked or unlocked state of the electronic device (eg, a lock icon (eg, 4038), an unlock icon (eg, 4040)) )))). In some examples, upon determining that the second progress indicator is displayed at a location proximate to the first portion of the electronic device, the electronic device displays an error as part of the animation after the first portion and before the second portion (eg, 4028 ) is displayed.

In some examples, the electronic device (eg, 100 , 300 , 500 , 4000 ) is positioned on a display (eg, 4002 ) at a third location within the user interface (eg, proximate a side (eg, bottom side) of the user interface). location) to the home affordance (e.g., 4044) (e.g., an indication of the location of a gesture that, when performed, results in displaying the home screen, such as a swipe up gesture from the edge of the display or a tap gesture on the affordance) Display. In some examples, upon determining that the error indication (eg, 4028 ) is displayed at the third location, the electronic device stops displaying the home affordance (eg, 4044 ) while displaying the error indication at the third location. Stopping the display of the home affordance while displaying the error indication quickly allows the user to recognize that the home affordance is not accessible because of an error and prompts the user to take further action to correct the error condition. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating and/or interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, no indicator is displayed during biometric authentication.

In some examples, after ceasing to display the home affordance (eg, 4044 ), the electronic device (eg, 100 , 300 , 500 , 4000 ) determines that the biometric sensor (eg, 4003 ) detects biometric information about a user of the device. Detects the correction of the error condition that prevents it from being obtained. In some examples, the electronic device detects the absence of the error condition after displaying an error indication (eg, 4028 ) in the third location. In some examples, in response to detecting the correction of the error condition, the electronic device displays, on a display (eg, 4002 ), a home affordance at a third location within the user interface (eg, and an error indication (eg, 4028 ) ) to stop displaying).

In some examples, the electronic device (eg, 100 , 300 , 500 , 4000 ) is an input (eg, 100 , 300 , 500 , 4000 ) at a location proximate to (eg, adjacent to, proximate to, within a predetermined distance thereof) a first portion of the electronic device. , palm, finger) are detected. In some examples, in response to detecting input at a location proximate to the first portion of the electronic device, the electronic device displays, on the display, an error indication (eg, 4028 ) at the different location. In some examples, the different location is a location where no input is detected. In some examples, prior to displaying the error indication at the new location, the electronic device determines a different location based on the location of the input to the display. In some examples, the different location is proximate to a location proximate to the first portion of the electronic device. In some examples, the error indication is initially displayed at a first location proximate to the first portion of the electronic device and then moved to a different location. In some examples, the error indication is initially displayed at a selected location away from any areas of the display that are known to be obscured (eg, obscured by the detected touch input). Displaying the error indication at different locations depending on the location of the input (e.g., the user's hand) provides the user with feedback regarding the current state of the device (e.g., that an error condition is preventing successful biometric authentication) and Prompts the user to take further action to correct the error condition. Also, by adjusting the location, the device ensures that the error indication is visible to the user, and thus the user is more likely to take corrective action on the device. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (eg, 100 , 300 , 500 , 4000 ) is positioned, on the display (eg, 4002 ), in proximity to (eg, adjacent to, in the vicinity of, a first portion of the electronic device) its predetermined A transaction (or payment) at a location that is within a distance of a first transaction interface (eg, 4014 ) (eg, separate from (or overlaid on) the user interface and including transaction information such as a credit card number, billing address, etc. interface) is displayed. In some examples, the first transaction interface is upon receiving an input (eg, 4010) corresponding to an affordance (eg, 4012) (eg, affordance to make a payment or complete a transaction) of a user interface (eg, 4008) displayed in response.

In some examples, displaying the first transaction interface (eg, 4014 ). and displaying an animation in which the first transaction interface transitions (eg, transforms) from an initial position that is substantially centered relative to the display to a position proximate to the first portion of the electronic device. In some examples, the animation displays (eg, maintains display of) the first transaction interface while the first transaction interface transitions (eg, transforms) from an initial position to a location proximate to the first portion of the electronic device. includes In some examples, the animation includes a visual effect in which the first transaction interface appears to be floating during transition.

In some examples, the electronic device (eg, 100 , 300 , 500 , 4000 ) prompts (eg, 4016 ) to provide, on a display (eg, 4002 ), one or more activations of a hardware button (eg, 4004 ) of the electronic device ) is displayed. In some examples, the electronic device prompts the user by displaying "double click for Apple Pay." In some examples, the prompt is displayed adjacent to the button. In some examples, the prompt is displayed (eg, when the device is displaying the transaction user interface area (eg, 4014 ) without receiving any indication that the transaction terminal is nearby and is requesting transaction credentials (eg, 4014 ). A prompt is displayed to provide one or more activations of the button before the device is placed in the NFC field of the NFC reader requesting payment information). In some examples, the hardware button is a mechanical button or a solid state button. In some examples, the button is a switch or any other type of toggle. In some examples, the button has a fixed position with respect to the electronic device, particularly with respect to the display of the electronic device, such that the electronic device can display prompts based on the position of the button. In some examples, the button is a solid state button that operates according to capacitive and/or resistive touch and/or responds to changes in the strength of the input without having a mechanical switch depressed to activate the button, and instead, Monitors whether the intensity of s exceeds an intensity threshold corresponding to activation of the solid-state button. In some examples, the electronic device (eg, 100, 300, 500, 4000) receives one or more activations (eg, 4020) of a hardware button of the electronic device, and in response to receiving one or more activations of the hardware button, The electronic device displays, on a display (eg, 4002 ), an authentication progress indicator (eg, 4022 , 4024 , 4030 , 4032 , 4034 ). In some examples, displaying the authentication progress indicator includes displaying an animation in which the authentication progress indicator transitions from a position of the prompt (eg, 4016 ) to a final position of the authentication progress indicator. In some examples, the authentication indicator provides the status of the authentication (eg, in progress, successful, not successful). In some examples, the animation includes displaying (eg, maintaining display of) the authentication progress indicator while the authentication progress indicator transitions (eg, transforms) from the position of the prompt to the final position. In some examples, the animation includes a visual effect in which the authentication progress indicator appears to slide out of the prompt. In some examples, the authentication progress indicator is displayed with (or overlaid on) a user interface (eg, 4014 ) (or transaction user interface area). Prompting the user to activate the hardware button guides the user to perform an action on the device to complete the transaction. Prompting the user in this way improves the operability of the device and makes the user-device interface more efficient (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device). This additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. Displaying the authentication progress indicator provides feedback to the user regarding the status of the authentication. Improved feedback improves the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating and/or interacting with the device); This additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, the electronic device (eg, 100, 300, 500, 4000) corresponds to a first application (eg, 4006, 4008) in a first area (eg, 4007, 4009), on a display (eg, 4002) ) and simultaneously display a second application (eg, corresponding to 4006, 4008) in a second area (eg, 4007, 4009), the second application being adjacent to (eg, next to) the first application; proximate to it, within its predetermined distance) (4122). In some examples, the electronic device displays ( 4124 ) a second transaction interface (eg, 4014 ) on the display. In some examples, the second transaction interface is the first transaction interface. In some examples, the second transaction interface is displayed overlaid on the first application and/or the second application. In some examples, in response to determining 4126 that the second transaction interface corresponds to the first application, the electronic device modifies a first visual characteristic (eg, ambiguity, darkness, blurry) of the first application. In some examples, the second transaction interface is triggered when the first application includes information about a good or service (or transaction) being purchased (or completed) using (or via) the second transaction interface. respond to In some examples, this determination is made while displaying the second transaction interface. In some examples, upon determining 4130 that the second transaction interface corresponds to the second application, the electronic device (eg, 100, 300, 500, 4000) displays a first visual characteristic (eg, ambiguity, darkness) of the second application. , blur). In some examples, the second transaction interface is triggered when the first application includes information about a good or service (or transaction) being purchased (or completed) using (or via) the second transaction interface. respond to In some examples, this determination is made while displaying the second transaction interface.

In some examples, modifying the first visual characteristic of the first application includes modifying the second visual characteristic of the second application. In some examples, modifying the second visual characteristic of the second application increases the darkening and/or increases the blur radius of the blur effect applied to the second application to a greater degree (or amount) than for the first application. including increasing to In some examples, modifying the first visual characteristic of the second application includes modifying the second visual characteristic of the first application. In some examples, modifying the second visual characteristic of the first application increases the darkening and/or increases the blur radius of the blur effect applied to the first application to a greater degree (or amount) than for the second application. including increasing to Modifying the visual properties of one application to a greater extent than for another application provides feedback to the user as to which application is more relevant at that time. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, no indicator is displayed during biometric authentication.

In some examples, modifying the first visual characteristic of the first application means that the second region is closer to (eg, closer to) the first portion (eg, biometric sensor) of the electronic device than the first region. and displaying the first application in the second area according to the determination ( 4128 ). In some examples, displaying the first application in the second area includes stopping displaying the first application in the first area. In some examples, modifying the first visual characteristic of the second application means that the first region is closer to (eg, closer to) the first portion (eg, biometric sensor) of the electronic device than the second region is. and displaying ( 4132 ) the second application in the first area according to the determination. In some examples, displaying the second application in the first area includes stopping displaying the second application in the second area. In some examples, the electronic device displays an animation of the first application swapping places with the second application.

In some examples, upon determining that the second transaction interface (eg, 4014 ) corresponds to the first application, the second transaction interface includes an indication of the first application (eg, the name of the first application). In some examples, upon determining that the second transaction interface corresponds to the second application, the second transaction interface includes an indication of the second application (eg, the name of the second application).

Note that the details of the processes described above with respect to method 4100 (eg, FIGS. 41A-41C ) are also applicable in a similar manner to the methods described above/below. For example, method 3700 , method 3900 , and/or method 4300 optionally includes one or more of the features of various methods described above with respect to method 4100 . For example, as described in method 4100 , error icon 4028 indicates that the biometric sensor is failing when biometric authentication is being performed in the processes described in connection with method 3700 and method 3900 . Can be used to indicate being disturbed. For the sake of brevity, these details are not repeated below.

42A-42P illustrate example user interfaces for orienting a device to enroll a biometric feature (eg, a face for later use in biometric authentication), in accordance with some examples. The user interfaces of these figures are used to illustrate the processes described below, including the processes of FIGS. 43A-43C.

42A illustrates an electronic device 4200 (eg, portable multifunction device 100 , device 300 , device 500 ). In the illustrative examples illustrated in FIGS. 42A-42P , the electronic device 4200 is a tablet computer. In other examples, the electronic device 4200 may be a different type of electronic device, such as a wearable device (eg, a smartwatch). Electronic device 4200 includes a display 4202 , one or more input devices (eg, a touchscreen, buttons, and microphone of display 4202 ), and a wireless communication radio. In some examples, the electronic device includes a plurality of cameras. In some examples, the electronic device includes only one camera. In FIG. 42A , the electronic device includes a biometric sensor 4203 . In some examples, the biometric sensor is one or more biometric sensors that may include a camera such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 4203 is biometric sensor 703 . In some examples, the one or more biometric sensors include one or more fingerprint sensors (eg, a fingerprint sensor integrated into a button). In some examples, the device further comprises a light emitting device (eg, a light projector), such as an IR floodlight, a structured light projector, or a combination thereof. The light emitting device is optionally used to illuminate the biometric feature (eg, face) during capture of biometric data of the biometric features by the one or more biometric sensors.

In FIG. 42A , the user wants to set up biometric (eg, facial) authentication on the electronic device 4200 . Successfully setting up biometric authentication on the device allows the user to perform operations on the device that require authentication (eg, unlock the device) by presenting the user's face for biometric authentication. In order to set up biometric authentication on the electronic device, the user must first register her face. The process for registering a face may include some or all of the features (or processes) of FIGS. 11A-11O .

As illustrated in FIG. 42A , the electronic device 4200 displays an introductory user interface (UI) 4206 having an initiation affordance 4208 . The electronic device 4200 receives an input 4210 in the initiation affordance 4208 to initiate the process of registering the user's face for biometric authentication.

In FIG. 42B , in response to receiving the input 4210 in the starting affordance 4208 , the electronic device 4200 determines that the orientation of the device is not suitable for registering the user's face. In some examples, a suitable orientation for registering a user's face is a portrait orientation in which the biometric sensor 4203 is upright (eg, vertical), wherein the biometric sensor 4203 is on the top of the device (eg, the side of the device furthest from the ground). ) to be in In response to determining that the orientation of the device is not suitable for registering the user's face, the electronic device 4200 displays one or more prompts prompting the user to orient the electronic device 4200 in a suitable orientation (eg, , replacing the display of the introduction UI 4206 with it). More specifically, the electronic device 4200 determines that the electronic device 4200 is in a substantially horizontal orientation (eg, approximately parallel to the ground). Consequently, as shown in FIG. 42B , the electronic device 4200 displays a prompt 4212A prompting the user to lift the electronic device 4200 to an upright position.

In some examples, in response to receiving the input 4210 at the starting affordance 4208 , the electronic device determines that the orientation of the device is suitable for registering the user's face. In some examples, upon determining that the orientation is suitable for registering the user's face, the electronic device 4200 automatically initiates a process for registering the user's face, as described below in connection with FIG. 42D . do.

In FIG. 42C , in response to determining that the electronic device 4200 is in an upright position but not in a portrait orientation (eg, the user has lifted the device from the table in response to prompt 4212A), the electronic device 4200 is Display prompt 4212B (eg, replace display of prompt 4212A with it) prompting the user to rotate electronic device 4200 to a portrait orientation (eg, with biometric sensor 4203 thereon) box). Specifically, prompt 4212B prompts the user to rotate in a particular direction such that a minimum rotation is required to achieve a desired (or suitable) orientation. For example, rotating the electronic device 4200 clockwise requires less rotation to achieve the desired orientation than rotating the device counterclockwise.

In FIG. 42D , in response to determining that the electronic device 4200 is in a suitable orientation, the electronic device 4200 automatically initiates a process for registering the user's face. 42D-42F , after initiating the process for registering the user's face, the electronic device 4200 displays the face registration UI 4214 . The face registration UI 4214 includes some or all of the features of the face registration UI 1104 .

In FIG. 42G , after successfully completing registration of the user's face, the electronic device 4200 displays a scan complete interface 4216 (eg, replacing the display of the face registration UI 4214 with it), which Continue includes affordance 4218 . The scan complete interface 4216 includes some or all of the features of the scan complete interface 1130 .

After completing registration of the user's face, a second iteration of the registration process is performed without requiring the user to reorient the device. As shown in FIG. 42G , while displaying the scan complete interface 4216 , the electronic device 4200 receives an input 4220 at the Continue affordance 4218 to initiate a second iteration of the registration process. .

In FIG. 42H , in response to receiving input 4220 in Continue affordance 4218 , electronic device 4200 proceeds with a registration process of a second iteration similar to the processes described above with respect to FIGS. 42D-42F . start Electronic device 4200 initiates the second iteration without prompting the user to reorient the device to a different orientation than its current orientation. Initiating the registration process of the second iteration includes displaying a second face registration UI 4222 . The second face registration UI 4222 includes some or all of the features of the second face registration UI 1138 .

In FIG. 42I , after successfully completing the registration process of the second iteration, the electronic device 4200 displays the second scan complete interface 4224 (eg, the display of the second face registration UI 4222 with it) replaced), which includes an affordance 4226 to continue. The second scan complete interface 4224 includes some or all of the features of the second scan complete interface 1156 . As illustrated in FIG. 42I , the electronic device 4200 receives an input 4228 at an affordance 4226 to continue.

In FIG. 42J , in response to receiving input 4228 in continue affordance 4226 , electronic device 4200 displays registration complete interface 4230 (eg, of second scan complete interface 4224 ). replace the display), providing the user an indication that biometric authentication has been successfully set up on the electronic device 4200 . The registration completion interface 4230 includes some or all of the features of the registration completion interface 1166 .

In FIG. 42K , after biometric authentication is set up on electronic device 4200 , the user can unlock electronic device 4200 using biometric authentication by presenting the user's face to biometric sensor 4203 . (eg, transitioning the device from a locked state to an unlocked state). In some examples, the user initiates biometric authentication to unlock the device by lifting (or raising) the electronic device 4200 (eg, from a substantially horizontal orientation). While the electronic device 4200 is being lifted, the electronic device 4200 detects a change in orientation of the device and, in response, initiates biometric authentication to unlock the device. While the electronic device 4200 is in the locked state, the electronic device 4200 provides a biometric sensor indicator 4234 that provides the user with an indication of the location of the biometric sensor 4203 , and the electronic device 4200 is locked. Note that it displays a locked status interface 4232 that includes a lock icon 4236 that provides an indication that it is in a state. In some examples, the electronic device 4200 does not display the biometric sensor indicator 4234 while the electronic device 4200 is in a locked state.

As shown in FIG. 42L , when the electronic device 4200 initiates biometric authentication, the user is holding the electronic device 4200 so that the user's face is outside the field of view 4238 of the biometric sensor 4203 . . In some examples, the user's face is out of view 4238 when more than a threshold portion of the face is out of view. In some examples, the user's face is outside the field of view 4238 when no face is detected within the field of view. While attempting to biometrically authenticate the user's face, the electronic device 4200 may not be able to obtain sufficient information about the user's face using the biometric sensor 4203 . As a result, the electronic device 4200 does not have sufficient information for comparison with the stored authorized credentials that were generated from the registration process described above with respect to FIGS. 42D-42J .

42M , upon determining that the user's face is outside the field of view 4238 , the electronic device 4200 displays an error indication 4240 , which provides an indication to the user that the user's face is outside the field of view 4238 . . (Error indication 4240 includes some or all of the features of error indication 3814G.) Additionally, upon determining that the user's face is outside field of view 4238, electronic device 4200 automatically performs authentication. do not retry with In some examples, the electronic device 4200 also displays the biometric sensor indicator 4234 . In some examples, if sufficient information was obtained, but authentication nevertheless failed (eg, the obtained information did not match the stored authorized credentials), the electronic device 4200 automatically retryes the biometric authentication. do.

42N , after learning from the error indication 4240 that the user's face is outside the field of view 4238 of the biometric sensor 4203 , the user can Move the face into field of view 4238 . In response to detecting that the cause of the error indication 4240 has been corrected (eg, detecting a user's face greater than a threshold amount), the electronic device 4200 automatically re-attempts the biometric authentication. Upon determining that authentication is successful (eg, information obtained using biometric sensor 4203 matches stored authorized credentials) as a result of retrying biometric authentication, electronic device 4200 is locked transitions from to the unlocked state. After transitioning to the unlocked state, the electronic device displays the unlocked state interface 4242 .

In some examples, while displaying unlocked status interface 4242 , electronic device 4200 requests to access restricted content on the device (eg, home screen 4244 in FIG. 42O , most recently used application). (eg, an upward swipe starting within the area adjacent the lower edge of the display 4202 ). In response to receiving the request to access restricted content, the electronic device 4200 displays a home screen 4244 comprising a plurality of icons that, when activated, launch an application corresponding to the activated icon. In some examples, instead of displaying the home screen 4244 , the electronic device 4200 displays the most recently used application (eg, the user interface of the application). Note that the above processes described above with respect to FIGS. 42K-42O are performed when the electronic device 4200 is in a landscape orientation. However, in some examples, some or all of the processes described above with respect to FIGS. 42K-42N may be performed when the electronic device 4200 is in a portrait orientation.

In some examples, instead of transitioning to an unlocked state as described with respect to FIG. 42N , the electronic device 4200 remains locked if the obtained information does not match the stored authorized credentials. . In some examples, as shown in FIG. 42P , upon determining that the obtained information does not match the stored authorized credentials, the electronic device 4200 causes the locked state interface 4232 to simulate a “shake” effect. It displays its locked state interface while alternating the position of the lock icon 4236 , thereby providing an indication to the user that the electronic device 4200 remains locked.

43A-43C are flow diagrams illustrating a method for orienting a device to enroll a biometric feature (eg, a face for later use in biometric authentication), in accordance with some examples. The method 4300 includes a display (eg, 4202 ) and one or more biometric sensors (eg, 4203 ) (eg, a first biometric sensor of a device having a plurality of biometric sensors) (eg, a fingerprint sensor, a contactless biometric sensor). (eg, biometric sensors that do not require physical contact, eg, thermal or optical facial recognition sensors), iris scanners) (eg, 100, 300, 500, 4200). In some embodiments, the one or more biometric sensors include one or more cameras. Some operations of the method 4300 are selectively combined, the order of some operations is selectively changed, and some operations are optionally omitted.

As described below, the method 4300 provides an intuitive method for prompting the user to orient the device to enroll the biometric feature. This method reduces the cognitive burden on the user of registering a biometric feature (eg, a face for later use in biometric authentication), thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to register a biometric feature faster and more efficiently saves power and increases the time between battery charges.

The electronic device (eg, 100 , 300 , 500 , 4200 ) displays, on the display (eg, 4202 ), a biometric enrollment user interface (eg, 4206 ) for initiating biometric enrollment with one or more biometric sensors do (4302).

While displaying the biometric enrollment user interface ( 4304 ), the electronic device is an input (eg, 4210 ) (eg, a touch gesture (eg, tap), spoken user input, corresponding to a request to initiate biometric registration) ) is received.

In response to receiving the input (eg, 4210 ) ( 4306 ) and an orientation of the electronic device (eg, a current orientation, an orientation of the electronic device at (or near) the time of input) satisfies a set of enrollment criteria Upon determining to do so ( 4308 ), the electronic device initiates a process for registering the biometric feature with one or more biometric sensors (eg, 4203 ). In some examples, the set of enrollment criteria can determine whether the electronic device is oriented in a portrait orientation with respect to a frame of reference (eg, Earth, ground), one or more biometric sensors are positioned on a particular side of the electronic device (eg, Earth, Earth) in a portrait orientation. is oriented (or positioned) on the side furthest away from), or whether the electronic device is oriented such that it is not approximately parallel to the ground. In some examples, the set of enrollment criteria determines whether the electronic device is in a predetermined (eg, appropriate) orientation with respect to a biometric feature (eg, face) (eg, a major plane of the device (eg, defined by the display of the device). plane) is facing the biometric feature). In some examples, initiating a process for registering a biometric feature includes capturing data corresponding to the user's face using one or more biometric sensors.

In response to receiving the input (eg, 4210 ) ( 4306 ), and in response to a determination ( 4322 ) that the orientation of the electronic device does not satisfy the set of enrollment criteria, the electronic device sets the orientation of the electronic device to one of the enrollment criteria. Output one or more prompts (eg, 4212A, 4212B) (eg, visual, audio, and/or tactile prompt) to change to a different orientation that satisfies the set. Outputting one or more prompts if the set of enrollment criteria is not satisfied provides the user with feedback on corrective actions to take to continue enrolling the biometric feature. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

In some examples, outputting the one or more prompts includes outputting 4324 a first prompt (eg, 4212A) to orient the electronic device in an initial orientation. In some examples, the initial orientation is such that the electronic device is not approximately parallel to the ground. In some examples, the initial orientation is such that the electronic device is approximately parallel to the force of gravity. In some examples, the set of enrollment criteria includes a requirement that a major plane of the device be substantially aligned with a predetermined plane (eg, a plane substantially normal to the ground) such that the display of the device is substantially vertical. In some examples, the set of enrollment criteria is such that the major plane of the device is not resting on a horizontal surface while the device is attempting to enroll the biometric feature in a (second) predetermined plane (eg, a plane substantially parallel to the ground plane). ) and the requirement that they are not substantially aligned. In some examples, outputting the one or more prompts may include, subsequent to outputting the first prompt (eg, 4212A), a second prompt (eg, 4212A) to orient the electronic device in a different orientation that satisfies the set of enrollment criteria. 4212B), wherein the first prompt is different from the second prompt (4326). In some examples, the electronic device outputs the first prompt without outputting the second prompt. In some examples, the electronic device stops outputting the first prompt when the orientation of the electronic device is changed to the initial orientation. In some examples, the electronic device outputs a second prompt when the orientation of the electronic device is changed to the initial orientation. In some examples, the electronic device outputs the second prompt without outputting the first prompt (eg, when the electronic device is already in the initial orientation). In some examples, the set of enrollment criteria can determine whether the electronic device is oriented in a portrait orientation with respect to a frame of reference (eg, Earth, ground), one or more biometric sensors are positioned on a particular side of the electronic device (eg, Earth, Earth) in a portrait orientation. is oriented (or positioned) on the side furthest away from), or whether the electronic device is oriented such that it is not approximately parallel to the ground. Outputting the first prompt without outputting the second prompt provides improved feedback to the user as it reduces the chance of confusion when the user is taking corrective actions to trigger registration of the biometric feature. Providing the user with improved visual feedback improves the operability of the device and reduces user errors (eg, by helping the user provide appropriate inputs when operating/interacting with the device) and user-device interface. more efficient, which additionally enables users to use the device more quickly and efficiently, thereby reducing the device's power usage and improving battery life. In some examples, no indicator is displayed during biometric authentication.

In some examples, outputting the one or more prompts outputs a third prompt (eg, 4212B) to rotate the electronic device (eg, about an axis perpendicular to the electronic device) to a different orientation that satisfies the set of enrollment criteria. and the third prompt is based on an orientation of the electronic device while receiving the input. In some examples, the third prompt is a second prompt. In some examples, upon determining that the orientation of the electronic device is the first orientation, the electronic device outputs a first rotation prompt to rotate the electronic device to a different orientation that satisfies the set of enrollment criteria. In some examples, upon determining that the orientation of the electronic device is a second orientation different from the first orientation, the electronic device outputs a second rotation prompt to rotate the electronic device to a different orientation that satisfies the set of enrollment criteria; , the second rotation prompt is different from the first rotation prompt. In some examples, the first rotation prompt or the second rotation prompt is a second prompt. In some examples, the set of enrollment criteria can determine whether the electronic device is oriented in a portrait orientation with respect to a frame of reference (eg, Earth, ground), one or more biometric sensors are positioned on a particular side of the electronic device (eg, Earth, Earth) in a portrait orientation. is oriented (or positioned) on the side furthest away from), or whether the electronic device is oriented such that it is not approximately parallel to the ground. Outputting a prompt based on the orientation of the device provides the user with feedback on an efficient process for achieving the proper orientation of the device to enroll the biometric feature. Providing improved feedback to the user improves the operability of the device and enhances the user-device interface (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) making it more efficient, which additionally reduces the power usage of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

In some examples, outputting the one or more prompts may cause the electronic device (eg, about an axis perpendicular to the electronic device) to be oriented in a different orientation that satisfies a set of enrollment criteria (eg, a major plane of the device (eg, of the device). outputting a fourth prompt (eg, 4212B) to rotate (eg, along an axis parallel to the plane defined by the display), wherein the third prompt is a predetermined plane (eg, a plane substantially normal to the ground; based on the alignment of the major plane of the device (eg, the plane defined by the display of the device) with respect to a plane substantially parallel to . In some examples, the electronic device outputs a fourth prompt in response to determining that the electronic device is oriented substantially parallel to the ground. In some examples, the set of enrollment criteria includes a requirement that a major plane of the device be substantially aligned with a predetermined plane (eg, a plane substantially normal to the ground) such that the display of the device is substantially vertical. In some examples, the set of enrollment criteria is such that the major plane of the device is not resting on a horizontal surface while the device is attempting to enroll the biometric feature in a (second) predetermined plane (eg, a plane substantially parallel to the ground plane). ) and the requirement that they are not substantially aligned.

In some examples, following initiating a process for registering a biometric feature (eg, following successfully registering a biometric feature), the electronic device (eg, 100, 300, 500, 4200) requires authentication receive a request to perform an action (eg, a request to unlock the device (eg, perform a swipe from a predefined location)). In some examples, the electronic device receives a request to perform an action requiring authentication subsequent to performing (or completing) biometric registration. In some examples, the electronic device prompts one or more prompts (eg, 4212A, 4212B) (eg, visual, audio, and/or tactile prompt) to change the orientation of the electronic device to a different orientation that satisfies a set of enrollment criteria. After outputting , a request to perform an operation requiring authentication is received. In some examples, in response to receiving a request to perform an action requiring authentication, the electronic device authenticates (eg, data by the one or more biometric sensors) using one or more biometric sensors (eg, 4203 ). including obtaining ). In some examples, after attempting (eg, unsuccessfully) authentication using the one or more biometric sensors, and (eg, due to the face being out of field of view (eg, 4238 )) to the one or more biometric sensors. In accordance with a determination that the data obtained by the method corresponds to less than a threshold amount of biometric features (eg, a portion of a face/fingerprint rather than the entire face/fingerprint), the electronic device withholds retrying the authentication. In some examples, the electronic device withholds automatically retrying the authentication. In some examples, after attempting authentication using one or more biometric sensors, the electronic device fails the biometric authentication more than a predetermined number of times (eg, 5, 10, 15) since the last successful authentication by the device. Withholds retrying authentication due to what was done. In some examples, the electronic device prevents retrying authentication without an explicit request to perform an operation that requires authentication (eg, a request to unlock the device (eg, perform a swipe at a predefined location)). withhold In some examples, after an initial attempt at authentication is unsuccessful, the electronic device re-enables biometric authentication if a determination is not made that the data obtained by the one or more biometric sensors correspond to only a portion of the biometric feature. try Withholding retrying authentication when less than a threshold amount of a biometric feature is obtained avoids the user spending an allowed number of attempts on repeated requests (eg, repeated requests of the same type), so that , thereby preserving at least one attempt for requests for other operations requiring biometric authentication. Preserving at least one attempt improves the operability of the device (eg, by avoiding exhaustion of authentication attempts for repeated similar requests) and makes the user-device interface more efficient, which additionally It reduces the device's power usage and improves battery life by enabling faster and more efficient use of the device.

In some examples, after attempting (eg, unsuccessfully attempting) authentication using one or more biometric sensors, and data obtained by the one or more biometric sensors is greater than or equal to a threshold amount (eg, more than) of a biometric characteristic According to the determination that it corresponds to the negative, the electronic device reattempts authentication. Retrying authentication automatically when a threshold amount of biometric features are obtained provides the user the ability to attempt authentication when conditions are appropriate without requiring the user to explicitly request to retry authentication. Performing an action when a set of conditions are met without requiring additional user input (eg, by helping the user provide appropriate inputs and reducing user errors when operating/interacting with the device) It improves the operability of the device (eg, increases the chances of successful authentication) and makes the user-device interface more efficient, which in addition enables the user to use the device more quickly and efficiently, thereby consuming the power of the device. reduce and improve battery life.

In some examples, upon a determination that authentication resulting from retrying authentication is successful, the electronic device (eg, 100 , 300 , 500 , 4200 ) performs an action corresponding to the request. In some examples, upon a determination that authentication resulting from retrying authentication is not successful, the electronic device withholds performing an action corresponding to the request. In some examples, authentication is an authorization of credentials with biometric information captured using one or more biometric sensors (eg, an authorized biometric feature (eg, face, fingerprint) for use in biometric authentication). It is successful when it matches (or matches) the stored information about In some examples, authentication is an authorization of credentials with biometric information captured using one or more biometric sensors (eg, an authorized biometric feature (eg, face, fingerprint) for use in biometric authentication). It is unsuccessful when it does not match (or does not match) stored information about Withholding from performing an action when authentication is unsuccessful improves device security by preventing unauthorized and/or unauthorized access to the device. Improving the device's security measures improves the device's operability by preventing unauthorized access to content and operations and, in addition, the device's power usage by enabling the user to use the device more efficiently. reduce and improve battery life.

In some examples, output one or more prompts (eg, 4212A, 4212B) (eg, visual, audio, and/or tactile prompt) to change the orientation of the electronic device to a different orientation that satisfies a set of enrollment criteria. Subsequently, the electronic device (eg, 100 , 300 , 500 , 4200 ) detects ( 4328 ) that the current orientation of the electronic device satisfies the set of enrollment criteria. In some examples, in response to determining that the current orientation of the electronic device satisfies the set of enrollment criteria ( 4330 ), the electronic device initiates a process for registering the biometric feature with one or more biometric sensors. In some examples, the set of enrollment criteria can determine whether the electronic device is oriented in a portrait orientation with respect to a frame of reference (eg, Earth, ground), one or more biometric sensors are positioned on a particular side of the electronic device (eg, Earth, Earth) in a portrait orientation. is oriented (or positioned) on the side furthest away from), or whether the electronic device is oriented such that it is not approximately parallel to the ground. In some examples, the set of enrollment criteria includes a requirement that a major plane of the device be substantially aligned with a predetermined plane (eg, a plane substantially normal to the ground) such that the display of the device is substantially vertical. In some examples, the set of enrollment criteria is such that the major plane of the device is not resting on a horizontal surface while the device is attempting to enroll the biometric feature in a (second) predetermined plane (eg, a plane substantially parallel to the ground plane). ) and the requirement that they are not substantially aligned. In some examples, the set of enrollment criteria determines whether the electronic device is in a predetermined (eg, appropriate) orientation with respect to a biometric feature (eg, face) (eg, a major plane of the device (eg, defined by the display of the device). plane) is facing the biometric feature).

In some examples, initiating a process for registering a biometric feature with one or more biometric sensors includes successfully registering the biometric feature. In some examples, subsequent to successfully registering the biometric feature, the electronic device (eg, 100, 300, 500, 4200) prompts (eg, registers the biometric feature with one or more biometric sensors for a second time) 4222) is output (4312). In some examples, the electronic device outputs a prompt to register the biometric feature without prompting to change the orientation of the electronic device.

In some examples, initiating a process for registering a biometric feature with one or more biometric sensors includes successfully registering the biometric feature ( 4310 ). In some examples, subsequent to successfully registering the biometric feature, the electronic device (eg, 100, 300, 500, 4200) requests to perform an operation requiring authentication (eg, unlock the device (eg, in advance) Receive 4314 a request, a request to access a home screen (eg, 4244 ), to perform a swipe at a defined location. In some examples, in response to receiving 4316 a request to perform an action requiring authentication, and data obtained by the one or more biometric sensors correspond to (eg, with match) according to the determination, the electronic device performs an operation requesting authentication (4318). In some examples, in response to receiving a request to perform an action requiring authentication, the electronic device performs (or attempts to authenticate) authentication using one or more biometric sensors (eg, 4203 ). In some examples, in response to receiving 4316 a request to perform an action requiring authentication, and data obtained by the one or more biometric sensors does not correspond to the registered biometric feature (eg, the does not match) according to the determination, the electronic device withholds performing an operation requiring authentication ( 4320 ).

Note that the details of the processes described above with respect to method 4300 (eg, FIGS. 43A-43C ) are also applicable in a similar manner to the methods described above/below. For example, method 3700 , method 3900 , and/or method 4100 optionally includes one or more of the features of various methods described above with respect to method 4300 . For example, the processes described in method 4300 for registering a biometric feature include retrying biometric authentication in a passcode entry user interface, as described in method 3700 , for biometric authentication. may be used to register a face for future use in As another example, the registered face may be used to authorize payment for goods, as described in method 4100 . For the sake of brevity, these details are not repeated below.

The foregoing description, for purposes of explanation, has been described with reference to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings. The embodiments have been chosen and described in order to best explain the principles of the techniques and their practical applications. Accordingly, those skilled in the art will be able to best utilize the techniques and various embodiments with various modifications as are suited to the particular use contemplated.

While the present disclosure and examples have been fully described with reference to the accompanying drawings, it should be noted that various changes and modifications will become apparent to those skilled in the art. It is to be understood that such changes and modifications are included within the scope of the disclosure and examples as defined by the claims.

As noted above, one aspect of the present technology is the collection and use of data available from various sources to enhance delivery to users of invited content or any other content that users may be interested in. . This disclosure contemplates that, in some cases, such collected data may include personal information data that may be used to uniquely identify or contact or locate a particular individual. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, home addresses, or any other identifying information.

This disclosure recognizes that the use of such personal information data in the present technology can be used to benefit users. For example, personal information data may be used to deliver targeted content of greater interest to a user. Accordingly, the use of such personal information data enables calculated control of the delivered content. In addition, other uses for personal information data that benefit a user are also contemplated by this disclosure.

This disclosure further contemplates that entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information data will comply with well-established privacy policies and/or privacy practices. In particular, such entities must implement and continue to use privacy policies and practices that are generally recognized as meeting or exceeding industrial or administrative requirements for keeping personal information data private and secure. For example, personal information from users should be collected for lawful and appropriate uses of the entity and not shared or sold outside of these lawful uses. In addition, such collection should only occur after receiving informed consent from users. Additionally, such entities will take any necessary steps to protect and secure access to such personal information data and to ensure that others having access to personal information data adhere to their privacy policies and procedures. . In addition, such entities may themselves be assessed by third parties to prove their adherence to widely accepted privacy policies and practices.

Notwithstanding the foregoing, the present disclosure also contemplates embodiments in which a user selectively blocks access to, or use of, personal information data. That is, this disclosure contemplates that hardware and/or software elements may be provided to prevent or block access to such personal information data. For example, in the case of advertisement delivery services, the technology may be configured to allow users to select "I agree" or "I do not agree" to participate in the collection of personal information data during registration for the service. . In another example, users may choose not to provide location information for targeted content delivery services. In another example, users may choose not to provide accurate location information, but allow delivery of location zone information.

Accordingly, while this disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure recognizes that various embodiments may also be implemented without the need to access such personal information data. Also consider That is, various embodiments of the present technology are not rendered inoperable due to lack of all or a portion of such personal information data. For example, content may include non-personal data or minimal amounts of personal information, such as content requested by a device associated with a user, other non-personal information available for content delivery services, or publicly available information. It can be selected and communicated to users by inferring preferences based on it.

Claims (13)

As a method,
In an electronic device, the electronic device having a display and one or more biometric sensors;
displaying on the display a biometric registration user interface for initiating biometric registration using the one or more biometric sensors;
receiving, while displaying the biometric registration user interface, an input corresponding to a request to initiate biometric registration; and
In response to receiving the input:
in accordance with a determination that the orientation of the electronic device satisfies a set of enrollment criteria, initiating a process for registering a biometric feature using the one or more biometric sensors; and
in response to determining that the orientation of the electronic device does not satisfy the set of enrollment criteria, outputting one or more prompts to change the orientation of the electronic device to another orientation that satisfies the set of enrollment criteria;
How to include. According to claim 1,
The step of outputting the one or more prompts comprises:
outputting a first prompt to orient the electronic device in an initial orientation; and
subsequent to outputting the first prompt, outputting a second prompt to orient the electronic device in the other orientation that satisfies the set of enrollment criteria, wherein the first prompt is different from the second prompt comprising - a method. According to claim 1,
Outputting the one or more prompts includes outputting a third prompt to rotate the electronic device to the other orientation satisfying the set of enrollment criteria, the third prompt receiving the input based on the orientation of the electronic device during According to claim 1,
Outputting the one or more prompts includes outputting a fourth prompt to rotate the electronic device to the other orientation satisfying the set of enrollment criteria, the fourth prompt being in a predetermined plane. based on the alignment of the major plane of the device with respect to According to claim 1,
subsequent to initiating the process for registering the biometric feature, receiving a request to perform an action requiring authentication;
in response to receiving a request to perform an operation requiring authentication, attempting authentication using the one or more biometric sensors; and
After attempting authentication using the one or more biometric sensors, in accordance with a determination that data obtained by the one or more biometric sensors correspond to less than a threshold amount of biometric features, withhold retrying authentication step to do
How to further include 6. The method of claim 5,
after attempting authentication using the one or more biometric sensors, in accordance with a determination that data obtained by the one or more biometric sensors correspond to at least a threshold amount of biometric features, retrying authentication How to include it. 7. The method of claim 6,
The step of retrying the authentication is
performing an operation corresponding to the request according to a determination that the authentication is successful by retrying the authentication; and
suspending performing an operation corresponding to the request according to a determination that authentication by retry of authentication is not successful;
How to include. According to claim 1,
Subsequent to outputting one or more prompts to change the orientation of the electronic device to another orientation that satisfies the set of enrollment criteria:
detecting that the current orientation of the electronic device satisfies the set of enrollment criteria; and
in response to determining that the current orientation of the electronic device satisfies the set of enrollment criteria, further comprising initiating a process for registering the biometric feature with the one or more biometric sensors. . According to claim 1,
Initiating a process for registering a biometric feature using the one or more biometric sensors comprises successfully registering the biometric feature;
The method also includes, subsequent to successfully registering the biometric feature, outputting a prompt to register the biometric feature for a second time using the one or more biometric sensors. . According to claim 1,
Initiating a process for registering a biometric feature using the one or more biometric sensors includes successfully registering the biometric feature, the method further comprising:
subsequent to successfully registering the biometric feature, receiving a request to perform an action requiring authentication;
In response to receiving a request to perform the action requiring authentication:
in response to determining that data obtained by the one or more biometric sensors corresponds to the registered biometric feature, performing an operation requiring the authentication; and
and in response to determining that the data obtained by the one or more biometric sensors does not correspond to the registered biometric feature, withholding from performing the action requiring authentication. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, comprising:
The one or more programs comprising instructions for performing the method of any one of claims 1 to 10, a computer readable storage medium. An electronic device comprising:
display;
one or more biometric sensors;
one or more processors; and
a memory storing one or more programs configured to be executed by the one or more processors
An electronic device comprising: the one or more programs comprising instructions for performing the method of any one of claims 1 to 10. An electronic device comprising:
display;
one or more biometric sensors; and
Means for carrying out the method of any one of claims 1 to 10
An electronic device comprising a.

Images