WO2019134116A1

WO2019134116A1 - Method for interacting with user interface, and terminal device

Info

Publication number: WO2019134116A1
Application number: PCT/CN2018/071533
Authority: WO
Inventors: 王骐骥; 李厚辰
Original assignee: 深圳市汇顶科技股份有限公司
Priority date: 2018-01-05
Filing date: 2018-01-05
Publication date: 2019-07-11
Also published as: CN108235814B; CN108235814A

Abstract

A method for interacting with a user interface, and a terminal device, being capable of improving user experience. The method is applied to a terminal device comprising a fingerprint apparatus. A valid fingerprint detection area of the fingerprint apparatus is at least partially located in the display area of the screen of the terminal device. The method comprises: receiving a first operation instruction from a user, the first operation instruction being used to instruct a user interface response of a fingerprint area guide icon of the screen to be disabled, the fingerprint area guide icon being used to indicate, under an enabled state, the valid fingerprint detection range of the fingerprint apparatus (S310); and according to the first operation instruction, disabling the user interface response of the fingerprint area guide icon (S320).

Description

User interface interaction method and terminal device

Technical field

The present application relates to the field of electronic devices, and more particularly, to a user interface (UI) interaction method and terminal device.

Background technique

In the current screen module fingerprint scheme, the fingerprint module can be installed under the display screen of the terminal device. In order to facilitate the user to perform fingerprint pressing, a fingerprint area guiding icon is usually displayed on the screen for indicating the installation of the fingerprint module. Location to guide the user to fingerprint press.

In order to receive the user's pressing operation and trigger the fingerprint module to perform fingerprint collection, the fingerprint area guiding icon needs to be displayed on the uppermost layer of the user interface (UI) layout of the entire screen, so that if the fingerprint area guides the icon and other applications The icons are overlapped. When the user wants to operate the icon or interface of the application that overlaps with the fingerprint area guide icon, the response is the UI of the fingerprint module, not the UI of the application, affecting the user experience.

Summary of the invention

The embodiment of the present application provides a method for user interface interaction and a terminal device, which can improve user experience.

In a first aspect, a method for user interface interaction is provided, the method being applied to a terminal device including a fingerprint device, wherein a fingerprint effective detection area of the fingerprint device is at least partially located in a display area of a screen of the terminal device, Methods include:

Receiving a first operation instruction of the user, the first operation instruction is used to indicate a user interface response of the fingerprint area guiding icon for enabling the screen, wherein the fingerprint area guiding icon is used to indicate the Describe the effective detection range of the fingerprint device;

Deactivating the user interface response of the fingerprint area guide icon according to the first operation instruction.

Therefore, in the method of user interface interaction of the embodiment of the present application, when receiving the first operation instruction of the user, the terminal device may disable the UI response of the fingerprint area guiding icon, and further, after receiving the conflict with the fingerprint device. When an application's access request is made, it can respond to the application's access request instead of responding to the fingerprint device's access request, which can improve the user experience.

Optionally, in the embodiment of the present application, the first operation instruction may be a specific gesture (for example, a S-shaped, Z-shaped gesture, or the like), or a specific button (for example, a return key), Alternatively, the specific area or the like is clicked (for example, clicked, double-clicked, or long-pressed), and the embodiment of the present application does not limit this.

Optionally, in the embodiment of the present application, after the UI response of the fingerprint area guiding icon is disabled, the terminal device may further control the fingerprint device to be in a sleep state, thereby reducing power consumption of the terminal device, when receiving the user The terminal device may enable the UI response of the fingerprint area guiding icon when the second operation instruction of the UI response of the fingerprint area guiding icon is enabled, and further, the terminal device may further wake up the Fingerprint device.

In conjunction with the first aspect, in some implementations of the first aspect, the method further comprises:

After the user interface response of the fingerprint area guiding icon is disabled, receiving an access request of the user to the application, the icon or interface of the application at least partially overlapping with the fingerprint area guiding icon before de-enabling;

The user interface of the application is responsive to the access request.

Receiving a second operation instruction of the user, where the second operation instruction is used to indicate a user interface response that enables the fingerprint area guidance icon;

And according to the second operation instruction, enabling a user interface response of the fingerprint area guide icon.

Optionally, in the embodiment of the present application, the second operation instruction may also be a specific gesture (for example, a S-shaped, Z-shaped gesture, or the like), or a specific button (for example, a return button). The specific area or the like is not limited by the embodiment of the present application, for example, by clicking, double-clicking, or long-pressing.

Receiving a pressing operation of the fingerprint area guiding icon by the user;

The user interface of the fingerprint area guiding icon is responsive to the pressing operation, and performs fingerprint collection by the fingerprint device.

Therefore, after the user interface interaction method of the embodiment of the present application is configured to enable the UI response of the fingerprint area guide icon, the terminal device may further receive a second operation instruction of the user, enable the fingerprint area guide icon, and further The fingerprint image can be collected by the fingerprint device when the user presses the fingerprint area guide icon.

In conjunction with the first aspect, in some implementations of the first aspect, the UI response to disable the fingerprint area guide icon is one of:

Hiding the fingerprint area guide icon, zooming out the fingerprint area guide icon, displaying the fingerprint area guide icon in a floating icon, setting a user interface of the fingerprint device to be under the user interface of the application, and virtualizing The fingerprint area guide icon is displayed in a button manner.

In conjunction with the first aspect, in some implementations of the first aspect, the UI response enabling the fingerprint area guide icon is one of:

The fingerprint area guide icon is displayed, the fingerprint area guide icon is enlarged, and the user interface of the fingerprint device is set to be in an upper layer of a user interface of the application.

A second aspect provides a terminal device, including a fingerprint device and a processor, wherein a fingerprint effective detection area of the fingerprint device is at least partially located in a display area of a screen of the terminal device;

The processor is operative to perform the method of the first aspect or any one of the possible implementations of the first aspect.

In a third aspect, a computer readable medium storing program code for execution by a terminal device, the program code comprising instructions for performing the method of the first aspect.

In a fourth aspect, a computer program product is provided, the computer program product comprising: computer program code, when the processor of the computer program code terminal device is in operation, causing the terminal device to perform the first aspect or the first aspect A method in a possible implementation.

DRAWINGS

FIG. 1 is a schematic flowchart of a method for user interface interaction according to an embodiment of the present application.

FIG. 2 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

3 is a schematic diagram of an implementation of a UI response to enable a fingerprint area guide icon.

4 is a schematic diagram of a state of the fingerprint area guiding icon after the UI response of the fingerprint area guiding icon is disabled.

5 is a schematic diagram of an implementation of a UI response that enables a fingerprint area guide icon.

FIG. 6 is a schematic block diagram of a terminal device according to an embodiment of the present application.

FIG. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

Detailed ways

The technical solutions of the embodiments of the present application are described below with reference to the accompanying drawings of the embodiments of the present application.

As a common application scenario, the method for user interface interaction involved in the embodiments of the present application may be applied to a smart phone, a tablet computer, and other mobile terminals or other terminal devices having a display screen; more specifically, in the foregoing terminal device, The fingerprint recognition system may be specifically an optical fingerprint system or an ultrasonic fingerprint system, which may be disposed in a partial area or an entire area below the display screen to form an under-display fingerprint system.

FIG. 7 is a schematic structural diagram of a terminal device applicable to an embodiment of the present application. The fingerprint identification system of the terminal device 100 uses an optical fingerprint system as an example, and includes a display screen 120 and an optical fingerprint device 130. The optical fingerprint device 130 is disposed at least in a partial area below the display screen 120. The optical fingerprint device 130 may be an optical fingerprint sensor, which includes a sensing array having a plurality of optical sensing units, and the sensing array is located in the fingerprint identification area 103 of the optical fingerprint device 130. As shown in FIG. 1 , the fingerprint identification area 103 is located in the display area 102 of the display screen 120. Therefore, when the user needs to unlock the terminal device or perform other fingerprint verification, the user only needs to press the finger. Fingerprint input can be implemented in the fingerprint recognition area 103 of the display screen 120. Since the fingerprint detection can be implemented in the screen, the terminal device 100 adopting the above structure does not need to reserve a space for setting a fingerprint button (such as a Home button) on the front side, so that a full screen scheme, that is, a display area of the display screen 120 can be adopted. The 102 can be substantially extended to the front of the entire terminal device 100. It should be understood that in other alternative embodiments, the fingerprint identification system of the terminal device 100 may also adopt an ultrasonic or other type of fingerprint recognition system. Correspondingly, the optical fingerprint sensor may adopt an ultrasonic fingerprint sensor or other types of fingerprints. Instead of the sensor, the present application does not specifically limit the type of the fingerprint sensor, as long as the above fingerprint sensor can meet the performance requirements of the fingerprint recognition under the screen.

In an optional embodiment, the display screen 120 may be a self-illuminating display screen, which adopts a self-luminous display unit as a display pixel, such as an Organic Light-Emitting Diode (OLED) display or Micro-LED display. Taking an OLED display as an example, the optical fingerprint device 130 can utilize an OLED display unit (ie, an OLED light source) of the OLED display 120 located in the fingerprint recognition area 103 as an excitation light source for optical fingerprint detection. Moreover, the sensing array of the optical fingerprint device 130 is specifically a photo detector array including a plurality of photodetectors distributed in an array, and the photodetectors can be used as the optical sensing unit as described above. When a finger touches, presses, or approaches (collectively referred to as touch for convenience of description) in the fingerprint recognition area 103, the light emitted by the display unit of the fingerprint recognition area 103 reflects on the fingerprint of the finger surface and forms reflected light. The reflected light of the ridges and valleys of the fingerprint of the finger is different, and the reflected light is received from the display screen 120 and received by the photodetector array and converted into a corresponding electrical signal, that is, a fingerprint detection signal. Fingerprint image data can be obtained based on the fingerprint detection signal, and fingerprint matching verification can be further performed, thereby implementing an optical fingerprint recognition function at the terminal device 100.

In other alternative embodiments, the optical fingerprint device 130 may also be disposed over the entire area below the display screen 120, thereby extending the fingerprint identification area 103 to the entire display area 102 of the display screen 120, Full screen fingerprint detection. Alternatively, the optical fingerprint device 130 may also be disposed in a predetermined area inside the terminal device 100, such as an edge region of the terminal device 100, and a light guiding structure is disposed under the display screen 120 to reflect the surface of the finger. Light is directed to the sensing array of the optical fingerprint device 130.

It should be understood that, in a specific implementation, the terminal device 100 further includes a transparent protective cover 110, and the cover plate 110 may be a transparent cover plate, such as a glass cover or a sapphire cover, which is located on the display screen. Above the 120 and covering the front side of the terminal device 100. Therefore, in the embodiment of the present application, the so-called finger touching the display screen 120 actually refers to a finger touching the cover plate 110 above the display screen 120 or covering the surface of the protective layer of the cover plate 110. In addition, the terminal device 100 may further include a touch sensor, which may be specifically a touch panel, which may be disposed on the surface of the display screen 120, or may be partially or integrally integrated into the display screen 120, that is, The display screen 120 is specifically a touch display screen.

As an alternative implementation, as shown in FIG. 1, the optical fingerprint device 130 may include an optical component 132 and an optical detection unit 134; the optical component 132 may include an optical path modulator and a filter layer, wherein The optical path modulator may include an array of vias, and the filter layer may be disposed under the optical path modulator. The light emitted by the display screen 120 is reflected on the surface of the finger to be detected above the display screen 120. The light path modulator collimates and modulates the reflected light reflected from the surface of the finger through the array of through holes, and reflects the reflected light. Guided to the filter layer, the reflected light is filtered by the filter layer and then received by the optical detecting unit 134. The optical detecting unit 134 can further detect the received reflected light to implement fingerprint recognition. It should be understood that the above optical fingerprint device 130 is merely an exemplary structure. In a specific implementation, the position of the filter layer of the optical component 132 is not limited to the optical path modulator; for example, in an alternative In an embodiment, the filter layer may also be disposed between the optical path modulator and the display screen 120, that is, above the optical path modulator; or the optical component 132 may include two layers of filter layers. Both are disposed above and below the optical path modulator, respectively. In other alternative embodiments, the filter layer can also be integrated into the optical path modulator, or even omitted. This application does not limit this.

In a specific implementation, the optical component 132 may be packaged in the same optical fingerprint chip as the optical detecting unit 134, or may be installed inside the optical fingerprint module as a component independent of the optical detecting unit 134. The optical path modulator may be specifically a collimator layer or a lens (Lens) layer made of a semiconductor silicon wafer or a silicon oxide or a nitride, and has a plurality of collimating units or lens units. The collimating unit or the lens unit may be used as a modulating unit of the optical path modulator. Specifically, the modulating unit may be specifically a through hole having a high aspect ratio, so that the plurality of collimating units or lens units may constitute The above-mentioned via array of the optical path modulator. In the reflected light reflected from the finger, the light incident on the modulation unit can pass through and be received by the optical sensing unit below it, and each optical sensing unit can basically receive the through hole above it. The fingerprint pattern reflects the light so that the sensing array can detect the fingerprint image of the finger.

In the optical fingerprint device 130, each modulation unit of the optical path modulator may respectively correspond to one of the optical sensing units of the sensing array; alternatively, the modulation unit and the optical sensing unit of the sensing array A non-one-to-one correspondence may also be used to reduce the occurrence of moiré interference. For example, an optical sensing unit may correspond to a plurality of modulation units, or the modulation unit may also be implemented in an irregular arrangement. There is no specific correspondence between the optical sensing units of the array. When the modulation unit of the optical path modulator adopts an irregular arrangement, the optical fingerprint device 130 can correct the reflected light detected by each sensing unit by a post-software algorithm.

It should be understood that although the above-described optical under-screen fingerprinting scheme makes it possible to implement the fingerprint recognition function inside the display screen 120 in the terminal device 100, in some application scenarios, the optical fingerprint device 130 may simply A partial area of the display screen 120 is disposed, or a fingerprint detection effective range of the optical fingerprint device 130 covers only a partial area of the display screen 120. In this case, the user of the terminal device 100 cannot perceive the fingerprint detection effective range of the display screen 120, and if the user performs the fingerprint recognition operation, the finger deviates from the operation area of the display screen 120. If the fingerprint detection is valid, the optical fingerprint device 130 may not detect the fingerprint information of the user normally. Therefore, the user may need to try the fingerprint identification area multiple times, which not only affects the fingerprint detection efficiency of the terminal device. It also reduces the user experience. Therefore, as a solution, the embodiment of the present application first provides a user interface interaction method, which is designed and implemented by a user interface (also referred to as a user interface, hereinafter referred to as UI) of the terminal device 100, and implemented in the The fingerprint detection effective range of the display screen 120 provides a fingerprint area guiding icon to guide the user to perform fingerprint input in the fingerprint detection effective range.

1 is a schematic flowchart of a method for UI interaction according to an embodiment of the present application, the method is applied to a terminal device including a fingerprint device, and a fingerprint effective detection region of the fingerprint device is at least partially located on a screen of the terminal device. Display area. Optionally, the fingerprint device may be a screen fingerprint device (such as an optical fingerprint device or an ultrasonic fingerprint device) disposed under a screen of the terminal device, such as an OLED display or an LCD display.

As shown in FIG. 1, the UI interaction method includes the following contents:

S310. Receive a first operation instruction of the user, where the first operation instruction is used to indicate a user interface response of the fingerprint area guiding icon to enable the screen, wherein the fingerprint area guiding icon is used in an enabled state. Indicating a valid detection range of the fingerprint of the fingerprint device;

S320. According to the first operation instruction, the user interface response of the fingerprint area guiding icon is disabled.

It should be understood that the screen of the embodiment of the present application may be the display screen 120 as shown in FIG. 7, and the fingerprint device may be a screen fingerprint device, such as the optical fingerprint device 130 shown in FIG. 7 or other types of fingerprint devices. Set at the bottom (or back) of the screen of the terminal device. When the fingerprint recognition function needs to be enabled, the display driving module of the terminal device can drive the screen to display a fingerprint area guiding icon in the fingerprint effective detection area, and is used to guide the user to perform fingerprint pressing input in the fingerprint effective detection area, that is, the The fingerprint area guiding icon can be used to indicate the fingerprint effective detection area, such as the installation position of the fingerprint device below the screen. The fingerprint device may collect a fingerprint image of the user during a fingerprint press input process in the fingerprint effective detection area. Further, the terminal device may perform fingerprint identification according to the collected fingerprint image to implement user identity verification, and the fingerprint The recognition result can also be used to trigger other functions. For example, the contact, the business card holder, or the hidden application can be quickly searched according to the fingerprint recognition result. The effect of the fingerprint identification result is not specifically limited in the embodiment of the present application. In other alternative embodiments, the fingerprint device may also employ an in-screen fingerprint device, ie, integrate the fingerprint device into the display screen.

In general, when the fingerprint area guide icon is displayed on the screen of the terminal device, there may be a case where an icon or an interface of some applications overlaps with the fingerprint area guide icon, where the overlap may refer to partial overlap. It may also mean that all overlap, that is, the UI of the fingerprint device and the UI of the above application conflict. When the user wants to operate the icon or interface of the application covered by the fingerprint area guiding icon to access the corresponding application, since the UI of the fingerprint device is at the upper layer of the UI of the application, the user is at this time The operation of the icon of the application or the area where the interface is located actually triggers the UI of the fingerprint device to respond, but the UI of the application that actually needs to operate cannot respond normally, thereby affecting the user experience.

In the embodiment of the present application, when the user wants to operate an icon or an interface of an application covered by the fingerprint area guiding icon, the user may first provide a first operation instruction to the terminal device, where the terminal device After receiving the first operation instruction of the user, it may be determined that the user wants to enable the UI response of the fingerprint area guiding icon, and further, the terminal device may control the fingerprint area guiding icon to be in a de-enabled state, wherein The fact that the fingerprint area guiding icon is in the de-enabled state means that the UI of the fingerprint device does not respond to the user's operation. For example, as an implementation manner, the operating system of the terminal device may be configured with a fingerprint identification middleware (Middleware), and the fingerprint driving unit is prohibited by the middleware to prohibit the UI of the fingerprint device from responding to the operation of the user. . In this way, when the user operates the icon or interface of the application of the fingerprint effective detection area, the UI of the application is responded to the user's operation, instead of the UI of the fingerprint device, so that the user can implement the user The access to the application helps to improve the user experience.

It should be understood that, in the embodiment of the present application, the UI of the fingerprint device is a medium for interaction between the user and the fingerprint device hardware, that is, the user can operate the hardware of the fingerprint device by operating the UI of the fingerprint device. The presentation form of the UI of the fingerprint device may be a graphical user interface displayed on the screen, for example, the fingerprint area guiding icon, that is, the user may operate the fingerprint area guiding icon to achieve the purpose of operating the fingerprint device hardware. . Specifically, when the fingerprint identification function of the terminal device is turned on, the terminal device may provide a UI of the fingerprint device by using a fingerprint area guiding icon of the screen, and when the user touches or presses the fingerprint guiding icon, The UI of the fingerprint device may be triggered to respond, and the hardware of the fingerprint device is turned on to implement fingerprint collection of the user. Similarly, the UI of the application is a medium for interaction between the user and the application, and the expression may be an icon or an interface of the application displayed on the screen, that is, the user may operate the application. The icon or interface reaches the purpose of interacting with the application.

It should be noted that, in this embodiment of the present application, the application scenario of the first operation instruction is not particularly limited, and the user may execute the first operation instruction when you want to access an application covered by the fingerprint area guide icon. The UI response of the fingerprint area can be guided by the fingerprint area. Optionally, the user may perform the first operation instruction to disable the UI response of the fingerprint area guiding icon in other scenarios, for example, the user may perform the method when determining that the fingerprint collection function is not required to be used. The first operation instruction, when the terminal device receives the first operation instruction of the user, disables the UI response of the fingerprint area guide icon.

Further, the terminal device may further control the fingerprint device to enter a sleep state while disabling the UI response of the fingerprint region guide icon, thereby reducing power consumption of the terminal device, when receiving the user-provided When the fingerprint area can guide the second operation instruction of the UI response of the icon, the terminal device can enable the UI response of the fingerprint area guiding icon, that is, turn on the UI of the fingerprint device so that it can respond to the user in the The input operation of the fingerprint area guide icon, further, the terminal device may also wake up the fingerprint device at the same time as or after the fingerprint area guide icon is enabled.

It should be understood that, after the fingerprint device is awakened, the fingerprint device is in an active state, so that when the user touches or presses the fingerprint region guiding icon by a finger, the fingerprint device can perform fingerprint collection; When the fingerprint device is in the sleep state, even if the finger touches or presses the fingerprint area guide icon, the UI of the fingerprint device cannot respond, and thus the fingerprint device does not perform fingerprint collection. Therefore, controlling the fingerprint device to be in a sleep state when fingerprint collection is not required is beneficial to reducing power consumption of the terminal device.

Optionally, in the embodiment of the present application, the UI response of the de-enabled fingerprint area guiding icon (or controlling the fingerprint area guiding icon to be in a non-enabled state) may be adopted such that the fingerprint area guiding icon and The implementation of the application does not specifically limit the implementation of the icon or the interface of the application. For example, the fingerprint area guide icon may be hidden, or the fingerprint area guide icon may be reduced such that an icon or interface of an application is not covered by the fingerprint area guide icon, or the fingerprint area guide icon may be set to Floating the icon so that the fingerprint area guiding icon can be arbitrarily dragged, for example, the fingerprint area guiding icon can be moved to the edge position of the screen to avoid occluding the icon or interface of the application, or Displaying the fingerprint area guiding icon in a virtual button manner, that is, the fingerprint area guiding icon may be displayed at a specific position (for example, a bottom side edge of the screen), and when the fingerprint area guiding icon is not operated, the Fingerprint area guide icon.

Optionally, the disabling the UI response of the fingerprint area guiding icon may further comprise setting the UI of the fingerprint device to be in a lower layer of the UI of the application, as described above, because the fingerprint is implemented The UI of the device may be responsive to a fingerprint input operation of the user in the fingerprint area guiding icon on the UI layout, where the UI of the fingerprint device is generally set in the UI layout of the entire screen when the fingerprint area guiding icon is enabled The uppermost layer, so the operation of the icon or interface of the application that is covered by the fingerprint area guiding icon by the user may not be responsive to the application, and therefore, when the terminal device determines the user according to the first operation instruction When it is desired to enable the UI response of the fingerprint area guide icon, the terminal device may set the UI of the fingerprint device to the lower layer of the UI of the application. In this way, when the user operates the icon or interface of the application that overlaps with the fingerprint area guiding icon, the UI of the application can be triggered to respond, and the UI of the fingerprint device is prevented from being mis-responsive, thereby enabling Implementing user access to the application helps to improve the user experience.

It should be understood that in this implementation, since the UI of the fingerprint device is set to be in the lower layer of the UI of the application, the response is the UI of the application, which is equivalent to the fingerprint area located below the UI of the application. The UI response of the boot icon is disabled. In an implementation manner, the terminal device may also set the fingerprint area guiding icon to a state in which the UI response is prohibited by the operating system. Further, the terminal device may further set the fingerprint device to be in a sleep state to reduce The power consumption of the terminal device.

It should be noted that, in the embodiment of the present application, after performing the UI response to disable the fingerprint area guiding icon, in some cases, for example, hiding the fingerprint area guiding icon may prevent the user from operating the fingerprint area. The icon is displayed; however, in other cases, the user can still perform other auxiliary operations on the fingerprint area guiding icon. For example, after the fingerprint area guiding icon is set as a floating icon, the fingerprint area guiding icon can also be The drag operation is performed, except that the fingerprint area guide icon is in a floating state at this time, and the fingerprint area guide icon is not in the fingerprint effective detection area, and therefore, fingerprint collection cannot be performed. That is to say, the UI response to enable the fingerprint area guiding icon is actually in the de-enabled state, and the user cannot trigger the fingerprint device to perform fingerprint collection by pressing or touching the fingerprint area guiding icon.

Further, after the UI response of the fingerprint area guiding icon is disabled, the method may further include:

The user interface of the application is responsive to the access request.

Specifically, after the UI response of the fingerprint area guiding icon is disabled, the user can operate an icon or an interface of the application overlapping with the previous fingerprint area guiding icon, or an icon of another application of the screen or The interface, because the current fingerprint area guiding icon is in a de-enabled state, the current state of the fingerprint area guiding icon does not affect the user's access to the application, and therefore, the user's operation on the icon or interface of the application is responsive. Is the UI of the application, not the UI of the fingerprint device. The UI interaction method of the embodiment of the present application solves the problem of UI conflict between the fingerprint device of the terminal device and other applications, so that the fingerprint device and other applications can be better compatible.

It should be understood that since the fingerprint area guiding icon in the de-enabled state may be arbitrarily dragged in some cases, the position of the fingerprint area guiding icon in the de-enabled state may not indicate the fingerprint effective detecting area, That is, it cannot be used to guide the user to perform fingerprint pressing. However, when the fingerprint area guiding icon is in an enabled state (including before the fingerprint area guiding icon is disabled in the above S320), the location thereof may be used to indicate the fingerprint effective detecting area, and therefore, Used to guide the user to fingerprint press. Thus, the at least partial overlap of the icon or interface of the application with the fingerprint area guide icon prior to de-enable may mean that the icon or interface of the application at least partially overlaps the fingerprint valid detection area or the fingerprint collection area.

Therefore, in the UI interaction method of the embodiment of the present application, when receiving the first operation instruction of the user, the terminal device may disable the UI response of the fingerprint area guidance icon, and therefore, the UI of the icon is guided in the fingerprint area. After the response is de-enabled, upon receiving an access request with an application located in the fingerprint valid detection area, the application may respond to the access request while avoiding the fingerprint device from responding to the access request Can enhance the user experience.

Optionally, in some embodiments, the method may further include:

Specifically, the user may control the terminal device to enable the UI response of the fingerprint area guiding icon by providing a second operation instruction to the terminal device, and the UI response of the fingerprint area guiding icon is restored after being enabled. To indicate the fingerprint effective detection area; for example, if the fingerprint area guide icon is hidden or dragged to another location after being disabled, the fingerprint area guide icon is restored to the fingerprint effective detection area ( For example, the installation location of the fingerprint device). Further, after the fingerprint area guiding icon is enabled, the UI of the fingerprint device may respond to a user pressing or touching the fingerprint effective detecting area, and the terminal device may perform fingerprint collection by using the fingerprint device. Further, operations such as fingerprint recognition may be performed according to the collected fingerprint image.

By way of example and not limitation, if the fingerprint area guiding icon after being disabled is a floating icon, the second operation instruction may specifically restore the fingerprint area guiding icon to the original position by clicking the floating icon (ie, Deactivating the location of the previous fingerprint area guiding icon), or if the UI response of the fingerprint area guiding icon is disabled to hide the fingerprint area guiding icon, by pressing a hardware button (for example, a power button, The sound key or home button, or a software button (for example, a return key) or a specific gesture input means that the fingerprint area guide icon is displayed at the original position (ie, the position of the fingerprint area guide icon before the enable is disabled) Or, if the UI response to enable the fingerprint area guide icon is to reduce the fingerprint area guide icon, by pressing a hardware button (for example, a power button, a sound button or a Home button, etc.) or a software button (for example, returning) The key) or the manner in which the specific gesture is input causes the fingerprint area guide icon to return to the size before the de-enablement.

Hereinafter, the method for UI interaction in an embodiment of the present application is described in detail with reference to FIG. 2 to FIG. 5, taking the terminal device as a mobile phone as an example.

2 is a schematic structural diagram of a terminal device 200 according to an embodiment of the present application. The terminal device 200 may include a display screen 201 and a fingerprint device 202. The fingerprint device 202 is disposed under the display screen 201 or integrated into the display. The inside of the screen 201 is such that the fingerprint effective detection area of the fingerprint device 202 is located at at least part of the display area of the display screen 201, and the display screen 201 can display a fingerprint area guiding icon 203 for indicating the fingerprint device 202. The effective fingerprint detection area, it should be understood that the mounting position, size and shape of the fingerprint device 202 shown in FIG. 2, and the shape and size of the fingerprint area guiding icon 203 are merely examples and are not limited, as long as the The fingerprint area guiding icon 203 can indicate the fingerprint effective detection range.

When the user wants to access an application covered by the fingerprint area guiding icon, the user can execute a first operation instruction, for example, as shown in FIG. 3, making a specific gesture on the screen of the terminal device, thereby controlling the terminal The device goes to enable the fingerprint area boot icon. After the UI response of the fingerprint area guiding icon is disabled, the state of the fingerprint area guiding icon may be as described above, and FIG. 4 illustrates the fingerprint area guiding by taking the fingerprint area guiding icon as a floating icon. a de-enabled state of the icon, wherein the fingerprint area guiding icon is dragged to point to an edge position of the screen, so the user can operate on an icon or interface of the application of the fingerprint effective detecting area, and The UI of the application can respond to the user's actions and perform the function of the response.

When the user wants to use the fingerprint recognition function, the second operation instruction may be executed. For example, as shown in FIG. 5, the fingerprint area guiding icon in the floating state is clicked, thereby restoring the fingerprint area guiding icon to the original position and restoring. To the enabled state, the UI of the fingerprint device can respond to the user's operation of guiding the icon in the fingerprint region.

The method embodiment of the present application is described in detail with reference to FIG. 1 to FIG. 5 . Hereinafter, the device embodiment of the present application is described in detail with reference to FIG. 6 . It should be understood that the device embodiment and the method embodiment correspond to each other, and a similar description may be used. Refer to method embodiments.

FIG. 6 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in FIG. 6, the terminal device 600 includes a fingerprint device 601 and a processor 602, wherein at least part of the fingerprint effective detection area of the fingerprint device 601 is shown. a display area of a screen of the terminal device 600;

The processor 602 is configured to:

Receiving a first operation instruction of the user, the first operation instruction is used to indicate a user interface response of the fingerprint area guiding icon for enabling the screen, and the fingerprint area guiding icon is used to indicate the fingerprint in an enabled state The fingerprint of the device is effective to detect the range; and according to the first operation instruction, the user interface response of the fingerprint area guiding icon is disabled.

Optionally, in some embodiments, the processor 602 is further configured to:

After the user interface response of the fingerprint area guiding icon is disabled, receiving an access request of the user to the application, the icon or interface of the application at least partially overlapping with the fingerprint area guiding icon before de-enabling; And, responding to the access request by a user interface of the application.

Optionally, in some embodiments, the processor 602 is further configured to:

Receiving a pressing operation of the fingerprint area guiding icon by the user, and the user interface of the fingerprint area guiding icon is responsive to the pressing operation;

The fingerprint device is configured to perform fingerprint collection according to a response of the user interface of the fingerprint area guiding icon to the pressing operation.

Optionally, in some embodiments, the disabling the fingerprint area guiding icon is one of the following:

Optionally, in some embodiments, the enabling the fingerprint area guiding icon is one of:

Optionally, in the embodiment of the present application, the fingerprint device 601 of the embodiment of the present application may include an optical fingerprint sensor. For example, the screen of the terminal device may be an Organic Light-Emitting Diode (OLED) screen. Or other self-illuminating display device having a plurality of array-type self-illuminating pixel units, wherein the optical fingerprint sensor can implement optical fingerprint detection by using at least a portion of the self-illuminating pixel unit of the screen as a light source. Specifically, the light emitted by the light source can be reflected by the finger pressing the screen. Since the peak of the fingerprint and the light path corresponding to the grain are different, the peak and the grain of the finger fingerprint can be obtained by detecting the reflected light. The location of the valley is the fingerprint image. Alternatively, the optical fingerprint sensor itself may also include a light source and implement optical fingerprint detection using its own light source, in which case the screen may employ a non-self-illuminating display device, such as a liquid crystal display using backlight Device, etc.

Optionally, the terminal device 600 may further include a memory, the memory may be used to store a program, an instruction or a code, and the processor may execute a program, an instruction or a code stored in the memory, such that the terminal The device can perform the corresponding content in the foregoing method embodiments.

Optionally, in the embodiment of the present application, the functions performed by the processor 602 may be directly implemented by a hardware processor, or may be performed by a combination of hardware and software modules in the processor, or may be implemented by software. The module is executed to complete. The software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage medium may be located in a memory of the terminal device, and the processor may execute various functional applications or data processing in the terminal device by running a software program or module stored in the memory, the memory may be mainly The storage program area and the storage data area are included, wherein the storage program area can store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area can be stored according to the terminal device. Use the created data (such as audio data, phone book, etc.). Further, the memory may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

Optionally, the terminal device may be a mobile phone, a tablet computer, or the like, which is not limited in this embodiment of the present application.

The embodiment of the present application further provides a computer readable storage medium storing one or more programs, the one or more programs including instructions, when the portable electronic device is included in a plurality of applications When executed, the portable electronic device can be caused to perform the method of the embodiment shown in FIG.

The embodiment of the present application also proposes a computer program comprising instructions which, when executed by a computer, cause the computer to execute the corresponding flow of the method of the embodiment shown in FIG.

It should be understood that the term "and/or" herein is merely an association relationship describing an associated object, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists separately, and A and B exist simultaneously. There are three cases of B alone. In addition, the character "/" in this article generally indicates that the contextual object is an "or" relationship.

It should be understood that, in the various embodiments of the present application, the size of the sequence numbers of the foregoing processes does not mean the order of execution sequence, and the order of execution of each process should be determined by its function and internal logic, and should not be applied to the embodiment of the present application. The implementation process constitutes any limitation.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present application.

A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

The functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the technical solution of the present application, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

The foregoing is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application. It should be covered by the scope of protection of this application. Therefore, the scope of protection of the present application should be determined by the scope of the claims.

Claims

A method for user interface interaction, wherein the method is applied to a terminal device including a fingerprint device, wherein a fingerprint effective detection area of the fingerprint device is at least partially located in a display area of a screen of the terminal device, and the method includes :

Receiving a first operation instruction of the user, the first operation instruction is used to indicate a user interface response of the fingerprint area guiding icon for enabling the screen, wherein the fingerprint area guiding icon is used to indicate the Describe the effective detection range of the fingerprint device;

Deactivating the user interface response of the fingerprint area guide icon according to the first operation instruction.
The method of claim 1 further comprising:

After the user interface response of the fingerprint area guiding icon is disabled, receiving an access request of the user to the application, the icon or interface of the application at least partially overlapping with the fingerprint area guiding icon before de-enabling;

The user interface of the application is responsive to the access request.
The method according to claim 1 or 2, wherein the method further comprises:

Receiving a second operation instruction of the user, where the second operation instruction is used to indicate a user interface response that enables the fingerprint area guidance icon;

And according to the second operation instruction, enabling a user interface response of the fingerprint area guide icon.
The method of claim 3, wherein the method further comprises:

Receiving a pressing operation of the fingerprint area guiding icon by the user;

The user interface of the fingerprint area guiding icon is responsive to the pressing operation, and performs fingerprint collection by the fingerprint device.
The method according to claim 3 or 4, wherein said disabling said fingerprint area guide icon is one of:

Hiding the fingerprint area guide icon, zooming out the fingerprint area guide icon, displaying the fingerprint area guide icon in a floating icon, setting a user interface of the fingerprint device to be under the user interface of the application, and virtualizing The fingerprint area guide icon is displayed in a button manner.
The method according to claim 5, wherein said enabling said fingerprint area guide icon is one of:

The fingerprint area guide icon is displayed, the fingerprint area guide icon is enlarged, and the user interface of the fingerprint device is set to be on an upper layer of a user interface of the application.
A terminal device, comprising: a fingerprint device and a processor;

The fingerprint effective detection area of the fingerprint device is at least partially located in a display area of a screen of the terminal device;

The processor is used to:

Receiving a first operation instruction of the user, the first operation instruction is used to indicate a user interface response of the fingerprint area guiding icon for enabling the screen, and the fingerprint area guiding icon is used to indicate the fingerprint in an enabled state The fingerprint of the device is effective to detect the range; and according to the first operation instruction, the user interface response of the fingerprint area guiding icon is disabled.
The terminal device according to claim 7, wherein the processor is further configured to:

After the user interface response of the fingerprint area guiding icon is disabled, receiving an access request of the user to the application, the icon or interface of the application at least partially overlapping with the fingerprint area guiding icon before de-enabling; And, responding to the access request by a user interface of the application.
The terminal device according to claim 7 or 8, wherein the processor is further configured to:

Receiving a second operation instruction of the user, where the second operation instruction is used to indicate a user interface response that enables the fingerprint area guidance icon;

And according to the second operation instruction, enabling a user interface response of the fingerprint area guide icon.
The terminal device according to claim 9, wherein the processor is further configured to:

Receiving a pressing operation of the fingerprint area guiding icon by the user, and the user interface of the fingerprint area guiding icon is responsive to the pressing operation;

The fingerprint device is configured to perform fingerprint collection according to a response of the user interface of the fingerprint area guiding icon to the pressing operation.
The terminal device according to claim 9 or 10, wherein the disabling the fingerprint area guiding icon is one of the following:

Hiding the fingerprint area guide icon, zooming out the fingerprint area guide icon, displaying the fingerprint area guide icon in a floating icon, setting a user interface of the fingerprint device to be under the user interface of the application, and virtualizing The fingerprint area guide icon is displayed in a button manner.
The terminal device according to claim 11, wherein said enabling said fingerprint area guiding icon is one of:

The fingerprint area guide icon is displayed, the fingerprint area guide icon is enlarged, and the user interface of the fingerprint device is set to be in an upper layer of a user interface of the application.