WO2021218431A1

WO2021218431A1 - Password inputting method and terminal device

Info

Publication number: WO2021218431A1
Application number: PCT/CN2021/080264
Authority: WO
Inventors: 李丽君; 黄小宇; 董德强; 王锦锋; 刘晓丽
Original assignee: 百富计算机技术（深圳）有限公司
Priority date: 2020-04-26
Filing date: 2021-03-11
Publication date: 2021-11-04
Also published as: CN111580737A

Abstract

Provided are a password inputting method and a terminal device, suitable for the technical field of password auxiliary input. An auxiliary device matching a virtual keyboard is arranged on the terminal device, and comprises: a first frame provided with touch marks and a second frame provided with touch marks. The password inputting method comprises: after a first preset gesture that a visually impaired person performs sliding along a column where a target key is located after finding the column by touching the touch marks on the first frame, or a second preset gesture that the visually impaired person performs sliding along a row where the target key is located after finding the row by touching the touch marks on the second frame is detected, sending voice information; and after the second preset gesture is detected, inputting characters at contact positions of the first preset gesture, thereby assisting the visually impaired person in inputting a password by means of a touch screen.

Description

Password input method and terminal equipment

This application claims the priority of the Chinese patent application with application number 202010338676.7 filed at the Chinese Patent Office on April 26, 2020, the entire content of which is incorporated into this application by reference.

Technical field

This application belongs to the technical field of password-assisted input, and in particular relates to a password input method and terminal equipment.

Background technique

With the development of touch screen technology and device miniaturization, many devices have eliminated physical keyboards and used touch screens to display virtual keyboards to achieve the purpose of inputting characters. When using a physical keyboard to input a password, the visually impaired can set Braille on the physical keys of the physical keyboard, or set a mark on the physical key "5" as a guide to input the password.

However, when using a touch screen to display a virtual keyboard to input a password, the visually impaired cannot use a physical keyboard to input a password on a smooth touch screen. Therefore, there is an urgent need for a method that can assist the visually impaired to input a password on the touch screen.

technical problem

In view of this, the embodiments of the present application provide a password input method and terminal device, which can assist the visually impaired to input a password through a touch screen.

Technical solutions

The first aspect of the embodiments of the present application provides a password input method, which is applied to a terminal device, and the terminal device is provided with a touch screen for displaying a virtual keyboard and an auxiliary device matched with the virtual keyboard; the auxiliary device It includes: a first support, provided with touch marks for indicating the position of each row of keys on the virtual keyboard; a second support, connected to the first support, provided with a touch mark for indicating the positions of each row of keys on the virtual keyboard;

The password input method includes:

In the password-assisted input mode, displaying a virtual keyboard on the touch screen and monitoring gesture information on the touch screen, wherein the virtual keyboard has four rows and three columns;

If the monitored gesture information is the first preset gesture, the contact position of the first preset gesture is recorded, where the first preset gesture includes: the visually impaired touches the first bracket on the Touch the mark to find the column where the target button is located, and then make a gesture of sliding along the column where the target button is located, or the visually impaired can find the row where the target button is located by touching the touch mark on the second bracket, and then follow the target button. Swipe gestures on the line;

When the contact position of the first preset gesture is a character key, send out the first voice message;

After the end of the first preset gesture is monitored, if the detected gesture information is a second preset gesture, when the key corresponding to the last contact position of the first preset gesture is a character, enter the The character corresponding to the last contact position of the first preset gesture.

In a possible embodiment of the first aspect, if the detected gesture information is the first preset gesture, the method further includes:

When the contact position of the first preset gesture is an operation button, emitting a second voice message;

Correspondingly, if the detected gesture information is the second preset gesture, it also includes:

When the button corresponding to the last contact position of the first preset gesture is an operation button, an operation corresponding to the operation button is performed.

In a possible embodiment of the first aspect, the first preset gesture further includes: a click gesture;

When the first preset gesture is a sliding gesture, the contact position of the first preset gesture is the real-time position of the contact in the sliding gesture;

When the first preset gesture is a click gesture, the contact position of the first preset gesture is the position of the contact point in the click gesture;

The second preset gesture is a double-tap gesture.

In a possible embodiment of the first aspect, the first voice information corresponding to each character key is the same;

The second voice information corresponding to each operation button is the operation corresponding to the operation button.

In a possible embodiment of the first aspect, when the button corresponding to the last contact position of the first preset gesture is an operation button, performing an operation corresponding to the operation button includes:

When the key corresponding to the last contact position of the first preset gesture is confirming, upload all the characters that have been input as a password;

When the button corresponding to the last contact position of the first preset gesture is cancel, all characters that have been input are deleted.

In a possible embodiment of the first aspect, after inputting the character corresponding to the last contact position of the first preset gesture, the method further includes:

Send a third prompt message, where the third prompt message is used to prompt the user of the number of characters that have been input.

In a possible embodiment of the first aspect, the process of recording the contact position of the first preset gesture further includes:

When the position of the contact point of the first preset gesture is outside the virtual keyboard, send out fourth prompt information, where the fourth prompt information is used to prompt the user of the contact point of the first preset gesture The position is not in the area corresponding to the virtual keyboard and/or the positional relationship between the contact position of the first preset gesture and the area where the virtual keyboard is located.

In a possible embodiment of the first aspect, in the password-assisted input mode, the method further includes:

The fifth prompt information is played, where the fifth prompt information is used to prompt the layout of the virtual keyboard and the method of using the auxiliary device for password input.

In a possible embodiment of the first aspect, the number of touch marks on the first support is 3, and the number of touch marks on the second support is 4;

The touch mark is a raised mark;

In a possible embodiment of the first aspect, the mark indicating the second row and the mark indicating the second column of the touch marks are both double-bump marks;

In the touch marks, the marks indicating the first row, the third row, the fourth row, the first column, and the third column are all single-bump marks.

A second aspect of the embodiments of the present application provides a terminal device, including:

Touch screen for displaying virtual keyboard;

An auxiliary device matched with the virtual keyboard, the auxiliary device comprising: a first bracket provided with a touch mark for indicating the position of each column of the virtual keyboard; a second bracket connected to the first bracket, provided There is a touch mark used to indicate the position of each row of keys on the virtual keyboard;

A memory, a processor, and a computer program that is stored in the memory and can run on the processor; wherein the processor implements the method according to any one of claims 1 to 10 when the computer program is executed step.

An embodiment of the application provides a password input method, which is used on a terminal device with a touch screen. The touch screen can display a virtual keyboard when entering a password, and the terminal device is also provided with a virtual keyboard. A matching auxiliary device, the auxiliary device includes: a first bracket, provided with touch marks for indicating the position of each key of the virtual keyboard; a second bracket, connected with the first bracket, provided with a pointer for indicating the virtual keyboard The touch mark of each row of key positions; in the password-assisted input mode, when the password is input, a virtual keyboard is displayed on the touch screen, and gesture information on the touch screen is monitored, wherein the virtual keyboard is Four rows and three columns; the visually impaired can find the column where the target button is located by touching the touch mark on the first support, and then slide along the column where the target button is located, or the visually impaired can touch the second support After finding the row where the target button is located, slide along the row where the target button is located. When the contact position of the above sliding gesture is a character button, the first voice message will be emitted; the visually impaired will hear the first The number of a voice message determines the button corresponding to the current touch point. When the position of the touch point is the target button, the second preset gesture can be input on the touch screen. After the terminal device detects the second preset gesture, input sliding The character corresponding to the last touch point of the gesture. Through the above method, the visually impaired can independently input the password on the touch screen through the auxiliary device provided on the terminal device only according to the voice information and the first preset gesture and the second preset gesture.

It can be understood that, for the beneficial effects of the above-mentioned second aspect, reference may be made to the relevant description in the above-mentioned first aspect, which will not be repeated here.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only of the present application. For some embodiments, for those of ordinary skill in the art, other drawings may be obtained based on these drawings without creative labor.

FIG. 1 is a schematic diagram of the layout structure of a physical key provided by an embodiment of the present application;

2 is a schematic structural diagram of an auxiliary device provided by an embodiment of the present application;

3 is a schematic diagram of the distribution of positioning marks and guide marks in the auxiliary device provided in the embodiment of FIG. 2;

4 is a schematic structural diagram of another auxiliary device provided by an embodiment of the present application;

5 is a schematic structural diagram of another auxiliary device provided by an embodiment of the present application;

Fig. 6 is a schematic structural diagram of another auxiliary device provided by an embodiment of the present application;

FIG. 7 is a schematic diagram of the implementation process of a password input method provided by an embodiment of the present application;

FIG. 8 is a schematic block diagram of a terminal device provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of a terminal device provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of a terminal device provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of a terminal device provided by an embodiment of the present application.

Embodiments of the present invention

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are proposed for a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from obstructing the description of this application.

It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the existence of the described features, wholes, steps, operations, elements and/or components, but does not exclude one or more other features , The existence or addition of a whole, a step, an operation, an element, a component, and/or a collection thereof.

It should also be understood that the terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in the specification of this application and the appended claims, unless the context clearly indicates other circumstances, the singular forms "a", "an" and "the" are intended to include plural forms.

It should be further understood that the term "and/or" used in the specification and appended claims of this application refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations .

As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "once" or "in response to determination" or "in response to detection" depending on the context . Similarly, the phrase "if determined" or "if detected [described condition or event]" can be interpreted as meaning "once determined" or "in response to determination" or "once detected [described condition or event]" depending on the context ]" or "in response to detection of [condition or event described]".

In order to illustrate the technical solutions described in the present application, specific embodiments are used for description below.

Figure 1 is a relatively common layout of a physical keyboard. In the physical keyboard described in Figure 1, the first row is: "1", "2", and "3"; the second row is: "4" , "5", "6"; the third line is: "7", "8", "9"; the fourth line is: "cancel", "0", "confirm". It can be seen that the physical keyboard shown in Figure 1 is consistent with the layout of the standard telephone keys.

The password input method provided in the embodiment of this application is applied to a terminal device. The terminal device needs to be equipped with a touch screen that displays a virtual keyboard and an auxiliary device matching the virtual keyboard. Before introducing the password input method, first introduce this The password input method provided in the application embodiment requires matching auxiliary devices.

Fig. 2 is an auxiliary device provided by an embodiment of the present application, which is used to assist the visually impaired to input a password through a virtual keyboard displayed on a touch screen. The auxiliary device includes:

The first bracket 1 is provided with touch marks for indicating the positions of the keys of each column of the virtual keyboard; the second bracket 2 is connected with the first bracket 1 and is provided with touch marks for indicating the positions of the keys of each row of the virtual keyboard .

In the embodiment of the present application, the touch mark set on the first bracket may be recorded as the first mark 11, and the touch mark set on the second bracket may be recorded as the second mark 21.

In the embodiment of the present application, the visually impaired persons include: blind persons, visually impaired/color impaired persons, and the like. The auxiliary device needs to be used in conjunction with the virtual keyboard displayed on the touch screen. When the virtual keyboard is square or rectangular, the first bracket of the auxiliary device is used to be set on the upper or lower side of the virtual keyboard, so The second bracket of the auxiliary device is configured to be arranged on the left or right side of the virtual keyboard, and the first bracket and the second bracket may be fixedly connected or detachably connected.

The first bracket is provided with a first mark, and the first mark is a mark that can be used for touch recognition, for example, a convex point, a convex circle, a convex ring, a convex triangle, etc., need to be explained The first mark is used to indicate the position of each column of virtual keys in the virtual keyboard, and is not used to indicate the specific meaning of the virtual keys. In the same way, the second bracket is provided with a second mark, and the second mark is also a mark that can be used for touch recognition, for example, a convex point, a convex circle, a convex ring, a convex triangle, etc. The second mark is used to indicate the position of each row of virtual keys in the virtual keyboard, and is not used to indicate the specific meaning of the virtual keys. In view of the understanding of the first mark and the second mark, the first mark and the second mark may be the same mark or different marks, and there may be m first marks, where m The first marks may be the same mark or different marks, and there may be n second marks, where the n second marks may be the same mark or different marks.

The auxiliary device is used in conjunction with the virtual keyboard on the touch screen. Therefore, the layout of the virtual keyboard directly affects the positional relationship between the first mark and the second mark. As an example, when the virtual keyboard has three rows and four columns, the m=4 and n=3, and when the virtual keyboard has four rows and three columns, the m=3 and n=4. In the embodiment of the present application, in order to follow the user's past habits, such as getting used to the layout of the phone keys, the virtual keyboard can be set to the same layout as the physical keyboard shown in Figure 1. At this time, m=3, n=4 . In this way, the visually impaired can find the target button (the button that the visually impaired wants to find) according to their previous cognition of the standard phone buttons, which reduces the cost of learning the password input method provided by the embodiment of the application for the visually impaired, so that The visually impaired are easier to use.

Referring to FIG. 3, FIG. 3 is another auxiliary device provided by an embodiment of the application. In order to more clearly guide the visually impaired, the first mark 11 can also be divided into a first positioning mark 111 and a first guide mark 112 As shown in the figure, the first positioning mark 111 is a double convex point, and the first index mark 112 is a single convex point.

In the embodiment of the present application, the first positioning mark may be the first mark in the first mark, and the rest are first index marks; the first positioning mark may also be the mark in the first mark Marks at specific locations, and the rest are the first guide marks.

As an example, when the layout of the virtual keyboard and the physical keyboard shown in FIG. 1 are consistent, the first positioning mark 111 indicates the column where the character "5" is located, that is, it is used to indicate the first position in the virtual keyboard. The position of the virtual buttons in the second column.

In the same way, the second positioning mark 211 is a double convex point, the second index mark 212 is a single convex point, the second positioning mark may be the first mark in the second mark, and the rest are the first mark. Two index marks; the second positioning mark may also be a mark that identifies a specific position in the second mark, and the rest are second index marks.

As an example, when the layout of the virtual keyboard and the physical keyboard shown in FIG. 1 are the same, the second positioning mark 211 indicates the row where the character "5" is located, that is, it is used to indicate the second position in the virtual keyboard. The position of the second row of virtual buttons.

Fig. 4 is another auxiliary device provided by an embodiment of the present application, and the auxiliary device further includes:

The first bracket 1 is provided with m first marks 11 for touch recognition, wherein the first marks 11 are used to indicate the position of each column of virtual keys in the virtual keyboard;

The second bracket 2, which is connected to the first bracket 1, is provided with n second marks 21 for touch recognition, wherein the second marks 21 are used to indicate the position of each row of virtual keys in the virtual keyboard ；

The third bracket 3 is arranged in parallel with the first bracket 1 and connected to the second bracket 2;

with,

The fourth bracket 4 is arranged in parallel with the second bracket 2 and connected to the first bracket 1.

In the embodiment of the present application, the third bracket may not be provided with a third mark, and the third bracket is used as a supporting auxiliary device to balance the auxiliary device, or m third marks for touch recognition (which can be combined with the first The pattern and arrangement of the marks are exactly the same), the third mark is used to indicate the position of each column of virtual keys in the virtual keyboard, so that the visually impaired can touch the mark from the upper side or from the lower side to find each The specific location of each button.

In the same way, the fourth bracket may not be provided with a fourth mark, and the fourth bracket may be used as a supporting auxiliary device to balance the auxiliary device, or n fourth marks for touch recognition (which can be combined with the pattern of the second mark and the The arrangement is exactly the same), the fourth mark is used to indicate the position of each column of virtual keys in the virtual keyboard, so that the visually impaired can touch the mark from the left or right to find the position of each key. Specific location.

When the third bracket and the fourth bracket are included at the same time, the first bracket, the second bracket, the third bracket, and the fourth bracket form a frame, and when in use, the frame is provided with a virtual keyboard displayed on the touch screen All around.

Fig. 5 is another auxiliary device provided by an embodiment of the present application, and the auxiliary device includes:

The first bracket 1 is provided with m first marks 11 for touch recognition, wherein the first marks 11 are used to indicate the position of each column of virtual keys in the virtual keyboard 0;

The second bracket 2 is connected to the first bracket 1 and is provided with n second marks 21 for touch recognition, wherein the second marks 21 are used to indicate the number of virtual keys in each row of the virtual keyboard 0 Location;

The fourth bracket 4 is arranged in parallel with the second bracket 2 and connected to the first bracket 1, and is provided with m fourth marks 41 for touch recognition, wherein the fourth marks 41 are used to indicate The position of each column of virtual keys in the virtual keyboard 0.

In the embodiment of the present application, the auxiliary device may be a separate component as shown in FIG. 5, or it may be a housing of a terminal device. See FIG. 6, which is an auxiliary device provided by an embodiment of the present application. The left frame of the housing surrounding the touch screen of the terminal device is the second bracket, the right frame is the fourth bracket, and the lower frame is the first bracket. The first mark is arranged on the lower frame of the terminal equipment housing, the second mark is arranged on the left frame of the terminal equipment housing, and the fourth mark is arranged on the right frame of the terminal equipment housing.

As another embodiment of the present application, the auxiliary device may also include a first support, a second support, and a third support, but does not include the fourth support, which is not limited here.

FIG. 7 is a schematic diagram of the implementation process of a password input method provided by an embodiment of the present application. The password input method can be applied to a terminal device provided with any of the auxiliary devices provided in the embodiments of the present application, and the auxiliary device may With reference to the auxiliary device provided in any of the foregoing embodiments, details are not described herein again. As shown in the figure, the method includes:

Step S701: In the password-assisted input mode, display a virtual keyboard on the touch screen, and monitor gesture information on the touch screen, where the virtual keyboard has four rows and three columns.

In the embodiment of the present application, the password input method can have two input modes, one is a password-assisted input mode, in which the visually impaired is mainly assisted to input a password, and the other is a password-unassisted input mode. In the mode, people with normal vision can enter the password. Of course, for some visually impaired/color-impaired people, they can also enter the password in the password unassisted input mode.

The embodiment of the application focuses on the password input process in the password-assisted input mode. After entering the password-assisted input mode, a virtual keyboard is displayed on the touch screen, and gesture information on the touch screen can be monitored. The gesture information is a gesture implemented by the user through touch on the touch screen, for example, a single-click gesture, a sliding gesture, a double-click gesture, and the like.

As another embodiment of the present application, after entering the password-assisted input mode, the fifth prompt information may be played first, where the fifth prompt information is used to prompt the layout of the virtual keyboard and use the auxiliary device to perform passwords. Input method.

In the embodiment of the present application, in order for the visually impaired to input the password smoothly, the layout of the virtual keyboard and the method of password input can be played in advance.

For some visually impaired/color-impaired people who do not need to cooperate with auxiliary devices to enter a password, each character can be input by clicking. However, for some visually impaired/color-impaired people or blind people who need to cooperate with an auxiliary device to input a password, it is necessary to play the layout of the virtual keyboard and a method for password input through the auxiliary device.

As an example, the fifth prompt message is: please listen to the following voice prompt to perform a payment operation. The layout of the password keyboard is the same as that of the standard telephone keyboard. The keys 1, 2, and 3 are in the first row, and the cancel key, 0 number key and confirmation key are in the last row. The raised touch points around the keyboard will identify the position of the keyboard row and column, and the row and column where the number button ‘5’ is located are marked with double dots. The voice feedback of the number keys is a beep, and the confirmation key and the cancel key will have voice prompts "confirm" and "cancel". Please use your finger to slide your finger on the touch screen according to the position marked by the touch point, and identify the number buttons according to the buzzer feedback. After finding the target number, lift your finger and double-tap anywhere on the screen to enter the number. After entering all the password numbers, move to the lower right corner of the keyboard to find the confirmation key. After hearing the voice "confirm", lift your finger and double-tap anywhere on the screen to confirm the input. The cancel key is at the lower left corner of the keyboard. Entering the cancel key will cancel all the numbers that have been entered and cancel the current transaction. Please insert a card at the top (or bottom) of the device to start payment.

Step S702: If the monitored gesture information is a first preset gesture, record the contact position of the first preset gesture, where the first preset gesture includes: the visually impaired person touches the first preset gesture After the touch mark on the bracket finds the column where the target button is located, slide the gesture along the column where the target button is located, or a visually impaired person finds the row where the target button is located by touching the touch mark on the second bracket, and then moves along Swipe gesture to the row where the target is located.

In the embodiment of the present application, as described in step S701, each character can be input by a single click, that is, the first preset gesture includes: a single click gesture. When a visually impaired person needs to input characters with the cooperation of an auxiliary device, the first preset gesture may also be a sliding gesture, for example, the first preset gesture may be: a sliding starting from the edge of the virtual keyboard gesture. This is because the visually impaired need to find the corresponding row or column from the touch mark of the auxiliary device, and then slide into the virtual keyboard area displayed on the touch screen to find the character to be input or the operation to be performed.

The contact position of the first preset gesture is the real-time position of the contact in the sliding gesture. When the first preset gesture is a sliding gesture, as the sliding progresses, the real-time position of the corresponding touch point will change, and the real-time position of the touch point is the position of the end point in the real-time sliding track corresponding to the first preset gesture . Similarly, when the first preset gesture is a click gesture, the contact position of the first preset gesture is the position of the contact point in the click gesture.

It should be noted here that when the auxiliary device includes: a third support and/or a fourth support, the first preset gesture may also include: the visually impaired person finds the target by touching a touch mark on the third support After the column where the key is located, perform a sliding gesture along the column where the target key is located; and/or, after the visually impaired person finds the row where the target key is located by touching the touch mark on the fourth bracket, follow the row where the target key is located Perform a swipe gesture.

Step S703: When the contact position of the first preset gesture is a character button, a first voice message is sent out.

In the embodiment of the present application, the character keys are keys corresponding to the numbers 0 to 9 respectively. When the user (the visually impaired) slides through the area of the virtual keyboard with his fingers, if the touch position of the sliding gesture is a character button, the first voice message can be sent out. For safety reasons, the first voice message may not be Prompt the specific character corresponding to the contact position, but feedback the current contact position corresponding to the character with an undifferentiated buzzer. When the contact position is switched to the position of another character, the current contact will be fed back again with a buzzer The position corresponds to the character. Therefore, the first voice information corresponding to each character key may be the same.

As an example, when a visually impaired person needs to input the character "2", he can find the uppermost touch mark on the second bracket by touching the touch mark on the second bracket on the left side of the auxiliary device, that is, find the target Press the row where the button "2" is located, and then slide it horizontally to the right along the row where the "2" is located. After sliding to the position where the virtual button "1" is located, the first voice prompt message (such as a buzzer) will be issued. When the visually impaired person knows that the current finger position is the virtual button "1", the visually impaired person knows that the target button "2" is to the right of the virtual button "1" by virtue of their understanding of the layout of the virtual keyboard. The disabled can continue to slide to the right horizontally, and when they hear the first voice information prompt (buzzer) again, they will know that the current position of the finger is the target button "2". Of course, in practical applications, the visually impaired can also find the row where the target button "2" is located by touching the touch mark on the fourth bracket on the right side of the assistive device, and then slide horizontally to the left to find the target button "2" "The specific location. In the same way, the visually impaired can also find the touch mark in the middle (ie the column where the target button "2" is located) by touching the touch mark on the first bracket on the lower side of the auxiliary device, and then follow the "2" position. Slide the column up vertically. When you hear the fourth first voice message (0-8-5-2), you know that the current position of your finger is the position of the target button "2".

As another embodiment of the present application, when the contact position of the first preset gesture is an operation button, the second voice message is emitted.

In the embodiment of the present application, the operation buttons include: a "confirm" button and a "cancel" button. The second voice information does not involve privacy content such as the user's password. Therefore, the second voice information is the operation corresponding to the operation button. For example, when the contact position of the sliding gesture is the "confirm" button, the The second voice information is: confirm; when the contact position of the sliding gesture is the "cancel" button, the second voice information is: cancel.

As another embodiment of the present application, the process of monitoring gesture information on the touch screen further includes:

In the embodiment of the present application, if the first preset gesture is a sliding gesture, and the real-time contact position of the sliding gesture has slid out of the area outside the virtual keyboard, the user needs to be prompted for the first preset The contact position of the gesture is not in the area corresponding to the virtual keyboard. In addition, in order to guide the user back to the area where the virtual keyboard is located, the user may also be prompted that the contact position of the first preset gesture and the virtual keyboard The positional relationship of the corresponding area, for example, the fourth prompt message is: the password keyboard is at a lower position.

Step S704: After the end of the first preset gesture is monitored, if the monitored gesture information is the second preset gesture, then when the key corresponding to the last contact position of the first preset gesture is a character, Input the character corresponding to the last contact position of the first preset gesture.

Similarly, when the button corresponding to the last contact position of the first preset gesture is an operation button, an operation corresponding to the operation button is performed.

In the embodiment of the present application, the first preset gesture is used to assist the visually impaired to find the character they want to input or the operation they want to perform, and the second preset gesture is used to perform the button found in the first preset gesture. Confirmation, therefore, only when the first preset gesture exists before the second preset gesture, the characters are input or the characters that have been input are operated. Wherein, the second preset gesture may be a double-tap gesture.

Of course, in practical applications, after the visually impaired finds the character key to be input or the operation key to be performed through the first preset gesture, the visually impaired can input the second preset at the contact position of the first preset gesture. Assuming a gesture, in this case, the contact position of the first preset gesture is the same as the contact position of the second preset gesture. If the contact position is a character button, enter the corresponding Characters, usually you can set a password input box, and enter the characters corresponding to the contact position into the password input box; if the contact position is an operation button, perform the corresponding operation. After the visually impaired finds the character they want to input or the target operation they want to perform through the first preset gesture, they can also input the second preset gesture at any position on the touch screen. The last contact position of the last first preset gesture corresponds to a character key, then enter the character represented by the character key; if the last first preset gesture before the second preset gesture corresponds to the last contact position of the first preset gesture To operate the button, perform the operation corresponding to the operation button.

As an example, after a visually impaired person finds the position of the character "5" through the first preset gesture, he can keep the position unchanged and input the second preset gesture. At this time, the last first preset gesture before the second preset gesture The last contact position is the position of the character "5", you can input the character "5" into the password input box. Or, after the visually impaired finds the position of the character "5" through the first preset gesture, enter the second preset gesture at any position on the touch screen, the last first preset gesture before the second preset gesture and the last The contact position is the position of the character "5", you can input the character "5" into the password input box. For the privacy of the password information, characters can be entered in the password input box in the form of hidden characters (for example, "*", ".").

It should be noted here that after the visually impaired input the first preset gesture, and the contact position of the first preset gesture passes the characters "1", "2" and "5" in turn, then the second preset gesture is not input , But continue to input the first preset gesture "1", "2", and "3". At this time, if the second preset gesture is input, the input character is not "5", but "3", because the input is the first Second, the character corresponding to the last contact position of the last first preset gesture before the preset gesture.

As another embodiment of the present application, after inputting the character corresponding to the last contact position of the first preset gesture, the method further includes:

Of course, in practical applications, when the last contact position of the first preset gesture is an operation button, a voice message (for example, the same buzzer sound as the first voice message) may also be issued first to remind the visually impaired After the characters are successfully entered, a third prompt message is issued to remind the user of the number of characters (ie, digits) currently entered, so that the user can know which password character should be entered in the next step.

As another embodiment of the present application, when the button corresponding to the last contact position of the first preset gesture is an operation button, performing an operation corresponding to the operation button includes:

When the button corresponding to the last contact position of the first preset gesture is cancel, all characters that have been input are deleted and the current transaction is canceled.

In the embodiment of the present application, after the visually impaired finds the position of the operation button "confirm" through the first preset gesture, the position can be kept unchanged, and the second preset gesture can be input. At this time, the password is entered into the characters in the box Upload as input password. Or, after the visually impaired finds the position of the operation button "confirm" through the first preset gesture, enter the second preset gesture anywhere on the touch screen, and then the characters in the password input box can be used as the input password Upload. If the operation button is "Cancel", the operations performed include: deleting all characters in the password input box and canceling the current transaction. It should be noted here that after canceling the current transaction, it is equivalent to the end of the password input process, and the terminal device will return to the state of step S701 "the virtual keyboard is displayed on the touch screen, and the gestures on the touch screen are monitored. information".

In order to provide a clearer description of the embodiments of the present application, the process of password input by the visually impaired through the auxiliary device and the password input method provided in the embodiments of the present application is illustrated as an example.

If the password to be entered by the visually impaired is "135678", after entering the password-assisted input mode, the fifth prompt message is played to prompt the layout of the virtual keyboard and the method of password input using the auxiliary device, and touch The virtual keyboard is displayed on the screen. The visually impaired can touch the second bracket on the left side of the virtual keyboard to find the uppermost touch mark on the second bracket, and then slide horizontally to the right. After sliding to the position of the first virtual button, A buzzer sounds. At this time, tell the visually impaired that the finger is currently located in the first row (the touch mark on the top of the second bracket) and the position of the first button from the left (the first beep). The visually impaired needs The character "1" is found. The first button from the left in the first line of the virtual keyboard is "1". Therefore, the visually impaired can double-tap anywhere on the touch screen. At this time, the sliding gesture before the double-tap gesture is the last The key corresponding to the contact position of is the character "1", you can enter the character "1" in the password input box, at this time, you can send out the prompt message "Currently input a character".

The visually impaired continue to enter the character "3". The visually impaired can touch the fourth bracket on the right side of the virtual keyboard to find the uppermost touch mark on the fourth bracket, and then slide horizontally to the left to reach the first virtual After pressing the position of the button, a buzzer sounds. At this time, tell the visually impaired that the finger is currently located in the first row (the touch mark on the top of the fourth bracket), and the position of the first button from the right (the first buzzer) , The visually impaired need to find the character "3". The first key from the right in the first line of the virtual keyboard is "3". Therefore, the visually impaired can double-click anywhere on the touch screen. At this time, the double-click gesture The key corresponding to the last contact position of the previous sliding gesture is the character "3", and the character "3" can be input in the password input box. At this time, the prompt message "Currently input two characters" can be issued;

...

The visually impaired can continue to find the "confirm" button after inputting the last character "8" according to the above method. The visually impaired can use the touch mark on the rightmost side of the first bracket located on the lower side of the virtual keyboard to slide up to hear the first After the first beep, you can confirm by double-clicking on the touch screen. You can also use the touch mark on the fourth bracket on the right side of the virtual keyboard to slide to the left. After hearing the first beep, press the touch screen. Confirm by double-clicking on it. After double-clicking, you can play the voice message "Confirm", and then upload the code in the password input box as the password. After uploading, if the password is correct, you can play "transaction successful" or "transaction completed". Of course, if the uploaded password is wrong, you can also play "Wrong password, please try again" or "Transaction failed", etc.

If during the above process of inputting characters, the visually impaired finds the cancel button and double-clicks it, it means to delete all characters in the password input box and cancel the current transaction, such as returning to the previous interface. At this time, it is necessary to play "Delete All" and/or "Cancel Transaction" accordingly.

After the transaction is completed or cancelled, the user can continue to prompt the user with "please take out the card" and other prompts.

Since none of the voice prompt content in the embodiments of the present application involves the privacy of the user, the visually impaired person does not need to wear a headset when inputting a password, and the voice content can be released outside.

Through the above example, it can be seen that the visually impaired can realize all the operations of password input (find the target character, enter the target character, delete the entered character only based on the voice prompt information with the sliding gesture and the double-tap gesture during the password input process. , Upload the entered characters as a password, cancel transactions, etc.).

It should be understood that the size of the sequence number of each step in the foregoing embodiment does not mean the order of execution. The execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

FIG. 8 is a schematic block diagram of a terminal device provided by an embodiment of the present application. As shown in FIG. 8, the terminal device 8 of this embodiment includes: a touch screen for displaying a virtual keyboard, any auxiliary device provided in the embodiments of the present application, one or more processors 80, a memory 81, and A computer program 82 in the memory 81 that can be run on the processor 80. The processor 80 implements the steps in the foregoing method embodiments when the computer program 82 is executed, for example, steps S701 to S704 shown in FIG. 7.

Exemplarily, the computer program 82 may be divided into one or more modules/units, and the one or more modules/units are stored in the memory 81 and executed by the processor 80 to complete This application. The one or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 82 in the terminal device 8.

The terminal device includes but is not limited to a processor 80 and a memory 81. Those skilled in the art can understand that FIG. 8 is only an example of the terminal device 8 and does not constitute a limitation on the terminal device 8. It may include more or less components than shown in the figure, or combine certain components, or different components. Components, for example, the terminal device 8 may also include an input device, an output device, a network access device, a bus, and the like.

The processor 80 may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs), application specific integrated circuits (Application Specific Integrated Circuits, ASICs), Ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory 81 may be an internal storage unit of the terminal device 8, such as a hard disk or memory of the terminal device 8. The memory 81 may also be an external storage device of the terminal device 8, such as a plug-in hard disk equipped on the terminal device 8, a smart memory card (Smart Media Card, SMC), Secure Digital (SD) card, Flash Card, etc. Further, the memory 81 may also include both an internal storage unit of the terminal device 8 and an external storage device. The memory 81 is used to store the computer program and other programs and data required by the terminal device 8. The memory 81 can also be used to temporarily store data that has been output or will be output.

The terminal device provided in the embodiment of the present application may be a payment terminal, such as a POS machine. The example regulations shown in Figure 8 do not indicate how the auxiliary device is set on the terminal device. In order to have a clearer understanding of the payment equipment provided with the auxiliary device, please refer to the schematic diagrams of the payment equipment shown in Figures 9 to 11 . The payment devices shown in FIGS. 9 to 11 have different structures. Correspondingly, there are some differences in the structure of the auxiliary device and the manner in which the auxiliary device is set on the terminal device. It should be noted here that although Figures 9 to 11 show payment devices, the payment devices shown in Figures 9 to 11 do not mean that this application is only used for payment devices, but can be applied to operations that require password input. On the terminal device.

In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail or recorded in an embodiment, reference may be made to related descriptions of other embodiments.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed terminal device and method may be implemented in other ways. For example, the terminal device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components. It can be combined or integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiments and methods, and can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the program is executed by one or more processors, it can implement the steps of the foregoing method embodiments.

Similarly, as a computer program product, when the computer program product runs on a terminal device, the terminal device can realize the steps in the foregoing method embodiments when executed.

Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), electrical carrier signal, telecommunications signal, and software distribution media, etc. It should be noted that the content contained in the computer-readable medium can be appropriately added or deleted according to the requirements of the legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to the legislation and patent practice, the computer-readable medium Does not include electrical carrier signals and telecommunication signals.

The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, a person of ordinary skill in the art should understand that it can still implement the foregoing The technical solutions recorded in the examples are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the application, and should be included in Within the scope of protection of this application.

Claims

A password input method applied to a terminal device, wherein the terminal device is provided with a touch screen for displaying a virtual keyboard and an auxiliary device matched with the virtual keyboard; the auxiliary device includes: a first bracket , Provided with a touch mark for indicating the position of each row of keys on the virtual keyboard; a second bracket, connected to the first bracket, provided with a touch mark for indicating the position of each row of keys on the virtual keyboard;

The password input method includes:

In the password-assisted input mode, displaying a virtual keyboard on the touch screen and monitoring gesture information on the touch screen, wherein the virtual keyboard has four rows and three columns;

If the monitored gesture information is the first preset gesture, the contact position of the first preset gesture is recorded, where the first preset gesture includes: the visually impaired touches the first bracket on the Touch the mark to find the column where the target button is located, and then make a gesture of sliding along the column where the target button is located, or the visually impaired can find the row where the target button is located by touching the touch mark on the second bracket, and then follow the target button. Swipe gestures on the line;

When the contact position of the first preset gesture is a character key, send out the first voice message;

After the end of the first preset gesture is monitored, if the detected gesture information is a second preset gesture, when the key corresponding to the last contact position of the first preset gesture is a character, enter the The character corresponding to the last contact position of the first preset gesture.
The password input method of claim 1, wherein if the detected gesture information is the first preset gesture, the method further comprises:

When the contact position of the first preset gesture is an operation button, emitting a second voice message;

Correspondingly, if the detected gesture information is the second preset gesture, it also includes:

When the button corresponding to the last contact position of the first preset gesture is an operation button, an operation corresponding to the operation button is performed.
3. The password input method according to claim 2, wherein the first preset gesture further comprises: a single click gesture;

When the first preset gesture is a sliding gesture, the contact position of the first preset gesture is the real-time position of the contact in the sliding gesture;

When the first preset gesture is a click gesture, the contact position of the first preset gesture is the position of the contact point in the click gesture;

The second preset gesture is a double-tap gesture.
The password input method according to claim 2, wherein the first voice information corresponding to each character key is the same;

The second voice information corresponding to each operation button is the operation corresponding to the operation button.
The password input method according to claim 2, wherein when the button corresponding to the last contact position of the first preset gesture is an operation button, performing an operation corresponding to the operation button comprises:

When the key corresponding to the last contact position of the first preset gesture is confirming, upload all the characters that have been input as a password;

When the button corresponding to the last contact position of the first preset gesture is cancel, all characters that have been input are deleted, and the transaction is canceled.
The password input method according to claim 1, wherein after inputting the character corresponding to the last contact position of the first preset gesture, the method further comprises:

Send a third prompt message, where the third prompt message is used to prompt the user of the number of characters that have been input.
The password input method according to claim 1, wherein the process of recording the contact position of the first preset gesture further comprises:

When the position of the contact point of the first preset gesture is outside the virtual keyboard, send out fourth prompt information, where the fourth prompt information is used to prompt the user of the contact point of the first preset gesture The position is not in the area corresponding to the virtual keyboard and/or the positional relationship between the contact position of the first preset gesture and the area where the virtual keyboard is located.
The password input method according to claim 1, wherein in the password-assisted input mode, the method further comprises:

The fifth prompt information is played, where the fifth prompt information is used to prompt the layout of the virtual keyboard and the method of using the auxiliary device for password input.
The password input method according to claim 1, wherein the number of touch marks on the first support is 3, and the number of touch marks on the second support is 4;

The touch mark is a raised mark.
9. The password input method according to claim 9, wherein the mark indicating the second row and the mark indicating the second column of the touch marks are both double-bump marks;

In the touch marks, the marks indicating the first row, the third row, the fourth row, the first column, and the third column are all single-bump marks.
A terminal device, characterized in that it comprises:

Touch screen for displaying virtual keyboard;

An auxiliary device matched with the virtual keyboard, the auxiliary device comprising: a first bracket provided with a touch mark for indicating the position of each column of the virtual keyboard; a second bracket connected to the first bracket, provided There is a touch mark used to indicate the position of each row of keys on the virtual keyboard;

A memory, a processor, and a computer program that is stored in the memory and can run on the processor; wherein the processor implements the method according to any one of claims 1 to 10 when the computer program is executed step.