CN109903054B - Operation confirmation method and device, electronic equipment and storage medium - Google Patents
Operation confirmation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN109903054B CN109903054B CN201910172269.0A CN201910172269A CN109903054B CN 109903054 B CN109903054 B CN 109903054B CN 201910172269 A CN201910172269 A CN 201910172269A CN 109903054 B CN109903054 B CN 109903054B
- Authority
- CN
- China
- Prior art keywords
- user
- confirmation
- password
- confirmation password
- payment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012790 confirmation Methods 0.000 title claims abstract description 200
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000005516 engineering process Methods 0.000 claims abstract description 26
- 230000001960 triggered effect Effects 0.000 claims abstract description 18
- 238000004590 computer program Methods 0.000 claims description 4
- 238000012552 review Methods 0.000 claims description 4
- 238000010200 validation analysis Methods 0.000 claims description 2
- 230000000875 corresponding effect Effects 0.000 description 30
- 238000012549 training Methods 0.000 description 8
- 230000009471 action Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000013135 deep learning Methods 0.000 description 3
- 230000001815 facial effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000001680 brushing effect Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Abstract
The invention discloses an operation confirmation method, an operation confirmation device, electronic equipment and a storage medium. The method comprises the following steps: when an operation request triggered by a user is received, judging whether the user accords with an operation condition or not; if the user accords with the operation condition, displaying a confirmation password, wherein the confirmation password is used for the user to confirm the operation; when the user restarts the confirmation password, determining whether the user restarts the confirmation password correctly based on a lip recognition technology; when the user is determined to correctly re-describe the confirmation password, executing the operation corresponding to the operation request; wherein the copying of the confirmation password includes silently reading the confirmation password. By adopting the technical scheme, the aim of simplifying the operation confirmation flow is fulfilled.
Description
Technical Field
The embodiment of the invention relates to an electronic payment technology, in particular to an operation confirmation method, an operation confirmation device, electronic equipment and a storage medium.
Background
In a face payment scenario, in order to prevent erroneous brushing, a user is usually allowed to perform a payment confirmation operation before performing a payment operation after the user finishes brushing the face.
Currently, the following manner is generally adopted for the user to perform payment confirmation: one is to perform a payment confirmation operation by clicking a touch screen button by a user; another is to make payment confirmation by letting the user swing or nod.
The operation mode that the user clicks the touch screen button to confirm the payment requires the user to search for the corresponding confirmation button on the touch screen, and the user hand cannot be occupied by other objects, so that the payment complexity is increased undoubtedly, the operation is inconvenient, and especially when the user is the elderly, the experience of the user is worse. The operation mode that the user performs payment confirmation by shaking or nodding is easy to be quite different in user behavior, and is not easy to be accepted and adopted by most users.
Disclosure of Invention
The invention provides an operation confirmation method, an operation confirmation device, electronic equipment and a storage medium.
In a first aspect, an embodiment of the present invention provides an operation confirmation method, including:
when an operation request triggered by a user is received, judging whether the user accords with an operation condition or not;
if the user accords with the operation condition, displaying a confirmation password, wherein the confirmation password is used for the user to confirm the operation;
when the user restarts the confirmation password, determining whether the user restarts the confirmation password correctly based on a lip recognition technology;
when the user is determined to correctly re-describe the confirmation password, executing the operation corresponding to the operation request;
wherein the copying of the confirmation password includes silently reading the confirmation password.
In a second aspect, an embodiment of the present invention further provides an operation confirmation device, including:
the judging module is used for judging whether the user accords with the operation condition or not when receiving the operation request triggered by the user;
the display module is used for displaying a confirmation password if the user accords with the operation condition, wherein the confirmation password is used for the user to confirm the operation;
the determining module is used for determining whether the user correctly restarts the confirmation password based on a lip language recognition technology when the user restarts the confirmation password;
the execution module is used for executing the operation corresponding to the operation request when the confirmation password is confirmed to be correctly repeated by the user;
wherein the copying of the confirmation password includes silently reading the confirmation password.
In a third aspect, an embodiment of the present invention further provides an electronic device, including:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the operation validation method of any of claims 1-7.
In a fourth aspect, embodiments of the present invention also provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the operation confirmation method according to any one of claims 1 to 7.
According to the operation confirmation method provided by the embodiment of the invention, when the operation request triggered by the user is received, whether the user accords with the operation condition is judged; if the user accords with the operation condition, displaying a confirmation password, wherein the confirmation password is used for the user to confirm the operation; when the user restarts the confirmation password, determining whether the user restarts the confirmation password correctly based on a lip recognition technology; when the user is determined to correctly re-describe the confirmation password, executing the operation corresponding to the operation request; the confirmation password is repeated by a technical means of reading the confirmation password silently, so that the purpose of simplifying operation confirmation flow is achieved.
Drawings
FIG. 1 is a flow chart of a method for confirming operation according to a first embodiment of the invention;
FIG. 2 is a flow chart of a method for confirming operation according to a second embodiment of the invention;
FIG. 3 is a flow chart of a method for confirming operation in a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an operation confirmation device according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device in a fifth embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Example 1
Fig. 1 is a flow chart of an operation confirmation method according to an embodiment of the present invention, where the method may be applied to a case of confirming an operation request triggered by a user, and the method may be performed by an operation confirmation device, where the device may be implemented by software and/or hardware, and may be generally integrated in a terminal, for example, a server. Referring specifically to fig. 1, the operation confirmation method includes the following steps:
step 110, when an operation request triggered by a user is received, judging whether the user meets an operation condition, if so, continuing to execute step 120, otherwise, executing step 150.
The operation request can be any operation request needing to be confirmed, such as a payment request, a downloading request or a login request; the purpose of performing operation confirmation is to ensure the correctness of the operation request and avoid the situations of misoperation and the like of a user.
Taking the operation request as a downloading request as an example, a user triggers the downloading request through a download button in a downloading interface, and when a component responsible for a downloading task receives the downloading request triggered by the user, whether the current user meets the downloading condition is judged, wherein the downloading condition is as follows: whether a member is registered and a member account is logged in, if it is determined that the current user is registered and a member account is logged in, step 120 of displaying a confirmation password is continued, so that the user confirms whether the current download request is correct, and the interface displaying the confirmation password generally displays a target file to be downloaded by the user, so as to achieve the purpose of ensuring that the current operation is correct. If it is determined that the current user does not register a member or does not register a member account, that is, the current user does not meet the downloading condition, step 150 is executed to "send out information indicating an error", where the information indicating an error may specifically be information such as "unregistered member" or "unregistered member account", so that the user knows the reason that the current operation cannot be continued.
Taking the operation request as a login request as an example, a user triggers the login request through a login button in a login interface, and when a component responsible for a login task receives the login request triggered by the user, whether the current user meets login conditions is judged, wherein the login conditions are as follows: whether the login account and the password are correctly input, if the login account and the password input by the user are correct, step 120 of displaying the confirmation password is continuously executed, so that the user confirms whether the current login account is correct, and the target account to be logged in by the user is also displayed on the interface for displaying the confirmation password, so that the purpose of ensuring whether the current operation is correct by the user is achieved. If it is determined that the login account input by the current user is incorrect or the password is incorrect, that is, the current user does not meet the login condition, step 150 is executed to "send out information indicating that the current operation cannot be continued, where the information indicating that the current operation is incorrect may specifically be information such as" login account error "or" login password error ".
Step 120, displaying the confirmation password.
The confirmation password is used for the user to confirm whether the current operation is correct, for example, whether the current payment amount is correct, whether the current downloaded target file is correct, whether the current login account is correct, and the like.
Illustratively, the displaying the confirmation password includes: randomly determining the confirmation password from a preset password template; wherein each password in the preset password template comprises a word or a word.
In order to simplify the operation confirmation process, the operation confirmation does not occupy two hands of the user, the convenience of operation confirmation is improved, the embodiment combines the lip language recognition technology to recognize whether the user correctly restarts the confirmation password, if the user correctly restarts the confirmation password, the user is considered to confirm that the current operation is correct, and if the user does not correctly restarts the confirmation password, the user is considered to confirm that the current operation is incorrect, so that the purpose of operation confirmation is realized. Further, in order to improve accuracy of lip language identification and improve operation confirmation efficiency, the confirmation password should be as simple as possible, and should be a word or word that makes a user need to make a typical lip action when replying, preferably, each password in the preset password template may be a word or word that makes a typical lip action by a person, such as "me" or "it".
And 130, when the user restarts the confirmation password, determining whether the user restarts the confirmation password correctly based on a lip language recognition technology.
The confirmation password is repeated, namely, the user can read the confirmation password in a silent manner, or can read the confirmation password in a silent manner without sending out a sound, and the user can decide according to own will, so that the operation confirmation method provided by the embodiment of the invention has better user experience. It should be noted that, since the operation confirmation scheme provided in this embodiment is implemented by determining whether the user correctly restarts the confirmation password based on the lip recognition technology, the restated confirmation password does not include the manner of being silently read in mind, and the user needs to make a corresponding action when the user restated the confirmation password.
The lip language identification technology is a technology for reading speaking content according to the lip movements during speaking, when the lip language automatic identification is carried out, a plurality of images containing the speaker's mouth lip movements or videos containing the speaker's mouth lip movements are required to be acquired, then a plurality of continuous image sequences are identified by combining an image processing technology and a deep learning technology, mouth shapes in the plurality of continuous image sequences are identified, the mouth shapes are mapped to pronunciation, and then corresponding natural language words and sentences, namely speaking content, are determined according to pronunciation conditions in a continuous time period. In this embodiment, the user may review the confirmation password to obtain the image of the lip action by triggering the terminal with the operation request, where the terminal is a terminal with the image acquisition function.
And 140, executing the operation corresponding to the operation request when the user is determined to correctly repeat the confirmation password.
If the operation request is a downloading request, the operation corresponding to the operation request is a downloading operation; if the operation request is a login request, the operation corresponding to the operation request is a login operation; and if the operation request is a payment request, the operation corresponding to the operation request is a payment operation.
And 150, sending out information for prompting errors.
According to the operation confirmation method, through operation confirmation by combining the lip language identification technology, the purpose of operation confirmation without relying on the two hands of an operation user is achieved, the operation confirmation flow is simplified, the user experience is improved, the operation user can not sound when the confirmation password is repeated, and no large-scale external action is required, other people around the operation user cannot be interfered, and the operation confirmation method is easy to accept by the user.
Example two
Fig. 2 is a flowchart of an operation confirmation method according to a second embodiment of the present invention. Based on the above embodiment, the present embodiment optimizes step 130 "when the user restarts the confirmation password, determines whether the user restarts the confirmation password based on the lip recognition technology", specifically, performs lip recognition by combining the facial contour change near the lips and the lip contour change, so that the advantage of optimizing is that the accuracy of lip recognition is improved. Referring specifically to fig. 2, the method comprises the steps of:
step 210, when an operation request triggered by a user is received, determining whether the user meets an operation condition, and if the user meets the operation condition, continuing to execute step 220.
Step 220, displaying a confirmation password, wherein the confirmation password is used for operation confirmation of the user.
And 230, collecting face images of the user in real time when the user restarts the confirmation password.
Specifically, a terminal camera capable of triggering an operation request by a user can acquire face image sequence frames of the user in a certain period of time in real time, the acquired face image sequence frames are sequentially input into a preset face recognition model, each face image sequence frame is sequentially operated through the face recognition model, user face contour data and mouth contour data corresponding to each face image sequence frame are respectively obtained, and then the user face contour data and the mouth contour data which are arranged according to a time sequence relationship are obtained.
Step 240, sequentially inputting the face images to a preset face recognition model to obtain face contour data and mouth contour data of the user.
The face contour data and the mouth contour data are specifically represented by coordinate points. The face recognition model is constructed based on a deep learning technology and a face recognition technology, and is obtained by training in advance by using a large number of training samples, wherein the training samples are specifically a large number of face image sequence frames, and face contour data and mouth contour data corresponding to each face image sequence frame.
And 250, inputting the face outline data and the mouth outline data into a preset lip language identification model to obtain the text information repeated by the user.
Based on the deep learning technology, the lip language recognition model completes classification tasks according to facial contour data and mouth contour data arranged according to time sequence relations, finally outputs text contents repeated by a user, or outputs possible text contents repeated by the user and corresponding confidence degrees, obtains text information repeated by the user according to the confidence degrees, and selects the text content with the highest confidence degrees as the text information repeated by the user.
Because the confirmation passwords in the preset password template are set to be words or words which are as simple as possible and have limited quantity, the lip language recognition model does not need to recognize a large number of words, and a training sample with better quality can be extracted pertinently for training the lip language recognition model, so that the recognition accuracy of the lip language recognition model is improved. Training samples may be created, for example, for all passwords in a preset password template to pre-train the labial model. Specifically, supposing that a password I in a preset password template is aimed at, when the user recommends I, continuously shooting the password I, adding artificial participation based on an image sequence frame obtained by shooting, and obtaining corresponding face contour data and mouth contour data, wherein the image sequence frame, the corresponding face contour data and the mouth contour data form a training sample with better quality of a face recognition model, and the corresponding face contour data, the mouth contour data and the password I form a training sample with better quality of a lip recognition model.
Step 260, matching the text information with the confirmation password, and determining whether the user correctly copies the confirmation password according to the matching result.
For example, if the text information identified based on the lip language identification technology is "me" and the confirmation password is "it", and the two are not matched, determining that the user does not correctly re-describe the confirmation password; if the text information recognized based on the lip language recognition technology is I and the confirmation password is I, and the text information and the confirmation password are matched, the user is determined to correctly repeat the confirmation password.
And step 270, executing the operation corresponding to the operation request when the user is determined to correctly repeat the confirmation password.
According to the technical scheme, the accuracy of the user lip recognition is improved by using the facial contour change characteristics and the mouth change characteristics when the user restarts the confirmation password, and the lip recognition model does not need to recognize more words by setting the preset password templates which are small in number and as simple as possible, so that the lip recognition accuracy is improved, the operation confirmation efficiency is improved, and the user experience is improved.
Example III
Fig. 3 is a flowchart of an operation confirmation method according to a third embodiment of the present invention. On the basis of the above embodiment, in this embodiment, the operation request is taken as an example of a payment request, and the operation confirmation method flow is described. The operation confirmation method of the present embodiment is applicable to the case of performing payment confirmation in a face payment scenario, and the method may be performed by a payment device, where the device may be implemented by software and/or hardware, and may generally be integrated in a payment terminal or a server corresponding to the payment terminal. Referring specifically to fig. 3, the operation confirmation method includes the steps of:
step 310, when a payment request triggered by a user is received, a face image of the user is acquired.
Wherein the payment request is typically issued by a payment terminal interacting with the user and sent to a corresponding payment server or module for payment in the payment terminal. The payment terminal may specifically refer to a mobile terminal, such as a smart phone or a vending machine; the payment terminal may also refer to a payment application, such as a payment instrument, installed on the mobile terminal. When a user has a payment demand, inputting a payment amount through a payment page of a payment terminal, clicking a 'confirmation' operation, and triggering the payment terminal to send a corresponding payment request to a payment server by clicking the 'confirmation' operation process by the user, wherein the payment request comprises payment amount information; or the merchant application program automatically pops up the payment page with the payment amount, for example, in the payment flow when the user selects the payment or the payment button in the shopping of the panning mall, the payment page with the specific payment amount is popped up automatically, and the corresponding payment request is sent to the payment server while the payment page with the specific payment amount is popped up automatically in the scene.
The face image of the user can be acquired by a camera arranged on the payment terminal, after the face image of the user is shot by the payment terminal, the face image of the user is further sent to a corresponding payment server or is sent to a functional module integrated on the payment terminal for payment, and the payment server or the functional module judges whether the user accords with the payment condition based on the face image.
Step 320, judging whether the user meets the payment condition based on the face image, if the user meets the payment condition, continuing to execute step 330, otherwise, executing step 370.
Specifically, the step of judging whether the user meets the payment condition based on the face image comprises the following steps:
matching the face image with images in a preset image set;
if a target image with the matching similarity reaching a set threshold value exists in the preset image set, determining that the user is a legal user;
if the account balance associated with the target image is larger than the current payment amount, determining that the user has payment authority;
if the user is a legal user and the user has payment authority, determining that the user meets the payment condition.
In the face payment scenario, each payment user needs to register in advance, that is, upload the face image of the user to the payment server in advance according to the registration flow, and establish a binding relationship between the face image and the payment account. When the registered user performs payment, the payment terminal acquires face images of the user and uploads the face images to the payment server, and the payment server matches the face images with images in a preset image set, wherein the preset image set is the face images of all the registered users. If a target image with the matching similarity reaching a set threshold value with the face image of the current user exists in the preset image set, determining that the current user is a legal user, namely, the current user has completed registration in advance. And further acquiring account information bound with a target image of which the matching similarity reaches a set threshold value, wherein the account information comprises account balance, if the account balance is larger than the current payment amount, determining that the current user has payment authority, and if the current user is a legal user and has payment authority, the user accords with the payment condition.
Step 330, displaying a confirmation password, wherein the confirmation password is used for the user to confirm payment.
Step 340, sending prompt information for prompting the user to review the confirmation password; or, sending out prompt information for prompting the user to silently read the confirmation password.
Wherein, the prompt message prompting the user to recommends the confirmation password is sent; or sending prompt information for prompting the user to silently read the confirmation password, so that the purpose that the user knows how to operate the confirmation password to finish payment can be achieved, and especially for a new payment user, when the confirmation password is seen and the corresponding input box is not seen, the user does not know how to operate the confirmation password, so that the prompt information is very important, and the user experience is improved.
Step 350, when the user restarts the confirmation password, determining whether the user restarts the confirmation password correctly based on a lip language recognition technology.
And 360, executing a payment operation when the user is determined to correctly repeat the confirmation password.
Step 370, sending out information prompting the error.
If the user does not meet the payment condition, corresponding prompt error information can be sent out according to the reason that the user does not meet the payment condition. For example, if the reason that the user does not meet the payment condition is that the user is not a legal user, the corresponding prompting error message may specifically be "incomplete registration, please register before payment"; if the user does not meet the payment condition because the user does not have the payment authority, the corresponding prompting error information can be specifically 'current account balance shortage'.
According to the technical scheme, in the face payment scene, the purpose of carrying out payment confirmation operation without relying on the hands of the user is achieved by carrying out the payment confirmation based on the lip language recognition technology, the operation flow is simplified, the user experience is improved, the user can not sound when the confirmation password is repeated, and the user does not need to do a large-scale external action, so that other people around the user can not be interfered, and the user is easy to accept.
Example IV
Fig. 4 is a flowchart of an operation confirmation device according to a fourth embodiment of the present invention. Referring to fig. 4, the apparatus includes: a judging module 410, a displaying module 420, a determining module 430 and an executing module 440;
the judging module 410 is configured to, when receiving an operation request triggered by a user, judge whether the user meets an operation condition; the display module 420 is configured to display a confirmation password if the user meets an operation condition, where the confirmation password is used for the user to confirm operation; a determining module 430, configured to determine, based on a lip recognition technique, whether the user correctly restarts the confirmation password when the user restarts the confirmation password; an execution module 440, configured to execute an operation corresponding to the operation request when it is determined that the user correctly restarts the confirmation password; wherein the copying of the confirmation password includes silently reading the confirmation password.
Further, the determining module 430 includes:
the acquisition unit is used for acquiring face images of the user in real time when the user restarts the confirmation password;
the face recognition unit is used for sequentially inputting the face images into a preset face recognition model to obtain face outline data and mouth outline data of the user;
the lip language identification unit is used for inputting the face outline data and the mouth outline data into a preset lip language identification model to obtain the text information repeated by the user;
the matching unit is used for matching the text information with the confirmation password;
and the determining unit is used for determining whether the user correctly restarts the confirmation password according to the matching result.
Further, when the operation request is a payment request, the judging module 410 includes:
the acquisition unit is used for acquiring a face image of a user when receiving a payment request triggered by the user;
and the judging unit is used for judging whether the user accords with the payment condition or not based on the face image.
Further, the judging unit includes:
the matching subunit is used for matching the face image with images in a preset image set;
a legal user determining subunit, configured to determine that the user is a legal user if a target image whose matching similarity with the face image reaches a set threshold exists in a preset image set;
a payment right determining subunit, configured to determine that the user has a payment right if an account balance associated with the target image is greater than a current payment amount;
and the payment condition determining subunit is used for determining that the user accords with the payment condition if the user is a legal user and the user has payment authority.
Further, the display module 420 is specifically configured to: randomly determining the confirmation password from a preset password template; wherein each password in the preset password template comprises a word or a word.
Further, the device further comprises: the prompt module is used for sending prompt information for prompting a user to review the confirmation password after the confirmation password is displayed; or, sending out prompt information for prompting the user to silently read the confirmation password.
Further, the prompting module is further configured to send out a message indicating an error if it is determined that the user does not meet the operation condition.
According to the operation confirmation device, through operation confirmation by combining the lip language identification technology, the purpose of operation confirmation without relying on the two hands of an operation user is achieved, the operation confirmation flow is simplified, the user experience is improved, the operation user can not sound when the confirmation password is repeated, no large-scale external action is required, other people around the operation user cannot be interfered, and the operation confirmation device is easy to accept by the user.
The operation confirmation device provided by the embodiment of the invention can execute the operation confirmation method provided by any embodiment of the invention, has corresponding functional modules and beneficial effects of the execution method, and technical details which are not described in detail in the embodiment can be seen in the operation confirmation method provided by any embodiment of the invention.
Example five
Fig. 5 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention. Fig. 5 shows a block diagram of an exemplary device 12 suitable for use in implementing embodiments of the present invention. The device 12 shown in fig. 5 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in fig. 5, device 12 is in the form of a general purpose computing device. Components of device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 that connects the various system components, including the system memory 28 and the processing units 16.
Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory 32. Device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 5, commonly referred to as a "hard disk drive"). Although not shown in fig. 5, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. The memory 28 may include at least one program product having a set of program modules (e.g., a determination module 410, a display module 420, a determination module 430, and an execution module 440 of an operation confirmation device) configured to perform the functions of the various embodiments of the invention.
The program/utility 40 having a set (judgment module 410, display module 420, determination module 430, and execution module 440 of operation confirmation means) of program modules 42 may be stored in, for example, memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods of the embodiments described herein.
Device 12 may also communicate with one or more external devices 14 (e.g., camera, keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with device 12, and/or any devices (e.g., network card, modem, etc.) that enable device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Also, device 12 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, via network adapter 20. As shown, network adapter 20 communicates with other modules of device 12 over bus 18. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with device 12, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, implementing an operation confirmation method provided by an embodiment of the present invention, the method including:
when an operation request triggered by a user is received, judging whether the user accords with an operation condition or not;
if the user accords with the operation condition, displaying a confirmation password, wherein the confirmation password is used for the user to confirm the operation;
when the user restarts the confirmation password, determining whether the user restarts the confirmation password correctly based on a lip recognition technology;
when the user is determined to correctly re-describe the confirmation password, executing the operation corresponding to the operation request;
wherein the copying of the confirmation password includes silently reading the confirmation password.
Example six
The sixth embodiment of the present invention also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor implements the operation confirmation method provided by the embodiment of the present invention, the method including:
when an operation request triggered by a user is received, judging whether the user accords with an operation condition or not;
if the user accords with the operation condition, displaying a confirmation password, wherein the confirmation password is used for the user to confirm the operation;
when the user restarts the confirmation password, determining whether the user restarts the confirmation password correctly based on a lip recognition technology;
when the user is determined to correctly re-describe the confirmation password, executing the operation corresponding to the operation request;
wherein the copying of the confirmation password includes silently reading the confirmation password.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (8)
1. An operation confirmation method, comprising:
when an operation request triggered by a user is received, judging whether the user accords with an operation condition or not;
and if the user meets the operation condition, displaying a confirmation password, wherein the confirmation password comprises the following steps:
randomly determining the confirmation password from a preset password template;
wherein each password in the preset password template comprises a word or a word;
the confirmation password is used for operation confirmation of the user;
when the user re-copies the confirmation password, determining whether the user correctly re-copies the confirmation password based on a lip recognition technology includes:
when the user restarts the confirmation password, acquiring a face image of the user in real time;
sequentially inputting the face images into a preset face recognition model to obtain face contour data and mouth contour data of the user;
inputting the face outline data and the mouth outline data into a preset lip language identification model to obtain the text information repeated by the user;
matching the text information with the confirmation password;
determining whether the user correctly restates the confirmation password according to the matching result;
when the user is determined to correctly re-describe the confirmation password, executing the operation corresponding to the operation request;
wherein the copying of the confirmation password includes silently reading the confirmation password.
2. The method according to claim 1, wherein when the operation request is a payment request, the determining whether the user meets an operation condition when receiving the operation request triggered by the user comprises:
when a payment request triggered by a user is received, acquiring a face image of the user;
and judging whether the user accords with a payment condition or not based on the face image.
3. The method of claim 2, wherein determining whether the user meets a payment condition based on the face image comprises:
matching the face image with images in a preset image set;
if a target image with the matching similarity reaching a set threshold value exists in the preset image set, determining that the user is a legal user;
if the account balance associated with the target image is larger than the current payment amount, determining that the user has payment authority;
if the user is a legal user and the user has payment authority, determining that the user meets the payment condition.
4. A method according to any one of claims 1-3, wherein, if the user meets an operating condition, after displaying a confirmation password, the method further comprises:
sending prompt information for prompting a user to review the confirmation password; or,
and sending prompt information for prompting the user to silently read the confirmation password.
5. A method according to any one of claims 1-3, further comprising: and if the user is judged to be not in accordance with the operation condition, sending out information for prompting the error.
6. An operation confirmation device, characterized by comprising:
the judging module is used for judging whether the user accords with the operation condition or not when receiving the operation request triggered by the user;
the display module is used for displaying a confirmation password if the user accords with the operation condition, wherein the confirmation password is used for the user to confirm the operation;
the display module is specifically used for: randomly determining the confirmation password from a preset password template; wherein each password in the preset password template comprises a word or a word;
the determining module is used for determining whether the user correctly restarts the confirmation password based on a lip language recognition technology when the user restarts the confirmation password;
the determining module comprises:
the acquisition unit is used for acquiring face images of the user in real time when the user restarts the confirmation password;
the face recognition unit is used for sequentially inputting the face images into a preset face recognition model to obtain face outline data and mouth outline data of the user;
the lip language identification unit is used for inputting the face outline data and the mouth outline data into a preset lip language identification model to obtain the text information repeated by the user;
the matching unit is used for matching the text information with the confirmation password;
a determining unit, configured to determine whether the user correctly re-copies the confirmation password according to a matching result; the execution module is used for executing the operation corresponding to the operation request when the confirmation password is confirmed to be correctly repeated by the user;
wherein the copying of the confirmation password includes silently reading the confirmation password.
7. An electronic device, the electronic device comprising:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the operation validation method of any of claims 1-5.
8. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the operation confirmation method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910172269.0A CN109903054B (en) | 2019-03-07 | 2019-03-07 | Operation confirmation method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910172269.0A CN109903054B (en) | 2019-03-07 | 2019-03-07 | Operation confirmation method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109903054A CN109903054A (en) | 2019-06-18 |
| CN109903054B true CN109903054B (en) | 2023-11-28 |
Family
ID=66946776
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910172269.0A Active CN109903054B (en) | 2019-03-07 | 2019-03-07 | Operation confirmation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109903054B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110544270A (en) * | 2019-08-30 | 2019-12-06 | 上海依图信息技术有限公司 | method and device for predicting human face tracking track in real time by combining voice recognition |
| CN111242029A (en) * | 2020-01-13 | 2020-06-05 | 湖南世优电气股份有限公司 | Device control method, device, computer device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104680375A (en) * | 2015-02-28 | 2015-06-03 | 优化科技（苏州）有限公司 | Identification verifying system for living human body for electronic payment |
| CN106709402A (en) * | 2015-11-16 | 2017-05-24 | 优化科技（苏州）有限公司 | Living person identity authentication method based on voice pattern and image features |
| CN107977559A (en) * | 2017-11-22 | 2018-05-01 | 杨晓艳 | A kind of identity identifying method, device, equipment and computer-readable recording medium |
| CN109063449A (en) * | 2018-10-11 | 2018-12-21 | 平安科技（深圳）有限公司 | Electronic equipment unlocking method and relevant apparatus based on vocal print |
| CN109389028A (en) * | 2018-08-17 | 2019-02-26 | 深圳壹账通智能科技有限公司 | Face identification method, device, equipment and storage medium based on motion analysis |
-
2019
- 2019-03-07 CN CN201910172269.0A patent/CN109903054B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104680375A (en) * | 2015-02-28 | 2015-06-03 | 优化科技（苏州）有限公司 | Identification verifying system for living human body for electronic payment |
| CN106709402A (en) * | 2015-11-16 | 2017-05-24 | 优化科技（苏州）有限公司 | Living person identity authentication method based on voice pattern and image features |
| CN107977559A (en) * | 2017-11-22 | 2018-05-01 | 杨晓艳 | A kind of identity identifying method, device, equipment and computer-readable recording medium |
| CN109389028A (en) * | 2018-08-17 | 2019-02-26 | 深圳壹账通智能科技有限公司 | Face identification method, device, equipment and storage medium based on motion analysis |
| CN109063449A (en) * | 2018-10-11 | 2018-12-21 | 平安科技（深圳）有限公司 | Electronic equipment unlocking method and relevant apparatus based on vocal print |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109903054A (en) | 2019-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110069608B (en) | Voice interaction method, device, equipment and computer storage medium | |
| CN110287479B (en) | Named entity recognition method, electronic device and storage medium | |
| CN108898186B (en) | Method and device for extracting image | |
| CN109993150B (en) | Method and device for identifying age | |
| CN109034069B (en) | Method and apparatus for generating information | |
| JP2019046468A (en) | Interface smart interactive control method, apparatus, system and program | |
| US11694474B2 (en) | Interactive user authentication | |
| CN104808794A (en) | Method and system for inputting lip language | |
| CN109887187A (en) | A kind of pickup processing method, device, equipment and storage medium | |
| CN110427849B (en) | Face pose determination method and device, storage medium and electronic equipment | |
| CN110247898B (en) | Identity verification method, identity verification device, identity verification medium and electronic equipment | |
| CN111077996B (en) | Information recommendation method and learning device based on click-to-read | |
| US10936815B2 (en) | Removable spell checker device | |
| CN109214501B (en) | Method and apparatus for identifying information | |
| CN109903054B (en) | Operation confirmation method and device, electronic equipment and storage medium | |
| JP2021034003A (en) | Human object recognition method, apparatus, electronic device, storage medium, and program | |
| CN112330533A (en) | Mixed blood face image generation method, model training method, device and equipment | |
| CN109495549A (en) | Method, equipment and the computer storage medium of work are drawn in a kind of application | |
| CN113961836A (en) | Page jump method and device, electronic equipment and storage medium | |
| CN112330534A (en) | Animal face style image generation method, model training method, device and equipment | |
| CN112309389A (en) | Information interaction method and device | |
| CN113642438A (en) | Data processing method, device, equipment and computer readable storage medium | |
| US11755118B2 (en) | Input commands via visual cues | |
| CN112817441A (en) | Method and device for combining key and human eye identification | |
| CN109036379B (en) | Speech recognition method, apparatus and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |