TWM586381U - Mobile banking system with voice and face recognition - Google Patents

Abstract

This creation provides a mobile banking system with voice and facial recognition. A mobile banking application is installed on the mobile device, and the mobile banking application includes a voice recognition module and a face recognition module. After logging in to the mobile banking application, read out at least one transaction requirement by voice input, and the voice recognition module performs voice recognition on the transaction requirement; then captures a face image of one of the users and stores it in the face recognition mode in advance One of the users in the group compares the images of the user. If the face recognition is successful, the mobile banking application can send the transaction requirements identified by the voice to a bank server, and the bank server will perform subsequent operations according to the transaction requirements. This creation allows users to operate mobile banking applications with voice input, which is extremely convenient for people who are not convenient to press the keyboard or who have low vision.

Description

Mobile banking system with voice and face recognition

This creation is about a mobile banking system, especially a mobile banking system with voice and facial recognition.

With the increasing popularity of online transactions and the advent of the era of a smart phone, more and more transactions are transferred to the Internet, and the manpower for counters has also been reduced. However, online transactions pay great attention to information security. If they do not pay attention to the risk of being stolen during the data transmission process, they will also be vulnerable to identity theft when confirming whether the trader is himself.

In addition, online trading is a very difficult operation for some seniors, and many instructions can make people unfamiliar with computers face operational obstacles. And for some people, entering text and numbers on a smart phone with a keyboard is easy to make mistakes, and it ’s even less tolerant to input errors such as transferring money or entering a password. Based on the above reasons, the implementation of online banking on mobile devices has created a limitation. For people who are not familiar with online transactions, how to increase their willingness to use mobile banking applications is an important issue.

Therefore, this creation proposes a mobile banking system with voice and facial recognition, which effectively solves these problems. The specific architecture and implementation will be detailed below:

The main purpose of this creation is to provide a mobile banking system with voice and face recognition. It combines voice recognition with a mobile banking application. The user speaks the transaction needs by speaking. The mobile banking application uses voice recognition to convert the voice After converting to text, confirm the transaction order issued by the user, providing users with more convenient mobile internet banking operations.

Another purpose of this creation is to provide a mobile banking system with voice and facial recognition, which uses facial recognition to confirm the identity of the user, and avoids fingerprint recognition often failing to be recognized by water or oil stains on the fingers.

In order to achieve the above purpose, this creation provides a mobile banking system with voice and facial recognition, which is applied to a mobile banking application installed on a mobile device, including: a keyword setting module for setting operations Plural voice instructions of the mobile banking application; a voice recognition module electrically connected to the keyword setting module, the voice recognition module recognizes at least one transaction requirement read by a user, and recognizes The transaction requirements are compared with the voice instructions in the keyword setting module. If the transaction requirements meet the voice instructions, the recognition is successful and the voice instructions corresponding to the transaction requirements are obtained; and a face recognition Module, electrically connected to the voice recognition module, the face recognition module stores a user image of the user in advance, and captures a face image of the user after the speech recognition is successful and before the transaction is performed, Compare with the stored user image and continue the transaction of the mobile banking application after the face recognition is successful.

According to the embodiment of this creation, the user logs in the mobile banking application to confirm the identity of the user by recognizing the facial image.

According to the embodiment of this creation, the voice commands in the keyword setting module are set by the user.

According to the embodiment of the present creation, after the face recognition is successful, the mobile banking application connects to a bank server for online transactions.

According to the above description, the mobile banking application program transmits the transaction requirements identified by the voice recognition module to the bank server, and the bank server performs subsequent operations according to the transaction requirements.

According to the embodiment of the present creation, the voice instructions in the keyword setting module are set to correspond to actual operations. When the voice instructions are accounts, the mobile banking application stores the actual account number corresponding to the account.

According to the embodiment of this creation, the voice recognition module converts the result of identifying the transaction demand into text and displays it on the mobile device for the user to confirm whether the identified content is correct.

According to the embodiment of the present invention, the voice recognition module is connected to a microphone for receiving the voice command of the user for recognition.

This creation provides a mobile banking system with voice and facial recognition, which confirms the identity of the user through facial recognition, increases the information security of online banking transactions, and provides users with a service that can operate transactions by voice, allowing mobile banking applications The program is more convenient to use.

Please refer to FIG. 1, which is a schematic diagram of a mobile banking system with voice and facial recognition. It is a mobile banking application 12 installed on a mobile device 10. The mobile device 10 may be a smart phone or a tablet. Computer, and the mobile banking application 12 is a software program dedicated to the mobile device 10 issued by a banking institution, which performs calculation processing through a processor in the mobile device 10, and the bank server 20 of the banking institution uses the The wireless network signal provided by the communication module on the motherboard is connected with the mobile banking application 12. The mobile banking application 12 includes a keyword setting module 122, a voice recognition module 124, and a face recognition module 126. The keyword setting module 122 is used to set a plurality of voices for operating the mobile banking application. Commands, such as "My NT account", "Daddy's transfer account", "Taiwan account balance query", etc .; the voice recognition module 124 is electrically connected to the keyword setting module 122, and when the user is facing the mobile device 10 After at least one transaction requirement is read, the user's voice is received by the microphone 14 and transmitted to the speech recognition module 124. The speech recognition module 124 performs speech recognition on the transaction requirement, converts the speech into text, and recognizes it. The transaction requirements are compared with the voice instructions set in the keyword setting module 122. If the transaction requirements meet the voice instructions, the recognition is successful and a voice instruction corresponding to the transaction requirements is obtained; the face recognition module 126 is electrically connected to the voice recognition module Group 124. After the voice recognition module 124 successfully recognizes the user's transaction needs, the face image must be verified before the transaction, so the face An image of one of the users is stored in the recognition module 126 in advance. After the voice recognition is successful and before the transaction is performed, the image capture device 16 of the mobile device is used to capture a face image of one of the users. The face recognition module 126 and compare the face image with the stored user image. When the face recognition is successful, the mobile banking application 12 continues the transaction proposed by the user.

Further, when the face recognition is successful, the mobile banking application 12 will connect to the bank server 20 to perform online transactions.

Figure 2 is a flowchart of the operation method of creating a mobile banking system with voice and face recognition. In step S10, the user logs in to the mobile banking application on the mobile device, and then in step S12, the user sets the multiple transaction requirements and the corresponding multiple voice commands. After the setting is completed, the user can operate the mobile bank by voice input. The application program, as described in step S14, the user reads out at least one transaction requirement; in step S16, after the mobile banking application receives the user's voice through the microphone, it uses the voice recognition module to perform voice recognition on the transaction requirement, The identified transaction demand is compared with a preset voice command. If the transaction demand meets the voice command, as described in step S18, the voice recognition is successful, and the mobile banking application obtains a voice command corresponding to the transaction demand; then step In S20, the mobile banking application will perform a user identity verification, use the image capture device on the mobile device to capture a face image of the user, and compare it with a pre-stored user image; if the face If the identification is successful, as described in step S22, the mobile banking application sends the transaction request Bank servers, bank server then follow-up business based on the trading needs.

In step S10, the user logs in to the mobile banking application to confirm the identity of the user by recognizing the facial image. In other words, regardless of logging in to the mobile banking application or performing a transaction, the user can use facial recognition for identity authentication, which is in common use with current ones. Compared with fingerprint recognition, fingerprint recognition is prone to failure due to wet and greasy fingers, but as long as the face recognition is sufficient and the face image is clear, there is no possibility of failure.

In addition, the step of setting a voice command in the keyword setting module of step S12 can be set by the user, as shown in FIG. 3A to FIG. 3C, which is the user interface of the mobile banking application in this creation Please refer to Figure 3A for the steps of setting the voice command. The homepage of the mobile banking application contains various service functions. Select "Other Services" in the lower right corner and enter the page shown in Figure 3B. The options on the page Contains a "voice keyword". Click to enter the keyword setting module. The voice commands in the keyword setting module are the actual operations of setting the corresponding. When the voice command is an account, the mobile banking application stores the corresponding account. The actual account number, as shown in Figure 3C, assumes that the user sets the voice command to "My Taiwanese account" in the keyword database management, and the account number corresponding to this voice command is 045005000001.

After the voice command is stored, the user can directly use the voice input after querying the Taiwanese account. As shown in Figures 3D and 3E, if the user says "I want to check the balance of my Taiwanese account", The voice recognition module can recognize this voice information and convert it into text and display it on the user interface of the mobile banking application, as shown in Figure 3D. If the user confirms that the identified transaction demand is correct, he will act The bank application will send this transaction request to the bank server, obtain the user's NT account balance information, and return it to the mobile device for display, as shown in Figure 3E. In particular, the speech recognition module of this creation uses fuzzy recognition, so as long as the transaction request "I want to check my Taiwanese account balance" contains the voice command "My Taiwanese account", the recognition is successful. Therefore, with the setting of the voice instruction program proposed by this author, the user can use the voice input method to obtain the desired transaction result, without having to choose among the various services in Figure 3A, and without entering an account number. You only need to enter the account number once when setting the keywords, which can greatly reduce the difficulty for users to operate mobile banking applications, make it easier for users to get started, and increase their willingness to use mobile banking applications.

In addition to setting the most basic voice commands for account inquiry, this creation can also perform all banking services such as transfer, fixed deposit, fund purchase, foreign exchange settlement and sales, because the speech recognition module of this creation also includes a semantic judgment function Based on linguistics, the identified text information is calculated and understood by artificial intelligence to obtain the corresponding business. For example, if the keyword setting module stores "My Taiwanese account" and "My dad's transfer account", when the user enters "Transfer 1,000 yuan from my Taiwanese account to my dad's account" "Transfer into account", the speech recognition module can understand "My Taiwanese account", "Transfer 1,000 yuan", "My dad's transfer account", especially the action keyword "Transfer", so My Taiwan dollar account balance shown in Figure 3E will be displayed, but the "transfer" action will be performed specifically, and the semantics will be used to determine which of the transfer account and transfer account are.

For another example, taking the fund purchase as an example, the user sets "fund purchase" in the keyword setting module, and the mobile banking application will jump to the fund purchase page. The user can choose to input by voice and read "I want to buy 1,000 yuan for xxxx fund", after the speech recognition module recognizes it, send the transaction requirements to the bank server, and the bank server will search for the xxxx fund and transfer it from the user's account 1,000 yuan to buy the fund.

To sum up, a mobile banking system with voice and face recognition provided by this creation is a combination of voice recognition and mobile banking applications. Users use voice input to input transaction requirements. Mobile banking applications use voice recognition to convert voice After converting to text, confirm the transaction order issued by the user, providing users with a more convenient way of operating online banking. In addition, in this creation, a face recognition method is added to confirm the identity of the user, which can effectively avoid risks such as easy leakage of passwords and easy theft of fingerprints, and increase information security.

The above are only the preferred embodiments of this creation, and are not used to limit the scope of this creation. Therefore, all equal changes or modifications based on the characteristics and spirit described in the scope of the application for this creation shall be included in the scope of the patent application for this creation.

10‧‧‧ mobile device
12‧‧‧ Mobile Banking Application
122‧‧‧Keyword Setting Module
124‧‧‧Voice recognition module
126‧‧‧Face recognition module
14‧‧‧ Microphone
16‧‧‧Image capture device
20‧‧‧Bank Server

Figure 1 is a schematic diagram of a mobile banking system with voice and face recognition.
Figure 2 is a flowchart of the operation method of creating a mobile banking system with voice and face recognition.
Figures 3A to 3E are schematic diagrams of the steps for setting and using voice commands on the user interface of a mobile banking application in the creation.

Claims (8)

A mobile banking system with voice and facial recognition, which is applied to a mobile banking application installed on a mobile device, including:
A keyword setting module for setting a plurality of voice instructions for operating the mobile banking application;
A voice recognition module electrically connected to the keyword setting module. The voice recognition module recognizes at least one transaction requirement read by a user, and recognizes the identified transaction requirement and the keyword setting module. The voice instructions in the group are compared. If the transaction requirements meet the voice instructions, the recognition is successful and the voice instructions corresponding to the transaction requirements are obtained; and a face recognition module is electrically connected to the voice recognition module. Group, the face recognition module stores a user image of the user in advance, and captures a face image of the user after the speech recognition is successful and before the transaction, and compares the stored user image with the stored user image Yes, the transaction of the mobile banking application will continue after the face recognition is successful. The mobile banking system with voice and facial recognition as described in claim 1, wherein the user logs into the mobile banking application to confirm the identity of the user by recognizing the facial image. The mobile banking system with voice and face recognition as described in claim 1, wherein the voice commands in the keyword setting module are set by the user. The mobile banking system with voice and face recognition as described in claim 1, wherein after the face recognition is successful, the mobile banking application connects to a bank server to perform online transactions. The mobile banking system with voice and face recognition as described in claim 4, wherein the mobile banking application program transmits the transaction requirements identified by the voice recognition module to the bank server, and the bank server then Follow-up business according to the transaction needs. The mobile banking system with voice and face recognition as described in claim 1, wherein the voice instructions in the keyword setting module are corresponding actual operations. When the voice instructions are accounts, the mobile bank The application stores the actual account number corresponding to the account. The mobile banking system with voice and facial recognition as described in claim 1, wherein the voice recognition module converts the result of recognizing the transaction demand into text and displays it on the mobile device for the user to confirm whether the recognition content is correct . The mobile banking system with voice and face recognition as described in claim 1, wherein the voice recognition module is connected to a microphone for receiving the voice command of the user for recognition.