TWI843056B - Online speech service system with semantic learning and method thereof - Google Patents

Abstract

An online speech service system with semantic learning and a method thereof are provided. When the mobile banking server performs semantic analysis on the text information according to the semantic analysis database and fails to analyze the financial operation and analyzes the to-be-defined vocabulary, the to-be-defined vocabulary is compared with at least one expanded financial operation vocabulary in the vocabulary expansion database to obtain a matching vocabulary , import all the expanded financial operation vocabulary corresponding to the financial operation vocabulary in the vocabulary expansion database into the semantic analysis database and establish an association with the financial operation vocabulary to analyze the financial operation, and the mobile banking server based on the amount information and/or Account information for financial transactions in financial operations, thereby achieving the technical effect of providing automatic financial operation vocabulary expansion so that online banking services are not interrupted.

Description

Online voice service system with semantic learning capability and method thereof

An online voice service system and method thereof, in particular, an online voice service system and method thereof with semantic learning capability realized through voice input of an APP on a user's mobile device.

Mobile devices are developing towards being thinner and smaller. Due to this development, it is not convenient to input information through a virtual keyboard due to mis-pressing. When inputting information through handwriting input, the handwriting recognition technology may recognize incorrect words due to the individual's handwriting habit. Inputting information through voice input can avoid the problems of virtual keyboard and handwriting input.

Existing mobile devices input information through voice input, which can only convert the user's voice information into text information. How to recognize the semantics of the input information can effectively simplify the service operations provided in the application, and expand the automatic financial operation vocabulary so that online banking services are not interrupted will be the technical problems that the present invention needs to solve.

In summary, it can be seen that the existing technology has long had the problem that the existing voice input through mobile devices lacks semantic recognition and cannot realize application service operations. Therefore, it is necessary to propose improved technical means to solve this problem.

In view of the problem that the existing technology of voice input through mobile devices lacks semantic recognition and cannot realize application service operation, the present invention discloses an online voice service system with semantic learning capability and its method, wherein: the online voice service system with semantic learning capability disclosed by the present invention comprises: a user mobile device and a mobile banking server, the user mobile device is installed and runs a mobile banking server. Mobile banking application, the user's mobile device logs in to the mobile banking server through the mobile banking application. The mobile banking application also includes: display module, voice receiving module and mobile device transmission module; the mobile banking server also includes: semantic analysis database, vocabulary expansion database, server transmission module, speech to text module, semantic analysis module, generation module and financial transaction module.

The display module displays the voice input interface, displays text information on the voice input interface, displays response information on the voice input interface, displays financial information on the voice input interface, and displays transaction result information on the voice input interface; the voice receiving module receives voice information and receives voice financial information; and the mobile device transmission module transmits voice information, receives text information or response information, transmits voice financial information, receives financial information, and receives transaction result information.

The semantic analysis database stores multiple sentences and multiple financial operation words; the vocabulary extension database stores financial operation words and at least one extended financial operation word; the server transmission module receives voice information from the automatic device transmission module, and transmits text information, response information or transaction result information to the mobile device transmission module, and the automatic device transmission module receives voice financial information; the voice-to-text module converts voice information into text information and converts voice financial information into financial information; the semantic analysis module is when the text information fails to analyze financial operations according to the semantic analysis database and analyzes The undefined vocabulary is obtained, and the undefined vocabulary is compared with at least one expanded financial operation vocabulary in the vocabulary expansion database to obtain matching vocabulary, and all the expanded financial operation vocabulary corresponding to the financial operation vocabulary in the vocabulary expansion database are imported into the semantic analysis database and associated with the financial operation vocabulary to analyze the financial operation, and the financial information is semantically analyzed according to the semantic analysis database to analyze the amount information and/or account information; the generation module generates response information according to the financial operation; and the financial transaction module performs financial transactions of financial operations according to the amount information and/or account information to generate transaction result information.

The online voice service method with semantic learning capability disclosed in the present invention comprises the following steps: first, the user logs into the mobile banking server through the mobile banking application program through the mobile device to display the voice input interface; then, the mobile banking application program receives the voice information and transmits it to the mobile banking server; then, the mobile banking server converts the voice information into text information; then, the mobile banking server transmits the text information to the mobile banking application program for voice input. The mobile banking server then establishes a semantic analysis database storing multiple sentences and multiple financial operation words; then, the mobile banking server establishes a vocabulary extension database storing the financial operation words and at least one extended financial operation word; then, when the text information fails to analyze the financial operation and analyzes the undefined words according to the semantic analysis database, the mobile banking server performs semantic analysis on the text information according to the semantic analysis database, and the undefined words are combined with the vocabulary extension database. The expanded financial operation vocabulary is matched with the matching vocabulary, and all the expanded financial operation vocabulary corresponding to the financial operation vocabulary in the vocabulary expansion database is imported into the semantic analysis database and associated with the financial operation vocabulary to analyze the financial operation; then, the mobile banking server generates corresponding response information according to the financial operation and transmits it to the mobile banking application for display; then, the mobile banking application receives the voice financial information and transmits it to the mobile banking server ; Then, the mobile banking server converts the voice financial information into financial information to feed back to the mobile banking application and display it; Then, the mobile banking server performs semantic analysis on the financial information based on the semantic analysis database to analyze the amount information and/or account information; Finally, the mobile banking server performs financial transactions based on the amount information and/or account information to generate transaction result information and transmit it to the mobile banking application and display it.

The system and method disclosed in the present invention are as described above. The difference between the system and the prior art is that when the mobile banking server fails to analyze the financial operation and analyzes the undefined vocabulary based on the semantic analysis database, the undefined vocabulary is compared with at least one expanded financial operation vocabulary in the vocabulary expansion database to find the matching vocabulary. All the expanded financial operation vocabulary corresponding to the financial operation vocabulary in the vocabulary expansion database are imported into the semantic analysis database and associated with the financial operation vocabulary to analyze the financial operation. The mobile banking server performs the financial transaction of the financial operation based on the amount information and/or account information.

Through the above-mentioned technical means, the present invention can achieve the technical effect of providing automatic financial operation vocabulary expansion so that online banking services are not interrupted.

10: User mobile device

101: Mobile banking app

11: Display module

12: Voice receiving module

13: Mobile device transmission module

20: Mobile banking server

21: Semantic Analysis Database

211: Sentences

212: Financial Operations Vocabulary

22: Vocabulary expansion database

221: Financial Operations Vocabulary

222: Expand the vocabulary of financial operations

23: Server transmission module

24: Speech-to-text module

25:Semantic analysis module

26: Generate module

27: Financial transaction module

30: Voice input interface

41: Text information

42: Response information

43: Financial information

44: Transaction result information

45: Confirm response information

46: Confirm information

Step 101: The user's mobile device logs into the mobile banking server through the mobile banking application to display the voice input interface

Step 102: The mobile banking application receives the voice message and sends it to the mobile banking server

Step 103: The mobile banking server converts the voice information into text information

Step 104: The mobile banking server sends text information to the mobile banking application for display on the voice input interface

Step 105: The mobile banking server creates a semantic analysis database that stores multiple statements and multiple financial operation terms.

Step 106: The mobile banking server establishes a vocabulary extension database corresponding to and storing financial operation vocabulary and at least one extended financial operation vocabulary.

Step 107: When the mobile banking server performs semantic analysis on the text information based on the semantic analysis database and fails to analyze the financial operation and analyzes the undefined vocabulary, the undefined vocabulary is compared with at least one expanded financial operation vocabulary in the vocabulary expansion database to find the matching vocabulary, and all the expanded financial operation vocabulary corresponding to the financial operation vocabulary in the vocabulary expansion database are imported into the semantic analysis database and associated with the financial operation vocabulary to analyze the financial operation.

Step 108: The mobile banking server generates corresponding response information based on the financial operation and sends it to the mobile banking application for display

Step 109: The mobile banking application receives voice financial information and sends it to the mobile banking server

Step 110: The mobile banking server converts the voice financial information into financial information to feed back to the mobile banking application and display it.

Step 111: The mobile banking server performs semantic analysis on the financial information based on the semantic analysis database to analyze the amount information and/or account information.

Step 112: The mobile banking server performs financial transactions based on the amount information and/or account information to generate transaction result information and transmit it to the mobile banking application for display.

Figure 1 shows a system block diagram of the online voice service system with semantic learning capabilities of the present invention.

Figure 2 shows a schematic diagram of the voice input interface display of the online voice service system with semantic learning capabilities of the present invention.

Figures 3A to 3D are schematic diagrams showing information display of the online voice service with semantic learning capability of the present invention.

Figure 4A is a schematic diagram of the semantic analysis database of the online voice service with semantic learning capability of the present invention.

FIG. 4B is a schematic diagram of the vocabulary expansion database of the online voice service with semantic learning capability of the present invention.

Figure 4C is a schematic diagram of the semantic analysis database of the online voice service with semantic learning capability of the present invention.

Figures 5A and 5B are flowcharts of the method for providing online voice service with semantic learning capabilities of the present invention.

The following will be used in conjunction with diagrams and examples to explain in detail the implementation of the present invention, so that the process of how the present invention applies technical means to solve technical problems and achieve technical effects can be fully understood and implemented accordingly.

The following first describes the online voice service system with semantic learning capabilities disclosed in the present invention, and please refer to "Figure 1", which shows a system block diagram of the online voice service system with semantic learning capabilities of the present invention.

The online voice service system with semantic learning capability disclosed in the present invention comprises: a user mobile device 10 and a mobile banking server 20. The user mobile device 10 is installed with and runs a mobile banking application 101. The user mobile device 10 logs into the mobile banking server 20 through the mobile banking application 101. The mobile banking application 101 further comprises: a display module 11, a voice receiving module 12 and a mobile device transmission module 13; the mobile banking server 20 further comprises: a semantic analysis database 21, a vocabulary expansion database, a server transmission module 23, a speech-to-text module 24, a semantic analysis module 25, a generation module 26 and a financial transaction module 27.

The user mobile device 10 and the mobile banking server 20 are connected to each other via a wireless transmission method. The aforementioned wireless transmission method is, for example, Wi-Fi, mobile communication network (for example, 3G, 4G, 5G, etc.), etc. This is only used as an example to illustrate, and does not limit the scope of application of the present invention.

The user mobile device 10 is, for example, a smart phone, a tablet computer, etc. This is only used as an example to illustrate the invention, and the scope of application of the invention is not limited thereto. The display module 11 displays a voice input interface 30. Please refer to "Figure 2" for the display diagram of the voice input interface 30. "Figure 2" is a display diagram of the voice input interface of the online voice service system with semantic learning capability of the invention. The user mobile device 10 logs into the mobile banking server 20, for example, through an account and password method, a biometric identification method, a Taiwan mobile identity identification method, etc. This is only used as an example to illustrate the invention, and the scope of application of the invention is not limited thereto.

After the user receives the voice information through the voice receiving module 12, the mobile device transmission module 13 transmits the voice information to the server transmission module 23, and the voice-to-text module 24 converts the voice information into text information. Please refer to the existing technical description for how the voice-to-text module 24 converts the voice information into text information, and the present invention will not elaborate on this.

When the voice-to-text module 24 converts the voice information into text information, the server transmission module 23 transmits the text information to the mobile device transmission module 13 so that the text information is displayed on the voice input interface 30 through the display module 11.

Please refer to "Figure 3A", which is a schematic diagram of the information display of the online voice service with semantic learning capabilities of the present invention.

When the user receives the voice message "I want to transfer money" through the voice receiving module 12, the mobile device transmission module 13 transmits the voice message to the server transmission module 23, and the voice-to-text module 24 converts the voice message into text message 41 "I want to transfer money". The server transmission module 23 then transmits the text message 41 to the mobile device transmission module 13, so that the display module 11 displays the text message 41 on the voice input interface 30.

When the speech-to-text module 24 converts the speech information into text information, the semantic analysis module 25 performs semantic analysis on the text information. The mobile banking server 20 has pre-established a semantic analysis database 21. The semantic analysis database 21 stores multiple sentences 211 and multiple financial operation words 212. Please refer to "Figure 4A" for a schematic diagram of the semantic analysis database 21. "Figure 4A" is a schematic diagram of the semantic analysis database of the online speech service with semantic learning capability of the present invention.

The mobile banking server 20 also pre-establishes a vocabulary expansion database 22, which stores financial operation vocabulary 221 and at least one extended financial operation vocabulary 222. Please refer to "Figure 4B" for a schematic diagram of the vocabulary expansion database 22. "Figure 4B" is a schematic diagram of the vocabulary expansion database of the online voice service with semantic learning capability of the present invention. Specifically, the financial operation vocabulary 221 is "transfer" and the corresponding extended financial operation vocabulary 222 is "remittance", "remittance" and "transfer out". This is only an example for explanation, and does not limit the scope of application of the present invention.

The semantic analysis module 25 first compares the text information with the sentence to analyze the text part of the sentence contained in the text information, and then compares the text information with the financial operation vocabulary to analyze the financial operation. When the text information fails to analyze the financial operation according to the semantic analysis database 21, the semantic analysis module 25 analyzes the undefined vocabulary, compares the undefined vocabulary with at least one expanded financial operation vocabulary in the vocabulary expansion database 22 to find the matching vocabulary, imports all the expanded financial operation vocabulary corresponding to the financial operation vocabulary in the vocabulary expansion database 22 into the semantic analysis database 21 and establishes an association with the financial operation vocabulary to analyze the financial operation.

Specifically, in the semantic analysis database 21, a sentence 211 is established as "I want to transfer money" and a financial operation vocabulary 212 is "transfer money". The semantic analysis module 25 cannot analyze the text information 41 as "I want to transfer money" based on the sentence 211 as "I want to transfer money" and the financial operation vocabulary 212 as "transfer money" to determine the financial operation and analyzes the undefined vocabulary as "transfer money". The undefined vocabulary as "transfer money" can be compared with the extended financial operation vocabulary 222 as "transfer money" in the vocabulary extension database 22 as a matching vocabulary. The financial operation vocabulary 221 corresponding to the extended financial operation vocabulary 222 as "transfer money" is "transfer money". Then, all the extended financial operation terms 222 corresponding to the financial operation term 221 "transfer" in the extended vocabulary database 22 are imported into the semantic analysis database 21 and associated with the financial operation term 212 "transfer". Please refer to "Figure 4C" for the semantic analysis database 21 after the extended financial operation term 222 is imported. "Figure 4C" is a schematic diagram of the semantic analysis database of the online voice service with semantic learning capability of the present invention. By this, the semantic analysis module 25 can analyze that the text information 41 "I want to transfer money" corresponds to the financial operation "transfer".

Next, the generation module 26 generates a corresponding response message 42 for "transfer" according to the financial operation, which is "please enter the transfer amount and the transfer account number". The server transmission module 23 transmits the response message 42 to the mobile device transmission module 13, and the display module 11 can display the response message 42 as "please enter the transfer amount and the transfer account number" on the voice input interface 30. Please refer to "Figure 3B", which is a schematic diagram of the information display of the online voice service with semantic learning capability of the present invention.

The user then receives voice financial information "the transfer amount is 1000 and the transfer account number is 123456789" through the voice receiving module 12, and the mobile device transmission module 13 transmits the voice financial information to the server transmission module 23, and the voice-to-text module 24 converts the voice financial information into financial information 43 "the transfer amount is 1000 and the transfer account number is 123456789". The server transmission module 23 then transmits the financial information 43 to the mobile device transmission module 13, so that the display module 11 displays the financial information 43 on the voice input interface 30. It is worth noting that the display module 11 further displays and inputs the financial information through the information display dialog window, and the mobile banking application 101 can receive the financial information from the information display dialog window.

When the speech-to-text module 24 converts the speech financial information into financial information 43, the semantic analysis module 25 performs semantic analysis on the financial information 43 and the sentences and financial operation words in the semantic analysis database 21 to analyze the amount information and/or account information. Specifically, the semantic analysis module 25 performs semantic analysis on the text information. The semantic analysis module 25 can analyze the amount information as "1000" based on "the transfer amount is 1000", and the semantic analysis module 25 can analyze the account information as "123456789" based on "the transfer account number is 123456789".

The financial transaction module 27 can perform a financial transaction with the financial operation of "transfer" according to the amount information "1000" and the account information "123456789", that is, transfer 1000 from the account corresponding to the mobile banking application 101 to the account information "123456789" and generate the transaction result information 44 as "transfer completed", and then the server transmission module 23 transmits the transaction result information 44 to the mobile device transmission module 13. The display module 11 can display the transaction result information 44 as "transfer completed" on the voice input interface 30, please refer to "Figure 3C", "Figure 3C" is a schematic diagram of information display of the online voice service with semantic learning capability of the present invention.

When the semantic analysis module 25 fails to analyze the financial operation based on the semantic analysis database 21 and the financial operation is analyzed through the above process, the generation module 26 can further generate the confirmation response information 45 as "Please confirm whether to transfer money" based on the financial operation, and then the server transmission module 23 transmits the confirmation response information 45 to the mobile device transmission module 13, and the display module 11 displays the confirmation response information 45 as "Please confirm whether to transfer money" on the voice input interface 30. Please refer to "Figure 3D" for the display diagram of the confirmation response information 45, which is a schematic diagram of the information display of the online voice service with semantic learning capability of the present invention.

Then, the voice receiving module 12 receives the voice confirmation information as "yes", and the mobile device transmission module 13 transmits the voice confirmation information to the server transmission module 23, and the voice-to-text module 24 converts the voice confirmation information into confirmation information 46 as "yes". When the generation module 26 confirms that the confirmation information 46 is "yes", it generates the corresponding response information 42 for "transfer" according to the financial operation as "please enter the transfer amount and transfer account number", and the server transmission module 23 also transmits the confirmation information 46 to the mobile device transmission module 13, and then the display module 11 displays the confirmation information as "yes" on the voice input interface 30.

Next, the operation method of the present invention will be described below, and please refer to "Figure 5A" and "Figure 5B" at the same time. "Figure 5A" and "Figure 5B" are flowcharts of the online voice service method with semantic learning capabilities of the present invention.

First, the user's mobile device logs in to the mobile banking server through the mobile banking application to display the voice input interface (step 101); then, the mobile banking application receives the voice information and transmits it to the mobile banking server (step 102); then, the mobile banking server converts the voice information into text information (step 103); then, the mobile banking server transmits the text information to the mobile banking application to be displayed on the voice input interface (step 104); then, the mobile banking server The mobile banking server establishes a semantic analysis database storing multiple sentences and multiple financial operation words (step 105); then, the mobile banking server establishes a vocabulary extension database storing the financial operation words and at least one extended financial operation word (step 106); then, when the text information fails to analyze the financial operation and analyzes the undefined words according to the semantic analysis database, the mobile banking server compares the undefined words with at least one extended financial operation word in the vocabulary extension database to obtain the corresponding financial operation words. The word of the financial operation word is imported into the semantic analysis database and associated with the financial operation word in the vocabulary expansion database to analyze the financial operation (step 107); then, the mobile banking server generates corresponding response information according to the financial operation and transmits it to the mobile banking application for display (step 108); then, the mobile banking application receives the voice financial information and transmits it to the mobile banking server (step 109); then, the mobile banking The bank server converts the voice financial information into financial information to feed back to the mobile banking application and display it (step 110); then, the mobile banking server performs semantic analysis on the financial information based on the semantic analysis database to analyze the amount information and/or account information (step 111); then, the mobile banking server performs financial operations based on the amount information and/or account information to generate transaction result information and transmit it to the mobile banking application and display it (step 112).

In summary, the difference between the present invention and the prior art is that when the mobile banking server fails to analyze the financial operation and analyzes the undefined vocabulary based on the semantic analysis database, the undefined vocabulary is compared with at least one expanded financial operation vocabulary in the vocabulary expansion database to find the matching vocabulary, and all the expanded financial operation vocabulary corresponding to the financial operation vocabulary in the vocabulary expansion database are imported into the semantic analysis database and associated with the financial operation vocabulary to analyze the financial operation, and the mobile banking server performs the financial transaction of the financial operation based on the amount information and/or account information.

This technical means can solve the problem of the existing technology that the lack of semantic recognition through voice input on mobile devices cannot realize application service operation, and thus achieve the technical effect of providing automatic financial operation vocabulary expansion so that online banking services are not interrupted.

Although the implementation method disclosed in the present invention is as above, the content described is not used to directly limit the scope of patent protection of the present invention. Anyone with common knowledge in the technical field to which the present invention belongs can make slight changes in the form and details of implementation without departing from the spirit and scope disclosed in the present invention. The scope of patent protection of the present invention shall still be based on the scope defined in the attached patent application.

10: User mobile device

101: Mobile banking app

11: Display module

12: Voice receiving module

13: Mobile device transmission module

20: Mobile banking server

21: Semantic Analysis Database

22: Vocabulary expansion database

23: Server transmission module

24: Speech-to-text module

25:Semantic analysis module

26: Generate module

27: Financial transaction module

Claims (8)

An online voice service system with semantic learning capability comprises: a user mobile device, the user mobile device is installed with and runs a mobile banking application, the mobile banking application further comprises: a display module, displaying a voice input interface, displaying a text message on the voice input interface, displaying a response message on the voice input interface, displaying a financial message on the voice input interface, and displaying a transaction result message on the voice input interface; a voice receiving module, receiving a voice message, receiving a voice financial message; and a mobile device transmission module, transmitting the voice message, receiving the text message or The response information, transmits the voice financial information, receives the financial information, receives the transaction result information; and a mobile banking server, the user mobile device logs in to the mobile banking server through the mobile banking application, the mobile banking server further includes: a semantic analysis database, storing multiple sentences and multiple financial operation words; a vocabulary expansion database, correspondingly storing the financial operation words and at least one extended financial operation word; a server transmission module, receiving the voice information from the mobile device transmission module, transmitting the text information, the response information or the transaction result information to the server; The mobile device transmission module receives the voice financial information from the mobile device transmission module; a voice-to-text module converts the voice information into the text information and converts the voice financial information into the financial information; a semantic analysis module uses the semantic analysis database to perform semantic analysis on the text information, and fails to analyze a financial operation, and the text information analyzes an undefined vocabulary, compares the undefined vocabulary with the at least one expanded financial operation vocabulary in the vocabulary expansion database to find out the vocabulary that matches, and then finds out the at least one expanded financial operation vocabulary that matches the undefined vocabulary. A financial operation vocabulary, adding all the expanded financial operation vocabulary corresponding to the searched financial operation vocabulary in the vocabulary expansion database to the semantic analysis database and establishing an association with the financial operation vocabulary, so as to analyze the financial operation according to the financial operation vocabulary, and semantically analyze the financial information according to the semantic analysis database to analyze an amount information and/or an account information; a generation module, generating the response information according to the financial operation; and a financial transaction module, performing a financial transaction of the financial operation according to the amount information and/or the account information to generate the transaction result information. The online voice service system with semantic learning capability as described in claim 1, wherein the generating module further comprises generating a confirmation response information according to the financial operation, the server transmission module transmits the confirmation response information to the mobile device transmission module, the display module displays the confirmation response information on the voice input interface, the voice receiving module further comprises receiving a voice confirmation information, the mobile device transmission module transmits the voice confirmation information to the server transmission module, the voice-to-text module converts the voice confirmation information into a confirmation information, and the generating module generates the response information according to the financial operation when confirming the confirmation information. An online voice service system with semantic learning capabilities as described in claim 1, wherein the display module further includes displaying and inputting the financial information through an information display dialog window, and the mobile banking application receives the financial information from the information display dialog window. An online voice service system with semantic learning capabilities as described in claim 1, wherein the semantic analysis module first compares the text information with the sentence to analyze the text part of the sentence contained in the text information, and then compares the text information with the financial operation vocabulary to analyze the financial operation. An online voice service method with semantic learning capability comprises the following steps: a user's mobile device logs in to a mobile banking server through a mobile banking application to display a voice input interface; the mobile banking application receives a voice message and transmits it to the mobile banking server; the mobile banking server converts the voice message into a text message; the mobile banking server transmits the text message to the mobile banking application to be displayed on the voice input interface; the mobile banking server establishes and stores a plurality of The mobile banking server establishes a semantic analysis database corresponding to and storing the financial operation vocabulary and at least one extended financial operation vocabulary; the mobile banking server uses the semantic analysis database to perform semantic analysis on the text information, but fails to analyze a financial operation, and the text information analyzes an undefined vocabulary, compares the undefined vocabulary with the at least one extended financial operation vocabulary in the vocabulary extension database to find out the matching vocabulary, and then finds out the undefined vocabulary. The financial operation vocabulary corresponding to the at least one matched extended financial operation vocabulary is compared, and all the extended financial operation vocabulary corresponding to the searched financial operation vocabulary in the vocabulary extension database is added to the semantic analysis database and associated with the financial operation vocabulary, so as to analyze the financial operation according to the financial operation vocabulary; the mobile banking server generates a corresponding response information according to the financial operation and transmits it to the mobile banking application program for display; the mobile banking application program receives a voice financial information and transmits it to the mobile banking application program; The mobile banking server converts the voice financial information into financial information to feed back to the mobile banking application and displays it; the mobile banking server performs semantic analysis on the financial information according to the semantic analysis database to analyze an amount information and/or an account information; and the mobile banking server performs the financial transaction of the financial operation according to the amount information and/or the account information to generate a transaction result information and transmits it to the mobile banking application and displays it. As described in claim 5, the online voice service method with semantic learning capability further comprises the following steps: the mobile banking server generates a confirmation response message according to the financial operation and transmits it to the mobile banking application for display; the mobile banking application receives a voice confirmation message and transmits it to the mobile banking server; and the mobile banking server converts the voice confirmation message into a confirmation message and then generates the response message according to the financial operation. As described in claim 5, the online voice service method with semantic learning capability further includes the step of the mobile banking application displaying and inputting the financial information through an information display dialog window to receive the financial information from the information display dialog window. In the online voice service method with semantic learning capability as described in claim 5, the mobile banking server performs semantic analysis on the text information and the sentences and financial operation vocabulary in the semantic analysis database to analyze the financial operation by first comparing the text information with the sentence to analyze the text part of the text information containing the sentence, and then comparing the text information with the financial operation vocabulary to analyze the financial operation.

Images