TW201923621A - Conversational financial service device and system comprising a transceiver module, a control module and an emotion recognition module - Google Patents

Abstract

A conversational financial service device includes a transceiver module, a control module connected to the transceiver module, and an emotion recognition module connected to the control module. The transceiver module receives a voice message. The control module transmits the voice message to the emotion recognition module and generates a reply message according to the emotions contained in the voice message recognized by the emotion recognition module. The conversational financial service device further includes a natural language dialogue module connected to the control module. The natural language dialogue module is configured to identify contents of the voice message.

Description

Conversational financial service device and system

The present invention relates to a financial service device and system, and more particularly to a conversational financial service device and system for obtaining financial services by natural language dialogue.

In recent years, due to the high development of communication and network-related industries, people are increasingly demanding the electronic and mobileization of various industries. For the financial industry, in addition to providing online banking, it also provides mobile banking services, enabling users to log in to online banking or mobile banking through various electronic devices such as computers and smart phones. Financial transactions such as auditing, transfer, payment, foreign exchange, and remittance are carried out on the road.

However, in the existing technology, although online banking or mobile banking can bring a lot of convenience, when operating various financial services, it is still necessary to keep eyes and hands on the physical keyboard or screen to operate, not only very Trouble, and for users with visual impairment or physical disabilities, the existing click-to-operate interface is also not friendly.

Accordingly, it is an object of the present invention to provide a conversational financial service device that utilizes natural language dialogue to obtain financial services.

Therefore, the conversational financial service device of the present invention comprises a transceiver module, a control module connected to the transceiver module, a natural language dialogue module connected to the control module, and an emotion recognition module connected to the control module, which are sent and received. The module receives a voice message, the natural language dialogue module is used to identify the content of the voice message, the emotion recognition module is used to identify the emotion contained in the voice message, and the control module is based on the emotion recognition module and the natural language dialogue module. The recognition result is corresponding to generate a reply message, wherein the control module determines the recognition result of the emotion recognition module to be higher than the recognition result of the natural language dialogue module.

In an embodiment, the emotion recognition module includes a text recognition unit and an emotional word database connected to the text recognition unit, and the emotional word database stores a plurality of words or sentence patterns related to the emotional text, and the character recognition unit captures Corresponding voice text in the voice message, and the emotional word database is used to determine the emotional text of the voice message, and an emotional probability score value is generated, and the control module determines the voice message according to the emotional probability score value. mood.

In addition, the emotion recognition module may further include a voiceprint emotion recognition unit and a mood feature database connected to the voiceprint emotion recognition unit, and the emotion feature database stores a plurality of emotion-related voiceprint signals and prediction models, and voiceprint emotions. The identification unit captures the corresponding voiceprint signal in the voice message, and determines the emotion of the voice message with the emotional feature database, and generates an emotional feature value, and the control module determines the emotional probability score and the emotional feature value. The emotions contained in the voice message.

In an embodiment, the natural language dialogue module includes a natural language understanding unit and a dialog generation unit. The natural language understanding unit is configured to execute a corresponding financial service according to the content of the voice message, and the dialog generating unit is configured to use the voice message according to the voice message. Generate corresponding dialogue content.

Further, the natural language dialogue module further includes a language-to-text unit and a text-to-speech unit, wherein the language-to-text unit is configured to compare the text in the voice message with at least one financial vocabulary, and the text-to-speech unit is used to convert the text. Convert to the corresponding audio signal output.

Further, another object of the present invention is to provide a conversational financial service system for obtaining financial services using natural language dialogue.

The conversational financial service system of the present invention comprises a user device for generating a voice message, and a conversational financial service device for communicating with the user device, the conversational financial service device comprising a transceiver module for receiving the voice message, A control module connected to the transceiver module, a natural language dialogue module connected to the control module, and an emotion recognition module connected to the control module, the natural language dialogue module is used to identify the content of the voice message, and the emotion recognition module For identifying the emotion contained in the voice message, the control module generates a reply message according to the recognition result of the emotion recognition module and the natural language dialogue module, wherein the control module determines the weight of the recognition result of the emotion recognition module. It will be higher than the recognition result of the natural language dialogue module.

In an embodiment, the emotion recognition module includes a character recognition unit and a mood word database connected to the character recognition unit, and the emotion word database stores a plurality of words or sentence patterns related to the emotion text, and the text recognition unit captures the Corresponding voice text in the voice message, and using the word database to determine the emotional text of the voice message, and generating an emotional probability score value, and the control module determines the emotion included in the voice message according to the emotional probability score value .

In addition, the emotion recognition module may further comprise a voiceprint emotion recognition unit and a sentiment feature database connected with the voiceprint emotion recognition unit, the emotion feature database stores the complex sound and sound pattern and prediction model, and the voiceprint emotion recognition. The unit captures the corresponding voiceprint signal in the voice message, and determines the emotion of the voice message with the emotional feature database, and generates an emotional feature value, and the control module is based on the emotional probability score value and the emotional feature value. Determine the emotions contained in the voice message.

In an embodiment, the natural language dialogue module includes a natural language understanding unit and a dialog generation unit. The natural language understanding unit is configured to execute a corresponding financial service according to the content of the voice message, and the dialog generating unit is configured to use the voice message according to the voice message. Generate corresponding dialogue content.

Further, the natural language dialogue module further includes a language-to-text unit and a text-to-speech unit, wherein the language-to-text unit is configured to compare the text in the voice message with at least one financial vocabulary, and the text-to-speech unit is used to convert the text. Convert to the corresponding audio signal output.

The effect of the invention is that the use of natural language interaction to obtain financial services can be more convenient in operation, which not only saves the user from having to both eyes and hands to stay on the physical keyboard or the screen, and for the obstacle or vision. Users of the barrier can also easily complete financial services.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same reference numerals.

Referring to FIG. 1 , which is an embodiment of a conversational financial service system 100 of the present invention, the conversational financial service system 100 can obtain financial services through natural dialogue, and not only provides services to customers with special needs, but also solves the current problem. The user must maintain the trouble of both eyes and hands staying on the physical screen, increasing the convenience of operation and life.

The conversational financial service system 100 includes a consumer device 10 and a conversational financial service device 20 that communicates with the user device 10.

The user device 10 can be a mobile device, such as a mobile device, a personal computer (PC), a tablet computer, a notebook computer (NB), etc., which can be installed/opened by an application (APP), social software, The web page and the like perform the dialog financial service of the present invention, that is, the user can talk to the conversational financial service device 20 through the electronic device to obtain the financial service. The user device 10 generates a corresponding voice message according to the words spoken by the user.

The conversational financial service device 20 is a background host or server located at the bank (or enterprise), and includes a transceiver module 21, a control module 22 connected to the transceiver module 21, and a connection control module 22. Emotion recognition module 23.

The transceiver module 21 is a wireless transmission circuit, such as: a radio frequency circuit (RFID), or a near field communication (NFC), a WiFi, a Bluetooth, a 3G/4G network, etc. The end device 10 is used to communicate to transmit signals to each other.

The control module 22 can be a microprocessor (MCU) or a central controller for controlling the operation and signal transmission between the modules. The control module 22 transmits the voice message received by the transceiver module 21 to the emotion recognition. The module 23 generates a reply message according to the emotion contained in the voice message recognized by the emotion recognition module 23, and transmits the reply message to the user device 10 through the transceiver module 21 to reply to the user's office. The content of the description.

In this embodiment, the emotion recognition module 23 includes a character recognition unit 231, an emotion word database 232 connected to the character recognition unit 231, a voiceprint emotion recognition unit 233, and an emotional feature of the voiceprint emotion recognition unit 233. Database 234.

The Emotional Character Database 232 stores a plurality of vocabulary or sentence patterns related to emotional words, such as: anger vocabulary words (such as "dirty words", "what is doing", etc.), doubtful vocabulary words (such as "OK?", "Why?", etc.), impatient emotional vocabulary (such as "can you hurry?", "very slow", etc.), happy emotional vocabulary (such as "very good", "good", etc.) and other emotional vocabulary, Not limited to the above. The character recognition unit 231 receives the voice message and extracts the corresponding voice text, and cooperates with the emotion word database 232 to generate an emotional probability score according to the combination of the grammar sentence type and the keyword, and according to the preset threshold ( Threshold) Judging the above various emotional words, for example, when the sentence pattern is a negative sentence or contains abusive words, the combined anger is high (ie, high emotional probability score).

The emotional feature database 234 stores complex vocal tract signals and predictive models related to emotions. The voiceprint emotion recognition unit 233 receives the voice message, and extracts the corresponding voiceprint signal, and cooperates with the voiceprint signal and the prediction model stored in the emotion feature database 234 to determine the various emotions (including anger, doubt, and impatientness). , happy, etc.) and produce an emotional feature value.

In other words, the character recognition unit 231 and the emotion word database 232 use words such as emotional vocabulary to judge the emotion of the voice message, and the voiceprint emotion recognition unit 233 and the emotion feature database 234 are judged by using voiceprints such as pitch fluctuations. The emotion of the voice message, of course, the two methods can be selected in accordance with different applications and the method is selected (ie, the emotion recognition module 23 includes only the character recognition unit 231 and the emotion word database 232, or the voiceprint emotion recognition unit 233 and the emotion. The feature database 234), therefore, the control module 22 determines the emotion contained in the voice message according to the emotion probability score value generated by the character recognition unit 231 and/or the emotion feature value generated by the voiceprint emotion recognition unit 233, and correspondingly generates Reply to the message.

In addition, the conversational financial service device 20 may further include a natural language dialogue module 24 connected to the control module 22 for determining the content of the voice message received by the transceiver module 21.

The natural language dialogue module 24 includes a language-to-text unit 241, a natural language understanding unit 242, a dialog generation unit 243, and a text-to-speech unit 244.

The language-to-text unit 241 includes a financial vocabulary database in which a plurality of financial vocabularies related to financial services and products are stored, such as a 玺 Y card, a LINE PAY card, etc., and the language-to-text unit 241 is used to extract from the voice message. Take the corresponding text, and cooperate with the financial vocabulary database to compare whether there is at least one relevant financial vocabulary in the text to improve the accuracy of the recognition of the voice-to-text. In addition, the language-to-text unit 241 can also include a Chinese acoustic model, which can collect the pronunciation patterns of different users for the same financial vocabulary, so as to increase the adaptability to the accent (for example, Taiwanese Mandarin), and optimize the voice-to-text Correct conversion rate.

The natural language comprehension unit 242 can include an intent and instruction database, the intent and instruction database storing a plurality of control instructions for the financial transaction, and the natural language understanding unit 242 can cooperate with the intent and the instruction according to the content of the speech message. The control instructions in the database execute the corresponding financial services, including personal account balance inquiry, billing inquiry, transaction detail inquiry, remittance transfer, bill payment, income and expenditure record and inquiry, stock exchange price inquiry, arrival price reminder, transaction reservation , investment transaction execution, online customer service Q&A, policy content inquiry, etc., but not limited to the above.

The dialog generating unit 243 can include a brand personality database for storing the complex context and the user's emotions, and providing a variety of assistant character personalities and generating conversation content, so that the user can decide the service. The way to interact.

The text-to-speech unit 244 is configured to convert any text into a corresponding audio signal output, and in this embodiment, the text-to-speech unit 244 can collect and establish a brand-recognized voiceprint model for the synthesized sound of the specific character. Output the sound signal of a specific character.

Moreover, the conversational financial service device 20 can further include an identity recognition module 25 connected to the control module 22 for checking and verifying the identity of the user. The identity recognition module 25 includes an identity recognition unit 251, a personal data library 252 connected to the identity recognition unit 251, a voiceprint recognition unit 253, and a user voiceprint database 254 connected to the voiceprint recognition unit 253.

The personal database 252 is a user identity verification, account password, and digital certificate database, wherein the financial personal information of the plurality of users is stored; the identity recognition unit 251 is based on the content of the voice message (for example, the user speaks himself) Check the identity of the user with the personal account information of the personal database 252. The user voiceprint database 254 is a voiceprint for storing the voice message of the user each time; the voiceprint recognition unit 253 can establish a personal identifiable model by using the voiceprint extraction method to check the voice of the user in the future use.

In addition, the identity module 25 can also be located in another host or server (for example, an existing identity verification server), and the control module 22 can communicate with the host or server through the transceiver module 21. To verify the identity of the user. In addition, the conversational financial service device 20 may also include a personal financial database (not shown) connected to the control module 22 for storing information and records of the user's account, credit, financial transaction, or the like. The communication of the group 21 is stored in the database of another electronic device (for example, an existing personal data server), so the above is not limited to the embodiment.

Therefore, after the user identity is verified, the control module 22 transmits the voice message received by the transceiver module 21 to the emotion recognition module 23 and the natural language dialogue module 24, and the emotion recognition module 23 transmits the text. The natural language dialogue module 24 determines the content of the voice message, such as whether a specific financial vocabulary is mentioned, or whether it is necessary to perform such a transfer transfer, bill payment, etc. The financial transaction service, and the emotion recognition module 23 and the natural language dialogue module 24 respectively transmit the determination result to the control module 22 for the control module 22 to perform comprehensive evaluation and correspondingly generated by the dialog generation unit 243. Reply to the message.

Specifically, the judgment weight of the emotion recognition module 23 is higher than that of the natural language dialogue module 24, that is, when the emotion recognition result exceeds a preset threshold (Threshold), the emotion is processed preferentially, and the conversation is performed. In the branding personality database of the generating unit 243, the default response to the emotion is responded to. For example, when the user responds "Wow! This is too expensive," the corresponding reply message will be "Don't Worried, when the emotional response priority processing is completed, the corresponding financial transaction service is executed according to the user's intention determined by the natural language dialogue module 24.

Referring to FIG. 2, FIG. 2 is a schematic financial service method of the present invention. The method can be applied to the conversational financial service system 100, or any system or electronic device that can execute the following processes. The detailed process of this dialogue financial service method is as follows:

In step S10, the user performs a conversational financial service by installing/opening an application (APP), a social software, a webpage, etc., and starts a conversation, for example, "Hello, I am Wang Xiaoming, please help me."

In step S20, the user terminal 10 converts the content of the conversation into a voice message and transmits it to the conversational financial service device 20.

In step S30, the control module 22 first transmits the voice message to the identity recognition module 25 for checking the identity. The identity recognition unit 251 can determine the personal information of "Wang Xiaoming" and cooperate with the voiceprint recognition unit 253 to determine the identity of the user for the voiceprint determination of the dialogue. If the identity is correct, the control module 22 generates Reply to the message, for example: "Hello, Mr. Wang, I am very happy to serve you."

In step S40, the content of the conversation (for example, "How much is my credit card bill this month?") can be converted into a voice message by using the terminal device 10, and transmitted to the conversational financial service device 20.

In step S50, the control module 22 performs a comprehensive evaluation based on the emotion contained in the voice message recognized by the emotion recognition module 23 and the content of the voice message judged by the natural language dialogue module 24, and correspondingly generates a reply message, for example: Your credit card bill for this month is 50,000 yuan."

Step S60 is transmitted back to the user device 10 through the transceiver module 21 to output the reply message. In particular, the output mode can display the corresponding text not only in a voice manner but also through the interactive interface of the terminal device 10, and is not limited to which manner.

In summary, the conversational financial service system 100 and method of the present invention can facilitate the easy access to financial related services by using the form of natural language interaction, and can solve the problem that the current user must maintain both eyes and hands on the physical screen. The trouble of the operation, for example, at the same time as driving, can complete the daily financial service in a dialogue manner, so that the object of the present invention can be achieved.

However, the above is only the embodiment of the present invention, and the scope of the invention is not limited thereto, and all the equivalent equivalent changes and modifications according to the scope of the patent application and the patent specification of the present invention are still The scope of the invention is covered.

100‧‧‧Dialogue Financial Services System

10‧‧‧Using end device

20‧‧‧Dialogue financial service installation

21‧‧‧ transceiver module

22‧‧‧Control Module

23‧‧‧Emotion Recognition Module

231‧‧‧Text recognition unit

232‧‧‧Emotional word database

233‧‧‧ voiceprint emotion recognition unit

234‧‧‧Emotional Characteristics Database

24‧‧‧Natural Language Dialogue Module

241‧‧‧ language to text unit

242‧‧‧Natural Language Understanding Unit

243‧‧‧Dialog generation unit

244‧‧‧Text-to-speech unit

25‧‧‧identification module

251‧‧‧identity unit

252‧‧‧Personal Database

253‧‧‧ voiceprint identification unit

254‧‧‧User voiceprint database

Steps S10 to S60

The other features and advantages of the present invention will be apparent from the embodiments of the present invention, wherein: Figure 1 is a circuit block diagram of an embodiment of the dialog financial service system of the present invention; and Figure 2 is a dialog of the present invention. Flow chart of the financial services method.

Claims (10)

A conversational financial service device comprising: a transceiver module for receiving a voice message; a control module for connecting the transceiver module; a natural language dialogue module for connecting the control module, the natural language dialogue module The emotion recognition module is configured to identify the emotion contained in the voice message, and the emotion recognition module is configured to identify the emotion included in the voice message, and the control module identifies the module according to the emotion and the natural The recognition result of the language dialogue module correspondingly generates a reply message, wherein the control module determines the recognition result of the emotion recognition module to be higher than the recognition result of the natural language dialogue module. The conversational financial service device of claim 1, wherein the emotion recognition module comprises a text recognition unit and an emotional word database connected to the character recognition unit, wherein the emotional word database stores a plurality of characters related to the emotional text. a vocabulary or sentence pattern, the character recognition unit captures the corresponding voice text in the voice message, and uses the emotion word database to determine the emotional text of the voice message, and generates an emotional probability score value, and the control module is The emotion contained in the voice message is determined based on the emotional probability score value. The conversational financial service device of claim 2, wherein the emotion recognition module further comprises a voiceprint emotion recognition unit and a mood feature database connected to the voiceprint emotion recognition unit, wherein the emotion feature database stores a plurality of An emotion-related voiceprint signal and prediction model, the voiceprint emotion recognition unit captures a corresponding voiceprint signal in the voice message, and cooperates with the emotion feature database to determine the emotion of the voice message, and generates an emotional feature value. The control module determines the emotion contained in the voice message according to the emotional probability score value and the emotion feature value. The conversational financial service device of claim 1, wherein the natural language dialogue module comprises a natural language understanding unit and a dialog generation unit, wherein the natural language understanding unit is configured to execute the corresponding financial according to the content of the voice message. The service, the dialog generating unit is configured to generate a corresponding conversation content according to the voice message. The conversational financial service device of claim 4, wherein the natural language dialogue module further comprises a language-to-text unit and a text-to-speech unit, wherein the language-to-text unit is configured to compare whether the text in the voice message is The at least one financial vocabulary is matched, and the text-to-speech unit is used to convert the text into a corresponding audio signal output. A conversational financial service system comprising: a user device for generating a voice message; and a conversational financial service device communicating with the user device, the conversational financial service device comprising a transceiver module for receiving the voice message a control module connected to the transceiver module, a natural language dialogue module connected to the control module, and an emotion recognition module connected to the control module, the natural language dialogue module is configured to identify the voice message Contenting, the emotion recognition module is configured to identify the emotion contained in the voice message, and the control module generates a reply message according to the recognition result of the emotion recognition module and the natural language dialogue module, wherein the control module The judgment weight of the recognition result of the emotion recognition module is higher than the identification result of the natural language dialogue module. The conversational financial service system of claim 6, wherein the emotion recognition module comprises a text recognition unit and an emotional word database connected to the character recognition unit, wherein the emotion word database stores the plural and the emotional text a vocabulary or sentence pattern, the character recognition unit captures the corresponding voice text in the voice message, and uses the emotion word database to determine the emotional text of the voice message, and generates an emotional probability score value, and the control module is The emotion contained in the voice message is determined based on the emotional probability score value. The conversational financial service system of claim 7, wherein the emotion recognition module further comprises a voiceprint emotion recognition unit and a mood feature database connected to the voiceprint emotion recognition unit, wherein the emotion feature database stores a plurality of An emotion-related voiceprint signal and prediction model, the voiceprint emotion recognition unit captures a corresponding voiceprint signal in the voice message, and cooperates with the emotion feature database to determine the emotion of the voice message, and generates an emotional feature value. The control module determines the emotion contained in the voice message according to the emotional probability score value and the emotion feature value. The conversational financial service system of claim 6, wherein the natural language dialogue module comprises a natural language understanding unit and a dialog generation unit, wherein the natural language understanding unit is configured to perform a corresponding financial according to the content of the voice message. The service, the dialog generating unit is configured to generate a corresponding conversation content according to the voice message. The conversational financial service system of claim 9, wherein the natural language dialogue module further comprises a language-to-text unit and a text-to-speech unit, wherein the language-to-text unit is used to compare whether the text in the voice message is The at least one financial vocabulary is matched, and the text-to-speech unit is used to convert the text into a corresponding audio signal output.