CN110019718B - Method for modifying multi-turn question-answering system, terminal equipment and storage medium - Google Patents

Method for modifying multi-turn question-answering system, terminal equipment and storage medium Download PDF

Info

Publication number
CN110019718B
CN110019718B CN201711346539.2A CN201711346539A CN110019718B CN 110019718 B CN110019718 B CN 110019718B CN 201711346539 A CN201711346539 A CN 201711346539A CN 110019718 B CN110019718 B CN 110019718B
Authority
CN
China
Prior art keywords
question
answering
interactive
node
turn
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711346539.2A
Other languages
Chinese (zh)
Other versions
CN110019718A (en
Inventor
李波
姜中秋
曾永梅
朱频频
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Xiaoi Robot Technology Co Ltd
Original Assignee
Shanghai Xiaoi Robot Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Xiaoi Robot Technology Co Ltd filed Critical Shanghai Xiaoi Robot Technology Co Ltd
Priority to CN201711346539.2A priority Critical patent/CN110019718B/en
Priority to US16/106,680 priority patent/US11341422B2/en
Publication of CN110019718A publication Critical patent/CN110019718A/en
Application granted granted Critical
Publication of CN110019718B publication Critical patent/CN110019718B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3329Natural language query formulation or dialogue systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention discloses a method for modifying a multi-turn question-answering system, terminal equipment and a storage medium. The modification method comprises the following steps: acquiring modification information of a set system component in a target multi-turn question-answering system; wherein the modification information comprises any one or more of the following: modifying subject knowledge points corresponding to the target multi-turn question-answering system, modifying a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system, and modifying knowledge points corresponding to set interactive nodes in the target multi-turn question-answering flow module; and correspondingly updating the target multi-turn question-answering system according to the modification information. The scheme of the embodiment of the invention optimizes the modification mode of the existing multi-turn question-answering system, realizes the quick modification and update of the multi-turn question-answering system, avoids the introduction of developers in the modification process of the multi-turn question-answering system, and greatly reduces the workload of the developers.

Description

Method for modifying multi-turn question-answering system, terminal equipment and storage medium
Technical Field
The embodiment of the invention relates to an intelligent question-answering technology, in particular to a method for modifying a multi-turn question-answering system, terminal equipment and a storage medium.
Background
Human-computer interaction is the science of studying the interactive relationships between systems and users. The system may be a variety of machines, and may be a computerized system and software. For example, various artificial intelligence systems (intelligent customer service systems, voice control systems, etc.) can be realized through human-computer interaction. Artificial intelligence semantic recognition is the basis for human-machine interaction, which is capable of recognizing human language for conversion into machine-understandable language.
The intelligent question-answering system is a typical application of human-computer interaction, wherein when a user proposes a question, the intelligent question-answering system gives an answer to the question. A multi-turn question-answering system is a very important intelligent question-answering system, and it often needs to interact with users in multiple turns. And determining feedback information provided for the user in the next round of question answering according to the interactive content input by the user in the process of a certain round of question answering. Correspondingly, a multi-turn question-answering system usually corresponds to a multi-turn question-answering process, and the next trend of the whole multi-turn question-answering process is continuously determined from a root node in the multi-turn question-answering process according to user interaction information received at a plurality of interaction nodes (judgment nodes) until a final node in the expectation is finally reached to finish the whole multi-turn question-answering process.
With the continuous progress of the technology, the modification requirements of people on the multi-turn question-answering system and the multi-turn system are continuously improved, and the existing modification technology of the multi-turn question-answering system cannot meet the increasingly-increasing personalized and convenient modification requirements of people.
Disclosure of Invention
The embodiment of the invention provides a method for modifying a multi-turn question-answering system, terminal equipment and a storage medium, which are used for optimizing the existing technology for modifying the multi-turn question-answering system and improving the modification efficiency and modification convenience of the multi-turn question-answering system.
In a first aspect, an embodiment of the present invention provides a method for modifying a multi-turn question-answering system, which is applied to the multi-turn question-answering system;
the multi-round question-answering system comprises: a plurality of rounds of question-answering flow modules corresponding to a plurality of rounds of question-answering flow charts, wherein the plurality of rounds of question-answering flow charts comprise a plurality of graphic assemblies, and the graphic assemblies comprise: a plurality of interactive nodes;
one or more knowledge points which are stored in a knowledge base and have corresponding relations with each interactive node in the multi-round question-answering flow chart, wherein the knowledge points corresponding to the interactive nodes comprise: the system comprises interactive questions and interactive answers, wherein the interactive questions are used for being matched with received user interactive information, and the interactive answers are used for determining the next trend of the multi-turn question-answering flow module; and
theme knowledge points stored in the knowledge base, wherein the theme knowledge points comprise theme questions and theme answers, the theme questions are used for representing trigger conditions of the multiple rounds of question-answering flow modules matched with a multiple rounds of question-answering system, and the theme answers are used for establishing trigger relations between the theme knowledge points and the multiple rounds of question-answering flow modules;
the method for modifying the multi-turn question-answering system comprises the following steps:
acquiring modification information of a set system component in a target multi-turn question-answering system;
wherein the modification information comprises any one or more of the following: modifying subject knowledge points corresponding to the target multi-turn question-answering system, modifying a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system, and modifying knowledge points corresponding to set interactive nodes in the target multi-turn question-answering flow module;
and correspondingly updating the target multi-turn question-answering system according to the modification information.
In a second aspect, an embodiment of the present invention further provides a terminal device, where the terminal device includes:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a method for modifying a multi-turn question-and-answer system as described in any embodiment of the invention.
In a third aspect, an embodiment of the present invention further provides a computer storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a method for modifying a multi-turn question-answering system according to any embodiment of the present invention.
The embodiment of the invention provides a method for modifying a multi-turn question-answering system, terminal equipment and a storage medium, wherein modification information of a set system component in a target multi-turn question-answering system is obtained; wherein the modification information comprises any one or more of the following: modifying subject knowledge points corresponding to the target multi-turn question-answering system, modifying a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system, and modifying knowledge points corresponding to set interactive nodes in the target multi-turn question-answering flow module; according to the modification information, a specific mode for modifying the multi-turn question-answering system is provided by a technical means for correspondingly updating the target multi-turn question-answering system, the modification requirements of a user on the multi-turn question-answering system are greatly met, the existing method for modifying the multi-turn question-answering system is optimized, the modification efficiency and modification convenience of the multi-turn question-answering system are improved, the multi-turn question-answering system is rapidly modified and updated, developers are prevented from being introduced in the modification process of the multi-turn question-answering system, and the workload of the developers is greatly reduced.
Drawings
FIG. 1a is a flow chart of a method for generating a multi-turn question-answering system to which embodiments of the present invention are applicable;
FIG. 1b is a schematic diagram of a graphical multi-turn question-answering flow chart, to which embodiments of the present invention are applicable;
FIG. 1c is a diagram illustrating a user-defined configuration information of an input interaction node, to which an embodiment of the present invention is applicable;
fig. 1d is a schematic diagram of inputting the custom configuration information of the broadcast node according to the embodiment of the present invention;
FIG. 1e is a diagram illustrating a user-defined configuration information of an input connector according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method for modifying a multi-turn question-answering system in accordance with one embodiment of the present invention;
FIG. 3 is a flow chart of a method for modifying a multi-turn question-answering system in accordance with a second embodiment of the present invention;
FIG. 4 is a flow chart of a method of modifying a multi-turn question-answering system in a third embodiment of the present invention;
fig. 5 is a schematic structural diagram of a computer device in the fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
In order to facilitate understanding of the content of the embodiment of the invention, question-answer knowledge points in intelligent question-answers and related concepts of semantic expressions are introduced for simple introduction:
1. question-answering knowledge point
The most primitive and simplest form of question-answer knowledge points in the knowledge base is the frequently used FAQ in normal times, and the general form is a question-answer pair. For example, "the tariff for a coloring ring back tone" is a clear description of the standard. The term "question" should not be construed narrowly as "question" but rather broadly as "input" with corresponding "output". For example, for semantic recognition for a control system, an instruction of a user, for example "turn on radio", should also be understood as a "question", in which case the corresponding "answer" may be a call to a control program for executing the corresponding control.
When the user inputs the information to the machine, the most ideal situation is to use standard questions, and the intelligent semantic recognition system of the machine can immediately understand the meaning of the user. However, rather than using standard questions, users often use some variant form of standard questions. For example, if the standard form of a station switch for a radio is "change station", then the command that the user may use is "switch station", and the machine also needs to be able to recognize that what the user has expressed is the same meaning.
For intelligent semantic recognition, an expanded question of a standard question is required in the knowledge base, and the expanded question is slightly different from the expression form of the standard question but expresses the same meaning.
Therefore, the knowledge base comprises a plurality of question-answer knowledge points, each question-answer knowledge point comprises a question and an answer, the question comprises a standard question and a plurality of expanded questions, and the questions in the question-answer knowledge points are generally represented in the form of semantic expressions.
2. Semantic expression
The semantic expression mainly comprises words, parts of speech and their or relations, the core of the semantic expression depends on the parts of speech, the simple understanding of the parts of speech is a group of common words, the words can be similar or dissimilar in semantics, and the words can be marked as important or unimportant. The semantic expression and user question relationship is very different from the traditional template matching, in which the template and user question are just matching and unmatching relationships, and the relationship between the semantic expression and user question is represented by a quantized value (similarity), and the quantized value and the similarity between the similar question and the user question can be compared with each other. Because the semantic expression and the similar question sentence participate in similarity calculation, the definition of the template grammar is not complex, but enough ability to express the semantic is required.
In addition, in each embodiment of the present invention, a method for modifying a multi-turn question-answering system is provided, wherein the multi-turn question-answering system specifically includes:
a plurality of rounds of question-answering flow modules corresponding to a plurality of rounds of question-answering flow charts, wherein the plurality of rounds of question-answering flow charts comprise a plurality of graphic assemblies, and the graphic assemblies comprise: a plurality of interactive nodes;
one or more knowledge points which are stored in a knowledge base and have corresponding relations with each interactive node in the multi-round question-answering flow chart, wherein the knowledge points corresponding to the interactive nodes comprise: the system comprises interactive questions and interactive answers, wherein the interactive questions are used for being matched with received user interactive information, and the interactive answers are used for determining the next trend of the multi-turn question-answering flow module; and
the topic knowledge points are stored in the knowledge base and comprise topic questions and topic answers, the topic questions are used for representing trigger conditions of the multiple rounds of question-answering flow modules matched with the multiple rounds of question-answering systems, and the topic answers are used for establishing trigger relations between the topic knowledge points and the multiple rounds of question-answering flow modules.
For ease of understanding, the generation method of the multi-turn question-answering system will be briefly described first.
As shown in fig. 1a, the method for generating the multi-turn question-answering system specifically includes:
and S110, acquiring one or more graphical multi-turn question-answer flow charts.
The multiple rounds of question answering flow charts can be graphical flow charts obtained by selecting and combining various graphical components provided in a set flow editing interface.
Wherein a graph component may comprise nodes and connectors (typically connecting lines) for connecting different nodes. The nodes comprise interactive nodes, the interactive nodes are specifically nodes which can interact with interactive users in a question-answer mode (either a question-answer mode or a question-answer mode), and the next trend of a multi-turn question-answer flow chart can be determined according to user interaction information input by the users under the interactive nodes.
From the overall structure of the multi-round question-answering flow chart, a multi-round question-answering flow chart can comprise a root node representing the beginning of the flow and one or more termination nodes representing the end of the flow. In addition, multiple layers of interactive nodes can be included in the multi-turn question-answering flow chart, and each layer of interactive nodes comprises one or more interactive nodes. Wherein, one layer of interactive nodes corresponds to one question answering stage.
It is to be understood that the nodes may include broadcast nodes, variable setting nodes, or recording nodes, besides the interactive nodes, and this embodiment does not limit this, and generally, a root node in a multi-turn question-and-answer flowchart is an interactive node, and a termination node is a broadcast node.
For ease of understanding, a graphical multi-round question-answering flow chart is shown in FIG. 1 b. As shown in fig. 1b, the diamond-shaped graphic component in the multi-round question-answering flow chart is an interactive node (for example, an age inquiry node 101), and the square-shaped graphic component is a broadcast node (for example, an age not meeting the loan condition node 102). The nodes are connected through node-to-node connecting lines. Wherein, the flow chart of the multi-turn question answering in fig. 1b includes four layers of interactive nodes. Each layer comprises an interactive node, namely: the first layer includes: an inquiry age node 101 (root node) representing an age inquiry stage, a second layer including an inquiry as to whether there is a car-owned house node 103 representing a car-owned house inquiry stage, a third layer including a node 106 inquiring a loan amount representing a loan amount inquiry stage, and a fourth layer including an inquiry installment node 107 representing an installment amount inquiry stage. And different trends of the multi-turn question-answering flow chart are correspondingly determined in each interactive node according to the input different interactive contents. In addition, the multi-turn question-answering flow chart comprises a plurality of termination nodes, namely: the node 102 for indicating the age does not meet the loan condition, the node 109 for indicating excess amount, the node 108 for indicating the excess amount and the node 10A for reporting the loan staging result.
S120, generating a standardized code frame matched with each multi-round question-answering flow chart according to each graphic component included in each multi-round question-answering flow chart, wherein the graphic components comprise: a plurality of interactive nodes.
The multi-turn question-answering flow module capable of being automatically generated is provided. Accordingly, standard implementation code matching different types of graphic components is provided in advance, such as: and establishing standard implementation codes respectively corresponding to the interactive nodes and the broadcast nodes, packaging the standard implementation codes in different library files, and establishing a corresponding relation between the standard implementation codes and the corresponding graphic assemblies in advance. Typically, a storage address (or a reference address) of a standardized implementation code matched with each graphic component may be written in the flow editing interface in advance, and accordingly, a matched standardized code frame may be automatically generated for each graphic component included in a multi-turn question-answering flow chart drawn based on the flow editing interface.
It should be noted that, the embodiment of the present invention mainly focuses on a method for generating a multi-round question-answering system, and therefore, a multi-round question-answering flow chart may include a plurality of interactive nodes, but the technical solution of the embodiment of the present invention may theoretically implement generation of any type of question-answering system, and as long as a corresponding flow chart is drawn as needed, a corresponding standardized code frame may be obtained, and a corresponding flow module may be obtained.
S130, generating custom codes corresponding to the graphic assemblies respectively according to custom configuration information matched with the graphic assemblies in the multi-round question-answering flow chart, and adding the custom codes to positions, associated with the graphic assemblies, in the standardized code frame to generate a multi-round question-answering flow module corresponding to the multi-round question-answering flow chart.
It is understood that the standard implementation code matched to each graphic component includes only general functions that the corresponding graphic component can implement. For example: for an interactive node, the corresponding standard implementation code comprises judgment logic, or for a broadcast node, the corresponding standard implementation code comprises broadcast logic and the like. In order to enable one graphic assembly to realize the functions given to the graphic assembly in the multi-turn question-answering flow chart, corresponding custom configuration parameters need to be input.
As a simple example, for the node 102 whose age does not satisfy the loan condition in fig. 1b, the node 102 whose age does not satisfy the loan condition can broadcast the content "the age does not satisfy the loan condition" after being triggered, and accordingly, the "age does not satisfy the loan condition" is a function assigned to the node 102 whose age does not satisfy the loan condition, and in order to enable the node 102 whose age does not satisfy the loan condition to realize the function, the broadcast content needs to be added to the standardized code frame as custom configuration information.
Typically, blank code segments may be reserved at set positions in standard implementation codes matched with each graphic assembly, and when a custom configuration parameter input for one graphic assembly in the multi-turn question-and-answer flowchart is acquired (for example, through a parameter configuration interface input provided by a flow editing interface), the custom code matched with the custom configuration parameter is added to the corresponding blank code segment, so as to implement a custom graphic assembly function.
Optionally, custom configuration information (for example, age does not satisfy loan conditions) may be directly added to the standardized code frame as the custom code, and a custom code that matches different pre-written custom configuration information may also be added to the standardized code frame according to the custom configuration information (for example, turning on a rejection preference or turning on a knowledge preference), which is not limited in this embodiment.
Correspondingly, if the user-defined setting is completed for all the graphic components included in one multi-turn question-answering flow chart, an implementation code capable of implementing the functions of the multi-turn question-answering flow chart can be generated, namely: a multi-round question-answering flow module according to the embodiment of the invention is generated.
S140, establishing a corresponding relation between each interactive node and one or more knowledge points in a knowledge base, wherein the knowledge points corresponding to the interactive nodes comprise: the system comprises interactive questions and interactive answers, wherein the interactive questions are used for being matched with received user interactive information, and the interactive answers are used for determining the next trend of the multi-turn question-answering flow module.
And the interactive nodes need to determine the next trend of the established multi-turn question-answering flow module according to the user interaction information. Namely: the interactive nodes comprise at least two branches, and different branches correspond to different trends of the multi-turn question-answering flow modules. Therefore, different branch conditions need to be set for different branches in the multi-round question-answering flow module, such as: as shown in fig. 1B, if the query age node 101 determines that the user interaction information is "20 years old full", the multi-turn question and answer flow module goes along the branch a to the node 103 querying whether there is a car room, and if the user interaction information is determined to be "20 years old short", the multi-turn question and answer flow module goes along the branch B to the node 102 not meeting the loan condition.
In fact, the expression form of the user interaction information input by the interactive user (i.e. the user who performs question-answering interaction with the multi-turn question-answering system) under one interactive node may not be unique, or a plurality of different user interaction information may all correspond to the same branch condition. As in the previous example, for example, when the user interaction information is "20 years old full", "grown up", or "meeting the age condition", the multiple rounds of question-answering flow modules all circulate along branch a, and besides setting the dynamic trigger condition of branch a (link) to "20 years old full", it is also necessary to establish an interaction knowledge point matching the interaction node in the knowledge base: (full 20 years old ), (adult, full 20 years old) and (meeting the age criteria, full 20 years old). And respectively establishing the corresponding relation between the interactive knowledge point and the inquiry age node 101. Similarly, for the branch "less than 20 years old", it is also necessary to establish an interaction knowledge point matching the interaction node in the knowledge base: (less than 20 years old ), (immature, less than 20 years old) and (not satisfying the age condition, less than 20 years old). Therefore, the query age node 101 needs to establish correspondence with six interactive knowledge points. It is to be understood that knowledge points corresponding to the interactive nodes are distinguished from question-and-answer knowledge points in the prior art, and therefore, for convenience of distinction, knowledge points corresponding to the interactive nodes will be hereinafter referred to as interactive knowledge points.
The first half part in each bracket represents an interactive question of an interactive knowledge point and is used for matching with received user interactive information, and the second half part in each bracket represents an interactive answer of the interactive knowledge point and is used for determining the next trend of the multi-turn question-answer flow module.
Through the above operations, when the multi-round question-answering flow module flows to the query age node 101, no matter the interactive user inputs "20 years old" or "grown up", the interactive answer "20 years old" is matched in the knowledge base, after the interactive answer "20 years old" is obtained, the multi-round question-answering system can determine that the interactive answer is matched with the dynamic trigger condition set by branch a, and then the multi-round question-answering flow module continues to flow downwards through branch a.
It should be emphasized again that the interaction knowledge points corresponding to the interaction nodes stored in the knowledge base are different from the question-answer knowledge points stored in the knowledge base, as described above, the so-called question-answer knowledge points generally include questions and corresponding answers (also referred to as "question-answer" pairs), where the question-answer knowledge points are mainly used in a scene of asking and answering with the interaction user, the questions in the question-answer knowledge points are used for matching with the user interaction information of the interaction user, and if matching is successful, the answers in the question-answer knowledge points are fed back to the interaction user, or a control program matching with the answer content is invoked.
Namely: the question-answering knowledge points can directly determine the interaction processing result (for example, answer feedback content or execution setting control program calling) corresponding to the user interaction information, and the interaction knowledge points are used for determining the branch conditions of the multi-turn question-answering system and have different purposes. In order to distinguish the two types of knowledge points in different application scenes, the interactive knowledge points and the question-answering knowledge points can be stored in different storage positions in the knowledge base, or knowledge point labels distinguished from the question-answering knowledge points are added in the interactive knowledge points.
In fact, the main purpose of setting the interaction knowledge point is to consider that the content of the received user interaction information may be various for the same interaction node, for example, "20 years old" or "grown up" as described in the previous example, but in order to ensure the simplicity of a multi-turn question-answering system, only a single condition content is generally used when setting a branch condition of the interaction node, for example: "has been 20 years old", and therefore, the concept of interactive knowledge points was introduced. By setting a plurality of interactive knowledge points in the knowledge base for the same branch condition of the same interactive node, namely: and corresponding a plurality of different interactive questions pointing to the same branch to the same interactive answer, namely enabling a plurality of similar expression contents to correspond to the same branch condition.
In other embodiments of the present invention, when the question-answer knowledge point and the interaction knowledge point are different, they may not be distinguished from each other, which is within the protection scope of the present invention.
As described above, a multi-turn question-answering flow module may include a plurality of connectors to connect different nodes, so that the determination of the next trend of the multi-turn question-answering flow module may be implemented by configuring a custom configuration information for connecting an upper layer interactive node and a target connector of a lower layer node.
Accordingly, the custom configuration information may include: dynamic condition configuration information matched with the target connection element; the target connecting piece is used for connecting the associated upper-layer node and the associated lower-layer node, and the associated upper-layer node is an interactive node;
the dynamic condition configuration information is a condition that the multi-turn question-answering flow module flows from the associated upper-layer node to the associated lower-layer node, and the dynamic condition configuration information is matched with an interactive answer in one knowledge point corresponding to the associated upper-layer node in the knowledge base.
S150, adding theme knowledge points corresponding to each multi-turn question-answer flow module in a knowledge base, wherein the theme knowledge points comprise theme questions and theme answers, the theme questions are used for representing triggering conditions of the multi-turn question-answer flow modules, and the theme answers are used for establishing triggering relations between the theme knowledge points and the multi-turn question-answer flow modules.
After a plurality of rounds of question-answering flow modules (codes for realizing a plurality of rounds of question-answering flow charts) are generated and the corresponding relation between an interactive node and one or more knowledge points is established in a knowledge base, in order to realize normal use of the plurality of rounds of question-answering flow modules, theme knowledge points corresponding to each of the plurality of rounds of question-answering flow modules need to be further added in the knowledge base.
It should be noted that the above description provides an implementation manner that first generates multiple rounds of question and answer flow modules and then establishes topic knowledge points, and those skilled in the art can understand that the establishment process of topic knowledge points may not be limited to be performed after generating multiple rounds of question and answer flow modules, and is not limited herein. For example, topic knowledge points may be established first, followed by establishing corresponding rounds of question-answering flow modules, and so on.
In fact, the topic knowledge points are different from the question-answer knowledge points in the knowledge base in that: when the user interaction information input by the interactive user is matched with the questions in the question-answer knowledge points, the answers of the question-answer knowledge points are directly output, or the calling of a control program matched with the answer content is executed, and when the user interaction information input by the interactive user (hereinafter referred to as initial request information) is matched with the subject questions of one subject knowledge point, the multi-turn question-answer flow module is correspondingly triggered (for example, the root nodes of the multi-turn question-answer flow module are directly triggered).
Typically, the topic answers in a topic knowledge point may be storage addresses or calling addresses of multiple rounds of question and answer flow modules corresponding to the topic knowledge point, and the like, which can accurately locate information of the multiple rounds of question and answer flow modules.
The generation method of the multi-turn question-answering system which can be realized through the WYSIWYG mode is provided, the realization mode of the existing multi-turn question-answering system is optimized, the multi-turn question-answering system is quickly constructed and updated, developers are prevented from being introduced into the generation process of the multi-turn question-answering system, the workload of the developers is greatly reduced, the cost is reduced, and the accuracy and the efficiency are improved.
Specifically, the custom configuration information may further include: and rejecting the preference corresponding to the interactive node.
When the multi-turn question-answering flow module flows to a first interaction node configured with a function of starting rejection priority, if the received user interaction information is determined not to be matched with the interaction problem in at least one knowledge point corresponding to the first interaction node in the knowledge base, a rejection response is provided, and the user interaction information is requested to be input again.
Namely: if an interactive node is configured with a rejection preference, only interactive problems based on the interactive node can be identified in the interactive node. Typically, if the rejection preference is set for an interactive node of the multi-turn question-and-answer flowchart, a pre-written custom code matching the rejection preference function is obtained, and the custom code is added to the position associated with the interactive node in the standardized code frame.
By setting the rejection preference, the multi-turn question-answering system can be executed according to a pre-designed flow sequence, and random skipping or feedback caused by some questions which cannot be identified by the multi-turn question-answering system and input by a user can not be carried out, so that the regularity and the sequence of the whole multi-turn question-answering system are better.
Unlike the rejection preference, the custom configuration information may further include: a knowledge preference corresponding to the interactive node;
when the multi-turn question-answering flow module flows to a second interactive node configured with a knowledge priority starting function, if the fact that the received user interactive information is not matched with the interactive problems in at least one knowledge point corresponding to the second interactive node in the knowledge base is determined, the user interactive information is globally searched in the knowledge base, and corresponding interactive operation is executed according to the global searching result.
Namely: if an interactive node is configured with knowledge priority, an interactive problem based on the interactive node is firstly identified in the interactive node, and if the identification fails, problems in other knowledge points are continuously identified in the knowledge base. Typically, if a knowledge preference is set for an interactive node of the multi-turn question-and-answer flowchart, a pre-written custom code matching the knowledge preference function is obtained and added to the standardized code framework at a position associated with the interactive node.
By setting the knowledge priority option, the execution flexibility of the multi-turn question-answering system is ensured, and the question-answering interaction with the user can be well carried out when the fact that the user interaction information is not matched with the currently circulated nodes is determined, so that the user satisfaction is further improved.
In a specific example, for a multi-round interactive system corresponding to the flowchart in fig. 1b, there are 6 interactive knowledge points for the interactive node inquiring about the age node 101, and the interactive questions of the 6 interactive knowledge points are "20 years old reached", "grown up", "meeting the age condition", "not 20 years old", "not grown up", and "not meeting the age condition", respectively, when the input user interaction information does not match with the 6 interactive questions, for example: "what is the weather today", if the query age node 101 sets the rejection preference, the multi-turn question-answering system does not give corresponding feedback for the user interaction information, and stays on the query age node 101 to continue to wait for the user to input new interaction information again; if the query age node 101 sets the knowledge priority, the multi-turn question-answering system searches the knowledge base for the question-answering knowledge point corresponding to the question of the query weather, and feeds back the answer of the question-answering knowledge point.
Specifically, the customized configuration information may further include: backtracking function options corresponding to the interactive nodes;
when the multi-turn question-answer flow module flows to a third interactive node configured with a backtracking starting function, if the received user interaction information is determined to be matched with the interaction problem of the upper node corresponding to the third interactive node in the knowledge base, the multi-turn question-answer flow module flows to the upper node corresponding to the third interactive node.
By setting the backtracking function, the universality of the multi-turn question-answering system is stronger, the trend of the whole multi-turn question-answering system can be readjusted at any time according to the content input by the user in the question-answering interaction process of the multi-turn question-answering system and the user, particularly, the multi-turn question-answering system can be returned to an executed interaction node for re-execution, and the next trend based on the interaction node is re-determined, so that the actual multi-turn question-answering requirement of the user can be better met.
In a specific example, for the multi-round interactive system corresponding to the flowchart of fig. 1B, the user inputs the user interaction information "less than 20 years old" for the query age node 101, and accordingly, the multi-round interactive system flows to the node 102 whose age does not satisfy the loan condition through the branch B and plays the corresponding broadcast content to the user. At this time, if the user re-inputs the user interaction information of "20 years old is full", the multi-turn question-answering system re-flows (backtracks) to the query age node 101, and according to the above content input by the user, the multi-turn question-answering system re-flows to the query whether there is a room in the car node 103 through the branch a to continue the question-answering interaction with the user.
Specifically, the graphic assembly may further include: and broadcasting the nodes. Accordingly, the custom configuration information may include: broadcast content corresponding with the node, the node includes: interaction nodes and broadcast nodes;
and if the multi-turn question and answer flow module flows to a fourth node configured with broadcast contents, correspondingly broadcasting the broadcast contents corresponding to the fourth node.
In a specific example, as shown in fig. 1b, when the multi-turn question and answer system flows to the interactive node 103 inquiring whether there is a car with a room, the interactive node will broadcast a preset broadcast content, for example, "ask you whether there is a car with a room", and then will determine the next trend of the multi-turn question and answer system based on the subsequently received user interaction information; when the multi-turn question-answering system flows to the broadcast node meeting the 20-million loan conditions, the broadcast node can directly broadcast preset broadcast contents, for example: "you satisfy the 20 ten thousand loan conditions".
Through setting the broadcast content, the method can effectively perform question and answer interaction with the user, and can effectively prompt the interactive content which needs to be input by the user in the next step.
Specifically, the customized configuration information may further include: an interrupt function option corresponding to the node;
when the multi-turn question-answering flow module flows to a fifth node with an interruption function, if user interaction information is received before broadcasting of the broadcast content corresponding to the fifth node is finished, continuous broadcasting of the broadcast content is stopped.
The benefits of setting the interrupt function option are: if a user is familiar with the interaction process of the whole multi-turn question-answering system, the user can quickly input information required to interact without waiting for a node in the multi-turn question-answering system to finish broadcasting, and the efficiency of man-machine interaction is further improved.
In a specific example, as shown in fig. 1b, when the multi-turn question and answer system flows to the interactive node 103 inquiring whether there is a car with a house, in the process that the interactive node reports "ask for whether there is a car with a house", if the interactive node receives "there is a car without a house" input by the user, the broadcast content is not continuously reported, but the interactive node quickly flows to the node 104 meeting the 20 ten thousand loan condition to interact with the user, so that the whole question and answer interaction time is saved.
According to various function requirements which can be used by the multi-turn question-answering system, corresponding implementation codes are correspondingly written and packaged, so that a flow designer can conveniently select or input a required custom configuration requirement according to an actual design requirement, and the universality and the use satisfaction of the generation method of the multi-turn question-answering system are further improved.
For easy understanding, a schematic diagram of inputting the custom configuration information of the interactive node is shown in fig. 1 c. As shown in fig. 1c, a schematic diagram of the custom configuration information for the query age node 101 in fig. 1b is given. In the input box corresponding to "knowledge", all the interactive questions corresponding to the query age node 101 may be input.
Fig. 1d shows a schematic diagram of inputting the custom configuration information of the broadcast node. As shown in fig. 1d, a schematic diagram of the custom configuration information for the reminder excess node 109 in fig. 1b is given. In the answer box, the broadcast content corresponding to the excess reminding node 109 may be input.
A schematic diagram of custom configuration information for one input connector is shown in fig. 1 e. As shown in fig. 1d, a schematic diagram of the custom configuration information for the connector corresponding to branch a in fig. 1b is given, wherein in the input box corresponding to "condition", the condition that the branch is selected to execute can be input.
Typically, when a user double-clicks or clicks one graphic component in a multi-turn question-answering flow chart, the input template of the user-defined configuration information is correspondingly popped up, and a flow designer can input different user-defined configuration information to different graphic components through simple selection and input operation.
Example one
Fig. 2 is a flowchart of a method for modifying a multi-turn question-answering system in an embodiment of the present invention, where the basis of the modification method described in this embodiment is the aforementioned multi-turn question-answering system, and this embodiment is applicable to a case of modifying a multi-turn question-answering system that has been successfully generated, and this method may be executed by a modification device of the multi-turn question-answering system, and this modification device may be implemented by software and/or hardware, and may be generally integrated in a terminal device or a server for modifying the multi-turn question-answering system, and this terminal device or server is directly or indirectly connected to a knowledge base.
Wherein the multi-round question-answering system comprises: a plurality of rounds of question-answering flow modules corresponding to a plurality of rounds of question-answering flow charts, wherein the plurality of rounds of question-answering flow charts comprise a plurality of graphic assemblies, and the graphic assemblies comprise: a plurality of interactive nodes;
one or more knowledge points which are stored in a knowledge base and have corresponding relations with each interactive node in the multi-round question-answering flow chart, wherein the knowledge points corresponding to the interactive nodes comprise: the system comprises interactive questions and interactive answers, wherein the interactive questions are used for being matched with received user interactive information, and the interactive answers are used for determining the next trend of the multi-turn question-answering flow module; and
theme knowledge points stored in the knowledge base, wherein the theme knowledge points comprise theme questions and theme answers, the theme questions are used for representing trigger conditions of the multiple rounds of question-answering flow modules matched with a multiple rounds of question-answering system, and the theme answers are used for establishing trigger relations between the theme knowledge points and the multiple rounds of question-answering flow modules;
the method for modifying the multi-turn question-answering system specifically comprises the following steps:
s210, acquiring modification information of the set system components in the target multi-turn question answering system.
In this embodiment, the system component may include: the system comprises topic knowledge points corresponding to a target multi-turn question-answering system, a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system or one or more knowledge points corresponding to interactive nodes in the target multi-turn question-answering flow module.
Wherein the modification information comprises any one or more of the following: modifying subject knowledge points corresponding to the target multi-turn question-answering system, modifying a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system, and modifying knowledge points corresponding to set interactive nodes in the target multi-turn question-answering flow module.
And S220, correspondingly updating the target multi-turn question-answering system according to the modification information.
In this embodiment, the target multi-turn question-answering system is correspondingly updated in different updating manners according to different modification information for different system components.
For example, if the modification information is to adjust the topic knowledge points corresponding to the target multi-turn question-answering system, the topic knowledge points in the knowledge base may be updated correspondingly directly according to the modified topic questions and/or topic answers, and if the modification content is to delete the topic knowledge points corresponding to the target multi-turn question-answering system, the topic knowledge points may be deleted directly in the knowledge base.
The embodiment of the invention provides a method for modifying a multi-turn question-answering system, which comprises the steps of obtaining modification information aiming at set system components in a target multi-turn question-answering system; wherein the modification information comprises any one or more of the following: modifying subject knowledge points corresponding to the target multi-turn question-answering system, modifying a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system, and modifying knowledge points corresponding to set interactive nodes in the target multi-turn question-answering flow module; according to the modification information, a specific mode for modifying the multi-turn question-answering system is provided by a technical means for correspondingly updating the target multi-turn question-answering system, the modification requirements of a user on the multi-turn question-answering system are greatly met, the existing method for modifying the multi-turn question-answering system is optimized, the modification efficiency and modification convenience of the multi-turn question-answering system are improved, the multi-turn question-answering system is rapidly modified and updated, developers are prevented from being introduced in the modification process of the multi-turn question-answering system, and the workload of the developers is greatly reduced.
Example two
Fig. 3 is a flowchart of a method for modifying a multi-turn question-answering system according to a second embodiment of the present invention, where the present embodiment is optimized based on the above-mentioned embodiment, and in the present embodiment, the operation of updating the target multi-turn question-answering system when the modification content is to modify a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system is further embodied, and accordingly, the method according to the second embodiment of the present invention includes:
s310, acquiring modification information of the set system components in the target multi-turn question answering system.
Wherein the modification information specifically includes: and modifying a target multi-round question-answering flow module corresponding to the target multi-round question-answering system. Specifically, modifying the target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system may include: and adding, deleting and/or adjusting the interactive nodes of the target multi-turn question-answer flow module.
Generally speaking, a flow designer is not a developer and cannot directly modify a plurality of rounds of question and answer flow modules (namely, codes are realized), and correspondingly, a corresponding relationship between a plurality of rounds of question and answer flow diagrams and the plurality of rounds of question and answer flow modules can be established in advance, and the modification aiming at the plurality of rounds of question and answer flow diagrams is obtained correspondingly by obtaining the modification aiming at the plurality of rounds of question and answer flow diagrams.
S320, determining a modification mode of the target multi-turn question-answer flow module: if the modification mode is a new interactive node, S330 is executed; if the modification mode is deleting the interactive node, executing S340; if the modification is to adjust the interactive node, S350 is performed.
S330, correspondingly updating the multi-turn question-answer flow modules corresponding to the target multi-turn question-answer system according to the adding position of at least one newly-added interactive node in the multi-turn question-answer flow chart corresponding to the target multi-turn question-answer system and the custom configuration information matched with the newly-added interactive node, and establishing the corresponding relation between the newly-added interactive node and one or more knowledge points in a knowledge base.
S340, correspondingly updating the multi-turn question-answering flow modules corresponding to the target multi-turn question-answering system according to the deletion positions of at least one deletion interactive node in the multi-turn question-answering flow chart corresponding to the target multi-turn question-answering system, and deleting the corresponding relation between the deletion interactive node and one or more knowledge points in the knowledge base.
In an optional implementation manner of this embodiment, deleting the correspondence between the deletion interaction node and one or more knowledge points in the knowledge base may include:
searching one or more knowledge points corresponding to the deleting node in the knowledge base as knowledge points to be deleted;
if the knowledge point to be deleted is determined to only correspond to the deletion interaction node, deleting the knowledge point to be deleted in the knowledge base, and deleting the corresponding relation between the deletion interaction node and the knowledge point to be deleted;
and if the knowledge point to be deleted is determined to simultaneously correspond to other interactive nodes, the knowledge point to be deleted is reserved in the knowledge base, and only the corresponding relation between the interactive node to be deleted and the knowledge point to be deleted is deleted.
And S350, correspondingly updating the multi-turn question-answering flow modules corresponding to the target multi-turn question-answering system according to the original positions and the adjusted positions of the at least one adjustment interactive node in the multi-turn question-answering flow chart corresponding to the target multi-turn question-answering system.
The technical scheme of the embodiment of the invention provides an updating method of a target multi-round question-answering system when modifying the target multi-round question-answering flow module corresponding to the target multi-round question-answering system, so that a flow designer can conveniently modify the multi-round question-answering flow module when the process designer is not skilled in code writing, and the workload of a developer is reduced to the greatest extent.
On the basis of the foregoing embodiments, modifying the target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system may include: newly adding, deleting and/or adjusting broadcast nodes and/or connecting pieces of the target multi-turn question-answering flow module;
correspondingly updating the target multi-turn question-answering system according to the modification information may include:
correspondingly updating a multi-round question-answering flow module corresponding to the target multi-round question-answering system according to the adding position of at least one newly-increased broadcasting node and/or newly-increased connecting piece in a multi-round question-answering flow chart corresponding to the target multi-round question-answering system and the user-defined configuration information matched with the newly-increased broadcasting node and/or the newly-increased connecting piece;
correspondingly updating the multi-turn question-answering flow modules corresponding to the target multi-turn question-answering system according to the deletion positions of at least one deletion broadcast node and/or deletion connecting piece in the multi-turn question-answering flow chart corresponding to the target multi-turn question-answering system;
and correspondingly updating the multi-turn question-answering flow modules corresponding to the target multi-turn question-answering system according to the original positions and the adjusted positions of the at least one adjusting broadcast node and/or the adjusting connecting piece in the multi-turn question-answering flow chart corresponding to the target multi-turn question-answering system.
The benefits of this arrangement are: and when another target multi-round question-answering flow module corresponding to the target multi-round question-answering system is modified, the updating method of the target multi-round question-answering system is provided, so that a flow designer can conveniently modify the multi-round question-answering flow module when the flow designer is not skilled in code writing, and the workload of a developer is reduced to the greatest extent.
EXAMPLE III
Fig. 4 is a flowchart of a method for modifying a multi-turn question-answering system according to a third embodiment of the present invention, where the third embodiment of the present invention is optimized based on the above-mentioned embodiments, and in the present embodiment, the operation of updating the target multi-turn question-answering system when modifying knowledge points corresponding to interaction nodes set in the target multi-turn question-answering flow module is further embodied, and accordingly, the method according to the third embodiment of the present invention includes:
and S410, acquiring modification information of the set system components in the target multi-turn question answering system.
In this embodiment, the modification information for setting system components in the target multi-turn question-answering system specifically includes: and modifying the knowledge points corresponding to the set interactive nodes in the target multi-turn question-answering flow module. Specifically, the modification information includes: and adding, deleting and/or adjusting the knowledge points of the interactive nodes.
S420, determining a modification mode of the knowledge point corresponding to the set interactive node: if the modification mode is the new knowledge point, executing S430; if the modification mode is to delete the knowledge point, executing S440; if the modification is to adjust the knowledge point, S450 is performed.
S430, acquiring at least one newly added knowledge point aiming at the set interaction node, and if the newly added knowledge point is determined to exist in the knowledge base, establishing a corresponding relation between the newly added knowledge point and the set interaction node in the knowledge base; and if the newly added knowledge points are determined not to exist in the knowledge base, newly establishing the newly added knowledge points in the knowledge base, and establishing a corresponding relation between the newly added knowledge points and the set interaction nodes.
S440, acquiring at least one deletion knowledge point aiming at the set interaction node; if the deleted knowledge point in the knowledge base is determined to only correspond to the set interaction node, deleting the deleted knowledge point in the knowledge base, and deleting the corresponding relation between the set interaction node and the deleted knowledge point; and if the deleted knowledge point is determined to correspond to other interactive nodes at the same time, the deleted knowledge point is reserved in the knowledge base, and only the corresponding relation between the set interactive node and the deleted knowledge point is deleted.
S450, acquiring at least one change knowledge point aiming at the set interaction node and an original knowledge point corresponding to the change knowledge point in a knowledge base; replacing the original knowledge points in the knowledge base with the modified knowledge points if the original knowledge points are determined to correspond to the set interaction nodes only; and if the original knowledge point is determined to simultaneously correspond to other interactive nodes, only deleting the corresponding relation between the original knowledge point and the set interactive node, newly adding the modified knowledge point in the knowledge base and establishing the corresponding relation between the modified knowledge point and the set interactive node.
The technical scheme of the embodiment of the invention provides the updating method of the target multi-round question-answering system when the knowledge points corresponding to the set interactive nodes in the target multi-round question-answering flow module are modified, so that a flow designer can conveniently modify the knowledge points corresponding to the set interactive nodes when the process designer is not skilled in code compiling, and the workload of a developer is reduced to the greatest extent.
Example four
Fig. 5 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention. FIG. 5 illustrates a block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention. The computer device 12 shown in FIG. 5 is only an example and should not bring any limitations to the functionality or scope of use of embodiments of the present invention.
As shown in FIG. 5, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Computer device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. Computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 5, and commonly referred to as a "hard drive"). Although not shown in FIG. 5, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
Computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with computer device 12, and/or with any devices (e.g., network card, modem, etc.) that enable computer device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, computer device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via network adapter 20. As shown, network adapter 20 communicates with the other modules of computer device 12 via bus 18. It should be appreciated that although not shown in FIG. 5, other hardware and/or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 16 executes various functional applications and data processing by executing programs stored in the system memory 28, for example, implementing the method for modifying a multi-turn question-and-answer system provided by the embodiment of the present invention.
Namely: acquiring modification information of a set system component in a target multi-turn question-answering system;
wherein the modification information comprises any one or more of the following: modifying subject knowledge points corresponding to the target multi-turn question-answering system, modifying a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system, and modifying knowledge points corresponding to set interactive nodes in the target multi-turn question-answering flow module; and correspondingly updating the target multi-turn question-answering system according to the modification information.
EXAMPLE five
An embodiment five of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for modifying a multi-turn question-answering system, as provided in all the inventive embodiments of the present application:
namely: acquiring modification information of a set system component in a target multi-turn question-answering system;
wherein the modification information comprises any one or more of the following: modifying subject knowledge points corresponding to the target multi-turn question-answering system, modifying a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system, and modifying knowledge points corresponding to set interactive nodes in the target multi-turn question-answering flow module; and correspondingly updating the target multi-turn question-answering system according to the modification information.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (11)

1. A method for modifying a multi-turn question-answering system is applied to the multi-turn question-answering system and is characterized by comprising the following steps:
acquiring modification information of a set system component in a target multi-turn question-answering system;
wherein the modification information comprises any one or more of the following: modifying subject knowledge points corresponding to the target multi-turn question-answering system, modifying a target multi-turn question-answering flow module corresponding to the target multi-turn question-answering system, and modifying knowledge points corresponding to set interactive nodes in the target multi-turn question-answering flow module;
correspondingly updating the target multi-turn question-answering system according to the modification information;
wherein the multi-round question-answering system comprises:
a plurality of rounds of question-answering flow modules corresponding to a plurality of rounds of question-answering flow charts, wherein the plurality of rounds of question-answering flow charts comprise a plurality of graphic assemblies, and the graphic assemblies comprise: a plurality of interactive nodes;
one or more knowledge points which are stored in a knowledge base and have corresponding relations with each interactive node in the multi-round question-answering flow chart, wherein the knowledge points corresponding to the interactive nodes comprise: the system comprises interactive questions and interactive answers, wherein the interactive questions are used for being matched with received user interactive information, and the interactive answers are used for determining the next trend of the multi-turn question-answering flow module; and
the topic knowledge points are stored in the knowledge base and comprise topic questions and topic answers, the topic questions are used for representing trigger conditions of the multiple rounds of question-answering flow modules matched with the multiple rounds of question-answering systems, and the topic answers are used for establishing trigger relations between the topic knowledge points and the multiple rounds of question-answering flow modules.
2. The method of claim 1, wherein the multiple rounds of question-answering flow modules corresponding to the multiple rounds of question-answering flow charts comprise:
generating a standardized code frame matched with the multi-round question-answering flow chart according to each graphic component included in the multi-round question-answering flow chart; and
and generating custom codes which respectively correspond to the graphic components and are added to the positions, associated with the graphic components, in the standardized code frame according to the custom configuration information matched with the graphic components in the multi-turn question-answering flow chart.
3. The method of claim 2, wherein the custom configuration information comprises: rejection preference corresponding to the interactive node;
when the multi-turn question-answering flow module flows to a first interaction node configured with a function of starting rejection priority, if the received user interaction information is determined not to be matched with the interaction problem in at least one knowledge point corresponding to the first interaction node in the knowledge base, a rejection response is provided, and the user interaction information is requested to be input again.
4. The method of claim 2, wherein the custom configuration information comprises: a knowledge preference corresponding to the interactive node;
when the multi-turn question-answering flow module flows to a second interactive node configured with a knowledge priority starting function, if the fact that the received user interactive information is not matched with the interactive problems in at least one knowledge point corresponding to the second interactive node in the knowledge base is determined, the user interactive information is globally searched in the knowledge base, and corresponding interactive operation is executed according to the global searching result.
5. The method of claim 2, wherein the custom configuration information comprises: backtracking function options corresponding to the interactive nodes;
when the multi-turn question-answer flow module flows to a third interactive node configured with a backtracking starting function, if the received user interaction information is determined to be matched with the interaction problem of the upper node corresponding to the third interactive node in the knowledge base, the multi-turn question-answer flow module flows to the upper node corresponding to the third interactive node.
6. The method of claim 1, wherein modifying the target multi-round question-answering flow module corresponding to the target multi-round question-answering system comprises: adding, deleting and/or adjusting interactive nodes of the target multi-turn question-answer flow module;
correspondingly updating the target multi-turn question-answering system according to the modification information, wherein the target multi-turn question-answering system comprises:
correspondingly updating a multi-round question-answering flow module corresponding to the target multi-round question-answering system according to the adding position of at least one newly-added interactive node in a multi-round question-answering flow chart corresponding to the target multi-round question-answering system and user-defined configuration information matched with the newly-added interactive node, and establishing the corresponding relation between the newly-added interactive node and one or more knowledge points in a knowledge base;
correspondingly updating a multi-turn question-answering flow module corresponding to the target multi-turn question-answering system according to the deletion position of at least one deletion interactive node in a multi-turn question-answering flow chart corresponding to the target multi-turn question-answering system, and deleting the corresponding relation between the deletion interactive node and one or more knowledge points in a knowledge base;
and correspondingly updating the multi-turn question-answering flow modules corresponding to the target multi-turn question-answering system according to the original positions and the adjusted positions of the at least one adjustment interactive node in the multi-turn question-answering flow chart corresponding to the target multi-turn question-answering system.
7. The method of claim 6, wherein deleting the correspondence of the deleted interaction node to one or more knowledge points in a knowledge base comprises:
searching one or more knowledge points corresponding to the deleting node in the knowledge base as knowledge points to be deleted;
if the knowledge point to be deleted is determined to only correspond to the deletion interaction node, deleting the knowledge point to be deleted in the knowledge base, and deleting the corresponding relation between the deletion interaction node and the knowledge point to be deleted;
and if the knowledge point to be deleted is determined to simultaneously correspond to other interactive nodes, the knowledge point to be deleted is reserved in the knowledge base, and only the corresponding relation between the interactive node to be deleted and the knowledge point to be deleted is deleted.
8. The method of claim 1, wherein modifying the target multi-round question-answering flow module corresponding to the target multi-round question-answering system comprises: newly adding, deleting and/or adjusting broadcast nodes and/or connecting pieces of the target multi-turn question-answering flow module;
correspondingly updating the target multi-turn question-answering system according to the modification information, wherein the target multi-turn question-answering system comprises:
correspondingly updating a multi-round question-answering flow module corresponding to the target multi-round question-answering system according to the adding position of at least one newly-increased broadcasting node and/or newly-increased connecting piece in a multi-round question-answering flow chart corresponding to the target multi-round question-answering system and the user-defined configuration information matched with the newly-increased broadcasting node and/or the newly-increased connecting piece;
correspondingly updating the multi-turn question-answering flow modules corresponding to the target multi-turn question-answering system according to the deletion positions of at least one deletion broadcast node and/or deletion connecting piece in the multi-turn question-answering flow chart corresponding to the target multi-turn question-answering system;
and correspondingly updating the multi-turn question-answering flow modules corresponding to the target multi-turn question-answering system according to the original positions and the adjusted positions of the at least one adjusting broadcast node and/or the adjusting connecting piece in the multi-turn question-answering flow chart corresponding to the target multi-turn question-answering system.
9. The method of claim 1, wherein modifying the knowledge points corresponding to the set interaction nodes in the target multi-round question-answering flow module comprises: adding, deleting and/or adjusting the knowledge points of the interactive nodes;
correspondingly updating the target multi-turn question-answering system according to the modification information, wherein the target multi-turn question-answering system comprises:
acquiring at least one newly added knowledge point aiming at the set interaction node; if the newly added knowledge point is determined to exist in the knowledge base, establishing a corresponding relation between the newly added knowledge point and the set interaction node in the knowledge base; if the newly added knowledge point is determined not to exist in the knowledge base, newly establishing the newly added knowledge point in the knowledge base, and establishing a corresponding relation between the newly added knowledge point and the set interaction node;
acquiring at least one deletion knowledge point aiming at the set interaction node; if the deleted knowledge point in the knowledge base is determined to only correspond to the set interaction node, deleting the deleted knowledge point in the knowledge base, and deleting the corresponding relation between the set interaction node and the deleted knowledge point; if the deleted knowledge point is determined to correspond to other interactive nodes at the same time, the deleted knowledge point is reserved in the knowledge base, and only the corresponding relation between the set interactive node and the deleted knowledge point is deleted;
acquiring at least one changed knowledge point aiming at the set interaction node and an original knowledge point corresponding to the changed knowledge point in a knowledge base; replacing the original knowledge points in the knowledge base with the modified knowledge points if the original knowledge points are determined to correspond to the set interaction nodes only; and if the original knowledge point is determined to simultaneously correspond to other interactive nodes, only deleting the corresponding relation between the original knowledge point and the set interactive node, newly adding the modified knowledge point in the knowledge base and establishing the corresponding relation between the modified knowledge point and the set interactive node.
10. A terminal device, characterized in that the terminal device comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a method of modifying a multi-turn question-and-answer system as claimed in any one of claims 1 to 9.
11. A computer storage medium on which a computer program is stored which, when being executed by a processor, carries out a method of modifying a multi-round question-answering system according to any one of claims 1 to 9.
CN201711346539.2A 2017-12-15 2017-12-15 Method for modifying multi-turn question-answering system, terminal equipment and storage medium Active CN110019718B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201711346539.2A CN110019718B (en) 2017-12-15 2017-12-15 Method for modifying multi-turn question-answering system, terminal equipment and storage medium
US16/106,680 US11341422B2 (en) 2017-12-15 2018-08-21 Multi-round questioning and answering methods, methods for generating a multi-round questioning and answering system, and methods for modifying the system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711346539.2A CN110019718B (en) 2017-12-15 2017-12-15 Method for modifying multi-turn question-answering system, terminal equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110019718A CN110019718A (en) 2019-07-16
CN110019718B true CN110019718B (en) 2021-04-09

Family

ID=67186963

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711346539.2A Active CN110019718B (en) 2017-12-15 2017-12-15 Method for modifying multi-turn question-answering system, terminal equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110019718B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101650797A (en) * 2009-09-14 2010-02-17 中国科学院计算技术研究所 Movable service knowledge base system and working method thereof
EP2691876A2 (en) * 2011-03-31 2014-02-05 Microsoft Corporation Personalization of queries, conversations, and searches
CN105051761A (en) * 2013-03-15 2015-11-11 谷歌公司 Questions answering to populate knowledge base
CN105975286A (en) * 2016-06-16 2016-09-28 中国建设银行股份有限公司 Method and system for generating interface for man-machine interaction
CN106503242A (en) * 2016-11-08 2017-03-15 上海智臻智能网络科技股份有限公司 A kind of intelligent interactive method, device and server
CN106776649A (en) * 2015-11-24 2017-05-31 镇江诺尼基智能技术有限公司 Exchange method and system are taken turns a kind of intelligent answer based on visible process figure more

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9483549B2 (en) * 2013-09-30 2016-11-01 Microsoft Technology Licensing, Llc Persisting state at scale across browser sessions

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101650797A (en) * 2009-09-14 2010-02-17 中国科学院计算技术研究所 Movable service knowledge base system and working method thereof
EP2691876A2 (en) * 2011-03-31 2014-02-05 Microsoft Corporation Personalization of queries, conversations, and searches
CN105051761A (en) * 2013-03-15 2015-11-11 谷歌公司 Questions answering to populate knowledge base
CN106776649A (en) * 2015-11-24 2017-05-31 镇江诺尼基智能技术有限公司 Exchange method and system are taken turns a kind of intelligent answer based on visible process figure more
CN105975286A (en) * 2016-06-16 2016-09-28 中国建设银行股份有限公司 Method and system for generating interface for man-machine interaction
CN106503242A (en) * 2016-11-08 2017-03-15 上海智臻智能网络科技股份有限公司 A kind of intelligent interactive method, device and server

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
电子商务订单手以人化实时处理的人机对话软件机器人研究;许智超,等;《哈尔滨工业大学学报》;20060228;第38卷(第2期);第274-278页 *

Also Published As

Publication number Publication date
CN110019718A (en) 2019-07-16

Similar Documents

Publication Publication Date Title
CN108090177B (en) Multi-round question-answering system generation method, equipment, medium and multi-round question-answering system
CN107977236B (en) Question-answering system generation method, terminal device, storage medium and question-answering system
US11341422B2 (en) Multi-round questioning and answering methods, methods for generating a multi-round questioning and answering system, and methods for modifying the system
US11409425B2 (en) Transactional conversation-based computing system
CN110019716B (en) Multi-turn question and answer method, terminal equipment and storage medium
US10942955B2 (en) Questioning and answering method, method for generating questioning and answering system, and method for modifying questioning and answering system
US11823661B2 (en) Expediting interaction with a digital assistant by predicting user responses
CN109101545A (en) Natural language processing method, apparatus, equipment and medium based on human-computer interaction
CN111241245B (en) Human-computer interaction processing method and device and electronic equipment
US10860289B2 (en) Flexible voice-based information retrieval system for virtual assistant
US20060155546A1 (en) Method and system for controlling input modalities in a multimodal dialog system
CN110096516B (en) User-defined database interaction dialog generation method and system
JP2021111379A (en) Method and apparatus for recommending interactive information
CN115129878B (en) Conversation service execution method, device, storage medium and electronic equipment
CN110019723A (en) Answering method, terminal device and storage medium based on question answering system
CN111144132B (en) Semantic recognition method and device
CN109960489B (en) Method, device, equipment, medium and question-answering system for generating intelligent question-answering system
JP7182584B2 (en) A method for outputting information of parsing anomalies in speech comprehension
CN109933314B (en) Generation device of multi-turn question-answering system
CN110019718B (en) Method for modifying multi-turn question-answering system, terminal equipment and storage medium
CN110020014B (en) Multi-turn question and answer device
CN109960490B (en) Method, device, equipment, medium and question-answering system for generating intelligent question-answering system
CN110019717B (en) Device for modifying multi-turn question-answering system
JP6944920B2 (en) Smart interactive processing methods, equipment, equipment and computer storage media
CN110019727A (en) Intelligent interactive method, device, terminal device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant