CN108846073A - A kind of man-machine emotion conversational system of personalization - Google Patents

A kind of man-machine emotion conversational system of personalization Download PDF

Info

Publication number
CN108846073A
CN108846073A CN201810584345.4A CN201810584345A CN108846073A CN 108846073 A CN108846073 A CN 108846073A CN 201810584345 A CN201810584345 A CN 201810584345A CN 108846073 A CN108846073 A CN 108846073A
Authority
CN
China
Prior art keywords
session
emotional
emotion
response
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810584345.4A
Other languages
Chinese (zh)
Other versions
CN108846073B (en
Inventor
任福继
鲍艳伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei University of Technology
Original Assignee
QINGDAO LEO ROBOT TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by QINGDAO LEO ROBOT TECHNOLOGY Co Ltd filed Critical QINGDAO LEO ROBOT TECHNOLOGY Co Ltd
Priority to CN201810584345.4A priority Critical patent/CN108846073B/en
Publication of CN108846073A publication Critical patent/CN108846073A/en
Application granted granted Critical
Publication of CN108846073B publication Critical patent/CN108846073B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/30Semantic analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明公开了一种个性化人机情感会话系统,个性化人机情感会话系统包括:个性化人格建模与动态分析模块、会话管理模块和应答舒适度检测与应答策略调整模块。个性化人格建模与动态分析模块包括:会话知识库与心理知识库、个性化人格建模与动态分析方法;会话管理模块包括如下步骤:1、对用户输入进行语义分析;2、在语义分析基础上进行语义推理;3、根据推理结果制定应答策略;4、以应答策略为指导生成会话内容;应答舒适度检测与应答策略调整模块包括:情感动力学与心理知识库、应答舒适度检测与应答策略调整方法。本发明适用于人机交互任务,并融入个性化人格建模分析及情感会话服务,提高了人机会话系统个性化的自然交互体验。

The invention discloses a personalized human-machine emotional conversation system. The personalized human-computer emotional conversation system includes: a personalized personality modeling and dynamic analysis module, a conversation management module, and a response comfort degree detection and response strategy adjustment module. Personalized personality modeling and dynamic analysis module includes: conversational knowledge base and psychological knowledge base, personalized personality modeling and dynamic analysis method; conversational management module includes the following steps: 1. Semantic analysis of user input; 2. Semantic analysis 3. Develop response strategies based on reasoning results; 4. Generate conversational content guided by response strategies; response comfort detection and response strategy adjustment modules include: emotional dynamics and psychological knowledge base, response comfort detection and Response policy adjustment method. The present invention is suitable for human-computer interaction tasks, and incorporates personalized personality modeling analysis and emotional conversation services, thereby improving the personalized natural interaction experience of the human-computer conversation system.

Description

一种个性化人机情感会话系统A Personalized Human-Machine Emotional Conversation System

技术领域technical field

本发明涉及人工智能、自然语言理解、情感计算、人机交互技术领域,尤其涉及一种个性化人机情感会话系统。The invention relates to the technical fields of artificial intelligence, natural language understanding, emotional computing and human-computer interaction, in particular to a personalized human-computer emotional conversation system.

背景技术Background technique

人工智能试图了解智能的本质,通过对人的意识、思维的模拟,将人类智能相似的能力赋予机器,以延伸和扩展人的智能,从而使机器可以完成通常需要人类智能才能完成的任务。自然语言处理是人工智能“皇冠上的明珠”,主要研究能实现人与计算机之间使用自然语言进行有效沟通的各种理论和方法。情感计算是以情感为研究对象,以赋予计算机感知、理解与表达情感的能力为途径,以构建和谐人机环境为目的。人机交互主要研究用户与系统之间的交互关系,具体体现为人与计算机之间以一定的交互方式完成某一任务的信息交换过程。Artificial intelligence tries to understand the essence of intelligence. By simulating human consciousness and thinking, it endows machines with similar capabilities to human intelligence to extend and expand human intelligence, so that machines can complete tasks that usually require human intelligence. Natural language processing is the "crown jewel" of artificial intelligence. It mainly studies various theories and methods that can realize effective communication between humans and computers using natural language. Affective computing takes emotion as the research object, aims at endowing computers with the ability to perceive, understand and express emotions, and aims at building a harmonious human-machine environment. Human-computer interaction mainly studies the interactive relationship between users and systems, which is embodied in the information exchange process between humans and computers to complete a certain task in a certain interactive way.

传统人机会话系统在会话过程中忽略了情感因素与会话应答的相互关系,往往只侧重于事实性会话;且未考虑用户个性化因素,不能根据用户个性特征生成个性化应答;系统难以在不同领域间泛化,只能完成特定领域的特定任务;且会话应答产生主要依靠信息检索技术,无法生成知识库中从未出现的会话应答。Traditional human-machine conversational systems ignore the relationship between emotional factors and conversational responses during conversations, and often only focus on factual conversations; and do not consider user personalization factors, and cannot generate personalized responses based on user personality characteristics; Generalization between domains can only complete specific tasks in specific domains; and the generation of conversational responses mainly relies on information retrieval technology, which cannot generate conversational responses that have never appeared in the knowledge base.

发明内容Contents of the invention

本发明目的就是为了弥补已有技术的缺陷,提供一种个性化人机情感会话系统。The purpose of the present invention is to provide a personalized human-machine emotional conversation system in order to remedy the defects of the prior art.

本发明是通过以下技术方案实现的:The present invention is achieved through the following technical solutions:

一种个性化人机情感会话系统,包括有个性化人格建模与动态分析模块CD、会话管理模块DM和应答舒适度检测与应答策略调整模块CA,所述的会话管理模块DM根据用户输入的对话内容自动生成带有情感的会话应答;所述的个性化人格建模与动态分析模块CD存储人机对话历史数据,根据所述人机对话历史数据分析用户长期人格特征及短期情感转移特征,进而制定人机会话应答策略;所述的应答舒适度检测与应答策略调整模块CA检测用户情感波动,调整人机会话应答策略。A personalized human-machine emotional conversation system, including personalized personality modeling and dynamic analysis module CD, conversation management module DM and response comfort level detection and response strategy adjustment module CA, described conversation management module DM according to user input Dialogue content automatically generates a conversational response with emotion; the personalized personality modeling and dynamic analysis module CD stores man-machine dialogue history data, and analyzes the user's long-term personality characteristics and short-term emotion transfer characteristics according to the man-machine dialogue history data, Then formulate the man-machine conversation response strategy; the response comfort detection and response strategy adjustment module CA detects the user's emotional fluctuations, and adjusts the man-machine conversation response strategy.

利用式(1)将个性化人机情感会话系统PEDS描述为一个五元组:Use formula (1) to describe the personalized human-machine emotional dialogue system PEDS as a five-tuple:

PEDS=(Input,CD,DM,CA,Output) (1)PEDS=(Input, CD, DM, CA, Output) (1)

式(1)中,Input表示所述个性化人机情感会话系统的用户输入,Output表示所述个性化人机情感交互系统的系统输出,In formula (1), Input represents the user input of described personalized human-computer emotion dialogue system, and Output represents the system output of described personalized human-computer emotional interaction system,

所述的会话管理模块DM的组成包括:语义分析、语义推理、应答策略和会话生成;The composition of the conversation management module DM includes: semantic analysis, semantic reasoning, response strategy and conversation generation;

所述的个性化人格建模与动态分析模块CD的组成包括:会话知识库与心理知识库、个性化人格建模与动态分析方法;The composition of described individualized personality modeling and dynamic analysis module CD comprises: conversational knowledge base and psychological knowledge base, individualized personality modeling and dynamic analysis method;

所述的会话知识库与心理知识库的组成包括:动态知识库、会话历史库和心理知识库;The composition of the conversational knowledge base and the psychological knowledge base includes: a dynamic knowledge base, a conversational history base and a psychological knowledge base;

所述的应答舒适度检测与应答策略调整模块CA组成包括:情感动力学与心理知识库、应答舒适度检测与应答策略调整方法;The CA composition of the response comfort detection and response strategy adjustment module includes: emotional dynamics and psychological knowledge base, response comfort detection and response strategy adjustment method;

所述情感动力学与心理知识库的组成包括:动态心理知识库、情感动力学知识库和静态心理知识库。The emotional dynamics and psychological knowledge base include: a dynamic psychological knowledge base, an emotional dynamics knowledge base and a static psychological knowledge base.

所述会话管理模块DM是按如下步骤进行的:The session management module DM is carried out as follows:

步骤1、对话管理模块DM接收用户输入会话内容,获取所述用户输入会话内容的语义表示SP;Step 1. The dialog management module DM receives the user input session content, and obtains the semantic representation SP of the user input session content;

步骤2、对所述用户输入的所述语义表示SP进行语义分析,获取用户的会话语境信息C、会话主题T、情感对象O、情感类别E、情感强度S和会话意图I;Step 2. Perform semantic analysis on the semantic representation SP input by the user, and obtain the user's conversational context information C, conversational topic T, emotional object O, emotional category E, emotional intensity S, and conversational intent I;

步骤2.1、所述语义分析中对会话上下文进行分析,得到会话语境信息C;Step 2.1, analyzing the conversational context in the semantic analysis to obtain the conversational context information C;

步骤2.2、得到所述语境信息后,结合所述用户输入,分析得到所述会话主题信息T;Step 2.2. After obtaining the context information, analyze and obtain the conversation topic information T in combination with the user input;

步骤2.3、在所述会话主题中分析所述会话主题的属性,确定所述会话主题中的所述情感对象O;Step 2.3, analyzing the attributes of the conversation topic in the conversation topic, and determining the emotional object O in the conversation topic;

步骤2.4、结合所述会话上下文及当前用户输入Q,对所述用户输入中针对所述情感对象的情感进行分析,确定用户对所述情感对象的所述情感类别E及所述情感强度S;Step 2.4. Combining the conversation context and the current user input Q, analyze the emotion of the emotional object in the user input, and determine the user's emotional category E and emotional intensity S for the emotional object;

利用式(2)表示所述情感类别E的集合:Utilize formula (2) to represent the collection of described emotion category E:

{E}={平静,高兴,喜爱,惊讶,焦虑,悲伤,生气,憎恨,期待} (2){E} = {peace, joy, love, surprise, anxiety, sadness, anger, hatred, anticipation} (2)

步骤2.5、根据所述步骤2.1~2.4,分析用户所述会话意图I;Step 2.5. According to the steps 2.1 to 2.4, analyze the conversational intention I of the user;

利用式(3)表示所述会话意图I获取过程:Utilize formula (3) to express described session intent I acquisition process:

I=f(C,T,O,E,S) (3)I=f(C,T,O,E,S) (3)

利用式(4)将所述语义分析描述为一个六元组SA:The semantic analysis is described as a six-tuple SA by using formula (4):

SA=(I,C,T,O,E,S) (4)SA=(I,C,T,O,E,S) (4)

步骤3、在获取所述会话意图I后,所述语义推理基于步骤2所述会话语境信息C、会话主题T、情感对象O、情感类别E、情感强度S和会话意图I前提,进行逻辑推理与判断,得到所述用户输入的深层语义结论Res;Step 3, after obtaining the conversational intent I, the semantic reasoning is based on the conversational context information C, the conversational topic T, the emotional object O, the emotional category E, the emotional intensity S and the conversational intent I premise in the step 2, and carry out logic Reasoning and judging to obtain the deep semantic conclusion Res input by the user;

利用式(5)表示所示语义推理过程:Use formula (5) to represent the semantic reasoning process shown:

(I,C,T,O,E,S)→Res (5)(I,C,T,O,E,S)→Res (5)

步骤4、所述应答策略根据所述深层语义结论Res制定用于指导会话生成的策略,所述应答策略制定过程是受如下因素影响:Step 4, the response strategy formulates a strategy for guiding conversation generation according to the deep semantic conclusion Res, and the response strategy formulation process is affected by the following factors:

因素1、所述步骤2所述会话语境信息C、会话主题T、情感对象O、情感类别E、情感强度S、会话意图I及所述步骤3所述深层语义结论Res;Factor 1, the conversation context information C in the step 2, the conversation topic T, the emotion object O, the emotion category E, the emotion intensity S, the conversation intention I and the deep semantic conclusion Res in the step 3;

因素2、所述个性化人格建模与动态分析模块CD的长期情感模型,表现为个性化人格;Factor 2, the long-term emotional model of the personalized personality modeling and dynamic analysis module CD, which is expressed as personalized personality;

因素3、所述个性化人格建模与动态分析模块CD的短期情感模型,表现为情感转移概率;Factor 3, the short-term emotional model of the personalized personality modeling and dynamic analysis module CD, which is expressed as the probability of emotional transfer;

因素4、所述应答舒适度检测与应答策略调整模块CA的应答策略调整方法;Factor 4. The response strategy adjustment method of the response comfort detection and response strategy adjustment module CA;

步骤5、所述会话生成在所述应答策略指导下生成会话应答A,所述会话生成是按如下情况进行:Step 5, the session generation generates a session response A under the guidance of the response policy, and the session generation is performed as follows:

情况1、若所述用户输入为事实性问答内容,所述会话生成在所述会话知识库中匹配检索现有知识,并生成所述会话应答A;Case 1. If the user input is factual question and answer content, the conversation generation matches and retrieves existing knowledge in the conversation knowledge base, and generates the conversation answer A;

情况2、若所述用户输入为聊天性内容,所述会话生成根据所述会话语境信息C及所述当前用户输入Q生成所述会话应答A;Case 2. If the user input is chat content, the conversation generation generates the conversation response A according to the conversation context information C and the current user input Q;

情况3、若所述用户输入为带有情感的会话内容,所述会话生成在所述应答策略指导下生成具有情感引导功能的所述会话应答A;Case 3. If the user input is emotional conversation content, the conversation generation generates the conversation response A with emotion guidance function under the guidance of the response strategy;

步骤6、所述会话应答A经所述系统输出进行人机交互与反馈;Step 6, the conversation response A is output by the system for human-computer interaction and feedback;

步骤7、所述用户输入Q与所述会话应答A存储至会话历史库。Step 7: The user input Q and the conversation response A are stored in a conversation history database.

所述个性化人格建模与动态分析模块CD中所述个性化人格建模与动态分析方法是按如下步骤进行:Described individualized personality modeling and dynamic analysis method described in described individualized personality modeling and dynamic analysis module CD are to carry out as follows:

步骤(1)、所述步骤2中利用所述语义分析对所述会话历史库中所述用户输入进行分析,得到所述用户输入的所述情感类别;Step (1), in the step 2, utilize the semantic analysis to analyze the user input in the conversation history storehouse to obtain the emotion category of the user input;

步骤(2)、统计计算所述情感类别间的转移概率关系,计算从一种情感类别转移为另一种情感类别的概率,进而得到所述情感类别的情感状态转移概率矩阵M,用以表示所述短期情感模型;Step (2), statistically calculate the transition probability relationship between the emotional categories, calculate the probability of transferring from one emotional category to another emotional category, and then obtain the emotional state transition probability matrix M of the emotional category, to represent said short-term affective model;

利用式(6)表示所述情感状态转移概率矩阵M:Utilize formula (6) to express described emotional state transition probability matrix M:

其中,pij表示由情感状态i转移至情感状态j的概率,pii表示情感状态保持不变的概率;Among them, p ij represents the probability of transferring from emotional state i to emotional state j, and p ii represents the probability that emotional state remains unchanged;

步骤(3)、以所述情感状态转移概率矩阵为特征,进行个性化人格建模,配合大五人格量表确定所述情感状态转移概率矩阵M与大五人格F的对应关系,M→F,用以表示所述长期情感模型;Step (3), using the emotional state transition probability matrix as a feature, carry out personalized personality modeling, and cooperate with the Big Five personality scale to determine the corresponding relationship between the emotional state transition probability matrix M and the Big Five personality F, M→F , used to represent the long-term emotional model;

利用式(7)表示所述大五人格F的集合:Utilize formula (7) to express the collection of described big five personality F:

{F}={开放性,责任心,外倾性,宜人性,神经质} (7){F} = {openness, conscientiousness, extraversion, agreeableness, neuroticism} (7)

步骤(4)、根据所述大五人格F的人格五因素,分析用户的个人喜好和会话特征;Step (4), according to the personality five factors of described big five personality F, analyze the user's personal preferences and conversation characteristics;

步骤(5)、依据所述用户个人喜好和会话特征以及所述情感状态转移概率矩阵M,联合所述应答舒适度检测与策略调整模块CA,制定具有情感引导作用的所述应答策略并微调,对所述会话内容及情感倾向性进行引导;Step (5), according to the user's personal preferences and conversation features and the emotional state transition probability matrix M, in conjunction with the response comfort detection and strategy adjustment module CA, formulate and fine-tune the response strategy with emotion guidance, Guiding the conversation content and emotional tendency;

步骤(6)、利用所述情感引导作用,对所述会话内容及情感倾向性进行引导,进而更新所述情感状态转移概率矩阵中所述情感状态转移概率。Step (6), using the emotional guidance function to guide the conversation content and emotional tendency, and then update the emotional state transition probability in the emotional state transition probability matrix.

所述应答舒适度检测与策略调整模块CA中所述应答舒适度检测与策略调整方法是按如下步骤进行:The response comfort detection and strategy adjustment method described in the response comfort detection and strategy adjustment module CA is performed in the following steps:

步骤1)、步骤2中所述语义分析,获得用户t时刻、t-1时刻、t-2时刻…t-n时刻时间序列输入内容的所述情感类别Et、Et-1、Et-2…Et-n及所述情感强度St、St-1、St-2…St-nSemantic analysis described in step 1), step 2, obtains described emotion category E t , E t-1 , E t-2 of user t time, t-1 time, t-2 time...tn time series input content ...E tn and the emotional intensity S t , S t-1 , S t-2 ...S tn ;

步骤2)、根据所述步骤1)中所述时间序列中所述情感类别的转移关系,以及所述情感强度的波动变化,计算所述应答舒适度;Step 2), according to the transfer relationship of the emotional category in the time series in the step 1), and the fluctuation of the emotional intensity, calculate the response comfort;

利用式(8)定义情感能量函数,表征所述时间序列内情感能量强度EE:Equation (8) is used to define the emotional energy function to characterize the emotional energy intensity EE in the time series:

EE=f(E,S) (8)EE=f(E,S) (8)

其中,若所述情感类别E∈{高兴,喜爱,期待},则所述情感能量函数值为正;若所述情感类别E∈{焦虑,悲伤,生气,憎恨,惊讶},则所述情感能量函数值为负;若所述情感类别E∈{平静},则所述情感能量函数值为0;Wherein, if the emotion category E∈{happiness, love, expectation}, the value of the emotion energy function is positive; if the emotion category E∈{anxiety, sadness, anger, hatred, surprise}, the emotion The value of the energy function is negative; if the emotional category E∈{calm}, the value of the emotional energy function is 0;

利用式(9)定义所述时间序列内所述情感强度的过零率R:Utilize formula (9) to define the zero-crossing rate R of described emotion intensity in described time series:

R=N/n (9)R=N/n (9)

其中,N表示所述时间序列内情感函数值的正负转换次数,n表示所述时间序列长度;Wherein, N represents the positive and negative conversion times of sentiment function value in described time series, and n represents described time series length;

利用式(10)定义情感能量函数变化率D,表征情感能量的变化趋势:Use formula (10) to define the rate of change of the emotional energy function D, to represent the changing trend of emotional energy:

利用式(11)将所述应答舒适度表示为一个三元组CL:Using formula (11) to express the response comfort level as a triplet CL:

CL=(EE,R,D) (11)CL=(EE,R,D) (11)

步骤3)、根据所述应答舒适度检测异常情感状态,并基于所述用户输入、所述系统输出及所述情感动力学与心理知识库对应答策略进行调整;Step 3), detecting an abnormal emotional state according to the response comfort level, and adjusting the response strategy based on the user input, the system output and the emotional dynamics and psychological knowledge base;

根据所述情感引导功能,重点对如下情况进行应答策略调整:According to the emotional guidance function, focus on adjusting the response strategy for the following situations:

情况1)、所述时间序列内所述情感能量函数值长期为负,表征为所述情感状态长期处于负向情感;Case 1), the emotional energy function value in the time series is negative for a long time, which is characterized by the negative emotion of the emotional state for a long time;

情况2)、所述时间序列内所述情感能量函数值由正减为负,表征为所述情感类型由正向情感转移为负向情感;Case 2), the value of the emotional energy function in the time series changes from positive to negative, which is characterized by the transfer of the emotional type from positive emotion to negative emotion;

情况3)、所述时间序列内所述过零率R高于某一设定阈值,表征为情感状态不稳定;Case 3), the zero-crossing rate R in the time series is higher than a certain set threshold, which is characterized by an unstable emotional state;

情况4)、所述时间序列内所述情感能量函数变化率为负值,表征为情感状态有转移为负向情感或负向情感强度增加的趋势。Case 4), the rate of change of the emotional energy function in the time series is negative, which is characterized by a tendency for the emotional state to shift to negative emotion or to increase the intensity of negative emotion.

本发明的优点是:The advantages of the present invention are:

1、本发明通过提取用户输入的情感语义信息,将情感因素引入到人机会话系统中,克服了现有技术中忽略情感因素的缺陷,从而使得人机交互更加自然和谐,应用领域更加广泛。1. The present invention introduces emotional factors into the man-machine conversation system by extracting the emotional semantic information input by the user, which overcomes the defect of ignoring the emotional factors in the prior art, thereby making the human-computer interaction more natural and harmonious, and the application field is wider.

2、本发明通过个性化人格建模与动态分析模块,会话系统可以对用户人格进行个性化建模与分析,从而生成个性化的会话应答,进而可以针对特定用户群进行个性化情感引导。2. In the present invention, through the personalized personality modeling and dynamic analysis module, the conversation system can carry out personalized modeling and analysis of user personality, thereby generating personalized conversation responses, and then can carry out personalized emotional guidance for specific user groups.

3、本发明通过应答舒适度检测与应答策略调整模块,可检测上一轮会话系统应答的质量并通过调整下一轮应答策略改善会话应答质量,可解决多轮情感会话问题。3. The present invention can detect the quality of the system response in the last round of conversation and improve the quality of the conversation response by adjusting the response strategy of the next round through the response comfort detection and response strategy adjustment module, which can solve the problem of multiple rounds of emotional conversation.

4、本发明会话管理模块使用生成模型,可生成知识库以外的会话应答,从而使得系统适用于开放领域的人机情感会话,并通过知识的积累实现情感会话系统的进化。4. The conversation management module of the present invention uses a generative model to generate conversation responses other than the knowledge base, so that the system is suitable for human-machine emotional conversation in the open field, and realizes the evolution of the emotional conversation system through the accumulation of knowledge.

附图说明Description of drawings

图1为本发明的整体结构与流程示意图。Fig. 1 is the overall structure and flow diagram of the present invention.

具体实施方式Detailed ways

如图1所示,一种个性化人机情感会话系统,适用于人机交互任务,包括有个性化人格建模与动态分析模块CD、会话管理模块DM和应答舒适度检测与应答策略调整模块CA,所述的会话管理模块DM根据用户输入的对话内容自动生成带有情感的会话应答;所述的个性化人格建模与动态分析模块CD存储人机对话历史数据,根据所述人机对话历史数据分析用户长期人格特征及短期情感转移特征,进而制定人机会话应答策略;所述的应答舒适度检测与应答策略调整模块CA检测用户情感波动,调整人机会话应答策略。As shown in Figure 1, a personalized human-computer emotional conversation system is suitable for human-computer interaction tasks, including a personalized personality modeling and dynamic analysis module CD, a conversation management module DM, and a response comfort detection and response strategy adjustment module CA, the conversation management module DM automatically generates a conversation response with emotion according to the dialogue content input by the user; the personalized personality modeling and dynamic analysis module CD stores the man-machine conversation history data, according to the man-machine conversation The historical data analyzes the user's long-term personality characteristics and short-term emotional transfer characteristics, and then formulates a human-computer conversation response strategy; the response comfort detection and response strategy adjustment module CA detects user emotional fluctuations, and adjusts the human-computer conversation response strategy.

利用式(1)将个性化人机情感会话系统PEDS描述为一个五元组:Use formula (1) to describe the personalized human-machine emotional dialogue system PEDS as a five-tuple:

PEDS=(Input,CD,DM,CA,Output) (1)PEDS=(Input, CD, DM, CA, Output) (1)

式(1)中,Input表示所述个性化人机情感会话系统的用户输入,Output表示所述个性化人机情感交互系统的系统输出,In formula (1), Input represents the user input of described personalized human-computer emotion dialogue system, and Output represents the system output of described personalized human-computer emotional interaction system,

所述的会话管理模块DM的组成包括:语义分析、语义推理、应答策略和会话生成;The composition of the conversation management module DM includes: semantic analysis, semantic reasoning, response strategy and conversation generation;

所述的个性化人格建模与动态分析模块CD的组成包括:会话知识库与心理知识库、个性化人格建模与动态分析方法;The composition of described individualized personality modeling and dynamic analysis module CD comprises: conversational knowledge base and psychological knowledge base, individualized personality modeling and dynamic analysis method;

所述的会话知识库与心理知识库的组成包括:动态知识库、会话历史库和心理知识库;The composition of the conversational knowledge base and the psychological knowledge base includes: a dynamic knowledge base, a conversational history base and a psychological knowledge base;

所述的应答舒适度检测与应答策略调整模块CA组成包括:情感动力学与心理知识库、应答舒适度检测与应答策略调整方法;The CA composition of the response comfort detection and response strategy adjustment module includes: emotional dynamics and psychological knowledge base, response comfort detection and response strategy adjustment method;

所述情感动力学与心理知识库的组成包括:动态心理知识库、情感动力学知识库和静态心理知识库。The emotional dynamics and psychological knowledge base include: a dynamic psychological knowledge base, an emotional dynamics knowledge base and a static psychological knowledge base.

所述会话管理模块DM是按如下步骤进行的:The session management module DM is carried out as follows:

步骤1、对话管理模块DM接收用户输入会话内容,使用预训练词向量连接的方式,考虑句子中词序关系,获取所述用户输入会话内容的语义表示SP;Step 1. The dialogue management module DM receives the user input conversation content, uses the pre-training word vector connection mode, considers the word order relationship in the sentence, and obtains the semantic representation SP of the user input conversation content;

步骤2、对所述用户输入的所述语义表示SP进行语义分析,获取用户的会话语境信息C、会话主题T、情感对象O、情感类别E、情感强度S和会话意图I;假设用户输入为:皇马这场球踢得太烂了!经步骤2可依次得到语境C为体育,会话主题T为足球,情感对象O为皇马,情感类别E为生气,情感强度为0.8,会话意图I为吐槽;Step 2. Perform semantic analysis on the semantic representation SP input by the user, and obtain the user's conversational context information C, conversational topic T, emotional object O, emotional category E, emotional intensity S, and conversational intent I; assuming that the user inputs For: Real Madrid played too badly this time! After step 2, the context C is sports, the conversation topic T is football, the emotion object O is Real Madrid, the emotion category E is anger, the emotion intensity is 0.8, and the conversation intention I is complaining;

步骤2.1、所述语义分析中对会话上下文进行分析,得到会话语境信息C;Step 2.1, analyzing the conversational context in the semantic analysis to obtain the conversational context information C;

步骤2.2、得到所述语境信息后,结合所述用户输入,分析得到所述会话主题信息T;Step 2.2. After obtaining the context information, analyze and obtain the conversation topic information T in combination with the user input;

步骤2.3、在所述会话主题中分析所述会话主题的属性,确定所述会话主题中的所述情感对象O;Step 2.3, analyzing the attributes of the conversation topic in the conversation topic, and determining the emotional object O in the conversation topic;

步骤2.4、结合所述会话上下文及当前用户输入Q,对所述用户输入中针对所述情感对象的情感进行分析,确定用户对所述情感对象的所述情感类别E及所述情感强度S;Step 2.4. Combining the conversation context and the current user input Q, analyze the emotion of the emotional object in the user input, and determine the user's emotional category E and emotional intensity S for the emotional object;

利用式(2)表示所述情感类别E的集合:Utilize formula (2) to represent the collection of described emotion category E:

{E}={平静,高兴,喜爱,惊讶,焦虑,悲伤,生气,憎恨,期待} (2){E} = {peace, joy, love, surprise, anxiety, sadness, anger, hatred, anticipation} (2)

步骤2.5、根据所述步骤2.1~2.4,分析用户所述会话意图I;Step 2.5. According to the steps 2.1 to 2.4, analyze the conversational intention I of the user;

利用式(3)表示所述会话意图I获取过程:Utilize formula (3) to express described session intent I acquisition process:

I=f(C,T,O,E,S) (3)I=f(C,T,O,E,S) (3)

利用式(4)将所述语义分析描述为一个六元组SA:The semantic analysis is described as a six-tuple SA by using formula (4):

SA=(I,C,T,O,E,S) (4)SA=(I,C,T,O,E,S) (4)

步骤3、在获取所述会话意图I后,所述语义推理基于步骤2所述会话语境信息C、会话主题T、情感对象O、情感类别E、情感强度S和会话意图I前提,进行逻辑推理与判断,得到所述用户输入的深层语义结论Res;该深层语义结论Res在深度神经网络中以隐向量的形式表示,如(0.24,0.62,0.71,0.12,…,0.56,0.98,0.46),可视为用户内心活动的一种表述,假如用户是皇马的铁粉,那此时用户的内心可能是一种“恨铁不成钢”的状态。Step 3, after obtaining the conversational intent I, the semantic reasoning is based on the conversational context information C, the conversational topic T, the emotional object O, the emotional category E, the emotional intensity S and the conversational intent I premise in the step 2, and carry out logic Reasoning and judging to obtain the deep semantic conclusion Res input by the user; the deep semantic conclusion Res is expressed in the form of hidden vector in the deep neural network, such as (0.24,0.62,0.71,0.12,...,0.56,0.98,0.46) , can be regarded as an expression of the user's inner activities. If the user is a fan of Real Madrid, then the user's heart may be in a state of "hate iron but not steel" at this time.

利用式(5)表示所示语义推理过程:Use formula (5) to represent the semantic reasoning process shown:

(I,C,T,O,E,S)→Res (5)(I,C,T,O,E,S)→Res (5)

步骤4、所述应答策略根据所述深层语义结论Res制定用于指导会话生成的策略,所述应答策略制定过程是受如下因素影响:Step 4, the response strategy formulates a strategy for guiding conversation generation according to the deep semantic conclusion Res, and the response strategy formulation process is affected by the following factors:

因素1、所述步骤2所述会话语境信息C、会话主题T、情感对象O、情感类别E、情感强度S、会话意图I及所述步骤3所述深层语义结论Res;Factor 1, the conversation context information C in the step 2, the conversation topic T, the emotion object O, the emotion category E, the emotion intensity S, the conversation intention I and the deep semantic conclusion Res in the step 3;

因素2、所述个性化人格建模与动态分析模块CD的长期情感模型,表现为个性化人格;一般情况下,人的行为和表达方式会受个人人格的影响,若该用户是神经质人格,那么他的行为和语言表达多表现为焦虑、敌对、冲动等;而如果该用户是外倾性人格,那么他的行为和语言白殴打多表现为客观、果断、热情等特质;Factor 2, the long-term emotional model of the personalized personality modeling and dynamic analysis module CD, manifested as personalized personality; generally, people's behavior and expression will be affected by personal personality, if the user is a neurotic personality, Then his behavior and language expression are mostly anxious, hostile, impulsive, etc.; and if the user is an extraverted personality, then his behavior and language expression are mostly objective, decisive, and enthusiastic;

因素3、所述个性化人格建模与动态分析模块CD的短期情感模型,表现为情感转移概率;情感转移概率受个人人格、兴趣爱好、心理状态等多因素影响;不同用户从正向情感转移至负向情感,或者负向情感转移至正向情感的概率是不同的,所经历的时间和过程也不尽相同;Factor 3, the short-term emotional model of the personalized personality modeling and dynamic analysis module CD, which is expressed as the probability of emotional transfer; the probability of emotional transfer is affected by multiple factors such as personal personality, hobbies, and psychological states; different users transfer from positive to emotional The probability of reaching negative emotions, or transferring negative emotions to positive emotions is different, and the time and process experienced are also different;

因素4、所述应答舒适度检测与应答策略调整模块CA的应答策略调整方法;该因素可通过检测前序应答条件下用户的情感波动调整会话应答的策略,进而通过下一轮会话应答引导用户情感转移;Factor 4, the response strategy adjustment method of the response comfort detection and response strategy adjustment module CA; this factor can adjust the conversation response strategy by detecting the user's emotional fluctuations under the pre-order response condition, and then guide the user through the next round of conversation response Emotional transfer;

步骤5、所述会话生成在所述应答策略指导下生成会话应答A,所述会话生成是按如下情况进行:Step 5, the session generation generates a session response A under the guidance of the response policy, and the session generation is performed as follows:

情况1、若所述用户输入为事实性问答内容,所述会话生成在所述会话知识库中匹配检索现有知识,并生成所述会话应答A;假如用户输入内容为:“中国的首都是哪里”,会话系统会检索知识库,得到会话应答“中国的首都是北京”;Situation 1. If the user input is factual question and answer content, the conversation generation matches and retrieves existing knowledge in the conversation knowledge base, and generates the conversation answer A; if the user input content is: "The capital of China is Where", the conversation system will search the knowledge base and get the conversation response "The capital of China is Beijing";

情况2、若所述用户输入为聊天性内容,所述会话生成根据所述会话语境信息C及所述当前用户输入Q生成所述会话应答A;假如用户输入为:“你看昨天晚上皇马的比赛了吗?”,则会话系统可根据语境信息回答:“看了”或者“没看”;Situation 2. If the user input is chat content, the conversation generation generates the conversation answer A according to the conversation context information C and the current user input Q; if the user input is: "Look at Real Madrid last night Did you play the game?", then the dialogue system can answer: "I watched" or "I didn't watch" according to the context information;

情况3、若所述用户输入为带有情感的会话内容,所述会话生成在所述应答策略指导下生成具有情感引导功能的所述会话应答A;假如用户输入内容为:“烦死了,又下雨了,只能待在家里!”,则会话系统可生成:“没关系,我们可以在家看看电影,挺好的”(正向情感引导),或者“是啊,天气真是糟透了”(负向情感引导)。该发明更侧重于正向情感的引导;Situation 3: If the user input is conversational content with emotion, the conversational generation generates the conversational response A with emotion guiding function under the guidance of the response strategy; It’s raining again, so we can only stay at home!”, then the conversational system can generate: “It’s okay, we can watch movies at home, it’s good” (positive emotional guidance), or “Yeah, the weather is really terrible "(Negative emotional guidance). The invention focuses more on the guidance of positive emotions;

步骤6、所述会话应答A经所述系统输出进行人机交互与反馈;Step 6, the conversation response A is output by the system for human-computer interaction and feedback;

步骤7、所述用户输入Q与所述会话应答A存储至会话历史库。Step 7: The user input Q and the conversation response A are stored in a conversation history database.

个性化人格建模与动态分析模块存储人机对话历史数据,根据所述人机对话历史数据分析用户长期人格特征及短期情感转移特征,进而制定人机会话应答策略。个性化人格建模与动态分析方法是按如下步骤进行:The personalized personality modeling and dynamic analysis module stores the historical data of man-machine dialogue, analyzes the user's long-term personality characteristics and short-term emotional transfer characteristics according to the historical data of man-machine dialogue, and then formulates the man-machine dialogue response strategy. Personalized personality modeling and dynamic analysis methods are carried out in the following steps:

步骤(1)、所述步骤2中利用所述语义分析对所述会话历史库中所述用户输入进行分析,得到所述用户输入的所述情感类别;Step (1), in the step 2, utilize the semantic analysis to analyze the user input in the conversation history storehouse to obtain the emotion category of the user input;

步骤(2)、统计计算所述情感类别间的转移概率关系,计算从一种情感类别转移为另一种情感类别的概率,进而得到所述情感类别的情感状态转移概率矩阵M,用以表示所述短期情感模型;Step (2), statistically calculate the transition probability relationship between the emotional categories, calculate the probability of transferring from one emotional category to another emotional category, and then obtain the emotional state transition probability matrix M of the emotional category, to represent said short-term affective model;

利用式(6)表示所述情感状态转移概率矩阵M:Utilize formula (6) to express described emotional state transition probability matrix M:

其中,pij表示由情感状态i转移至情感状态j的概率,pii表示情感状态保持不变的概率;Among them, p ij represents the probability of transferring from emotional state i to emotional state j, and p ii represents the probability that emotional state remains unchanged;

步骤(3)、以所述情感状态转移概率矩阵为特征,进行个性化人格建模,配合大五人格量表确定所述情感状态转移概率矩阵M与大五人格F的对应关系,M→F,用以表示所述长期情感模型;假如通过概率计算发现某用户总是以大概率从正向情感转移至负向情感或者情感波动比较大,那么,该用户属于神经质人格的概率就较大;Step (3), using the emotional state transition probability matrix as a feature, carry out personalized personality modeling, and cooperate with the Big Five personality scale to determine the corresponding relationship between the emotional state transition probability matrix M and the Big Five personality F, M→F , used to represent the long-term emotional model; if it is found through probability calculation that a certain user always transfers from positive emotion to negative emotion with a high probability or the emotional fluctuation is relatively large, then the probability of the user belonging to neurotic personality is relatively large;

利用式(7)表示所述大五人格F的集合:Utilize formula (7) to express the collection of described big five personality F:

{F}={开放性,责任心,外倾性,宜人性,神经质} (7){F} = {openness, conscientiousness, extraversion, agreeableness, neuroticism} (7)

步骤(4)、根据所述大五人格F的人格五因素,分析用户的个人喜好和会话特征;Step (4), according to the personality five factors of described big five personality F, analyze the user's personal preferences and conversation characteristics;

步骤(5)、依据所述用户个人喜好和会话特征以及所述情感状态转移概率矩阵M,联合所述应答舒适度检测与策略调整模块CA,制定具有情感引导作用的所述应答策略并微调,对所述会话内容及情感倾向性进行引导;用户个人喜好会影响用户的情感转移概率,对自己喜好的事物,即使开始是负向情感,也会较快的转移至正向情感;相反如果是用户反感的事物,则会以较大的概率转移至负向情感;Step (5), according to the user's personal preferences and conversation features and the emotional state transition probability matrix M, in conjunction with the response comfort detection and strategy adjustment module CA, formulate and fine-tune the response strategy with emotion guidance, Guide the conversation content and emotional tendency; the user's personal preferences will affect the user's emotional transfer probability, and even if the things he likes initially are negative emotions, they will quickly transfer to positive emotions; on the contrary, if they are Things that the user dislikes will be transferred to negative emotions with a higher probability;

步骤(6)、利用所述情感引导作用,对所述会话内容及情感倾向性进行引导,进而更新所述情感状态转移概率矩阵中所述情感状态转移概率。Step (6), using the emotional guidance function to guide the conversation content and emotional tendency, and then update the emotional state transition probability in the emotional state transition probability matrix.

所述应答舒适度检测与策略调整模块CA中所述应答舒适度检测与策略调整方法是按如下步骤进行:The response comfort detection and strategy adjustment method described in the response comfort detection and strategy adjustment module CA is performed in the following steps:

步骤1)、步骤2中所述语义分析,获得用户t时刻、t-1时刻、t-2时刻…t-n时刻时间序列输入内容的所述情感类别Et、Et-1、Et-2…Et-n及所述情感强度St、St-1、St-2…St-nSemantic analysis described in step 1), step 2, obtains described emotion category E t , E t-1 , E t-2 of user t time, t-1 time, t-2 time...tn time series input content ...E tn and the emotional intensity S t , S t-1 , S t-2 ...S tn ;

步骤2)、根据所述步骤1)中所述时间序列中所述情感类别的转移关系,以及所述情感强度的波动变化,计算所述应答舒适度;Step 2), according to the transfer relationship of the emotional category in the time series in the step 1), and the fluctuation of the emotional intensity, calculate the response comfort;

利用式(8)定义情感能量函数,表征所述时间序列内情感能量强度EE:Equation (8) is used to define the emotional energy function to characterize the emotional energy intensity EE in the time series:

EE=f(E,S) (8)EE=f(E,S) (8)

其中,若所述情感类别E∈{高兴,喜爱,期待},则所述情感能量函数值为正;若所述情感类别E∈{焦虑,悲伤,生气,憎恨,惊讶},则所述情感能量函数值为负;若所述情感类别E∈{平静},则所述情感能量函数值为0;情感强度有正负之分,若正向情感强度越大,说明用户情感状态越积极;若负向情感强度越小,说明用户情感状态越消极;若情感强度接近0,说明用户情感状态趋于平静;Wherein, if the emotion category E∈{happiness, love, expectation}, the value of the emotion energy function is positive; if the emotion category E∈{anxiety, sadness, anger, hatred, surprise}, the emotion The energy function value is negative; if the emotional category E∈{calm}, the emotional energy function value is 0; the emotional intensity can be positive or negative, and if the positive emotional intensity is greater, the user's emotional state is more positive; If the negative emotional intensity is smaller, it means that the user's emotional state is more negative; if the emotional intensity is close to 0, it means that the user's emotional state tends to be calm;

利用式(9)定义所述时间序列内所述情感强度的过零率R:过零率越大则用户在该段时间内的情感波动越频繁,说明情感不稳定:Use formula (9) to define the zero-crossing rate R of the emotional intensity in the time series: the greater the zero-crossing rate, the more frequent the user's emotional fluctuations during this period, indicating that the emotional instability:

R=N/n (9)R=N/n (9)

其中,N表示所述时间序列内情感函数值的正负转换次数,n表示所述时间序列长度;Wherein, N represents the positive and negative conversion times of sentiment function value in described time series, and n represents described time series length;

利用式(10)定义情感能量函数变化率D,表征情感能量的变化趋势:Use formula (10) to define the rate of change of the emotional energy function D, to represent the changing trend of emotional energy:

情感能量函数变化率为正,说明情感能量函数值增加,表现为情感状态趋于正向情感;情感能量函数变化率为福,说明情感能量函数值减小,表现为情感状态趋于负向情感;情感能量函数变化率为零,说明情感能量函数值保持不变,表现为情感状态平静;The change rate of the emotional energy function is positive, indicating that the value of the emotional energy function increases, showing that the emotional state tends to be positive; the rate of change of the emotional energy function is Fu, indicating that the value of the emotional energy function decreases, showing that the emotional state tends to be negative. ; The rate of change of the emotional energy function is zero, indicating that the value of the emotional energy function remains unchanged, showing a calm emotional state;

利用式(11)将所述应答舒适度表示为一个三元组CL:Using formula (11) to express the response comfort level as a triplet CL:

CL=(EE,R,D)(11)CL=(EE,R,D)(11)

步骤3)、根据所述应答舒适度检测异常情感状态,并基于所述用户输入、所述系统输出及所述情感动力学与心理知识库对应答策略进行调整;Step 3), detecting an abnormal emotional state according to the response comfort level, and adjusting the response strategy based on the user input, the system output and the emotional dynamics and psychological knowledge base;

根据所述情感引导功能,重点对如下情况进行应答策略调整:According to the emotional guidance function, focus on adjusting the response strategy for the following situations:

情况1)、所述时间序列内所述情感能量函数值长期为负,表征为所述情感状态长期处于负向情感;Case 1), the emotional energy function value in the time series is negative for a long time, which is characterized by the negative emotion of the emotional state for a long time;

情况2)、所述时间序列内所述情感能量函数值由正减为负,表征为所述情感类型由正向情感转移为负向情感;Case 2), the value of the emotional energy function in the time series changes from positive to negative, which is characterized by the transfer of the emotional type from positive emotion to negative emotion;

情况3)、所述时间序列内所述过零率R高于某一设定阈值,表征为情感状态不稳定;Case 3), the zero-crossing rate R in the time series is higher than a certain set threshold, which is characterized by an unstable emotional state;

情况4)、所述时间序列内所述情感能量函数变化率为负值,表征为情感状态有转移为负向情感或负向情感强度增加的趋势。Case 4), the rate of change of the emotional energy function in the time series is negative, which is characterized by a tendency for the emotional state to shift to negative emotion or to increase the intensity of negative emotion.

Claims (5)

1. a kind of man-machine emotion conversational system of personalization, it is characterised in that:It include personalized personality modeling and dynamic analysis mould Block CD, session management module DM and the detection of response comfort level and acknowledgment strategy adjustment module CA, the session management module DM The session response with emotion is automatically generated according to the conversation content that user inputs;The modeling of personalized personality and dynamic point It analyses module CD and stores human-computer dialogue historical data, according to the long-term personality characteristics of the human-computer dialogue historical data analysis user and short Phase transference feature, and then formulate man-machine conversation's acknowledgment strategy;The response comfort level detection adjusts mould with acknowledgment strategy Block CA detects user feeling fluctuation, adjusts man-machine conversation's acknowledgment strategy.
2. the man-machine emotion conversational system of a kind of personalization according to claim 1, it is characterised in that:It will be a using formula (1) The man-machine emotion conversational system PEDS of propertyization is described as a five-tuple:
PEDS=(Input, CD, DM, CA, Output) (1)
In formula (1), Input table shows user's input of the man-machine emotion conversational system of the personalization, and Output indicates the individual character Change the system output of Human-Machine Emotion Interactive System,
The composition of the session management module DM includes:Semantic analysis, semantic reasoning, acknowledgment strategy and session generate;
The personalized personality models and the composition of dynamic analysis module CD includes:It is session knowledge base and psychological knowledge base, a Property personality modeling and dynamic analysing method;
The composition of the session knowledge base and psychological knowledge base includes:Dynamic repository, conversation history library and psychological knowledge base;
The response comfort level detection is formed with acknowledgment strategy adjustment module CA:Emotion dynamics and psychological knowledge base, The detection of response comfort level and acknowledgment strategy method of adjustment;
The composition of the emotion dynamics and psychological knowledge base includes:The psychological knowledge base of dynamic, emotion dynamics knowledge base and quiet State psychology knowledge base.
3. the man-machine emotion conversational system of a kind of personalization according to claim 2, it is characterised in that:The session management mould Block DM is carried out as follows:
Step 1, dialogue management module DM receive user and input session content, obtain the semantic table that the user inputs session content Show SP;
Step 2, to the user input the semantic expressiveness SP carry out semantic analysis, obtain user session language ambience information C, Session theme T, emotion object O, emotional category E, emotional intensity S and session are intended to I;
Session context is analyzed in step 2.1, the semantic analysis, obtains session language ambience information C;
Step 2.2 after obtaining the language ambience information, is inputted in conjunction with the user, and analysis obtains the session subject information T;
Step 2.3, the attribute that the session theme is analyzed in the session theme, determine the feelings in the session theme Feel object O;
Step 2.4 inputs Q in conjunction with the session context and active user, to being directed to the emotion pair in user input The emotion of elephant is analyzed, and determines user to the emotional category E and the emotional intensity S of the emotion object;
The set of the emotional category E is indicated using formula (2):
{ E }=and it is tranquil, it is glad, like, surprised, anxiety, it is sad, it is angry, hate, expect (2)
Step 2.5, according to step 2.1~2.4, analyze session described in user and be intended to I;
Indicate that the session is intended to I acquisition process using formula (3):
I=f (C, T, O, E, S) (3)
The semantic analysis is described as a hexa-atomic group of SA using formula (4):
SA=(I, C, T, O, E, S) (4)
Step 3, after obtaining the session and being intended to I, the semantic reasoning is based on session language ambience information C, session master described in step 2 It inscribes T, emotion object O, emotional category E, emotional intensity S and session and is intended to I premise, carry out reasoning from logic and judgement, obtain described The Deep Semantics conclusion Res of user's input;
Shown semantic reasoning process is indicated using formula (5):
(I,C,T,O,E,S)→Res (5)
Step 4, the acknowledgment strategy formulate the strategy for instructing session to generate according to the Deep Semantics conclusion Res, described Acknowledgment strategy formulation process is influenced by following factor:
Session language ambience information C, session theme T described in factor 1, the step 2, emotion object O, emotional category E, emotional intensity S, Session is intended to Deep Semantics conclusion Res described in I and the step 3;
Factor 2, the personalized personality model the long-term emotion model with dynamic analysis module CD, show as personalized personality;
Factor 3, the personalized personality model the short-term emotion model with dynamic analysis module CD, and it is general to show as transference Rate;
Factor 4, the acknowledgment strategy method of adjustment of response comfort level detection and acknowledgment strategy adjustment module CA;
Step 5, the session generate and generate session response A under acknowledgment strategy guidance, and the session generation is by as follows Situation carries out:
If situation 1, user input are fact question and answer content, the session is generated matches inspection in the session knowledge base Rope existing knowledge, and generate the session response A;
If situation 2, user input are chat property content, the session is generated according to the session language ambience information C and described Active user inputs Q and generates the session response A;
If situation 3, user input are the session content with emotion, the session is generated under acknowledgment strategy guidance Generate the session response A with emotion guiding function;
Step 6, the session response A are exported through the system carries out human-computer interaction and feedback;
Step 7, the user input Q and the session response A is stored to conversation history library.
4. the man-machine emotion conversational system of a kind of personalization according to claim 3, it is characterised in that:The personalization personality It is to carry out as follows that modeling, which is modeled with personalization personality described in dynamic analysis module CD with dynamic analysing method,:
The input of user described in the conversation history library is divided using the semantic analysis in step (1), the step 2 Analysis obtains the emotional category of user's input;
Step (2), statistics calculate the transition probability relationship between the emotional category, and it is another for calculating from a kind of transfer of emotional category The probability of kind emotional category, and then the affective state transition probability matrix M of the emotional category is obtained, to indicate described short-term Emotion model;
The affective state transition probability matrix M is indicated using formula (6):
Wherein, pijIndicate the probability that affective state j is transferred to by affective state i, piiIndicate the probability that affective state remains unchanged;
Step (3), characterized by the affective state transition probability matrix, carry out personalized personality modeling, cooperate five-factor model personality Scale determines the corresponding relationship of the affective state transition probability matrix M and five-factor model personality F, M → F, to indicate described long-term Emotion model;
The set of the five-factor model personality F is indicated using formula (7):
{ F }={ open, sense of responsibility, extroversion, pleasant property are neurotic } (7)
Step (4), five factor of personality according to the five-factor model personality F, analyze the personal preference and session characteristics of user;
Step (5), according to individual subscriber hobby and session characteristics and the affective state transition probability matrix M, joint The response comfort level detection and Developing Tactics module CA, formulate the acknowledgment strategy with emotion guiding function and finely tune, The session content and emotion tendency are guided;
Step (6), using the emotion guiding function, the session content and emotion tendency are guided, so update Affective state transition probability described in the affective state transition probability matrix.
5. the man-machine emotion conversational system of a kind of personalization according to claim 4, it is characterised in that:The response comfort level It is to carry out as follows that detection, which is detected with response comfort level described in Developing Tactics module CA with strategy adjusting method,:
Semantic analysis described in step 1), step 2 obtains user's t moment, t-1 moment, t-2 moment ... t-n time sequence The emotional category E of input contentt、Et-1、Et-2…Et-nAnd the emotional intensity St、St-1、St-2…St-n
The transfer relationship of emotional category described in step 2), the time series according to the step 1) and the emotion The fluctuating change of intensity calculates the response comfort level;
Emotional energy function is defined using formula (8), characterizes emotional energy intensity EE in the time series:
EE=f (E, S) (8)
Wherein, if the emotional category E ∈ { glad, to like, expect }, then the emotional energy functional value is positive;If the feelings Feel classification E ∈ { anxiety, sad, angry, hatred are surprised }, then the emotional energy functional value is negative;If the emotional category E ∈ { tranquil }, then the emotional energy functional value is 0;
The zero-crossing rate R of the emotional intensity in the time series is defined using formula (9):
R=N/n (9)
Wherein, N indicates the positive and negative conversion times of emotion functional value in the time series, and n indicates the length of time series;
Emotional energy function change rate D is defined using formula (10), characterizes the variation tendency of emotional energy:
The response comfort level is expressed as a triple CL using formula (11):
CL=(EE, R, D) (11)
Step 3) detects abnormal emotion state according to the response comfort level, and based on user input, system output And the emotion dynamics is adjusted acknowledgment strategy with psychological knowledge base;
According to the emotion guiding function, emphasis carries out acknowledgment strategy adjustment to following situation:
Situation 1), the emotional energy functional value is negative for a long time in the time series, be characterized as the affective state and locate for a long time In negative sense emotion;
Situation 2), the emotional energy functional value is born by being just kept in the time series, be characterized as the affective style by just It is negative sense emotion to transference;
Situation 3), the zero-crossing rate R is higher than a certain given threshold in the time series, it is unstable to be characterized as affective state;
Situation 4), the emotional energy function change rate is negative value in the time series, being characterized as affective state has the transfer to be Negative sense emotion or the increased trend of negative sense emotional intensity.
CN201810584345.4A 2018-06-08 2018-06-08 Personalized man-machine emotion conversation system Active CN108846073B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810584345.4A CN108846073B (en) 2018-06-08 2018-06-08 Personalized man-machine emotion conversation system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810584345.4A CN108846073B (en) 2018-06-08 2018-06-08 Personalized man-machine emotion conversation system

Publications (2)

Publication Number Publication Date
CN108846073A true CN108846073A (en) 2018-11-20
CN108846073B CN108846073B (en) 2022-02-15

Family

ID=64211450

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810584345.4A Active CN108846073B (en) 2018-06-08 2018-06-08 Personalized man-machine emotion conversation system

Country Status (1)

Country Link
CN (1) CN108846073B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109684459A (en) * 2018-12-28 2019-04-26 联想(北京)有限公司 A kind of information processing method and device
CN111309864A (en) * 2020-02-11 2020-06-19 安徽理工大学 User group emotional tendency migration dynamic analysis method for microblog hot topics
CN112380329A (en) * 2020-11-13 2021-02-19 四川大学 Training robot system and method under fine positive symptom background
CN112489654A (en) * 2020-11-17 2021-03-12 深圳康佳电子科技有限公司 Voice interaction method and device, intelligent terminal and storage medium
CN113326359A (en) * 2020-02-28 2021-08-31 浙江大搜车软件技术有限公司 Training method and device for dialogue response and response strategy matching model
CN113656562A (en) * 2020-11-27 2021-11-16 话媒(广州)科技有限公司 Multi-round man-machine psychological interaction method and device
CN115658908A (en) * 2022-12-29 2023-01-31 华南理工大学 A big five personality perception method and system based on dialogue interaction process
CN117972075A (en) * 2024-03-28 2024-05-03 华南理工大学 A method for generating emotional dialogues by collaborating with mind and language agents

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140012930A1 (en) * 2012-06-15 2014-01-09 Life of Two Sharing emotion using remote control commands
CN104331506A (en) * 2014-11-20 2015-02-04 北京理工大学 Multiclass emotion analyzing method and system facing bilingual microblog text
CN106448670A (en) * 2016-10-21 2017-02-22 竹间智能科技(上海)有限公司 Dialogue automatic reply system based on deep learning and reinforcement learning
CN106559321A (en) * 2016-12-01 2017-04-05 竹间智能科技(上海)有限公司 The method and system of dynamic adjustment dialog strategy
CN106683672A (en) * 2016-12-21 2017-05-17 竹间智能科技(上海)有限公司 Intelligent dialogue method and system based on emotion and semantics
CN106775665A (en) * 2016-11-29 2017-05-31 竹间智能科技(上海)有限公司 The acquisition methods and device of the emotional state change information based on sentiment indicator
CN107025371A (en) * 2017-03-09 2017-08-08 安徽创易心理科技有限公司 A kind of mood is dynamically monitored and management method and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140012930A1 (en) * 2012-06-15 2014-01-09 Life of Two Sharing emotion using remote control commands
CN104331506A (en) * 2014-11-20 2015-02-04 北京理工大学 Multiclass emotion analyzing method and system facing bilingual microblog text
CN106448670A (en) * 2016-10-21 2017-02-22 竹间智能科技(上海)有限公司 Dialogue automatic reply system based on deep learning and reinforcement learning
CN106775665A (en) * 2016-11-29 2017-05-31 竹间智能科技(上海)有限公司 The acquisition methods and device of the emotional state change information based on sentiment indicator
CN106559321A (en) * 2016-12-01 2017-04-05 竹间智能科技(上海)有限公司 The method and system of dynamic adjustment dialog strategy
CN106683672A (en) * 2016-12-21 2017-05-17 竹间智能科技(上海)有限公司 Intelligent dialogue method and system based on emotion and semantics
CN107025371A (en) * 2017-03-09 2017-08-08 安徽创易心理科技有限公司 A kind of mood is dynamically monitored and management method and system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
李嗣威: "基于情感能量的情绪心理模型研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
肖克聪: "具有情绪识别能力的智能聊天机器人的研究与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109684459A (en) * 2018-12-28 2019-04-26 联想(北京)有限公司 A kind of information processing method and device
CN111309864A (en) * 2020-02-11 2020-06-19 安徽理工大学 User group emotional tendency migration dynamic analysis method for microblog hot topics
CN111309864B (en) * 2020-02-11 2022-08-26 安徽理工大学 User group emotional tendency migration dynamic analysis method for microblog hot topics
CN113326359A (en) * 2020-02-28 2021-08-31 浙江大搜车软件技术有限公司 Training method and device for dialogue response and response strategy matching model
CN112380329A (en) * 2020-11-13 2021-02-19 四川大学 Training robot system and method under fine positive symptom background
CN112489654A (en) * 2020-11-17 2021-03-12 深圳康佳电子科技有限公司 Voice interaction method and device, intelligent terminal and storage medium
CN113656562A (en) * 2020-11-27 2021-11-16 话媒(广州)科技有限公司 Multi-round man-machine psychological interaction method and device
CN115658908A (en) * 2022-12-29 2023-01-31 华南理工大学 A big five personality perception method and system based on dialogue interaction process
CN117972075A (en) * 2024-03-28 2024-05-03 华南理工大学 A method for generating emotional dialogues by collaborating with mind and language agents

Also Published As

Publication number Publication date
CN108846073B (en) 2022-02-15

Similar Documents

Publication Publication Date Title
CN108846073A (en) A kind of man-machine emotion conversational system of personalization
Nie et al. Long dialogue emotion detection based on commonsense knowledge graph guidance
Mai et al. Analyzing multimodal sentiment via acoustic-and visual-LSTM with channel-aware temporal convolution network
Danescu-Niculescu-Mizil et al. No country for old members: User lifecycle and linguistic change in online communities
Han et al. A review on sentiment discovery and analysis of educational big‐data
Zhu Research on emotion recognition-based smart assistant system: Emotional intelligence and personalized services
CN107368572A (en) Multifunctional intellectual man-machine interaction method and system
KR20210070213A (en) Voice user interface
Hung et al. Towards a method for evaluating naturalness in conversational dialog systems
Saha et al. A multitask multimodal ensemble model for sentiment-and emotion-aided tweet act classification
Li et al. Interactive double states emotion cell model for textual dialogue emotion prediction
Zhang et al. Exploring implicit feedback for open domain conversation generation
CN106815321A (en) Chat method and device based on intelligent chat robots
CN115470991A (en) Prediction Method of Internet Rumor Spread Based on User's Short-term Emotion and Evolutionary Game
Chen et al. Construction of affective education in mobile learning: The study based on learner’s interest and emotion recognition
Matsuyama et al. Automatic expressive opinion sentence generation for enjoyable conversational systems
CN112949684A (en) Multimodal dialogue emotion information detection method based on reinforcement learning framework
Huang et al. Applied to mobile multimedia intelligent speech system interactive topic guiding model
Chen et al. A novel user emotional interaction design model using long and short-term memory networks and deep learning
Zhao et al. Transferring age and gender attributes for dimensional emotion prediction from big speech data using hierarchical deep learning
Wei et al. Investigating the relationship between dialogue and exchange-level impression
Moutti et al. A dataset for speech emotion recognition in greek theatrical plays
Zhou et al. Emotion inferring from large-scale internet voice data: A multimodal deep learning approach
YIN A compression-based BiLSTM for treating teenagers’ depression chatbot
Zhang Exploration of affect sensing from speech and metaphorical text

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220125

Address after: 230601 feicuihu campus of Hefei University of technology, No. 485 Danxia Road, Shushan District, Hefei City, Anhui Province

Applicant after: Hefei University of Technology

Address before: 266200 room 605, Yuyuan building, 75 Hong Kong West Road, Shinan District, Qingdao, Shandong Province

Applicant before: QINGDAO LEO ROBOT TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant