CN113158045A - Interpretable recommendation method based on graph neural network reasoning - Google Patents

Interpretable recommendation method based on graph neural network reasoning Download PDF

Info

Publication number
CN113158045A
CN113158045A CN202110426669.7A CN202110426669A CN113158045A CN 113158045 A CN113158045 A CN 113158045A CN 202110426669 A CN202110426669 A CN 202110426669A CN 113158045 A CN113158045 A CN 113158045A
Authority
CN
China
Prior art keywords
user
representation
item
user behavior
graph
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110426669.7A
Other languages
Chinese (zh)
Other versions
CN113158045B (en
Inventor
吕子钰
乔宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Advanced Technology of CAS
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Priority to CN202110426669.7A priority Critical patent/CN113158045B/en
Publication of CN113158045A publication Critical patent/CN113158045A/en
Application granted granted Critical
Publication of CN113158045B publication Critical patent/CN113158045B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明公开了一种基于图神经网络推理的可解释推荐方法。该方法包括:针对用户行为的交互矩阵,构建多关系用户行为图;对于用户行为图,利用用户行为偏好理解模型学习高阶的关联关系并传播用户行为偏好,得到用户、物品、用户‑物品间关联的向量表示;将用户行为偏好理解模型输出的用户状态表示、物品状态表示、用户‑物品关联表示输入至用户行为偏好理解模型,获得给定用户的物品推荐;将用户行为偏好理解模型输出的用户偏好状态表示、物品状态表示、用户‑物品关联表示的融合作为解释生成模型的输入,并结合文本评论集合,获得为给定用户所推荐物品的相关解释。本发明能够在提供高性能的推荐结果的同时生成高质量、易于理解的推荐解释。

Figure 202110426669

The invention discloses an interpretable recommendation method based on graph neural network reasoning. The method includes: constructing a multi-relational user behavior graph according to the interaction matrix of user behavior; for the user behavior graph, using a user behavior preference understanding model to learn high-level association relationships and disseminate user behavior preferences, and obtain user, item, user-item relationship The associated vector representation; input the user state representation, item state representation, and user-item association representation output by the user behavior preference understanding model into the user behavior preference understanding model to obtain item recommendations for a given user; The fusion of user preference state representation, item state representation, and user-item association representation is used as the input to the explanation generation model, and combined with a set of text reviews, relevant explanations of the items recommended for a given user are obtained. The present invention can generate high-quality, easy-to-understand recommendation explanations while providing high-performance recommendation results.

Figure 202110426669

Description

一种基于图神经网络推理的可解释推荐方法An Interpretable Recommendation Method Based on Graph Neural Network Reasoning

技术领域technical field

本发明涉及计算机技术领域,更具体地,涉及一种基于图神经网络推理的可解释推荐方法。The present invention relates to the field of computer technology, and more particularly, to an interpretable recommendation method based on graph neural network reasoning.

背景技术Background technique

推荐系统作为缓解信息过载问题的重要工具,在电子商务、新闻推荐、视频推荐等领域得到了广泛的应用,逐渐改变着人们的生活方式。例如,网上书店根据用户的历史行为信息推荐用户喜欢的书籍。如果能用通俗易懂的解释让用户了解到为什么会推荐这本书,可以极大地提高推荐的有效性(帮助用户快速做出决策)和推荐的说服力(提高用户购买这本书的可能性),这就是推荐系统的可解释性。可解释推荐系统在向用户推荐物品的同时呈现推荐的原因及解释,不仅能够提升推荐系统的透明度,提高用户对推荐系统的信任度和接受度,还能提升用户对推荐产品和服务的满意度。可解释推荐系统在电子商务、金融、医疗、法律等可解释性和透明度至关重要的领域具有重要的研究意义和应用价值。As an important tool to alleviate the problem of information overload, recommender systems have been widely used in e-commerce, news recommendation, video recommendation and other fields, gradually changing people's lifestyles. For example, an online bookstore recommends books that users like based on their historical behavior information. If users can understand why the book is recommended with an easy-to-understand explanation, it can greatly improve the effectiveness of the recommendation (helping users make decisions quickly) and the persuasiveness of the recommendation (improving the possibility of users buying the book) ), which is the interpretability of recommender systems. The explainable recommendation system presents the reasons and explanations of the recommendation while recommending items to users, which can not only improve the transparency of the recommendation system, improve the user's trust and acceptance of the recommendation system, but also improve the user's satisfaction with the recommended products and services. . Explainable recommender systems have important research significance and application value in fields such as e-commerce, finance, medical care, and law where interpretability and transparency are critical.

在现有技术中,可解释推荐方法主要包括两类:基于解释生成的可解释推荐方法和基于知识图谱的可解释推荐方法。近年来,随着自然语言处理技术发展,提出了很多基于解释生成的可解释推荐方法,可生成类似人类真实评论形式的文本推荐解释。例如,一项研究成果提出结合双注意力机制的卷积神经网络模型,从用户/物品评论中学习用户偏好表示和物品特征表示,采用本地和全局注意力机制选取有信息量的词辅助评分预测,增强模型的解释性。又如,一项研究成果提出了神经评分回归模型预测用户-物品评分,同时基于编码器-解码器(encoder-decoder)框架利用循环神经网络如长短期记忆网络(LongShort-Term Memory,LSTM)、门循环单元(Gate Recurrent Unit,GRU)生成文本解释。另外一项研究成果利用矩阵分解进行评分预测,同时提出基于生成对抗网络的序列到序列的解释生成模型。In the prior art, explainable recommendation methods mainly include two categories: explainable recommendation methods based on explanation generation and explainable recommendation methods based on knowledge graphs. In recent years, with the development of natural language processing technology, many interpretable recommendation methods based on explanation generation have been proposed, which can generate textual recommendation explanations in the form of real human comments. For example, a research result proposes a convolutional neural network model combined with a dual attention mechanism to learn user preference representation and item feature representation from user/item reviews, and use local and global attention mechanisms to select informative words to assist score prediction , to enhance the interpretability of the model. Another example, a research result proposes a neural scoring regression model to predict user-item ratings, and uses recurrent neural networks such as LongShort-Term Memory (LSTM), based on the encoder-decoder framework. The Gate Recurrent Unit (GRU) generates textual interpretations. Another research result uses matrix factorization for score prediction, and proposes a sequence-to-sequence explanation generative model based on generative adversarial networks.

对于基于知识图谱的可解释推荐方法,将知识图谱作为辅助信息引入到推荐系统受到了越来越多的关注,知识图谱能够引入多种类型的关联信息。研究者们利用知识图谱的推理路径增强模型的透明度和解释性,提出了一些基于知识图谱的可解释推荐方法。一项研究中提出端到端的知识图谱感知推荐方法RippleNet,从知识图谱的关联路径中自动发现传播路径,并利用信息传播机制发现用户层次化的潜在兴趣。另一项研究成果提出知识感知路径的循环神经网络,结合知识图谱实体和关系的表示生成路径表示,利用路径的序列化依赖关系推理用户偏好,应用推理路径提供推荐解释。For interpretable recommendation methods based on knowledge graphs, the introduction of knowledge graphs as auxiliary information into recommender systems has received more and more attention, and knowledge graphs can introduce various types of related information. Researchers use the reasoning path of knowledge graph to enhance the transparency and interpretability of the model, and propose some interpretable recommendation methods based on knowledge graph. In one study, an end-to-end knowledge graph-aware recommendation method, RippleNet, was proposed to automatically discover the propagation path from the associated paths of the knowledge graph, and use the information propagation mechanism to discover the hierarchical potential interests of users. Another research result proposes a recurrent neural network for knowledge-aware paths, which combines the representation of knowledge graph entities and relationships to generate path representations, uses the serialized dependencies of paths to infer user preferences, and applies reasoning paths to provide recommended explanations.

然而,尽管现有的可解释推荐方案利用文本信息提取生成推荐解释,或利用知识图谱推理路径增强模型的可解释性,取得了一定的效果,但是在用户行为分析建模和解释质量方面还存在一定的不足。此外,基于解释生成的可解释推荐方法直接采用生成模型产生推荐解释,虽然在解释形式上能够生成易于人类理解的文本解释,但是由于数据稀疏性问题,导致生成的解释质量低、可读性差。However, although existing interpretable recommendation schemes use text information extraction to generate recommended explanations, or use knowledge graph reasoning paths to enhance model interpretability, and achieve certain results, there are still problems in user behavior analysis modeling and interpretation quality. certain deficiencies. In addition, interpretable recommendation methods based on explanation generation directly use generative models to generate recommended explanations. Although they can generate text explanations that are easy for humans to understand in the form of explanations, due to the problem of data sparsity, the generated explanations are of low quality and poor readability.

此外,基于知识图谱的可解释推荐方法利用常识知识库如DBPedia、FreeBase等引入常识库的事实及关联构建知识图,基于图模型的信息传播和推理虽然能够提升推荐性能,但是引入了冗余噪声数据,难以处理无关联的实体,影响了推荐效率和结果。并且,基于知识图谱的方法需人工预先设定路径、规则等,缺少领域知识,导致推荐解释结果同质化。In addition, the interpretable recommendation method based on knowledge graph uses the facts and associations introduced from common knowledge bases such as DBPedia and FreeBase to construct knowledge graphs. Although information dissemination and reasoning based on graph models can improve the recommendation performance, it introduces redundant noise. Data, it is difficult to deal with unrelated entities, which affects the recommendation efficiency and results. Moreover, methods based on knowledge graphs need to manually pre-set paths, rules, etc., and lack domain knowledge, resulting in homogenization of recommended interpretation results.

发明内容SUMMARY OF THE INVENTION

本发明的目的是克服上述现有技术的缺陷,提供一种基于图神经网络推理的可解释推荐方法。The purpose of the present invention is to overcome the above-mentioned defects of the prior art and provide an interpretable recommendation method based on graph neural network reasoning.

本发明的技术方案是提供一种基于图神经网络推理的可解释推荐方法。该方法包括以下步骤:The technical solution of the present invention is to provide an interpretable recommendation method based on graph neural network reasoning. The method includes the following steps:

针对用户行为的交互矩阵,构建多关系用户行为图,其中图的节点集合为所有用户和所有物品,边为用户-物品交互关系;According to the interaction matrix of user behavior, construct a multi-relational user behavior graph, in which the node set of the graph is all users and all items, and the edges are user-item interaction relationships;

对于所述用户行为图,利用用户行为偏好理解模型学习高阶的关联关系并传播用户行为偏好,得到用户、物品、用户-物品间关联的向量表示;For the user behavior graph, use the user behavior preference understanding model to learn high-level associations and propagate user behavior preferences, and obtain a vector representation of user, item, and user-item associations;

将所述用户行为偏好理解模型输出的用户状态表示、物品状态表示、用户-物品关联表示输入至用户行为偏好理解模型,获得给定用户的物品推荐;Inputting the user state representation, the item state representation, and the user-item association representation output by the user behavior preference understanding model into the user behavior preference understanding model, to obtain an item recommendation for a given user;

将所述用户行为偏好理解模型输出的用户偏好状态表示、物品状态表示、用户-物品关联表示的融合作为解释生成模型的输入,并结合文本评论集合,获得为给定用户所推荐物品的相关解释。The fusion of user preference state representation, item state representation, and user-item association representation output by the user behavior preference understanding model is used as the input of the explanation generation model, and combined with the text comment set, the relevant explanation of the item recommended for a given user is obtained. .

与现有技术相比,本发明的优点在于,针对可解释性推荐问题,提出了基于图神经网络推理的可解释推荐方法,利用知识推理深入理解用户行为模式,挖掘用户行为潜在意图,从而实现对用户行为全面地、细粒度地分析和建模。并且,本发明兼顾推荐准确性和可解释性,向用户提供个性化推荐的同时生成高质量、易于用户理解的推荐解释,在提供推荐结果的同时生成推荐解释(推荐理由),提升了推荐系统的透明度以及用户对推荐系统的信任度和接受度,并提升了用户对推荐产品和服务的满意度。Compared with the prior art, the advantage of the present invention is that, for the problem of interpretable recommendation, an interpretable recommendation method based on graph neural network reasoning is proposed, and knowledge reasoning is used to deeply understand user behavior patterns and mine potential intentions of user behaviors, thereby realizing Comprehensive, fine-grained analysis and modeling of user behavior. In addition, the present invention takes into account the accuracy and interpretability of the recommendation, provides personalized recommendations to users while generating high-quality and easy-to-understand recommendation explanations, and generates recommendation explanations (recommendation reasons) while providing recommendation results, thereby improving the recommendation system. The transparency of the recommendation system and users' trust and acceptance of the recommendation system, and improve the user's satisfaction with the recommended products and services.

通过以下参照附图对本发明的示例性实施例的详细描述,本发明的其它特征及其优点将会变得清楚。Other features and advantages of the present invention will become apparent from the following detailed description of exemplary embodiments of the present invention with reference to the accompanying drawings.

附图说明Description of drawings

被结合在说明书中并构成说明书的一部分的附图示出了本发明的实施例,并且连同其说明一起用于解释本发明的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.

图1是根据本发明一个实施例的基于图神经网络推理的可解释推荐方法的流程图;1 is a flowchart of an interpretable recommendation method based on graph neural network reasoning according to an embodiment of the present invention;

图2是根据本发明一个实施例的基于图神经网络推理的可解释推荐方法的框架图。FIG. 2 is a frame diagram of an interpretable recommendation method based on graph neural network reasoning according to an embodiment of the present invention.

具体实施方式Detailed ways

现在将参照附图来详细描述本发明的各种示例性实施例。应注意到:除非另外具体说明,否则在这些实施例中阐述的部件和步骤的相对布置、数字表达式和数值不限制本发明的范围。Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the invention unless specifically stated otherwise.

以下对至少一个示例性实施例的描述实际上仅仅是说明性的,决不作为对本发明及其应用或使用的任何限制。The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

对于相关领域普通技术人员已知的技术、方法和设备可能不作详细讨论,但在适当情况下,所述技术、方法和设备应当被视为说明书的一部分。Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, such techniques, methods, and apparatus should be considered part of the specification.

在这里示出和讨论的所有例子中,任何具体值应被解释为仅仅是示例性的,而不是作为限制。因此,示例性实施例的其它例子可以具有不同的值。In all examples shown and discussed herein, any specific values should be construed as illustrative only and not limiting. Accordingly, other instances of the exemplary embodiment may have different values.

应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步讨论。It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further discussion in subsequent figures.

在以下描述的实施例中,设数据集中具有m个用户,记为u;n个物品,记为v。用户与物品的交互行为表示为<ui,vj,rij,dij>,其中rij表示用户ui对物品vj的评分,dij表示用户ui对物品vj的文本评论,用户-物品交互矩阵表示为R,文本评论集合表示为D,所有文本评论构成的词典表示为VgIn the embodiment described below, it is assumed that there are m users in the data set, denoted as u; n items, denoted as v. The interaction behavior between the user and the item is represented as < ui , vj , r ij , d ij >, where r ij represents the user ui 's rating on the item v j , and d ij represents the user ui 's textual comment on the item v j , The user-item interaction matrix is denoted R, the set of text reviews is denoted D, and the dictionary composed of all text reviews is denoted V g .

本发明的问题可定义为:给定用户集合U,物品集合V,用户-物品交互矩阵R和文本评论集合D,对于给定的用户u,推荐top-N个物品(该用户未交互过的物品),同时生成推荐物品的解释Y。The problem of the present invention can be defined as: given a set of users U, a set of items V, a user-item interaction matrix R and a set of text reviews D, for a given user u, recommend the top-N items (the ones that the user has not interacted with before). item), while generating an explanation Y for the recommended item.

简言之,本发明提供的基于图神经网络推理的可解释推荐方法,通过构建用户行为图,利用图神经网络推理进行多跳信息传播,实现全面地用户行为建模。总体上,该方法包括四部分内容,分别是用户行为图构建、基于图神经网络推理的用户行为偏好理解、用户行为交互预测、解释生成模型。In short, the interpretable recommendation method based on graph neural network reasoning provided by the present invention realizes comprehensive user behavior modeling by constructing a user behavior graph and using graph neural network reasoning to propagate multi-hop information. In general, the method includes four parts, which are user behavior graph construction, user behavior preference understanding based on graph neural network inference, user behavior interaction prediction, and explanation generation model.

具体地,结合图1和图2所示,所提供的基于图神经网络推理的可解释推荐方法包括以下步骤。Specifically, as shown in FIG. 1 and FIG. 2 , the provided interpretable recommendation method based on graph neural network reasoning includes the following steps.

步骤S110,对于用户行为的交互矩阵,构建用户行为图。Step S110, for the interaction matrix of user behavior, construct a user behavior graph.

针对用户行为交互矩阵R,构建多关系用户行为图G,其中图G的节点集合(node)为所有用户和所有物品U∪V。边为用户-物品交互关系。对于图G,利用随机变量初始节点和边的图嵌入表示。用户节点的图嵌入表示记为eu,物品节点的图嵌入表示记为ev,用户-物品交互关系边表示记为ruv。通过构建用户行为图,有利于后续的用户行为理解。For the user behavior interaction matrix R, a multi-relational user behavior graph G is constructed, where the node set (node) of the graph G is all users and all items U∪V. Edges are user-item interactions. For a graph G, the graph embedding representation of the initial nodes and edges using random variables. The graph embedding representation of user node is denoted as e u , the graph embedding representation of item node is denoted as e v , and the edge representation of user-item interaction relationship is denoted as r uv . By constructing a user behavior map, it is beneficial to the subsequent understanding of user behavior.

步骤S120,利用图神经网络推理出用户行为偏好理解。Step S120, using a graph neural network to infer user behavior preference understanding.

在一个实施例中,提出基于图注意力网络的用户行为偏好理解模型,不仅可以学习高阶的关联信息,还可以利用多跳(multi-hop)传播机制深层次地、全面地理解用户行为偏好,可得到完整的用户、物品、用户-物品间关联的向量表示。具体包括以下步骤:In one embodiment, a user behavior preference understanding model based on graph attention network is proposed, which can not only learn high-level association information, but also use a multi-hop propagation mechanism to deeply and comprehensively understand user behavior preferences. , a complete vector representation of users, items, and user-item associations can be obtained. Specifically include the following steps:

步骤S121,用户行为图注意力网络的信息传播。Step S121, information dissemination of the user behavior graph attention network.

定义信息传播机制,即节点与它邻居节点间(直接连接节点)的信息传播。对于节点ei,它的一阶邻居节点集合为

Figure BDA0003029781830000058
根据图结构的一阶关联性,从一阶邻居节点
Figure BDA0003029781830000059
传播到节点ei的信息定义为:Define the information dissemination mechanism, that is, the information dissemination between a node and its neighbor nodes (directly connected nodes). For node e i , its first-order neighbor node set is
Figure BDA0003029781830000058
According to the first-order associativity of the graph structure, from the first-order neighbor nodes
Figure BDA0003029781830000059
The information propagated to node e i is defined as:

Figure BDA0003029781830000051
Figure BDA0003029781830000051

其中,

Figure BDA0003029781830000052
测量了一对关系节点间的影响程度,δ为非线性的激活函数,可以选用ReLU或者tanh函数等,Wt,Wr,We,Wn为学习参数,b是偏置参数。
Figure BDA0003029781830000053
同时考虑了关联的节点ei、ej和它们间关联关系的影响rij,γ为正则化后的影响度量值。因此邻居节点向当前节点ei传播的信息是权重化地邻居节点表示组合
Figure BDA0003029781830000054
in,
Figure BDA0003029781830000052
The influence degree between a pair of relational nodes is measured, δ is a nonlinear activation function, ReLU or tanh function can be selected, W t , W r , We , W n are learning parameters, and b is a bias parameter.
Figure BDA0003029781830000053
At the same time, the influence r ij of the associated nodes e i , e j and the relationship between them is considered, and γ is the regularized influence metric value. Therefore, the information propagated by the neighbor nodes to the current node e i is the weighted neighbor node representation combination
Figure BDA0003029781830000054

步骤S122,用户行为图注意力网络的信息融合。Step S122, information fusion of the user behavior graph attention network.

在得到(一阶)邻接节点的信息传播后,融合节点自身的嵌入表示ei和来自邻接节点的传播信息

Figure BDA0003029781830000055
Figure BDA0003029781830000056
其中
Figure BDA0003029781830000057
是所使用的融合函数,可采用图卷积网络的非线性加权求和等融合方式。After obtaining the information propagation of the (first-order) adjacent nodes, fuse the embedded representation e i of the node itself and the propagation information from the adjacent nodes
Figure BDA0003029781830000055
for
Figure BDA0003029781830000056
in
Figure BDA0003029781830000057
is the fusion function used, and fusion methods such as nonlinear weighted summation of graph convolutional networks can be used.

步骤S123,用户行为图注意力网络的更新。Step S123, the user behavior graph attention network is updated.

在一个实施例中,图神经网络采用递归方式利用多跳(multi-hop)推理对图结构的高阶连接信息进行建模。因此后续用融合后的表示更新为节点的新的表示。例如,在第k次更新,节点

Figure BDA0003029781830000061
的表示为:
Figure BDA0003029781830000062
In one embodiment, the graph neural network employs multi-hop reasoning in a recursive manner to model the higher-order connectivity information of the graph structure. Therefore, the fused representation is subsequently updated to the new representation of the node. For example, at the kth update, the node
Figure BDA0003029781830000061
is expressed as:
Figure BDA0003029781830000062

通过上述过程,最终输出节点和边的表示,即用户状态表示eu、物品状态表示ev、用户-物品关联表示ruvThrough the above process, the representations of nodes and edges are finally output, that is, user state representation e u , item state representation ev , and user-item association representation r uv .

在此步骤S120中,针对现有方法在用户行为建模方面的不足,提出基于图神经网络推理构建用户行为偏好理解模型,以获得高质量的用户行为偏好表示。In this step S120, aiming at the deficiencies of existing methods in user behavior modeling, it is proposed to construct a user behavior preference understanding model based on graph neural network reasoning, so as to obtain a high-quality user behavior preference representation.

步骤S130,利用神经网络协同过滤框架对用户行为交互进行预测。Step S130, using a neural network collaborative filtering framework to predict user behavior interaction.

在一个实施例中,基于神经网络协同过滤框架,融合用户表示、物品表示、用户-物品关联表示,采用神经协同层实现推荐预测。In one embodiment, based on a neural network collaborative filtering framework, user representation, item representation, and user-item association representation are integrated, and a neural collaboration layer is used to implement recommendation prediction.

例如,应用三层神经协同过滤模型(Neural CF layers)实现用户-物品交互预测。模型的网络结构服从塔状结构,其中最低层最宽,每个接下来的层会有更少的神经元。模型中每一层的输出会作为下一层的输入。具体地,第一层的神经网络协同层的输入为用户状态表示eu、物品状态表示ev、用户-物品关联表示ruv的拼接,即[eu,ev,ruv]。在每一神经网络协同层,生成隐藏的向量,表示为:For example, a three-layer neural collaborative filtering model (Neural CF layers) is applied to achieve user-item interaction prediction. The network structure of the model follows a tower-like structure, where the lowest layer is the widest, and each subsequent layer has fewer neurons. The output of each layer in the model is used as the input to the next layer. Specifically, the input of the neural network collaboration layer of the first layer is the splicing of user state representation e u , item state representation ev , and user-item association representation r uv , namely [e u , e v , r uv ]. At each neural network synergy layer, a hidden vector is generated, which is expressed as:

Figure BDA0003029781830000063
Figure BDA0003029781830000063

其中Wl和bl为第l层的权重矩阵和偏置矩阵,

Figure BDA0003029781830000064
为使用的激活函数,可使用修正线性单元ReLU。在最后一层,隐藏向量hl被映射为预测评分
Figure BDA0003029781830000065
表示为:where W l and b l are the weight matrix and bias matrix of the lth layer,
Figure BDA0003029781830000064
For the activation function used, a rectified linear unit ReLU can be used. In the last layer, the hidden vector h l is mapped to the predicted score
Figure BDA0003029781830000065
Expressed as:

Figure BDA0003029781830000066
Figure BDA0003029781830000066

其中W为权重矩阵,σ为sigmoid函数。对于用户u,根据预测评分排序

Figure BDA0003029781830000067
推荐top-N个物品,即前N个推荐物品,N是预先设定的整数。where W is the weight matrix and σ is the sigmoid function. For user u, sort by predicted score
Figure BDA0003029781830000067
Recommend top-N items, that is, the top N recommended items, where N is a preset integer.

步骤S140,利用解释生成模型,获得针对推荐物品的直观文本解释。Step S140, using the explanation generation model to obtain an intuitive text explanation for the recommended item.

在一个实施例中,设计基于编码器-解码器框架的解释生成器,引入拷贝机制从用户/物品源文本评论中抽取相关信息,结合生成模式和拷贝模式生成高质量、易于理解的推荐解释。In one embodiment, an explanation generator based on an encoder-decoder framework is designed, a copy mechanism is introduced to extract relevant information from user/item source text reviews, and a high-quality, easy-to-understand recommendation explanation is generated by combining the generation mode and the copy mode.

具体地,应用循环神经网络GRU作为解释生成器,并引入拷贝机制从用户原有评论中抽取信息,结合两种模式(生成模式和拷贝模式)生成直观文本解释Y=[y1,y2,..yT](词序列),易于用户阅读理解。Specifically, the recurrent neural network GRU is used as the explanation generator, and the copy mechanism is introduced to extract information from the original comments of users, and the two modes (generating mode and copy mode) are combined to generate an intuitive text explanation Y=[y 1 , y 2 , ..y T ] (word sequence), easy for users to read and understand.

对于生成模式,利用GRU作为解码器,其中解码器的初始状态

Figure BDA0003029781830000071
为用户偏好状态表示eu、物品状态表示ev、用户-物品关联表示ruv的融合,用户ui推荐物品vj时生成的解释词yijt为wt的概率为Pgen(yijt=wt),表示为:For generative mode, GRU is utilized as the decoder, where the initial state of the decoder
Figure BDA0003029781830000071
is the fusion of user preference state representation e u , item state representation ev , and user-item association representation r uv , the probability that the interpretation word y ijt generated when user ui recommends item v j is w t is P gen (y ijt = w t ), expressed as:

Figure BDA0003029781830000072
Figure BDA0003029781830000072

Figure BDA0003029781830000073
Figure BDA0003029781830000073

其中,

Figure BDA0003029781830000074
为在t时刻GRU的隐藏状态,wt是词的向量表示,wt来自整个词典Vg。in,
Figure BDA0003029781830000074
is the hidden state of the GRU at time t, wt is the vector representation of the word, and wt comes from the entire dictionary V g .

对于拷贝模式,是计算出现在原评论中的词的概率,在向用户ui推荐物品vj时解释词的拷贝源为ui的用户评论文档和vj的物品评论文档的词的集合

Figure BDA0003029781830000075
在拷贝模式下,解释词yijt为wt的概率表示为Pcopy(yijt=wt):For the copy mode, it is to calculate the probability of the word appearing in the original comment, and when recommending the item v j to the user ui , the copy source of the word is the set of words of the user comment document of ui and the item comment document of v j .
Figure BDA0003029781830000075
In copy mode, the probability that the interpreter y ijt is wt is expressed as P copy (y ijt = wt ):

Figure BDA0003029781830000076
Figure BDA0003029781830000076

优选地,结合生成模式和拷贝模式,构成解释生成模型,最终生成目标词的概率为P(yijt=wt),参照公式(6),生成向用户ui推荐物品vj的推荐解释Yij=[yij1,yij2,..yijT],T为解释长度。Preferably, an explanation generation model is formed by combining the generation mode and the copy mode, and the probability of finally generating the target word is P(y ijt =wt). Referring to formula (6), a recommendation explanation Yi ij for recommending the item v j to the user u i is generated. =[y ij1 , y ij2 , .. y ijT ], T is the interpretation length.

P(yijt=wt)=Pgen(yijt=wt)+Pcopy(yijt=wt) (6)P(y ijt =w t )=P gen (y ijt =w t )+P copy (y ijt =w t ) (6)

通过设计结合生成模式和拷贝机制的解释生成模型,相对于现有的基于解释生成的可解释推荐方法能够获得高质量的、易于用户理解的推荐解释,解决了目前解释质量低、可读性差的问题。By designing an explanation generation model that combines the generation mode and the copy mechanism, compared with the existing explainable recommendation methods based on explanation generation, high-quality and easy-to-understand recommendation explanations can be obtained, which solves the problems of low explanation quality and poor readability. question.

需说明的是,本发明提出的方法是端到端的方法,因此特征表示学习、推荐预测和解释生成模型采用联合学习的方式训练和优化,这种端到端的可解释推荐框架,降低了训练难度,加速了训练过程,同时减少了内存需求,It should be noted that the method proposed by the present invention is an end-to-end method, so the feature representation learning, recommendation prediction and explanation generation model are trained and optimized by means of joint learning. This end-to-end interpretable recommendation framework reduces the difficulty of training. , speeding up the training process while reducing memory requirements,

为了验证本发明的有效性和先进性,利用提出的基于图神经网络推理的可解释方法,对Amazon-Electronics和Amazon-Music Instrument这两个数据集进行了大量实验。实验结果表明,本发明始终优于可解释性推荐当前最好方法,展现出巨大优越性,具有十分广阔的应用前景。In order to verify the effectiveness and advancement of the present invention, a large number of experiments are carried out on two datasets, Amazon-Electronics and Amazon-Music Instrument, using the proposed interpretable method based on graph neural network inference. The experimental results show that the present invention is always better than the current best method for interpretable recommendation, shows great advantages, and has a very broad application prospect.

相对于现有技术,本发明至少具有以下优势:Compared with the prior art, the present invention has at least the following advantages:

(1)针对可解释性推荐任务,所提出的基于图神经网络推理的可解释推荐方法,在提供高性能的推荐结果的同时生成高质量、易于人类理解的推荐解释,实现兼顾推荐有效性和可解释性的推荐框架。(1) For the interpretable recommendation task, the proposed interpretable recommendation method based on graph neural network reasoning provides high-performance recommendation results while generating high-quality, easy-to-understand recommendation explanations to achieve both recommendation effectiveness and A recommended framework for interpretability.

(2)基于图神经网络推理提出了深层次的用户行为理解模型,利用用户行为中的高阶关联信息传播执行深层次的用户行为推理,实现全面的、深层次的用户行为建模及理解,在用户、物品、用户-物品三方面获得高质量的表征,有效地提高推荐性能。(2) Based on graph neural network reasoning, a deep-level user behavior understanding model is proposed, which uses the high-order correlation information propagation in user behavior to perform deep-level user behavior reasoning, and realizes comprehensive and deep-level user behavior modeling and understanding. Obtaining high-quality representations in three aspects: user, item, and user-item can effectively improve recommendation performance.

(3)在解释生成模型中,引入了拷贝机制,提出了生成模式和拷贝模式相结合的解释生成模型,有利于生成高质量、易于人类理解的推荐解释。(3) In the explanation generation model, a copy mechanism is introduced, and an explanation generation model combining the generation mode and the copy mode is proposed, which is conducive to the generation of high-quality and easy-to-understand recommended explanations.

综上所述,本发明创新地提出一种基于图神经网络推理的用户行为理解模型,通过构建用户行为图,基于图神经网络推理进行多跳信息传播,学习深层次、高质量的用户、物品、用户-物品关联表示,实现全面的、细粒度的用户行为建模,解决了目前用户行为分析建模的不足的问题。To sum up, the present invention innovatively proposes a user behavior understanding model based on graph neural network reasoning. , User-item association representation, realizes comprehensive and fine-grained user behavior modeling, and solves the problem of insufficiency of current user behavior analysis and modeling.

应理解的是,在不违背本发明精神和范围的前提下,本领域技术人员可对上述实施例进行适当的改变或变型,例如,采用LSTM替代GRU网络,或者采用其他的激活函数用于非线性处理等。It should be understood that, without departing from the spirit and scope of the present invention, those skilled in the art can make appropriate changes or modifications to the above embodiments, for example, using LSTM to replace the GRU network, or using other activation functions for non- Linear processing, etc.

本发明可以是系统、方法和/或计算机程序产品。计算机程序产品可以包括计算机可读存储介质,其上载有用于使处理器实现本发明的各个方面的计算机可读程序指令。The present invention may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present invention.

计算机可读存储介质可以是可以保持和存储由指令执行设备使用的指令的有形设备。计算机可读存储介质例如可以是――但不限于――电存储设备、磁存储设备、光存储设备、电磁存储设备、半导体存储设备或者上述的任意合适的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括:便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、静态随机存取存储器(SRAM)、便携式压缩盘只读存储器(CD-ROM)、数字多功能盘(DVD)、记忆棒、软盘、机械编码设备、例如其上存储有指令的打孔卡或凹槽内凸起结构、以及上述的任意合适的组合。这里所使用的计算机可读存储介质不被解释为瞬时信号本身,诸如无线电波或者其他自由传播的电磁波、通过波导或其他传输媒介传播的电磁波(例如,通过光纤电缆的光脉冲)、或者通过电线传输的电信号。A computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above. Computer-readable storage media, as used herein, are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.

这里所描述的计算机可读程序指令可以从计算机可读存储介质下载到各个计算/处理设备,或者通过网络、例如因特网、局域网、广域网和/或无线网下载到外部计算机或外部存储设备。网络可以包括铜传输电缆、光纤传输、无线传输、路由器、防火墙、交换机、网关计算机和/或边缘服务器。每个计算/处理设备中的网络适配卡或者网络接口从网络接收计算机可读程序指令,并转发该计算机可读程序指令,以供存储在各个计算/处理设备中的计算机可读存储介质中。The computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

用于执行本发明操作的计算机程序指令可以是汇编指令、指令集架构(ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、或者以一种或多种编程语言的任意组合编写的源代码或目标代码,所述编程语言包括面向对象的编程语言—诸如Smalltalk、C++、Python等,以及常规的过程式编程语言—诸如“C”语言或类似的编程语言。计算机可读程序指令可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络—包括局域网(LAN)或广域网(WAN)—连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。在一些实施例中,通过利用计算机可读程序指令的状态信息来个性化定制电子电路,例如可编程逻辑电路、现场可编程门阵列(FPGA)或可编程逻辑阵列(PLA),该电子电路可以执行计算机可读程序指令,从而实现本发明的各个方面。The computer program instructions for carrying out the operations of the present invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages. Source or object code written in any combination, including object-oriented programming languages, such as Smalltalk, C++, Python, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect). In some embodiments, custom electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), can be personalized by utilizing state information of computer readable program instructions. Computer readable program instructions are executed to implement various aspects of the present invention.

这里参照根据本发明实施例的方法、装置(系统)和计算机程序产品的流程图和/或框图描述了本发明的各个方面。应当理解,流程图和/或框图的每个方框以及流程图和/或框图中各方框的组合,都可以由计算机可读程序指令实现。Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

这些计算机可读程序指令可以提供给通用计算机、专用计算机或其它可编程数据处理装置的处理器,从而生产出一种机器,使得这些指令在通过计算机或其它可编程数据处理装置的处理器执行时,产生了实现流程图和/或框图中的一个或多个方框中规定的功能/动作的装置。也可以把这些计算机可读程序指令存储在计算机可读存储介质中,这些指令使得计算机、可编程数据处理装置和/或其他设备以特定方式工作,从而,存储有指令的计算机可读介质则包括一个制造品,其包括实现流程图和/或框图中的一个或多个方框中规定的功能/动作的各个方面的指令。These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams. These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.

也可以把计算机可读程序指令加载到计算机、其它可编程数据处理装置、或其它设备上,使得在计算机、其它可编程数据处理装置或其它设备上执行一系列操作步骤,以产生计算机实现的过程,从而使得在计算机、其它可编程数据处理装置、或其它设备上执行的指令实现流程图和/或框图中的一个或多个方框中规定的功能/动作。Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.

附图中的流程图和框图显示了根据本发明的多个实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或指令的一部分,所述模块、程序段或指令的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。对于本领域技术人员来说公知的是,通过硬件方式实现、通过软件方式实现以及通过软件和硬件结合的方式实现都是等价的。The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation in hardware, implementation in software, and implementation in a combination of software and hardware are all equivalent.

以上已经描述了本发明的各实施例,上述说明是示例性的,并非穷尽性的,并且也不限于所披露的各实施例。在不偏离所说明的各实施例的范围和精神的情况下,对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择,旨在最好地解释各实施例的原理、实际应用或对市场中的技术改进,或者使本技术领域的其它普通技术人员能理解本文披露的各实施例。本发明的范围由所附权利要求来限定。Various embodiments of the present invention have been described above, and the foregoing descriptions are exemplary, not exhaustive, and not limiting of the disclosed embodiments. Numerous modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.

Claims (10)

1. An interpretable recommendation method based on graph neural network reasoning comprises the following steps:
step S1: aiming at an interaction matrix of user behaviors, constructing a multi-relationship user behavior graph, wherein a node set of the graph comprises all users and all articles, and the edges are user-article interaction relationships;
step S2: for the user behavior diagram, learning a high-order incidence relation by using a user behavior preference understanding model and transmitting user behavior preference to obtain vector representation of user, article and user-article correlation;
step S3: inputting the user state representation, the article state representation and the user-article association representation output by the user behavior preference understanding model into the user behavior preference understanding model to obtain article recommendation of a given user;
step S4: and taking the fusion of the user preference state representation, the item state representation and the user-item association representation output by the user behavior preference understanding model as the input of an interpretation generation model, and combining a text comment set to obtain the relevant interpretation of the item recommended for the given user.
2. The method according to claim 1, wherein step S2 includes:
for the user behavior graph G, according to the first-order relevance of the graph structure, the first-order neighbor nodes
Figure FDA0003029781820000011
Propagate to node eiThe information of (2) is defined as:
Figure FDA0003029781820000012
Figure FDA0003029781820000013
Figure FDA0003029781820000014
wherein,
Figure FDA0003029781820000015
is a pair of relational nodes ejAnd eiDegree of influence between, delta being a non-linear activation function, Wt,Wr,We,WnIs the correlation term weight, b is the offset, rijExpressing the influence of the incidence relation between the nodes, wherein gamma is the influence metric value after regularization, and the neighbor node points to the current node eiThe propagated information is a weighted combination of the representations of the neighboring nodes
Figure FDA0003029781820000016
Node eiIs a first-order neighbor node set
Figure FDA0003029781820000017
After information propagation of the first-order adjacent nodes is obtained, the embedded expression e of the fusion node is selfiAnd propagation information from neighboring nodes
Figure FDA0003029781820000018
Is shown as
Figure FDA0003029781820000019
Wherein
Figure FDA00030297818200000110
As a fusion function used;
modeling the high-order connection information of the graph structure by using multi-hop inference in a recursive mode, and finally outputting the representation of nodes and edges, wherein the representation is marked as a user state euArticle state evUser-item association representation ruv
3. The method according to claim 1, wherein step S3 includes:
the user behavior preference understanding model adopts a neural collaborative filtering model with a tower-shaped structure, the input of a first layer of neural network collaborative layer is the splicing of user state representation, article state representation and user-article association representation, and for each neural network collaborative layer, the generation of a hidden vector is shown as follows:
Figure FDA0003029781820000021
wherein, WlAnd blThe weight matrix and the bias matrix for the l-th layer,
Figure FDA0003029781820000022
is an activation function, hl-1Is the vector of the l-1 layer output;
at the last layer of the neural collaborative filtering model, the vector h is hiddenlPredicted scores mapped to recommended items
Figure FDA0003029781820000023
Scoring based on prediction for a given user
Figure FDA0003029781820000024
The items are sorted and recommended.
4. The method of claim 1, wherein in step S4, the given user u is generated by extracting information from the user' S original comments in conjunction with the copy modeiRecommending items vjRecommended explanation of (Y)ij=[yij1,yij2,..yijT]Expressed as:
P(yijt=wt)=Pgen(yijt=wt)+Pcopy(yijt=wt)
wherein T is the interpretation length, Pgen(yijt=wt) Is a user u obtained by using a generation patterniRecommending items vjInterpreter y generated at the timeijtIs wtProbability of (P)copy(yijt=wt) Is a user u obtained by a copy mechanismiRecommendation materialArticle vjInterpreter y generated at the timeijtIs wtThe probability of (c).
5. Method according to claim 4, characterized in that for the generation mode a recurrent neural network GRU is used as decoder, the initial state of which is the initial state
Figure FDA0003029781820000025
Representing e for user preference statusuArticle status representation evUser-item association representation ruvFusion of (1), user uiRecommending items vjInterpreter y generated at the timeijtIs wtThe probability of (d) is expressed as:
Figure FDA0003029781820000026
Figure FDA0003029781820000027
wherein,
Figure FDA0003029781820000028
is a hidden state of GRU at time t, wtIs a vector representation of a word, wtFrom a dictionary Vg
6. The method of claim 5, wherein in copy mode, user uiRecommending items vjInterpreter y generated at the timeijtIs wtThe probability of (d) is expressed as:
Figure FDA0003029781820000031
wherein, VcIs uiV andjof item review documents。
7. The method of claim 3, wherein the hidden vector h is hidden at the last layer of the neural collaborative filtering modellPredicted scores mapped to recommended items
Figure FDA0003029781820000032
Expressed as:
Figure FDA0003029781820000033
wherein W is a weight matrix, sigma is a sigmoid function, and hlIs the concealment vector and l is the layer index.
8. The method of claim 2, wherein the fusion function
Figure FDA0003029781820000034
A non-linear weighted sum.
9. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 8.
10. A computer device comprising a memory and a processor, on which memory a computer program is stored which is executable on the processor, characterized in that the steps of the method of any of claims 1 to 8 are implemented when the processor executes the program.
CN202110426669.7A 2021-04-20 2021-04-20 Interpretable recommendation method based on graph neural network reasoning Active CN113158045B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110426669.7A CN113158045B (en) 2021-04-20 2021-04-20 Interpretable recommendation method based on graph neural network reasoning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110426669.7A CN113158045B (en) 2021-04-20 2021-04-20 Interpretable recommendation method based on graph neural network reasoning

Publications (2)

Publication Number Publication Date
CN113158045A true CN113158045A (en) 2021-07-23
CN113158045B CN113158045B (en) 2022-11-01

Family

ID=76867723

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110426669.7A Active CN113158045B (en) 2021-04-20 2021-04-20 Interpretable recommendation method based on graph neural network reasoning

Country Status (1)

Country Link
CN (1) CN113158045B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113987261A (en) * 2021-11-08 2022-01-28 烟台大学 Video recommendation method and system based on dynamic trust perception
CN114840763A (en) * 2022-05-23 2022-08-02 山东大学 Conversational recommendation method and system based on user preference
CN117216408A (en) * 2023-10-25 2023-12-12 浙江工业大学 Visual recommendation analysis method and device based on interpretable graph neural network

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109754317A (en) * 2019-01-10 2019-05-14 山东大学 Interpretable clothing recommendation method, system, device and medium incorporating reviews
CN109933721A (en) * 2019-02-01 2019-06-25 中森云链(成都)科技有限责任公司 A kind of interpretable recommended method merging user concealed article preference and implicit trust
CN110060132A (en) * 2019-04-24 2019-07-26 吉林大学 Interpretable Method of Commodity Recommendation based on fine-grained data
WO2019183191A1 (en) * 2018-03-22 2019-09-26 Michael Bronstein Method of news evaluation in social media networks
CN112084407A (en) * 2020-09-08 2020-12-15 辽宁工程技术大学 Collaborative filtering recommendation method fusing graph neural network and attention mechanism
CN112650929A (en) * 2020-12-31 2021-04-13 安徽农业大学 Graph neural network recommendation method integrating comment information

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019183191A1 (en) * 2018-03-22 2019-09-26 Michael Bronstein Method of news evaluation in social media networks
CN109754317A (en) * 2019-01-10 2019-05-14 山东大学 Interpretable clothing recommendation method, system, device and medium incorporating reviews
CN109933721A (en) * 2019-02-01 2019-06-25 中森云链(成都)科技有限责任公司 A kind of interpretable recommended method merging user concealed article preference and implicit trust
CN110060132A (en) * 2019-04-24 2019-07-26 吉林大学 Interpretable Method of Commodity Recommendation based on fine-grained data
CN112084407A (en) * 2020-09-08 2020-12-15 辽宁工程技术大学 Collaborative filtering recommendation method fusing graph neural network and attention mechanism
CN112650929A (en) * 2020-12-31 2021-04-13 安徽农业大学 Graph neural network recommendation method integrating comment information

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王子冬: ""基于评论文本的推荐算法研究"", 《中国优秀硕士学位论文全文数据库信息科技辑》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113987261A (en) * 2021-11-08 2022-01-28 烟台大学 Video recommendation method and system based on dynamic trust perception
CN114840763A (en) * 2022-05-23 2022-08-02 山东大学 Conversational recommendation method and system based on user preference
CN114840763B (en) * 2022-05-23 2024-12-24 山东大学 Conversational recommendation method and system based on user preference
CN117216408A (en) * 2023-10-25 2023-12-12 浙江工业大学 Visual recommendation analysis method and device based on interpretable graph neural network
CN117216408B (en) * 2023-10-25 2025-03-04 浙江工业大学 Visual recommendation analysis method and device based on interpretable graph neural network

Also Published As

Publication number Publication date
CN113158045B (en) 2022-11-01

Similar Documents

Publication Publication Date Title
WO2022222037A1 (en) Interpretable recommendation method based on graph neural network inference
Schwarzenberg et al. Layerwise relevance visualization in convolutional text graph classifiers
CN113505244B (en) Knowledge graph construction method, system, equipment and medium based on deep learning
Kumar et al. Multi-input integrative learning using deep neural networks and transfer learning for cyberbullying detection in real-time code-mix data
CN113158045B (en) Interpretable recommendation method based on graph neural network reasoning
JP2023539532A (en) Text classification model training method, text classification method, device, equipment, storage medium and computer program
CN108734276A (en) A kind of learning by imitation dialogue generation method generating network based on confrontation
CN111581966A (en) Aspect-level sentiment classification method and device fused with contextual features
Wang et al. Text FCG: Fusing contextual information via graph learning for text classification
Hassija et al. Unleashing the potential of conversational AI: Amplifying chat-GPT’s capabilities and tackling technical hurdles
CN111598118B (en) Method and system for realizing visual question answering task
CN111931054A (en) A sequence recommendation method and system based on improved residual structure
CN115526322A (en) Sequence generating type knowledge inference method and system based on precision transform
CN116049343A (en) Method and system for document-level threat intelligence relationship extraction based on feature enhancement
Xu et al. Adversarial attacks on text classification models using layer‐wise relevance propagation
Xu et al. Netrl: Task-aware network denoising via deep reinforcement learning
CN111967941A (en) Method for constructing sequence recommendation model and sequence recommendation method
Gao et al. Exploring bridge maintenance knowledge graph by leveraging GrapshSAGE and text encoding
Li et al. Adaptive heterogeneous graph reasoning for relational understanding in interconnected systems
CN117033635A (en) Aspect-level emotion analysis method based on multi-level knowledge enhancement
CN116596143A (en) Social media behavior prediction method, device, computing device and storage medium
CN116257632A (en) Unknown target position detection method and device based on graph comparison learning
CN115292483A (en) Short text classification method based on uncertainty perception heterogeneous graph attention network
Pang Multi-round dialogue state tracking by object-entity alignment in visual dialog
Sun et al. Aspect Term Extraction via Dynamic Attention and a Densely Connected Graph Convolutional Network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant