CN113127604B - Method and system for fine-grained item recommendation based on review text - Google Patents
Method and system for fine-grained item recommendation based on review text Download PDFInfo
- Publication number
- CN113127604B CN113127604B CN202110505981.5A CN202110505981A CN113127604B CN 113127604 B CN113127604 B CN 113127604B CN 202110505981 A CN202110505981 A CN 202110505981A CN 113127604 B CN113127604 B CN 113127604B
- Authority
- CN
- China
- Prior art keywords
- user
- item
- comment text
- granularity
- comment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012552 review Methods 0.000 title claims abstract description 67
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000003993 interaction Effects 0.000 claims abstract description 40
- 239000011159 matrix material Substances 0.000 claims abstract description 35
- 235000019580 granularity Nutrition 0.000 claims abstract description 32
- 230000002452 interceptive effect Effects 0.000 claims abstract description 24
- 238000013528 artificial neural network Methods 0.000 claims abstract description 14
- 239000013598 vector Substances 0.000 claims description 19
- 238000013527 convolutional neural network Methods 0.000 claims description 12
- 230000010339 dilation Effects 0.000 claims description 9
- 238000000605 extraction Methods 0.000 claims description 5
- 230000006870 function Effects 0.000 claims description 5
- 230000004913 activation Effects 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims description 4
- 238000000354 decomposition reaction Methods 0.000 claims description 4
- 230000008034 disappearance Effects 0.000 claims 1
- 238000004880 explosion Methods 0.000 claims 1
- 230000008569 process Effects 0.000 description 5
- 238000011176 pooling Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000013135 deep learning Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 238000003306 harvesting Methods 0.000 description 1
- 238000012417 linear regression Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/3331—Query processing
- G06F16/334—Query execution
- G06F16/3344—Query execution using natural language analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- Biophysics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Databases & Information Systems (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
本公开提供了一种基于评论文本的细粒度物品推荐方法及系统,包括:分别获取用户评论文本集合和物品评论文本集合;利用细粒度特征交互网络计算用户和物品间的多粒度关联矩阵,获得3D交互图像;将所述3D交互图像输入到全连接神经网络和传统因子分解机中实现用户‑物品的评分预测,根据评分结果实现物品的推荐;所述方案以多层次扩张卷积结构来编码用户和物品评论,避免了评论中细粒度信息的丢失,在多个粒度下构建用户和物品评论的特征交互,并使用3D卷积来融合处理多粒度信息,有效的突出了评论中多个粒度下的相关信息,有效提高了物品推荐的合理性和准确性。
The present disclosure provides a method and system for fine-grained item recommendation based on comment text, including: obtaining a user comment text set and an item comment text set respectively; using a fine-grained feature interaction network to calculate a multi-granularity correlation matrix between users and items to obtain 3D interactive image; inputting the 3D interactive image into a fully connected neural network and a traditional factorization machine to achieve user-item scoring prediction, and implementing item recommendation according to the scoring result; the scheme is encoded with a multi-level dilated convolution structure User and item reviews avoid the loss of fine-grained information in reviews, construct feature interactions between user and item reviews at multiple granularities, and use 3D convolution to fuse multi-granularity information, effectively highlighting multiple granularities in reviews The relevant information below can effectively improve the rationality and accuracy of item recommendation.
Description
技术领域technical field
本公开属于物品推荐技术领域,尤其涉及一种基于评论文本的细粒度物品推荐方法及系统。The present disclosure belongs to the technical field of item recommendation, and in particular, relates to a method and system for fine-grained item recommendation based on review text.
背景技术Background technique
本部分的陈述仅仅是提供了与本公开相关的背景技术信息,不必然构成在先技术。The statements in this section merely provide background information related to the present disclosure and do not necessarily constitute prior art.
在许多工作中,利用评论文本来提升推荐系统的效果被证明是有效的。基于评论的推荐系统不仅可以缓解冷启动问题,还可以获得更细粒度的用户和物品表示。较早的工作主要集中于主题建模和语言建模方法。近年来,研究者使用深度学习方法,取得了不错的成果。ConvMF使用卷积神经网络(CNN)作为自动特征提取器,将用户(项目)编码为低维向量表示。然后利用概率矩阵分解(PMF)结合起来进行评分预测。DeepCoNN(Deep CooperativeNeural Networks)使用了两个并行的卷积架构从用户和物品的评论中推断潜在的特征表示。用户和物品的特征表示被连接起来,并用作因子分解机(FM)的输入,用于评分预测。由于不同的词对建模的重要性是不同的,所以D-Attn引入了词级别的的注意力机制,为不同的词赋予了不同的权重。DAML关注用户和物品评论之间的局部信息以及两者的交互。DAML将评分特征和评论特征整合到统一的框架中,利用神经因子分解机实现特征的高阶非线性交互,完成最终的评分预测。增强了模型的可解释性。MPCN从用户和项目的评论中提取重要的评论,然后逐字匹配它们。它不仅可以利用信息最丰富的评论进行预测,还可以进行更深层次的文字互动。In many works, leveraging review texts to improve the performance of recommender systems has been shown to be effective. Review-based recommender systems can not only alleviate the cold-start problem, but also obtain more fine-grained representations of users and items. Earlier work mainly focused on topic modeling and language modeling methods. In recent years, researchers have used deep learning methods and achieved good results. ConvMF uses Convolutional Neural Networks (CNN) as automatic feature extractors to encode users (items) into low-dimensional vector representations. These are then combined using probabilistic matrix factorization (PMF) for scoring prediction. DeepCoNN (Deep Cooperative Neural Networks) uses two parallel convolutional architectures to infer latent feature representations from user and item reviews. Feature representations of users and items are concatenated and used as input to a factorization machine (FM) for rating prediction. Since the importance of different words for modeling is different, D-Attn introduces a word-level attention mechanism and assigns different weights to different words. DAML focuses on local information between users and item reviews and the interaction between the two. DAML integrates rating features and review features into a unified framework, and uses neural factorization machines to achieve high-order nonlinear interactions of features to complete the final rating prediction. Enhanced model interpretability. MPCN extracts important reviews from user and item reviews and then matches them verbatim. It not only makes predictions with the most informative reviews, but also enables deeper text interactions.
随着深度学习在自然语言处理等领域取得的巨大成功,许多基于该技术的推荐模型极大的提高了评分预测的性能。在这些工作中,卷积神经网络架构分别从用户和物品对应的评论中提取潜在特征。通过使用一个密集的词嵌入矩阵来表示评论,随后应用一个固定大小的滑动窗口来捕获上下文信息。基于卷积神经网络的技术更好的促进了对评论中语义信息的理解,导致对现有基于词袋模式的评分预测方法的显著改进。然而,一个饱受诟病的缺点是人们难以有效的理解神经网络所提取的特征,这限制了推荐系统的可解释性。With the great success of deep learning in fields such as natural language processing, many recommendation models based on this technology have greatly improved the performance of rating prediction. In these works, convolutional neural network architectures extract latent features from user- and item-corresponding reviews, respectively. By using a dense word embedding matrix to represent reviews, a fixed-size sliding window is subsequently applied to capture contextual information. Convolutional neural network-based techniques better facilitate the understanding of semantic information in reviews, leading to significant improvements over existing bag-of-words model-based rating prediction methods. However, a much criticized shortcoming is that it is difficult for people to effectively understand the features extracted by neural networks, which limits the interpretability of recommender systems.
基于评论的推荐系统的关键在于对评论文本中不同粒度信息的捕获。通常而言,同一用户对不同物品往往具有不同的偏好,这整体地反映在他所撰写的评论。同时,评论中的重要语义特征被隐含在不同粒度的文本片段中。图中的举例说明了这一问题。不同粒度的文本(如:单词、短语和句子)可以揭示用户对不同物品的偏好。例如单词:“best”、“great”、“disappointing”;短语:“quality great battery life”、“screen looksamazing”和句子:“I usually go with product red but it looked a bit orange thisyear.”。The key to review-based recommender systems lies in the capture of different granularity information in review texts. Generally speaking, the same user tends to have different preferences for different items, which is reflected in the reviews he writes as a whole. At the same time, important semantic features in reviews are implied in text fragments of different granularities. The example in the figure illustrates this problem. Different granularity of text (such as words, phrases, and sentences) can reveal user preferences for different items. Examples include words: "best", "great", "disappointing"; phrases: "quality great battery life", "screen looks amazing" and sentences: "I usually go with product red but it looked a bit orange this year.".
然而,发明人发现,现有的工作通常通过整合用户和物品的评论文本来为每个用户或物品学习单一的特征向量,然后通过因子分解等手段来实现评分预测。这些方法在捕捉细粒度的用户偏好和物品属性方面存在着局限性,因为它们仅仅是为用户物品分配一个单一的特征向量,导致评论中多个粒度下的信息没有被明显的捕获。However, the inventors found that existing works usually learn a single feature vector for each user or item by integrating the review texts of users and items, and then achieve rating prediction by means such as factorization. These methods have limitations in capturing fine-grained user preferences and item attributes, as they only assign a single feature vector to user items, resulting in information at multiple granularities in reviews not being clearly captured.
发明内容SUMMARY OF THE INVENTION
本公开为了解决上述问题,提供了一种基于评论文本的细粒度物品推荐方法及系统,所述方案提供了一种细粒度特征交互网络,以多层次扩张卷积结构来编码用户和物品评论,避免了评论中细粒度信息的丢失,在多个粒度下构建用户和物品评论的特征交互,并使用3D卷积来融合处理多粒度信息,有效的突出了评论中多个粒度下的相关信息,有效提高了物品推荐的合理性和准确性。In order to solve the above problems, the present disclosure provides a method and system for fine-grained item recommendation based on review text. The solution provides a fine-grained feature interaction network that encodes user and item reviews with a multi-level dilated convolution structure. It avoids the loss of fine-grained information in reviews, constructs feature interactions between user and item reviews at multiple granularities, and uses 3D convolution to process multi-granularity information, effectively highlighting relevant information at multiple granularities in reviews. Effectively improve the rationality and accuracy of item recommendation.
根据本公开实施例的第一个方面,提供了一种基于评论文本的细粒度物品推荐方法,包括:According to a first aspect of the embodiments of the present disclosure, a fine-grained item recommendation method based on review text is provided, including:
分别获取用户评论文本集合和物品评论文本集合;Obtain the user comment text collection and the item review text collection respectively;
利用细粒度特征交互网络计算用户和物品间的多粒度关联矩阵,获得3D交互图像;Use the fine-grained feature interaction network to calculate the multi-granularity correlation matrix between users and items to obtain 3D interactive images;
将所述3D交互图像输入到全连接神经网络和传统因子分解机中实现用户-物品的评分预测,根据评分结果实现物品的推荐;Inputting the 3D interactive image into a fully connected neural network and a traditional factorization machine to achieve user-item rating prediction, and implement item recommendation according to the rating result;
其中,所述细粒度特征交互网络具体包括:利用层次扩张卷积模型分别对用户评论文本集合和物品评论文本集合中的每条评论文本进行多粒度语义特征提取,获得用户和物品的多粒度评论表示集合;计算用户和物品之间的多粒度关联矩阵,并通过3D卷积神经网络将所述关联矩阵融合成3D交互图像。The fine-grained feature interaction network specifically includes: using a hierarchical dilated convolution model to extract multi-granularity semantic features for each comment text in the user comment text set and the item comment text set, respectively, to obtain multi-granularity comments on users and items. Represents a collection; computes a multi-granularity correlation matrix between users and items, and fuses the correlation matrix into a 3D interactive image through a 3D convolutional neural network.
进一步的,所述利用层次扩张卷积模型不同于标准卷积在每一步对输入的一个连续子序列进行卷积,不同层次的扩张卷积通过每次跳过δ个输入元素,所述扩张操作具体描述为:Further, the use of the hierarchical dilated convolution model is different from the standard convolution to perform convolution on a continuous subsequence of the input at each step, and the dilated convolution of different levels skips δ input elements each time. The specific description is:
其中,是向量拼接,b是偏置项,ReLU是非线性激活函数,xt表示上下文中心单词,W为大小为2w+1的卷积核,w为用于调整卷积核大小的参数,δ为扩张率,其为不小于1的整数。in, is the vector splicing, b is the bias term, ReLU is the nonlinear activation function, x t represents the context center word, W is the convolution kernel of size 2w+1, w is the parameter used to adjust the size of the convolution kernel, and δ is the expansion rate, which is an integer not less than 1.
进一步的,所述计算用户和物品之间的多粒度关联矩阵,具体包括:通过在每个粒度上构建关联矩阵实现用户和物品之间特征的交互,给定用户和物品的第n个和第m个多粒度评论表示,则第l层粒度的关联矩阵通过如下的点乘运算实现:Further, the calculation of the multi-granularity correlation matrix between the user and the item specifically includes: realizing the interaction of the features between the user and the item by constructing the correlation matrix on each granularity, given the nth and the th of the user and the item. There are m multi-granularity comment representations, then the relationship matrix of the l-th granularity is realized by the following dot product operation:
其中,l=[1,2,...,L]为语义粒度的数量, 中的元素代表着用户与物品评论中第i个特征与第j个特征在l粒度下的相关性。where l=[1,2,...,L] is the number of semantic granularities, elements in Represents the correlation between the ith feature and the jth feature in user and item reviews at l granularity.
根据本公开实施例的第二个方面,提供了一种基于评论文本的细粒度物品推荐系统,包括:According to a second aspect of the embodiments of the present disclosure, a fine-grained item recommendation system based on review text is provided, including:
数据获取单元,其用于分别获取用户评论文本集合和物品评论文本集合;a data acquisition unit, which is used to acquire the user comment text set and the item comment text set respectively;
多粒度特征提取单元,其用于利用层次扩张卷积模型分别对用户评论文本集合和物品评论文本集合中的每条评论文本进行多粒度语义特征提取,获得用户和物品的多粒度评论表示集合;A multi-granularity feature extraction unit, which is used to extract multi-granularity semantic features for each comment text in the user comment text set and the item comment text set respectively by using a hierarchical dilated convolution model to obtain a multi-granularity comment representation set of users and items;
交互图像生成单元,其用于基于用户和物品的多粒度评论表示,构建用户和物品之间的多粒度关联矩阵,并通过3D卷积神经网络将所述关联矩阵融合成3D交互图像;an interactive image generation unit, which is used to construct a multi-granularity correlation matrix between users and items based on the multi-granularity comment representation of users and items, and fuse the correlation matrix into a 3D interactive image through a 3D convolutional neural network;
物品推荐单元,其用于将所述3D交互图像输入到全连接神经网络和传统因子分解机中实现用户-物品的评分预测,根据评分结果实现物品的推荐。An item recommendation unit, which is used to input the 3D interactive image into a fully connected neural network and a traditional factorization machine to achieve user-item rating prediction, and implement item recommendation according to the rating result.
根据本公开实施例的第三个方面,提供了一种电子设备,包括存储器、处理器及存储在存储器上运行的计算机程序,所述处理器执行所述程序时实现所述的一种基于评论文本的细粒度物品推荐系统。According to a third aspect of the embodiments of the present disclosure, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and running on the memory, the processor implements the comment-based method when the processor executes the program A fine-grained item recommendation system for text.
根据本公开实施例的第四个方面,提供了一种非暂态计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现所述的一种基于评论文本的细粒度物品推荐系统。According to a fourth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the described fine-grained comment text-based Item recommendation system.
与现有技术相比,本公开的有益效果是:Compared with the prior art, the beneficial effects of the present disclosure are:
(1)本公开所述方案给出了一种细粒度特征交互网络,通过所述细粒度特征交互网络来计算用户和物品间的多粒度关联矩阵,其优势在于:多层次的用户/物品表示和细粒度的特征交互,所述网络不是用单个抽象向量来表示每个用户,而是在一个统一的模块中使用分层扩展卷积来构建基于评论的多层次表示;通过分层叠加扩展的卷积,每一层的接收输入宽度呈指数增长,而参数的数量仅线性增加。同时,每一层的输出被保留为跨不同长度的文本段的特征映射,不会因为没有使用任何形式的池化或步进卷积而造成覆盖损失;通过这种方法,所述方案可以在不同粒度上通过局部相关性和长期依赖性逐步获得评论中的语义特征,包括词、短语和句子层次。所述方案以多层次扩张卷积结构来编码用户和物品评论,避免了评论中细粒度信息的丢失。(1) The solution of the present disclosure provides a fine-grained feature interaction network, and the multi-granularity correlation matrix between users and items is calculated through the fine-grained feature interaction network. The advantages are: multi-level user/item representation Interacting with fine-grained features, the network does not represent each user with a single abstract vector, but uses hierarchical dilated convolutions in a unified module to build comment-based multi-level representations; In convolution, the received input width of each layer grows exponentially, while the number of parameters increases only linearly. At the same time, the output of each layer is preserved as feature maps across text segments of different lengths, without any coverage loss due to the absence of any form of pooling or stepped convolution; in this way, the scheme can Semantic features in reviews are gradually obtained at different granularities through local correlations and long-term dependencies, including word, phrase, and sentence levels. The proposed scheme encodes user and item reviews with a multi-level dilated convolution structure, avoiding the loss of fine-grained information in reviews.
(2)为了避免信息丢失,所述细粒度特征交互网络,在每个语义粒度上构建用户评论和物品评论的特征交互。在实际应用中,该模型基于评论文本的分层表示方法,对每一对评论分别从词到句的层次上构建一个关联矩阵。通过这种方式,可以识别用户和物品评论中隐含的多个粒度特征,并以最小的损失进行交互,从而为预测准确的评分提供足够的内容相关性线索。然后,我们将每个粒度的评论对的多个关联矩阵合并成一个3D图像,其通道表示不同粒度下用户和物品评论特征交互的相关程度。通过类似于基于3D卷积的图像识别层次,识别高阶显著信号来预测用户对物品评分;所述方案在多个粒度下构建用户和物品评论的特征交互,并使用3D卷积来融合处理多粒度信息,有效的突出了评论中多个粒度下的相关信息。(2) In order to avoid information loss, the fine-grained feature interaction network constructs feature interactions between user reviews and item reviews at each semantic granularity. In practical applications, the model is based on the hierarchical representation method of comment text, and builds an association matrix from word to sentence level for each pair of comments. In this way, multiple granular features implicit in user and item reviews can be identified and interacted with with minimal loss, providing sufficient contextual relevance cues for predicting accurate ratings. Then, we merge the multiple association matrices of review pairs at each granularity into a 3D image whose channels represent the correlation degree of user and item review feature interactions at different granularities. Predict user ratings for items by identifying high-order salient signals through a hierarchy similar to 3D convolution-based image recognition; the proposed scheme builds feature interactions between users and item reviews at multiple granularities, and uses 3D convolution to fuse multiple Granular information, effectively highlighting the relevant information under multiple granularities in the comments.
(3)所述方案不仅在性能方面有优越性,还具有强力的可解释性。(3) The proposed scheme is not only superior in performance, but also has strong interpretability.
本公开附加方面的优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本公开的实践了解到。Advantages of additional aspects of the disclosure will be set forth in part in the description that follows, and in part will become apparent from the description below, or will be learned by practice of the disclosure.
附图说明Description of drawings
构成本公开的一部分的说明书附图用来提供对本公开的进一步理解,本公开的示意性实施例及其说明用于解释本公开,并不构成对本公开的不当限定。The accompanying drawings that constitute a part of the present disclosure are used to provide further understanding of the present disclosure, and the exemplary embodiments of the present disclosure and their descriptions are used to explain the present disclosure and do not constitute an improper limitation of the present disclosure.
图1为本公开实施例一中所述的细粒度特征交互网络模型结构示意图;1 is a schematic structural diagram of the fine-grained feature interaction network model described in
图2为本公开实施例一中所述的层次扩张卷积。FIG. 2 is the hierarchical dilated convolution described in
具体实施方式Detailed ways
下面结合附图与实施例对本公开做进一步说明。The present disclosure will be further described below with reference to the accompanying drawings and embodiments.
应该指出,以下详细说明都是例示性的,旨在对本公开提供进一步的说明。除非另有指明,本文使用的所有技术和科学术语具有与本公开所属技术领域的普通技术人员通常理解的相同含义。It should be noted that the following detailed description is exemplary and intended to provide further explanation of the present disclosure. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs.
需要注意的是,这里所使用的术语仅是为了描述具体实施方式,而非意图限制根据本公开的示例性实施方式。如在这里所使用的,除非上下文另外明确指出,否则单数形式也意图包括复数形式,此外,还应当理解的是,当在本说明书中使用术语“包含”和/或“包括”时,其指明存在特征、步骤、操作、器件、组件和/或它们的组合。It should be noted that the terminology used herein is for the purpose of describing specific embodiments only, and is not intended to limit the exemplary embodiments according to the present disclosure. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural as well, furthermore, it is to be understood that when the terms "comprising" and/or "including" are used in this specification, it indicates that There are features, steps, operations, devices, components and/or combinations thereof.
在不冲突的情况下,本公开中的实施例及实施例中的特征可以相互组合。The embodiments of this disclosure and features of the embodiments may be combined with each other without conflict.
实施例一:Example 1:
本实施例的目的是提供一种基于评论文本的细粒度物品推荐方法。The purpose of this embodiment is to provide a fine-grained item recommendation method based on review text.
一种基于评论文本的细粒度物品推荐方法,包括:A fine-grained item recommendation method based on review text, including:
分别获取用户评论文本集合和物品评论文本集合;Obtain the user comment text collection and the item review text collection respectively;
利用细粒度特征交互网络计算用户和物品间的多粒度关联矩阵,获得3D交互图像;Use the fine-grained feature interaction network to calculate the multi-granularity correlation matrix between users and items to obtain 3D interactive images;
将所述3D交互图像输入到全连接神经网络和传统因子分解机中实现用户-物品的评分预测,根据评分结果实现物品的推荐;Inputting the 3D interactive image into a fully connected neural network and a traditional factorization machine to achieve user-item rating prediction, and implement item recommendation according to the rating result;
其中,所述细粒度特征交互网络具体包括:利用层次扩张卷积模型分别对用户评论文本集合和物品评论文本集合中的每条评论文本进行多粒度语义特征提取,获得用户和物品的多粒度评论表示集合;计算用户和物品之间的多粒度关联矩阵,并通过3D卷积神经网络将所述关联矩阵融合成3D交互图像。The fine-grained feature interaction network specifically includes: using a hierarchical dilated convolution model to extract multi-granularity semantic features for each comment text in the user comment text set and the item comment text set, respectively, to obtain multi-granularity comments on users and items. Represents a collection; computes a multi-granularity correlation matrix between users and items, and fuses the correlation matrix into a 3D interactive image through a 3D convolutional neural network.
具体的,为了便于理解,以下结合附图对本公开所述方案进行详细说明:Specifically, in order to facilitate understanding, the solutions described in the present disclosure are described in detail below with reference to the accompanying drawings:
如图1展示了细粒度特征交互网络模型结构示意图,所述模型结构依次描述我们提出的细粒度特征交互网络(FFIN:fine-grained feature interaction network)。首先,我们对基于评论的推荐问题进行了定义;随后,我们详细描述了评论表示模块中层次扩张卷积结构对原始评论文本的编码过程;其次,我们展示了用户和物品的多粒度的评论表示特征的交互过程;最后,我们介绍了一个带有因子分解机(FM)的评分预测层实现用户对物品的评分,其中:Figure 1 shows a schematic diagram of the model structure of the fine-grained feature interaction network, which in turn describes the fine-grained feature interaction network (FFIN: fine-grained feature interaction network) proposed by us. First, we define the review-based recommendation problem; then, we describe in detail the encoding process of the original review text by the hierarchical dilated convolutional structure in the review representation module; secondly, we show the multi-granular review representation of users and items feature interaction process; finally, we introduce a rating prediction layer with a factorization machine (FM) to achieve user ratings for items, where:
(一)问题定义(1) Definition of the problem
基于评论的推荐问题可以表述为:对于给定的用户u和物品i,它们都对应一组原始的评论文本集合和其中N,M对应用户和物品评论集合的评论数量,其中,用户评论文本集合,其存储的是特定用户关于不同物品的评论文本;物品评论文本集合,其存储的是关于特定物品不同用户的评论文本。我们的目的是建立一个预测模型,通过一组用户和物品的评论集合来预测用户对该物品的评分。设一组用户和物品评论集合中单个评论的最大长度分别为Tu和Ti,则第n个用户和第m个物品原始的评论文本可以分别表示为:The review-based recommendation problem can be formulated as: for a given user u and item i, they both correspond to a set of original review texts and Among them, N and M correspond to the number of comments in the user and item comment sets, among which, the user comment text set stores the comment text of a specific user about different items; the item comment text set stores the comments of different users about a specific item text. Our goal is to build a predictive model that predicts a user's rating for an item from a set of user and item reviews. Assuming that the maximum lengths of a single comment in a set of user and item comments are Tu and Ti, respectively, the original comment texts of the nth user and the mth item can be expressed as:
(二)评论文本表示(2) Representation of comment text
由于用户和物品的多粒度评论表示的产生过程是类似的,因此我们仅展示单个评论文本的编码步骤,且将简化为s,评论长度设为T。Since the generation process of multi-granular review representations for users and items is similar, we only show the encoding steps for a single review text, and Simplify to s, and the comment length is set to T.
受到多层扩张卷积结构的启发,如图2所示,我们设计了一种层次扩张卷积(hierarchical dilated convolution,HDC)来直接从评论中学习多个语义粒度的评论表示。Inspired by the multi-layer dilated convolution structure, as shown in Figure 2, we design a hierarchical dilated convolution (HDC) to learn multiple semantic-grained review representations directly from reviews.
对于给定的评论文本s=[w1,w2,...,wT],模型首先通过一个嵌入矩阵将其映射为相应的词向量矩阵,即X=[x1,x2,...,xT],其中xt∈Rd是该文本中的第t个单词的词嵌入表示,d是词向量的维度大小。然后,HDC以该词向量矩阵为输入,捕获评论中的多粒度语义特征。For a given review text s=[w 1 , w 2 , ..., w T ], the model first maps it to the corresponding word vector matrix through an embedding matrix, namely X=[x 1 , x 2 , . .., x T ], where x t ∈ R d is the word embedding representation of the t-th word in this text, and d is the dimension size of the word vector. Then, HDC takes this word vector matrix as input to capture the multi-granularity semantic features in the reviews.
不同于标准卷积在每一步对输入的一个连续子序列进行卷积,扩张卷积通过每次跳过δ个输入元素,而拥有更为广泛的接受域,其中δ是扩张率。对于上下文中心单词xt和大小为2w+1的卷积核W,扩张卷积操作可以被公式为:Unlike standard convolution which convolves a contiguous subsequence of the input at each step, dilated convolution has a wider receptive field by skipping δ input elements at a time, where δ is the dilation rate. For a context center word xt and a convolution kernel W of size 2w+1, the dilated convolution operation can be formulated as:
其中,是向量拼接、b是偏置项、ReLU是非线性激活函数。如图2所示,每个卷积层的输出是前一层输入的加权组合。我们以δ=1为开始(等同于标准卷积),以确保不遗漏原始输入序列中的任何元素。之后,通过以更大的扩张率层次叠加扩张之后的卷积,卷积文本的长度以指数形式扩展,只需使用少量的层和适量的参数就可以覆盖不同接受域的语义特征。in, is the vector concatenation, b is the bias term, and ReLU is the nonlinear activation function. As shown in Figure 2, the output of each convolutional layer is a weighted combination of the inputs of the previous layer. We start with δ=1 (equivalent to standard convolution) to ensure that no elements in the original input sequence are missed. Afterwards, by stacking the dilated convolutions hierarchically with a larger dilation rate, the length of the convolutional text expands exponentially, covering the semantic features of different receptive fields with only a small number of layers and appropriate parameters.
此外,为了防止梯度的消失或爆炸,我们在每个卷积层的最后应用层归一化(layer normalization)。由于可能会有不相关的信息引入到长距离的语义单元中,我们实际根据验证中的性能设计多层次的扩张率。每个堆叠层l的输出都保存为文本在特定粒度水平上的特征图,公式为其中f是是每一层卷积滤波器的数量。假设有L层堆叠的扩张卷积,多粒度评论表示可以定义为[s1,s2,...,sL]。通过这种方式,HDC以较小的扩张率从单词和短语层次逐步收获词义和语义特征,以较大的扩张率从句子层次捕获长期的依赖关系。我们的评论编码模块不仅在并行能力上优于循环神经网络,而且相比于完全基于注意力的方法能够显著减少内存的消耗。Furthermore, to prevent vanishing or exploding gradients, we apply layer normalization at the end of each convolutional layer. Since there may be irrelevant information introduced into long-distance semantic units, we actually design multi-level dilation rates according to the performance in validation. The output of each stacked layer l is saved as a feature map of the text at a specific granularity level, the formula is where f is the number of convolutional filters in each layer. Assuming there are L layers of stacked dilated convolutions, the multi-granularity comment representation can be defined as [s 1 , s 2 , ..., s L ]. In this way, HDC gradually harvests word sense and semantic features from the word and phrase levels with a small dilation rate, and captures long-term dependencies from the sentence level with a large dilation rate. Our comment encoding module not only outperforms recurrent neural networks in parallelism, but also significantly reduces memory consumption compared to fully attention-based methods.
经过HDC模块编码,单个用户和物品的多粒度评论表示可以分别被表述为:After the HDC module encoding, the multi-granularity comment representation of a single user and item can be expressed as:
其中,分别为用户和物品评论集合Su、Si中的第n个和第m个评论文本。in, are the nth and mth review texts in the user and item review sets Su , Si, respectively.
(三)特征交互模块(3) Feature interaction module
给定的用户和物品的多粒度评论表示集合和我们通过在每个粒度上构建关联矩阵实现用户和物品之间特征的交互。给定用户和物品的第n个和第m个多粒度评论表示,第l层粒度的关联矩阵可以通过如下的点乘运算实现:A collection of multi-granular review representations for a given user and item and We implement the interaction of features between users and items by building an association matrix at each granularity. Given the n-th and m-th multi-granularity review representations of users and items, the relationship matrix of the l-th granularity can be realized by the following dot product operation:
其中,l=[1,2,...,L]是语义粒度的数目, 中的元素代表着用户与物品评论中第i个特征与第j个特征在l粒度下的相关性。where l=[1,2,...,L] is the number of semantic granularities, elements in Represents the correlation between the ith feature and the jth feature in user and item reviews at l granularity.
为了总结整个用户和物品的评论中的多粒度特征,FFIN将用户和物品的所有交互得到的关联矩阵融合成一个3D交互图像,公式为:In order to summarize the multi-granularity features in the reviews of the entire user and item, FFIN fuses the correlation matrix obtained from all interactions between the user and the item into a 3D interaction image, the formula is:
其中n×m代表关联矩阵在单个粒度下的总数量,3D交互图像中的每个像素点由以下方式得到:where n×m represents the total number of correlation matrices under a single granularity, and each pixel in the 3D interactive image is obtained in the following way:
具体来讲,每个像素点都是所有粒度下特征的拼接向量,表示用户与物品在多个粒度下的交互程度。Specifically, each pixel is a spliced vector of features at all granularities, representing the degree of interaction between users and items at multiple granularities.
由于用户的评分行为通常是带有主观性的个性化,因此在面对不同的物品时会体现出不同的偏好。我们采用分层的3D卷积神经网络和最大池化操作,从整个图像中识别出突出的匹配信号。三维卷积是典型的二维卷积的扩展,其滤波器和步长都是三维立方体。形式上,第t层的第z个特征图上的高阶像素在(k,i,j)处的计算方式为:Since the user's rating behavior is usually subjective and personalized, it will reflect different preferences when faced with different items. We employ a layered 3D convolutional neural network and a max-pooling operation to identify salient matching signals from the entire image. The 3D convolution is an extension of the typical 2D convolution, and its filter and stride are 3D cubes. Formally, the high-order pixels on the z-th feature map of the t-th layer are computed at (k, i, j) as:
其中,ELU为非线性激活函数,z'代表着上一层的特征图,和b(t)分别是3D卷积核和偏置项,大小为Wt×Ht×Rt。随后,通过一个最大池化操作提取出显著的信息:Among them, ELU is a nonlinear activation function, z' represents the feature map of the previous layer, and b (t) are the 3D convolution kernel and bias term, respectively, of size W t ×H t ×R t . Subsequently, significant information is extracted by a max-pooling operation:
其中,和是3D池化操作的大小。最后一层的输出是将用户和物品评论之间的综合交互向量进行拼接,表示为 in, and is the size of the 3D pooling operation. The output of the last layer is to concatenate the comprehensive interaction vectors between users and item reviews, expressed as
(四)评分预测模块(4) Score prediction module
在本小节中,我们将上述特征交互模块产生的预测向量输入到全连接神经网络和传统的因子分解机(FM)中来实现最终的用户-物品评分预测。全连接神经网络的实现过程可以被公式如下:In this subsection, we combine the prediction vectors produced by the feature interaction module above The inputs are fed into a fully connected neural network and a traditional Factorization Machine (FM) to achieve the final user-item rating prediction. The implementation process of the fully connected neural network can be formulated as follows:
其中,W0∈Rn×e和b0∈Rn分别是全连接网络的权重参数和偏置项。Among them, W 0 ∈ R n×e and b 0 ∈ R n are the weight parameters and bias terms of the fully connected network, respectively.
FM接受一个实值特征向量,并使用分解参数对特征之间的相互作用进行建模。其定义如下FM takes a real-valued feature vector and uses decomposition parameters to model the interactions between features. Its definition is as follows
其中,是实值输入特征向量。<.,.>是点乘操作。参数{v1,...,vn},υ∈Rn是用于建模交互对(xi,xi)的分解参数。和分别是全局偏置项和线性回归组件。FM的权重参数。FM的输出是一个标量,代表用户和物品交互的预测评分。in, is the real-valued input feature vector. <., .> is the dot product operation. The parameters {v 1 , . . . , v n }, υ∈R n are the decomposition parameters used to model the interaction pair ( xi , x i ). and are the global bias term and the linear regression component, respectively. FM weight parameter. FM output is a scalar representing the predicted rating of the user-item interaction.
进一步的,对不同的物品按照其预测评分由大到小排序,将预测评分高的物品推荐给用户。Further, different items are sorted in descending order according to their predicted scores, and items with high predicted scores are recommended to users.
实施例二:Embodiment 2:
本实施例的目的是提供一种基于评论文本的细粒度物品推荐系统。The purpose of this embodiment is to provide a fine-grained item recommendation system based on comment text.
一种基于评论文本的细粒度物品推荐系统,包括:A fine-grained item recommendation system based on review text, including:
数据获取单元,其用于分别获取用户评论文本集合和物品评论文本集合;a data acquisition unit, which is used to acquire the user comment text set and the item comment text set respectively;
多粒度特征提取单元,其用于利用层次扩张卷积模型分别对用户评论文本集合和物品评论文本集合中的每条评论文本进行多粒度语义特征提取,获得用户和物品的多粒度评论表示集合;A multi-granularity feature extraction unit, which is used to extract multi-granularity semantic features for each comment text in the user comment text set and the item comment text set respectively by using a hierarchical dilated convolution model to obtain a multi-granularity comment representation set of users and items;
交互图像生成单元,其用于基于用户和物品的多粒度评论表示,构建用户和物品之间的多粒度关联矩阵,并通过3D卷积神经网络将所述关联矩阵融合成3D交互图像;an interactive image generation unit, which is used to construct a multi-granularity correlation matrix between users and items based on the multi-granularity comment representation of users and items, and fuse the correlation matrix into a 3D interactive image through a 3D convolutional neural network;
物品推荐单元,其用于将所述3D交互图像输入到全连接神经网络和传统因子分解机中实现用户-物品的评分预测,根据评分结果实现物品的推荐。An item recommendation unit, which is used to input the 3D interactive image into a fully connected neural network and a traditional factorization machine to achieve user-item rating prediction, and implement item recommendation according to the rating result.
在更多实施例中,还提供:In further embodiments, there is also provided:
一种电子设备,包括存储器和处理器以及存储在存储器上并在处理器上运行的计算机指令,所述计算机指令被处理器运行时,完成实施例一中所述的方法。为了简洁,在此不再赘述。An electronic device includes a memory, a processor, and computer instructions stored on the memory and executed on the processor, and when the computer instructions are executed by the processor, the method described in the first embodiment is completed. For brevity, details are not repeated here.
应理解,本实施例中,处理器可以是中央处理单元CPU,处理器还可以是其他通用处理器、数字信号处理器DSP、专用集成电路ASIC,现成可编程门阵列FPGA或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。It should be understood that, in this embodiment, the processor may be a central processing unit CPU, and the processor may also be other general-purpose processors, digital signal processors DSP, application-specific integrated circuits ASIC, off-the-shelf programmable gate array FPGA or other programmable logic devices , discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
存储器可以包括只读存储器和随机存取存储器,并向处理器提供指令和数据、存储器的一部分还可以包括非易失性随机存储器。例如,存储器还可以存储设备类型的信息。The memory may include read-only memory and random access memory and provide instructions and data to the processor, and a portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information.
一种计算机可读存储介质,用于存储计算机指令,所述计算机指令被处理器执行时,完成实施例一中所述的方法。A computer-readable storage medium is used to store computer instructions, and when the computer instructions are executed by a processor, the method described in the first embodiment is completed.
实施例一中的方法可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器、闪存、只读存储器、可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成上述方法的步骤。为避免重复,这里不再详细描述。The method in the first embodiment can be directly embodied as being executed by a hardware processor, or executed by a combination of hardware and software modules in the processor. The software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art. The storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware. To avoid repetition, detailed description is omitted here.
本领域普通技术人员可以意识到,结合本实施例描述的各示例的单元即算法步骤,能够以电子硬件或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those of ordinary skill in the art can realize that the unit, that is, the algorithm step of each example described in conjunction with this embodiment, can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
上述实施例提供的一种基于评论文本的细粒度物品推荐方法及系统可以实现,具有广阔的应用前景。The method and system for fine-grained item recommendation based on review text provided by the above embodiments can be implemented and have broad application prospects.
以上所述仅为本公开的优选实施例而已,并不用于限制本公开,对于本领域的技术人员来说,本公开可以有各种更改和变化。凡在本公开的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本公开的保护范围之内。The above descriptions are only preferred embodiments of the present disclosure, and are not intended to limit the present disclosure. For those skilled in the art, the present disclosure may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure shall be included within the protection scope of the present disclosure.
上述虽然结合附图对本公开的具体实施方式进行了描述,但并非对本公开保护范围的限制,所属领域技术人员应该明白,在本公开的技术方案的基础上,本领域技术人员不需要付出创造性劳动即可做出的各种修改或变形仍在本公开的保护范围以内。Although the specific embodiments of the present disclosure have been described above in conjunction with the accompanying drawings, they do not limit the protection scope of the present disclosure. Those skilled in the art should understand that on the basis of the technical solutions of the present disclosure, those skilled in the art do not need to pay creative efforts. Various modifications or variations that can be made are still within the protection scope of the present disclosure.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110505981.5A CN113127604B (en) | 2021-05-10 | 2021-05-10 | Method and system for fine-grained item recommendation based on review text |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110505981.5A CN113127604B (en) | 2021-05-10 | 2021-05-10 | Method and system for fine-grained item recommendation based on review text |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113127604A CN113127604A (en) | 2021-07-16 |
CN113127604B true CN113127604B (en) | 2022-10-04 |
Family
ID=76781246
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110505981.5A Active CN113127604B (en) | 2021-05-10 | 2021-05-10 | Method and system for fine-grained item recommendation based on review text |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113127604B (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113570154B (en) * | 2021-08-09 | 2024-07-05 | 齐鲁工业大学 | Multi-granularity interaction recommendation method and system integrating dynamic interests of users |
CN114154071B (en) * | 2021-12-09 | 2023-05-09 | 电子科技大学 | An Attention Mechanism Based Sentiment Sequence Recommendation Method |
CN114170389A (en) * | 2021-12-29 | 2022-03-11 | 北京橙色云科技有限公司 | Three-dimensional image generation method and device and storage medium |
CN114676315B (en) * | 2022-01-28 | 2024-11-05 | 齐鲁工业大学(山东省科学院) | Attribute fusion interactive recommendation model construction method and system based on enhanced graph convolution |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109740154A (en) * | 2018-12-26 | 2019-05-10 | 西安电子科技大学 | A fine-grained sentiment analysis method for online reviews based on multi-task learning |
CN110060132A (en) * | 2019-04-24 | 2019-07-26 | 吉林大学 | Interpretable Method of Commodity Recommendation based on fine-grained data |
CN111061951A (en) * | 2019-12-11 | 2020-04-24 | 华东师范大学 | Recommendation model based on double-layer self-attention comment modeling |
CN112182156A (en) * | 2020-09-28 | 2021-01-05 | 齐鲁工业大学 | Aspect-level interpretable deep network score prediction recommendation method based on text processing |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130218914A1 (en) * | 2012-02-20 | 2013-08-22 | Xerox Corporation | System and method for providing recommendations based on information extracted from reviewers' comments |
US9400779B2 (en) * | 2013-06-06 | 2016-07-26 | Xerox Corporation | Method and system for classifying reviewers' comments and recommending related actions in idea-generating social media platforms |
CN107038609A (en) * | 2017-04-24 | 2017-08-11 | 广州华企联信息科技有限公司 | A kind of Method of Commodity Recommendation and system based on deep learning |
CN110083684B (en) * | 2019-04-24 | 2021-11-19 | 吉林大学 | Interpretable recommendation model for fine-grained emotion |
CN112100485B (en) * | 2020-08-20 | 2024-07-05 | 齐鲁工业大学 | Comment-based scoring prediction article recommendation method and system |
CN112699215B (en) * | 2020-12-24 | 2022-07-05 | 齐鲁工业大学 | Rating prediction method and system based on capsule network and interactive attention mechanism |
-
2021
- 2021-05-10 CN CN202110505981.5A patent/CN113127604B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109740154A (en) * | 2018-12-26 | 2019-05-10 | 西安电子科技大学 | A fine-grained sentiment analysis method for online reviews based on multi-task learning |
CN110060132A (en) * | 2019-04-24 | 2019-07-26 | 吉林大学 | Interpretable Method of Commodity Recommendation based on fine-grained data |
CN111061951A (en) * | 2019-12-11 | 2020-04-24 | 华东师范大学 | Recommendation model based on double-layer self-attention comment modeling |
CN112182156A (en) * | 2020-09-28 | 2021-01-05 | 齐鲁工业大学 | Aspect-level interpretable deep network score prediction recommendation method based on text processing |
Also Published As
Publication number | Publication date |
---|---|
CN113127604A (en) | 2021-07-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113127604B (en) | Method and system for fine-grained item recommendation based on review text | |
CN113255755B (en) | Multi-modal emotion classification method based on heterogeneous fusion network | |
CN111061856A (en) | Knowledge perception-based news recommendation method | |
CN114969304B (en) | Method for generating abstract of case public opinion multi-document based on element diagram attention | |
CN114926835A (en) | Text generation method and device, and model training method and device | |
CN113779994B (en) | Element extraction method, element extraction device, computer equipment and storage medium | |
CN109145974A (en) | One kind being based on the matched multi-level image Feature fusion of picture and text | |
CN109558576A (en) | A kind of punctuation mark prediction technique based on from attention mechanism | |
CN116933051A (en) | Multi-mode emotion recognition method and system for modal missing scene | |
CN117371456B (en) | Multi-mode irony detection method and system based on feature fusion | |
CN108536735A (en) | Multi-modal lexical representation method and system based on multichannel self-encoding encoder | |
CN115588122A (en) | A News Classification Method Based on Multimodal Feature Fusion | |
CN112199954A (en) | Disease entity matching method and device based on voice semantics and computer equipment | |
CN114328910A (en) | Text clustering method and related device | |
CN117131869A (en) | A nested named entity recognition method based on span boundary awareness | |
CN119091170A (en) | Cluster prototype-guided image-text matching method based on aggregated neighborhood embedding | |
CN116756314A (en) | Aspect-level multi-modal sentiment analysis method based on GCN | |
CN115240713B (en) | Voice emotion recognition method and device based on multi-modal characteristics and contrast learning | |
CN115422939A (en) | Fine-grained commodity named entity identification method based on big data | |
CN115392260A (en) | Social media tweet emotion analysis method facing specific target | |
CN115204171A (en) | Document-level event extraction method and system based on hypergraph neural network | |
CN117951092A (en) | Multi-mode information fusion-based electronic archive image multi-stage classification method and device | |
CN115114934B (en) | Combined extraction method for label fusion | |
CN117592477A (en) | Named entity recognition method, system, electronic device and storage medium | |
CN113822018B (en) | Entity Relation Joint Extraction Method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP03 | Change of name, title or address | ||
CP03 | Change of name, title or address |
Address after: 250353 University Road, Changqing District, Ji'nan, Shandong Province, No. 3501 Patentee after: Qilu University of Technology (Shandong Academy of Sciences) Country or region after: China Address before: 250353 University Road, Changqing District, Ji'nan, Shandong Province, No. 3501 Patentee before: Qilu University of Technology Country or region before: China |