CN111222332A - A Product Recommendation Method Combining Attention Network and User Sentiment - Google Patents

A Product Recommendation Method Combining Attention Network and User Sentiment Download PDF

Info

Publication number
CN111222332A
CN111222332A CN202010008804.1A CN202010008804A CN111222332A CN 111222332 A CN111222332 A CN 111222332A CN 202010008804 A CN202010008804 A CN 202010008804A CN 111222332 A CN111222332 A CN 111222332A
Authority
CN
China
Prior art keywords
vector
attribute
user
comment
product
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010008804.1A
Other languages
Chinese (zh)
Other versions
CN111222332B (en
Inventor
张星明
罗凌杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN202010008804.1A priority Critical patent/CN111222332B/en
Publication of CN111222332A publication Critical patent/CN111222332A/en
Application granted granted Critical
Publication of CN111222332B publication Critical patent/CN111222332B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9535—Search customisation based on user profiles and personalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/088—Non-supervised learning, e.g. competitive learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Item recommendations

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Biophysics (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明公开了一种结合注意力网络和用户情感的商品推荐方法，包括步骤：1)提取出用户对商品的评分和评论数据并预处理，构建样本集合T；2)采用无监督的学习模型，利用T中评论的文本数据，不断训练得到相应领域的属性矩阵W；3)构建基于注意力的神经网络结构C，利用基于W的记忆网络和循环神经网络作为基础，使用预测的情感得分作为权重，构建用户偏好向量U和商品特征向量I，利用U和I计算出缺失评分的预测值，同时计算出当前用户和商品的属性向量，用于最终的推荐解释；4)根据预测的评分进行降序排序，为用户推荐前N个商品，并根据属性矩阵和属性向量，为推荐结果提供属性级别的解释。本发明解决了传统评分预测推荐方法缺乏解释性和难以处理大规模数据等问题。

Figure 202010008804

The invention discloses a product recommendation method combining attention network and user emotion, including steps: 1) extracting user's rating and comment data on products and preprocessing, and constructing a sample set T; 2) adopting an unsupervised learning model , using the text data of comments in T, and continuously train to obtain the attribute matrix W of the corresponding field; 3) Build an attention-based neural network structure C, use the memory network and recurrent neural network based on W as the basis, and use the predicted sentiment score as the Weight, construct the user preference vector U and the product feature vector I, use U and I to calculate the predicted value of the missing score, and calculate the attribute vector of the current user and product for the final recommendation explanation; 4) According to the predicted score Sort in descending order, recommend the top N products for users, and provide attribute-level explanations for the recommended results according to the attribute matrix and attribute vector. The invention solves the problems of lack of interpretability and difficulty in handling large-scale data in the traditional scoring prediction and recommendation method.

Figure 202010008804

Description

Commodity recommendation method combining attention network and user emotion
Technical Field
The invention relates to the technical field of electronic commerce, in particular to a commodity recommendation method combining an attention network and user emotion.
Background
With the advent of the big data era and the explosion of the internet, electronic commerce has come. On the E-commerce platform, users are often difficult to decide about the full-color products, and the recommendation algorithm can utilize data accumulated by the E-commerce platform, including data of purchasing, grading, commenting and the like of the users, to mine potential interests of the users, so as to recommend corresponding products. An excellent recommendation algorithm aims to perform personalized accurate recommendation on a user and provide corresponding explanation, so that the user experience can be improved, and the benefit of an e-commerce platform can be increased. For the user, explanation is provided for the user, the purchase quantity of the commodity can be increased, and the user experience can be improved; for the E-commerce platform, user interest and hobbies and purchasing preference are mastered, so that a user portrait can be constructed for a user, personalized marketing is performed on the user, and the conversion rate of user behaviors is improved. Therefore, the invention of an excellent interpretable recommendation algorithm has important practical significance by utilizing accumulated data of the commercial platform.
In the current recommendation system, one of the common methods is: and carrying out score prediction on the commodities by utilizing the historical behavior data of the user, and recommending the commodities to the user according to the predicted scores. The scoring prediction method mainly comprises the following steps: the first is a traditional matrix decomposition model that uses a scoring matrix to predict the missing scores and generate recommendations. The method only utilizes the historical scoring data of the user, obtains less characteristics of user preference and article attributes, and lacks interpretability. The second type is a model combining a topic model and matrix decomposition, which simultaneously utilizes historical scores and comment data of a user, and the topic model is used for extracting topics in comments so as to provide certain interpretability. But the shortcomings are that the processing of comments by the topic model is simple word extraction, the consideration of the time sequence characteristics of words is lacked, and the topic model is difficult to solve for large-scale data.
The invention provides a commodity recommendation method combining an attention network and user emotion. The method utilizes the memory network and the recurrent neural network to process the comments so as to extract the characteristics, wherein the result of the memory network is used as the attention of the recurrent neural network, so that certain interpretability is provided for the method; meanwhile, different weights are applied to different comments by utilizing the predicted emotion scores, and the interpretability of the recommendation method is further increased. Therefore, the accuracy of the scoring prediction is improved, and the problems that the traditional scoring prediction recommendation method is lack of interpretability and large-scale data is difficult to process are solved.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, provides a commodity recommendation method combining an attention network and user emotion, solves the problems of insufficient interpretability and difficulty in processing big data of the traditional scoring prediction method, improves the scoring prediction accuracy, and increases the interpretability of the method. The method utilizes the grading and comment data of the commodities to construct a user preference vector and a commodity feature vector, predicts the missing grade and provides a recommendation explanation.
In order to achieve the purpose, the technical scheme provided by the invention is as follows: a commodity recommendation method combining attention network and user emotion comprises the following steps:
1) processing historical behavior data of a user in an e-commerce platform, mainly extracting grading and comment data of the user on commodities, including comment text data, preprocessing the comment data, and constructing a sample set T;
2) continuously training by adopting an unsupervised learning model and utilizing text data commented in the sample set T to finally obtain an attribute matrix W of the sample set T;
3) constructing an attention-based neural network structure C, using a memory network and a cyclic neural network based on an attribute matrix W as a basis, using predicted emotion scores as weights, further constructing a user preference vector U and a commodity feature vector I, finally calculating predicted values of deletion scores by using the user preference vector U and the commodity feature vector I, and meanwhile calculating attribute vectors of current users and commodities for final recommendation interpretation;
4) and performing descending sorting according to the predicted scores, recommending the first N commodities for the user, and providing attribute level explanation for the recommendation result according to the attribute matrix W obtained in the step 2) and the attribute vector obtained in the step 3).
In the step 1), grading and comment data of a user on commodities are extracted from user historical behavior data in an e-commerce platform, manual rules are formulated, part of useless data are filtered out, and the comment data are preprocessed and divided into two parts, wherein the first part is used for mapping the ID of the user and the ID of the commodities into numerical values so as to facilitate subsequent use, the second part is used for performing word segmentation processing on the text data of comments and mapping words in the text data into word vectors, and a sample set T is finally obtained after data preprocessing.
In the step 2), text data of all comments in the sample set T is utilized, an unsupervised learning model is adopted to learn an attribute matrix W, the attribute matrix W is initialized randomly at first, an average word vector e is obtained through word vectors of the comments, weights corresponding to the word vectors are obtained according to the association condition of the average word vector e and each word vector in the comments, and the word vectors in the comments are weighted and summed to construct an original vector z of the comments; and then constructing a reconstruction vector r of the comment from the attribute matrix W according to the original vector z, training by taking a difference value between the reconstruction vector r and the original vector z as a target function, and finally obtaining the attribute matrix W of the field corresponding to the sample set T, wherein each dimension of the attribute matrix W represents a corresponding attribute vector.
In the step 3), constructing an attention-based neural network structure C which mainly comprises a memory network and a circulating neural network; for the sample set T, taking the text data of the comments in T as the input of C, and taking the real scoring data in T as the learning target of C; for the appointed users and commodities, firstly processing each comment by using a memory network and a recurrent neural network based on an attribute matrix W, processing the comment by using the memory network, obtaining an attribute vector a from the attribute matrix W, taking the attribute vector a as the attention of a recurrent neural network hidden layer to obtain the output v of the recurrent neural network, and connecting a and v to obtain a corresponding comment vector, wherein in the process, the attribute vector a is used as the attention so that the recurrent neural network can capture the local information related to a in the comment to increase the interpretability, then on the basis that different comments have different degrees of emotion, different weights are given to each comment vector according to the predicted emotion scores to further construct a user preference vector U and a commodity feature vector I, and meanwhile, an attribute vector f for the current users and commodities can be constructed according to the emotion scores, the emotion scores are used, so that comments with higher emotion scores have higher weights, and more information is provided for the construction of U or I, so that the interpretability is further increased; finally, the scores of the current user and the current commodity are predicted by utilizing the user preference U and the commodity feature vector I; this step increases the interpretability of the recommendation method through the use of attention mechanisms and sentiment scores.
In step 4), for a specific user, carrying out score prediction on the commodity set by using the attention-based neural network structure C trained in step 3), sorting the commodity set in a descending order according to scores, and taking the top N commodities as a recommended commodity list for the user; meanwhile, for the recommended commodities, the closest attribute vector is selected from the attribute matrix W obtained in the step 2) according to the attribute vector f calculated in the step 3), wherein each attribute vector corresponds to a specific attribute, and the attribute is used as the recommendation reason of the current commodities, so that the user experience is increased, and the purchase rate of the current commodities can also be improved.
Compared with the prior art, the invention has the following advantages and beneficial effects:
1. according to the method, the score and the comment data of the commodity are reasonably utilized, the missing score is predicted, and compared with a traditional score prediction algorithm, the accuracy of prediction is improved.
2. According to the invention, the attributes in the comment data are obtained through an unsupervised learning method, so that the process of manual labeling is reduced, manual intervention is reduced, and the model is easier to use and operate.
3. The comment data processing method and the comment data processing device simultaneously utilize the memory network and the recurrent neural network to construct a new network to process the comment data, capture the time sequence information of words in the comment and obtain the implicit characteristics of corresponding attribute levels compared with the traditional processing modes such as a theme model. And the problem that the subject model cannot process large-scale data is solved.
4. In the process of generating the prediction scores by the neural network structure, the invention uses the attention mechanism and the sentiment scores, increases the interpretability of the method, acquires the attribute characteristics from the comments and provides attribute level explanation for the final commodity recommendation.
Drawings
FIG. 1 is a general flow diagram of the process of the present invention.
Fig. 2 is a flowchart of S2 in fig. 1.
Fig. 3 is a flowchart of S3 in fig. 1.
Fig. 4 is a schematic diagram of the neural network structure a in fig. 3.
Detailed Description
In order to describe the present invention more specifically, a detailed description of the embodiments of the present invention will be given below with reference to the drawings and examples.
In this embodiment, a commodity recommendation method combining an attention network and user emotion is used to recommend a corresponding commodity to a user by using the scoring and comment data of commodities in an e-commerce platform, an overall flow of the method is shown in fig. 1, and the method mainly includes the following steps:
firstly, data collection and preprocessing:
the data of the embodiment is based on real historical data of the e-commerce platform, firstly, grading and comment data of users are collected from a large amount of historical behavior data of the users, and then filtering is carried out, wherein the specific filtering mode is that less than 5 pieces of user data of grading and comment behaviors are removed. After data collection, preprocessing of the data is required, which is mainly divided into two parts: the first part is that the ID of the user and the ID of the commodity are respectively mapped into numerical values so as to facilitate subsequent use; the second part is to preprocess the text data of the comment, in the embodiment, a stop word list is added through a jieba word segmentation tool, and the text data of the comment is segmented, so that the comment is composed of a plurality of words. And mapping all words into word vectors by utilizing the thought of word2vec and training in the word library of the whole comment, wherein the dimension of the word vectors is d. And finally forming a sample set T after preprocessing of data.
Secondly, constructing an attribute matrix W
This section corresponds to section S2 in fig. 1, and the flow thereof is shown in fig. 2. And training to obtain an attribute matrix W by using text data of comments in the T through an unsupervised learning model.
Firstly, randomly initializing an attribute matrix W, wherein the size of the attribute matrix W is k multiplied by d, k is the number of attributes, and d is the size of each attribute vector and is the same as the size of a word vector; and then training with the text data of all comments in T. The specific operations in this embodiment are: for the unsupervised learning model, each time a comment is input, an average word vector e is obtained by calculation according to all word vectors in the comment, then matrix mapping is carried out on the average word vector e and each word vector to obtain the weight of each word vector by calculation, and finally the original vector z of the comment is obtained by weighting. And then calculating the weight p of each attribute vector in the W by using the original vector z of the comment in the following calculation mode:
p＝softmax(Wa·z+b)
wherein, WaFor the weight matrix, b is the bias term, and the softmax function computes the weights for each dimension of the vector, which is defined as follows:
Figure BDA0002356363670000061
wherein x isiFor the ith dimension of the x vector, after a weight vector p is calculated, a reconstructed vector r of the comments is obtained by weighting and summing each attribute, wherein r is generated based on the attribute matrix. The calculation method is as follows:
r＝WT·p
wherein, WTFor the transpose of the attribute matrix W, p is the weight of each attribute vector.
And finally, training by using the difference between the reconstructed vector r of the comment and the original vector z of the comment as an objective function of the model to obtain a final attribute matrix W. And calculating 100 word vectors similar to the attribute vector from each dimension vector of the W to represent one attribute, thereby manually obtaining the specific attribute corresponding to each dimension vector in the W. (for example in the field of cell phones, the acquisition attribute might be camera, CPU, screen, etc.)
Thirdly, combining attention network and user emotion score prediction
This section corresponds to the section S3 in fig. 1, and the processing flow thereof is shown in fig. 3. The method mainly utilizes the comment and the grading data of the commodity to further construct a user preference vector U and a commodity feature vector I, and then uses the idea of a hidden factor model to obtain the final prediction grade.
The whole neural network structure is a parallel structure, the processing modes of users and commodities are similar, and only the learned parameters are different. For a specific user, assuming that there are m comments, processing each comment by the memory network and the recurrent neural network together to capture hidden information in the comment, and representing the parts of the memory network and the recurrent neural network by the neural network structure a, the schematic structural diagram is shown in fig. 4:
firstly, an average word vector e is obtained according to the word vectors in the comments, then e is used as a query vector of the memory network, a parameter matrix is initialized to be used as a key matrix K of the memory network, and a previously trained attribute matrix W is used as a value matrix of the memory network. And obtaining the weight of each attribute of the attribute matrix W from the key matrix K through the query vector e, and further carrying out weighted summation on each attribute vector in W to obtain an attribute vector a of the comment. Then, the word vectors in the comment are input into a recurrent neural network LSTM, and each word vector obtains a corresponding hidden layer vector h. And taking the attribute vector a obtained by the last step as attention, taking the correlation degree between the attribute vector a and the hidden layer vector h as a score, further calculating the weight of each hidden layer vector h, and weighting and summing all the hidden layer vectors h to obtain a vector v. And finally, connecting the vector a and the vector v to obtain a final comment vector l.
After the common processing of the memory network and the recurrent neural network, each comment is to obtain a comment vector l. Different reviews have different degrees of importance to the user, and each review vector contributes differently to the formation of the end user preference vector. Therefore, the score of each comment is mapped into the emotion score of the user for each comment, wherein the emotion score is 1 when the emotion score is higher than three points, and the emotion score is 0 when the emotion score is other points; and obtaining an emotion score vector s, wherein the size of the emotion score vector s is the number m of the comments, and the emotion score vector s ' is used as an emotion score label for training, wherein s ' is a predicted emotion score vector, the calculation method uses the idea of a latent semantic model for reference, and a sigmoid function is used for mapping the emotion score into a section from 0 to 1 for convenience of calculation as a weight, so that s ' can be calculated by the following formula:
s′＝sigmoid(qu T·pi+bu+bi+μ)
wherein q isuAs hidden vectors of the user, piIs an implicit vector of the commodity, mu is a global bias term, buBiasing terms for the user, biBiasing the items for the good. And the sigmoid function is defined as follows:
Figure BDA0002356363670000081
wherein e is a natural base number. And then, endowing each comment with different weights by using a softmax function, wherein a weight vector g of each comment is calculated by the following formula:
g＝softmax(s′)
wherein the softmax function is defined in accordance with the softmax function in the second step.
According to the weight vector g, all comment vectors are subjected to weighted summation to finally obtain a current user preference vector U, and according to the emotion weight vector g, a final attribute vector a for the user can also be obtainedu. For the commodity, the processing modeSimilarly, a commodity feature vector I and an attribute vector a for the commodity are finally obtainedi. To auAnd aiAnd averaging to obtain an attribute vector f for the user u and the commodity i. In this step, the attribute vector is used as the attention of the recurrent neural network, and the sentiment score is used as the weight of each comment, so that the interpretability of the method is increased, and the recommendation method is more convincing.
For user u and item i, the prediction scores are
Figure BDA0002356363670000082
The calculation formula is as follows:
Figure BDA0002356363670000083
where μ is the global bias term, buBiasing terms for the user, biAnd U is a commodity bias item, and I is a commodity feature vector.
For the whole neural network, a squared error loss function is adopted as a final objective function L, which is defined as follows:
Figure BDA0002356363670000091
where T is the entire training set, ru,iIn order to be a true score, the score,
Figure BDA0002356363670000092
is the predicted score. And Ω (θ) is a regular term of L2, where θ is a parameter set and λ is a coefficient of a regular term of L2.
And (4) obtaining a parameter set theta which is continuously updated through iterative training, and finally obtaining a final attention-based neural network C for predicting the score.
Fourthly, recommendation and explanation are provided
And for a specific user, carrying out score prediction on the commodity set by using the attention-based neural network structure C trained in the S3, sorting the commodity set in a descending order according to the scores, and taking the top N commodities as a recommended commodity list for the user. At the same time, for the recommended product, any one of the attributes is selected from the attribute matrix W based on the attribute vector f calculated in S3, and the reason for recommending the current product is, for example: "recommend commodity a to you because commodity a has excellent attribute B, and you pay more attention to attribute B", this process increases user experience, and can also improve the purchase rate of the current commodity.
The above-mentioned embodiments are merely preferred embodiments of the present invention, and the scope of the present invention is not limited thereto, so that the changes in the shape and principle of the present invention should be covered within the protection scope of the present invention.

Claims (5)

1.一种结合注意力网络和用户情感的商品推荐方法，其特征在于，包括以下步骤：1. a product recommendation method combining attention network and user emotion, is characterized in that, comprises the following steps: 1)对电商平台中的用户历史行为数据进行处理，主要提取出用户对商品的评分和评论数据，包含评论的文本数据，并对评论数据进行预处理后，构建样本集合T；1) Process the user's historical behavior data in the e-commerce platform, mainly extract the user's rating and comment data on the product, including the text data of the comment, and construct a sample set T after preprocessing the comment data; 2)采用无监督的学习模型，利用样本集合T中评论的文本数据，不断训练最终得到样本集合T的属性矩阵W；2) Using an unsupervised learning model, using the text data of the comments in the sample set T, continuously train to finally obtain the attribute matrix W of the sample set T; 3)构建基于注意力的神经网络结构C，其利用基于属性矩阵W的记忆网络和循环神经网络作为基础，并使用预测的情感得分作为权重，进而构建用户偏好向量U和商品特征向量I，最终利用用户偏好向量U和商品特征向量I计算出缺失评分的预测值，与此同时，计算出对于当前用户和商品的属性向量，用于最终的推荐解释；3) Construct an attention-based neural network structure C, which uses the memory network and recurrent neural network based on the attribute matrix W as the basis, and uses the predicted sentiment score as the weight, and then constructs the user preference vector U and the commodity feature vector I, and finally Use the user preference vector U and the product feature vector I to calculate the predicted value of the missing score, and at the same time, calculate the attribute vector for the current user and product for the final recommendation explanation; 4)根据预测的评分进行降序排序，为用户推荐前N个商品，并根据步骤2)得到的属性矩阵W和步骤3)得到的属性向量，进而为推荐结果提供属性级别的解释。4) Sort in descending order according to the predicted scores, recommend the top N products for the user, and provide attribute-level explanations for the recommendation results according to the attribute matrix W obtained in step 2) and the attribute vector obtained in step 3). 2.根据权利要求1所述的一种结合注意力网络和用户情感的商品推荐方法，其特征在于：在步骤1)中，从电商平台中的用户历史行为数据中提取出用户对商品的评分和评论数据，制定人工规则，过滤掉部分无用数据，并对评论数据进行预处理，分为两部分，第一部分是将用户的ID和商品的ID映射为数值，以方便后续使用，第二部分是对评论的文本数据进行分词处理以及将文本数据中的词映射为词向量，经过数据预处理后最终得到样本集合T。2. a kind of product recommendation method combining attention network and user emotion according to claim 1 is characterized in that: in step 1), from the user's historical behavior data in the e-commerce platform, the user's preference for the product is extracted. Score and comment data, formulate manual rules, filter out some useless data, and preprocess the comment data. It is divided into two parts. The first part is to map the user's ID and the product's ID to a numerical value to facilitate subsequent use. The second The part is to segment the text data of the comments and map the words in the text data to word vectors, and finally obtain the sample set T after data preprocessing. 3.根据权利要求1所述的一种结合注意力网络和用户情感的商品推荐方法，其特征在于：在步骤2)中，利用样本集合T中所有评论的文本数据，采用无监督的学习模型来学习属性矩阵W，首先随机初始化属性矩阵W，通过评论的词向量求得平均词向量e，再根据平均词向量e与评论中每个词向量的关联情况获得每个词向量对应的权重，对评论中的词向量加权求和构建出评论的原始向量z；再根据原始向量z，从属性矩阵W中构建出评论的重构向量r，以重构向量r与原始向量z的差异值作为目标函数进行训练，最终获得样本集合T对应领域的属性矩阵W，其中该属性矩阵W的每一维代表一个对应的一个属性向量。3. a kind of product recommendation method combining attention network and user emotion according to claim 1, is characterized in that: in step 2), utilize the text data of all comments in sample set T, adopt unsupervised learning model To learn the attribute matrix W, first randomly initialize the attribute matrix W, obtain the average word vector e through the word vector of the comment, and then obtain the corresponding weight of each word vector according to the relationship between the average word vector e and each word vector in the comment, The original vector z of the comment is constructed by the weighted summation of the word vectors in the comment; then, according to the original vector z, the reconstructed vector r of the comment is constructed from the attribute matrix W, and the difference between the reconstructed vector r and the original vector z is used as the The objective function is trained, and finally the attribute matrix W of the corresponding field of the sample set T is obtained, wherein each dimension of the attribute matrix W represents a corresponding attribute vector. 4.根据权利要求1所述的一种结合注意力网络和用户情感的商品推荐方法，其特征在于：在步骤3)中，构建基于注意力的神经网络结构C，其主要包括记忆网络和循环神经网络两部分；对于样本集合T，将T中评论的文本数据作为C的输入，而T中的真实评分数据则作为C的学习的目标；对于指定的用户和商品，首先利用基于属性矩阵W的记忆网络和循环神经网络对其每一条评论进行处理，记忆网络处理评论，从属性矩阵W中得到属性向量a，将属性向量a作为循环神经网络隐藏层的注意力，得到循环神经网络的输出v，将a和v联结得到对应的评论向量，这一过程，将属性向量a用作注意力，使得循环神经网络能够捕获评论中与a有关的局部信息，以增加可解释性，接着以不同评论拥有不同程度的情感为基础，根据预测的情感得分为每一个评论向量赋予不同的权重，进而构建用户偏好向量U和商品特征向量I，同时根据情感得分能够构建得到对于当前用户和商品的属性向量f，情感得分的使用，使得情感得分更高的评论具有更高的权重，为U或者I的构建提供更多的信息，以进一步增加可解释性；最后利用用户偏好U和商品特征向量I，对当前用户和商品的评分进行预测；此步骤通过注意力机制以及情感得分的使用，增加了推荐方法的可解释性。4. a kind of product recommendation method combining attention network and user emotion according to claim 1, it is characterized in that: in step 3), build the neural network structure C based on attention, it mainly comprises memory network and loop The neural network has two parts; for the sample set T, the text data of the comments in T is used as the input of C, and the real rating data in T is used as the learning target of C; for the specified users and products, the attribute matrix W is first used. The memory network and the recurrent neural network process each comment, the memory network processes the comments, obtains the attribute vector a from the attribute matrix W, and uses the attribute vector a as the attention of the hidden layer of the recurrent neural network to obtain the output of the recurrent neural network. v, connect a and v to get the corresponding comment vector. In this process, the attribute vector a is used as attention, so that the recurrent neural network can capture the local information related to a in the comment to increase the interpretability, and then use different Comments are based on different degrees of emotion. According to the predicted sentiment score, each comment vector is given different weights, and then the user preference vector U and the product feature vector I are constructed. At the same time, the attributes of the current user and product can be constructed according to the sentiment score. The vector f, the use of sentiment score, makes comments with higher sentiment scores have higher weights, providing more information for the construction of U or I to further increase interpretability; finally, use user preference U and product feature vector I , to predict the ratings of the current user and item; this step increases the interpretability of the recommendation method through the use of attention mechanisms and sentiment scores. 5.根据权利要求1所述的一种结合注意力网络和用户情感的商品推荐方法，其特征在于：在步骤4)中，对于一个特定的用户，利用步骤3)中训练完毕的基于注意力的神经网络结构C，对商品集合进行评分预测并根据评分降序排序，取前N个商品，作为对于该用户的推荐商品列表；于此同时，对于推荐的商品，根据步骤3)中计算得到的属性向量f，从步骤2)中得到的属性矩阵W中选取最接近的一个属性向量，其中每一个属性向量对应一个特定的属性，将此属性作为当前商品的推荐理由，增加用户体验，也能提高当前商品的购买率。5. a kind of product recommendation method combining attention network and user emotion according to claim 1 is characterized in that: in step 4), for a specific user, utilize the attention-based attention trained in step 3). The neural network structure C of , predicts the score of the product set and sorts it in descending order according to the score, and takes the first N products as the recommended product list for the user; at the same time, for the recommended products, according to step 3) Calculated Attribute vector f, select the closest attribute vector from the attribute matrix W obtained in step 2), where each attribute vector corresponds to a specific attribute, this attribute is used as the recommendation reason for the current product, and the user experience can be increased. Increase the purchase rate of current items.
CN202010008804.1A 2020-01-06 2020-01-06 Commodity recommendation method combining attention network and user emotion Expired - Fee Related CN111222332B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010008804.1A CN111222332B (en) 2020-01-06 2020-01-06 Commodity recommendation method combining attention network and user emotion

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010008804.1A CN111222332B (en) 2020-01-06 2020-01-06 Commodity recommendation method combining attention network and user emotion

Publications (2)

Publication Number Publication Date
CN111222332A true CN111222332A (en) 2020-06-02
CN111222332B CN111222332B (en) 2021-09-21

Family

ID=70828140

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010008804.1A Expired - Fee Related CN111222332B (en) 2020-01-06 2020-01-06 Commodity recommendation method combining attention network and user emotion

Country Status (1)

Country Link
CN (1) CN111222332B (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111782765A (en) * 2020-06-24 2020-10-16 安徽农业大学 A Recommendation Method Based on Graph Attention Mechanism
CN112069402A (en) * 2020-08-28 2020-12-11 山东省人工智能研究院 Personalized comment recommendation method based on emotion and graph convolution neural network
CN112100485A (en) * 2020-08-20 2020-12-18 齐鲁工业大学 A review-based rating prediction method and system for item recommendation
CN112182156A (en) * 2020-09-28 2021-01-05 齐鲁工业大学 Aspect-level interpretable deep network score prediction recommendation method based on text processing
CN112200623A (en) * 2020-09-27 2021-01-08 深圳市其乐游戏科技有限公司 Product recommendation method, device, equipment and storage medium
CN112270570A (en) * 2020-11-03 2021-01-26 重庆邮电大学 A Click Conversion Rate Prediction Method Based on Feature Combination and Representation Learning
CN112308666A (en) * 2020-10-26 2021-02-02 福建菩泰网络科技有限公司 Method and system for recommending online shopping mall commodities
CN112435103A (en) * 2020-12-18 2021-03-02 东北大学 Intelligent recommendation method and system for post diversity explanation
CN112785331A (en) * 2021-01-07 2021-05-11 之江实验室 Injection attack resistant robust recommendation method and system combining evaluation text
CN112884551A (en) * 2021-02-19 2021-06-01 武汉大学 Commodity recommendation method based on neighbor users and comment information
CN113159891A (en) * 2021-04-24 2021-07-23 桂林电子科技大学 Commodity recommendation method based on fusion of multiple user representations
CN113159892A (en) * 2021-04-24 2021-07-23 桂林电子科技大学 Commodity recommendation method based on multi-mode commodity feature fusion
CN114357283A (en) * 2021-12-10 2022-04-15 安徽农业大学 Recommendation method based on comment and self-attention mechanism
CN114385926A (en) * 2021-12-02 2022-04-22 山东师范大学 Robust recommendation method and system for reducing the proportion of useless information in attack environment
CN114529340A (en) * 2022-02-18 2022-05-24 浪潮卓数大数据产业发展有限公司 Shop recommendation method and device and computer medium
WO2022135118A1 (en) * 2020-12-23 2022-06-30 浙江大学 Combined product mining method based on knowledge graph rule embedding
CN114691988A (en) * 2022-03-23 2022-07-01 华南理工大学 A cross-domain recommendation method based on personalized transfer of user preferences

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105095477A (en) * 2015-08-12 2015-11-25 华南理工大学 Recommendation algorithm based on multi-index grading
CN105678590A (en) * 2016-02-07 2016-06-15 重庆邮电大学 topN recommendation method for social network based on cloud model
CN107862343A (en) * 2017-11-28 2018-03-30 南京理工大学 The rule-based and comment on commodity property level sensibility classification method of neutral net
CN108230059A (en) * 2016-12-13 2018-06-29 中国联合网络通信集团有限公司 Film recommends method and device
CN108399158A (en) * 2018-02-05 2018-08-14 华南理工大学 Attribute sensibility classification method based on dependency tree and attention mechanism
CN108959409A (en) * 2018-06-06 2018-12-07 电子科技大学 A Matrix Factorization Recommendation Algorithm Combining Topic and Sentiment Information in Reviews
CN109325120A (en) * 2018-09-14 2019-02-12 江苏师范大学 A Text Sentiment Classification Method for Separating User and Product Attention Mechanisms
CN110008377A (en) * 2019-03-27 2019-07-12 华南理工大学 A method for movie recommendation using user attributes
CN110097089A (en) * 2019-04-05 2019-08-06 华南理工大学 A kind of sensibility classification method of the documentation level based on attention combination neural net
CN110362817A (en) * 2019-06-04 2019-10-22 中国科学院信息工程研究所 A kind of viewpoint proneness analysis method and system towards product attribute
CN110399565A (en) * 2019-07-29 2019-11-01 北京理工大学 Points of interest recommendation method based on recurrent neural network based on spatio-temporal periodic attention mechanism
CN110517121A (en) * 2019-09-23 2019-11-29 重庆邮电大学 Commodity recommendation method and commodity recommendation device based on comment text sentiment analysis
CN110532379A (en) * 2019-07-08 2019-12-03 广东工业大学 A kind of electronics information recommended method of the user comment sentiment analysis based on LSTM
CN110599307A (en) * 2019-09-17 2019-12-20 北京三快在线科技有限公司 Commodity recommendation method and device

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105095477A (en) * 2015-08-12 2015-11-25 华南理工大学 Recommendation algorithm based on multi-index grading
CN105678590A (en) * 2016-02-07 2016-06-15 重庆邮电大学 topN recommendation method for social network based on cloud model
CN108230059A (en) * 2016-12-13 2018-06-29 中国联合网络通信集团有限公司 Film recommends method and device
CN107862343A (en) * 2017-11-28 2018-03-30 南京理工大学 The rule-based and comment on commodity property level sensibility classification method of neutral net
CN108399158A (en) * 2018-02-05 2018-08-14 华南理工大学 Attribute sensibility classification method based on dependency tree and attention mechanism
CN108959409A (en) * 2018-06-06 2018-12-07 电子科技大学 A Matrix Factorization Recommendation Algorithm Combining Topic and Sentiment Information in Reviews
CN109325120A (en) * 2018-09-14 2019-02-12 江苏师范大学 A Text Sentiment Classification Method for Separating User and Product Attention Mechanisms
CN110008377A (en) * 2019-03-27 2019-07-12 华南理工大学 A method for movie recommendation using user attributes
CN110097089A (en) * 2019-04-05 2019-08-06 华南理工大学 A kind of sensibility classification method of the documentation level based on attention combination neural net
CN110362817A (en) * 2019-06-04 2019-10-22 中国科学院信息工程研究所 A kind of viewpoint proneness analysis method and system towards product attribute
CN110532379A (en) * 2019-07-08 2019-12-03 广东工业大学 A kind of electronics information recommended method of the user comment sentiment analysis based on LSTM
CN110399565A (en) * 2019-07-29 2019-11-01 北京理工大学 Points of interest recommendation method based on recurrent neural network based on spatio-temporal periodic attention mechanism
CN110599307A (en) * 2019-09-17 2019-12-20 北京三快在线科技有限公司 Commodity recommendation method and device
CN110517121A (en) * 2019-09-23 2019-11-29 重庆邮电大学 Commodity recommendation method and commodity recommendation device based on comment text sentiment analysis

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
MUHAMMAD IBRAHIM: "A Neural Network-Inspired Approach for Improved and True Movie Recommendations", 《ADVANCES IN RECENT NATURE-INSPIRED ALGORITHMS FOR NEURAL ENGINEERING》 *
ONDREJ KASSAK: "User Preference Modeling by Global and Individual Weights for Personalized Recommendation", 《ACTA POLYTECHNICA HUNGARICA》 *
QIAO LIU: "STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation", 《PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MININGJULY》 *
单晓红: "基于在线评论的混合推荐算法", 《系统工程》 *
孔德江: "面向序列数据的深度学习算法研究", 《中国博士学位论文全文数据库 信息科技辑》 *
高茂庭: "基于循环神经网络的推荐算法", 《计算机工程》 *

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111782765A (en) * 2020-06-24 2020-10-16 安徽农业大学 A Recommendation Method Based on Graph Attention Mechanism
CN112100485A (en) * 2020-08-20 2020-12-18 齐鲁工业大学 A review-based rating prediction method and system for item recommendation
CN112069402B (en) * 2020-08-28 2021-04-20 山东省人工智能研究院 Personalized comment recommendation method based on emotion and graph convolution neural network
CN112069402A (en) * 2020-08-28 2020-12-11 山东省人工智能研究院 Personalized comment recommendation method based on emotion and graph convolution neural network
CN112200623A (en) * 2020-09-27 2021-01-08 深圳市其乐游戏科技有限公司 Product recommendation method, device, equipment and storage medium
CN112182156B (en) * 2020-09-28 2023-02-07 齐鲁工业大学 Aspect-Level Interpretable Deep Network Score Prediction Recommendation Method Based on Text Processing
CN112182156A (en) * 2020-09-28 2021-01-05 齐鲁工业大学 Aspect-level interpretable deep network score prediction recommendation method based on text processing
CN112308666A (en) * 2020-10-26 2021-02-02 福建菩泰网络科技有限公司 Method and system for recommending online shopping mall commodities
CN112270570B (en) * 2020-11-03 2022-03-11 重庆邮电大学 A Click Conversion Rate Prediction Method Based on Feature Combination and Representation Learning
CN112270570A (en) * 2020-11-03 2021-01-26 重庆邮电大学 A Click Conversion Rate Prediction Method Based on Feature Combination and Representation Learning
CN112435103B (en) * 2020-12-18 2023-11-24 东北大学 An intelligent recommendation method and system for ex post diversity explanation
CN112435103A (en) * 2020-12-18 2021-03-02 东北大学 Intelligent recommendation method and system for post diversity explanation
WO2022135118A1 (en) * 2020-12-23 2022-06-30 浙江大学 Combined product mining method based on knowledge graph rule embedding
CN112785331A (en) * 2021-01-07 2021-05-11 之江实验室 Injection attack resistant robust recommendation method and system combining evaluation text
CN112884551A (en) * 2021-02-19 2021-06-01 武汉大学 Commodity recommendation method based on neighbor users and comment information
CN112884551B (en) * 2021-02-19 2023-08-18 武汉大学 Commodity recommendation method based on neighbor users and comment information
CN113159892A (en) * 2021-04-24 2021-07-23 桂林电子科技大学 Commodity recommendation method based on multi-mode commodity feature fusion
CN113159891B (en) * 2021-04-24 2022-05-17 桂林电子科技大学 A product recommendation method based on the fusion of multiple user representations
CN113159892B (en) * 2021-04-24 2022-05-06 桂林电子科技大学 A product recommendation method based on multimodal product feature fusion
CN113159891A (en) * 2021-04-24 2021-07-23 桂林电子科技大学 Commodity recommendation method based on fusion of multiple user representations
CN114385926A (en) * 2021-12-02 2022-04-22 山东师范大学 Robust recommendation method and system for reducing the proportion of useless information in attack environment
CN114385926B (en) * 2021-12-02 2024-11-15 山东师范大学 Robust recommendation method and system for reducing the proportion of useless information in attack environment
CN114357283A (en) * 2021-12-10 2022-04-15 安徽农业大学 Recommendation method based on comment and self-attention mechanism
CN114357283B (en) * 2021-12-10 2024-08-02 安徽农业大学 Recommendation method based on comment and self-attention mechanism
CN114529340A (en) * 2022-02-18 2022-05-24 浪潮卓数大数据产业发展有限公司 Shop recommendation method and device and computer medium
CN114691988A (en) * 2022-03-23 2022-07-01 华南理工大学 A cross-domain recommendation method based on personalized transfer of user preferences

Also Published As

Publication number Publication date
CN111222332B (en) 2021-09-21

Similar Documents

Publication Publication Date Title
CN111222332B (en) Commodity recommendation method combining attention network and user emotion
CN112598462B (en) Personalized recommendation method and system based on collaborative filtering and deep learning
WO2021139164A1 (en) Sequential recommendation method based on long-term interest and short-term interest
CN108537624B (en) A travel service recommendation method based on deep learning
CN114202061A (en) Article recommendation method, electronic device and medium based on generation of confrontation network model and deep reinforcement learning
CN110245285B (en) A Personalized Recommendation Method Based on Heterogeneous Information Network
CN111339415A (en) A CTR Prediction Method and Device Based on Multi-Interactive Attention Network
CN107563841A (en) A kind of commending system decomposed that scored based on user
Fareed et al. A collaborative filtering recommendation framework utilizing social networks
CN106156333B (en) A kind of improvement list class collaborative filtering method of mosaic society's information
CN112905739A (en) False comment detection model training method, detection method and electronic equipment
CN112860998B (en) Click rate estimation method based on multi-task learning mechanism
CN112085525A (en) User network purchasing behavior prediction research method based on hybrid model
CN108647226A (en) A kind of mixing recommendation method based on variation autocoder
CN113190751B (en) A Recommendation Method for Fusion Keyword Generation
CN114942974A (en) E-commerce platform commodity user evaluation emotional tendency classification method
CN106339718A (en) Classification method based on neural network and classification device thereof
Yi et al. Graphical visual analysis of consumer electronics public comment information mining under knowledge graph
CN114022233A (en) A Novel Product Recommendation Method
CN118154235A (en) Method, device and storage medium for predicting commodity marketing topic communication behavior
CN112435103A (en) Intelligent recommendation method and system for post diversity explanation
Bisane et al. A comprehensive product review system for improved customer satisfaction
CN118113938A (en) Recommendation method based on contrast learning and multi-behavior semantic enhancement
Alqhatani et al. IoT-driven hybrid deep collaborative transformer with federated learning for personalized e-commerce recommendations: An optimized approach
CN111723302A (en) Recommendation method based on collaborative dual-model deep representation learning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210921