CN117648493A - Cross-domain recommendation method based on graph learning - Google Patents
Cross-domain recommendation method based on graph learning Download PDFInfo
- Publication number
- CN117648493A CN117648493A CN202311712911.2A CN202311712911A CN117648493A CN 117648493 A CN117648493 A CN 117648493A CN 202311712911 A CN202311712911 A CN 202311712911A CN 117648493 A CN117648493 A CN 117648493A
- Authority
- CN
- China
- Prior art keywords
- user
- domain
- item
- learning
- representation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000008569 process Effects 0.000 claims abstract description 13
- 238000012512 characterization method Methods 0.000 claims abstract description 12
- 238000013528 artificial neural network Methods 0.000 claims abstract description 10
- 230000005012 migration Effects 0.000 claims abstract description 5
- 238000013508 migration Methods 0.000 claims abstract description 5
- 230000002195 synergetic effect Effects 0.000 claims abstract description 4
- 230000006870 function Effects 0.000 claims description 30
- 230000003993 interaction Effects 0.000 claims description 16
- 238000013461 design Methods 0.000 claims description 9
- 230000004927 fusion Effects 0.000 claims description 8
- 230000007246 mechanism Effects 0.000 claims description 7
- 238000012549 training Methods 0.000 claims description 6
- 238000005457 optimization Methods 0.000 claims description 5
- 230000002708 enhancing effect Effects 0.000 claims description 4
- 230000008901 benefit Effects 0.000 claims description 3
- 230000000052 comparative effect Effects 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 claims description 3
- 238000013507 mapping Methods 0.000 claims description 3
- 239000000203 mixture Substances 0.000 claims description 3
- 230000008447 perception Effects 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 238000013527 convolutional neural network Methods 0.000 claims description 2
- 238000000844 transformation Methods 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 4
- 230000004913 activation Effects 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000003623 enhancer Substances 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Landscapes
- Machine Translation (AREA)
Abstract
The invention discloses a cross-domain recommendation method based on graph learning. The method reasonably judges the effectiveness and feasibility of the proposed cross-domain recommendation method by predicting the probability of a given user item pair. Mainly comprises three parts: the first part precisely separates domain-invariant features and domain-specific features of the domain in a spatially mapped manner, and aggregates user-project high-order synergistic relationship information using a lightweight graph convolution neural network to pre-enhance the information content of the disentangled tokens. The second part considers that the information quantity of the characterization after the disentanglement is further assisted and enhanced through the heterogeneous graph neural network by means of the social relationship and the project dependency relationship of the user, and meanwhile, personalized knowledge migration of the user and the project embedding is carried out through the meta network, so that the heterogeneous relationship learning is realized. The third part builds two contrast learning tasks, one is to monitor the disentanglement process, so that the disentanglement process can obtain embedded characterization with low redundancy and light noise to a certain degree in the initial stage, and the other is to enhance the robustness of self-enhanced heterogeneous relation learning. The invention combines the related technologies such as graph learning, contrast learning and the like, effectively utilizes the side information to realize user-project characterization modeling, and improves the performance of personalized cross-domain recommendation.
Description
Technical Field
The invention belongs to the technical field of cross-domain recommendation systems, and particularly relates to a cross-domain recommendation method based on graph learning.
Background
The challenge of data sparsity has been a long-felt problem in Recommendation Systems (RSs). Cross-domain recommendations (CDRs) facilitate seamless migration of knowledge from source domain to target domain to address this challenge and improve personalized recommendations. The existing CDR method mainly focuses on the scene of user overlapping, and realizes knowledge transfer based on shared user representation. However, these approaches take into account the consistency of user interests, ignoring the multi-dimensional differences in user preferences across domains. Based on this, recent studies have attempted to generate domain-invariant features and domain-specific features. Nevertheless, identifying and packaging disparate semantic data in complex data sets presents certain challenges. Thus, the challenge of building a representation with rich multi-dimensional semantics to mitigate data sparsity arises. In reality, the social network association structure between users presents dynamic features. Meanwhile, mutual dependency exists between items. Therefore, integrating heterogeneous information to help enrich the information content of domain-invariant and domain-specific representations, thereby improving the performance of the recommendation system, is a solution worthy of research.
In recent years, graph Neural Networks (GNNs) have achieved significant success in feature extraction in non-euclidean space. This motivated the researchers' search for heterographic neural networks (Hetero-GNNs). Their goal is to smartly integrate rich semantic information from heterogeneous relationships into potential tokens. However, due to the sparsity of data, contemporary Hetero-GNNs have difficulty achieving high quality user/item embedding. Fortunately, contrast Learning (CL) was proposed. It is particularly suitable for alleviating the problem of data scarcity because it can self-enhance unlabeled data. Subsequently, one notable advance is the integration of CL with GNN. This synergy is known as Graph Contrast Learning (GCL). It may enhance the robustness of the representation learning in the graph structure without enough observation of the labels. Therefore, inspired from previous GCL studies, the present invention proposes hetero-relationship contrast learning. The invention aims to enrich the representation information quantity after the entanglement and enhance the individuation performance of cross-domain recommendation.
The invention obtains light noise, low redundancy and high richness depth representation by separating domain invariant features from domain specific features while embedding heterogeneous semantic relationships therein. Based on this, the present invention needs to face the problems that: (1) How to accurately separate domain-invariant features from domain-specific features in complex user-project interactions. (2) How to integrate the heterogeneous semantic relationships to enrich the information content of the disentangled characterization. (3) How to reduce noise and redundancy in the disentangled user and project representations.
Disclosure of Invention
The invention aims at the problems, and designs and invents a cross-domain recommendation method based on graph learning. Specifically, the present invention exploits a feature abstraction component to separate domain-invariant and domain-specific representations while capturing high-level collaboration information from a user-project interaction graph. The invention designs a heterogeneous representation learning component. The component employs a Hetero-GNN as an encoder to preserve rich semantic information related to heterogeneous relationships. Furthermore, a self-supervising presentation enhancement component is proposed that comprises two CL paradigms. The invention aims to realize personalized knowledge transfer through self-adaptive contrast enhancement while supervising the entanglement.
In order to achieve the above purpose, the invention adopts the following technical scheme:
a cross-domain recommendation method based on graph learning comprises the following steps:
step 1: first, abstracting the user and item representation of each domain to domain-invariant and domain-specific space, initializing the disentangled embedded token. A lightweight graph convolution neural network is used in the interaction graph to aggregate user-project high-order synergistic relationship information to pre-enhance the amount of information represented by the user and project after de-entanglement.
In said step 1, the invention first introduces user-item pairs as input. By sampling from a gaussian normal distribution, two independent embedding matrices are randomly generatedAnd->To generate an initial embedding->Representing the initial embedded representations of the generated user and item, respectively.
Second, the present invention separates the domain-invariant representation and domain-specific representation of users and items in a spatially mapped manner. In particular, the invention willAnd->Abstract into two independent subspaces, namely a domain-invariant space x and a domain-specific space y. Every user +.>The representation of (2) will be->Two-part composition, representing the domain-invariant and domain-specific representation of item u, respectively, and item +.>And the same is true. Next, it is considered to enrich the de-entangled representation in advance in the interaction map using higher-order collaboration information. The invention fuses the learned characteristics of each layer of graph after convolution, captures multi-order neighbor semantics, and defines a fusion function as follows:
next, consider utilizing higher-order collaboration information in an interaction graphTo pre-enrich the de-entangled representation. Taking the field-invariant as an example, in the present inventionAnd->Can be abstracted into:
wherein,is a mean function>Representing the join operation, the enrichment of user and item representations for a particular domain may be performed similarly. The present invention connects enhanced domain-invariant and domain-specific user and item representations to achieve a more comprehensive embedded representation. The specific operations can be summarized as follows:
where || denotes a connection operation. This enrichment process is for D (s) And D (t) Are identical.And->As an initial embedded representation of the next-to-be-implemented personalized rich user and item and.
And 2, obtaining embedding for modeling social relationships and project dependency relationships of users from the disentangled domain space, fusing relationship perception semantics into disentangled user and project representations through a heterogeneous graph neural network, and meanwhile, carrying out personalized knowledge migration of the users and the projects through a meta network to realize heterogeneous relationship learning.
In the step 2, as heterogeneous information contains rich semantic information, the user and the item representation are further enriched by combining the advantage. An initial embedding for modeling user social relationships and project dependencies is first derived from the above-described embedding.Representing the user-user, item-item and the representation of the relationship between user-item, respectively, the initial representation derived by this mechanism has heterogeneity in the modeling of the user and item relationship and is>Share the same semantics. The embedded characterization is again learned through the heterographing convolutional neural network.
Inspired by the soft-element path design, the information in each iteration is aggregated from heterogeneous relationships. Through multiple iterations of heterogeneous message propagation, the high-order embedding preserves the heterogeneous semantics of the multi-hop connection. In particular, the embedding of users and items is updated by custom heterogeneous fusion programs.
Wherein,is a mean function>Representing the connection operation. />Is an end user and item representation after fusing the heterogeneous side information, and similar steps are adopted to obtain the corresponding +.>
To generate a personalized mapping of the auxiliary view to the user-item interaction code of each user and each item, first the meta-knowledge is extractedImportant features of the user and the item are preserved in the auxiliary view and the interactive view. To facilitate user and project embedded personalized transformations, multiple Layer Perceptron (MLP) is used to transform meta-knowledge representations into weight matricesTo obtain a more comprehensive representation, the present invention uses weighted summation to integrate the user and item representations. />Representing the final embedding for recommending primary tasks, this series of processes for spaces y and D (t) The same is true.
And 3, constructing two CL tasks. The MI mutual information maximization mechanism is based on a contrast learning target design, and in order to monitor the disentanglement process, the embedded characterization with low redundancy and light noise can be obtained to a certain degree in the initial stage. The contrast learning objective is designed based on the info nce loss function in order to enhance the robustness of learning with self-enhanced heterogeneous relationships.
In the step 3, two comparison learning tasks are constructed. Under the influence of the maximum Mutual Information (MI), the invention hopes to mitigate the influence of noise and redundancy, and the comparative learning targets based on the design are as follows:
where c (-) is a cosine similarity function and τ is a parameter that controls the smoothness of the softmax curve. The inspiration is obtained from the success of the contrast learning of the info nce loss function, enhancing the user-item representation learning in the model. This procedure is as follows:
wherein,respectively is a matrix->Is used to determine the embedded vector of (a). g (-) represents a similarity function, +.>Is a super parameter of the softmax temperature. Based on the above method, the project, the space y and D can be obtained as well (t) Is a comparison learning objective. Overall, total contrast loss->Is a weighted sum of all losses.
Step 4, the invention connects the domain-invariant representation and domain-specific representation of the user and item, respectively, to generate a final representation and predict the probability of a given user item pair. Given two domains D (s) And D (t) In the case of (a) the Top-k recommendation with implicit feedback for all users in each domain is considered to improve the recommendation performance for both domains simultaneously.
In the step 4, the invention predicts D by dot product (s) The possibility of user-item interactions. In the optimization stage, the invention follows a classical ordering model, and utilizes Bayesian personalized ordering (BPR) recommended loss as main task loss to further optimize parameters. The present invention proposes a training strategy paradigm to better learn information from different angles and further optimize the model. The total training loss is as follows:
wherein Ω is a model parameter that can be learned, η 1 And eta 2 Is a weight used to control the self-supervising signal and regularization term.
The cross-domain recommendation method based on graph learning provided by the invention has the beneficial effects that:
(1) The invention provides a cross-domain recommendation characterization learning strategy. It emphasizes the key distinction between domain-invariant features and domain-specific features and integrates heterogeneous relationship semantics into the de-entangled representation. This enhances personalized semantic interactions between the user and the item in the recommendation.
(2) The invention designs two comparison learning tasks. Firstly, generating a supervision signal based on MI (MI) for a disentanglement process; another is to enhance the isopgram comparison learning with a meta-network to enable customized knowledge extraction from users and projects.
(3) The invention provides a cross-domain recommendation solution, which improves the cross-domain recommendation performance by effectively utilizing graph learning knowledge.
Drawings
For a clearer description of embodiments of the present application or of the solutions in the prior art, the drawings that are needed in the embodiments will be briefly described, and it is obvious that the drawings in the following description are only some embodiments described in the present invention, and that other drawings can be obtained according to these drawings by a person having ordinary skill in the art.
FIG. 1 is a schematic diagram of the overall structure of a model according to the present invention;
FIG. 2 is a schematic diagram of a generic isomerism diagram construction in accordance with the present invention;
FIG. 3 is a schematic diagram of a general comparative learning process according to the present invention.
Detailed Description
In order to better understand the above technical solutions, the following further details of the technical solutions of the present invention are described with reference to the accompanying drawings and examples. The relevant experiments of the present examples are based on the Python 3.8 version and Pytorch deep learning framework of the programming language. All experiments were run on NVIDIAGPU T4. And carrying out parameter learning optimization on the model by utilizing Adam.
The cross-domain recommendation method based on graph learning provided by the invention mainly comprises three parts: domain feature abstraction, heterogeneous representation learning, and self-supervised characterization enhancement. Without loss of generality, the present invention is described in domain D (s) Modeling is elaborated for the example.
Step 1, a domain feature abstract module. First, abstracting the user and item representation of each domain to domain-invariant and domain-specific space, initializing the disentangled embedded token. A lightweight graph convolution neural network is used in the interaction graph to aggregate user-project high-order synergistic relationship information to pre-enhance the amount of information represented by the user and project after de-entanglement.
(1) De-entangled representation generator
The module separates the domain-invariant representation from the domain-specific representation. The invention first introduces the user-item pairs (u, i (s) ) And (u, i) (t) ) As input. Then, two independent embedding matrices are randomly generatedAnd->As an initial embedding, by sampling from a gaussian normal distribution:
where α represents a gaussian normal distribution with a mean value of 0 and a standard deviation of 0.1. h is a u Andis a single thermal encoding of user and item, +.>And->Respectively are provided withRepresenting the initial embedded representation of the generated user and item.
Based on the embedding, the present invention separates the domain-invariant representation and domain-specific representation of users and items in a spatially mapped manner. In particular, the invention willAnd->Abstractions are two independent subspaces:
where x, y represents the dimension space of the shared and specific representation, σ (·) is the activation function, Θ x (～),Θ y (-) is a projection space mapping function. Each userThe representation of (2) will be->Two-part composition, representing the domain-invariant and domain-specific representation of item u, respectively, and item +.>And the same is true.
(2) Collaboration enhancer
Since recent studies have demonstrated the effectiveness of LightGCN, the present invention considers the utilization of higher order collaboration information in interactive graphs to pre-enrich the amount of representation information after disentanglement. Taking the field-invariant as an example, in the present inventionAnd->Can be abstracted into:
the invention fuses the learned characteristics of each layer of graph after convolution, captures multi-order neighbor semantics, and defines a fusion function as follows:
wherein,is a mean function>Representing the join operation, the enrichment of user and item representations for a particular domain may be performed similarly. The enhanced domain invariance and domain specific user and item representations are connected to achieve a more comprehensive embedded representation. The specific operations can be summarized as follows:
where || denotes a connection operation. This enrichment process is for D (s) And D (t) Are identical.And->As an initial embedded representation of the next-to-be-implemented personalized rich user and item and.
And 2, heterogeneous representation learning module. Embedding for modeling user social relations and project dependency relations is obtained from the disentangled domain space, relation perception semantics are fused into disentangled user and project representations through a heterogeneous graph neural network, personalized knowledge migration of the user and the project is carried out through a meta network, and heterogeneous relation learning is achieved.
(1) Intelligent relational awareness representation
Because heterogeneous information contains rich semantic information, the present invention contemplates further enriching user and project representations in combination with this advantage. The main function of this module is to obtain an embedding for modeling user social relationships and project dependencies from the disentangled domain space. The specific method comprises the following steps:
wherein,representing element level multiplication, delta represents federation, sig (-) is an activation function.Representing the weight matrix generated by the Xavier normal distribution. />Representing the user-user, item-item and the representation of the relationship between user-item, respectively, the initial representation derived by this mechanism has heterogeneity in the modeling of the user and item relationship and is>Share the same semantics.
(2) Domain aware heterogeneous information fusion
In combination with the previously generated relational awareness embeddings, the module again utilizes the LightGCN to incorporate different information into the domain-invariant and domain-specific representations, further improving the quality of the representation. To be used forThe following are examples:
similarly, the user-user embedding and project-project embedding relationships also iterate in accordance with the same GCN model.
Inspiration is drawn from the soft-element path, and heterogeneous side information is enhanced by using dedicated aggregation functions. To further integrate the different information types, and incorporate coding layer specific representations. In particular, the embedding of users and items is updated by a heterogeneous fusion procedure defined as follows:
wherein,and integrating heterogeneous relation semantics to become the input of the next layer. Phi (·) represents the L2 normalization operation, f up (-) is an information fusion function. />Is an end user and item representation after fusing the heterogeneous side information, and similar steps are adopted to obtain the corresponding +.>
(3) Knowledge element optimization
And personalized learning is facilitated, and knowledge information is transmitted from the side face. The invention introduces a new method for extracting heterogeneous side information element path knowledge through a meta-network attention mechanism, and the specific formulas are summarized as follows:
wherein,meta-knowledge representation of user and item, respectively, f meta (-) is a meta-knowledge extraction function. The auxiliary representation effectively captures the category dependencies of the items based on the time stamps and trust networks between users.
To facilitate personalized conversion of user and project embeddings, a multi-layer perceptron (MLP) is used to convert the meta-knowledge representation into a weight matrix. The specific procedure can be summarized as follows:
wherein f mlp (-) is a meta-knowledge learner consisting of two linear transformation layers with PReLU activation function. so (-) is a softmax function.And->Is embedded for personalizing the converted user and item. To obtain a more comprehensive representation, a weighted sum is used to integrate the user and item representations:
wherein λ, β ε R control the weights between embeddings and the sum is 1.Representing the final embedding for recommending primary tasks, this series of processes for spaces y and D (t) The same is true.
And 3, enhancing self-supervision characterization. Two CL tasks are constructed, a comparison learning target is designed based on an MI mutual information maximization mechanism, and in order to supervise the disentanglement process, the embedded characterization with low redundancy and light noise can be obtained to a certain degree in the initial stage. The contrast learning objective is designed based on the info nce loss function in order to enhance the robustness of learning with self-enhanced heterogeneous relationships.
(1) Mutual information driven contrast learning
The invention creates one positive sample and three negative samples. It is desirable to minimize dissimilarity between positive samples, subject to the greatest mutual information. At the same time, dissimilarity between negative samples is maximized to mitigate the effects of noise and redundancy. The contrast learning targets designed by the invention are as follows:
where c (-) is a cosine similarity function and τ is a parameter that controls the smoothness of the softmax curve.
(2) Heterogeneous relationship contrast learning
And generating two sets of embeddings by adopting heterogeneous graph contrast learning and meta-path personalized conversion. The inspiration is obtained from the success of recent contrast learning based on the info nce loss function, enhancing the user-item representation learning in the model. This procedure is as follows:
wherein,respectively is a matrix->Is used to determine the embedded vector of (a). g (-) represents a similarity function, +.>Is a super parameter of the softmax temperature. Based on the above method, the project, the spaces y and D, can be obtained as well (t) Is of (3)And comparing the learning targets. Overall, total contrast loss->Is a weighted sum of all contrast losses.
And 4, a joint learning module. With the above modules, it is an object of the present invention to achieve a more comprehensive embedded representation by smartly connecting enhanced domain-invariant representations with domain-specific user and item representations. The specific operations can be summarized as follows:
the model of the present invention predicts D by dot product (s) Possibility of user-item interaction: wherein->Is an embedded vector in a representative matrix. In the optimization stage, the invention follows a classical ordering model, and uses Bayesian personalized ordering (BPR) recommended loss as main task loss to further optimize parameters:
wherein,for the positive set of interactions with the user in all samples, +.>And vice versa. D (D) (t) Estimating the corresponding BPR loss as +.>
In combination with the above loss function, the present invention proposes a training strategy paradigm to better learn information from different angles and further optimize the model. The total training loss is as follows:
wherein Ω is a model parameter that can be learned, η 1 And eta 2 Is a weight used to control the self-supervising signal and regularization term.
In a recommended task, the embodiment of the invention evaluates the model by using NDCG@K and HR@K, and for three sets of real comment data sets from the Amazon data set, the invention first keeps a valid sample with a score greater than 4, wherein each entry is marked as 0 or 1, indicating whether the user has scored the item. Then, the present invention preprocesses a data set by selecting users having interactions more than 5 times in each domain, and extracts overlapping users in two domains while limiting each domain to 10000 entries or less. In addition, the invention also performs data filtering to preserve user votes and project timestamps. Experimental results show that the model of the embodiment of the invention has excellent performance on all data sets and indexes, and the recommended accuracy is improved.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.
Claims (5)
1. A cross-domain recommendation method based on graph learning aims at learning new users and project embedded representations so as to improve recommendation performance of two domains at the same time. The method is characterized by comprising the following steps of:
step 1, firstly abstracting the user and item representation of each domain to a domain-invariant and domain-specific space, and initializing the disentangled embedded representation. A lightweight graph convolution neural network is used in the interaction graph to aggregate user-project high-order synergistic relationship information to pre-enhance the amount of information represented by the user and project after de-entanglement.
And 2, obtaining embedding for modeling social relationships and project dependency relationships of users from the disentangled domain space, fusing relationship perception semantics into disentangled user and project representations through a heterogeneous graph neural network, and meanwhile, carrying out personalized knowledge migration of the users and the projects through a meta network to realize heterogeneous relationship learning.
And 3, constructing two CL tasks. The MI mutual information maximization mechanism is based on a contrast learning target design, and in order to monitor the disentanglement process, the embedded characterization with low redundancy and light noise can be obtained to a certain degree in the initial stage. The contrast learning objective is designed based on the info nce loss function in order to enhance the robustness of learning with self-enhanced heterogeneous relationships.
Step 4, the invention connects the domain-invariant representation and domain-specific representation of the user and item, respectively, to generate a final representation and predict the probability of a given user item pair. Given two domains D (s) And D (t) In the case of (a) the Top-k recommendation with implicit feedback for all users in each domain is considered to improve the recommendation performance for both domains simultaneously.
The cross-domain recommendation method based on graph learning as claimed in claim 1, wherein the method uses domain D (s) Modeling is elaborated for the examples.
2. The cross-domain recommendation method based on graph learning of claim 1, wherein the method comprises the following steps: in said step 1, user-item pairs are introduced as input for each domain. By sampling from a gaussian normal distribution, two independent embedding matrices are randomly generatedAnd->To generate an initial embedding->Representing the initial embedded representations of the generated user and item, respectively.
Based on the embedding, the present invention separates the domain-invariant representation and domain-specific representation of users and items in a spatially mapped manner. Specifically, it willAnd->Abstract into two independent subspaces, namely a domain-invariant space x and a domain-specific space y. Every user +.>The representation of (2) will be->Two-part composition, representing the domain-invariant and domain-specific representation of item u, respectively, and item +.>And the same is true. Next, the present invention contemplates the use of higher order collaboration information in the interaction graph to pre-enrich the de-entangled representation. The learned characteristics of each layer of graph after convolution are fused, multi-order neighbor semantics are captured, and the fusion function is defined as follows:
wherein,is a mean function>Representing the join operation, the enrichment of user and item representations for a particular domain may be performed similarly. The present invention connects enhanced domain-invariant and domain-specific user and item representations to achieve a more comprehensive embedded representation. The specific operations can be summarized as follows:
where || denotes a connection operation. This enrichment process is for D (s) And D (t) Are identical.And->As an initial embedded representation of the next-to-be-implemented personalized rich user and item and.
3. The cross-domain recommendation method based on graph learning of claim 1, wherein the method comprises the following steps: in the step 2, as heterogeneous information contains rich semantic information, the user and the item representation are further enriched by combining the advantage. An initial embedding for modeling user social relationships and project dependencies is first derived from the above-described embedding.Representing the user-user, item-item and the representation of the relationship between user-item, respectively, the initial representation derived by this mechanism has heterogeneity in the modeling of the user and item relationship and is>Share the same semantics. The embedded characterization is again learned through the heterographing convolutional neural network.
Inspired by the soft-element path design, the information in each iteration is aggregated from heterogeneous relationships. Through multiple iterations of heterogeneous message propagation, the high-order embedding preserves the heterogeneous semantics of the multi-hop connection. In particular, the embedding of users and items is updated by custom heterogeneous fusion programs.
Wherein,is a mean function>Representing the connection operation. />Is an end user and item representation after fusing the heterogeneous side information, and similar steps are adopted to obtain the corresponding +.>
To generate a personalized mapping of the auxiliary view to the user-item interaction code of each user and each item, first the meta-knowledge is extractedImportant features of the user and the item are preserved in the auxiliary view and the interactive view. To facilitate user and project embedded personalized transformations, multiple Layer Perceptron (MLP) is used to transform meta-knowledge representations into weight matricesTo obtain a more comprehensive representation, a weighted sum is used to integrate the user and item representations. />Representing the final embedding for recommending primary tasks, this series of processes for spaces y and D (t) The same is true.
4. The cross-domain recommendation method based on graph learning of claim 1, wherein the method comprises the following steps: in the step 3, two comparison learning tasks are constructed. Under the influence of the maximum Mutual Information (MI), the invention hopes to mitigate the influence of noise and redundancy, and the comparative learning targets based on the design are as follows:
where c (-) is a cosine similarity function and τ is a parameter that controls the smoothness of the softmax curve. The inspiration is obtained from the success of the contrast learning of the info nce loss function, enhancing the user-item representation learning in the model. This procedure is as follows:
wherein,respectively is a matrix->Is used to determine the embedded vector of (a). g (-) represents a similarity function, +.>Is a super parameter of the softmax temperature. Based on the above method, the project, the space y and D can be obtained as well (t) Is a comparison learning objective. Overall, total contrast loss->Is a weighted sum of all losses.
5. The cross-domain recommendation method based on graph learning of claim 1, wherein the method comprises the following steps: in the step 4, the invention predicts D by dot product (s) The possibility of user-item interactions. In the optimization stage, the invention follows a classical ordering model, and utilizes Bayesian personalized ordering (BPR) recommended loss as main task loss to further optimize parameters. The present invention proposes a training strategy paradigm to better learn information from different angles and further optimize the model. The total training loss is as follows:
wherein Ω is a model parameter that can be learned, η 1 And eta 2 Is a weight used to control the self-supervising signal and regularization term.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311712911.2A CN117648493B (en) | 2023-12-13 | 2023-12-13 | Cross-domain recommendation method based on graph learning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311712911.2A CN117648493B (en) | 2023-12-13 | 2023-12-13 | Cross-domain recommendation method based on graph learning |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117648493A true CN117648493A (en) | 2024-03-05 |
| CN117648493B CN117648493B (en) | 2024-05-31 |
Family
ID=90049357
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311712911.2A Active CN117648493B (en) | 2023-12-13 | 2023-12-13 | Cross-domain recommendation method based on graph learning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117648493B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1750221A1 (en) * | 2005-07-14 | 2007-02-07 | The Boeing Company | System, method, and computer program to predict the likelihood, the extent, and the time of an event or change occurrence using a combination of cognitive causal models with reasoning and text processing for knowledge driven decision support |
| CN108022161A (en) * | 2017-12-26 | 2018-05-11 | 河北中晟易通科技有限公司 | Clothing matching commending system based on image recognition and big data analysis |
| CN112541132A (en) * | 2020-12-23 | 2021-03-23 | 北京交通大学 | Cross-domain recommendation method based on multi-view knowledge representation |
| US20210383231A1 (en) * | 2020-08-20 | 2021-12-09 | Chang'an University | Target cross-domain detection and understanding method, system and equipment and storage medium |
| CN115168653A (en) * | 2022-05-18 | 2022-10-11 | 上海交通大学 | Cross-domain recommendation method and system based on inter-domain and intra-domain relationships |
| CN115982480A (en) * | 2023-02-13 | 2023-04-18 | 山东师范大学 | Sequence recommendation method and system based on cooperative attention network and comparative learning |
| CN116010708A (en) * | 2023-02-13 | 2023-04-25 | 重庆市知识产权保护中心(重庆摩托车(汽车)知识产权信息中心) | Multi-comparison learning recommendation method based on knowledge graph |
| CN116468720A (en) * | 2023-05-09 | 2023-07-21 | 南京航空航天大学 | Medical image multi-target domain field self-adaption method based on prompt learning |
| CN116501956A (en) * | 2023-04-03 | 2023-07-28 | 清华大学 | Knowledge perception multi-domain recommendation method and system based on hierarchical graph comparison learning |
| CN116610874A (en) * | 2023-06-06 | 2023-08-18 | 哈尔滨理工大学 | Cross-domain recommendation method based on knowledge graph and graph neural network |
-
2023
- 2023-12-13 CN CN202311712911.2A patent/CN117648493B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1750221A1 (en) * | 2005-07-14 | 2007-02-07 | The Boeing Company | System, method, and computer program to predict the likelihood, the extent, and the time of an event or change occurrence using a combination of cognitive causal models with reasoning and text processing for knowledge driven decision support |
| CN108022161A (en) * | 2017-12-26 | 2018-05-11 | 河北中晟易通科技有限公司 | Clothing matching commending system based on image recognition and big data analysis |
| US20210383231A1 (en) * | 2020-08-20 | 2021-12-09 | Chang'an University | Target cross-domain detection and understanding method, system and equipment and storage medium |
| CN112541132A (en) * | 2020-12-23 | 2021-03-23 | 北京交通大学 | Cross-domain recommendation method based on multi-view knowledge representation |
| CN115168653A (en) * | 2022-05-18 | 2022-10-11 | 上海交通大学 | Cross-domain recommendation method and system based on inter-domain and intra-domain relationships |
| CN115982480A (en) * | 2023-02-13 | 2023-04-18 | 山东师范大学 | Sequence recommendation method and system based on cooperative attention network and comparative learning |
| CN116010708A (en) * | 2023-02-13 | 2023-04-25 | 重庆市知识产权保护中心(重庆摩托车(汽车)知识产权信息中心) | Multi-comparison learning recommendation method based on knowledge graph |
| CN116501956A (en) * | 2023-04-03 | 2023-07-28 | 清华大学 | Knowledge perception multi-domain recommendation method and system based on hierarchical graph comparison learning |
| CN116468720A (en) * | 2023-05-09 | 2023-07-21 | 南京航空航天大学 | Medical image multi-target domain field self-adaption method based on prompt learning |
| CN116610874A (en) * | 2023-06-06 | 2023-08-18 | 哈尔滨理工大学 | Cross-domain recommendation method based on knowledge graph and graph neural network |
Non-Patent Citations (8)
| Title |
|---|
| YANLING ZHANG等: "Multi-graph Convolutional Feature Transfer for Cross-domain Recommendation", 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 30 September 2022 (2022-09-30), pages 1 - 8 * |
| YI LIU等: "Self-Supervised Dynamic Hypergraph Recommendation based on Hyper-Relational Knowledge Graph", BIRMINGHAM, UNITED KINGDOM, 31 August 2023 (2023-08-31), pages 1 - 10 * |
| 曹子旋: "基于深度迁移学习的跨领域细粒度情感分析", 中国优秀硕士学位论文全文数据库信息科技辑, no. 8, 15 August 2020 (2020-08-15), pages 138 - 795 * |
| 林伟业: "基于图神经网络的推荐模型研究", 中国优秀硕士学位论文全文数据库信息科技辑, no. 2, 15 February 2023 (2023-02-15), pages 138 - 3985 * |
| 潘崇煜;黄健;郝建国;龚建兴;张中杰;: "融合零样本学习和小样本学习的弱监督学习方法综述", 系统工程与电子技术, no. 10, 16 September 2020 (2020-09-16), pages 104 - 114 * |
| 田青等: "基于深度学习的域适应方法综述", 数据采集与处理, 15 May 2022 (2022-05-15), pages 512 - 541 * |
| 臧秀波等: "基于自监督图掩码神经网络的社交推荐模型", 模式识别与人工智能, vol. 36, no. 10, 15 October 2023 (2023-10-15), pages 942 - 952 * |
| 陈少东: "海量数据下广义线性模型算法研究", 中国优秀硕士学位论文全文数据库基础科学辑, no. 8, 15 August 2022 (2022-08-15), pages 002 - 60 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117648493B (en) | 2024-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Darban et al. | GHRS: Graph-based hybrid recommendation system with application to movie recommendation | |
| Zhou et al. | Network representation learning: from preprocessing, feature extraction to node embedding | |
| Wang et al. | A dnn-based cross-domain recommender system for alleviating cold-start problem in e-commerce | |
| CN112732936A (en) | Radio and television program recommendation method based on knowledge graph and user microscopic behaviors | |
| Xie et al. | Unsupervised learning of paragraph embeddings for context-aware recommendation | |
| Sakurai et al. | Deep reinforcement learning-based music recommendation with knowledge graph using acoustic features | |
| Zhou et al. | Knowledge-based recommendation with hierarchical collaborative embedding | |
| CN113918711A (en) | Academic paper-oriented classification method based on multi-view and multi-layer attention | |
| Chen et al. | Exploiting visual contents in posters and still frames for movie recommendation | |
| CN117648493B (en) | Cross-domain recommendation method based on graph learning | |
| CN116662601A (en) | Song recommendation method based on graphic neural network and knowledge graph | |
| CN115600642B (en) | Stream media-oriented decentralization federation learning method based on neighbor trust aggregation | |
| Sun | Music Individualization Recommendation System Based on Big Data Analysis | |
| Ben Hassen et al. | Deep Learning for Visual-Features Extraction Based Personalized User Modeling | |
| Li et al. | Semi-siamese network for content-based video relevance prediction | |
| Ma et al. | Knowledge graph based recommendation algorithm for educational resource | |
| Estevez-Velarde et al. | Demo application for leto: Learning engine through ontologies | |
| Sama et al. | Movie recommendation system using deep learning | |
| Khosla | Knowledge-Based Intelligent Information and Engineering Systems: 9th International Conference, KES 2005, Melbourne, Australia, September 14-16, 2005, Proceedings, Part III | |
| Wang et al. | A Tri‐Attention Neural Network Model‐BasedRecommendation | |
| Li et al. | Disentangled-feature and composite-prior VAE on social recommendation for new users | |
| Zhang et al. | A Multi-classification Division-aggregation Framework for Fake News Detection | |
| Hao | Cross-domain recommender system through tag-based models | |
| Kala et al. | Applicability of deep learning techniques in recommender systems | |
| Pellegrino | Flexible recommender systems based on graphs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |