WO2021121106A1 - Federated learning-based personalized recommendation method, apparatus and device, and medium - Google Patents

Abstract

A federated learning-based personalized recommendation method, apparatus and device, and a medium. The federated learning-based personalized recommendation method comprises: receiving uploaded data, and extracting a target recall set corresponding to the uploaded data from a preset recall set storage database (S10); acquiring predicting data corresponding to both the uploaded data and the target recall set, and inputting the predicting data into a personalized recommendation model acquired on the basis of the federated learning and acquiring a model output result (S20); and filtering the model output result to obtain a personalized recommendation result (S30).

Description

Personalized recommendation method, device, equipment and medium based on federated learning

This application requires: the priority of the Chinese patent application filed on December 20, 2019, with the application number 201911326853.3, and the name "Personalized recommendation method, device, equipment and medium based on federal learning", which is hereby introduced as reference.

Technical field

This application relates to the field of artificial intelligence technology of financial technology (Fintech), and in particular to a method, device, device, and medium for personalized recommendation based on federated learning.

Background technique

With the continuous development of financial technology, especially Internet technology and finance, more and more technologies (such as distributed, blockchain, artificial intelligence, etc.) are applied in the financial field, but the financial industry has also proposed higher technology Requirements, such as the distribution of to-do items in the financial industry, also have higher requirements.

With the continuous development of computer software and artificial intelligence, personalized recommendation technology has become more and more widely used. At present, personalized recommendation providers usually obtain user attribute data, user behavior data, user behavior context data and other data obtained by themselves. , Predict the user’s personalized behavior or item, for example, predict the user’s favorite mobile phone and predict the user’s web page click-through rate, etc. However, the feature richness of user data in this method often has a great impact on the prediction result. Due to the tightening of data privacy protection legislation, user data cannot be shared in clear text between different data owners. Therefore, the feature richness of user data of a single personalized recommendation provider is often low, which in turn leads to personalized behavior or The prediction accuracy of items is also low, which in turn leads to a poor personalized recommendation effect. Therefore, there is a technical problem in related technologies that the personalized recommendation effect is poor.

The above content is only used to assist the understanding of the technical solution of the application, and does not mean that the above content is recognized as prior art.

Technical solutions

The main purpose of this application is to provide a method, device, device and medium for personalized recommendation based on federated learning, aiming to solve the technical problem of poor personalized recommendation effect in related technologies.

In order to achieve the above objective, the embodiments of the present application provide a personalized recommendation method based on federated learning. The personalized recommendation method based on federated learning is applied to a personalized recommendation device based on federated learning. The personalized recommendation method based on federated learning Recommended methods include:

Receiving uploaded data, and extracting a target recall set corresponding to the uploaded data from a preset recall set storage database;

Acquiring the data to be predicted corresponding to the uploaded data and the target recall set, and inputting the data to be predicted into a personalized recommendation model obtained based on the federated learning to obtain a model output result;

The output results of the model are screened to obtain personalized recommendation results.

In an embodiment, the target recall set includes a list of items to be recommended, and the upload data includes user data, item data, and behavior data,

The step of obtaining the data to be predicted corresponding to the uploaded data and the target recall set, and inputting the data to be predicted into a personalized recommendation model obtained based on the federated learning, and obtaining the model output result includes:

Filtering the item data based on the list of items to be recommended to obtain item data to be recommended, and setting the user data, the item data to be recommended and the behavior data as the data to be predicted;

The data to be predicted is input into the personalized recommendation model to score and sort the recommended items in the list of recommended items to obtain model output results.

In an embodiment, the step of inputting the to-be-predicted data into the personalized recommendation model to score and sort the to-be-recommended items in the to-be-recommended item list, and obtaining model output results includes:

Input the to-be-predicted data into the personalized recommendation model to score the to-be-recommended item based on the user data and the behavior data to obtain a scoring result;

Based on the scoring result, the items to be recommended are sorted, and the model output result is obtained.

In an embodiment, the personalized recommendation method based on federated learning is applied to the first device that performs the federated learning,

The step of obtaining the to-be-predicted data corresponding to the uploaded data and the target recall set, and inputting the to-be-predicted data into the personalized recommendation model obtained based on the federated learning, before the step of obtaining the model output result includes:

Perform sample matching with the second device associated with the first device to obtain a public training sample ID (Identity document, identification number);

Based on the public training sample ID, the personalized recommendation model is obtained by interacting with the second device for federated learning.

In an embodiment, the personalized recommendation model includes a logistic regression model,

The step of obtaining the personalized recommendation model by interacting with the second device for federated learning based on the public training sample ID includes:

Based on the public training sample ID, extract the first sample data corresponding to the public training sample ID, and calculate the first weight corresponding to the first sample data;

Receive the second weight value sent by the second device, calculate the gradient auxiliary variable corresponding to the first weight value and the second weight value through a preset intermediate parameter formula, and send the gradient auxiliary variable to A second device, wherein the second device is used to calculate a second gradient corresponding to the gradient auxiliary variable;

Based on the gradient auxiliary variable, the first gradient is calculated, and the first gradient is sent to a preset federation server, where the preset federation server is used to send data based on the first gradient and the second device The second gradient calculates the total gradient of the federated model;

The total gradient of the federation model fed back by the federation server is received, and the local training model of the first device is iteratively updated based on the total gradient of the federation model to obtain the logistic regression model.

In an embodiment, the step of receiving uploaded data and extracting a target recall set corresponding to the uploaded data from a preset recall set storage database includes:

Receiving uploaded data, and extracting the sample ID in the uploaded data;

Based on the sample ID, query the corresponding target recall set in the preset recall set storage database.

In an embodiment, the personalized recommendation method based on federated learning is applied to the first device that performs the federated learning,

The step of receiving uploaded data and extracting the target recall set corresponding to the uploaded data from a preset recall set storage database includes:

The second device associated with the first device performs federated learning to obtain a federated recall algorithm model;

Obtain sample upload data, and input the sample upload data into the federal recall algorithm model to obtain a target recall set set, and store the target recall set set in the preset recall set storage database.

The present application also provides a personalized recommendation device based on federated learning. The personalized recommendation device based on federated learning is applied to a personalized recommendation device based on federated learning. The personalized recommendation device based on federated learning includes:

The extraction module is configured to receive the uploaded data, and extract the target recall set corresponding to the uploaded data from a preset recall set storage database;

A prediction module, configured to obtain the data to be predicted corresponding to the uploaded data and the target recall set, and input the data to be predicted into a personalized recommendation model obtained based on the federated learning to obtain a model output result;

The screening module is used to screen the output results of the model to obtain personalized recommendation results.

In an embodiment, the prediction module includes:

The screening unit is configured to screen the item data based on the list of items to be recommended to obtain the item data to be recommended, and set the user data, the item data to be recommended and the behavior data as all State the data to be predicted;

The prediction unit is used for inputting the data to be predicted into the personalized recommendation model, so as to score and sort the recommended items in the list of to-be-recommended items, and obtain model output results.

In an embodiment, the prediction unit includes:

A scoring subunit for inputting the data to be predicted into the personalized recommendation model to score the item to be recommended based on the user data and the behavior data to obtain a scoring result;

The sorting subunit is used for sorting the items to be recommended based on the scoring result to obtain a model output result.

In an embodiment, the personalized recommendation device based on federated learning further includes:

A sample matching module, configured to perform sample matching on the second device associated with the first device to obtain a public training sample ID;

The first federated learning module is used to obtain the personalized recommendation model by interacting with the second device to perform federated learning based on the public training sample ID.

In an embodiment, the federated learning module includes:

A first calculation unit, configured to extract the first sample data corresponding to the public training sample ID based on the public training sample ID, and calculate the first weight corresponding to the first sample data;

The second calculation unit is configured to receive the second weight value sent by the second device, and calculate the gradient auxiliary variable corresponding to the first weight value and the second weight value by using a preset intermediate parameter formula, And sending the gradient auxiliary variable to a second device, where the second device is used to calculate a second gradient corresponding to the gradient auxiliary variable;

The third calculation unit is configured to calculate a first gradient based on the gradient auxiliary variable, and send the first gradient to a preset federated server, where the preset federated server is used to calculate the first gradient based on the first gradient. The gradient and the second gradient sent by the second device to calculate the total gradient of the federated model;

An iterative update unit, configured to receive the total gradient of the federation model fed back by the federation server, and to iteratively update the local training model of the first device based on the total gradient of the federation model to obtain the logistic regression model .

In an embodiment, the extraction module includes:

An extraction unit, configured to receive the uploaded data and extract the sample ID in the uploaded data;

The query unit is configured to query the corresponding target recall set in the preset recall set storage database based on the sample ID.

In an embodiment, the personalized recommendation device based on federated learning includes:

A second federated learning module, configured to perform federated learning for the second device associated with the first device to obtain a federated recall algorithm model;

The storage module is used to obtain the sample upload data and input the sample upload data into the federated recall algorithm model to obtain a target recall set set, and store the target recall set set in the preset recall set storage In the database.

This application also provides a personalized recommendation device based on federated learning. The personalized recommendation device based on federated learning includes: a memory, a processor, and the The program of the personalized recommendation method based on federated learning, when the program of the personalized recommendation method based on federated learning is executed by the processor, can realize the steps of the above-mentioned personalized recommendation method based on federated learning.

This application also provides a medium, the medium is a readable storage medium, the medium stores a program for implementing a personalized recommendation method based on federated learning, and the program for the personalized recommendation method based on federated learning is processed by a processor During execution, the steps of the above-mentioned personalized recommendation method based on federated learning are realized.

This application receives uploaded data, extracts the target recall set corresponding to the uploaded data from a preset recall set storage database, and then obtains the to-be-predicted data corresponding to the uploaded data and the target recall set, and combines the The data to be predicted is input based on the personalized recommendation model obtained by the federated learning, and the model output result is obtained, and then the model output result is filtered to obtain the personalized recommendation result. That is, this application first receives the upload data, and then extracts the target recall set corresponding to the uploaded data from the preset recall set storage database, and then performs the common correspondence between the upload data and the target recall set. Obtain the data to be predicted, and input the data to be predicted into a personalized recommendation model obtained based on the federated learning to obtain model output results, and then screen the model output results to obtain personalized recommendation results. That is, after the application obtains the data to be predicted based on the uploaded data and the target recall set, the data to be predicted is input into the personalized recommendation model obtained based on the federated learning to further predict the personalized recommendation result of the user. The personalized recommendation model is acquired based on federated learning, that is, through the federated learning, the training of the personalized recommendation model can be combined with multi-party data, thereby increasing the feature richness of the training samples of the personalized recommendation model, and The data privacy of each data provider and data user will not be disclosed, thereby improving the robustness and broadness of the personalized recommendation model, thereby improving the prediction accuracy of the personalized recommendation model, and avoiding the result of the personalized recommendation model The prediction accuracy rate of, which leads to poor personalized recommendation effect, and by inputting the data to be predicted into the personalized recommendation model obtained based on the federated learning, the joint multi-party data for prediction is achieved when only local data is used for prediction. The prediction effect of the model reduces the amount of calculation for personalized recommendation, thereby improving the response speed during personalized recommendation, and enhancing the effect of personalized recommendation. Therefore, the technical problem of poor personalized recommendation effect is solved.

Embodiments of the present invention

It should be understood that the specific embodiments described here are only used to explain the present application, and are not used to limit the present application.

The embodiment of the present application provides a personalized recommendation method based on federated learning. The personalized recommendation method based on federated learning is applied to a personalized recommendation device based on federated learning. In an embodiment, referring to FIG. 1, the personalized recommendation method based on federated learning includes:

Step S10, receiving uploaded data, and extracting a target recall set corresponding to the uploaded data from a preset recall set storage database;

In this embodiment, it should be noted that the upload data includes sample ID, user data, item data, and behavior data. The upload data is uploaded by the client, and the user data includes user natural attribute data and user data. Interest attribute data, etc. The item data includes data such as the item name and item attributes of the item to be personalized and recommended, and the behavior data includes user behavior data on the item and context data when the behavior occurs, such as user behavior on the item The data includes browsing, clicking, etc., the context data when the behavior occurs includes geographic location, network type, etc., and the sample ID includes the user's name, user ID number, and user phone number.

Receive upload data, and extract the target recall set corresponding to the upload data from the preset recall set storage database, specifically, receive the upload data, and store it in the preset recall set based on the user data in the upload data The database is queried for the target recall set corresponding to the user data, where the target recall set includes one or more initial items to be recommended, where the initial items to be recommended refer to items that may be of interest to the user.

Wherein, the step of receiving uploaded data and extracting a target recall set corresponding to the uploaded data from a preset recall set storage database includes:

Step S11, receiving uploaded data, and extracting the sample ID in the uploaded data;

In this embodiment, it should be noted that the sample ID includes identity tags such as user IDs and character strings, the uploaded data includes one or more data samples, and the data samples are represented by a preset data sample format. For example, "id, label, user_a_feature_i, item_feature_i, action_i, other_a_i" is a preset data sample format, where id is the sample ID and label is the sample label, where the sample label identifies the type of user, for example, The user is a good customer or a bad customer, user_a_feature_i is user data, item_feature_i is item data, action_i is behavior data, and other_a_i is other data.

Step S12, based on the sample ID, query a corresponding target recall set in the preset recall set storage database.

In this embodiment, it should be noted that the sample ID includes identity tags such as user ID, character string, phone number, etc. That is, the sample ID can be represented by a character string, or can be directly represented by a phone number .

Based on the sample ID, the corresponding target recall set is queried in the preset recall set storage database. Specifically, the sample ID is used as a keyword to search in the preset recall set storage database to obtain all The target recall set.

Wherein, the personalized recommendation method based on federated learning is applied to the first device that performs the federated learning,

The step of receiving uploaded data and extracting the target recall set corresponding to the uploaded data from a preset recall set storage database includes:

Step A10, the second device associated with the first device performs federated learning to obtain a federated recall algorithm model;

In this embodiment, it should be noted that the federated learning includes vertical federated learning and horizontal federated learning, and the first device and the second device may be communicatively connected.

The second device associated with the first device performs federated learning to obtain a federated recall algorithm model, specifically, performs sample alignment with the second device to align the sample ID of the first device with the second device Align the sample ID of the sample to obtain the public training sample ID, train the first training model of the first device based on the uploaded data corresponding to the public training sample ID, obtain the first training result, and calculate the first training result The error from the theoretical training result is further based on the error and the network weight of the first training model to obtain a partial derivative of the preset objective function to obtain the first gradient, wherein the preset objective function is related to the error And the network weight function, and then send the first gradient to a preset federation server, so that the preset federation server sends the first gradient and the second device to the first gradient and the second device based on preset federation rules. The two gradients are federated to obtain the federated gradient, and then the federated gradient fed back by the preset federated server is received, and the first training model is iteratively updated based on the federated gradient to obtain the federated recall algorithm model. The preset federal rules include weighted average, and the conditions for stopping the iterative update include reaching the maximum number of iterations, and the model converges to a preset error threshold.

Step A20: Obtain sample upload data, and input the sample upload data into the federal recall algorithm model to obtain a target recall set set, and store the target recall set set in the preset recall set storage database.

In this embodiment, it should be noted that the target recall set includes one or more target recall sets, wherein each sample ID corresponds to a target recall set.

Obtain sample upload data, and input the sample upload data into the federal recall algorithm model to obtain a target recall set set, and store the target recall set set in the preset recall set storage database, specifically, obtain Sample upload data, where the sample upload data includes upload data of each user stored in the first device, and each user corresponds to a sample ID, where the upload data includes user data, item data, and behavior data Etc., and then input the sample upload data into the federal recall algorithm model to predict the items that may be of interest to the user of the first device, obtain one or more items to be recommended, and assign them to the items to be recommended corresponding to the same sample ID. The recommended item is divided into a target recall set, the target recall set is obtained, and the target recall set is stored in the preset recall set storage database, where the target recall set is in the preset recall set The collection storage database is stored in the form of item lists, item collections, etc., and the query keywords corresponding to the target recall collection include sample IDs.

Step S20: Obtain the data to be predicted corresponding to the uploaded data and the target recall set, and input the data to be predicted into a personalized recommendation model obtained based on the federated learning to obtain a model output result;

In this embodiment, it should be noted that there are two or more participants in the federated learning, and the participants include a first device and a second device, and the personalized learning obtained based on the federated learning The recommendation model includes a logistic regression model that has been trained based on the federated learning, the output of the model includes items to be recommended and their ratings and rankings, and the data to be predicted includes user data, behavior data, and corresponding target recall sets. Item data, etc.

Obtain the data to be predicted corresponding to the upload data and the target recall set, and input the data to be predicted into the personalized recommendation model obtained based on the federated learning to obtain the model output result, specifically, upload the The data to be predicted corresponding to the target recall set is input based on the personalized recommendation model obtained by the federated learning to score and rank the recommended items corresponding to the target recall set, and obtain the corresponding items to be recommended The sorted list of items and the scores corresponding to the items to be recommended, that is, the output results of the model are obtained.

Wherein, the target recall set includes a list of items to be recommended, and the upload data includes user data, item data, and behavior data,

The step of obtaining the data to be predicted corresponding to the uploaded data and the target recall set, and inputting the data to be predicted into a personalized recommendation model obtained based on the federated learning, and obtaining the model output result includes:

Step S21: Screen the item data based on the list of items to be recommended to obtain item data to be recommended, and set the user data, the item data to be recommended and the behavior data as the data to be predicted ；

In this embodiment, it should be noted that the items in the list of items to be recommended are associated with the item data to be recommended.

Step S22: Input the to-be-predicted data into the personalized recommendation model to score and sort the to-be-recommended items in the to-be-recommended item list to obtain model output results.

In this embodiment, the to-be-predicted data is input into the personalized recommendation model to score and sort the to-be-recommended items in the to-be-recommended item list to obtain the model output result, specifically, the The prediction data is input into the personalized recommendation model to score the items in the list of items to be recommended based on the user data, the behavior data, and the item data to be recommended to obtain a scoring result, which is then based on the score As a result, the items in the list of items to be recommended are sorted, and the output result of the model is obtained.

Wherein, in step S22, the step of inputting the to-be-predicted data into the personalized recommendation model to score and sort the to-be-recommended items in the to-be-recommended item list, and obtaining model output results includes:

Step S221: Input the to-be-predicted data into the personalized recommendation model to score the to-be-recommended item based on the user data and the behavior data to obtain a scoring result;

In this embodiment, the to-be-predicted data is input into the personalized recommendation model to score the to-be-recommended item based on the user data and the behavior data to obtain a scoring result, specifically, the The data to be predicted is input into the personalized recommendation model to score the items to be recommended based on the user data and the behavior data, to obtain a first scoring result and a second scoring result, based on the first scoring result And the second scoring result, the scoring result is calculated by a preset calculation rule, where the preset calculation rule includes weighted average, summation, quadrature, etc., for example, assuming that the calculation rule is a summation, If the first scoring result is 1 point and the second scoring result is 2 points, then the scoring result is 3 points.

Step S222: Sort the items to be recommended based on the scoring result to obtain a model output result.

In this embodiment, based on the scoring result, the items to be recommended are sorted to obtain a model output result, specifically, based on the scoring result, the scoring items to be recommended are performed in a preset sorting manner Sorting, wherein the preset sorting method includes sorting from small to large, sorting from large to small, etc., to obtain model output results.

Step S30: Screen the output results of the model to obtain personalized recommendation results.

In this embodiment, the model output results are filtered to obtain personalized recommendation results. Specifically, the model output results are filtered based on preset business logic, and the items to be recommended in the model output results are extracted as The personalized recommendation result, for example, extracting a preset number of items with the highest score in the model output result as the personalized recommendation result.

In this embodiment, upload data is received, and the target recall set corresponding to the uploaded data is extracted from a preset recall set storage database, and then the to-be-predicted data corresponding to the uploaded data and the target recall set are obtained, and all The data to be predicted is input based on the personalized recommendation model obtained by the federated learning, and the model output result is obtained, and then the model output result is filtered to obtain the personalized recommendation result. That is, this embodiment first receives the upload data, and then extracts the target recall set corresponding to the uploaded data from the preset recall set storage database, and then performs the common correspondence between the upload data and the target recall set. Obtain the data to be predicted, and input the data to be predicted into a personalized recommendation model obtained based on the federated learning to obtain model output results, and then screen the model output results to obtain personalized recommendation results. That is, in this embodiment, after obtaining the data to be predicted based on the uploaded data and the target recall set, the data to be predicted is input into the personalized recommendation model obtained based on the federated learning to further predict the personalized recommendation result of the user. The personalized recommendation model is obtained based on federated learning, that is, through the federated learning, the training of the personalized recommendation model can be combined with multi-party data, thereby increasing the feature richness of the training samples of the personalized recommendation model, The data privacy of each data provider and data user will not be leaked, thereby improving the robustness and broadness of the personalized recommendation model, thereby improving the prediction accuracy of the personalized recommendation model, and avoiding the result of personalized recommendation The prediction accuracy of the model leads to poor personalized recommendation effects, and by inputting the data to be predicted into the personalized recommendation model obtained based on the federated learning, joint multi-party data processing is achieved when only local data is used for prediction. The prediction effect of the predicted model reduces the amount of calculation when making personalized recommendation, thereby improving the response speed during personalized recommendation and enhancing the effect of personalized recommendation. Therefore, the technical problem of poor personalized recommendation effect is solved.

Further, referring to FIG. 2, based on the first embodiment of this application, in another embodiment of the personalized recommendation method based on federated learning, the personalized recommendation method based on federated learning is applied to the federated learning The first device,

The step of obtaining the to-be-predicted data corresponding to the uploaded data and the target recall set, and inputting the to-be-predicted data into the personalized recommendation model obtained based on the federated learning, before the step of obtaining the model output result includes:

Step B10: Perform sample matching with the second device associated with the first device to obtain a public training sample ID;

In this embodiment, it should be noted that the public training sample ID includes identity tags such as user IDs and identification strings.

The second device associated with the first device performs sample matching to obtain a common training sample ID, specifically, the first training sample ID in the first device is compared with the second training sample ID in the second device Perform intersection processing to obtain the public training sample ID.

Step B20: Based on the public training sample ID, the personalized recommendation model is obtained by interacting with the second device for federated learning.

In this embodiment, based on the public training sample ID, the personalized recommendation model is obtained by interacting with the second device for federated learning. Specifically, based on the public training sample ID, the public The first sample data corresponding to the training sample ID is obtained, and the first gradient is obtained based on the first sample data, and the second device interacts with the second device to assist the second device in obtaining the second gradient, and to The first gradient is sent to the preset federation server, and further, the federated model total gradient fed back by the preset federated server is received, wherein the federated model total gradient is calculated by the preset federated server through preset federation rules. And the second gradient sent by the second device, where the preset federation rules include weighted average, summation, etc., and the first training model in the first device is further determined based on the total gradient of the federation model. Iterative update is performed to obtain the personalized recommendation model.

Wherein, the personalized recommendation model includes a logistic regression model,

The step of obtaining the personalized recommendation model by interacting with the second device for federated learning based on the public training sample ID includes:

Step B21, based on the public training sample ID, extract the first sample data corresponding to the public training sample ID, and calculate the first weight corresponding to the first sample data;

In this embodiment, it should be noted that the first sample data is upload data of the user client, the upload data includes one or more data samples, and the first weight value is the same as the first The product of the first sample feature corresponding to this data and the first weight in the first training model, where the first weight is the network weight of the first training model, for example, suppose the first weight Is WB, and the first sample feature is XB, then the first weight value is WBXB.

Step B22: Receive the second weight value sent by the second device, calculate the gradient auxiliary variable corresponding to the first weight value and the second weight value through a preset intermediate parameter formula, and assist the gradient The variable is sent to a second device, where the second device is used to calculate a second gradient corresponding to the gradient auxiliary variable;

In this embodiment, the second weight value sent by the second device is received, and the gradient auxiliary variable corresponding to the first weight value and the second weight value is calculated through a preset intermediate parameter formula, and the all The gradient auxiliary variable is sent to a second device, where the second device is used to calculate a second gradient corresponding to the gradient auxiliary variable, specifically, receiving a second weight encrypted and sent by the second device, and encrypting The latter second weight is decrypted to obtain the second weight, where the second weight is the second sample feature corresponding to the second sample data and the second in the second training model in the second device. The product of weights, wherein the second weight is the network weight of the second training model, and further, the first weight and the second weight are combined to obtain the first device and the second The total weight corresponding to the two devices, and then substitute the total weight variable into the preset intermediate parameter formula to obtain the gradient auxiliary variable, and send the gradient auxiliary variable to the second device, and the The gradient auxiliary variable is associated with the sample label, wherein the preset intermediate parameter formula is as follows:

Where is the gradient auxiliary variable, wTx is the total weight, y is the sample label, and y can take the value 1 or -1. For example, when y=1, it can indicate that the customer is a good customer, and when y =-1, it can indicate that the customer is a bad customer.

Step B23: Calculate a first gradient based on the gradient auxiliary variable, and send the first gradient to a preset federated server, where the preset federated server is configured to be based on the first gradient and the second The second gradient sent by the device calculates the total gradient of the federated model;

In this embodiment, the first gradient is calculated based on the gradient auxiliary variable, and the first gradient is sent to a preset federated server, where the preset federated server is used to calculate the first gradient based on the first gradient and the The second gradient sent by the second device calculates the total gradient of the federated model, specifically, the product of the gradient auxiliary variable and the first sample feature is calculated to obtain the first gradient, where the first gradient can be obtained by the following formula Calculated,

Wherein, gB is the first sampling gradient, wTx is the total weight variable, y is the sample label, y can take the value 1 or -1, for example, when y=1, it can indicate that the customer is a good customer , When y=-1, it can indicate that the client is a bad client, and xB is the first sample feature of the first device. Further, the first gradient is sent to the preset federation server to pass the pre- It is assumed that the federation server calculates the total gradient of the federation model corresponding to the first gradient and the second gradient sent by the second device based on a preset federation rule, where the preset federation rule includes weighted average, summation, etc., The second gradient is the product of the gradient auxiliary variable and the second sample feature.

Step B24: Receive the total gradient of the federation model fed back by the federation server, and iteratively update the local training model of the first device based on the total gradient of the federation model to obtain the logistic regression model.

In this embodiment, it should be noted that the local training model is the first training model.

Receive the total gradient of the federation model fed back by the federation server, and iteratively update the local training model of the first device based on the total gradient of the federation model to obtain the logistic regression model, specifically, receive the federation The total gradient of the federated model fed back by the server, and based on the total gradient of the federated model, the local training model of the first device is trained and updated, and it is judged whether the updated local training device meets the preset training completion condition. If the local training device meets the preset training completion condition, the updated local training device is used as the logistic regression model. If the updated local training device does not meet the preset training completion condition, the next federated learning The local training device performs training updates until the local training device reaches a preset training completion condition, where the training completion condition includes the model reaching the maximum number of iterations, the model error is less than the preset error threshold and converging.

In this embodiment, a public training sample ID is obtained by performing sample matching with a second device associated with the first device, and then based on the public training sample ID, by interacting with the second device to perform federated learning, the Personalized recommendation model. That is, this embodiment first performs sample matching of the second device associated with the first device to obtain a public training sample ID, and then based on the public training sample ID, through interaction with the second device, In order to perform federated learning, the personalized recommendation model is obtained. That is, this embodiment provides a method for obtaining a personalized recommendation model through federated learning. That is, by interacting with the second device, the training sample data of the second device can be combined to perform federated learning. Obtain the personalized recommendation model, thereby improving the feature richness of the training samples of the personalized recommendation model, and then obtain the personalized recommendation model through training with training samples with higher feature richness, which improves the personalized recommendation The robustness and broadness of the model further improve the prediction accuracy of the personalized recommendation model. Then, by inputting the data to be predicted into the personalized recommendation model obtained based on the federated learning, in the case of using only local data for prediction It can achieve the model prediction effect of joint multi-party data prediction, which reduces the amount of calculation when making personalized recommendation, thereby improving the response speed of personalized recommendation, and enhancing the effect of personalized recommendation. Therefore, this implementation is to solve the personalized recommendation. The technical problem of poor recommendation effect laid the foundation.

Referring to FIG. 3, FIG. 3 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present application.

As shown in FIG. 3, the personalized recommendation device based on federated learning may include a processor 1001, such as a CPU, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to implement connection and communication between the processor 1001 and the memory 1005. The memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

In an embodiment, the personalized recommendation device based on federated learning may also include a rectangular user interface, a network interface, a camera, and RF (Radio Frequency (radio frequency) circuits, sensors, audio circuits, WiFi modules, etc. The rectangular user interface may include a display screen (Display) and an input sub-module such as a keyboard (Keyboard), and the optional rectangular user interface may also include a standard wired interface and a wireless interface. The optional network interface can include standard wired interface and wireless interface (such as WI-FI interface).

Those skilled in the art can understand that the structure of the personalized recommendation device based on federated learning shown in FIG. 3 does not constitute a limitation on the personalized recommendation device based on federated learning, and may include more or fewer components than shown in the figure. Or some parts are combined, or different parts are arranged.

As shown in FIG. 3, the memory 1005 as a computer storage medium may include an operating system, a network communication module, and a personalized recommendation program based on federated learning. The operating system is a program that manages and controls the hardware and software resources of the personalized recommendation device based on federated learning, and supports the running of the personalized recommendation program based on federated learning and other software and/or programs. The network communication module is used to realize the communication between the components in the memory 1005 and the communication with other hardware and software in the personalized recommendation system based on federated learning.

In the personalized recommendation device based on federated learning shown in FIG. 3, the processor 1001 is configured to execute the personalized recommendation program based on federated learning stored in the memory 1005 to realize the personalized recommendation based on federated learning described in any of the above items. Recommended method steps.

The specific implementation of the personalized recommendation device based on federated learning in this application is basically the same as the above-mentioned embodiments of the personalized recommendation method based on federated learning, and will not be repeated here.

An embodiment of the present application also provides a personalized recommendation device based on federated learning. The personalized recommendation device based on federated learning includes:

The extraction module is configured to receive the uploaded data, and extract the target recall set corresponding to the uploaded data from a preset recall set storage database;

A prediction module, configured to obtain the data to be predicted corresponding to the uploaded data and the target recall set, and input the data to be predicted into a personalized recommendation model obtained based on the federated learning to obtain a model output result;

The screening module is used to screen the output results of the model to obtain personalized recommendation results.

In an embodiment, the prediction module includes:

The screening unit is configured to screen the item data based on the list of items to be recommended to obtain the item data to be recommended, and set the user data, the item data to be recommended and the behavior data as all State the data to be predicted;

The prediction unit is used for inputting the data to be predicted into the personalized recommendation model, so as to score and sort the recommended items in the list of to-be-recommended items, and obtain model output results.

In an embodiment, the prediction unit includes:

A scoring subunit for inputting the data to be predicted into the personalized recommendation model to score the item to be recommended based on the user data and the behavior data to obtain a scoring result;

The sorting subunit is used for sorting the items to be recommended based on the scoring result to obtain a model output result.

In an embodiment, the personalized recommendation device based on federated learning further includes:

A sample matching module, configured to perform sample matching on the second device associated with the first device to obtain a public training sample ID;

The first federated learning module is used to obtain the personalized recommendation model by interacting with the second device to perform federated learning based on the public training sample ID.

In an embodiment, the federated learning module includes:

A first calculation unit, configured to extract the first sample data corresponding to the public training sample ID based on the public training sample ID, and calculate the first weight corresponding to the first sample data;

The second calculation unit is configured to receive the second weight value sent by the second device, and calculate the gradient auxiliary variable corresponding to the first weight value and the second weight value by using a preset intermediate parameter formula, And sending the gradient auxiliary variable to a second device, where the second device is used to calculate a second gradient corresponding to the gradient auxiliary variable;

The third calculation unit is configured to calculate a first gradient based on the gradient auxiliary variable, and send the first gradient to a preset federated server, where the preset federated server is used to calculate the first gradient based on the first gradient. The gradient and the second gradient sent by the second device to calculate the total gradient of the federated model;

An iterative update unit, configured to receive the total gradient of the federation model fed back by the federation server, and to iteratively update the local training model of the first device based on the total gradient of the federation model to obtain the logistic regression model .

In an embodiment, the extraction module includes:

An extraction unit, configured to receive the uploaded data and extract the sample ID in the uploaded data;

The query unit is configured to query the corresponding target recall set in the preset recall set storage database based on the sample ID.

In an embodiment, the personalized recommendation device based on federated learning includes:

A second federated learning module, configured to perform federated learning for the second device associated with the first device to obtain a federated recall algorithm model;

The storage module is used to obtain the sample upload data and input the sample upload data into the federated recall algorithm model to obtain a target recall set set, and store the target recall set set in the preset recall set storage In the database.

The specific implementation of the personalized recommendation device based on federated learning in this application is basically the same as the above-mentioned embodiments of the personalized recommendation method based on federated learning, and will not be repeated here.

The embodiment of the present application provides a medium, the medium is a readable storage medium, and the medium stores one or more programs, and the one or more programs may also be executed by one or more processors to It is used to implement the steps of any one of the above-mentioned personalized recommendation methods based on federated learning.

The specific implementation of the medium of this application is basically the same as the above-mentioned embodiments of the personalized recommendation method based on federated learning, and will not be repeated here.

The above are only preferred embodiments of this application, and do not limit the scope of this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of this application, or directly or indirectly used in other related technical fields , The same reason is included in the scope of patent processing of this application.

Claims (20)

1. A personalized recommendation method based on federated learning, wherein the personalized recommendation method based on federated learning includes:

   Receiving uploaded data, and extracting a target recall set corresponding to the uploaded data from a preset recall set storage database;

   Acquiring the data to be predicted corresponding to the uploaded data and the target recall set, and inputting the data to be predicted into a personalized recommendation model obtained based on the federated learning to obtain a model output result;

   The output results of the model are screened to obtain personalized recommendation results.
2. The personalized recommendation method based on federated learning according to claim 1, wherein the target recall set includes a list of items to be recommended, and the uploaded data includes user data, item data, and behavior data,

   The step of obtaining the data to be predicted corresponding to the uploaded data and the target recall set, and inputting the data to be predicted into a personalized recommendation model obtained based on the federated learning, and obtaining the model output result includes:

   Filtering the item data based on the list of items to be recommended to obtain item data to be recommended, and setting the user data, the item data to be recommended and the behavior data as the data to be predicted;

   The data to be predicted is input into the personalized recommendation model to score and sort the recommended items in the list of recommended items to obtain model output results.
3. The personalized recommendation method based on federated learning according to claim 2, wherein said inputting said data to be predicted into said personalized recommendation model to score and sort the items to be recommended in said list of items to be recommended , The steps to obtain model output results include:

   Input the to-be-predicted data into the personalized recommendation model to score the to-be-recommended item based on the user data and the behavior data to obtain a scoring result;

   Based on the scoring result, the items to be recommended are sorted, and the model output result is obtained.
4. The personalized recommendation method based on federated learning according to claim 1, wherein the personalized recommendation method based on federated learning is applied to the first device that performs the federated learning,

   The step of obtaining the to-be-predicted data corresponding to the uploaded data and the target recall set, and inputting the to-be-predicted data into the personalized recommendation model obtained based on the federated learning, before the step of obtaining the model output result includes:

   Performing sample matching on a second device associated with the first device to obtain a public training sample ID;

   Based on the public training sample ID, the personalized recommendation model is obtained by interacting with the second device for federated learning.
5. The personalized recommendation method based on federated learning according to claim 4, wherein the personalized recommendation model includes a logistic regression model,

   The step of obtaining the personalized recommendation model by interacting with the second device for federated learning based on the public training sample ID includes:

   Based on the public training sample ID, extract the first sample data corresponding to the public training sample ID, and calculate the first weight corresponding to the first sample data;

   Receive the second weight value sent by the second device, calculate the gradient auxiliary variable corresponding to the first weight value and the second weight value through a preset intermediate parameter formula, and send the gradient auxiliary variable to A second device, wherein the second device is used to calculate a second gradient corresponding to the gradient auxiliary variable;

   Based on the gradient auxiliary variable, the first gradient is calculated, and the first gradient is sent to a preset federation server, where the preset federation server is used to send data based on the first gradient and the second device The second gradient calculates the total gradient of the federated model; and

   The total gradient of the federation model fed back by the federation server is received, and the local training model of the first device is iteratively updated based on the total gradient of the federation model to obtain the logistic regression model.
6. The personalized recommendation method based on federated learning according to claim 1, wherein the step of receiving uploaded data and extracting a target recall set corresponding to the uploaded data from a preset recall set storage database comprises:

   Receiving uploaded data, and extracting the sample ID in the uploaded data;

   Based on the sample ID, query the corresponding target recall set in the preset recall set storage database.
7. The personalized recommendation method based on federated learning according to claim 1, wherein the personalized recommendation method based on federated learning is applied to the first device that performs the federated learning,

   The step of receiving uploaded data and extracting the target recall set corresponding to the uploaded data from a preset recall set storage database includes:

   The second device associated with the first device performs federated learning to obtain a federated recall algorithm model;

   Obtain sample upload data, and input the sample upload data into the federal recall algorithm model to obtain a target recall set set, and store the target recall set set in the preset recall set storage database.
8. The personalized recommendation method based on federated learning according to claim 1, wherein the step of receiving uploaded data and extracting the target recall set corresponding to the uploaded data from a preset recall set storage database comprises:

   Receiving uploaded data, and based on the user data in the uploaded data, query the target recall set corresponding to the user data in the preset recall set storage database, where

   The target recall set includes one or more initial items to be recommended, and the initial items to be recommended include items that may be of interest to the user.
9. The personalized recommendation method based on federated learning according to claim 6, wherein the step of querying the corresponding target recall set in the preset recall set storage database based on the sample ID comprises:

   The sample ID is used as a keyword, and the preset recall set storage database is searched to obtain the target recall set.
10. 8. The personalized recommendation method based on federated learning according to claim 7, wherein the step of performing federated learning for the second device associated with the first device to obtain a federated recall algorithm model comprises:

    Align the sample ID of the first device with the sample ID of the second device to obtain a common training sample ID;

    Training the first training model of the first device based on the uploaded data corresponding to the public training sample ID, obtaining the first training result, and calculating the error between the first training result and the theoretical training result; and

    Obtaining a partial derivative of a preset objective function based on the error and the network weight of the first training model to obtain the first gradient;

    Sending the first gradient to a preset federation server to federate the first gradient and the second gradient sent by the second device through the preset federation server based on a preset federation rule to obtain a federated gradient; as well as

    The federated gradient fed back by the preset federated server is received, and the first training model is iteratively updated based on the federated gradient to obtain the federated recall algorithm model.
11. 10. The personalized recommendation method based on federated learning according to claim 10, wherein the preset federated rule includes a weighted average, and the condition for stopping the iterative update includes reaching the maximum number of iterations and the model converging to a preset error threshold.
12. The personalized recommendation method based on federated learning according to claim 1, wherein said obtaining the data to be predicted corresponding to the uploaded data and the target recall set, and inputting the data to be predicted based on the federated learning The obtained personalized recommendation model, and the steps to obtain the output result of the model include:

    Inputting the data to be predicted corresponding to the uploaded data and the target recall set into a personalized recommendation model obtained based on the federated learning;

    Scoring and sorting the items to be recommended corresponding to the target recall set, and obtaining a ranking list of items corresponding to the items to be recommended and a score corresponding to the items to be recommended; and

    Obtain model output results.
13. The personalized recommendation method based on federated learning according to claim 1, wherein the target recall set includes a list of items to be recommended, and the uploaded data includes user data, item data, and behavior data.
14. The personalized recommendation method based on federated learning according to claim 4, wherein the public training sample ID is the first training sample ID in the first device and the second training sample ID in the second device. Sample ID after intersection processing.
15. The personalized recommendation method based on federated learning according to claim 4, wherein the step of obtaining the personalized recommendation model by interacting with the second device to perform federated learning based on the public training sample ID comprises :

    Extract the first sample data corresponding to the public training sample ID based on the public training sample ID;

    Acquiring a first gradient based on the first sample data, assisting the second device in acquiring the second gradient by interacting with the second device, and sending the first gradient to a preset federation server;

    Receive the total gradient of the federation model fed back by the preset federation server; and

    The first training model in the first device is iteratively updated based on the total gradient of the federation model to obtain the personalized recommendation model.
16. The personalized recommendation method based on federated learning as claimed in claim 15, wherein:

    The total gradient of the federation model is obtained by federating the first gradient and the second gradient sent by the second device by a preset federation server through a preset federation rule,

    The preset federal rules include weighted average and sum.
17. The personalized recommendation method based on federated learning according to claim 5, wherein:

    The first weight is the product of the first sample feature corresponding to the first sample data and the first weight in the first training model, where the first weight is the network of the first training model Weights;

    The second weight is the product of the second sample feature corresponding to the second sample data and the second weight in the second training model in the second device, and the second weight is the product of the second training model Network weight.
18. A personalized recommendation device based on federated learning, wherein the personalized recommendation device based on federated learning includes:

    The extraction module is configured to receive the uploaded data, and extract the target recall set corresponding to the uploaded data from a preset recall set storage database;

    A prediction module, configured to obtain the data to be predicted corresponding to the uploaded data and the target recall set, and input the data to be predicted into a personalized recommendation model obtained based on the federated learning to obtain a model output result;

    The screening module is used to screen the output results of the model to obtain personalized recommendation results.
19. A personalized recommendation device based on federated learning, wherein the personalized recommendation device based on federated learning includes: a memory, a processor, and a program stored in the memory for implementing the method of personalized recommendation based on federated learning ,

    The memory is used to store a program for implementing a personalized recommendation method based on federated learning;

    The processor is configured to execute a program for implementing the personalized recommendation method based on federated learning, so as to realize the steps of the personalized recommendation method based on federated learning according to any one of claims 1 to 17.
20. A medium, wherein a program for implementing a method of personalized recommendation based on federated learning is stored on the medium, and the program for implementing the method of personalized recommendation based on federated learning is executed by a processor to implement the method as in claims 1 to 17 Any of the steps of the personalized recommendation method based on federated learning.