Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N20/00—Machine learning
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q30/00—Commerce
  • G06Q30/02—Marketing; Price estimation or determination; Fundraising
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N20/00—Machine learning
  • G06N20/20—Ensemble learning
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N5/00—Computing arrangements using knowledge-based models
  • G06N5/04—Inference or reasoning models
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L67/00—Network arrangements or protocols for supporting network services or applications
  • H04L67/01—Protocols
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L67/00—Network arrangements or protocols for supporting network services or applications
  • H04L67/34—Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters 

Definitions

• the disclosure relates to an improved client, server, and client-server system allowing generation of personalized recommendations.
• a client-server system is a structure in which the tasks of the system are divided between the provider of a service, i.e. a server, and service requesters, i.e. clients.
• the server may run one or more programs which share their resources with the clients.
• the client does not share any of its resources, but requests a server's content or service function.
• the clients i.e. user devices such as mobile phones or tablets, are an important part of a machine learning process used in such a client-server system, since each client is a source of data, the data being used for building the models used in the machine learning process and for generating the results from the models.
• the results may, e.g., be a recommendation of one or several specific items, taken from a larger set of items, which specific items are predicted, by one or several models, to be of interest to the user of the client.
• An item is, e.g., a video available for viewing, an application available for downloading, or a physical object such as a piece of clothing available for purchase.
• the clients and the items may be collected in a so-called client-item matrix.
• the machine learning process comprises creating complex models and algorithms which may be used for prediction-making, e.g. by exploiting patterns found in historical and transactional data.
• prediction-making e.g. by exploiting patterns found in historical and transactional data.
• the predictions indicate the probability of the user viewing the video, downloading the application, or purchasing the piece of clothing, and may subsequently be used for generating recommendations to the user.
• Each client is a user device such as a mobile phone or a tablet, and it is not only a source of data used for building models used in the machine learning process, but it is also the medium for delivering the results of the models, e.g. recommending the video clips or pieces of clothing, which have received the highest scores, to the user of the client.
• the prior art approach to such model building comprises sending user data to a central server, where different algorithms are used to process the data, build the models, and generate results in the form of recommendations.
• the recommendations are to be individual and personal, wherefore the more personal the data, the better the recommendations.
• Clients such as mobile phones and tablets, comprise different kinds of personal user data, e.g., client location, which may be considered very sensitive personal data, and downloaded applications, which may be considered not particularly sensitive personal data. Regardless of the sensitivity levels, the data is still considered to be personal user data.
• Providing results such as personalized recommendations to the user of a client is an important means of engaging users in a service, e.g., by helping users find video clips they would enjoy watching while filtering out content that they are not interested in, e.g. due to having already watched a video clip.
• a client adapted for generating personalized item recommendations for a user of the client, the client being connected to a server utilizing a global set of items and at least one model, the client being configured to utilize at least one model downloaded from the server, and generate a recommendation set, comprising at least one of the items, by means of at least one of the downloaded model(s) and a local client data set stored on the client.
• a client comprising these features, allows efficient and secure generation of personalized item recommendations since some of the calculations, necessary for generating personalized item recommendations, are executed on the client, and some of the data used in the calculations is stored on the client.
• the model(s) comprise Collaborative Filtering, Predictive Modeling, and/or Deep Learning Models, models which are well-established for different types of use.
• the client data set comprises implicit user feedback and/or explicit user feedback, allowing estimates, used for generating personalized item recommendations, to be calculated on the basis of user actions, as well as allowing user reviews to be taken into account in the calculations.
• the recommendation set is generated by means of a combination of two models and the client data set, wherein one model is Collaborative Filtering and the other model is Predictive Modeling, models which, when combined, allow a highly efficient generation of personalized item recommendations.
• the recommendation set comprises a first recommendation set generated by means of one model and the client data set, and a second recommendation set generated by means of a further model, the first recommendation set, and the client data set, allowing the first recommendation set to be improved.
• generating the second recommendation set comprises selecting and scoring individual items of the first recommendation set, allowing generation of a smaller, and/or more correct, recommendation set.
• the client is configured to update each downloaded model by means of: calculating an updated model by means of the downloaded model and the local client data set, uploading the updated model to the server, wherein the updated model is used for the server calculating a new updated model, downloading the new updated model from the server, and calculating at least one further updated model by means of the new updated model and the local client data set.
• a client comprising these features, allows for a machine learning process which is efficient, since it has access to the client data of all clients connected to a server, as well as secure, since the client data related to an individual client remains on the very same. Since the server, connected to the client, does not have to collect or store large amounts of client data, the process is time- and cost-effective as well.
• the client is configured to calculate at least one update for each model by means of: calculating an update for each downloaded model by means of the local client data set, uploading the update to the server, wherein the update is used for the sever calculating an updated model, downloading the updated model from the server, calculating a new update for the updated model by means of the local client data set, calculating at least one further updated model by means of the updated model, the new update and the local client data set.
• calculating an update comprises calculating a value for each item by means of a function f(i,j), allowing a value which is disengaged from any personal client data to be calculated.
• the client is further configured to generate a recommendation set by means of the further updated model and the local client data set, allowing as much client data as possible to be used.
• a server adapted for assisting in generating personalized item recommendations for a user of a client, on the client, the server being configured to utilize a global set of items and at least one model, the server being connected to a plurality of clients, each client being configured to download the model(s), and generate updated model(s) or updates for the model(s), the server further being configured to: generate new updated model(s) by means of updated models or updates uploaded by at least one of the clients, and transmit the new updated model(s) to the plurality of clients, wherein the new updated model(s) and a local client data set, stored on the client, are utilized for each client (i) generating the personalized item recommendations.
• a server comprising these features, allows efficient and secure generation of personalized item recommendations since some of the calculations, necessary for generating personalized item recommendations, are executed on the client, and some of the data used in the calculations is stored on the client.
• the server is assigned the at least one model prior to utilizing the model(s), the act of assigning comprising one of selecting a random model or a previously known model, allowing use of either a new model or a previously used model as the starting point for the calculations.
• the server is configured to generate the new updated model(s) by means of: determining several of the clients, each determined client being configured to calculate updated model(s) by means of the downloaded model(s) and the local client data set, and to upload the updated model(s) to the server, receiving updated model(s) uploaded by at least one of the determined clients, calculating the new updated model by means of averaging the received, updated model(s).
• a server comprising these features, allows for a machine learning process which is efficient, since it has access to the client data of all clients connected to a server, as well as secure, since the client data related to an individual client remains on the very same. Since the server, connected to the client, does not have to collect or store large amounts of client data, the process is time- and cost-effective as well.
• the server is configured to generate the new updated model(s) by means of: determining several of the clients, each determined client being configured to calculate an update for each model by means of the local client data set, and to upload the update(s) to the server, receiving the update(s) uploaded by at least one of the determined clients, calculating the new updated model by means of the model and an aggregate of the received updates.
• a server comprising these features, allows for a machine learning process which is efficient as well as secure. Since the client does not have to download or upload entire models from the server, the process is particularly effective.
• a machine learning client-server system adapted for generating personalized item recommendations for a user of a client, the client-server system comprising a plurality of clients, described above, and a server, described above.
• a client-server system comprising these features, allows efficient and secure generation of personalized item recommendations since some of the calculations, necessary for generating personalized item recommendations, are executed on the client, and some of the data used in the calculations is stored on the client.
• Fig. 1 is a schematic drawing of a client-server system according to one embodiment of the present disclosure.
• Fig. 2 is a schematic drawing of a client-server system according to a further embodiment of the present disclosure.
• a client-server system is a structure in which the tasks of the system are divided between the provider of a service, i.e. a server, and service requesters, i.e. clients such as mobile phones or tablets.
• the service to be provided may be a video service, all of the user data associated with the video service being stored on the server.
• Prior art model building comprises sending personal user data from a client to a central server where the data is processed, models are built, and results are generated and sent back to the client.
• the results may, e.g., be an estimate to be used for generating recommendations of one or several specific items, taken from a larger set of items, which specific items are predicted, by one or several models, to be of interest to the user of the client.
• An item is, e.g., a video available for viewing, an application available for downloading, or a physical object such as a piece of clothing available for purchase.
• the client-item matrix R may be sparse with many elements r unspecified.
• One object of the present disclosure is to replace such unspecified elements with their estimates f t
• the present disclosure generates such estimates while still maintaining all personal user data on the client, i.e. personal user data is neither used nor stored on a central server. Hence, the amount of data to be transferred to, and stored on, the server is reduced, and issues related to data collection and user privacy are avoided.
• the elements r as well as the estimates t ⁇ are used for generating personalized item recommendations.
• Collaborative Filtering a model is built from a user's past behavior, such as items previously purchased or selected and/or numerical ratings given to those items by the user, as well as similar decisions made by other users. This model is then used to predict which other items the user may have an interest in.
• Collaborative Filtering is one of the most used models to generate recommendations for a user, either independently or in combination with other types of models such as, e.g., Predictive Modeling.
• Predictive Modeling is, preferably, used to apply a predictive score, such as a rating, to the above-mentioned estimates f t ).
• a Collaborative Filtering model A1 may be used to generate a first set of item recommendations R1 , a so-called candidate set comprising some, if not all, of the above-mentioned elements r and estimates r i whereafter a Predictive Modeling model A2 may be used to create the final, usable recommendations R2y by scoring the initially recommended items R1 y and sorting them by weight.
• the estimates t ⁇ may be based on implicit and/or explicit feedback from not only the specific client but a plurality of clients, in one embodiment all possible clients.
• Implicit feedback comprises actions taken by the user, e.g. downloading an application.
• Explicit feedback comprises user reviews of items.
• Collaborative Filtering only uses these two kinds of data, while the above-mentioned Predictive Modeling may use additional kinds of explicit feedback such as demographics, behavioral data, other user activity related data such as where and when an item was interacted with and what kind of device was used, and also personal user data such as name and login data.
• the value r is derived from explicit feedback such as user reviews, e.g. r tj e (1, .... ,5).
• ry 1 when user/client i downloaded application/item j, where 1 ⁇ i£N and 1 ⁇ j£M, while r is unspecified otherwise.
• Collaborative Filtering is used to replace the unspecified ry with their estimates i 7 , e.g. by means of Matrix Factorization.
• Matrix Factorization involves creating a client factor vector
• a value py>0 means that the application/item j has been rated
• the implicit feedback problem is, in other words, different from the standard explicit feedback problem in that the confidence levels Cy need to be taken into account.
• the above described prior art method uses Y for calculating X, and X for calculating Y, repeating and alternating between the two equations at least until a suitable convergence criteria is met.
• the convergence criteria is a predefined limit value, for example as 1 %.
• C and p which are based on user/client data, are used for calculating both X and Y, wherefore all user data has to be located in the same place as X and Y, i.e. on the server. This is referred to as the ALS (Alternating Least Squares) method for Collaborative Filtering, and it is frequently used in prior art.
• ALS Alternating Least Squares
• the embodiments of the present disclosure shown schematically in Fig. 1 , comprises an adaptation of the ALS method such that a different approach is taken to calculating Y, which adaptation allows the calculations to be distributed to the client, hence avoiding the need to transfer client data back to the server.
• All item factor vectors y, ⁇ e R kxl are located on the server, updated on the server, and thereafter distributed to each client i.
• All client factor vectors x t e R kxl remain on the client i, are updated on the client using local client data Uj, and the item factor vectors from the server.
• the updates are calculated from item j on each client i and transmitted to the server where they are aggregated and the are updated.
• the cost function J is minimized by alternating the calculations of the client factor vector matrix X and the item factor vector matrix Y.
• the first step of minimizing the cost function J is to differentiate J with regards to x, for all clients i and y j for all items j, by means of SJ/Sx, and SJ/Sy .
• SJ/Sy comprises a component which is a summation over all clients i, said summation being defined as f(i,j).
• Each client i reports back, to the server, an evaluation of the value f(i,j) calculated for each item j, whereafter all of the client evaluations are summarized, on the
• the present disclosure relates, in other words, to training at least one model, e.g. a Collaborative Filtering model A1 , without having to transfer user data from the client to the server, and at the same time using the model A1 to calculate estimates t ⁇ for the unspecified elements of the client-item matrix R, the estimates to be used for generating personalized recommendations.
• the machine learning model A1 is initially located on a centralized server, and distributed to each user device/client i.
• the initial model A1 is updated, on each client i, using model A1 and client data u, located on the client.
• Updates dA1 j, or complete updated models A12, generated on each user device/client, are transferred back to the server where they are aggregated across all determined clients to generate a new model component A12, which in turn is downloaded to the clients i and updated to form model A13,.
• model is meant either an entire model, or a part of a model.
• the model comprises at least two parts A1 , A2.
• One individual part A1 is assigned to the client, and one part A2 is downloaded to the client i from the server.
• the individual part A1 is updated by means of the downloaded server part and an element of local client data Uj, resulting in an updated individual part A12j.
• An individual value for each item j is calculated on the client using the downloaded server part A2, the updated individual part A12,, and the element of local client data u,.
• An evaluation of the value is uploaded to the server, from each client, such that the server part can be updated by means of an aggregate of such evaluations, forming updated server part A22.
• the updated server part A22 is downloaded to the clients, and yet a further updated individual part A13, is calculated on the client, by means of the downloaded updated server part A22 and an element of local client data u,. Thereafter, at least one unspecified element of the client-item matrix R can be updated, by replacing the unspecified element with its estimate, by means of the further updated individual part A13, and the updated server part A22.
• the model A13, stored locally on the client i, and the client data u, are used for calculating estimates replacing unspecified elements of the client-item matrix R.
• the updated client-item matrix R is, in other words, used to generate a first recommendation set R1 .
• a further model such as Predictive Modeling, is used to select, rescore, sort, and subsequently narrow down, the first recommendation set R1 y to a second recommendation set R2y.
• One aspect of the present disclosure relates to a client adapted for generating personalized item recommendations for a user of the client i.
• the client is connected to a server utilizing a global set of items ji , ... ,j M and at least one model A1 ,...,AK.
• the client i is configured to utilize at least one model A1 ,...,AK downloaded from the server, and to generate a recommendation set Ry, comprising at least one j p of the items ji, ...,j M , by means of at least one of the downloaded model(s) A1 , ...,AK and a local client data set u, stored on the client i, as shown in Fig. 1.
• the model(s) A1 , ...,AK comprise Collaborative Filtering, Predictive Modeling, and/or Deep Learning Models.
• the client data set u comprises implicit user feedback and/or explicit user feedback.
• the recommendation set Ry is generated by means of a combination of two models A1 , A2 and the client data set Uj, wherein one model A1 is Collaborative Filtering and the other model A2 is Predictive Modeling.
• the recommendation set R comprises a first recommendation set R1 generated by means of one model A1 , A12, A13 and the client data set Uj, and a second recommendation set R2y generated by means of a further model A2, A22, the first recommendation set R1 y, and the client data set u,. This is shown schematically in Fig. 2.
• Generating the second recommendation set R2y comprises selecting and scoring individual items j p of the first recommendation set R1 y.
• the client i may be configured to update each downloaded model by means of the following steps, shown schematically in Figs. 1 and 2:
• D. calculate at least one further updated model A13i, ...,AK3i by means of the new updated model A12,...,AK2 and the local client data set Uj.
• the model A may be updated, on the client, as mentioned in steps A and D above.
• the model A may be updated, on the server, as mentioned in step B above.
• the updating is executed by averaging the updated models which were uploaded to the server, also in step B.
• the client (i) may further be configured to calculate at least one update for each model by means of the following steps:
• E. calculate at least one further updated model A13i, ...,AK3i by means of the updated model A12,...,AK2, the new update dA12i,...,dAK2i and the local client data set u,.
• Calculating an update dA1 M dAK,, dA12ii, ...,dAK2i comprises calculating a value for each item ji, ...,j M by means of a function f(i,j).
• the model A may be updated, on the client, as mentioned in steps A, D, and E above.
• the model A may be updated, on the server, as mentioned in step B above.
• Each model A e.g A1
• J1 which is to be minimized with respect to the model parameter y. is given by the sum of dAT, i.e. the
• the client i is further configured to generate a recommendation set R by means of the further updated model A13,, ... ,AK3, and the local client data set u,.
• a further aspect of the present disclosure relates to a server adapted for assisting in generating personalized item recommendations for a user of a client i, on the client i, the server being configured to utilize a global set of items ji , ... ,j M and at least one model A1 ,...,AK.
• the server is connected to a plurality of clients ii, ... ,i N , each client i being configured to download the model(s) A1 , ...,AK, and generate updated model(s) A12 , ...,AK2, or updates for the model(s)
• the server is further configured to: generate new updated model(s) A12,...,AK2 by means of updated models A12i, ...,AK2i or updates dA1 dAK, uploaded by at least one of the clients h,...,i N , and transmit the new updated model(s) A12,...,AK2 to the plurality of clients ii , ... ,i N -
• the new updated model(s) A12,...,AK2 and a local client data set Uj, stored on the client i, are utilized for each client i generating the personalized item recommendations. This is shown schematically in Figs. 1 and 2
• the server is assigned the at least one model A1 ,...,AK prior to utilizing the model(s), the act of assigning comprising one of selecting a random model or a previously known model.
• the server may be configured to generate the new updated model(s) by means of the following steps: A. determine several of the clients ii , ... ,i N , each determined client i being configured to calculate updated model(s) A12i,...,AK2i by means of the downloaded model(s) A1 ,...,AK and the local client data set Uj, and to upload the updated model(s) A12 ,...,AK2, to the server,
• the server may furthermore be configured to generate the new updated model(s) by means of the following steps:
• the model A may be updated, on the server, as mentioned in step C above.
• FIG. 1 shows the flow of information in a client-server system adapted for updating a client-item matrix R schematically.
• Value f(i,j) for item j, is calculated on the client i using local user data u,.
• the values f(ij) for a plurality of items j, comprised in updated model A12, are transmitted back to the server S, from a plurality of clients, and aggregated, whereafter initial model A1 is updated to model A12.
• no local client data u need be transferred out of the client i to update model A1.
• the same procedure is thereafter executed for at least model A12, resulting in a model A13, on each client i, which model is used for generating personalized item recommendations directed towards the user of a client i.
• the system comprises one server S and a N number of clients i.
• Fig. 1 shows only two clients, h and i N , i.e. i N equals i 2 .
• Client h utilizes local client data Uj, i.e. ui, as well as downloaded model A1.
• client i 2 utilizes local client data u 2 , as well as model A1.
• Fig 2 similarly shows the flow of information in a client-server system comprising one server S, one client and which utilizes two models A1 , A2 for generating personalized item recommendations.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Business, Economics & Management (AREA)
• Software Systems (AREA)
• General Physics & Mathematics (AREA)
• Physics & Mathematics (AREA)
• Finance (AREA)
• Strategic Management (AREA)
• Development Economics (AREA)
• Accounting & Taxation (AREA)
• Artificial Intelligence (AREA)
• Mathematical Physics (AREA)
• General Engineering & Computer Science (AREA)
• Computing Systems (AREA)
• Evolutionary Computation (AREA)
• Data Mining & Analysis (AREA)
• Medical Informatics (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Signal Processing (AREA)
• Computer Networks & Wireless Communication (AREA)
• General Business, Economics & Management (AREA)
• Marketing (AREA)
• Economics (AREA)
• Game Theory and Decision Science (AREA)
• Entrepreneurship & Innovation (AREA)
• Computational Linguistics (AREA)
• Information Transfer Between Computers (AREA)
• Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Priority Applications (6)

Applications Claiming Priority (1)

Publications (1)

Family

ID=60935863

Family Applications (1)

Country Status (6)

Cited By (4)

Families Citing this family (3)

Citations (2)

Family Cites Families (15)

• 2017
  • 2017-12-22 RU RU2020122720A patent/RU2763530C1/ru active
  • 2017-12-22 EP EP17825542.8A patent/EP3698308A1/en active Pending
  • 2017-12-22 WO PCT/EP2017/084491 patent/WO2019120578A1/en unknown
  • 2017-12-22 JP JP2020534387A patent/JP6985518B2/ja active Active
  • 2017-12-22 US US16/956,258 patent/US20200342358A1/en not_active Abandoned
  • 2017-12-22 CN CN201780097874.5A patent/CN111492391A/zh active Pending

Patent Citations (2)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events