KR101620659B1 - Method for selecting similar users for collaborative filtering based on earth movers distance - Google Patents

Abstract

An EMD-based similar user selection method for collaborative filtering is disclosed. A method for selecting a similar user for a target user includes generating a histogram representing a user's preference for an item using information about the user, using an EMD (Earth Mover's Distance) based on the generated histogram, Calculating the similarity between the user and the target user, and selecting the similar user for the target user based on the calculated similarity.

Description

TECHNICAL FIELD [0001] The present invention relates to an EMD-based similar user selection method for collaborative filtering,

Embodiments of the present invention relate to an EMD (Earth Mover's Distance) based similar user selection method for collaborative filtering that selects a user similar to a target user for collaborative filtering.

In general, the recommendation method refers to a method of finding items that users prefer from among various items. Collaborative Filtering (Collaborative Filtering) is one of the most widely used recommendation methods, and recommends items using users who have a similar tendency to the target user (target user). Thus, the performance of collaborative filtering depends on how similar a user is to the target user.

For example, Korean Patent Laid-Open Publication No. 10-2008-0043140 (published on May 16, 2008) entitled " Collaborative Filtering System and Method ", weights are applied using user's content utilization information and user attribute information, It is disclosed that content is recommended by filtering an action of a user determined not to be a user.

However, the existing collaborative filtering technique can measure the similarity between the users only when there is an item commonly evaluated by the similar user and the target user, and when the target user does not evaluate the item, There is a problem that the degree of similarity can not be measured.

Accordingly, there is a need for a method that can more accurately select a user similar to the target user even when the target user has not evaluated the item.

An EMD-based similar-user selection method for collaborative filtering that can more accurately select a user similar to a target user even when the target user does not evaluate the item by reflecting the association between items when measuring the similarity between users is disclosed.

An EMD-based pseudo-user selection method for collaborative filtering that enables high quality recommendation using collaborative filtering is disclosed.

A method for selecting a similar user for a target user includes generating a histogram representing a user's preference for an item using information about the user, using an EMD (Earth Mover's Distance) based on the generated histogram, Calculating the similarity between the user and the target user, and selecting the similar user for the target user based on the calculated similarity.

According to one aspect, the information about the user may include an identifier of the user, an identifier of the item purchased or used by the user, and an evaluation score of the user's corresponding item.

According to another aspect, the generating step includes determining each bin of the histogram as a category of an item, and determining an average rating score for the item or a number of items evaluated in each category as a preference for the category Step < / RTI >

According to another aspect, the method further includes calculating a degree of similarity between the two categories by calculating distances between the two categories using a weight of items simultaneously included in the two categories before the calculating step, Calculating the similarity between the users may be a step of calculating the similarity between the user and the target user based on the calculated histogram of distances between the categories.

According to another aspect of the present invention, the information on the selected similar users may be obtained by predicting a score to be given to each item by the target user using collaboration filtering based on the information about the selected similar users, And may be used to select an item to be recommended to the target user as a basis.

By using the EMD (Earth Mover's Distance), users having similar tastes to the target user can be selected to find the similar user for the target user accurately.

Since it is possible to find similar users precisely for the target user, good recommendation is possible when using collaborative filtering.

FIG. 1 is a flowchart illustrating a method of selecting similar users based on EMD (Earth Mover's Distance) and recommending items in an exemplary embodiment of the present invention.
2 is an exemplary diagram illustrating the relationship between a particular user and information about each movie.
FIG. 3 is an exemplary diagram illustrating a histogram of a specific user in an embodiment of the present invention. FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a flowchart illustrating a method of selecting similar users based on EMD (Earth Mover's Distance) and recommending items in an exemplary embodiment of the present invention.

In order to select the items to be recommended to the target user using the collaborative filtering, a similar user having a tendency similar to the target user should be selected for each item.

Once a similar user is selected, the rating of an item that the target user has not evaluated can be predicted using collaborative filtering based on items evaluated by similar users. Then, the item can be recommended to the target user based on the predicted rating. Therefore, it is very important to select users similar to the target users in order to improve the recommendation quality of the collaborative filtering technique.

Accordingly, in order to more accurately select similar users, the similar user selection method according to the present invention calculates the degree of similarity between users and target users using the EMD (Earth Mover's Distance) based on the past item usage history of users (110) .

EMD is a similarity measure widely used in the field of image processing, and its accuracy is known to be very high. However, in order to apply the EMD to the similar user selection, information about the user must be expressed in the form of a histogram applicable to the EMD. In this case, the information about the user may include an identifier of the user, an identifier of the item purchased or used by the user, and an evaluation score for the item. In addition, in order to apply EMD to similar user selection, the distance between bin of the histogram must be defined.

Accordingly, in order to use the EMD when calculating the similarity between users, the similar user selection method according to the present invention defines each bin of the histogram for an arbitrary user as a category of an item, and sets the preference for the category to a value of the category A histogram representing the user's preference for the item can be generated. At this time, the average rating score of each item may be used as a preference or the number of items evaluated in each category may be used.

For example, in the similar user selection method according to the present invention, data between two users to be compared can be expressed by a histogram in order to measure distance between users using EMD. When there are two histograms P = {p ₁ , p ₂ , ..., p _n }, Q = {q ₁ , q ₂ , ..., q _n }, p _i and q _i are the i th bin of each histogram which means the weight of the bin. Here, it is assumed that the sum of the proportions of P and Q is the same.

Then calculate the minimum WORK to measure the distance between these two data. WORK means the minimum amount of the distribution of the histogram P into the distribution of Q. As an example, WORK can be obtained as the product of the amount (f) of bins moved from one histogram to another histogram by the distance (d) between each histogram bin as shown in Equation 1 below.

Here, F = [f _ij ] denotes the amount of histogram bin transferred from p _i to q _i , and D = [d _ij ] denotes the distance between transferred bins.

EMD is very accurate because it can measure the similarity between different bins in the histogram through the distance (d) between each histogram bin.

Once similarity between the users and the target user is calculated through the EMD, a similar user to the target user can be selected 120 by searching for a user similar to the target user based on the calculated similarity.

Once users similar to the target user are selected 130, the collaborative filtering may be used to predict the score that the target user will give to the item based on the scores of the items that the similar users have evaluated in the past.

Once the target user has predicted the score to be awarded to the item, he can select items to recommend to the target user 140 based on it, and thus recommend the selected items to the target user 150.

The similar user selection method described above can be performed by a sorting device for a similar user. The similar user selection device includes a generation unit for generating a histogram representing a preference of a user with respect to an item by using information about a user, a similarity determination unit for determining a similarity degree between a user and a target user using an EMD (Earth Mover's Distance) And a sorting unit for sorting similar users for the target user based on the calculated similarity.

FIG. 2 is a diagram illustrating an example of a relationship between a specific user and information about each movie, and FIG. 3 is an exemplary diagram illustrating a histogram of a specific user in an embodiment of the present invention. Hereinafter, with reference to FIG. 2 and FIG. 3, the process of selecting similar users will be described in more detail, for example.

Referring to FIG. 2, user data (USER DATA) may be composed of a user ID, a movie ID evaluated by a user, and an evaluation score for the movie. The item data (ITEM DATA) may be composed of a movie ID and a category ID to which the movie belongs. At this time, one movie can be included in several categories.

FIG. 3 shows a histogram of information on the user using the user data and item data. Here, the x-axis represents each bin of the histogram, and the y-axis represents the specific gravity of each bin. The weight of the bean indicates the average rating score given by the user to the movie in the category corresponding to the bin. For example, the weight of the bean corresponding to the romance of the user means "4".

To apply EMD to similar user selection, we need to define the ground distance between each bin. However, existing collaborative filtering does not define the distance between categories. In addition, since categories are independent of each other, Euclidean distances, which are commonly used in existing EMDs, can not be used. Therefore, in the present invention, it is possible to calculate the inter-category distance using the weight of the items existing simultaneously in the two categories based on the following Equation (2).

Here, x and y denote a category ID, I _x denotes an item set belonging to the category x, and I _y denotes an item set belonging to the category y.

The evaluation score of the target user can be predicted by applying the proposed technique to the collaborative filtering technique as shown in Equation (3).

는 사용자(u)의 평균 평가 점수, N_uq는 사용자(u)와 아이템(q)을 기준으로 했을 때 유사 사용자의 집합, v와 j는 집합 N_uq에 속한 사용자, r_vq는 사용자(v)가 아이템(q)를 평가한 평가 점수, 그리고

는 사용자(v)의 평균 평가 점수를 각각 나타낸다. sim(x, y)는 사용자 x 와 y 간의 유사도이며, 본 발명에서는 EMD 기반의 유사도를 사용한다.Here, r _uq is the score to be predicted by the user (u) for the item (q)

V and j are users belonging to the set N _uq , _vq is the user (v), u is the average score of the user (u), N _uq is the set of similar users based on the user (u) (Q), < / RTI > and

Represents the average evaluation score of the user (v). sim (x, y) is the similarity between user x and y, and the present invention uses EMD-based similarity.

In the following, it is verified that the similar user selection method according to the present invention is superior in accuracy and diversity to the existing technique through the experimental results using MovieLens data. We construct training data and test set by k-folding method. We compare the accuracy of proposed method with finding similar user using existing cosine, finding similar user using Pearson correlation number.

MAE (Mean Absolute Error) and RMSE (Root Mean Square Error) were used to measure the accuracy of the experimental results. MAE is the mean of the absolute values of the error between the actual and predicted values, and RMSE is the mean square of the mean square of the error between the actual value and the predicted value.

The following Table 1 shows the accuracy when the number of movies evaluated the user's preference.

Subject MAE RMSE Count Cosine 0.90 1.76 Count Pearson 1.03 1.94 Count EMD 0.80 1.61

Referring to Table 1, MAE and RMSE of the similar user selection method according to the present invention are improved by 11.33% and 8.49%, respectively, and the MAE and RMSE are improved by 22.89% and 17.03%, respectively, compared with the Pearson correlation coefficient .

The following Table 2 shows the accuracy when the user's preference is taken as the average score for each genre.

Subject MAE RMSE Rating Cosine 0.92 1.80 Rating Pearson 0.83 2.29 Rating EMD 0.80 1.61

Referring to Table 2, MAE and RMSE of the similar user selection method according to the present invention are improved by 13.10% and 10.16%, respectively, and the MAE is 4.35% and the RMSE is 29.66% higher than the Pearson correlation coefficient.

That is, when the similar user selection method according to the present invention is used, the MAE is increased by a maximum of 13% and the RMSE by a maximum of 10%, compared with the case of using the similarity method of the present invention. Is improved by up to 30%.

The pseudo-user sorting device described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the components described in the embodiments may be implemented in a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), a PLU a programmable logic unit), a microprocessor, or any other device capable of executing and responding to instructions. The like user selection device may execute an operating system (OS) and one or more software applications running on the operating system. In addition, the similar user selection device may access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, each component may be described as being used individually, but one of ordinary skill in the art will recognize that the processing device may be configured to include a plurality of processing elements and / Element can be included. For example, the pseudo-user sorting device may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may comprise a computer program, code, instructions, or a combination of one or more of the foregoing, and may be used to operate the like user selection device as desired or collectively, Command. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer (e.g., computer), computer Or may be embodied permanently, or temporarily, in a storage medium or device, or in a signal wave being transmitted. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The similar user selection method according to this embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (5)

A method for selecting a similar user for a target user performed by a similar user selection device,
Generating a histogram representing a user's preference for an item using information about a user, the generating unit of the similar-user selecting apparatus;
Determining a distance between the two categories using the weight of items included in the two categories that are present in the generated histogram;
Calculating a similarity between the user and a target user using an EMD (Earth Mover's Distance) based on the determined distance between the two categories; And
Selecting a similar user for the target user based on the calculated similarity;
Lt; / RTI >
The histogram may include:
Determining each bin as a category of items and determining an average rating score for the item or a number of items evaluated in each category as a preference for the category,
Preferably,
Wherein the histogram of the target user is determined by multiplying the histogram of the user by the amount of bins transferred to the histogram for the target user and the distance between the determined two bins. The method according to claim 1,
The information about the user includes:
An identifier of the user, an identifier of the item purchased or used by the user, and an evaluation score of the user for the corresponding item. delete delete The method according to claim 1,
The information about the selected similar user is,
A target user to predict a score to be given to each item using collaboration filtering based on the information about the selected similar user and to select an item to be recommended to the target user based on the predicted score A method for selecting similar users.

Images