AU2017221807A1 - Preference-guided data exploration and semantic processing - Google Patents

Abstract

Techniques for calculating a ranking of at least one item in a plurality of items. The techniques include receiving user preferences comprising a plurality of first-order user 5 preferences indicative of a user's preferences for items in the plurality of items, and at least one second-order user preference indicative of the user's preferences among first-order user preferences in the plurality of first-order user preferences; calculating, with at least one processor, a ranking of the at least one item in the plurality of items based, at least in part on, at least one data structure encoding a preference graph that represents the received user 0 preferences; and identifying and outputting at least a subset of the plurality of items to a user, in accordance with the ranking. 9431921_1

Description

2017221807 30 Aug 2017

PREFERENCE-GUIDED DATA EXPLORATION AND SEMANTIC PROCESSING

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a divisional of Australian Patent Application no. 2012272479, 5 the entirety of which is incorporated herein by reference.

BACKGROUND

Information retrieval systems are capable of accessing enormous volumes of information. As a result, locating information of interest to users presents challenges. One such challenge is 0 identifying information that may be of interest to users so that information may be presented to them without overwhelming users with irrelevant information. Even in environments, such as online search, where the user provides an explicit indication (e.g., a search query) of what information the user may be interested in, such an indication may not be sufficient to accurately identify the content which is appropriate to present to the user from among all the content that 5 may be available to be presented to the user.

Conventional approaches to identifying information of interest to a user often shift the burden of finding such information to the user. For example, conventional approaches to search may involve presenting all potentially relevant results to a user in response to the user’s search query. Subsequently, the user has to manually explore and/or rank these results in order to find !0 the information of greatest interest to him. When the number of potentially relevant results is large, which is often the case, the user may be overwhelmed and may fail to locate the information he is seeking.

One technique for addressing this problem is to integrate a user’s preferences into the process of identifying information of interest to the user. By presenting information to the user in 25 accordance with his preferences, the user may be helped to find the information he is seeking. 2017221807 30 Aug 2017

However, conventional approaches to specifying user preferences severely limit the ways in which user preferences may be specified, thereby limiting the utility of such approaches.

Consider, for example, a data exploration model adopted by many search services and illustrated in FIG. 1. Query interface 12 is used to collect query predicates in the form of 5 keywords and/or attribute values (e.g., “used Toyota” with price in the range [$2000-$5000]). Query results are then sorted (14) on the values of one or more attributes (e.g., order by Price then by Rating) in a major sort/minor sort fashion. The user then scans (16) through the sorted query answers to locate items of interest, refines query predicates, and repeats the exploration cycle (18). This “Query, Sort, then Scan” model limits the flexibility of preference specification to and imposes rigid infonnation retrieval schemes, as highlighted in the following example.

Example 1

Amy is searching online catalogs for a camera to buy. Amy is looking for a reasonably priced camera, whose color is preferably silver and less preferably black or 15 gray, and whose reviews contain the keywords “High Quality.” Amy is a money saver, so her primary concern is satisfying her Price preferences, followed by her Color and Reviews preferences.

The data exploration model of FIG. 1 allows Amy to sort results in ascending price order. 20 Amy then needs to scan through the results, which are sorted by price, comparing colors and inspecting reviews to find the camera that she wants. The path followed by Amy to explore search results is mainly dictated by her price preference, while other preferences are incorporated in the exploration task through Amy’s effort, which can limit the possibility of finding items that closely match her requirements. 25 Conventional approaches to specifying user preferences suffer from a number of other drawbacks in addition to not simultaneously supporting preferences for multiple attributes (e.g., price, color, and reviews). For example, preference specifications maybe inconsistent with one another. A typical example is having cycles (or “circularity”) in preferences among first-order preferences (preferences among attributes of items such as preferring one car to another car 30 based on the price or on brand). For instance, a user may indicate that a Honda is preferred to a Toyota, a Toyota is preferred to a Nissan, and a Nissan is preferred to a Honda. Even when first- 2017221807 30 Aug 2017 order preferences are consistent, preferences among first-order preferences, termed second-order preferences (e.g., brand preferences are more important than price preferences) may result in further inconsistencies among specified preferences. Conventional information retrieval systems are unable to rank search results when preference specifications may be inconsistent. 5

SUMMARY

In some embodiments, a computer-implemented method for calculating a ranking of at least one item in a plurality of items is disclosed. The method comprises receiving user preferences comprising a plurality of first-order user preferences indicative of a user’s 10 preferences for items in the plurality of items, and at least one second-order user preference indicative of the user’s preferences among first-order user preferences in the plurality of first-order user preferences. The method further comprises calculating, with at least one processor, a ranking of the at least one item in the plurality of items based, at least in part on, at least one data structure encoding a preference graph that represents the received user preferences, and 15 identifying and outputting at least a subset of the plurality of items to a user, in accordance with the ranking.

In some embodiments, a system is disclosed. The system comprises at least one memory configured to store a plurality of tuples, each tuple in the plurality of tuples corresponding to an item in a plurality of items, and at least one data structure encoding a preference graph to 20 represent user preferences, wherein the user preferences comprise a plurality of first-order user preferences indicative of a user’s preferences among items in the plurality of items, and at least one second-order user preference indicative of the user’s preferences among first-order user preferences in the plurality of first-order user preferences. The system further comprises at least one processor coupled to the at least one memory, the at least one processor configured to 25 calculate a ranking of at least one item in the plurality of items based, at least in part on, the at least one data structure encoding the preference graph that represents the user preferences, and identify and output at least a subset of the plurality of items to a user, in accordance with the ranking.

In some embodiments, at least one computer-readable storage medium article is 30 disclosed. The at least one computer-readable storage medium article stores a plurality of processor-executable instructions that, when executed by at least one processor, cause the at least 2017221807 30 Aug 2017 one processor to perform a method of calculating a ranking for at least one item in a plurality of items. The method comprises receiving user preferences comprising a plurality of first-order user preferences indicative of a user’s preferences among items in the plurality of items, and at least one second-order user preference indicative of the user’s preferences among first-order user 5 preferences in the plurality of first-order user preferences. The method further comprises calculating a ranking of the at least one item in the plurality of items based, at least in part on, at least one data structure encoding a preference graph that represents the received user preferences, and identifying and outputting at least a subset of the plurality of items to a user, in accordance with the ranking. 10 In some embodiments, a computer-implemented method for constructing at least one data structure encoding a preference graph that represents user preferences is disclosed. The preference graph comprises a first node for a first item in a plurality of items, a second node for a second item in the plurality of items, and an edge between the first node and the second node.

The method comprises receiving a plurality of first-order user preferences indicative of user 15 preferences among values of attributes of items in the plurality of items, receiving at least one second-order user preference indicative of user preferences among the attributes of items in the plurality of items, and computing, using at least one processor, a weight for the edge between the first node and the second node based at least in part on the plurality of first-order user preferences and the at least one second-order user preference, wherein the weight is indicative of 20 a degree of preference for the first item over the second item.

In some embodiments, a system for constructing at least one data structure encoding a preference graph that represents user preferences is disclosed. The preference graph comprising a first node for a first item in a plurality of items, a second node for a second item in the plurality of items, and an edge between the first node and the second node. The system comprises at least 25 on processor configured to receive a plurality of first-order user preferences indicative of user preferences among values of attributes of items in the plurality of items, receive at least one second-order user preference indicative of user preferences among the attributes of items in the plurality of items, and compute a weight for the edge between the first node and the second node based at least in part on the plurality of first-order user preferences and the at least one second-30 order user preference, wherein the weight is indicative of a degree of preference for the first item over the second item. 2017221807 30 Aug 2017

In some embodiments, at least one computer-readable storage medium article is disclosed. The at least one computer-readable storage medium article stores a plurality of processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method for constructing at least one data structure encoding a 5 preference graph that represents user preferences. The preference graph comprises a first node for a first item in a plurality of items, a second node for a second item in the plurality of items, and an edge between the first node and the second node. The method comprises receiving a plurality of first-order user preferences indicative of user preferences among values of attributes of items in the plurality of items, receiving at least one second-order user preference indicative of 10 user preferences among the attributes of items in the plurality of items, and computing a weight for the edge between the first node and the second node based at least in part on the plurality of first-order user preferences and the at least one second-order user preference, wherein the weight is indicative of a degree of preference for the first item over the second item.

In some embodiments, a computer-implemented method for obtaining user preferences is 15 disclosed. The method comprises receiving user context information associated with at least one user; identifying, based at least in part on the received user context information, a plurality of attributes of items in a plurality of item; obtaining, using at least one processor, at least one first-order user preference based at least in part on a first input provided by the at least one user, wherein the plurality of first-order user preferences comprises a preference for a first attribute in 20 the plurality of attributes; and obtaining, using the at least one processor, at least one second-order user preference based at least in part on a second input provided by the at least one user, wherein the at least one second-order user preference comprises a preference among attributes in the plurality of attributes.

In some embodiments, a system for obtaining user preferences is disclosed. The system 25 comprises at least one processor configured to receive user context information associated with at least one user; identify, based at least in part on the received user context infonnation, a plurality of attributes of items in a plurality of items; obtain, at least one first-order user preference based at least in part on a first input provided by the at least one user, wherein the plurality of first-order user preferences comprises a preference for a first attribute in the plurality 30 of attributes; and obtain at least one second-order user preference based at least in part on a second input provided by the at least one user, wherein the at least one second-order user preference comprises a preference among attributes in the plurality of attributes.

In some embodiments, at least one computer-readable storage medium article is disclosed. The at least one computer-readable storage medium article stores a plurality of processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method for obtaining user preferences. The method comprises receiving user context information associated with at least one user; identifying, based at least in part on the received user context information, a plurality of attributes of items in a plurality of items; obtaining, using at least one processor, at least one first-order user preference based at least in part on a first input provided by the at least one user, wherein the plurality of first-order user preferences comprises a preference for a first attribute in the plurality of attributes; and obtaining, using the at least one processor, at least one second-order user preference based at least in part on a second input provided by the at least one user, wherein the at least one second-order user preference comprises a preference among attributes in the plurality of attributes.

In some embodiments, a computer-implemented method for specifying user preferences in a semantic network encoded in at least one data structure is disclosed. The method comprises receiving, using at least one processor, a plurality of first-order user preferences for at least one concept in a semantic network, wherein the plurality of first-order user preferences are indicative of a user’s preferences among children of attributes of the at least one concept in the semantic network; receiving, using the at least one processor, at least one second-order user preference for the at least one concept in the semantic network, wherein the at least one second-order user preference is indicative of the user’s preferences among attributes of the at least one concept; and perfonning at least one semantic processing act by using the semantic network, the plurality of first-order user preferences, and the at least one second-order user preference.

In some embodiments, a system for specifying user preferences in a semantic network encoded in at least one data structure is disclosed. The system comprises at least one processor configured to receive a plurality of first-order user preferences for at least one concept in a semantic network, wherein the plurality of first-order user preferences are indicative of a user’s preferences among children of attributes of the at least one concept in the semantic network; receive at least one second-order user preference for the at least one concept in the semantic network, wherein the at least one second-order user preference is indicative of the user’s 2017221807 30 Aug 2017 preferences among attributes of the at least one concept; and perform at least one semantic processing act by using the semantic network, the plurality of first-order user preferences, and the at least one second-order user preference.

In some embodiments, at least one computer-readable storage medium article is 5 disclosed. The at least one computer-readable storage medium article stores a plurality of processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method for specifying user preferences in a semantic network encoded in at least one data structure. The method comprises receiving a plurality of first-order user preferences for at least one concept in a semantic network, wherein the plurality of first-10 order user preferences are indicative of a user’s preferences among children of attributes of the at least one concept in the semantic network; receiving at least one second-order user preference for the at least one concept in the semantic network, wherein the at least one second-order user preference is indicative of the user’s preferences among attributes of the at least one concept; and performing at least one semantic processing act by using the semantic network, the plurality of 15 first-order user preferences, and the at least one second-order user preference.

The foregoing is a non-limiting summary of the invention, which is defined by the attached claims.

BRIEF DESCRIPTION OF THE DRAWINGS 20 The accompanying drawings are not intended to be drawn to scale. In the drawings, each identical or nearly identical component that is illustrated in various figures is represented by a like numeral. For purposes of clarity, not every component may be labeled in every drawing. In the drawings: FIG. 1 is a diagram of a “query, sort, then scan” data exploration model, in accordance 25 with prior art. FIG. 2A is a diagram illustrating a relation, in accordance with some embodiments of the present invention. FIG. 2B is a diagram illustrating a semantic network associated with a portion of the relation illustrated in FIG. 2A. 30 FIG. 3 is a flowchart of an illustrative preference modeling process, in accordance with some embodiments of the present invention. 2017221807 30 Aug 2017 FIG. 4 is a diagram illustrating scopes obtained from a relation, in accordance with some embodiments of the present invention. FIG. 5 is a diagram illustrating scope comparators, in accordance with some embodiments of the present invention. 5 FIG. 6 is a diagram illustrating conjoint preferences, in accordance with some embodiments of the present invention. FIG. 7 is a diagram of an illustrative mapping of a partial order to linear extensions, in accordance with some embodiments of the present invention. FIG. 8 is a diagram of an illustrative preference graph, in accordance with some 10 embodiments of the present invention. FIG. 9 is a diagram of an illustrative computation of edge weights for different types of second-order preferences, in accordance with some embodiments of the present invention. FIG. 10 is a diagram of an illustrative page-rank based matrix for prioritized comparators, in accordance with some embodiments of the present invention. 15 FIG. 11 is a diagram of an illustrative weighted preference graph and tournaments derived from it, in accordance with some embodiments of the present invention. FIG. 12 is a flowchart for an illustrative process for interactively specifying user preferences, in accordance with some embodiments of the present invention. FIG. 13 is a flowchart for an illustrative process for computing a ranking for one or more 20 items based on user preferences, in accordance with some embodiments of the present invention. FIG. 14 shows an illustrative example of a knowledge representation, in accordance with some embodiments of the present invention. FIG. 15 is an illustrative computer system on which some embodiments of the present invention may be implemented. 25 FIG. 16 is a block diagram illustrating an exemplary system for implementing an atomic knowledge representation model in accordance with some embodiments of the present invention. FIG. 17 is a block diagram illustrating another exemplary system for implementing an atomic knowledge representation model in accordance with some embodiments of the present invention.

Inadequate incorporation of preferences in conventional information retrieval systems is due at least partly to the inability of these systems to integrate different types of preferences. For instance, in the above-described example, preferences include an ordering on all prices (a “total order” preference), an ordering between some, but not all, colors (a “partial order” preference), a Boolean predicate for the presence of the words “High Quality” in the reviews, and an indication that price is more important than the other preferences.

As well, it may be useful to specify different types of preferences when a user may have precise preferences for information in one domain (but not another domain—e.g., because the user may possess a large amount of knowledge about that one domain, but not another). Such precise preferences may be specified, for example, in the form of one or more scoring functions. The same user may have less precise preferences for information in another domain because the user may not possess the same degree of knowledge about the other domain. In this case, preferences may be specified, for example, in the form of one or more partial orders on attribute values. There are many instances in which the user may need to specify both types of preferences (i.e., using a scoring function and using a partial order), as shown in Example 2 below.

Example 2

Alice is searching for a car to buy. Alice has specific preferences regarding sports cars, and more relaxed preferences regarding SUVs. Alice supplies values scores to rank sports cars, and a set of partial orders encoding SUVs preferences. Alice expects reported results to be ranked according to her preferences. A system capable of integrating different preference types and identifying information of interest to a user or users, in accordance with preferences specified by the user(s), may address some of the above-discussed drawbacks of conventional approaches to information retrieval. However, not every embodiment addresses every one of these drawbacks, and some embodiments may not address any of them. As such, it should be appreciated that embodiments of the invention are not limited to addressing all or any of the above-discussed drawbacks of these conventional approaches to information retrieval.

Accordingly, in some embodiments, a preference language is provided for specifying different types of user preferences among items. A system, implemented in accordance with some embodiments, may assist a user to specify preferences using the preference language. The specified preferences may be used by the system to identify information of interest to the user.

To this end, in some embodiments, the specified preferences may be used to construct a preference model that, in turn, may be used to produce a ranking of one or more items in accordance with any user preferences.

Items may be any suitable objects or information (i.e., they may be tangible or intangible) about which a user may express preferences. In some embodiments, an item may be any product that may be manufactured, sold, and/or purchased. For example, an item may be a car or an airplane ticket and a user (e.g., a consumer) may have preferences for one car over another car and/or may prefer one airplane ticket to another airplane ticket. In some embodiments, an item may comprise information. Users may prefer one item to another item based at least in part on the information that these items contain. For example, items may include content (e.g., video content, audio content, one or more images, one or more webpages, text, etc.) and the user may prefer some content to other content. As another example, items may include metadata about content. As another example, a user may prefer to see a webpage that contains information related to cars over a webpage that contains information related to bicycles. A preference model may be used to identify information of interest to the user by ranking one or more of such items in accordance with any user preferences.

In some embodiments, where semantic processing techniques may be used to identify information of interest to a user or users, an item may be represented by one or more entities in a knowledge representation. Such a knowledge representation may be used by one or more semantic processing techniques to identify information of interest to the user(s). An item may be represented by an entity or entities in any suitable type of knowledge representation and, indeed, semantic processing techniques make use of a broad range of knowledge representations including, but not limited to, structured controlled vocabularies such as taxonomies, thesauri, and faceted classifications; formal specifications, such as semantic networks and ontologies; and unstructured forms, such as documents based in natural language.

While it is not intended that the claimed invention be limited to processing specific knowledge representations in accordance with user preferences, a preferred form is the type of formal specification referred to as a semantic network. Semantic networks are explained in many sources, noteworthy among them being U.S. Publication No. 2010/0235307, titled “Method, System, And Computer Program For User-Driven Dynamic Generation of Semantic Networks and Media Synthesis,” filed on, published on September 16, 2010, which is hereby incorporated by reference in its entirety.

In some embodiments, a semantic network may be represented as a data structure embodying (or representing) a directed graph comprising vertices or nodes that represent concepts, and edges that represent semantic relations between the concepts. The data structure embodying a semantic network may be encoded (i.e., instantiated) in one or more non-transitory, tangible computer-readable storage medium articles. As such, a semantic network may be said to comprise one or more concepts. Each such concept may be represented by a data structure storing any data associated with one or more nodes in the semantic network representing the concept. An edge in the directed graph (i.e., its encoded instantiation in the data structure) may represent any of different types of relationships between the concepts associated with the two nodes that the edge connects.

Accordingly, in embodiments where items may be represented by one or more entities in a knowledge representation, items may be represented, at least in part, by one or more concepts in a semantic network. For example, an item may be represented by a concept and one or more of its descendants. As a specific example, an item may be represented by a concept, children of the concept, and grandchildren of the concept. Though it should be appreciated that an item may be represented by any entity or entities in a semantic network as aspects of the present invention are not limited in this respect.

In embodiments where items may be represented by one or more entities in a knowledge representation (e.g., a semantic network), semantic processing techniques may be used to perform any suitable type of semantic processing in accordance with user preferences. As one non-limiting example, semantic processing techniques may be used to identify information of interest to a user at least in part by identifying concepts in the semantic network that are of interest to the user. To this end, user preferences may be used to construct a preference model that, in turn, may be used to produce a ranking of one or more concepts in accordance with any user preferences. As another non-limiting example, semantic processing techniques may be used to augment a semantic network by synthesizing one or more new concepts based at least in part on user preferences. Synthesis techniques may rely on preference information and/or a preference model, constructed in accordance with techniques described herein, when synthesizing one or more knowledge representations and/or presenting knowledge representations to a data consumer. To this end, the preference model may be used to produce a ranking of one or more concepts in a semantic network or the preference may be used for this purpose in any other suitable way.

Any of the above-described types of items may comprise, or have associated with it, one or more attributes. In some embodiments, an attribute of an item may be related to the item and may be a characteristic of the item. An attribute of an item may be a characteristic descriptive of the item. For example, if an item is an item that may be purchased (e.g., a car, a computer, etc.), an attribute of the item may be a price related to the item. As another example, if an item comprises information (e.g., a movie, music, etc.), an attribute of the item may be a genre of the content (e.g., horror movies, bluegrass music, etc.) or any other suitable characteristic of the content. In some instances, an attribute of an item may identify the item. For example, an attribute of an item may be an identifier (e.g., name, serial number, or model number) of the item.

In some embodiments, attributes may be numerical attributes or categorical attributes. Numerical attributes may comprise one or more values. For instance a numerical attribute may comprise a single number (e.g., 5) or a range of numbers (e.g., 1-1000). Categorical attributes may also comprise one or more values. For instance, a categorical value for the category “Color” may comprise a single color (e.g., “Red”) or a set of colors (e.g., {“Red”, “Green”}). Though, it should be recognized that attribute values are not limited to being numbers and/or categories and may be any of numerous other types of values. For instance, values may comprise alphabetic and alphanumeric strings. Though, it should be appreciated that, in some embodiments, attributes are not limited to being numerical attributes or categorical attributes as the case may be when an item is an element of a knowledge representation. In that case, an attribute of an item may be another element of the knowledge representation, as described below.

In some embodiments, where an item is represented at least in part by a concept in a semantic network (e.g., a concept and one or more of its descendants), an attribute of the item may be an attribute of the concept. In turn, an attribute of a concept in a semantic network may be any of numerous types of entities in the semantic network. An attribute of a concept may be 2017221807 30 Aug 2017 an entity in the semantic network, which is indicative of one or more characteristics of the concept. Additionally or alternatively, attributes of a concept may correspond to other concepts in the semantic network and, for example, may correspond to children of the concept. For instance, as shown in FIG. 2B, the concepts “Make/Model,” “Color,” “Price,” and “Deposit” are 5 attributes of the concept “Car” and the concepts “Red” “Blue” and “Black” are attributes of the concept “Color.” It should also be appreciated that in some embodiments, concepts in a semantic network may be defined in terms of compound levels of abstraction through their relationships to other entities and structurally in terms of other, more fundamental knowledge representation entities such as keywords and morphemes. In such embodiments, these more fundamental 10 knowledge representation entities such as keywords, morphemes and other entities that comprise concepts may be attributes of the concept.

In some embodiments, an item may be represented by one or more tuples comprising information associated with the item. For example, a tuple may comprise values for one or more attributes associated with the item. In some cases, a tuple representing an item may comprise a 15 value for each attribute associated with the item. In other cases, a tuple representing an item may comprise a value for only some of the attributes associated with the item. The values maybe of any suitable type and may depend on the type(s) of attributes associated with the item. FIG. 2A shows an illustrative example of a set of items, each item being represented by a tuple comprising values for the attributes of the item. In the illustrative example of FIG. 2 A, each 20 item is a car and is associated with six attributes'. “ID,” “Make,” “Model,” “Color,” “Price,” and “Deposit ” Though in this example all items share the same attributes, this is not a limitation of aspects of the present invention as different items may have different attributes from one another and some attributes may have unknown values. In this illustrated example, each item is represented by a tuple (i.e., a set) of attribute values. Accordingly, the first item is represented by 25 the first set of attribute values. For instance, the first item is represented by the tuple in the first row of the table shown in FIG. 2A. As illustrated, this first item is an $1600 Red Honda Civic identified by identifier “fi”. A deposit of $500 may be required to purchase this car.

As previously mentioned, aspects of the present invention are not limited to representing items using tuples and, in some embodiments, items may be represented using knowledge 30 representations such as semantic networks. In some instances, items may be represented using tuples and/or semantic networks. For example, as shown in FIG. 2B, items represented using 2017221807 30 Aug 2017 tuples in FIG. 2A may be represented by one or more entities in a semantic network. Each of the items shown in FIG. 2A is a car and the semantic network shown in FIG. 2B comprises a concept “car.” In FIG. 2B, the concept “car” is shown as having attributes “Make/Model,” “Color,” “Price,” and “Deposit” corresponding to some of the attributes of the items shown in FIG. 2A. In 5 addition, values of attributes shown in FIG. 2A correspond to children of the attributes of the concept “car” in the semantic network of FIG. 2B. As such, in this illustrative example, the concept “car,” children of the concept “car,” and the grandchildren of the concept “car” collectively represent items shown as being represented by tuples in FIG. 2A. It should he appreciated that the illustrative semantic network shown in FIG. 2B corresponds only to a 10 portion of the information shown in FIG. 2A; but this is for purposes of clarity only, as aspects of the present invention are not limited in this respect.

It should also be appreciated that, in some instances, a set of items may be represented alternatively using either a relation comprising one or more tuples or a knowledge representation such as a semantic network. FIGS. 2A and 2B provide one such example. However, in other 15 instances, only one type of representation may be used. This may be done for any of numerous reasons. For example, it may be more computationally efficient to manipulate data structures associated with one representation than with another representation. Additionally or alternatively, it may be more convenient to represent a set of items using one representation over another. 20 A user may express preferences for one item over another item in a set of items. As discussed below, user preferences may be of any suitable type and may be first-order user preferences, second-order user preferences, and even further-order preferences.

In some embodiments, first-order preferences may be preferences expressed with respect to values of attributes of items. For example, a first-order preference may be a preference for an 25 item over another item based on values of an attribute of the two items. For instance, a first-order preference may indicate that one item (e.g., a car) with a lower price (value of the attribute “price”) is preferred to another item (e.g., another car) with a higher price (a higher value of the attribute price). As another example, a first-order preference may indicate that an item (e.g., a car) that is red (value of the attribute “color”) is preferred to another item (e.g., another car) that 30 is blue (a different value of the attribute “color”). 2017221807 30 Aug 2017

Another type of preference that may be specified is a second-order preference. In some embodiments, second-order preferences may indicate which attributes are more important to a user. As such, second-order preferences may indicate which first-order preferences are preferred by the user, if first-order preferences have been specified. For example, second-order preferences 5 may indicate that the price of a car may be more important to a user than the color of the car. As such, if first-order preferences A were specified for values of the “price” attribute and first-order preferences B were specified for values of “color” attribute, the second-order preferences may indicate that first-order preferences A are preferred to first-order preferences B.

In some embodiments, where an item is represented at least in part by a concept in a 10 semantic network, user preferences associated with the item may be specified by specifying user preferences for the concept. For instance, as previously described with respect to the illustrative examples of FIGS. 2A and 2B, the items shown in FIG. 2A are represented at least in part by the concept “car” shown in FIG. 2B. As such, user preferences for the items shown in FIG. 2A may be specified by specifying user preferences for the concept “car” shown in FIG. 2B. 15 User preferences for a concept may be specified at least in part by specifying preferences among descendants of the concept. For example, first-order order preferences for a concept may be specified based at least in part by specifying preferences among descendants of its attributes. For instance, in the illustrative example of FIG. 2B, first-order preferences for the concept “car” may be used to express a preference for one car over another car by specifying preferences 20 among descendants (e.g., children, grandchildren, great-grandchildren, etc...) of an attribute of the concept “car.” As a specific example, first-order preferences for the concept “car” may be used to express a preference for a less expensive car than a more expensive car by indicating that a smaller value among children of the attribute “price” is preferred over a larger value. As another specific example, first-order preferences for the concept “car” may be used to express a 25 preference for a color of the car by indicating that, among the descendants of attribute “color,” the node “red” is preferred to the node “blue.” As another example, second-order preferences for a concept may be specified based at least in part by specifying preferences among its attributes. In the illustrative example of FIG. 2B, for instance, second-order preferences for the concept “car” may indicate that the attribute “price” is preferable to the attribute “color.” 2017221807 30 Aug 2017

There may be many different types of first-order and second-order preferences. These types of preferences, along with other aspects of first-order and second-order preferences, are discussed in greater detail below in Sections II and III, respectively.

An information retrieval system may be any system configured to identify and provide, 5 from a larger set of digital content, information which may be of interest to one or more users.

In some embodiments, an information retrieval system may be configured to obtain user context information associated with one or more users. As described in greater detail below in Section VIII, user context information may comprise any information related to the user(s) and/or provided by the user(s). For example, in some embodiments, user context information may 10 comprise one or more search queries received from one or more users; the queries may indicate content that the user(s) may be seeking. An information retrieval system may comprise and/or interface with a search engine such as an Internet search engine or a domain-specific search engine (e.g., a search engine created to search a particular information domain such as a company’s or institution’s intranet, or a specific subject-matter information repository) to 15 process such queries. In another example, an information retrieval system may comprise and/or interface with a database system that may allow user queries.

In embodiments where a user or users provide queries to an information retrieval system, such queries may be any of numerous types of queries. For instance, a query may comprise one or more keywords indicating what the user is seeking. In some cases, a query may comprise user 20 preferences. Though, it should be appreciated that user preferences may be specified separately and/or independently from any user query provided to the information retrieval system. For example, a user may specify preferences that may apply to multiple user queries. As another example, a user may specify preferences without providing any query. The specified preferences may comprise preferences of any suitable type such as first-order and/or second-order user 25 preferences.

Regardless of the types of preferences that a user may wish to specify, an information retrieval system may assist a user to specify preferences. In some embodiments, an information retrieval system may assist a user to specify preferences using the preference language. Some example approaches to how an information retrieval system may assist a user to specify 30 preferences are described in greater detail in Sections I and VI, below. 2017221807 30 Aug 2017

After user-specified preferences are obtained (e.g., from a user-specified query or any other suitable source), a preference model may be constructed from these preferences. The preference model may be constructed from different types of preferences and may be constructed from first-order preferences of different types and/or from second-order preferences of different 5 types. A preference model may be represented by a data structure encoding the preference model. The data structure may comprise any data necessary for representing the preference model and, for example, may comprise any parameters associated with the preference model. A data structure encoding a preference model may be stored on any tangible computer-10 readable storage medium. The computer-readable storage medium may be any suitable computer-readable storage medium and may be accessed by any physical computing device that may use the preference model encoded by the data structure.

In some embodiments, the preference model may be a graph-based preference model and the data structure encoding the preference model may encode a graph, termed a preference graph, 15 characterizing the graph-based preference model. The preference graph may comprise a set of nodes (vertices) and a set of edges connecting nodes in the set of nodes. The edges may be directed edges or may be undirected edges. Accordingly, the data structure encoding the preference graph may encode the preference graph by encoding the graph’s vertices and edges. Any of numerous data structures for encoding graphs, as are known in the art, may be used to 20 encode the preference graph, as the invention is not limited in this respect.

In some embodiments, nodes of the graph may be associated with items. For instance, a node in the graph may be associated with a tuple that, in turn, represents an item. The graph may represent items that are related with one or more keywords in a query. For instance, a set of items may be selected in response to a user-provided query. It should be appreciated that, in 25 embodiments where items are represented by one or more entities in a semantic network, the preference is not the same as the graph used to represent a semantic network. A first-order preference for one item over another item may be represented as an edge in the preference graph, with the edge connecting nodes associated with the tuples associated with the two items. A weight may be associated to each edge in the preference graph to provide an 30 indication of a degree of preference for one of the nodes terminating the edge. The weight may be computed based on first-order and/or second preferences. Aspects of a graph-based preference 2017221807 30 Aug 2017 model, including how such a preference model may be constructed from user-specified preferences, are described in greater detail in Sections IV and VII, below.

The preference model may be used to obtain a ranking of items in a set of items. A graph-based preference model may be used to construct such a ranking in any of numerous ways. For 5 instance, a complete directed graph may be obtained from the graph-based preference model and a ranking of items may be obtained based at least in part on the completed directed graph. As another example, a Markov-chain based algorithm may be applied to the graph-based preference model to obtain a ranking of items. These and other approaches to obtaining a ranking of items in a set of items from a preference model are described in greater detail in Section V, below. 10 It should be appreciated that although a preference graph may be a convenient abstraction, which is helpful for reasoning about user preferences, in practice, a preference graph may be implemented on a physical system via at least one data structure that may encode the preference graph. Similarly, many constructs described below (e.g., relations, scopes, scope comparators, etc.) are convenient abstractions used in various fields such as computer science 15 and information retrieval, but each such construct typically is realized, in practice, by one or more data structures representing data characterizing the construct and/or processor-executable instructions for carrying out functions associated with the construct. Similarly, although a knowledge representation such as a semantic network may be a convenient abstraction, which is helpful for reasoning about representing knowledge, in practice, a semantic network and/or other 20 knowledge representation may be implemented on a physical system via at least one data structure that may encode the semantic network and/or other knowledge representation. Such data structures and processor-executable instructions may be encoded on any suitable tangible computer-readable storage medium article or articles. Such data structures provide a physical instantiation in which a physical memory holds information organized according to certain rules 25 to facilitate use of the information by any software program that assumes such organization.

Accordingly, for ease of reading, every reference to a construct (e.g., a graph, a node, an edge, a relation, scope, scope comparator, semantic network, concept, knowledge representation, etc.) is a reference to one or more data structures encoding the construct and/or processor-executable instructions that when executed by a processor perform functions associated with the 30 construct, since explicitly referring to such data structures and processor-executable instructions for every reference to a construct is tedious. 2017221807 30 Aug 2017

It should also be appreciated that the above-described embodiments of aspects of described concepts can be implemented in any of numerous ways. For example, the embodiments may be implemented using hardware, software, or a combination thereof. When implemented in software, the software code may be embodied as stored program instructions that 5 may be executed on any suitable processor or collection of processors (e.g., a microprocessor or microprocessors), whether provided in a single computer or distributed among multiple computers.

Software modules comprising stored program instructions may be provided to cause one or more processors to perfonn any of numerous of tasks in accordance with some of the 10 disclosed embodiments. For example, one or multiple software modules for constructing a preference model may be provided. As another example, software modules for obtaining a ranking for a set of items based on (a data structure representing) the preference model may be provided. As another example, software modules comprising instructions for implementing any of numerous functions associated with an information retrieval system may be provided. Though, 15 it should be recognized that the above examples are not limiting and software modules may be provided to perform any functions in addition to or instead of the above examples. I. Design Goals

In some embodiments, an information retrieval system that utilizes user preferences may 20 reflect some or all of the following design goals: • Guidance: The system may assist users to formulate their preferences. To this end, the system may provide interactive preference management capability. For instance, the system may provide users with information to help users specify and/or modify preferences. As a specific example, the system may provide users with information about 25 how to modify their preferences to widen or narrow the scope of their search. As another specific example, the system may provide users with information about how to modify their preferences such that the ranking of items presented to a user is modified. Though, these are only examples and the system may aid the user to formulate their preferences in any of numerous ways as described in greater detail below, in Section VI. 2017221807 30 Aug 2017 • Flexibility: Specification of different types of preferences may be supported for arbitrary subsets of items, sometimes referred to as “contexts.” The system may accept natural descriptions of preferences and map these descriptions into preference constructs. • Provenance: The system may be able to provide justification of how search results are 5 generated and ranked by relating generated results to input preferences. FIG. 3 illustrates a flowchart for an example process of modeling preferences that reflects the above-mentioned design goals. As illustrated in FIG. 3, an information retrieval system may receive a query from one or more users. For instance, the information retrieval system may 10 comprise or be coupled to a database system or a search engine and the query may comprise one or more keywords.

Toward the guidance goal, the system may assist a user to specify preferences. In some embodiments, such support may be based on pre-computed summaries, termed “facets,” that may be used for guiding information retrieval. Each facet may be associated with a number that 15 may provide the user with an estimate on the expected number of results. Accordingly, facets may allow a user to get a quick and dirty view of the underlying set of items and/or domain, and how search results may be affected by tuning preferences.

For example, the system may comprise a memory 302 configured to store a plurality of tuples (recall that each tuple comprises one or more values for one or more attributes) and may 20 receive a range of desired values for an attribute from a user. In response, the system may output a value indicative of a number of tuples comprising a value for the attribute such that the value is in the range of values. As a specific example, for a categorical attribute, a facet may comprise a possible attribute value (e.g., ‘Color = Red’), while for a numerical attribute, a facet may comprise a range of possible values (e.g., ‘Price in the range [$1000-$5000]’). Moreover, the 25 user may be able to define custom facets as Boolean conditions over multiple attributes (e.g., ‘Color=Red AND price < $5000’). The system may associate a number to each of these facets, the number indicating an expected number of tuples consistent with these facets.

Toward the flexibility goal, the system may adopt the concept of contextualized preferences, where a user can assign different preference specifications to different subsets 30 (contexts) of items 306. A user may define a context by using predetermined facets or by defining custom facets. As discussed below in Sections II and III, the user has the flexibility of 2017221807 30 Aug 2017 expressing first-order and second-order preferences within and across contexts. Contextualized preferences 306 may also part of a user’s profile 304, which may be ascertained by any of the techniques disclosed herein as well as those disclosed in U.S. Non-Provisional Application Serial No. 12/555,293, filed September 08, 2009, and titled Synthesizing Messaging Using Context 5 Provided By Consumers, which is hereby incorporated by reference in its entirety. This way, they may be loaded, saved, and/or refined upon the user’s request.

Toward the provenance goal, the information retrieval system illustrated in FIG. 3 may maintain information regarding which preferences among the input preferences, affect the relative order of each pair of items in the final results ranking. This may be done in any of 10 numerous ways and, for example, may be done by modeling of preferences using a preference model 308. This feature may be useful for the analysis and refinement 310 of preferences in different scenarios. Examples include finding preference constructs that have dominating effect on results’ ranking, decreasing/increasing the influence of some preference constructs, and understanding the effect of removing a certain preference construct. 15 Additional ways in which an information retrieval system may assist a user to input preferences are discussed below in Section VI. II. Specifying First-Order Preferences

In some embodiments, the preference language may be based on capturing pairwise 20 preferences on different granularity levels. In some embodiments, at least some items’ descriptions may follow a relational model, where each item may be represented as a tuple. Preferences may be cast against a relation R with a known schema. Though, it should be appreciated that first-order preferences may be specified in cases where an item may not be represented as a tuple. For example, first-order preferences may be specified for items 25 represented using one or more entities in a knowledge representation. However, for ease of presentation, the discussion below treats the case of how to specify first-order preferences when items are represented by tuples. A context for expressing first-order preferences, termed a “scope,” may be defined in accordance with the following definition:

Definition 1 | Scope]: A scope R, is an arbitrary non-empty subset of tuples in R. 2017221807 30 Aug 2017 A scope defines a Boolean membership property that restricts the space of all possible tuples to a subset of tuples that are interesting for building preference relations. Such a membership property may be defined using a SQL query posed against R. For example, FIG. 4 5 shows six different scopes Ri... Re in the relation “Car” illustrated in FIG. 2A, where scopes are defined using SQL queries. Though, it should be recognized that such a membership property may be defined using any of numerous other ways. As one example, a database query language other than SQL may be used to define such a membership property. As another example, the membership property may be defined using a set of variables and a database language may not 10 be needed.

As shown in the illustrative diagram of FIG. 4, scopes may intersect. Thus, a tuple in the relation R may belong to zero, one or two or more scopes. Tuples that do not belong to any scopes may be non-interesting with respect to a preference specification. Thus, for clarity, all subsequent discussion is with respect to tuples that belong to at least one scope. 15

Definition 2 [Scope Comparator]: Let Rt andRj be two scopes in R. The scope comparatorfij is a function that takes a pair of distinct tuples (one is from Rj and the other is from Rj), and returns a first value such as 1 (e.g., if the tuple from Ri is preferred), a second value such as -1 (e.g., the tuple from Rj is preferred), or a null value “-L ” (e.g., if there is no preference). 20 A scope comparator may be used to specify first-order preferences. In some instances, the scope comparator may be user-defined. Though, in other instances, a scope comparator may be defined, automatically, by a computer. Still, in other embodiments a scope comparator may be defined by a combination of manual and automatic techniques. 25 A generic interface to a scope comparator may accept two tuples and return either an indication of preference of one tuple over the other, or an indication that no preference can be made. Whenever a tuple t, is preferred to a tuple tj, we say that dominates tj, denoted as tj y tj FIG. 5 shows illustrates 5 different scope comparators defined on the scopes shown in 30 FIG. 4. In FIG. 5, the scope comparators fs,4 and fu are unconditional (i.e., they produce first-order preferences without testing any conditions beyond the conditions captured by scope 2017221807 30 Aug 2017 definition). On the other hand, the scope comparators fu , fs.e, fe,2 are conditional (i.e., they produce preference relations conditioned on some logic).

Algorithm 1 Score-based Preferences SCORE-PRHFS (tf. tuple. If tuple, S: scoring function) 1 if (5(fj) > 2 then return 1 3 clw if(S(iJ)>S(ti)) 4 then lie turn -1 5 else return 1

Conditional scope comparators allow defining composite preferences that span multiple 5 attributes given in scope definition and/or comparator logic (e.g., fej defines a composite preference on Price and Make attributes).

The generality of scope definitions and preference comparators allow encoding different types of preferences, with different semantics. In the following we give templates for encoding different types of preferences using the above-described language constructs, to

Template 1 [Score-based Preferences]. Preferences are defined using a scoring function S, where tuples achieving better scores are preferred. Without loss of generality and without limitation, assume that higher scores are better, then score-based preferences can be specified using the template given by Algorithm 1. 15 A total order on a scope Rj (which can be the whole relation R) may be encoded by defining a comparator fu, using the template in Algorithm 1, where fu operates on pairs of distinct tuples belonging to Rj.

Template 2 [Partial Order Preferences]. For an attribute x, let Px be a partial order defined on 20 the domain of x. The partial order can be expressed as a set Px = {(vt > vf)j for values v, and v,- in the domain of x, such that Px is: • irreflexive (i.e., (i\ > ty) ¢. Px). • asymmetric (i.e., (r, > vf) £ Px {Vj > v,) ¢. PT). • transitive (i.e., {(r, > vfifVj > vk)} C Px => (Vi > ek) e P:r). 2017221807 30 Aug 2017

Partial order-based preferences may be encoded using the template given by Algorithm 2.

Template 3 [Skyline Preferences], Given a set of attributes A, a tuple t,· is preferred to tuple tj if there exists a non-empty subset X i= ^ where v.r G X : tj,.?' js preferred to tjx, while for 5 any other attribute -,J € Λ — Xr no preference can be made between tj,.JJ and t,.,r'. Skyline preferences may be encoded as shown in the template given by Algorithm 3.

Template 4 [Conjoint Analysis Preferences], Given a set of attributes A, conjoint analysis encodes preferences among attribute values in A when taken conjointly. This can be expressed as 10 a function CA that maps each combination of values in A to a unique rank. The function CA is partial on the domains of all possible combinations of values in A. Hence, there can be combinations of values in A that are not mapped to ranks under CA. Conjoint analysis preferences based on CA may be expressed using the template given by Algorithm 4. 15 The next example is an example for specifying and managing conjoint analysis preferences.

Example 3:

Alice’s preferences regarding cars may be expressed conjointly over the attribute pairs (Make, Color), and (Make, Price), as shown in Figure 6. The value in each 20 cell is the rank assigned to each combination of attribute values.

Conjoint analysis may be based on an additive utility model in which ranks, assigned to combinations of attribute values, may be used to derive a utility (part worth) of each attribute value. The objective is that the utility summation of attribute values reconstructs the given 25 ranking. In FIG. 6, for example, ‘Honda’ is assigned utility value 40, while ‘Red’ is assigned utility value 50. Hence, the score of ‘Honda, Red’ is 90, which matches the assigned rank 1 in the given Make-Color preferences. Utility values may be computed using regression. For instance, they may be computed using linear regression. Note the mapping between combinations of attribute values and ranks is modeled. 2017221807 30 Aug 2017

Algorithm 2 Partial Order Preferences PARTIAL ORDKR-Prefs (fgtuple , tp. tuple. Pr: partial order on attribute x ) 1 if ((ί,.χ > tyx) e P?) 2 then return 1 3 else if((fj..r > £ Px) 4 then return -1 5 else return 1

Algorithm 3 Skyline Preferences

SkyuNE-PreFS (i,: tuple, fj Tuple, A: subset of attributes) 1 pi — 0 2 Pj - 0 3 for all x e A 4 do 5 if (tj.x is preferred to tj.x) 6 then pi *- pi + 1 7 else if (tj.x is preferred to tt.x) 8 then pj t— pj + 1 9 if (pi > 0 AND Pj > 0) 10 then return 1 11 if (Pi >0) 12 then return 1 13 else if (p} > 0) 14 then return -1 III. Specifying Second-Order Preferences

Our main language construct for defining second-order preferences is a preferences order (POrder), defined as follows: 5

Definition 3 [POrder]: given a set of scope comparators F, a POrder is a permutation of comparators in F. A POrder represents an ordering of scope comparators based on their relative importance. 10 A POrder may quantify the strength of different first-order preferences based on the semantics of second-order preferences, as discussed in greater detail below in Section IV. 2017221807 30 Aug 2017

Definition 4 [POrder Projection]: Let A be a POrder defined on the set of comparators F. For 1' - F we denote with . Π F' A) a total order of comparators in &amp;' ordered according to A. It follows that Π/τΑ = A. 5

Algorithm 4 Conjoint Analysis Preferences CONJOINT Analysis-Frits (?,: tuple, i^tuple, A: subset of attributes, CA: conjoint analysis map) 1 if (C',i{ {fi..r : x € A}) is undefined OR CA{{tj.x : x € .4}) is undefined) 2 then return 1 3 else if(C4({c.x : x € .4}) < CAi{tr:r : x e A}) 4 then return 1 5 else return ! consistent with PO if the relative order of any two scope comparators in U) does not contradict with PO. The set is called the set of linear extensions of PO. For example, FIG. 7 shows a partial order defined on four comparators and the corresponding set of linear extensions. The set of linear extensions may be obtained using a simple recursive algorithm on the PO graph. Partially ordered preferences may be formulated as the set of POrders given by . • Pairwise Preferences: A set = lUi ^ f.i)}of pairwise second-order preferences on scope comparators. The pairwise second-order preference fP expresses the requirement that the first-order preferences corresponding to f are more important than the first-order preferences corresponding to fj. Pairwise second-order preferences PW may be formulated as the set of POrders {{fi-.fi/ ' Ui fi) G PW } • Pareto Preference Composition: The importance of all scope comparators is equal. The first-order preference ^ 0) is produced if and only if at least one scope comparator states that h), and no other scope comparator states that (7 i >- P). Pareto preference composition is formulated as a set of singleton POrders, where each POrder is composed of a single comparator. • Preferences Aggregation: The scope comparators act as voters on preference relations.

The first-order preference is produced if and only if at least one scope comparator states that *7 ' f j). Preferences aggregation may be formulated as a set of singleton POrders, where each POrder may be composed of a single comparator. IV. Constructing a Preference Graph

Given a set of scopes and scope comparators, a graph-based representation of the preferences, termed a preference graph, may be obtained. In this Section, techniques for constructing the given set of scope and scope comparators (first-order preferences) are described. A preference graph may be defined as follows: 2017221807 30 Aug 2017

Definition 5 [Preference Graph]: A directed graph (V,E), where V is the set of tuples in R and an edge eltj € E connects tuple ti to tuple tj if there exists at least one comparator applicable to (C · tj )and returning 1, or applicable to (Ki · ^ kind returning -1. The label of edge ejj, denoted l(eij) is the set of comparators inducing preference of tj over tj. 5 One technique for constructing a preference graph is described in Algorithm 5. That algorithm constructs the set of vertices also termed nodes of the preference graph using the union of tuples involved in all input scopes. In other words, each node in the preference graph is associated with a tuple. Accordingly, each node in the preference graph may represent an item. For each pair of distinct tuples, the set of applicable scope comparators may be found and used to 10 compute graph edges and their labels. Accordingly, an edge in the preference graph may correspond to a first-order preference, which may indicate a user preference for one of the two items represented by the nodes terminating the edge.

Edges of the preference graph may be directed edges and may be directed to the node associated with a preferred data item as indicated by the first-order preference associated with 15 the edge. Though, in some embodiments, edges may be undirected and an indication of which of nodes terminating the edge is preferred may be provided differently. For instance, such an indication may be provided by using a signed weight, with a negative weight indicating a preference for one node and a positive weight indicating a preference for the other node. FIG. 8 illustrates example for the output of the compilation algorithm. In particular, FIG. 20 8 shows the preference graph obtained from the set of scope comparators {/1,2./3,4- /5,6- /0.2-./1.5} described with reference to FIG. 4. Each edge is labeled with a set of supporting comparators. For example, for the edge e2,6, we have — {/1.2-/6,2^ since the tuple tj is preferred over the tuple tr, according to the scope comparators fu and fj. 25 Since scopes may intersect and arbitrary scope comparator logic may be allowed, the induced preference graph may be a cyclic graph. For example, in FIG. a t-i — +6 cycle exists since ti is preferred over tr, according to ffj, while if, is preferred over ti according to fj. Construction of a preference graph according to Algorithm 5 does not guarantee transitivity of 30 graph edges. For example, in FIG. 8, the existence of the edges β2.β and ef) / does not imply the existence of the edge ej, /. 2017221807 30 Aug 2017

Algorithm 5 Preferences Compilation COMPILE-PREFS (S: a set of scopes, F: a set of comparators) 1 V *— ij^ : t £ Sj} {find the union of all scopes) 2 E *— {) {initialize set of graph edges as empty) 3 for all (t,Jj) € {V x V'); t, φ t} 4 do 5 for all / e F 6 do 7 if (/ is applicable to (^./,)} 8 then 9 p 10 if (p = 1) 11 then 12 € hj 1 13 append / tO 14 if (<·;.> i E) 15 then add c, , to E 16 else if (p = -1) 17 then 18 fj.i 1 19 append / to l(ejj) 20 if (ej,i i E) 21 then add eu to E 22 return G{V. E) {return Preferences Graph}

The computational complexity of constructing and processing a preference graph is quadratic in the number of tuples. There is a tradeoff between a preference graph’s expressiveness and the scalability of its implementation. Though in some embodiments, 5 preferences may be highly “selective” and, consequently, the preference graph may be sparse.

Scalability issues due to the size of the preference graph may be addressed in any of numerous ways. One approach is to use distributed processing in a cloud environment, where storing and managing the preference graph is distributed over multiple nodes in the cloud. For example, a ranking algorithm described below in Section V.A may be easily adapted to function 10 in a cloud environment. Other approaches include sacrificing the precision of preference query results by conducting approximate processing, or thresholding managed preferences to prune weak preferences early, to reduce the size of the preference graph. A preference graph allows heterogeneous user preferences to be encoded using a unified graphical representation. Though, in some embodiments, computing a ranking of query results using such a representation may require additional quantification of preference strength. Preference strength may be quantified based on the semantics of first-order and second-order preferences, while preserving the preference information encoded by the preference graph. Preference strength may be represented by weights on edges of the preference graph.

Given a preference graph G(V,E), the set of graph edges E may represent pairwise first-order preferences. Specifically, an edge etJ may express the preference for tuple /, over tuple tj according to one or more scope comparator(s). In some instances, a weight Wy may be associated with an edge ey. The weight wy may be a weight indicative of a degree of preference for the first node over the second node. Stronger preferences may be indicated by higher weights. In some instances, the weight may be a weight between 0 and 1, inclusive and the sum of the weights wy and Wji may equal 1. Disconnected vertices in the preference graph indicate that their corresponding tuples are indifferent with respect to each other.

In some embodiments, computing the weight may comprise dividing the number of first-order preferences for item A relative to item B by the number of all first-order preferences indicating any preference (either for or not for) item A.

For instance, let F be the set of al! scope comparators associated with the preference graph. Let A be the set of POrders of F according to the chosen semantics of second-order preferences. Let Aj — J That is, Fy is the set of scope comparators that state a preference relationship between tuples /, and tj . Let Ay be the multiset of nonempty projections of POrders in A based on Fy . Let Ay — Ay be the set of POrder projections under which f ' and similarly let J > J — J '--1 be the set of POrder projections under which tj ' tj jt f0p0ws that Ay — At.·» uAy, and that A,.;11 Ay [s empty. The weight wy may be computed as follows: utj = IAjI/IAjI (i)

That is, Wjj corresponds the proportion of POrder projections, under which 1 * f J, among the set of POrder projections computed based on comparators relevant to the edge (t„ tj).

The weight wy may be similarly defined using the set A./. It follows that11 ' J = ‘. For 2017221807 30 Aug 2017 the case of Pareto composition, at most one of the two edges etj and ehl can exist in the preference graph, since otherwise /, and tj would be incomparable. Hence, under Pareto composition, we remove any graph edge e,-,- whenever an edge e,,, exists.

We next give an example illustrating how to compute preference weights under different 5 semantics of second-order preferences.

Example 4 FIG. 9 shows three weighted preference graphs, corresponding to the preference graph in FIG. 8, produced under different semantics of second-order preferences. The 10 different semantics of second-order preferences result in different edge weights and/or the removal of some edges in the original preference graph: • Under prioritized comparators, e/, 6 is removed since, based on the shown comparator priorities, it may be determined that (t6 >- h). • Under partially-ordered comparators, we have that since for the relevant 15 (t2t3) set of comparators is {f5>6, f]>5} and the given partial order induces four POrder projections (Ά5* Λ·6'1· (/μ· /s.e). (/s,6· /1,5)· (/5,6. /1,5) h where (t2 >-t3) under the two POrder projections \/s.6· ./ 1.5/- (/5.6. /1,5) 1 while (t3 > t2) under the other two POrder projections Άδ- A6'1 · Ά.5· ,/δ,β) • Under pairwise preferences, = 0:33 since 7s ^ U'>) based on (/6.2), which is 20 one out of three POrder projections ( 7 5,6/ · (/6.2) (/5,6/}. V. Ranking

The graph-based preference model described in Section IV may be used to obtain a ranking (a total order) of items in a set of items. This may be done in any of numerous ways. One 25 approach described in Section V.A obtains a ranking based on authority-based ranking algorithms. Another approach described in Section V.B is a probabilistic algorithm based on inducing a set of complete directed graphs called tournaments from the graph-based preference model and computing a ranking for at least one tournament from the set. 2017221807 30 Aug 2017 A. Importance Flow Ranking A total order of items (or, equivalently, tuples representing these items) may be obtained by estimating an importance measure for each tuple using the preference weights encoded by the weighted preference graph. Techniques related to the PageRank importance flow model may be 5 used to compute such importance measures. Under the PageRank model, scores may be assigned to Web pages based on the frequency with which they are visited by a random surfer. Pages are then ranked according to these scores. Intuitively, pages pointed to by many important pages are also important.

The PageRank importance flow model lends itself naturally to problems that require 10 computing a ranking based on binary relationships among items. In the context of preferences, the model may be applied based on the notion that an item may be important if it is preferred over many other important items.

Let G = (V, E) be a dominance graph (i.e., a directed graph in which an edge e,j means r‘ 1J), and let L(v) and U(y) be the set of nodes dominated by and dominating v, 15 respectively. Let ° “ be a real number called a damping factor. The PageRank algorithm, as known in the art, computes the PageRank score of node v,·, denoted Ti, according to:

1 - o TT Σ

1/(¾) I

The PageRank score of a node v is determined by summing PageRank scores of all nodes V1 dominated by v, normalized by the number of nodes dominating V1. It is well known that when Y.v.zV li =50I Equation 2 corresponds to a stationary distribution of a 25

Markov chain, and that a unique stationary distribution exists if the chain is irreducible (i.e., the dominance graph is strongly connected), and aperiodic. Nodes that have no incoming edges (i.e., nodes that are not dominated by any other nodes) lead to sinks in the Markov chain, which makes the chain irreducible. This problem may be handled by adding self-loops at sink nodes, or (uniform) transitions from sink states to all other states in the Markov chain. The damping factor a captures the requirement that each node is reachable from every other node. The value of a is the probability that we stop following the graph edges, and start the Markov chain from a new 2017221807 30 Aug 2017 random node. This may help to avoid being trapped in cycles between nodes that have no edges to the rest of the graph.

Accordingly, in some embodiments a pagerank-based algorithm may be used to calculate a total order of items from the weighted preference graph. Herein, a pagerank-based algorithm 5 refers to any algorithm based on calculating a value from a graph based on characteristics of a Markov chain defined with respect to the graph. Note that a difference between the above described weighted preference graph and the graphs that the PageRank algorithm to which is conventionally applied is that the weighted preference graph has preference weights associated to edges. The preference weights bias the probability of transition (flow) from one state to another, 10 according to weight value, in contrast to the conventional case in which transitions are uniformly defined. A pagerank-based algorithm may proceed as follows. Given a starting tuple t0 (node) in the weighted preference graph, assume a random surfer that jumps to a next tuple ti, among the set of tuples dominating to, biased by the edge weights. Intuitively, this corresponds to a process 15 where a tuple is constantly replaced by a more desired tuple (with respect to given preferences). Note that visiting tuples takes place in the opposite direction of edges (jumps are from a dominated tuple to a dominating tuple). Hence, it follows that tuples that are visited more frequently, according to this process, are more likely to be desirable than tuples that are visited less frequently. Ranking tuples based on their visit frequency (pagerank-based scores) defines an 20 ordering that corresponds to their global desirability.

The weighted preference graph may be represented using a square matrix M, where each tuple may corresponds to one row and one column in M. Let Ej be the set of incoming edges to tuple tj in the weighted preference graph. The entry M [i, j] may be computed as follows: 25 = ^——- (3) t Ej wk.j 30 Hence, the sum of all entries in each column in M is 1.0 unless the tuple corresponding to that column has no incoming edges. Matrices in which all the entries are nonnegative and the sum of the entries in every column is 1.0 are called column stochastic matrices. A stochastic matrix defines a Markov chain whose stationary distribution is the set of importance measures we need for ranking. In order to maintain the irreducibility of the chain, we need to eliminate 2017221807 30 Aug 2017 sinks (nodes with no incoming edges in the preference graph). We handle the problem of sinks by adding a self-loop, with weight 1.0, at each sink node.

Let Γ be the pagerank scores vector. Then, based on the previous matrix representation, the pagerank scores are given by solving the equation Γ = Μ - Γ, which is the same as finding 5 the eigenvector of M corresponding to eigenvalue 1. The solution that has been used in practice for computing pagerank scores is using the iterative power method, where 1 is computed by first choosing an initial vector! *’, and then producing a next vector 1 1 = M · Γ0. The process is repeated to generate a vector l7, at iteration T, using the vector \ generated at iteration T — 1. For convergence, at each iteration T, entries in 1 rare normalized so that they sum to 10 1.0. In practice, the number of iterations needed for the power method to converge may be any suitable of iterations. For instance, tens or hundreds of iterations may be used. FIG. 10 illustrates the pagerank matrix for the weighted preference graph with prioritized comparators illustrated in FIG. 9. Note that t4 is a sink node with no incoming edges (i.e., t4 has no other dominating tuples). Hence, we add a self-loop with weight 1.0 to t4, represented by the 15 matrix entry M[4, 4], A typical value of the damping factor a may be a value such as 0.15, but may be any value between 0 and 0.5. B. Probabilistic Ranking A total order of items (or top-ranked items) may be obtained from a complete directed 20 graph derived from the preference model. Computing a total order of items from a complete directed graph (also known as a tournament) is termed finding a tournament solution. This problem may be stated as follows. Given an irreflexive, asymmetric, and complete binary relation over a set, find the set of maximal elements of this set. Example methods for finding tournament solutions are computing Kendall scores, and finding a Condorcet winner. 25 It should be appreciated, however, that the preference graph described in Section IV is not necessarily a tournament. In particular, the preference graph may be symmetric and incomplete: • Symmetry: both edges eu and eJA may exist in the preference graph, • Incompleteness: both edges etJ and ej t may be missing from the preference graph. 2017221807 30 Aug 2017

The symmetry problem implies that some pairwise preferences may go either way with possibly different weights, while incompleteness implies that some pairwise preferences may be unknown.

In some embodiments, a probabilistic approach to obtaining a ranking from the 5 preference graph may be used. Such an approach may rely on deriving one or more tournaments from the preference graph. Each tournament may be associated with a probability. As such, a weighted preference graph may be viewed as a compact representation of a space of possible tournaments, wherein each tournament is obtained by repairing the preference graph to obtain an asymmetric and complete digraph. In order to construct a tournament, two repair operations may 10 be applied to the preference graph: • Remove an edge. Applying this operation eliminates a 2-length cycle by removing one of the involved edges. • Add an edge. Applying this operation augments the graph by adding a missing edge.

As discussed earlier, the value of the weight wy represents the probability of selecting a 15 POrder, among the set of all POrders relevant to (/„ tj), under which ^ > 1 We thus interpret w^· as the probability with which tuple t, is preferred to tuple tj. We further assume the independence of w,y values of different tuple pairs. For each tuple pair (/„ tj), if both wy> 0 and Wjj > 0 (i.e., /, and t, are involved in a 2-length cycle), the operation remove edge removes the edge βμ with probability wy and removes the edge ey otherwise. Alternatively, if wy = 0 and wJyi 20 = 0 (i.e., tj and tj are disconnected vertices), the operation add edge adds one of the edges e,} or ejti with the same probability 0.5.

Based on the probabilistic process described above, repairing the weighted Preference graph generates a tournament (irreflexive, asymmetric, and complete digraph) whose probability is given by the product of the probabilities of all remaining graph edges. Let c be the number of 25 2-length cycles in the Preference graph, and d be the number of disconnected tuple pairs. Then, the number of possible tournaments is 2c+d. FIG. 11 illustrates a weighted preference graph, and the corresponding set of possible tournaments {? i.....Tg}_ The illustrated preference graph has two 2-length cycles (G - t-2 and t-2 - G) and one pair of disconnected tuples (t2, tj), and hence the number of 30 possible tournaments is 8. The probability of each tournament is given by the product of the 2017221807 30 Aug 2017 15- f ~} with probability summation 0.3, probabilities associated with its edges. For example, the probability of 7/ is 0.09, which is the product of 0.3, 0.6, and 0.5 representing w2j, w2j, and w4j, respectively.

Given a tournament T and a total order of tuples O, we say that O violates T, with respect to the relative order of (/,, tj), if l} ^ fJ under O, while f‘ under T. The problem of 5 computing a total order of tuples with a minimum number of violations to tournament is known to be NP-hard. Multiple heuristics have been proposed to compute a total order from a tournament. We focus on using Kendall score for computing a total order. The Kendall score of tuple t is the number of tuples dominated by t according to the tournament.

The space of possible tournaments allows computing a total order of tuples under any of 10 numerous probabilistic ranking measures. Two specific measures are described below. • Most probable tournament ranking. Compute a total order of tuples based on the tournament with the highest probability. • Expected ranking. Compute a total order of tuples based on the expected ranking in the space of all the possible tournaments. 15 Finding the most probable tournament is done by maintaining the edge with the higher weight for each 2-length cycle in the preference graph, and adding an arbitrary edge for each pair of disconnected tuples. According to this method, there may be multiple tournaments with the highest probability among all possible tournaments. The computed total order under any of these tournaments is the required ranking. In the illustrative example of FIG. 11, tournaments T2 and 20 T(, are the most probable tournaments, each with probability 0.21. A total order of tuples in T2 using Kendall scores is ^1 · ti-H} while a total order of tuples in Te is^1 · *2>*3· be n be the number of tuples in the preference graph, the complexity of the algorithm is 0(n2), since we need to visit all edges of the preference graph.

Finding the expected ranking may be done by computing the expected Kendall score for 25 each tuple using the space of possible tournaments. We model the score of tuple /,· as a random variable s, whose distribution is given by the space of possible tournaments. In the illustrative example of FIG. 11,// dominates one tuple in {Γ3. while // dominates two tuples in {I2· h- le.Is} with probability summation 0.7. Hence, the random variable s, may take the value 1 with probability 0.3, and takes the value 2 with 30 probability 0.7. The expected value of s, is thus 1 *0.3+2*0.7=1.7. 2017221807 30 Aug 2017

Computing the exact expected score of each tuple requires materializing the space of possible tournaments, which is infeasible due to the exponential number of possible tournaments. We thus propose a sampling-based algorithm to approximate the expected value of s, of each tuple th and then rank tuples based on their estimated expected scores. Let L(ti) be the set of tuples dominated by t, in the weighted preference graph.

For a tuple t-„ a sample Z is generated by adding t} ς L(t, ) each tuple to Z with probability wtJ. All samples may be generated independently. Hence, a score sample from 57 10 distribution is given by A. The expected value of .v, is estimated as the mean of the generated score samples. It is well known that sample mean, computed from a sufficiently large set of independent samples, is an unbiased estimate of the true distribution mean. Let n be the number of tuples in the preference graph, and m be the number of drawn samples for each tuple, the complexity of the algorithm is 0((nm)2), since we access the dominated set of each tuple m times 15 to generate m score samples. VI. Obtaining User Preferences

An information retrieval system may obtain user preferences in various ways. In some embodiments, the information retrieval system may interact with one or more users to obtain 20 user preferences. The system may interact with the user(s) to obtain first-order preferences and/or second-order preferences and may interact with the user(s) in any suitable way to obtain these preferences. As such, the system may present any suitable information or interface to the user(s) to assist the user(s) in specifying preferences. Though, in some embodiments, the information retrieval system may obtain some, or even all, user preferences without interacting 25 with the user and, for example, may simply receive user preferences from another source and/or utilize user preferences previously obtained by the system or determined “passively,” or implicitly, as by observing user behavior. FIG. 12 shows a flowchart of an illustrative process 1200 for obtaining user preferences. Process 1200 begins in act 1202, where user context information is obtained. User context 30 information may comprise any information that may be used to identify what information the user may be seeking and/or may be interested in. As such, user context information may include, but is not limited to, any suitable information related to the user that may be collected from any available sources and/or any suitable information directly provided by the user. 2017221807 30 Aug 2017

In some embodiments, information related to a user may be any suitable information about the user. For example, information related to a user may comprise demographic information (e.g., gender, age group, education level, etc.) associated with the user. As another example, information related to a user may comprise details of the user’s Internet browsing 5 history. Such information may comprise a list of one or more websites that the user may have browsed, the time of any such browsing, and/or the place (i.e., geographic location) from where any such browsing occurred. The user’s browsing history may further comprise information that the user searched for and any associated browsing information including, but not limited to, the search results the user obtained in response to any such searches. 10 As another example, information related to a user may comprise any information that the user has provided via any user interface on the user’s computing device or on one or more websites that the user may have browsed. For instance, information related to a user may comprise any information associated with the user on any website such as a social networking website, job posting website, a blog, a discussion thread, etc. Such information may include, but 15 is not limited to, the user’s profile on the website, any information associated with multimedia (e.g., images, videos, etc.) corresponding to the user’s profile, and any other information entered by the user on the website.

In some embodiments, information related to a user may comprise geo-spatial information. For instance, the geo-spatial information may comprise the current location of the 20 user and/or a computing device of the user (e.g., user’s home, library in user’s hometown, user’s work place, a place to which the user has traveled, and/or the geographical location of the user’s device as determined by the user’s Internet IP address, etc.). Geo-spatial information may include an association between information about the location of the user’s computing device and any content that the user was searching or viewing when the user’s computing device was at 25 or near that location. In some embodiments, information related to a user may comprise temporal information. For example, the temporal information may comprise the time during which a user was querying or viewing specific content on a computing device. The time may be specified at any suitable scale such as on the scale of years, seasons, months, weeks, days, hours, minutes, seconds, etc. 30 Additionally or alternatively, user context information associated with one or more users may comprise information provided by the user. Such information may be any suitable 2017221807 30 Aug 2017 information indicative of what information the user may be interested in. For example, user context information may comprise one or more user search queries input by a user into a search engine (e.g., an Internet search engine, a search engine adapted for searching a particular domain such as a corporate intranet, etc.). A search query may comprise one or more keywords. For 5 instance, the search query may be a query containing the keyword “car” and may indicate that a user may be interested in looking at items related to cars. As another example, the user may input a query “television” into an Internet search engine, which may indicate that a user may be interested in looking at any webpages containing infonnation about television.

As another example, user context information may comprise one or more user-specified 10 indicators of the type of information the user may be interested in. A user may provide the indicator(s) in any of numerous ways. The user may type in or speak an indication of his preferences, select one or more options provided by a website or an application (e.g., select an item from a dropdown menu, check a box, etc.), highlight or otherwise select a portion of the content of interest to the user on a website or in an application, and/or in any other suitable 15 manner. For example, the user may select one or more options on a website to indicate that he wishes to receive news updates related to a certain topic or topics, advertisements relating to one or more types of product(s), information about updates on any of numerous types of websites, newsletters, e-mail digests, etc.

In act 1202, the user context information may be obtained in any of a variety of possible 20 ways. For example, in some embodiments, the user context information may be provided from a user’s client computer to one or more server computers that execute software code that performs process 1200. For example, a user may operate a client computer that executes an application program. The application program may send user context infonnation (e.g., a search query entered by the user into application program to a server computer, which may be a computer that 25 performs process 1200. Thus, the server may receive user context information from an application program executing on a client computer. Such an application program may be any of a variety of types of application programs that are capable of, directly or indirectly, sending information to and receiving information from a server. For example, in some embodiments, the application program may be an Internet or WWW browser, an instant messaging client, or any 30 other suitable application. Though, it should be recognized that receiving user context information from a user’s client computer is not a limiting aspect of the present invention as user 2017221807 30 Aug 2017 context information may be obtained in any other suitable way as part of act 1202 of process 1200. For example, user context information may be obtained, actively by requesting and/or passively by receiving, from any source with, or with access to, user context information associated with one or more users. 5 Next, in act 1204 of process 1200, one or more items in a plurality of items may be identified, based at least in part on the obtained user context information. Furthermore, one or more attributes of the items may be identified as part of act 1204. The items and their attributes may be identified in any suitable way. In some embodiments, items may be identified based on one or more keywords in the user context information. For example, items shown in FIG. 2A 10 may be identified when the user context information comprises the keyword “car.” In some embodiments, an attribute may be identified as being a characteristic of a keyword in the user context infonnation. Attributes may be of any suitable type and, for example, may be categorical attributes or numerical attributes. For instance, if the user context information comprised a search query for a “Car,” then attributes related to “Car” may be the attributes “Make,” “Color,” 15 “Price ” and any other attributes of car such as the attributes illustrated in FIG. 2A. Items and attributes may be identified automatically by a computer or may be, at least in part, manually specified.

In some embodiments, attributes identified based on received the user context information may be identified at least in part by using a knowledge representation such as a 20 semantic network. Such attributes may be identified if they are related to one or more entities (e.g., concepts) in the knowledge representation. This may be done in any suitable way. For example, if a keyword in the user context infonnation is found to be related to a concept in a semantic network, attributes of that concept may be identified as attributes that are related to the user context information. For instance, if the user context information contained the keyword 25 “Car,” then attributes of the concept “Car,” which is part of the illustrative semantic network of FIG. 2B, may be identified as attributes that are related to the user context information.

Regardless of the way in which attributes of items are identified, in act 1204, a subset of these attributes may be selected, in acts 1206-1208, so that first- and/or second-order preferences may subsequently be specified for the selected attributes. In some embodiments, the attributes 30 may be selected at least in part by interacting with a user. For example, in the illustrated embodiment, in act 1206, a user may be presented with one or more of the attributes identified in 2017221807 30 Aug 2017 act 1204 of process 1200. This may be done in any suitable way. For example, the user may be shown these attributes visually using a display screen that contains these attributes. The display screen may be any suitable screen containing a representation of the attributes, such as a text representation of the attributes. The user may be prompted to select one or more of the presented 5 attributes. For instance, a user may be presented with a list of previously mentioned attributes associated with the keyword “car” and may select the attributes “Price” and “Color.” In act 1208, attributes selected by the user may be received. The user may select one or more attributes in any suitable way by providing any of numerous types of input including, but not limited to, using a mouse click (e.g., to check a checkbox, to click a button, selecting an area of the screen, etc.), 10 dragging an item on the screen, pressing a button on a keyboard, etc. The user’s selection is received in act 1208. Though, it should be appreciated that, aspects of the present invention are not limited to selecting attributes by interacting with a user and, in some embodiments, attributes may be selected automatically.

Next, process 1200 proceeds to act 1210, where at least one first-order preference may be 15 obtained. The at least one first-order preference may be obtained based at least in part on input provided by the user. The input may be obtained in any suitable way and, for example, may be obtained by interacting with the user to obtain the input. In some embodiments, the user may be presented with a graphical user interface that enables the user to provide input to specify first-order preferences for each of one or more attributes (e.g., the attributes selected in acts 120820 1210). The graphical user interface may operate to help the user specify first-order preferences for one or more attributes and, for example, may prompt the user to provide input to specify the first-order preferences. The graphical user interface may allow the user to specify first-order preferences of any suitable type. For instance, the user may specify score-based preferences, partial order preferences, skyline preferences, and/or conjoint analysis preferences as discussed 25 with reference to Section II.

The user may be assisted in specifying any of the above-mentioned first-order preferences in any of numerous ways. In some embodiments, a graphical user interface may be used. The graphical user interface may allow the user to graphically represent the first-order preferences (e.g., by drawing preferences). In some embodiments, the user may be provided with 30 a series of prompts designed to obtain information required to specify first-order preferences. 2017221807 30 Aug 2017

Next, process 1200 proceeds to act 1212, where at least one second-order preference may be obtained. The at least one second-order preference may be obtained based at least in part on input provided by the user. The input may be obtained in any suitable way and, for example may be obtained by interacting with the user to obtain the input. In some embodiments, the user may 5 be presented with a graphical user interface that enables the user to provide input to specify second-order preferences among one or more attributes (e.g., the attributes selected in acts 12081210). The graphical user interface may operate to help the user specify second-order preferences for one or more attributes and, for example, may prompt the user to provide input to specify the second-preferences. The graphical user interface may allow the user to specifying 10 second-order preferences of any suitable type. For instance, the user may specify prioritized preference composition preferences, partial order preferences, pairwise preferences, and/or Pareto preference composition preferences as discussed with reference to Section 111. After first-order and second-order preferences have been specified, process 1200 completes.

It should be appreciated that the information retrieval system may be configured to 15 ascertain user preferences (e.g., first-order user preferences and/or second-order user preferences) in any suitable way and based on any suitable input provided by the user. For example, as described above, the system may ascertain user preferences in response to a user selection of one or more attributes. The system may be configured to ascertain user preferences based on any of numerous types of user input including, but not limited to, clicks, sliding bars, 20 variable font size, darkness, and proximity of placement of user input to the center of the screen. As another example, the system may be configured to ascertain user preferences based on the user’s selection and/or browsing of any content related to an attribute or attributes. VII. Illustrative Process for Calculating A Ranking For One or More Items 25 It should be appreciated that the above techniques may be implemented as part of a process for calculating a ranking for one or more items in a set of items. Each item may be any of the previously-described types of items including, but not limited to, any item that may be manufactured, sold, and/or purchased, an item comprising information (e.g., content), and one or more entities in a knowledge representation. One such process is illustrated in FIG. 13, which is 30 a flowchart of an illustrative process 1300 for calculating a ranking for one or more items. 2017221807 30 Aug 2017

Process 1300 begins in act 1302, where first-order-preferences are obtained. The first-order preferences may be obtained in any suitable way. For example, the first-order preferences may be provided by a user or on behalf of a user. In some embodiments, an infonnation retrieval system may interact with the user to help the user specify first-order preferences. This may be 5 done in any of numerous ways and, for example, may be done as previously described in Section VI.

Process 1300 next proceeds to act 1304, where second-order preferences are obtained. The second-order preferences may be obtained in any suitable way. For example, the second-order preferences may be provided by a user or on behalf of a user. In some embodiments, an 10 information retrieval system may interact with the user to help the user specify second-order preferences. This may be done in any of numerous ways and, for example, may be done as previously described in Section VI.

It should be appreciated that, although in the illustrated embodiment second-order preferences are shown as being obtained after first-order preferences are obtained this is not a 15 limitation of some aspects of the present invention. In some embodiments second-order preferences may be obtained before or concurrently with first-order preferences. For instance, in the previously described example of specifying preferences for cars, a user may first specify a second-order preference indicating that price of car is more important to the user than the color of a car. Then, the user may specify that the user prefers items with a lower price (a first-order 20 preference) and/or that the user prefers red cars to yellow cars (another first-order preference).

It should also be appreciated that, in some embodiments, both first-order preferences and second-order preferences need not be specified as aspects of the present invention are not limited in this respect. For example, in some instances, only one or more first-order preferences may be specified. In other instances, only one or more second-order preferences may be specified. 25 Regardless of the order in which they arc obtained, after the first- and second-order preferences are obtained, process 1300 proceeds to act 1306, where a preference model is constructed based at least in part on the obtained preferences. It should be appreciated that the preference model may be constructed from only first-order preferences, only second-order preferences or any suitable combination thereof as aspects of the present invention are not 30 limited in this respect. The preference model may be constructed in any of numerous ways and, for example, may be constructed by using any of the techniques described in Section IV above. 2017221807 30 Aug 2017

The preference model may be a graph-based preference model and the data structure encoding the preference model may encode a preference graph characterizing the graph-based preference model. Accordingly, in act 1306 of process 1300, a preference graph may be constructed based at least in part first- and/or second-order preferences. As previously 5 mentioned, the preference graph may comprise a set of nodes and a set of edges connecting nodes in the set of nodes. Nodes of the preference graph may be associated with items of any suitable type. For instance, nodes of the graph may be associated with tuples, concepts in one or more knowledge representations, concepts related with one or more keywords in a query, etc. Edges of the preference graph may be associated with one or more first-order preferences for one 10 item over another item.

Next, process 1300 proceeds to act 1308, where one or more weights for the preference graph may be computed. As previously described, a weight may be associated to each of one or more edges in the preference graph in order to provide an indication of a degree of preference for one of the nodes terminating the edge. The weight may be computed based on first-order and/or 15 second-order preferences. The weight may be computed in any of the ways described in Section IV above or in any other suitable way.

Next, process 1300 proceeds to act 1310, where a ranking of one or more items in the set of items may be computed, at least in part, by using the preference graph and any associated weights calculated in acts 1306 and 1308 of process 1300. The graph-based preference model 20 may be used to rank the item(s) in any of numerous ways including, but not limited to, any of the ways previously described in Section V such as by computing a ranking by identifying tournaments in a completed directed graph obtained from the preference graph, applying a Markov-chained based algorithm to the preference graph, etc.

Regardless of how the ranking of one or more items is calculated in act 1310, after the 25 ranking of the item(s) is calculated, process 1300 proceeds to act 1312, where the ranking is used to obtain output to present to one or more users and/or to utilize in any suitable subsequent processing. In some embodiments, at least a subset of items may be identified based on the ranking calculated in act 1310 and output associated with the identified items may be presented to one or more users. The subset of items may be identified based at least in part on the ranking 30 in any of numerous ways. For example, the subset of items may be a subset of top ranking items (e.g., items ranking in the top 1 percent of items, 2 percent of items, 3 percent of items, etc.). 2017221807 30 Aug 2017

Output associated with the identified items may be presented to one or more users in any suitable way. For example, the presented output may be presented in accordance with the ranking such that the output is ordered based on the ranking. In some embodiments, output associated with an item ranked higher than another item may be shown more prominently that output 5 associated with the other item. For example, output associated with the higher-ranking item may be presented on top of output associated with the other item, may be presented in a different (e.g., larger, boldfaced, italicized, etc.) font than output associated with the other item, may be emphasized more than output associated with the other item, etc.

Output associated with an item may comprise any suitable information about or related to 10 the item. In some embodiments, output associated with an item may comprise one or more values of attributes of the item. For example, in the illustrative example of FIG. 2A, output associated with each car may comprise one or more attribute values (e.g., “price,” “color,” etc.) of that car. In some embodiments, output associated with an item may comprise information identifying the item. For example, in the illustrative example of FIG. 2A, output associated with 15 each car may comprise an identifier of that car. Though it should be appreciated that these are merely illustrative examples and that output associated with an item may comprise any other suitable information associated with the item. Process 1300 completes after act 1312 is performed. 20 VIII. Applying Preferences To Knowledge Representations

As previously mentioned, in some embodiments, semantic processing techniques may be used to perform any of numerous types of semantic processing in accordance with user preferences. In these embodiments, user preferences may be specified for one or more concepts in the semantic network and one or more semantic processing acts may be performed by using 25 the specified user preferences and/or the semantic network.

Accordingly, various types of user preferences may be specified for one or more concepts in a semantic network. In particular, preferences for a concept in a semantic network may be specified as first-order preferences and/or second-order preferences. As previously mentioned, first-order preferences for a concept may be expressed by specifying preferences for a concept 30 among children of an attribute of the concept. For example, in the semantic network shown in FIG. 2B, first-order preferences for the concept “car” may be expressed by specifying 2017221807 30 Aug 2017 preferences among children of an attribute (e.g., “Price”) of the concept car. When a concept has multiple attributes (e.g., the concept “Car” has multiple attributes including “Price” and “Color”), first-order preferences may include preferences among children of an attribute, for each of the multiple attributes of the concept (e.g., first-order preferences specified for children 5 of the attribute “Price” and first-order preferences specified for children of the attribute “Color”).

In addition, as previously mentioned, second-order preferences for a concept may be expressed by specifying preferences among attributes of the concept. For example, in the semantic network shown in FIG. 2B, second-order preferences for the concept “Car” may be expressed by specifying preferences among attributes (e.g., “Price,” “Color,” “Deposit,” etc.) of to the concept “Car.” Such second-order preferences may be considered to be preferences among first-order preferences, if such first-order preferences were specified for children of the attributes of the concept.

It should be appreciated that, in embodiments where the semantic network represents one or more items using one or more concepts, preferences for the item(s) may be specified by 15 specifying preferences for the concept(s).

It should also be appreciated that user preferences for a concept in a semantic network are not limited to being first- or second-order preferences as described above. Furthermore, preferences for a concept are not limited to being specified based exclusively on descendants of the concept. For example, in some instances, user preferences for a concept may be specified by 20 using any concepts in the semantic network and, for example, may be specified using concepts that are ancestors, siblings, or descendant s of the concept, as aspects of the present invention are not limited in this respect.

It should also be appreciated that a semantic network may comprise multiple concepts for which user preferences may be specified. Indeed, preferences may be specified for one or 25 multiple concepts in a semantic network. For example, first-order preferences may be specified for any concept having at least one attribute with two or more children. As another example, second-order preferences may be specified for any concept having at least two attributes. One example of a semantic network representing multiple concepts is shown in FIG. 14, which shows a semantic network representing concepts relating to the concept “science.” User preferences 30 may be specified for multiple concepts in this illustrated semantic network. First-order preferences, for instance, may be specified at least for the concepts “Science” and “Astronomy.” 2017221807 30 Aug 2017

Second-order preferences may be specified for the concepts “Science,” “Astronomy,” “Biology,” and “Stargazing.”

In some embodiments, any of the types of first- and second-order preferences previously described in Section II and III may be specified for one or more concepts in a semantic network. 5 First-order preferences including, but not limited to, score-based preferences, partial order preferences, skyline preferences, and conjoint analysis preferences may be specified for one or more concepts in a semantic network. Similarly, second-order preferences including, but not limited to, prioritized preference composition, partially ordered preferences, pairwise preferences, Pareto preference composition, and preference aggregation may be specified for one 10 or more concepts in a semantic network.

Regardless of the type of user preferences specified for one or more concepts in a semantic network, once these preferences are specified, they may be used to construct a preference model for one or more items represented by a semantic network. This model may be a graph-based preference model and may be constructed in accordance with the techniques 15 described in Section IV. To this end, a preference graph may be constructed based at least in part on the specified preferences and the concept for which the preferences are specified.

Additionally, the preference graph may be constructed based on any other information associated with semantic network. For example, the preference graph may be constructed based at least in part on one or more of the following: the topology of the graph associated with the semantic 20 network, ancestors of the concept for which preferences were specified, siblings of the concept for which preferences were specified, descendants of the concept for which the preferences were specified, one or more weights associated with edges in the graph representing the semantic network, etc. Furthermore, weights may be computed for edges in the preference graph as previously described in Section IV. 25 Once a preference model for items represented by a knowledge representation is constructed, the specified preferences and/or the constructed preference model may be used to perform any of numerous types of semantic processing. For example, in some embodiments, where a semantic network may represent one or more items in a set of items, performing semantic processing may comprise calculating the ranking of one or more items represented by 30 the semantic network. This may be done at least in part by constructing a preference model based at least in part on the specified user preferences as discussed in greater detail below. As another 2017221807 30 Aug 2017 example, in some embodiments, performing semantic processing may comprise synthesizing one or more new concepts based at least in part on the specified user preferences. As yet another example, in some embodiments, performing semantic processing may comprise calculating the ranking of one or more concepts in the semantic network based at least in part on the specified 5 user preferences. Such a ranking may be used to present concepts in the semantic network to any data consumer, which may be a software application or a human user who may view and/or utilize the semantic network through a software interface.

To better appreciate how user preferences may be used to perform various types of semantic processing, reference will now be made to systems 1600 and 1700 shown in FIGS. 16 10 and 17, respectively. Some aspects of systems 1600 and 1700 are explained in greater detail in U. S. Application Pub. No. US 2011/0320396, filed June 21, 2011, published December 29, 2011, and titled “Systems and Methods for Analyzing and Synthesizing Complex Knowledge Representations” by Anne Hunt et al., which is hereby incorporated by reference in its entirety.

In particular, systems 1600 and 1700 comprise a number of components (e.g., AKRM data set 15 110, elemental data structure 120, knowledge processing rules 130, input rules 140, analysis engine 150, input KRs 160, synthesis engine 170, context information 180, and data consumer 195) that are described in greater detail in the above-referenced application publication.

In an exemplary system such as system 1600 of FIG. 16, embodiments of synthesis engine 170 may synthesize output knowledge representations (KRs), such as semantic networks, 20 by applying knowledge processing rules 130 to elemental data structures 120. Embodiments of synthesis engine 170 may be provided with context information 180 associated with a data consumer 195. In some embodiments, context information 180 may be user context information, which was previously described in Section VII, and as such may include information provided by a user or users. Such information may be, for example, a textual query or request, one or more 25 search terms, identification of one or more active concepts, a request for a particular form of output KR 190, etc. In some embodiments, receipt of context information 180 may be interpreted as a request for an output KR (e.g., an output semantic network), without need for an explicit request for an output KR to accompany the context.

In some embodiments, in response to an input request and/or context information 180, 30 synthesis engine 170 may apply one or more appropriate knowledge processing rules 130 encoded in AKRM data set 110 to elemental data structure 120 to synthesize one or more 2017221807 30 Aug 2017 additional concepts and/or concept relationships not explicitly encoded in elemental data structure 130. The synthesized concept(s) and/or concept relationship(s) may be used to augment a knowledge representation, such as a semantic network. In some embodiments, synthesis engine 170 may apply appropriate knowledge processing rules 130 to appropriate portions of elemental 5 data structure 120 in accordance with the received input request and/or context information 180. For example, if context information 180 specifies a particular type of complex KR to be output, in some embodiments only those knowledge processing rules 130 that apply to synthesizing that type of complex KR may be applied to elemental data structure 120. In some embodiments, if no particular type of complex KR is specified, synthesis engine 170 may synthesize a default type of 10 complex KR, such as a semantic network. In some embodiments, if context information 180 specifies one or more particular active concepts of interest, for example, synthesis engine 170 may select only those portions of elemental data structure 120 related (i.e., connected through concept relationships) to those active concepts, and apply knowledge processing rules 130 to the selected portions to synthesize the output KR. In some embodiments, a predetermined limit on a 15 size and/or complexity of the output complex KR may be set, e.g., by a developer of the exemplary system 1600, for example conditioned on a number of concepts included, hierarchical distance between the active concepts and selected related concepts in the elemental data structure, encoded data size of the resulting output complex KR, processing requirements, relevance, etc. 20 In some embodiments, an output KR may be encoded in accordance with any specified type of KR indicated in the received input. In some embodiments, the output KR may be provided to data consumer 195. As discussed above, data consumer 195 may be a software application or a human user who may view and/or utilize the output KR through a software user interface, for example. 25 In some embodiments, a data consumer 195 may provide context information 180 for directing synthesis operations. For example, by inputting context information 180 along with a request for an output KR 190, a data consumer may direct exemplary system 1600 to generate an output KR 190 relevant to context information 180. For example, context information 180 may contain a search term that may be mapped to a concept of interest to data consumer 195. In some 30 embodiments, synthesis engine 170 may, for example, apply knowledge processing rules to those 2017221807 30 Aug 2017 portions of elemental data structure 120 that are more relevant to the concept associated with the context information 180. FIG. 17 illustrates an exemplary system 1700 that may be employed in some embodiments for implementing an atomic knowledge representation model (AKRM) involved in 5 analysis and synthesis of complex knowledge representations (KRs), in accordance with some embodiments of the present invention. In some embodiments, context information 180 may comprise preference information. The preference information may be any of the previously described preference information and, for example, may comprise preferences specified for one or more entities in a knowledge representation. For instance, preference information may 10 comprise preferences specified for one or more concepts in a semantic network. Preferences for a concept in a semantic network may be any of the previously described types of preferences such as first-order preferences or second-order preferences. In some embodiments, such preference information may be represented by a preference model (e.g., a graph-based preference model). In some embodiments, synthesis engine 170 may rely on the preference information and/or 15 preference model when synthesizing KRs and/or presenting KRs to a data consumer.

Some embodiments of exemplary system 1700 may include data consumer model 1706 (or “user model”), which may comprise data related to one or more data consumers that was acquired from one or more information sources. For example, a user model 1706 may comprise one or more output KRs 190 provided by synthesis engine 170. In some embodiments, user 20 model 1706 may comprise data derived from an interaction of a data consumer 195 with an output KR 190. Exemplary interactions of a data consumer 195 with an output KR 190 may include selection, highlighting, or specification by a data consumer 195 of one or more output KRs 190 from a plurality of output KRs presented by synthesis engine 170, or selection, highlighting, or specification by the data consumer 195 of a particular aspect or portion of an 25 output KR 190. Though, a user model 1706 may comprise data derived from any interaction of a data consumer 195 with an output KR 190. Embodiments of exemplary system 1700 are not limited in this respect.

In some embodiments, a user model 1706 may comprise context information 180 or data associated with context information 180. As discussed above, context information 180 may 30 include a textual query or request, one or more search terms, identification of one or more active concepts, etc. 2017221807 30 Aug 2017

In some embodiments, a data consumer model 1706 may correspond to a data consumer 195. In some embodiments, a data consumer model 1706 corresponding to a data consumer 195 may persist for the duration of the data consumer’s session with exemplary system 1700. Some embodiments of a data consumer model 1706 may persist across multiple sessions. A session 5 may begin when a data consumer logs in or connects to exemplary system 1700, and may end when a data consumer logs out or disconnects from exemplary system 1700. Though, the scope of a session may be determined using conventional techniques or any suitable techniques as aspects of the present invention are not limited in this respect.

Some embodiments of exemplary system 1700 may include a preference engine 1702. In 10 some embodiments, synthetical components 1752 may comprise preference engine 1702. In some embodiments, preference engine 1702 may receive context information 180 containing preference information. In some embodiments, the preference information may comprise a preference model. In some embodiments, preference engine 1702 may create a preference model based on the preference information. In some embodiments, preference engine 1702 may 15 provide preference information and/or a preference model to synthesis engine 170. In some embodiments, synthesis engine 170 may rely on the preference information and/or the preference model provided by preference engine 1702 to guide synthesis of a complex KR in accordance with preferences of a data consumer 195. In some embodiments, preference engine 1702 may rely on preference information and/or the preference model to guide presentation of concepts in a 20 complex KR and/or presentation of output KRs in accordance with preferences of a data consumer 195.

In some embodiments, preference engine 1702 may assign a weight or probability to an active concept or to any elemental concept in an elemental data structure, the weight representing a relevance of the concept to a data consumer 195. The preference engine 1702 may calculate the 25 weight assigned to a concept based on context information 180, and/or preference information, and/or the preference model.

Preference engine 1702 may be implemented in accordance with techniques described herein. For example, Some embodiments of preference engine 1702 may allow a data consumer 195 to specify of user preferences for one or more entities in a knowledge representation or one 30 or more items represented by a knowledge representation. In particular, preference engine 1702 may allow a data consumer to specify preferences for one or more concepts in a semantic 2017221807 30 Aug 2017 network and/or one or more items, in a plurality, represented by the semantic network. These preferences may be any of the previously described types of preferences such as first-order preferences and second-order preferences. Preference engine 1702 may be configured to construct a preference model based on the specified preferences. In some embodiments, 5 preference engine 1702 may be configured to construct a graph-based preference model, in accordance with the techniques described in Section IV. In some embodiments, preference engine 1702 may be configured to calculate a rank for one or more concepts in a semantic network and/or one or more items represented by the semantic network, in accordance with techniques described in Section V. 10 In some embodiments, preference engine 1702 may provide preference information and/or a preference model to synthesis engine 170 to facilitate synthesis of a complex KR in accordance with preferences of a data consumer 195. In some embodiments, a preference model may comprise weighted concepts. In some embodiments, a weighted concept in a preference model may correspond to a concept in an elemental data structure 120. 15 In some embodiments, a preference model may influence the synthesis process in various ways. For example, in some embodiments, synthesis engine 170 may synthesize more concepts in relation to a concept in the preference model that is more heavily weighted (a “more preferred” concept), while synthesizing fewer concepts in relation to a less heavily weighted concept of the preference model (a “less preferred” concept). Synthesis engine 170 may control 20 a degree of synthesis in relation to a concept in a variety of ways. In some embodiments the synthesis engine 170 may apply more knowledge processing rules in relation to more preferred concepts. In some embodiments, the synthesis engine 170 may use less stringent thresholds when applying a knowledge processing rule in relation to a more preferred concept. For example, synthesis engine 170 may use a lower relevance threshold, coherence threshold, semantic 25 similarity threshold, or synonym threshold when applying a relevance rule, coherence rule, associative relationship rule, or synonym rule.

Furthermore, in some embodiments, synthesis engine 170 may temporally prioritize synthesis in relation to a more preferred concept over synthesis in relation to a less preferred concept. For example, synthesis engine 170 may synthesize concepts in relation to a more 30 preferred concept before synthesizing concepts in relation to a less preferred concept. If synthesis engine 170 is configured to generate at most a certain maximum number of concepts, 2017221807 30 Aug 2017 temporally prioritizing synthesis in this manner ensures that synthesis in relation to less preferred concepts does not occur at the expense of synthesis in relation to more preferred concepts. In some embodiments, synthesis engine 170 may begin synthesizing in relation to a less preferred concept only if the certain maximum number of concepts is not generated by first completing 5 synthesis in relation to more preferred concepts.

Likewise, the synthesis engine 170 may devote more processing resources and/or processing time to synthesizing in relation to a more preferred concept, while devoting less processing resources and/or processing time to synthesizing in relation to a less preferred concept. 10 Additionally or alternatively, some embodiments of preference engine 1702 may rely on preference information and/or a preference model to guide presentation of an output KR’s concepts in accordance with preferences of data consumer 195. In some embodiments, preference information may include a general preference model that may be used to produce a ranking of items and/or concepts in accordance with preferences of data consumer 195. 15 Preference engine 1702 may use such ranking information to impose an ordering on the concepts in an output KR 190.

In other words, in some embodiments an output KR 190 may be presented to a data consumer 195 in a format that is not rank-ordered, such as a graph. In other embodiments, an output KR 190 may be presented to a data consumer 195 in a rank-ordered format, such as a list, 20 with the rankings being assigned based on preference information. IX. Additional Implementation Detail

The above-described embodiments of the present invention can be implemented in any of numerous ways. For example, the embodiments may be implemented using hardware, software 25 or a combination thereof. When implemented in software, the software code may be embodied as stored program instructions that may be executed on any suitable processor or collection of processors (e.g., a microprocessor or microprocessors), whether provided in a single computer or distributed among multiple computers.

It should be appreciated that a computer may be embodied in any of numerous forms, 30 such as a rack-mounted computer, a desktop computer, a laptop computer, or a tablet computer. Additionally, a computer may be embodied in a device not generally regarded as a computer, but 2017221807 30 Aug 2017 with suitable processing capabilities, including a Personal Digital Assistant (PDA), a smart phone, a tablet, a reader, or any other suitable portable or fixed electronic device.

Also, a computer may have one or more input and output devices. These devices may be used, among other things, to present a user interface. Examples of output devices that may be 5 used to provide a user interface include printers or display screens for visual presentation of output, and speakers or other sound generating devices for audible presentation of output. Examples of input devices that may be used for a user interface include keyboards, microphones, and pointing devices, such as mice, touch pads, and digitizing tablets.

Such computers may be interconnected by one or more networks in any suitable form, 10 including networks such as a local area network (LAN) or a wide area network (WAN), such as an enterprise network, an intelligent network (IN) or the Internet. Such networks may be based on any suitable technology and may operate according to any suitable protocol and may include wireless networks, wired networks, and/or fiber optic networks. A computer system that may be used in connection with any of the embodiments of the 15 invention described herein is shown in Fig. 15. The computer system may include one or more processors 1510 and one or more non-transitory computer-readable storage media (e.g., memory 1520 and one or more non-volatile storage media 1530). The processor 1510 may control writing data to and reading data from the memory 1520 and the non-volatile storage device 1530 in any suitable manner, as the aspects of the invention described herein are not limited in this respect. 20 To perform any of the functionality described herein, the processor 1510 may execute one or more instructions stored in one or more computer-readable storage media (e.g., the memory 1520), which may serve as non-transitory computer-readable storage media storing instructions for execution by the processor 1510.

The various methods or processes outlined herein may be coded as software that is 25 executable on one or more processors that employ any one of a variety of operating systems or platforms. Additionally, such software may be written using any of numerous suitable programming languages and/or programming or scripting tools, and also may be compiled as executable machine language code or intermediate code that is executed on a virtual machine or a suitable framework. 30 In this respect, various inventive concepts may be embodied as at least one non-transitory computer-readable storage medium (e.g., a computer memory, one or more floppy discs, 2017221807 30 Aug 2017 compact discs, optical discs, magnetic tapes, flash memories, circuit configurations in Field Programmable Gate Arrays or other semiconductor devices, etc.) article(s) encoded with one or more programs that, when executed on one or more computers or other processors, implement the various process embodiments of the present invention. The non-transitory computer-readable 5 medium or media may be transportable, such that the program or programs stored thereon may be loaded onto any suitable computer resource to implement various aspects of the present invention as discussed above.

The terms “program” or “software” are used herein in a generic sense to refer to any type of computer code or set of computer-executable instructions that can be employed to program a 10 computer or other processor to implement various aspects of embodiments as discussed above. Additionally, it should be appreciated that according to one aspect, one or more computer programs that when executed perform methods of the present invention need not reside on a single computer or processor, but may be distributed in a modular fashion among different computers or processors to implement various aspects of the present invention. 15 Computer-executable instructions may be in many forms, such as program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, items, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Typically the functionality of the program modules may be combined or distributed as desired in various embodiments. 20 Also, data structures may be stored in non-transitory computer-readable storage media articles in any suitable form. For simplicity of illustration, data structures may be shown to have fields that are related through location in the data structure. Such relationships may likewise be achieved by assigning storage for the fields with locations in a non-transitory computer-readable medium that convey relationship between the fields. However, any suitable mechanism may be 25 used to establish relationships among information in fields of a data structure, including through the use of pointers, tags or other mechanisms that establish relationships among data elements.

Also, various inventive concepts may be embodied as one or more methods, of which an example has been provided. The acts performed as part of the method may be ordered in any suitable way. Accordingly, embodiments may be constructed in which acts are performed in an 30 order different than illustrated, which may include performing some acts simultaneously, even though shown as sequential acts in illustrative embodiments, or vice versa. 2017221807 30 Aug 2017

All definitions, as defined and used herein, should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and/or ordinary meanings of the defined terms.

The indefinite articles “a” and “an,” as used herein, unless clearly indicated to the 5 contrary, should be understood to mean “at least one.”

As used herein, the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in 10 the list of elements. This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, “at least one of A and B” (or, equivalently, “at least one of A or B,” or, equivalently “at least one of A and/or B”) can refer, in one embodiment, to at least one, 15 optionally including more than one, A, with no B present (and optionally including elements other than B); in another embodiment, to at least one, optionally including more than one, B, with no A present (and optionally including elements other than A); in yet another embodiment, to at least one, optionally including more than one, A, and at least one, optionally including more than one, B (and optionally including other elements); etc. 20 The phrase “and/or,” as used herein, should be understood to mean “either or both” of the elements so conjoined, i.e., elements that are conjunctively present in some cases and disjunctively present in other cases. Multiple elements listed with “and/or” should be construed in the same fashion, i.e., “one or more” of the elements so conjoined. Other elements may optionally be present other than the elements specifically identified by the “and/or” clause, 25 whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, a reference to “A and/or B”, when used in conjunction with open-ended language such as “comprising” can refer, in one embodiment, to A only (optionally including elements other than B); in another embodiment, to B only (optionally including elements other than A); in yet another embodiment, to both A and B (optionally including other elements); etc. 30 As used herein, “or” should be understood to have the same meaning as “and/or” as defined above. For example, when separating items in a list, “or” or “and/or” shall be interpreted 2017221807 30 Aug 2017 as being inclusive, i.e., the inclusion of at least one, but also including more than one, of a number or list of elements, and, optionally, additional unlisted items.

The phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of "including," "comprising," "having," “containing”, 5 “involving”, and variations thereof, is meant to encompass the items listed thereafter and additional items.

Having described several embodiments of the invention in detail, various modifications, and improvements will readily occur to those skilled in the art. Such modifications and improvements are intended to be within the spirit and scope of the invention. Accordingly, the 10 foregoing description is by way of example only, and is not intended as limiting.

What is claimed is: 57

Claims (84)

1. A computer-implemented method for calculating a ranking of at least one item in a plurality of items, the method comprising: receiving user preferences comprising a plurality of first-order user preferences indicative of a user’s preferences for items in the plurality of items, and at least one second-order user preference indicative of the user’s preferences among first-order user preferences in the plurality of first-order user preferences; calculating, with at least one processor, a ranking of the at least one item in the plurality of items based, at least in part on, at least one data structure encoding a preference graph that represents the received user preferences; and identifying and outputting at least a subset of the plurality of items to a user, in accordance with the ranking.

2. The computer-implemented method of claim 1, wherein calculating the ranking comprises: applying a pagerank-based algorithm to the at least one data structure encoding the preference graph to calculate the ranking.

3. The method of claim 2, wherein the preference graph comprises a plurality of nodes, wherein each node corresponds to an item in the plurality of items, and calculating the ranking comprises: calculating a pagerank score of at least one node in the plurality of nodes.

4. The computer-implemented method of claim 1, wherein the preference graph comprises a plurality of nodes, wherein each node corresponds to an item in the plurality of items, and wherein calculating the ranking comprises: computing a total order of nodes in a complete directed graph derived from the preference graph.

5. The computer-implemented method of claim 4, wherein computing the total order of nodes comprises calculating: a Kendall score for at least one node in the complete directed graph.

6. The computer-implemented method of claim 1, wherein receiving user preferences comprises prompting the user to provide the at least one second-order user preference.

7. The computer-implemented method of claim 1, wherein the method further comprises constructing the preference graph based at least in part on the received user preferences, wherein the preference graph comprises a plurality of nodes, wherein each node in the plurality of nodes corresponds to an item in the plurality of items; and wherein the preference graph further comprises a plurality of edges, wherein each edge corresponds to a first-order user preference in the plurality of first-order user preferences, the first-order user preference indicating a user preference for one of the two items represented by nodes terminating the each edge.

8. The computer-implemented method of claim 7, wherein the preference graph comprises a first node corresponding to a first item in the plurality of items, a second node corresponding to a second item in the plurality of items, and a directed edge from the first node directed to the second node, wherein the direction of the directed edge indicates that the second item is preferred to the first item as indicated by the first-order user preference associated with the directed edge.

9. The computer-implemented method of claim 7, wherein the preference graph comprises a first node corresponding to a first item, a second node corresponding to a second item, an edge between the first and second nodes, and a weight associated to the edge between the first node and the second node, the weight being indicative of a degree of preference for the first item over the second item.

10. A system comprising: at least one memory configured to store a plurality of tuples, each tuple in the plurality of tuples corresponding to an item in a plurality of items, and at least one data structure encoding a preference graph to represent user preferences, wherein the user preferences comprise a plurality of first-order user preferences indicative of a user’s preferences among items in the plurality of items, and at least one second-order user preference indicative of the user’s preferences among first-order user preferences in the plurality of first-order user preferences; and at least one processor coupled to the at least one memory, the at least one processor configured to: calculate a ranking of at least one item in the plurality of items based, at least in part on, the at least one data structure encoding the preference graph that represents the user preferences; and identify and output at least a subset of the plurality of items to a user, in accordance with the ranking.

11. The system of claim 10, wherein the at least one processor is configured to calculate the ranking at least by: applying a pagerank-based algorithm to the at least one data structure encoding the preference graph to calculate the ranking.

12. The system of claim 10, wherein the preference graph comprises a plurality of nodes, wherein each node corresponds to an item in the plurality of items, and wherein the at least one processor is configured to calculate the ranking at least by: computing a total order of nodes in a complete directed graph derived from the preference graph.

13. The system of claim 10, wherein the at least one processor is further configured to: construct the preference graph based at least in part on the received user preferences, wherein the preference graph comprises a plurality of nodes, wherein each node in the plurality of nodes corresponds to an item in the plurality of items; and wherein the preference graph further comprises a plurality of edges, wherein each edge corresponds to a first-order user preference in the plurality of first-order user preferences, the first-order user preference indicating a user preference for one of the two items represented by nodes terminating the each edge.

14. The system of claim 13, wherein the preference graph comprises a first node corresponding to a first item, a second node corresponding to a second item, an edge between the first and second nodes, and a weight associated to the edge between the first node and the second node, the weight being indicative of a degree of preference for the first item over the second item.

15. At least one computer-readable storage medium article storing a plurality of processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method of calculating a ranking for at least one item in a plurality of items, the method comprising: receiving user preferences comprising a plurality of first-order user preferences indicative of a user’s preferences among items in the plurality of items, and at least one second-order user preference indicative of the user’s preferences among first-order user preferences in the plurality of first-order user preferences; calculating a ranking of the at least one item in the plurality of items based, at least in part on, at least one data structure encoding a preference graph that represents the received user preferences; and identifying and outputting at least a subset of the plurality of items to a user, in accordance with the ranking.

16. The at least one computer-readable storage medium article of claim 15, wherein the at least one computer readable storage medium article further stores the at least one data structure encoding the preference graph.

17. The at least one computer-readable storage medium article of claim 15, wherein calculating the ranking comprises: applying a pagerank-based algorithm to the at least one data structure encoding the preference graph to calculate the ranking.

18. The at least one computer-readable storage medium article of claim 15, wherein the preference graph comprises a plurality of nodes, wherein each node corresponds to an item in the plurality of items, and wherein calculating the ranking comprises: computing a total order of nodes in a complete directed graph derived from the preference graph.

19. The at least one computer-readable storage medium article of claim 15, wherein the method further comprises: constructing the preference graph based at least in part on the received user preferences, wherein the preference graph comprises a plurality of nodes, wherein each node in the plurality of nodes corresponds to an item in the plurality of items; and wherein the preference graph further comprises a plurality of edges, wherein each edge corresponds to a first-order user preference in the plurality of first-order user preferences, the first-order user preference indicating a user preference for one of the two items represented by nodes terminating the each edge.

20. The at least one computer-readable storage medium article of claim 19, wherein the preference graph comprises a first node corresponding to a first item, a second node corresponding to a second item, an edge between the first and second nodes, and a weight associated to the edge between the first node and the second node, the weight being indicative of a degree of preference for the first item over the second item.

21. A computer-implemented method for constructing at least one data structure encoding a preference graph that represents user preferences, the preference graph comprising a first node for a first item in a plurality of items, a second node for a second item in the plurality of items, and an edge between the first node and the second node, the method comprising: receiving a plurality of first-order user preferences indicative of user preferences among values of attributes of items in the plurality of items; receiving at least one second-order user preference indicative of user preferences among the attributes of items in the plurality of items; and computing, using at least one processor, a weight for the edge between the first node and the second node based at least in part on the plurality of first-order user preferences and the at least one second-order user preference, wherein the weight is indicative of a degree of preference for the first item over the second item.

22. The computer-implemented method of claim 21, wherein the preference graph comprises a third node for a third item in the plurality of items, a fourth node for a fourth item in the plurality of items, the method further comprising: constructing the at least one data structure encoding the preference graph to include an edge between the third node and the fourth node when the plurality of first-order user preferences comprises a first-order user preference for the third item over the fourth item.

23. The computer-implemented method of claim 21, further comprising: constructing the at least one data structure encoding the preference graph to include a node for each item in the plurality of items and an edge for every pair of nodes associated with items related by a first-order user preference in the plurality of first-order user preferences.

24. The computer-implemented method of claim 21, wherein computing the weight comprises: computing a first number of first-order user preferences in the plurality of first-order user preferences indicating a user’s preference for the first item relative to the second item; computing a second number of all first-order user preferences in the plurality of first-order user preferences indicating any preference associated with the first item; and setting the weight based at least in part on the first number and the second number.

25. The computer-implemented method of claim 21, wherein items in the plurality of items are represented as tuples, each tuple comprising values of the attributes of the corresponding item, and wherein receiving the plurality of first-order preferences comprises: receiving a first-order preference for the first item over the second item by receiving an indication of a user preference for a first value of a first attribute of a first tuple representing the first item over a second value of the second attribute of a second tuple representing the second item.

26. The computer-implemented method of claim 25, wherein the first attribute is a same attribute as the second attribute.

27. The computer-implemented method of claim 21, wherein the plurality of first-order user preferences comprises at least two types of first-order user preferences selected from the group consisting of score-based preferences, partial order preferences, skyline preferences, and conjoint analysis preferences.

28. The computer-implemented method of claim 21, wherein the at least one second-order user preference comprises a plurality of second-order user preference relations that comprises at least two types of second-order preferences selected from the group consisting of prioritized preference composition, partial order preferences, pairwise preferences, and Pareto preference composition.

29. A system for constructing at least one data structure encoding a preference graph that represents user preferences, the preference graph comprising a first node for a first item in a plurality of items, a second node for a second item in the plurality of items, and an edge between the first node and the second node, the system comprising: at least on processor configured to receive a plurality of first-order user preferences indicative of user preferences among values of attributes of items in the plurality of items, receive at least one second-order user preference indicative of user preferences among the attributes of items in the plurality of items, and compute a weight for the edge between the first node and the second node based at least in part on the plurality of first-order user preferences and the at least one second-order user preference, wherein the weight is indicative of a degree of preference for the first item over the second item.

30. The system of claim 29, wherein the preference graph comprises a third node for a third item in the plurality of items, a fourth node for a fourth item in the plurality of items, and wherein at least one processor is further configured to: construct the at least one data structure encoding the preference graph to include an edge between the third node and the fourth node when the plurality of first-order user preferences comprises a first-order user preference for the third item over the fourth item.

31. The system of claim 29, wherein the at least one processor is further configured to: constructing the at least one data structure encoding the preference graph to include a node for each item in the plurality of items and an edge for every pair of nodes associated with items related by a first-order user preference in the plurality of first-order user preferences.

32. The system of claim 29, wherein the at least one processor is configured to compute the weight at least by: computing a first number of first-order user preferences in the plurality of first-order user preferences indicating a user’s preference for the first item relative to the second item; computing a second number of all first-order user preferences in the plurality of first-order user preferences indicating any preference associated with the first item; and setting the weight based at least in part on the first number and the second number.

33. The system of claim 29, wherein items in the plurality of items are represented as tuples, each tuple comprising values of the attributes of the corresponding item, and wherein the at least one processor is configured to receive the plurality of first-order preferences at least by: receiving a first-order preference for the first item over the second item by receiving an indication of a user preference for a first value of a first attribute of a first tuple representing the first item over a second value of the second attribute of a second tuple representing the second item.

34. The system of claim 33, wherein the first attribute is a same attribute as the second attribute.

35. The system of claim 29, wherein the plurality of first-order user preferences comprises at least two types of first-order user preferences selected from the group consisting of score-based preferences, partial order preferences, skyline preferences, and conjoint analysis preferences.

36. The system of claim 29, wherein the at least one second-order user preference comprises a plurality of second-order user preference relations that comprises at least two types of second-order preferences selected from the group consisting of prioritized preference composition, partial order preferences, pairwise preferences, and Pareto preference composition.

37. At least one computer-readable storage medium article storing a plurality of processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method for constructing at least one data structure encoding a preference graph that represents user preferences, the preference graph comprising a first node for a first item in a plurality of items, a second node for a second item in the plurality of items, and an edge between the first node and the second node, the method comprising: receiving a plurality of first-order user preferences indicative of user preferences among values of attributes of items in the plurality of items; receiving at least one second-order user preference indicative of user preferences among the attributes of items in the plurality of items; and computing a weight for the edge between the first node and the second node based at least in part on the plurality of first-order user preferences and the at least one second-order user preference, wherein the weight is indicative of a degree of preference for the first item over the second item.

38. The at least one computer-readable storage medium article of claim 37, wherein the preference graph comprises a third node for a third item in the plurality of items, a fourth node for a fourth item in the plurality of items, the method further comprising: constructing the at least one data structure encoding the preference graph to include an edge between the third node and the fourth node when the plurality of first-order user preferences comprises a first-order user preference for the third item over the fourth item.

39. The at least one computer-readable storage medium article of claim 37, further comprising: constructing the at least one data structure encoding the preference graph to include a node for each item in the plurality of items and an edge for every pair of nodes associated with items related by a first-order user preference in the plurality of first-order user preferences.

40. The at least one computer-readable storage medium article of claim 37, wherein computing the weight comprises: computing a first number of first-order user preferences in the plurality of first-order user preferences indicating a user’s preference for the first item relative to the second item; computing a second number of all first-order user preferences in the plurality of first-order user preferences indicating any preference associated with the first item; and setting the weight based at least in part on the first number and the second number.

41. The at least one computer-readable storage medium article of claim 37, wherein items in the plurality of items are represented as tuples, each tuple comprising values of the attributes of the corresponding item, and wherein receiving the plurality of first-order preferences comprises: receiving a first-order preference for the first item over the second item by receiving an indication of a user preference for a first value of a first attribute of a first tuple representing the first item over a second value of the second attribute of a second tuple representing the second item.

42. The at least one computer-readable storage medium article of claim 41, wherein the first attribute is a same attribute as the second attribute.

43. The at least one computer-readable storage medium article of claim 37, wherein the plurality of first-order user preferences comprises at least two types of first-order user preferences selected from the group consisting of score-based preferences, partial order preferences, skyline preferences, and conjoint analysis preferences.

44. The at least one computer-readable storage medium article of claim 37, wherein the at least one second-order user preference comprises a plurality of second-order user preference relations that comprises at least two types of second-order preferences selected from the group consisting of prioritized preference composition, partial order preferences, pairwise preferences, and Pareto preference composition.

45. A computer-implemented method for obtaining user preferences, the method comprising: receiving user context information associated with at least one user; identifying, based at least in part on the received user context information, a plurality of attributes of items in a plurality of items; obtaining, using at least one processor, at least one first-order user preference based at least in part on a first input provided by the at least one user, wherein the plurality of first-order user preferences comprises a preference for a first attribute in the plurality of attributes; and obtaining, using the at least one processor, at least one second-order user preference based at least in part on a second input provided by the at least one user, wherein the at least one second-order user preference comprises a preference among attributes in the plurality of attributes.

46. The computer-implemented method of claim 45, wherein obtaining the at least one first-order user preference comprises interacting with the at least one user to obtain the first input.

47. The computer-implemented method of claim 45, wherein obtaining the at least one second-order user preference comprises interacting with the at least one user to obtain the second input.

48. The computer-implemented method of claim 46, wherein interacting with the at least one user to obtain the first input comprises presenting a graphical user interface to the at least one user that enables the at least one user to specify the first-order user preference for the first attribute by specifying a preference among values of the first attribute.

49. The computer-implemented method of claim 46, wherein the plurality of items is represented by at least a first concept in a semantic network, wherein the first attribute is an attribute of the first concept, and wherein interacting with the at least one user to obtain the first input comprises presenting a graphical user interface to the at least one user that enables the at least one user to specify the first-order user preference for the first attribute by specifying a preference among children of the first attribute.

50. The computer-implemented method of claim 48, wherein presenting the graphical user interface to the at least one user comprises: prompting the at least one user to specify a first-order user preference for the first attribute.

51. The computer-implemented method of claim 45, wherein receiving the user context information associated with the at least one user comprises receiving a search query from the at least one user.

52. A system for obtaining user preferences, the system comprising: at least one processor configured to: receive user context information associated with at least one user; identify, based at least in part on the received user context information, a plurality of attributes of items in a plurality of items; obtain, at least one first-order user preference based at least in part on a first input provided by the at least one user, wherein the plurality of first-order user preferences comprises a preference for a first attribute in the plurality of attributes; and obtain at least one second-order user preference based at least in part on a second input provided by the at least one user, wherein the at least one second-order user preference comprises a preference among attributes in the plurality of attributes.

53. The system of claim 52, wherein the at least one processor is configured to obtain the at least one first-order user preference at least by interacting with the at least one user to obtain the first input.

54. The system of claim 52, wherein the at least one processor is configured to obtain the at least one second-order user preference at least by interacting with the at least one user to obtain the second input.

55. The system of claim 53, wherein interacting with the at least one user to obtain the first input comprises presenting a graphical user interface to the at least one user that enables the at least one user to specify the first-order user preference for the first attribute by specifying a preference among values of the first attribute.

56. The system of claim 53, wherein the plurality of items is represented by at least a first concept in a semantic network, wherein the first attribute is an attribute of the first concept, and wherein interacting with the at least one user to obtain the first input comprises presenting a graphical user interface to the at least one user that enables the at least one user to specify the first-order user preference for the first attribute by specifying a preference among children of the first attribute.

57. The system of claim 55, wherein presenting the graphical user interface to the at least one user comprises: prompting the at least one user to specify a first-order user preference for the first attribute.

58. The system of claim 52, wherein the at least one processor is configured to receive the user context information associated with the at least one user at least by receiving a search query from the at least one user.

59. At least one computer-readable storage medium article storing a plurality of processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method for obtaining user preferences, the method comprising: receiving user context information associated with at least one user; identifying, based at least in part on the received user context information, a plurality of attributes of items in a plurality of items; obtaining, using at least one processor, at least one first-order user preference based at least in part on a first input provided by the at least one user, wherein the plurality of first-order user preferences comprises a preference for a first attribute in the plurality of attributes; and obtaining, using the at least one processor, at least one second-order user preference based at least in part on a second input provided by the at least one user, wherein the at least one second-order user preference comprises a preference among attributes in the plurality of attributes.

60. The at least one computer-readable storage medium article of claim 59, wherein obtaining the at least one first-order user preference comprises interacting with the at least one user to obtain the first input.

61. The at least one computer-readable storage medium article of claim 59, wherein obtaining the at least one second-order user preference comprises interacting with the at least one user to obtain the second input.

62. The at least one computer-readable storage medium article of claim 60, wherein interacting with the at least one user to obtain the first input comprises presenting a graphical user interface to the at least one user that enables the at least one user to specify the first-order user preference for the first attribute by specifying a preference among the values of the first attribute.

63. The at least one computer-readable storage medium article of claim 60, wherein the plurality of items is represented by at least a first concept in a semantic network, wherein the first attribute is an attribute of the first concept, and wherein interacting with the at least one user to obtain the first input comprises presenting a graphical user interface to the at least one user that enables the at least one user to specify the first-order user preference for the first attribute by specifying a preference among the children of the first attribute.

64. The at least one computer-readable storage medium article of claim 63, wherein presenting the graphical user interface to the at least one user comprises: prompting the at least one user to specify a first-order user preference for the first attribute.

65. A computer-implemented method for specifying user preferences in a semantic network encoded in at least one data structure, the method comprising: receiving, using at least one processor, a plurality of first-order user preferences for at least one concept in a semantic network, wherein the plurality of first-order user preferences are indicative of a user’s preferences among children of attributes of the at least one concept in the semantic network; receiving, using the at least one processor, at least one second-order user preference for the at least one concept in the semantic network, wherein the at least one second-order user preference is indicative of the user’s preferences among attributes of the at least one concept; and performing at least one semantic processing act by using the semantic network, the plurality of first-order user preferences, and the at least one second-order user preference.

66. The computer-implemented method of claim 65, wherein the semantic network represents a plurality of items at least in part by using the at least one concept, and wherein performing the at least one semantic processing act comprises: calculating, using the at least one processor, a ranking of at least one item in the plurality of items based, at least in part on, at least one data structure encoding a preference graph that represents the plurality of first-order user preferences and the at least one second-order user preference; and identifying and outputting at least a subset of the plurality of items to a user, in accordance with the ranking.

67. The computer-implemented method of claim 65, wherein the semantic network represents a plurality of items at least in part by using the at least one concept, and wherein performing the at least one semantic processing act comprises: constructing a preference model for the plurality of items based at least in part on the received plurality of first-order preferences and the at least one second-order preference.

68. The computer-implemented method of claim 65, wherein performing the at least one semantic processing act comprises: synthesizing at least one new concept in accordance with the received plurality of first-order preferences and the at least one second-order preference.

69. The computer-implemented method of claim 68, wherein the at least one concept comprises a first concept and a second concept, and wherein synthesizing the at least one new concept comprises: calculating a first weight for the first concept and a second weight for the second concept based on the received plurality of first-order preferences and the at least one second-order preference; and synthesizing a first number of concepts in relation to the first concept and a second number of concepts in relation to the second concept, wherein the first number is greater than the second number when the first weight is greater than the second weight.

70. The computer-implemented method of claim 65, wherein the at least one semantic processing act comprises: calculating a ranking of concepts in the semantic network based at least in part on the received plurality of first-order preferences and the at least one second-order preference.

71. The computer-implemented method of claim 65, further comprising presenting concepts in the semantic network to a user in accordance with the ranking of the concepts.

72. A system for specifying user preferences in a semantic network encoded in at least one data structure, the system comprising: at least one processor configured to receive a plurality of first-order user preferences for at least one concept in a semantic network, wherein the plurality of first-order user preferences are indicative of a user’s preferences among children of attributes of the at least one concept in the semantic network; receive at least one second-order user preference for the at least one concept in the semantic network, wherein the at least one second-order user preference is indicative of the user’s preferences among attributes of the at least one concept; and perform at least one semantic processing act by using the semantic network, the plurality of first-order user preferences, and the at least one second-order user preference.

73. The system of claim 72, wherein the semantic network represents a plurality of items at least in part by using the at least one concept, and wherein the at least one processor is configured to performing the at least one semantic processing act at least by: calculating a ranking of at least one item in the plurality of items based, at least in part on, at least one data structure encoding a preference graph that represents the plurality of first-order user preferences and the at least one second-order user preference; and identifying and outputting at least a subset of the plurality of items to a user, in accordance with the ranking.

74. The system of claim 72, wherein the semantic network represents a plurality of items at least in part by using the at least one concept, and wherein the at least one processor is configured to perform the at least one semantic processing act at least by: constructing a preference model for the plurality of items based at least in part on the received plurality of first-order preferences and the at least one second-order preference.

75. The system of claim 72, wherein the at least one processor is configured to perform the at least one semantic processing act at least by: synthesizing at least one new concept in accordance with the received plurality of first-order preferences and the at least one second-order preference.

76. The system of claim 75, wherein the at least one concept comprises a first concept and a second concept, and wherein synthesizing the at least one new concept comprises: calculating a first weight for the first concept and a second weight for the second concept based on the received plurality of first-order preferences and the at least one second-order preference; and synthesizing a first number of concepts in relation to the first concept and a second number of concepts in relation to the second concept, wherein the first number is greater than the second number when the first weight is greater than the second weight.

77. The system of claim 72, wherein the at least one processor is configured to perform the at least one semantic processing act at least by: calculating a ranking of concepts in the semantic network based at least in part on the received plurality of first-order preferences and the at least one second-order preference.

78. The system of claim 77, wherein the at least one processor is further configured to present concepts in the semantic network to a user in accordance with the ranking of the concepts.

79. At least one computer-readable storage medium article storing a plurality of processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method for specifying user preferences in a semantic network encoded in at least one data structure, the method comprising: receiving a plurality of first-order user preferences for at least one concept in a semantic network, wherein the plurality of first-order user preferences are indicative of a user’s preferences among children of attributes of the at least one concept in the semantic network; receiving at least one second-order user preference for the at least one concept in the semantic network, wherein the at least one second-order user preference is indicative of the user’s preferences among attributes of the at least one concept; and performing at least one semantic processing act by using the semantic network, the plurality of first-order user preferences, and the at least one second-order user preference.

80. The at least one computer-readable storage medium article of claim 79, wherein the semantic network represents a plurality of items at least in part by using the at least one concept, and wherein performing the at least one semantic processing act comprises: calculating, using the at least one processor, a ranking of at least one item in the plurality of items based, at least in part on, at least one data structure encoding a preference graph that represents the plurality of first-order user preferences and the at least one second-order user preference; and identifying and outputting at least a subset of the plurality of items to a user, in accordance with the ranking.

81. The at least one computer-readable storage medium article of claim 79, wherein the semantic network represents a plurality of items at least in part by using the at least one concept, and wherein performing the at least one semantic processing act comprises: constructing a preference model for the plurality of items based at least in part on the received plurality of first-order preferences and the at least one second-order preference.

82. The at least one computer-readable storage medium article of claim 79, wherein performing the at least one semantic processing act comprises: synthesizing at least one new concept in accordance with the received plurality of first-order preferences and the at least one second-order preference.

83. The at least one computer-readable storage medium article of claim 82, wherein the at least one concept comprises a first concept and a second concept, and wherein synthesizing the at least one new concept comprises: calculating a first weight for the first concept and a second weight for the second concept based on the received plurality of first-order preferences and the at least one second-order preference; and synthesizing a first number of concepts in relation to the first concept and a second number of concepts in relation to the second concept, wherein the first number is greater than the second number when the first weight is greater than the second weight.

84. The at least one computer-readable storage medium article of claim 79, wherein the at least one semantic processing act comprises: calculating a ranking of concepts in the semantic network based at least in part on the received plurality of first-order preferences and the at least one second-order preference.