US7996396B2 - Identifying the items most relevant to a current query based on user activity with respect to the results of similar queries - Google Patents

Identifying the items most relevant to a current query based on user activity with respect to the results of similar queries Download PDF

Info

Publication number
US7996396B2
US7996396B2 US11392993 US39299306A US7996396B2 US 7996396 B2 US7996396 B2 US 7996396B2 US 11392993 US11392993 US 11392993 US 39299306 A US39299306 A US 39299306A US 7996396 B2 US7996396 B2 US 7996396B2
Authority
US
Grant status
Grant
Patent type
Prior art keywords
web page
plurality
distinguished
rating
query
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US11392993
Other versions
US20070239713A1 (en )
Inventor
Jonathan Leblang
Ruben Ortega
Colin Saunders
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
A9 com Inc
Original Assignee
A9 com Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor ; File system structures therefor
    • G06F17/30861Retrieval from the Internet, e.g. browsers
    • G06F17/30864Retrieval from the Internet, e.g. browsers by querying, e.g. search engines or meta-search engines, crawling techniques, push systems

Abstract

A facility for ranking in a result set is described. The facility establishes a system of ratings for combinations of a web page with the query term that reflect the level of relevance of the web page to the query term. In response to each of a number of content interactions performed by users, each with respect to a result corresponding to a web page included in a result set that was generated in response to a query comprising a set of one or more query terms, the facility adjusts a rating score for each combination of the web page and a query term among the set of query terms. For each of a number of web pages included as results in a distinguished result set produced in response to a distinguished query comprising a set of distinguished query terms, the facility (1) selects established and adjusted reading scores for each combination of the web page and a query term among the distinguished set of query terms, and (2) determines a ranking score for the result in the distinguished result set by combining the selected reading scores.

Description

TECHNICAL FIELD

The described technology is directed to the field of query processing.

BACKGROUND

Web search engines permit users to search for particular web sites within the range of known web sites. In many cases, users perform searches in order to ultimately find a single page.

In order to perform a search, a user submits a query containing one or more query terms. For example, a user may submit a query to the web search engine containing terms that the user believes are words contained by a web page sought by the user. A query server program processes the query to identify pages matching the terms of the query. The pages identified by the query server program are individually known as results, and collectively known as a result set. The result set is typically displayed to the user as a list of results each describing one of the identified pages. This list may be ordered in various ways. For example, the list may be ordered based on the extent to which the identified page corresponding to each result matches the terms of the query.

For many queries, it is common for result sets to contain tens or hundreds of results. Where the user is performing the search in order to find a single page, the application of conventional approaches to ordering the result set often fail to place the sought page or pages near the top of the result set, so that the user must read through many other results in the result set before reaching the sought page. In view of this disadvantage of conventional approaches to ordering result sets, a new, more effective technique for automatically ordering result sets in accordance with collective and/or individual user behavior would have significant utility.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing some of the components typically incorporated in at least some of the computer systems and other devices on which the facility executes.

FIG. 2 is a flow diagram showing steps typically performed by the facility in order to generate a new rating table.

FIGS. 3 and 4 are table diagrams showing augmentation of a sample rating table.

FIG. 5 is a table diagram showing the generation of rating tables for composite periods of time from rating tables for constituent periods of time.

FIG. 6 is a table diagram showing a rating table for a composite period.

FIG. 7 is a flow diagram showing steps typically performed by the facility to order a result set using a rating table by generating a ranking value for each result in the result set.

DETAILED DESCRIPTION

A software facility for identifying items most relevant to a current query based on user activity with respect to the result sets produced for similar queries (“the facility”) is described. In some embodiments, the facility generates ranking values for results each corresponding to a web page indicating the web page's level of relevance to a current query specifying one or more query terms. The facility generates a ranking value for a result by combining a group of rating scores, each corresponding to the level of relevance of the corresponding web page to a different one of the query terms specified by the current query. The facility adjusts rating scores for combinations each of a web page with a query term. The facility maintains a rating score for a particular combination of a web page with a query term based upon user activity with respect to that web page within result sets produced for queries containing the query term. In some environments, the facility employs a browser toolbar or other client-side program to monitor and report relevant user activity.

In some embodiments, the facility maintains rating scores in a manner that increases the rating scores for combinations of a result page with each of the query terms contained in the query that produced the result set containing the result in response to observing one or more of the following user actions regarded as demonstrating relevance of the result to these query terms: the user prints the page corresponding to the result or a downstream page (i.e., a page to which the user navigated from the result page); the user highlights content, such as text, in the page corresponding to the result or a downstream page; the user copies content, such as text, from the page corresponding to the result or a downstream page; the user pastes content, such as text, copied from the page corresponding to the result or a downstream page; the user bookmarks the page corresponding to the result or the downstream page; the user searches within the page corresponding to the result or the downstream page; the user posts form content from the page corresponding to the result or a downstream page, particularly where the post is a secure post; the user annotates the page corresponding to the result or the downstream page; the user clicks-through from the page corresponding to the result to another page in the same Internet domain; the user forwards to another user a link to the page corresponding to the result; the user responds affirmatively to an explicit inquiry about the usefulness of the page corresponding to the result page; the user views the web page for at least a threshold amount of time; and where there is a time-indexed media resource—such as an audio resource or a video resource—on or associated with the web page corresponding to the result, the user plays at least a threshold percentage of the time-indexed media resource.

In some embodiments, the facility maintains rating scores in a manner that decreases the rating scores for combinations of a page with each of the query terms contained in the query that produced the result set containing a page corresponding to the result in response to observing one or more of the following user actions regarded as demonstrating irrelevance of the page corresponding to the result to these query terms: after opening the page corresponding to the result, the user submits a new query; the user clicks-through from the page corresponding to the result to a page in a different Internet domain; and the user responds negatively to an explicit inquiry about the usefulness of the web page corresponding to the result.

In some embodiments, in addition to adjusting the rating scores for combinations of the page corresponding to the result with each of the query terms contained in the query that produced the result set containing the result, the facility also adjusts the rating scores for combinations of the page with other terms not contained in the query, such as one or more of the following: text associated with the link in the result set to the page corresponding to the result, such as anchor tag text or title attribute text specified for the link to the page corresponding to the result; and text associated with the page corresponding to the result, such as page title text or text contained elsewhere in the page. In some embodiments, the facility filters such terms based upon factors such as: whether the term is on a list of noise words; whether the term tends to differentiate and whether the term has a positive association with at least one of the query terms.

In some embodiments, the facility maintains and applies scores for de-duplicated versions of web pages to more accurately handle web pages that are referred to by multiple URLs.

By generating result set ranking values in some or all of the ways described above, the facility increases the likelihood that results of interest to the user are prominently featured in the result set.

FIG. 1 is a block diagram showing some of the components typically incorporated in at least some of the computer systems and other devices on which the facility executes. These computer systems and devices 100 may include one or more central processing units (“CPUs”) 110 for executing computer programs; input/output devices 120; and a computer memory 130 for storing programs and data—including data structures—while they are being used. The input/output devices typically include a persistent storage device 121, such as a hard drive, for persistently strong programs and data; a computer-readable media drive 122, such as a CD-ROM drive, for reading programs and data stored on a computer-readable medium; and a network connection 123 for connecting the computer system to other computer systems, such as the Internet, to exchange programs and/or data—including data structures. The memory 130 typically contains a query server 131 for general inquiry results from queries, a result set ranking facility 132 for automatically ranking the results in a result set in accordance with prior user activities, and rating tables 133 containing rating scores used by the facility. While computers systems configured as describe above are typically used to support the operation of the facility, one of ordinary skill in the art will appreciate that the facility may be implemented using devices of various types and configurations, and having various components.

The facility typically generates a new rating table periodically, and, when a result set is received, uses the last-generated rating table to rank the results in the result set. The rating table may be generated for the queries occurring during a period of time such as a day, a week, or month. This group of queries is termed a “rating set” of queries. FIG. 2 is a flow diagram showing steps typically performed by the facility in order to generate a new rating table for a rating period. In step 201, the facility initializes a rating table for holding entries each indicating the rating score for a particular combination of a query term and a page URL. The rating table usually has no entries when it is initialized. In step 202, the facility observes a user action during the rating period with respect to a selected page occurring in a query result. Such observation may be performed using techniques described in one or more of the following, each of which is hereby incorporated by reference in its entirety: U.S. Pat. No. 6,549,941; U.S. Pat. No. 6,691,163; and U.S. patent application Ser. No. 09/447,392, filed on Nov. 22, 1999. In step 203, the facility selects ratings scores for combinations of the selected page with terms included in the query that produce the query result, and/or with terms associated with the selected page, such as the pages title or other text in the page, or text associated with the link in the query result to the page, such as anchor tag text or title attribute text of the link. In some embodiments, to determine the anchor tag text associated with a link to a page in a query result traversed by the user, the facility uses a browser toolbar to query a link text attribute of an object passed in an event notification generated in response to the user's traversal of the link. In some embodiments, the facility uses a de-duplicated version of the URL for the selected page in selecting the rating scores.

In step 204, the facility branches on the type of the action observed in step 202 to adjust the rating scores selected in step 203. For the following action types, the facility typically increases each of the selected rating scores in steps 205-212: print the selected page or a downstream page; select content in the selected page or a downstream page; paste content from the selected page or a downstream page; bookmark the selected page or a downstream page; search within the selected page or a downstream page; post form content from a selected page or a downstream page; annotate the selected page or a downstream page; click through the selected page or a downstream page to a page in the same domain; forward to another user a link to the selected page (not shown); respond affirmatively to an explicit inquiry about the usefulness of the selected page (not shown); view the selected page for at least a threshold amount of time (not shown); or play at least a threshold percentage of a time-indexed media resource associated with the selected page (not shown). For the following action types, the facility typically decreases each of the selected rating scores in steps 213-214: submitting a new query after selecting the selected page; click through from the selected page or a downstream page to a page that is in a different Internet domain from the selected page or the downstream page; or respond negatively to an explicit query about the usefulness of the selected page (not shown). In some embodiments, the facility increases the selected rating scores when an action of a particular type is performed in certain circumstances, and decreases the selected rating scores when an action of that type is performed in other circumstances. For example, in some embodiments, when the user submits a subsequent query that is unrelated to the prior query, the facility reduces the rating selected for the prior query, while when the user submits a subsequent query that constitutes a refinement of the prior query, the facility increases rating scores selected for the prior query. Where an entry does not yet exist in the rating table for a selected term and page, the facility adds a new entry to the rating table for the selected term and page. Increasing or decreasing a rating score typically involves adding or subtracting an increment value, such as 1, to the existing rating score for the term and item. In some embodiments, the facility may add varying increment values depending upon the type or extent of the observed user action. In some embodiments (not shown), the facility augments the selected rating scores based upon a volume of communication events between the client and the server that follows the user's selection of the selected page from the result set. For example, where the selected page employs Ajax user interface techniques, the facility can augment the selected ratings score to a greater degree for greater levels of user interaction with such user interfaces. After any of steps 205-214, the facility continues in step 202 to observe the next user action.

Those skilled in the art will appreciate that the steps shown in FIG. 2 and in each of the flow diagrams discussed below may be altered in a variety of ways. For example, the order of the steps may be rearranged; substeps may be performed in parallel; shown steps may be omitted, or other steps may be included; etc.

FIGS. 3 and 4 are table diagrams showing augmentation of a sample rating table in accordance with FIG. 2. FIG. 3 shows the state of the sample rating table before its augmentation. It can be seen that the table 300 contains a number of entries, including entries 301-306. Each entry contains the rating score for a particular combination of a query term and a page URL identifying a page. For example, entry 302 identifies the score “22” for the term “dynamics” the page URL “www.cogpsych.org/article0132.html”. It can be seen by examining entries 301-303 that, in query results produced from queries including the term “dynamics”, the page having URL “www.cogpsych.org/article0132.html” has been the subject of more positive user page interaction than the page having the URL “www.herald.com/localnews/0134.asp”, and much more positive user interaction than the page having the URL “www.science.edu/physics”. In some embodiments, the facility uses various types of data structures to store the rating scores, such as sparse arrays.

While FIG. 3 and each of the table diagrams discussed below show a table whose contents and organization are designed to make them more comprehensible by a human reader, those skilled in the art will appreciate that actual data structures used by the facility to store this information may differ from the table shown, in that they, for example, may be organized in a different manner; may contain more or less information than shown; may be compressed and/or encrypted; etc.

In augmenting the rating table 300, the facility observes a positive user action with respect to the page having the URL “www.cogpsych.org/article0132.htm” from a result set produced by a query specifying the query terms “human” and “dynamics”. FIG. 4 shows the state of the sample rating table after the rating table is augmented by the facility to reflect this user action. It can be seen by comparing entry 405 in rating table 400 to entry 305 in rating table 300 that the facility has incremented the score for this entry from “45” to “46”. Similarly, the facility has incremented the rating score for the same URL the term “dynamics” from “22” to “23”. Although the increment values reflected in the differences between FIGS. 3 and 4 are both 1, as noted above, different increment values may be used for different actions, either positive or negative. The facility augments the rating table in a similar manner for the other actions in query results that it identifies during the time period.

Rather than generating a new rating table from scratch using the steps shown in FIG. 2 each time new selection information becomes available, in some embodiments, the facility generates and maintains separate rating tables for different constituent time periods of a relatively short length, such as one day. Each time a rating table is generated for a new constituent time period, the facility typically combines this new rating table with existing rating tables for earlier constituent time periods to form a rating table for a longer composite period of time. FIG. 5 is a table diagram showing the generation of rating tables for composite periods of time from rating tables for constituent periods of time. It can be seen in FIG. 5 that rating tables 501-506 each correspond to a single day between 8 Feb. 1998 and 13 Feb. 1998. Each time a new constituent period is completed, the facility generates a new rating table reflecting the user selections made during that constituent period. For example, at the end of 12 Feb. 1998, the facility generates rating table 505, which reflects all of the user selections occurring during 12 Feb. 1998. After the facility generates a new rating table for a completed constituent period, the facility also generates a new rating table for a composite period ending with that constituent period. For example, after generating the rating table 505 for the constituent period 12 Feb. 1998, the facility generates rating table 515 for the composite period 8 Feb. 1998 to 12 Feb. 1998. The facility typically generates such a rating table for a composite period by combining the entries of the rating tables for the constituent periods making up the composite period, and combining the scores of corresponding entries, for example, by summing them. In one preferred embodiment, the scores and rating tables for more recent constituent periods are weighted more heavily than those in rating tables for less recent constituent periods. When ranking result sets, the rating table for the most recent composite period is typically used. That is, until rating table 516 can be generated, the facility typically uses rating table 515 to rank result sets. After rating table 516 is generated, the facility typically uses rating table 516 to rank result sets. In some embodiments, the lengths of both constituent periods and composite periods are configurable.

In some embodiments, rather than segregating rating information into separate rating tables for constituent periods of time as shown in FIG. 5, the facility aggregates all such data into a single table and decays the data over time, such as by subtracting a fixed value from all of the rating scores periodically, such as every day, or by periodically dividing each rating score by a fixed value.

FIG. 6 is a table diagram showing a rating table for a composite period. By comparing the item rating table 600 shown in FIG. 6 to item rating table 400 shown in FIG. 4, it can be seen that the contents of rating table 600 constitute the combination of the contents of rating table 400 with several other rating tables for constituent periods. For example, the score for entry 602 is “116”, or about five times the score for corresponding entry 402. Further, although rating table 400 does not contain an entry for the term “dynamics” and the URL “www.reading.org”, entry 607 has been added to table 600 for this combination of term and page, as a corresponding entry occurs in a rating table for one of the other constituent periods within the composite period.

The facility uses rating tables that it has generated to generate ranking values for items in new result sets. FIG. 7 is a flow diagram showing steps typically performed by the facility to order a result set using a rating table by generating a ranking value for each result in the result set. In steps 701-707, the facility loops through each result identified in the result set. In step 702, the facility initializes a ranking value for the current result. In steps 703-705, the facility loops through each term occurring in the query. In step 704, the facility determines the rating score contained by the most recently-generated rating table for the current term and the page corresponding to the current result. In step 705, if any terms of the query remain to be processed, then the facility loops up to step 703, else the facility continues in step 706. In step 706, the facility combines the scores for the current result to generate a ranking value for the result. As an example, with reference to FIG. 6, in processing the page having the URL “www.cogpsych.org/article0132.html”, the facility combines the score “116” extracted from entry 602 for this page and the term “dynamics”, and the score “211” extracted from entry 605 for this page and the term “human”. In some embodiments, the combination of step 706 involves summing these scores. These scores may be combined in other ways, however. In particular, scores may be adjusted to more directly reflect the number of query terms that are matched by the page, so that items that match more query terms than others are favored in the ranking. In step 707, if any results remain to be processed, the facility loops back to step 701 to process the next result, else the facility continues in step 708. In step 708, the facility displays the results identified in the result set in accordance with the ranking values generated for the pages in step 706. In some embodiments, step 708 involves sorting the results in the result set in decreasing order of their ranking values, and/or subsetting the results in the result set to include only those items above a threshold ranking value, or only a predetermined number of results having the highest ranking values. After step 708, these steps conclude.

In some embodiments, the facility uses stemming techniques to combine rating scores for query terms having the same root as query terms occurring in the query. In different embodiments of the facility, the stemming techniques are incorporated in different ways. As a first example, in the rating table shown in FIGS. 3 and 4, the term column containing terms occurring in queries may be replaced with a term root column containing the roots of the terms occurring in queries. For instance, when pages are the subject of a positive user action in a query containing the terms “human” and “dynamics,” the facility would increment scores for rating table rows containing the term roots “human” and “dynamic”—the roots obtained by stemming those terms.

In a second example, the facility expands the terms occurring in a query from whose query result an item is selected to all of the different terms that share the same root as the term occurring in the query. For example, for a query containing the term “dynamics,” the facility would increment the score for rows with the item rating table containing the terms “dynamic,” “dynamics,” “dynamism,” “dynamist,” “dynamistic,” and “dynamically.”

In a third example, the facility continues to update the rating table without any use of stemming as described above, but in reading the rating table, such as in step 704, the facility combines, for each term occurring in the query at issue, the scores for all of the terms bearing the same root with the terms occurring in the query. For example, if the facility received a query containing the term “dynamics,” the facility would combine with the score for this term the scores for the additional terms “dynamic,” “dynamism,” “dynamist,” “dynamistic,” and “dynamically,” which all share the root “dynam-.” Other approaches to utilizing stemming are part of additional embodiments of the facility.

In some embodiments, the facility uses the search engine that produces the query results in response to queries to perform its query result processing, in some cases using some or all of the techniques described in U.S. patent application Ser. No. 11/097,468, filed on Mar. 31, 2005.

In some embodiments, the facility is implemented as a web service that is invoked against a result set produced by a separate search engine.

It will be appreciated by those skilled in the art that the above-described facility may be straightforwardly adapted or extended in various ways. For example, the facility may use a variety of techniques for observing user actions with respect to results listed in result set, including various client-side, server-side, or proxy-based techniques. The facility may be used in connection with documents or other content items of a variety of types other than web pages—such as various types of content items accessed via URIs, file system names and/or paths, or other addressing and/or accessing schemes—navigated to and/or interacted with by users using devices of any of a variety of types, via communications channels of any of a variety of types. The facility may use various formulae to determine; in the case of each user action, the amount by which to augment rating scores with respect to the action. Further, the facility may employ various formulae to combine rating scores into a ranking value for a result. Additionally, the facility may augment the rating table to reflect actions by users other than human users, such as software agents or other types of the artificial users. While the foregoing description makes reference to particular embodiments, the scope of the invention is defined solely by the claims that follow and the elements recited therein.

Claims (30)

1. A computer-implemented method for ranking web pages in a result set, comprising:
under control of one or more computer systems configured with executable instructions,
establishing, in response to receiving a query containing one or more query terms, a plurality of rating scores, a first subset of the plurality of rating scores reflecting a first determined level of relevance of one of a plurality of web pages generated in response to the query to one of a plurality of query terms, a second subset of the plurality of rating scores reflecting a second determined level of relevance of the one of the plurality of web pages generated in response to the query to one of a plurality of terms not included in the query terms and associated with the one of the plurality of web pages;
observing interaction of a plurality of users with a selected web page of the plurality of web pages during a rating period to detect any of a type of content interaction, each of the type of content interaction being performed with respect to the selected web page, the type of content interaction comprising printing the content and copying the content;
in response to detecting any of the type of content interaction performed by any of the plurality of users,
adjusting at least one of the established first subset of the plurality of rating scores for at least one combination of the selected web page and a query term among the one or more query terms, the rating score being adjusted by an amount based at least in part upon the detected content interaction, the adjustment to the rating score being configured to be positive based at least in part on the detected content interaction, each adjustment to the rating score corresponding to an inferred relevance of the web page to one of the query terms; and
adjusting at least one of the established second subset of the plurality of rating scores for at least one combination of the selected web page and one of the plurality of terms not included in the query terms and associated with the one of the plurality of web pages, the rating score being adjusted by an amount based at least in part upon the detected content interaction, the adjustment to the rating score being configured to be positive based at least in part on the detected content interaction, each adjustment to the rating score corresponding to an inferred relevance of the selected web page to the one of the plurality of terms; and
for each of a plurality of web pages included generated in response to the query:
selecting established and adjusted rating scores for each combination of the web page and a query term and for each combination of the web page and a term not included in the query terms, and
determining a ranking score for the web page by combining the selected rating scores.
2. The computer-implemented method of claim 1, further comprising causing the web pages included in the distinguished result set to be displayed in accordance with the determined ranking scores.
3. The computer-implemented method of claim 1, further comprising causing the web pages included in the distinguished result set to be displayed in an order corresponding to the determined ranking scores.
4. The computer-implemented method of claim 1, further comprising using the determined ranking scores to select a proper subset of the web pages included in the distinguished query result for display.
5. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to a content interaction in which a user prints content of the distinguished web page.
6. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to a content interaction in which a user highlights content of the distinguished web page.
7. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to a content interaction in which a user copies content of the distinguished web page.
8. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to a content interaction in which a user pastes content copied from the distinguished web page.
9. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to a content interaction in which a user bookmarks the distinguished web page.
10. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to a content interaction in which a user searches within the distinguished web page.
11. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to a content interaction in which a user posts form content from the distinguished web page.
12. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to a content interaction in which a user annotates the distinguished web page.
13. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to a content interaction in which a user follows a link in the distinguished web page to another web page in the Internet domain of the distinguished web page.
14. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a positive direction in response to at least a threshold volume of communications events between client and server while a user is viewing the distinguished web page to another web page in the Internet domain of the distinguished web page.
15. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a negative direction in response to a content interaction in which a user follows a link in the distinguished web page to another web page in the Internet domain of the distinguished web page.
16. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in a negative direction in response to a content interaction in which a user follows a link in the distinguished web page to a web page in an Internet domain other than that of the distinguished web page.
17. The computer-implemented method of claim 1 wherein at least one rating score for a distinguished web page is adjusted in response to a content interaction performed with respect to a web page reached by the user by following a link in the distinguished web page.
18. A computer-readable storage medium whose contents cause at least one computing system to perform a method for scoring the relevance of documents to terms, the method comprising:
under control of the at least one computer system configured with executable instructions,
initializing a first set of rating scores for combinations of a plurality of documents with a plurality of query terms included in a plurality of queries, each rating score of the first set of rating scores reflecting a first determined level of relevance of one of the plurality of documents to one of the plurality of˜terms, the plurality of documents being returned in response to the plurality of queries;
initializing a second set of rating scores for combinations of the plurality of documents with a plurality of terms not included in the query terms, the plurality of terms being associated with the plurality of documents, each rating score of the second set of rating scores reflecting a second determined level of relevance of one of the plurality of documents to one of the plurality of terms;
observing interaction of a plurality of users with respect to a selected document of the plurality of documents during a rating period to detect any of a type of content interaction, each of the type of content interaction being performed by a user with respect to the selected document when included in a result set generated in response to a query comprising one or more query terms from the plurality of query terms, the type of content interaction comprising highlighting content of the document and annotating content of the selected document; and
in response to detecting each of the type of content interaction performed by any of the plurality of users,
adjusting a rating score of the first set of rating scores for at least one combination of the selected document with respect to which the action was performed and a term among the one or more query terms, the rating score being adjusted by an amount based at least in part upon the detected content interaction, the adjustment to the rating score being configured to be positive based at least in part on the detected content interaction, each adjustment to the rating score corresponding to an inferred relevance of the selected document to the query term; and
adjusting a rating score for at least one combination of the selected document with respect to which the action was performed and one of the plurality of terms not included in the query terms and associated with the selected document, the rating score being adjusted by an amount based at least in part upon the detected content interaction, the adjustment to the rating score being configured to be positive based at least in part on the detected content interaction, each adjustment to the rating score corresponding to an inferred relevance of the selected document to the one of the plurality of terms;
for each of a plurality of documents included in a distinguished result set produced in response to a distinguished query comprising a set of distinguished query terms, at least:
selecting ratings for each combination of the document and a query term among the distinguished set of query terms, and
determining a ranking score for the document in the distinguished result set by combining the selected ratings.
19. The computer-readable storage medium of claim 18 wherein the type of content interaction further comprises printing content of the document.
20. The computer-readable storage medium of claim 18 wherein the type of content interaction further comprises copying content of the document.
21. The computer-readable storage medium of claim 18 wherein the type of content interaction further comprises pasting content copied from the document.
22. The computer-readable storage medium of claim 18 wherein the type of content interaction further comprises bookmarking the document.
23. The computer-readable storage medium of claim 18 wherein the type of content interaction further comprises searching within the document.
24. The computer-readable storage medium of claim 18 wherein the type of content interaction further comprises securely posting form contents from within the document.
25. The computer-readable storage medium of claim 18 wherein the type of content interaction further comprises following a link in the document to another document from the same source.
26. The computer-readable storage medium of claim 18 wherein, for at least one observed action, a rating for each combination of the document with which the action was performed and a term among the terms comprising the query in response to which the result set was generated is adjusted where the action is of the type interacting with the document to produce at least a threshold volume of communication events with a source of the document.
27. The computer-readable storage medium of claim 18 wherein, for at least one observed action, a rating for each combination of the document with which the action was performed and a term among the terms comprising the query in response to which the result set was generated is adjusted where the action is of the type submitting a new query after viewing the document.
28. The computer-readable storage medium of claim 18 wherein, for at least one observed action, a rating for each combination of the document with which the action was performed and a term among the terms comprising the query in response to which the result set was generated is adjusted where the action is of the type following a link in the document to another document from a source other than the source of the document.
29. The computer-readable storage medium of claim 18 wherein the type of content interaction further comprises interacting with the content of the document to produce at least a threshold volume of communication events with a source of the document.
30. The computer-readable storage medium of claim 18 wherein the type of content interaction further comprises playing at least a threshold percentage of a time-indexed media resource embedded in the document.
US11392993 2006-03-28 2006-03-28 Identifying the items most relevant to a current query based on user activity with respect to the results of similar queries Active 2026-08-27 US7996396B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11392993 US7996396B2 (en) 2006-03-28 2006-03-28 Identifying the items most relevant to a current query based on user activity with respect to the results of similar queries

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US11392993 US7996396B2 (en) 2006-03-28 2006-03-28 Identifying the items most relevant to a current query based on user activity with respect to the results of similar queries
EP20070759583 EP2011043A4 (en) 2006-03-28 2007-03-28 Identifying the items most relevant to a current query based on user activity with respect to the results of similar queries
PCT/US2007/065370 WO2007112439A3 (en) 2006-03-28 2007-03-28 Identifying the items most relevant to a current query based on user activity with respect to the results of similar queries
JP2009503249A JP5112418B2 (en) 2006-03-28 2007-03-28 Identifying the most relevant item in the current query based on user activity on the results of similar queries
CA 2646711 CA2646711C (en) 2006-03-28 2007-03-28 Identifying the items most relevant to a current query based on user activity with respect to the results of similar queries

Publications (2)

Publication Number Publication Date
US20070239713A1 true US20070239713A1 (en) 2007-10-11
US7996396B2 true US7996396B2 (en) 2011-08-09

Family

ID=38541892

Family Applications (1)

Application Number Title Priority Date Filing Date
US11392993 Active 2026-08-27 US7996396B2 (en) 2006-03-28 2006-03-28 Identifying the items most relevant to a current query based on user activity with respect to the results of similar queries

Country Status (5)

Country Link
US (1) US7996396B2 (en)
EP (1) EP2011043A4 (en)
JP (1) JP5112418B2 (en)
CA (1) CA2646711C (en)
WO (1) WO2007112439A3 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080016091A1 (en) * 2006-06-22 2008-01-17 Rohit Chandra Method and apparatus for highlighting a portion of an internet document for collaboration and subsequent retrieval
US20100131542A1 (en) * 2008-11-26 2010-05-27 James Paul Schneider Suggested websites
US8548995B1 (en) * 2003-09-10 2013-10-01 Google Inc. Ranking of documents based on analysis of related documents
US9292617B2 (en) 2013-03-14 2016-03-22 Rohit Chandra Method and apparatus for enabling content portion selection services for visitors to web pages

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8849895B2 (en) * 2006-03-09 2014-09-30 International Business Machines Corporation Associating user selected content management directives with user selected ratings
US8131703B2 (en) * 2006-04-14 2012-03-06 Adobe Systems Incorporated Analytics based generation of ordered lists, search engine feed data, and sitemaps
US8352573B2 (en) * 2006-06-23 2013-01-08 Rohit Chandra Method and apparatus for automatically embedding and emailing user-generated highlights
US8661031B2 (en) * 2006-06-23 2014-02-25 Rohit Chandra Method and apparatus for determining the significance and relevance of a web page, or a portion thereof
US8635214B2 (en) * 2006-07-26 2014-01-21 International Business Machines Corporation Improving results from search providers using a browsing-time relevancy factor
US7752195B1 (en) * 2006-08-18 2010-07-06 A9.Com, Inc. Universal query search results
US20080172636A1 (en) * 2007-01-12 2008-07-17 Microsoft Corporation User interface for selecting members from a dimension
US7958127B2 (en) * 2007-02-15 2011-06-07 Uqast, Llc Tag-mediated review system for electronic content
US8019742B1 (en) 2007-05-31 2011-09-13 Google Inc. Identifying related queries
US7831596B2 (en) * 2007-07-02 2010-11-09 Hewlett-Packard Development Company, L.P. Systems and processes for evaluating webpages
US20090013068A1 (en) * 2007-07-02 2009-01-08 Eaglestone Robert J Systems and processes for evaluating webpages
US8200694B1 (en) 2007-07-23 2012-06-12 Google Inc. Identification of implicitly local queries
US9178848B1 (en) * 2007-07-23 2015-11-03 Google Inc. Identifying affiliated domains
US9207990B2 (en) * 2007-09-28 2015-12-08 Hewlett-Packard Development Company, L.P. Method and system for migrating critical resources within computer systems
KR100893129B1 (en) * 2007-10-24 2009-04-15 엔에이치엔(주) System for extracting recommended keyword of multimedia contents and method thereof
US20090119276A1 (en) * 2007-11-01 2009-05-07 Antoine Sorel Neron Method and Internet-based Search Engine System for Storing, Sorting, and Displaying Search Results
US20090132935A1 (en) * 2007-11-15 2009-05-21 Yahoo! Inc. Video tag game
US8429145B2 (en) * 2007-12-21 2013-04-23 Yahoo! Inc. Syndicating humor
US20090248661A1 (en) * 2008-03-28 2009-10-01 Microsoft Corporation Identifying relevant information sources from user activity
JP2009295008A (en) * 2008-06-06 2009-12-17 Canon Inc Document management apparatus, documentation management method, and program
US8788490B1 (en) 2008-06-27 2014-07-22 Google Inc. Link based locale identification for domains and domain content
US9183323B1 (en) 2008-06-27 2015-11-10 Google Inc. Suggesting alternative query phrases in query results
US8725714B2 (en) * 2008-09-08 2014-05-13 Chuan David Ai Private information requests and information management
US9594835B2 (en) 2008-11-25 2017-03-14 Yahoo! Inc. Lightning search aggregate
US8290944B2 (en) 2008-11-25 2012-10-16 Yahoo! Inc. Method for storing bookmarks for search results from previously submitted search queries by a user and storing links to selected documents by the user
US8972411B1 (en) * 2009-01-27 2015-03-03 Google Inc. Selection of sponsored content using multiple sets of query terms
US8458171B2 (en) * 2009-01-30 2013-06-04 Google Inc. Identifying query aspects
US20100229188A1 (en) * 2009-03-03 2010-09-09 International Business Machines Corporation Presenting Data Files to an Application Based on a Characteristic of the Application and the Files
US8539487B2 (en) * 2009-09-11 2013-09-17 International Business Machines Corporation Automatically generating compound commands in a computer system
US9047380B1 (en) * 2009-12-31 2015-06-02 Intuit Inc. Technique for determining keywords for a document
US8849785B1 (en) 2010-01-15 2014-09-30 Google Inc. Search query reformulation using result term occurrence count
US20120284332A1 (en) * 2010-11-03 2012-11-08 Anantha Pradeep Systems and methods for formatting a presentation in webpage based on neuro-response data
US8903951B2 (en) 2011-07-12 2014-12-02 Facebook, Inc. Speculative database authentication
US8756217B2 (en) 2011-07-12 2014-06-17 Facebook, Inc. Speculative switch database
US8914390B2 (en) * 2011-07-12 2014-12-16 Facebook, Inc. Repetitive query recognition and processing
US9619508B2 (en) 2011-07-12 2017-04-11 Facebook, Inc. Speculative begin transaction
US9569986B2 (en) 2012-02-27 2017-02-14 The Nielsen Company (Us), Llc System and method for gathering and analyzing biometric user feedback for use in social media and advertising applications
US20140143681A1 (en) * 2012-11-16 2014-05-22 Rohit Chandra Method and apparatus for sharing user-selected content
US20140258472A1 (en) * 2013-03-06 2014-09-11 Cbs Interactive Inc. Video Annotation Navigation
US9092489B1 (en) * 2013-03-08 2015-07-28 Google Inc. Popular media items data set with exponential decay
US20140278308A1 (en) * 2013-03-15 2014-09-18 Yahoo! Inc. Method and system for measuring user engagement using click/skip in content stream
US9936250B2 (en) 2015-05-19 2018-04-03 The Nielsen Company (Us), Llc Methods and apparatus to adjust content presented to an individual

Citations (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4996642A (en) 1987-10-01 1991-02-26 Neonics, Inc. System and method for recommending items
US5446891A (en) 1992-02-26 1995-08-29 International Business Machines Corporation System for adjusting hypertext links with weighed user goals and activities
WO1995029451A1 (en) 1994-04-25 1995-11-02 Apple Computer, Inc. System for ranking the relevance of information objects accessed by computer users
EP0751471A1 (en) 1995-06-30 1997-01-02 Massachusetts Institute Of Technology Method and apparatus for item recommendation using automated collaborative filtering
US5640553A (en) 1995-09-15 1997-06-17 Infonautics Corporation Relevance normalization for documents retrieved from an information retrieval system in response to a query
US5748954A (en) 1995-06-05 1998-05-05 Carnegie Mellon University Method for searching a queued and ranked constructed catalog of files stored on a network
US5754237A (en) 1995-03-20 1998-05-19 Daewoo Electronics Co., Ltd. Method for determining motion vectors using a hierarchical motion estimation
US5826261A (en) 1996-05-10 1998-10-20 Spencer; Graham System and method for querying multiple, distributed databases by selective sharing of local relative significance information for terms related to the query
WO1999006924A1 (en) 1997-08-01 1999-02-11 Gary Culliss Method for organizing information
US5875443A (en) 1996-01-30 1999-02-23 Sun Microsystems, Inc. Internet-based spelling checker dictionary system with automatic updating
US5877485A (en) 1996-01-25 1999-03-02 Symbol Technologies, Inc. Statistical sampling security methodology for self-scanning checkout system
US5920859A (en) 1997-02-05 1999-07-06 Idd Enterprises, L.P. Hypertext document retrieval system and method
US6006225A (en) 1998-06-15 1999-12-21 Amazon.Com Refining search queries by the suggestion of correlated terms from prior searches
US6006222A (en) 1997-04-25 1999-12-21 Culliss; Gary Method for organizing information
US6064980A (en) 1998-03-17 2000-05-16 Amazon.Com, Inc. System and methods for collaborative recommendations
US6185558B1 (en) 1998-03-03 2001-02-06 Amazon.Com, Inc. Identifying the items most relevant to a current query based on items selected in connection with similar queries
US20010042064A1 (en) 1999-05-28 2001-11-15 Goto.Com. System and method for influencing a position on a search result list generated by a computer network search engine
US20010049688A1 (en) * 2000-03-06 2001-12-06 Raya Fratkina System and method for providing an intelligent multi-step dialog with a user
WO2002019167A2 (en) 2000-08-30 2002-03-07 Richard Reisman Task/domain segmentation in applying feedback to command control
US6421675B1 (en) 1998-03-16 2002-07-16 S. L. I. Systems, Inc. Search engine
US20020103798A1 (en) * 2001-02-01 2002-08-01 Abrol Mani S. Adaptive document ranking method based on user behavior
US20020123988A1 (en) 2001-03-02 2002-09-05 Google, Inc. Methods and apparatus for employing usage statistics in document retrieval
US20020147895A1 (en) * 1999-12-22 2002-10-10 Xerox Corporation System and method for caching
US20020198882A1 (en) * 2001-03-29 2002-12-26 Linden Gregory D. Content personalization based on actions performed during a current browsing session
US6546388B1 (en) 2000-01-14 2003-04-08 International Business Machines Corporation Metadata search results ranking system
US6549941B1 (en) 1999-11-22 2003-04-15 Alexa Internet Software system and methods for resubmitting form data to related web sites
US6631372B1 (en) 1998-02-13 2003-10-07 Yahoo! Inc. Search engine using sales and revenue to weight search results
US6640218B1 (en) * 2000-06-02 2003-10-28 Lycos, Inc. Estimating the usefulness of an item in a collection of information
US20040024739A1 (en) * 1999-06-15 2004-02-05 Kanisa Inc. System and method for implementing a knowledge management system
US6691163B1 (en) 1999-12-23 2004-02-10 Alexa Internet Use of web usage trail data to identify related links
US20040083127A1 (en) 2002-10-29 2004-04-29 Lunsford Joseph R. Web site and method for search engine optimization by prompting, recording and displaying feedback of a web site user
US20040260688A1 (en) * 2003-06-05 2004-12-23 Gross John N. Method for implementing search engine
US20040267723A1 (en) * 2003-06-30 2004-12-30 Krishna Bharat Rendering advertisements with documents having one or more topics using user topic interest information
US6865571B2 (en) 2000-10-31 2005-03-08 Hitachi, Ltd. Document retrieval method and system and computer readable storage medium
US20050131866A1 (en) * 2003-12-03 2005-06-16 Badros Gregory J. Methods and systems for personalized network searching
US20050222981A1 (en) * 2004-03-31 2005-10-06 Lawrence Stephen R Systems and methods for weighting a search query result
US20060004607A1 (en) * 2000-02-24 2006-01-05 Philip Marshall Personalized health history system with accommodation for consumer health terminology
US20060004711A1 (en) * 2004-06-30 2006-01-05 Microsoft Corporation System and method for ranking search results based on tracked user preferences
US20060106757A1 (en) * 1996-05-06 2006-05-18 Amada Company, Limited Search for similar sheet metal part models
US20060112098A1 (en) * 2004-11-19 2006-05-25 Microsoft Corporation Client-based generation of music playlists via clustering of music similarity vectors
US20060179053A1 (en) * 2005-02-04 2006-08-10 Microsoft Corporation Improving quality of web search results using a game
US20060195325A1 (en) * 2003-03-27 2006-08-31 Tateson Richard E Data retrieval system
US20060224938A1 (en) * 2005-03-31 2006-10-05 Google, Inc. Systems and methods for providing a graphical display of search activity
US7124129B2 (en) * 1998-03-03 2006-10-17 A9.Com, Inc. Identifying the items most relevant to a current query based on items selected in connection with similar queries
US7133870B1 (en) * 1999-10-14 2006-11-07 Al Acquisitions, Inc. Index cards on network hosts for searching, rating, and ranking
US20060271691A1 (en) * 2005-05-23 2006-11-30 Picateers, Inc. System and method for collaborative image selection
US20070016553A1 (en) * 2005-06-29 2007-01-18 Microsoft Corporation Sensing, storing, indexing, and retrieving data leveraging measures of user activity, attention, and interest
US20070100796A1 (en) * 2005-10-28 2007-05-03 Disney Enterprises, Inc. System and method for targeted ad delivery
US20070106659A1 (en) * 2005-03-18 2007-05-10 Yunshan Lu Search engine that applies feedback from users to improve search results
US20070112768A1 (en) * 2005-11-15 2007-05-17 Microsoft Corporation UserRank: ranking linked nodes leveraging user logs
US7225182B2 (en) * 1999-05-28 2007-05-29 Overture Services, Inc. Recommending search terms using collaborative filtering and web spidering
US20070130145A1 (en) * 2005-11-23 2007-06-07 Microsoft Corporation User activity based document analysis
US7243102B1 (en) * 2004-07-01 2007-07-10 Microsoft Corporation Machine directed improvement of ranking algorithms
US20070162424A1 (en) * 2005-12-30 2007-07-12 Glen Jeh Method, system, and graphical user interface for alerting a computer user to new results for a prior search
US7302426B2 (en) * 2004-06-29 2007-11-27 Xerox Corporation Expanding a partially-correct list of category elements using an indexed document collection
US7318057B2 (en) * 2000-05-31 2008-01-08 International Business Machines Corporation Information search using knowledge agents
US7424488B2 (en) * 2006-06-27 2008-09-09 International Business Machines Corporation Context-aware, adaptive approach to information selection for interactive information analysis

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002251410A (en) * 2001-02-26 2002-09-06 Sharp Corp Information retrieving device, information retrieving program, and computer-readable recording medium recording therein information retrieving program
JP2004029943A (en) * 2002-06-21 2004-01-29 Recruit Co Ltd Retrieval support method
JP2005267479A (en) * 2004-03-22 2005-09-29 Fuji Xerox Co Ltd Document use history management system and method

Patent Citations (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4996642A (en) 1987-10-01 1991-02-26 Neonics, Inc. System and method for recommending items
US5446891A (en) 1992-02-26 1995-08-29 International Business Machines Corporation System for adjusting hypertext links with weighed user goals and activities
WO1995029451A1 (en) 1994-04-25 1995-11-02 Apple Computer, Inc. System for ranking the relevance of information objects accessed by computer users
US6202058B1 (en) 1994-04-25 2001-03-13 Apple Computer, Inc. System for ranking the relevance of information objects accessed by computer users
US5754237A (en) 1995-03-20 1998-05-19 Daewoo Electronics Co., Ltd. Method for determining motion vectors using a hierarchical motion estimation
US5748954A (en) 1995-06-05 1998-05-05 Carnegie Mellon University Method for searching a queued and ranked constructed catalog of files stored on a network
EP0751471A1 (en) 1995-06-30 1997-01-02 Massachusetts Institute Of Technology Method and apparatus for item recommendation using automated collaborative filtering
US5640553A (en) 1995-09-15 1997-06-17 Infonautics Corporation Relevance normalization for documents retrieved from an information retrieval system in response to a query
US5877485A (en) 1996-01-25 1999-03-02 Symbol Technologies, Inc. Statistical sampling security methodology for self-scanning checkout system
US5875443A (en) 1996-01-30 1999-02-23 Sun Microsystems, Inc. Internet-based spelling checker dictionary system with automatic updating
US20060106757A1 (en) * 1996-05-06 2006-05-18 Amada Company, Limited Search for similar sheet metal part models
US5826261A (en) 1996-05-10 1998-10-20 Spencer; Graham System and method for querying multiple, distributed databases by selective sharing of local relative significance information for terms related to the query
US5920859A (en) 1997-02-05 1999-07-06 Idd Enterprises, L.P. Hypertext document retrieval system and method
US6006222A (en) 1997-04-25 1999-12-21 Culliss; Gary Method for organizing information
US6014665A (en) 1997-08-01 2000-01-11 Culliss; Gary Method for organizing information
WO1999006924A1 (en) 1997-08-01 1999-02-11 Gary Culliss Method for organizing information
US6631372B1 (en) 1998-02-13 2003-10-07 Yahoo! Inc. Search engine using sales and revenue to weight search results
US6185558B1 (en) 1998-03-03 2001-02-06 Amazon.Com, Inc. Identifying the items most relevant to a current query based on items selected in connection with similar queries
US7305390B2 (en) * 1998-03-03 2007-12-04 A9.Com, Inc. Identifying the items most relevant to a current query based on items selected in connection with similar queries
US7124129B2 (en) * 1998-03-03 2006-10-17 A9.Com, Inc. Identifying the items most relevant to a current query based on items selected in connection with similar queries
US6421675B1 (en) 1998-03-16 2002-07-16 S. L. I. Systems, Inc. Search engine
US6064980A (en) 1998-03-17 2000-05-16 Amazon.Com, Inc. System and methods for collaborative recommendations
US6006225A (en) 1998-06-15 1999-12-21 Amazon.Com Refining search queries by the suggestion of correlated terms from prior searches
US20010042064A1 (en) 1999-05-28 2001-11-15 Goto.Com. System and method for influencing a position on a search result list generated by a computer network search engine
US7225182B2 (en) * 1999-05-28 2007-05-29 Overture Services, Inc. Recommending search terms using collaborative filtering and web spidering
US20040024739A1 (en) * 1999-06-15 2004-02-05 Kanisa Inc. System and method for implementing a knowledge management system
US7133870B1 (en) * 1999-10-14 2006-11-07 Al Acquisitions, Inc. Index cards on network hosts for searching, rating, and ranking
US6549941B1 (en) 1999-11-22 2003-04-15 Alexa Internet Software system and methods for resubmitting form data to related web sites
US20020147895A1 (en) * 1999-12-22 2002-10-10 Xerox Corporation System and method for caching
US6691163B1 (en) 1999-12-23 2004-02-10 Alexa Internet Use of web usage trail data to identify related links
US6546388B1 (en) 2000-01-14 2003-04-08 International Business Machines Corporation Metadata search results ranking system
US20060004607A1 (en) * 2000-02-24 2006-01-05 Philip Marshall Personalized health history system with accommodation for consumer health terminology
US20010049688A1 (en) * 2000-03-06 2001-12-06 Raya Fratkina System and method for providing an intelligent multi-step dialog with a user
US7318057B2 (en) * 2000-05-31 2008-01-08 International Business Machines Corporation Information search using knowledge agents
US6640218B1 (en) * 2000-06-02 2003-10-28 Lycos, Inc. Estimating the usefulness of an item in a collection of information
WO2002019167A2 (en) 2000-08-30 2002-03-07 Richard Reisman Task/domain segmentation in applying feedback to command control
US20030172075A1 (en) 2000-08-30 2003-09-11 Richard Reisman Task/domain segmentation in applying feedback to command control
US6865571B2 (en) 2000-10-31 2005-03-08 Hitachi, Ltd. Document retrieval method and system and computer readable storage medium
US20020103798A1 (en) * 2001-02-01 2002-08-01 Abrol Mani S. Adaptive document ranking method based on user behavior
US20020123988A1 (en) 2001-03-02 2002-09-05 Google, Inc. Methods and apparatus for employing usage statistics in document retrieval
US20020198882A1 (en) * 2001-03-29 2002-12-26 Linden Gregory D. Content personalization based on actions performed during a current browsing session
US20040083127A1 (en) 2002-10-29 2004-04-29 Lunsford Joseph R. Web site and method for search engine optimization by prompting, recording and displaying feedback of a web site user
US20060195325A1 (en) * 2003-03-27 2006-08-31 Tateson Richard E Data retrieval system
US20040260688A1 (en) * 2003-06-05 2004-12-23 Gross John N. Method for implementing search engine
US20040267723A1 (en) * 2003-06-30 2004-12-30 Krishna Bharat Rendering advertisements with documents having one or more topics using user topic interest information
US20050131866A1 (en) * 2003-12-03 2005-06-16 Badros Gregory J. Methods and systems for personalized network searching
US20050222981A1 (en) * 2004-03-31 2005-10-06 Lawrence Stephen R Systems and methods for weighting a search query result
US7302426B2 (en) * 2004-06-29 2007-11-27 Xerox Corporation Expanding a partially-correct list of category elements using an indexed document collection
US20060004711A1 (en) * 2004-06-30 2006-01-05 Microsoft Corporation System and method for ranking search results based on tracked user preferences
US7243102B1 (en) * 2004-07-01 2007-07-10 Microsoft Corporation Machine directed improvement of ranking algorithms
US20060112098A1 (en) * 2004-11-19 2006-05-25 Microsoft Corporation Client-based generation of music playlists via clustering of music similarity vectors
US20060179053A1 (en) * 2005-02-04 2006-08-10 Microsoft Corporation Improving quality of web search results using a game
US20070106659A1 (en) * 2005-03-18 2007-05-10 Yunshan Lu Search engine that applies feedback from users to improve search results
US20060224938A1 (en) * 2005-03-31 2006-10-05 Google, Inc. Systems and methods for providing a graphical display of search activity
US20060271691A1 (en) * 2005-05-23 2006-11-30 Picateers, Inc. System and method for collaborative image selection
US20070016553A1 (en) * 2005-06-29 2007-01-18 Microsoft Corporation Sensing, storing, indexing, and retrieving data leveraging measures of user activity, attention, and interest
US20070100796A1 (en) * 2005-10-28 2007-05-03 Disney Enterprises, Inc. System and method for targeted ad delivery
US20070112768A1 (en) * 2005-11-15 2007-05-17 Microsoft Corporation UserRank: ranking linked nodes leveraging user logs
US20070130145A1 (en) * 2005-11-23 2007-06-07 Microsoft Corporation User activity based document analysis
US20070162424A1 (en) * 2005-12-30 2007-07-12 Glen Jeh Method, system, and graphical user interface for alerting a computer user to new results for a prior search
US7424488B2 (en) * 2006-06-27 2008-09-09 International Business Machines Corporation Context-aware, adaptive approach to information selection for interactive information analysis

Non-Patent Citations (22)

* Cited by examiner, † Cited by third party
Title
"Direct Hit Search Engine," http://web.archive.org/web/20000816061012/directhit.com/about/products/search-engine.html, Aug. 16, 2000.
"Direct Hit Shopping Engine," http://web.archive.org/web/200001027051006/directhit.com/about/products/shopping-engine.html, Oct. 27, 2000.
"Distributed Search Patent," located at , accessed Dec. 21, 1998.
"Infoseek Gets Patent on Internet Search Technique," located at , accessed Dec. 21, 1998.
"PLS Speeds Time to Market for Content-Rich Web Sites With PI Web Turbo Version 2.6; New Version Delivers Open Platform Support and Flexible Interface Design," PR Newswire, Financial News Section, Sep. 1996.
"Sageware Introduces Knowledge Sets for Verity's Line of Information searching Products," PR Newswire, Financial News section, May 1996.
"Searching Far and Wide: The Powerful Document Retrieval Software of PLS, Part 2," Seybold Report on Desktop Publishing, Apr. 1996, vol. 10, No. 8.
"Searching Far and Wide: The Powerful Document Retrieval Software of PLS, Part 3," Seybold Report on Desktop Publishing, Apr. 1996, vol. 10, No. 8.
"Direct Hit Search Engine," http://web.archive.org/web/20000816061012/directhit.com/about/products/search—engine.html, Aug. 16, 2000.
"Direct Hit Shopping Engine," http://web.archive.org/web/200001027051006/directhit.com/about/products/shopping—engine.html, Oct. 27, 2000.
"Distributed Search Patent," located at <http://software.inforseek.com/patents/dist—search/Default.htm>, accessed Dec. 21, 1998.
"Infoseek Gets Patent on Internet Search Technique," located at <http://software.infoseek.com/patent/dist—search/bg—info.htm>, accessed Dec. 21, 1998.
Banet, "Searching Far and Wide: The Powerful Document Retrieval Software of PLS, Part 1," Seybold Report on Desktop Publishing, Apr. 1996, vol. 10, No. 8.
Brooks, "Looking for Data in all the Wrong Places; Finding Data in Free-Form Data Sources, Technology Information," DBMS, Oct. 1997, vol. 11, No. 10, p. 70.
Courtois et al., "Cool Tools for Searching the Wet; World Wide Web Search Databases; Includes Related Articles," Online, Nov. 1995, vol. 19, No. 6 p. 14.
Jurvis, "Serving up Knowledge," Informationweek, Nov. 1997, vol. 657, pp. 141-150.
Klinger, "Search the Internet the Easy Way," LAN Times, May 1997, vol. 14, No. 10, p. 56.
Munro, "Filtering Utilities," PCT Magazine, Apr. 1997, vol. 16, No. 7, p. 235.
Munson, "World Wide Web Indexes and Hierarchical Lists: Finding Tools for the Internet," Computers in Libraries, Jun. 1996, vol. 16, No. 6, p. 54.
Notess, "Northern Light: New Search Engine for the Web and Full-Text Articles; Includes Related Article," Database, Feb. 1998, vol. 21, No. 1, p. 32.
Paul, "News Archives: One-stop Shopping, Boutique Hopping and the Specialty News Search Site: Includes Related Article Battle of the Search Engines," Searcher, Jan. 1998, vol. 6, No. 1, p. 64.
Sheldon et al., "Discover: A Resource Discovery System Based on Content Routing," Computer Networks and ISDN Systems, Apr. 1995, vol. 27, No. 6, pp. 953-972.

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8548995B1 (en) * 2003-09-10 2013-10-01 Google Inc. Ranking of documents based on analysis of related documents
US20080016091A1 (en) * 2006-06-22 2008-01-17 Rohit Chandra Method and apparatus for highlighting a portion of an internet document for collaboration and subsequent retrieval
US8910060B2 (en) 2006-06-22 2014-12-09 Rohit Chandra Method and apparatus for highlighting a portion of an internet document for collaboration and subsequent retrieval
US20100131542A1 (en) * 2008-11-26 2010-05-27 James Paul Schneider Suggested websites
US9053197B2 (en) * 2008-11-26 2015-06-09 Red Hat, Inc. Suggesting websites
US9292617B2 (en) 2013-03-14 2016-03-22 Rohit Chandra Method and apparatus for enabling content portion selection services for visitors to web pages

Also Published As

Publication number Publication date Type
US20070239713A1 (en) 2007-10-11 application
JP2009531792A (en) 2009-09-03 application
EP2011043A4 (en) 2012-04-11 application
CA2646711C (en) 2014-09-09 grant
EP2011043A2 (en) 2009-01-07 application
JP5112418B2 (en) 2013-01-09 grant
WO2007112439A3 (en) 2008-11-27 application
WO2007112439A2 (en) 2007-10-04 application
CA2646711A1 (en) 2007-10-04 application

Similar Documents

Publication Publication Date Title
Amento et al. Does “authority” mean quality? Predicting expert quality ratings of Web documents
Herring et al. Longitudinal content analysis of blogs: 2003-2004
US8204897B1 (en) Interactive search querying
White et al. Studying the use of popular destinations to enhance web search interaction
US7783644B1 (en) Query-independent entity importance in books
White et al. A study on the effects of personalization and task information on implicit feedback performance
US20090158161A1 (en) Collaborative search in virtual worlds
US20070276829A1 (en) Systems and methods for ranking implicit search results
Millen et al. Social bookmarking and exploratory search
US20080040323A1 (en) Method and apparatus for reconstructing a search query
US7624101B2 (en) Enhanced search results
US20070174237A1 (en) Search service that accesses and highlights previously accessed local and online available information sources
US20060149708A1 (en) Search method and system and system using the same
Breeding Introduction
US20050203888A1 (en) Method and apparatus for improved relevance of search results
US20100131902A1 (en) Navigation assistance for search engines
US20090043749A1 (en) Extracting query intent from query logs
US20060112081A1 (en) Storing searches in an e-mail folder
US20090182725A1 (en) Determining entity popularity using search queries
Yanbe et al. Can social bookmarking enhance search in the web?
US20060173819A1 (en) System and method for grouping by attribute
US20090094189A1 (en) Methods, systems, and computer program products for managing tags added by users engaged in social tagging of content
US20070073708A1 (en) Generation of topical subjects from alert search terms
US20090292696A1 (en) Computer-implemented search using result matching
US20080294617A1 (en) Probabilistic Recommendation System

Legal Events

Date Code Title Description
AS Assignment

Owner name: A9.COM, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEBLANG, JONATHAN;ORTEGA, RUBEN;SAUNDERS, COLIN;REEL/FRAME:021192/0662;SIGNING DATES FROM 20060427 TO 20060504

Owner name: A9.COM, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEBLANG, JONATHAN;ORTEGA, RUBEN;SAUNDERS, COLIN;SIGNING DATES FROM 20060427 TO 20060504;REEL/FRAME:021192/0662

FPAY Fee payment

Year of fee payment: 4