US20060167842A1 - System and method for query refinement - Google Patents

System and method for query refinement Download PDF

Info

Publication number
US20060167842A1
US20060167842A1 US11041418 US4141805A US2006167842A1 US 20060167842 A1 US20060167842 A1 US 20060167842A1 US 11041418 US11041418 US 11041418 US 4141805 A US4141805 A US 4141805A US 2006167842 A1 US2006167842 A1 US 2006167842A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
query
results
search
sub
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11041418
Inventor
Eric Watson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor ; File system structures therefor
    • G06F17/3061Information retrieval; Database structures therefor ; File system structures therefor of unstructured textual data
    • G06F17/30634Querying
    • G06F17/30637Query formulation
    • G06F17/3064Query formulation using system suggestions
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor ; File system structures therefor
    • G06F17/3061Information retrieval; Database structures therefor ; File system structures therefor of unstructured textual data
    • G06F17/30634Querying
    • G06F17/30657Query processing
    • G06F17/3066Query translation
    • G06F17/30672Query expansion

Abstract

A method and system are provided for automatically enhancing initial search results produced by a search engine in response to a multi-word user query. The method may include implementing a result evaluation mechanism within the search engine for evaluating adequacy of the initial search results. The method may additionally include formulating at least one alternative query, such as a sub-query, if the initial search results are deemed inadequate by the result evaluation mechanism. The method may additionally include displaying result information including the initial search results and a listing of any formulated alternative queries.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • [0001]
    None.
  • STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT
  • [0002]
    None.
  • TECHNICAL FIELD
  • [0003]
    Embodiments of the present invention relate to a technique for refining user queries and in particular to a technique for providing a user with adequate search results.
  • BACKGROUND OF THE INVENTION
  • [0004]
    Through the Internet and other networks, users have gained access to large amounts of information distributed over a large number of computers. In order to access the vast amounts of information, users typically implement a user browser to access a search engine. The search engine responds to an input user query by returning one or more sources of information available over the Internet or other network.
  • [0005]
    Currently, when implementing a search engine, a user enters one or more keywords and receives a set of results. Depending upon the particular terms entered by a user, the search engine produces a number of results. In some instances, user selected terms may not lead the search engine to locate the desired information. In particular, when users enter multi-word queries, often containing too much information, the users are often disappointed with unsatisfactory or minimal results produced by the search engine.
  • [0006]
    In operation, the search engine typically implements a crawler to access a plurality of websites and stores references to those websites in an index. The references in the index may be categorized based on one or more keywords. The search engine may also store some results in a cache.
  • [0007]
    When responding to a user query, the search engine may first traverse the index in order to locate the input query terms. However, in many instances, the terms in the index may not correspond to the input query terms. The desired information may be indexed based on synonymous terms or alternative combinations of keywords. Thus, in order to receive desired search results, users may implement a trial and error technique and enter terms several times before receiving acceptable results or any results.
  • [0008]
    When existing search engines receive user input query terms that cannot be found in the index, these existing search engines typically fail to provide any results. Some existing search engines will attempt spelling corrections and reissue the search. However, if users want to search for variations of the entered terms, the users are typically required to repeat the search with different input terms.
  • [0009]
    Accordingly, a solution is needed for processing multi-word search queries that will ensure the provision of adequate results by autonomously broadening the input query based on the quantity or quality of search results returned. Preferably, such a solution would ensure that a maximum number of relevant results is obtained.
  • BRIEF SUMMARY OF THE INVENTION
  • [0010]
    Embodiments of the present invention are directed to a method for automatically enhancing initial search results produced by a search engine in response to a multi-word user query. The method includes implementing a result evaluation mechanism within the search engine for evaluating adequacy of the initial search results. The method additionally includes formulating at least one alternative query if the initial search results are deemed inadequate by the result evaluation mechanism and displaying result information including the initial search results and a listing of any formulated alternative queries.
  • [0011]
    Additional embodiments are directed to a method for automatically enhancing initial search results produced by a search engine in response to a multi-word user query. The embodiments include parsing the multi-word user query into multiple sub-queries and determining validity of the multiple sub-queries by determining either a quantity of sub-query results or a relevance of sub-query results or a combination of quantity and relevance. The method may additionally include displaying the initial search results, the sub-queries, and the determined validity of the sub-queries.
  • [0012]
    In further embodiments, a system may be provided for automatically enhancing initial search results produced by a search engine in response to a multi-word user query. The system may include a result evaluation mechanism within the search engine for evaluating adequacy the initial search results. The system may additionally include an alternative query determination mechanism for formulating an alternative query if the initial search results are evaluated as inadequate by the result evaluation mechanism. The system may further include a result output component for outputting the alternative query for display along with the initial search results.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0013]
    The present invention is described in detail below with reference to the attached drawings figures, wherein:
  • [0014]
    FIG. 1 is a block diagram illustrating an overview of a system in accordance with an embodiment of the invention;
  • [0015]
    FIG. 2 is a block diagram illustrating a computerized environment in which embodiments of the invention may be implemented;
  • [0016]
    FIG. 3 is a block diagram illustrating query refinement components in accordance with an embodiment of the invention;
  • [0017]
    FIG. 4 is a block diagram illustrating a result evaluation mechanism in accordance with an embodiment of the invention; and
  • [0018]
    FIG. 5 is a flowchart illustrating a method for refining a user query in accordance with an embodiment of the invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • [0000]
    I. System Overview
  • [0019]
    FIG. 1 is a block diagram illustrating a system overview in accordance with embodiments of the invention. A user computer 10 including a user browser 12 may be connected over a network 20 with a search engine 200. The search engine 200 may include, for example, a web crawler 210, an index 220, and a cache 230. The search engine 200 may include other standard components omitted from the description for simplicity. The search engine 200 may also include query refinement components 300. The query refinement components 300 may refine a user query from the user computer 10 and user browser 12 when the search engine 200 fails to produce adequate results. Typically, the search engine 200 will maintain the index 220 based on websites traversed by the web crawler 210, such as the websites 30.
  • [0020]
    Embodiments of the invention include a method and system for refining a user query in order to avoid dead ends encountered when a search engine fails to produce adequate results. Results may be inadequate due to being few in number or low in relevance. In operation, embodiments of the system and method may determine that results are inadequate and give the user suggestions for broadening an input query. Inadequate results may be determined through known techniques, such as evaluation of click-through rate, or alternatively may be determined based on a threshold number.
  • [0021]
    When results are deemed inadequate, the query refinement components 300 may break the multi-word query up into sub-queries. Upon the return of results for each sub-query, the query refinement components 300 may capture the relevance of the top results and number of results for the sub-query. Ultimately, the search engine 200 may output all result sets having the required number of results or with a required threshold relevance.
  • [0000]
    II. Exemplary Operating Environment
  • [0022]
    FIG. 2 illustrates an example of a suitable computing system environment 100 on which the system and method query refinement may be implemented. The computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100.
  • [0023]
    The invention is described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
  • [0024]
    With reference to FIG. 2, the exemplary system 100 for implementing the invention includes a general purpose-computing device in the form of a computer 110 including a processing unit 120, a system memory 130, and a system bus 121 that couples various system components including the system memory to the processing unit 120.
  • [0025]
    Computer 110 typically includes a variety of computer readable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. The system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic routines that help to transfer information between elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation, FIG. 2 illustrates operating system 134, application programs 135, other program modules 136, and program data 137.
  • [0026]
    The computer 110 may also include other removable/nonremovable, volatile/nonvolatile computer storage media. By way of example only, FIG. 2 illustrates a hard disk drive 141 that reads from or writes to nonremovable, nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 152, and an optical disk drive 155 that reads from or writes to a removable, nonvolatile optical disk 156 such as a CD ROM or other optical media. Other removable/nonremovable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive 141 is typically connected to the system bus 121 through an non-removable memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 155 are typically connected to the system bus 121 by a removable memory interface, such as interface 150.
  • [0027]
    The drives and their associated computer storage media discussed above and illustrated in FIG. 2, provide storage of computer readable instructions, data structures, program modules and other data for the computer 110. In FIG. 2, for example, hard disk drive 141 is illustrated as storing operating system 144, application programs 145, other program modules 146, and program data 147. Note that these components can either be the same as or different from operating system 134, application programs 135, other program modules 136, and program data 137. Operating system 144, application programs 145, other program modules 146, and program data 147 are given different numbers here to illustrate that, at a minimum, they are different copies. A user may enter commands and information into the computer 110 through input devices such as a keyboard 162 and pointing device 161, commonly referred to as a mouse, trackball or touch pad. Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). A monitor 191 or other type of display device is also connected to the system bus 121 via an interface, such as a video interface 190. In addition to the monitor, computers may also include other peripheral output devices such as speakers 197 and printer 196, which may be connected through an output peripheral interface 195.
  • [0028]
    The computer 110 in the present invention will operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 180 may be a personal computer, and typically includes many or all of the elements described above relative to the computer 110, although only a memory storage device 181 has been illustrated in FIG. 2. The logical connections depicted in FIG. 2 include a local area network (LAN) 171 and a wide area network (WAN) 173, but may also include other networks.
  • [0029]
    When used in a LAN networking environment, the computer 110 is connected to the LAN 171 through a network interface or adapter 170. When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173, such as the Internet. The modem 172, which may be internal or external, may be connected to the system bus 121 via the user input interface 160, or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 110, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation, FIG. 2 illustrates remote application programs 185 as residing on memory device 181. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
  • [0030]
    Although many other internal components of the computer 110 are not shown, those of ordinary skill in the art will appreciate that such components and the interconnection are well known. Accordingly, additional details concerning the internal construction of the computer 110 need not be disclosed in connection with the present invention.
  • [0000]
    III. System and Method of the Invention
  • [0031]
    As set forth above, FIG. 1 illustrates FIG. 1 is a block diagram illustrating a system overview in accordance with embodiments of the invention. User computers, such as the user computer 10 that includes a user browser 12, may be connected over the network 20 with the search engine 200. The network 20 may be the Internet or alternatively any of the types of networks described above with reference to FIG. 2.
  • [0032]
    The search engine 200 may include the web crawler 210, web index 220, and cache 230. The web crawler typically traverses websites 30 on a regular basis and indexes the websites 30 in the index 220 in order to easily access results in response to a user input query. The query refinement components 300 may evaluate and refine a user query from the user computer 10 and user browser 12 when the search engine 200 fails to produce adequate results in response to the user query. Typically, when generating results, the search engine 200 will maintain an index of traversed websites, such as the websites 30. The created index 220 may be based on keywords that appear in the traversed sites 30.
  • [0033]
    FIG. 3 illustrates further details of the query refinement components 300 in accordance with an embodiment of the invention. The query refinement components 300 may include a result evaluation mechanism 310, a sub-query determination mechanism 320, a sub-query search mechanism 330, and a result output component 340. An embodiment of the result evaluation mechanism 310 is further illustrated in FIG. 4. The result evaluation mechanism 310 may include a relevance determination component 312 and a tunable threshold indicator 314. The relevance determination component 312 may determine both whether the results retrieved for the user input query are relevant and/or whether the number of results produced is sufficient. The relevance determination component 312 may access the tunable threshold indicator 314 to make this determination. For instance, the tunable threshold indicator 314 may store a pre-set threshold number of results, such as ten results, and/or a pre-set threshold of relevance indicator or score. The relevance determination component 312 can evaluate relevance based on trackable relevance factors such as click-through rates. Related techniques exist for determining relevance based on user behavior patterns. The relevance determination component 312 may implement any known technique for determining relevance.
  • [0034]
    If the user input query does not produce results that meet the pre-determined threshold, then the result evaluation mechanism 310 may notify the sub-query determination mechanism to create sub-queries from the input queries. The sub-query determination mechanism 320 parses the user input query into individual sub-queries. The sub-query search mechanism may then search the index 220 or prompt the search engine 200 to search the index 220 for matching results. The results produced may again be evaluated by the result evaluation mechanism 310 before being forwarded to the result output component 340 for output to the user computer 10.
  • [0035]
    The sub-query determination mechanism 320 may additionally supplement its alternative sub-queries by implementing a thesaurus in order to provide synonyms. Often, terms input by the user may be indexed with alternative synonyms. Accordingly, providing a thesaurus within the sub-query determination mechanism 320 may enhance relevance of the results.
  • [0036]
    The result evaluation mechanism 310 may, upon receiving results back for each sub-query, capture the relevance of top results, for instance the top three results, and may additionally count a number of results for the query. The result output component 340 may subsequently show all the sub-queries searched along with the number of results shown or may alternatively show the queries having a relevance index higher than a pre-set threshold.
  • [0037]
    As an example, if the input query is “mini blue ipod”, and the result evaluation mechanism 310, determines that the results produced from this multi-word query are inadequate, the query refinement components 300 may, through the user of the sub-query determination mechanism 320, the sub-query search mechanism 330, and the result output component 340, output alternative queries with the number of results received to the UI. For instance, in response to a user query for “blue mini ipod”, the result output component 340 may output the following:
  • [0038]
    “You can also try “blue ipod”˜50 k results or “Mini Ipod”˜15 k results” in addition to the results for the input query “blue mini ipod”.
  • [0039]
    This example shows alternative sub-queries and the number of results produced by each of the alternative sub-queries. The sub-query determination mechanism 320 parsed the user input query “blue mini ipod” into “blue ipod” and “mini ipod”. The sub-query determination mechanism 320 did not select the phrase “blue mini” as the relevance of the results for this phrase composed of two adjectives would likely be much lower than the relevance for the two above-noted phrases, each including a noun and an adjective.
  • [0040]
    Alternatively, the result output component 340 could produce the alternative sub-query accompanied by a relevance score rather than a number of results or by both a relevance score and a number of results. As suggested above, the values triggering sub-query searching and suggestions may be configurable or tunable. These values may be selected by the search engine and may be set in the tunable threshold indicator 314. In alternative embodiments, the search engine 200 may allow the user to actively tune thresholds. Under conditions of high system load, the query refinement components 300 may be either manually or automatically deactivated. The deactivation option prevents the use of the query refinement components 300 from resulting in unacceptable waiting times for search engine users.
  • [0041]
    The search engine 200 may determine how many people click on various provided selections and tune the threshold based on the number of clicks and the level of relevance. If the users only click on items or results with higher scores, then the system may reset the thresholds based on the clicks. Thus, relevance, as determined by the selected technique, triggers the display of options.
  • [0042]
    The components described above may be utilized in many contexts. In an exemplary context, the query refinement components 300 may be utilized in an online shopping environment. For example, a user may input a query such as “Digital Camera, Price<$200, manufacturer=cannon”. If this query returns an inadequate result set, the query refinement components 300 may be implemented to broaden the query to include, for example, Cannon cameras between 200 and 250 dollars or cameras under 200 dollars manufactured by other companies. The sub-query determination mechanism 320 may implement a system to determine which criteria to relax. In some situations, relaxing the price may yield more results and results having a higher relevance score. In other situations, the brand or other criteria may be the appropriate criteria to relax.
  • [0043]
    FIG. 5 is a flow chart illustrating a method for query refinement in accordance with an embodiment of the invention. The method begins in step 500 and the search engine 200 receives and processes an input user multi-word query in step 502. In step 504, the query refinement components 300 evaluate the results of the processing step. If the results are deemed adequate in step 506, the search engine 200 displays results in step 508. As set forth above, adequacy may be determined based on the quantity, quality, or combination of quantity and quality of results produced.
  • [0044]
    If the results are not deemed adequate in step 506, the query refinement components 300 divide the query into sub-queries in step 510. In step 512, the query refinement components 300 process the sub-query. In step 514, the query refinement components 300 evaluate the results of the sub-query processing and select the appropriate results. In step 516, the search engine 200 displays all selected results and the process ends in step 518.
  • [0045]
    While particular embodiments of the invention have been illustrated and described in detail herein, it should be understood that various changes and modifications might be made to the invention without departing from the scope and intent of the invention. The embodiments described herein are intended in all respects to be illustrative rather than restrictive. Alternate embodiments will become apparent to those skilled in the art to which the present invention pertains without departing from its scope.
  • [0046]
    From the foregoing it will be seen that this invention is one well adapted to attain all the ends and objects set forth above, together with other advantages, which are obvious and inherent to the system and method. It will be understood that certain features and sub-combinations are of utility and may be employed without reference to other features and sub-combinations. This is contemplated and within the scope of the appended claims.

Claims (20)

  1. 1. A method for automatically enhancing initial search results produced by a search engine in response to a multi-word user query, the method comprising:
    implementing a result evaluation mechanism within the search engine for evaluating adequacy of the initial search results;
    formulating at least one alternative query if the initial search results are deemed inadequate by the result evaluation mechanism; and
    displaying result information including the initial search results and a listing of any formulated alternative queries.
  2. 2. The method of claim 1, wherein implementing the result evaluation mechanism comprises evaluation at least one of a quantity and relevance of the initial results.
  3. 3. The method of claim 1, wherein formulating the at least one alternative query comprises formulating at least one sub-query from the multi-word user query.
  4. 4. The method of claim 3, further comprising formulating multiple sub-queries.
  5. 5. The method of claim 4, further comprising determining at least one of a quantity and a relevance of sub-query results.
  6. 6. The method of claim 5, further comprising displaying at least one of the quantity and the relevance of the sub-query results.
  7. 7. The method of claim 1, further comprising formulating the at least one query if the initial search results fall below one of a relevance and quantity threshold.
  8. 8. The method of claim 7, further comprising providing a tunable threshold for triggering the formulation of the at least one alternative query.
  9. 9. The method of claim 1, further comprising eliminating the formulation of alternative queries during high usage periods.
  10. 10. A method for automatically enhancing initial search results produced by a search engine in response to a multi-word user query, the method comprising:
    parsing the multi-word user query into multiple sub-queries;
    determining validity of the multiple sub-queries by determining one of a number of sub-query results and a relevance of sub-query results; and
    displaying the initial search results.
  11. 11. The method of claim 10, further comprising displaying the sub-queries and the determined validity of the sub-queries.
  12. 12. The method of claim 10, further comprising displaying only sub-queries having a determined validity value exceeding a pre-selected threshold value.
  13. 13. The method of claim 10, further comprising evaluating the validity of the initial search results by evaluating one of a quantity and a relevance of the initial search results.
  14. 14. The method of claim 13, further comprising parsing the multi-word query if the initial search results fall below one of a relevance and quantity threshold.
  15. 15. The method of claim 14, further comprising displaying at least one of the quantity and the relevance of the sub-query results.
  16. 16. The method of claim 14, further comprising providing a tunable threshold for triggering the parsing of the multi-word query.
  17. 17. A system for automatically enhancing initial search results produced by a search engine in response to a multi-word user query, the system comprising:
    a result evaluation mechanism within the search engine for evaluating adequacy the initial search results;
    an alternative query determination mechanism for formulating an alternative query if the initial search results are evaluated as inadequate by the result evaluation mechanism; and
    a result output component for outputting the alternative query for display along with the initial search results.
  18. 18. The system of claim 17, wherein the result evaluation mechanism comprises a mechanism for evaluation of at least one of a quantity and relevance of the initial results.
  19. 19. The system of claim 17, wherein the alternative query formulation mechanism formulates at least one sub-query from the multi-word user query.
  20. 20. The system of claim 19, wherein the sub-query evaluation mechanism includes components for determining at least one of a quantity and a relevance of sub-query results.
US11041418 2005-01-25 2005-01-25 System and method for query refinement Abandoned US20060167842A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11041418 US20060167842A1 (en) 2005-01-25 2005-01-25 System and method for query refinement

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US11041418 US20060167842A1 (en) 2005-01-25 2005-01-25 System and method for query refinement
KR20050118195A KR20060085908A (en) 2005-01-25 2005-12-06 System and method for query refinement
EP20050112800 EP1684196A1 (en) 2005-01-25 2005-12-22 System and method for query refinement
CN 200510107383 CN1811763A (en) 2005-01-25 2005-12-26 System and method for query refinement
JP2006010232A JP2006209757A (en) 2005-01-25 2006-01-18 System and method for query refinement

Publications (1)

Publication Number Publication Date
US20060167842A1 true true US20060167842A1 (en) 2006-07-27

Family

ID=36262881

Family Applications (1)

Application Number Title Priority Date Filing Date
US11041418 Abandoned US20060167842A1 (en) 2005-01-25 2005-01-25 System and method for query refinement

Country Status (5)

Country Link
US (1) US20060167842A1 (en)
EP (1) EP1684196A1 (en)
JP (1) JP2006209757A (en)
KR (1) KR20060085908A (en)
CN (1) CN1811763A (en)

Cited By (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040255237A1 (en) * 2003-06-10 2004-12-16 Simon Tong Document search engine including highlighting of confident results
US20060242130A1 (en) * 2005-04-23 2006-10-26 Clenova, Llc Information retrieval using conjunctive search and link discovery
US20070016574A1 (en) * 2005-07-14 2007-01-18 International Business Machines Corporation Merging of results in distributed information retrieval
US20070038615A1 (en) * 2005-08-11 2007-02-15 Vadon Eric R Identifying alternative spellings of search strings by analyzing self-corrective searching behaviors of users
US20070288445A1 (en) * 2006-06-07 2007-12-13 Digital Mandate Llc Methods for enhancing efficiency and cost effectiveness of first pass review of documents
US20080010268A1 (en) * 2006-07-06 2008-01-10 Oracle International Corporation Document ranking with sub-query series
US20080091675A1 (en) * 2006-10-13 2008-04-17 Wilson Chu Methods and apparatuses for modifying a search term utilized to identify an electronic mail message
US20080189273A1 (en) * 2006-06-07 2008-08-07 Digital Mandate, Llc System and method for utilizing advanced search and highlighting techniques for isolating subsets of relevant content data
US20080222134A1 (en) * 2007-03-09 2008-09-11 At&T Knowledge Ventures, Lp System and method of processing database queries
US20090006389A1 (en) * 2003-06-10 2009-01-01 Google Inc. Named url entry
US20090055242A1 (en) * 2007-08-24 2009-02-26 Gaurav Rewari Content identification and classification apparatus, systems, and methods
US20090055368A1 (en) * 2007-08-24 2009-02-26 Gaurav Rewari Content classification and extraction apparatus, systems, and methods
US20090100049A1 (en) * 2006-06-07 2009-04-16 Platformation Technologies, Inc. Methods and Apparatus for Entity Search
US20090157342A1 (en) * 2007-10-29 2009-06-18 China Mobile Communication Corp. Design Institute Method and apparatus of using drive test data for propagation model calibration
US20100049770A1 (en) * 2008-06-26 2010-02-25 Collarity, Inc. Interactions among online digital identities
US20100198802A1 (en) * 2006-06-07 2010-08-05 Renew Data Corp. System and method for optimizing search objects submitted to a data resource
US20100223256A1 (en) * 2009-03-02 2010-09-02 Vikram Chalana Adaptive query throttling system and method
US7809714B1 (en) 2007-04-30 2010-10-05 Lawrence Richard Smith Process for enhancing queries for information retrieval
US20110035403A1 (en) * 2005-12-05 2011-02-10 Emil Ismalon Generation of refinement terms for search queries
US20110040749A1 (en) * 2009-08-13 2011-02-17 Politecnico Di Milano Method for extracting, merging and ranking search engine results
US7962462B1 (en) * 2005-05-31 2011-06-14 Google Inc. Deriving and using document and site quality signals from search query streams
US8065277B1 (en) 2003-01-17 2011-11-22 Daniel John Gardner System and method for a data extraction and backup database
US8069151B1 (en) 2004-12-08 2011-11-29 Chris Crafford System and method for detecting incongruous or incorrect media in a data recovery process
US20120158765A1 (en) * 2010-12-15 2012-06-21 Microsoft Corporation User Interface for Interactive Query Reformulation
WO2012142553A2 (en) * 2011-04-15 2012-10-18 Microsoft Corporation Identifying query formulation suggestions for low-match queries
US20120290969A1 (en) * 2011-05-11 2012-11-15 Abb Technology Ag Multi-stage method and apparatus for interactively locating device data of an automation system
US8370345B2 (en) 2010-04-09 2013-02-05 International Business Machines Corporation Snippet based proximal search
US8375008B1 (en) 2003-01-17 2013-02-12 Robert Gomes Method and system for enterprise-wide retention of digital or electronic data
US8412699B1 (en) * 2009-06-12 2013-04-02 Google Inc. Fresh related search suggestions
US8442972B2 (en) 2006-10-11 2013-05-14 Collarity, Inc. Negative associations for search results ranking and refinement
US20130132418A1 (en) * 2011-11-18 2013-05-23 International Business Machines Corporation Systems, methods and computer program products for discovering a text query from example documents
US20130173662A1 (en) * 2012-01-03 2013-07-04 International Business Machines Corporation Dependency based prioritization of sub-queries and placeholder resolution
US8527468B1 (en) 2005-02-08 2013-09-03 Renew Data Corp. System and method for management of retention periods for content in a computing system
US8615490B1 (en) 2008-01-31 2013-12-24 Renew Data Corp. Method and system for restoring information from backup storage media
US8630984B1 (en) 2003-01-17 2014-01-14 Renew Data Corp. System and method for data extraction from email files
US8655862B1 (en) * 2007-10-17 2014-02-18 Google Inc. System and method for query re-issue in search engines
US8738668B2 (en) 2009-12-16 2014-05-27 Renew Data Corp. System and method for creating a de-duplicated data set
US8782042B1 (en) 2011-10-14 2014-07-15 Firstrain, Inc. Method and system for identifying entities
US8805840B1 (en) 2010-03-23 2014-08-12 Firstrain, Inc. Classification of documents
CN104011713A (en) * 2011-12-28 2014-08-27 乐天株式会社 Search device, searching method, search program and recording medium
US8832070B1 (en) * 2009-01-02 2014-09-09 Google Inc. Pre-computed impression lists
US20140289236A1 (en) * 2013-03-20 2014-09-25 International Business Machines Corporation Refining search results for a compound search query
US8875038B2 (en) 2010-01-19 2014-10-28 Collarity, Inc. Anchoring for content synchronization
US8903810B2 (en) 2005-12-05 2014-12-02 Collarity, Inc. Techniques for ranking search results
US8909627B1 (en) 2011-11-30 2014-12-09 Google Inc. Fake skip evaluation of synonym rules
US8943024B1 (en) 2003-01-17 2015-01-27 Daniel John Gardner System and method for data de-duplication
US8959103B1 (en) * 2012-05-25 2015-02-17 Google Inc. Click or skip evaluation of reordering rules
US8965875B1 (en) 2012-01-03 2015-02-24 Google Inc. Removing substitution rules based on user interactions
US8965882B1 (en) 2011-07-13 2015-02-24 Google Inc. Click or skip evaluation of synonym rules
US20150066594A1 (en) * 2013-08-27 2015-03-05 New York University System, method and computer accessible medium for determining one or more effects of rankings on consumer behavior
US8977613B1 (en) 2012-06-12 2015-03-10 Firstrain, Inc. Generation of recurring searches
US20150161262A1 (en) * 2009-01-30 2015-06-11 Google Inc. Providing remedial search operation based on analysis of user interaction with search results
US9141672B1 (en) 2012-01-25 2015-09-22 Google Inc. Click or skip evaluation of query term optionalization rule
US9146966B1 (en) 2012-10-04 2015-09-29 Google Inc. Click or skip evaluation of proximity rules
US9152698B1 (en) 2012-01-03 2015-10-06 Google Inc. Substitute term identification based on over-represented terms identification
US9251185B2 (en) 2010-12-15 2016-02-02 Girish Kumar Classifying results of search queries
US10002201B2 (en) 2015-09-23 2018-06-19 Google Llc Named URL entry

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6363377B1 (en) * 1998-07-30 2002-03-26 Sarnoff Corporation Search data processor
US20020049752A1 (en) * 1998-03-03 2002-04-25 Dwayne Bowman Identifying the items most relevant to a current query based on items selected in connection with similar queries
US6647383B1 (en) * 2000-09-01 2003-11-11 Lucent Technologies Inc. System and method for providing interactive dialogue and iterative search functions to find information
US20040078251A1 (en) * 2002-10-16 2004-04-22 Demarcken Carl G. Dividing a travel query into sub-queries

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3007375B2 (en) * 1990-04-02 2000-02-07 株式会社リコー Document information retrieval system
JP2792287B2 (en) * 1991-10-31 1998-09-03 日本電気株式会社 Information retrieval system
DE69423838D1 (en) * 1993-09-23 2000-05-11 Xerox Corp Semantic DC event filtering for voice recognition and signal translation applications
JP3521176B2 (en) * 1997-09-26 2004-04-19 株式会社東芝 Search method and search device
JP2002024261A (en) * 2000-07-07 2002-01-25 Denso Corp Information retrieval system
US7206778B2 (en) * 2001-12-17 2007-04-17 Knova Software Inc. Text search ordered along one or more dimensions
EP1353279A1 (en) * 2002-04-12 2003-10-15 Bouygues S.A. Method and system for computer-aided data-driven adaptation of database queries
US7836391B2 (en) * 2003-06-10 2010-11-16 Google Inc. Document search engine including highlighting of confident results

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020049752A1 (en) * 1998-03-03 2002-04-25 Dwayne Bowman Identifying the items most relevant to a current query based on items selected in connection with similar queries
US6363377B1 (en) * 1998-07-30 2002-03-26 Sarnoff Corporation Search data processor
US6647383B1 (en) * 2000-09-01 2003-11-11 Lucent Technologies Inc. System and method for providing interactive dialogue and iterative search functions to find information
US20040078251A1 (en) * 2002-10-16 2004-04-22 Demarcken Carl G. Dividing a travel query into sub-queries

Cited By (88)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8943024B1 (en) 2003-01-17 2015-01-27 Daniel John Gardner System and method for data de-duplication
US8375008B1 (en) 2003-01-17 2013-02-12 Robert Gomes Method and system for enterprise-wide retention of digital or electronic data
US8065277B1 (en) 2003-01-17 2011-11-22 Daniel John Gardner System and method for a data extraction and backup database
US8630984B1 (en) 2003-01-17 2014-01-14 Renew Data Corp. System and method for data extraction from email files
US20090006389A1 (en) * 2003-06-10 2009-01-01 Google Inc. Named url entry
US20040255237A1 (en) * 2003-06-10 2004-12-16 Simon Tong Document search engine including highlighting of confident results
US20110029518A1 (en) * 2003-06-10 2011-02-03 Google Inc. Document search engine including highlighting of confident results
US7836391B2 (en) * 2003-06-10 2010-11-16 Google Inc. Document search engine including highlighting of confident results
US9189548B2 (en) 2003-06-10 2015-11-17 Google Inc. Document search engine including highlighting of confident results
US9256694B2 (en) 2003-06-10 2016-02-09 Google Inc. Named URL entry
US8069151B1 (en) 2004-12-08 2011-11-29 Chris Crafford System and method for detecting incongruous or incorrect media in a data recovery process
US8527468B1 (en) 2005-02-08 2013-09-03 Renew Data Corp. System and method for management of retention periods for content in a computing system
US20060242130A1 (en) * 2005-04-23 2006-10-26 Clenova, Llc Information retrieval using conjunctive search and link discovery
US8818982B1 (en) 2005-05-31 2014-08-26 Google Inc. Deriving and using document and site quality signals from search query streams
US7962462B1 (en) * 2005-05-31 2011-06-14 Google Inc. Deriving and using document and site quality signals from search query streams
US9569504B1 (en) 2005-05-31 2017-02-14 Google Inc. Deriving and using document and site quality signals from search query streams
US7984039B2 (en) * 2005-07-14 2011-07-19 International Business Machines Corporation Merging of results in distributed information retrieval
US20070016574A1 (en) * 2005-07-14 2007-01-18 International Business Machines Corporation Merging of results in distributed information retrieval
US20070038615A1 (en) * 2005-08-11 2007-02-15 Vadon Eric R Identifying alternative spellings of search strings by analyzing self-corrective searching behaviors of users
US7321892B2 (en) * 2005-08-11 2008-01-22 Amazon Technologies, Inc. Identifying alternative spellings of search strings by analyzing self-corrective searching behaviors of users
US8812541B2 (en) 2005-12-05 2014-08-19 Collarity, Inc. Generation of refinement terms for search queries
US8429184B2 (en) 2005-12-05 2013-04-23 Collarity Inc. Generation of refinement terms for search queries
US20110035403A1 (en) * 2005-12-05 2011-02-10 Emil Ismalon Generation of refinement terms for search queries
US8903810B2 (en) 2005-12-05 2014-12-02 Collarity, Inc. Techniques for ranking search results
US20070288445A1 (en) * 2006-06-07 2007-12-13 Digital Mandate Llc Methods for enhancing efficiency and cost effectiveness of first pass review of documents
US20090100049A1 (en) * 2006-06-07 2009-04-16 Platformation Technologies, Inc. Methods and Apparatus for Entity Search
US20080189273A1 (en) * 2006-06-07 2008-08-07 Digital Mandate, Llc System and method for utilizing advanced search and highlighting techniques for isolating subsets of relevant content data
US8150827B2 (en) * 2006-06-07 2012-04-03 Renew Data Corp. Methods for enhancing efficiency and cost effectiveness of first pass review of documents
US20100198802A1 (en) * 2006-06-07 2010-08-05 Renew Data Corp. System and method for optimizing search objects submitted to a data resource
US20080010268A1 (en) * 2006-07-06 2008-01-10 Oracle International Corporation Document ranking with sub-query series
US7849077B2 (en) * 2006-07-06 2010-12-07 Oracle International Corp. Document ranking with sub-query series
US8442972B2 (en) 2006-10-11 2013-05-14 Collarity, Inc. Negative associations for search results ranking and refinement
US20080091675A1 (en) * 2006-10-13 2008-04-17 Wilson Chu Methods and apparatuses for modifying a search term utilized to identify an electronic mail message
US9721014B2 (en) 2007-03-09 2017-08-01 Google Inc. System and method of processing database queries
US8768961B2 (en) * 2007-03-09 2014-07-01 At&T Labs, Inc. System and method of processing database queries
US20080222134A1 (en) * 2007-03-09 2008-09-11 At&T Knowledge Ventures, Lp System and method of processing database queries
US7809714B1 (en) 2007-04-30 2010-10-05 Lawrence Richard Smith Process for enhancing queries for information retrieval
US20090055242A1 (en) * 2007-08-24 2009-02-26 Gaurav Rewari Content identification and classification apparatus, systems, and methods
US20090055368A1 (en) * 2007-08-24 2009-02-26 Gaurav Rewari Content classification and extraction apparatus, systems, and methods
US9116993B2 (en) 2007-10-17 2015-08-25 Google Inc. System and method for query re-issue in search engines
US8655862B1 (en) * 2007-10-17 2014-02-18 Google Inc. System and method for query re-issue in search engines
US20090157342A1 (en) * 2007-10-29 2009-06-18 China Mobile Communication Corp. Design Institute Method and apparatus of using drive test data for propagation model calibration
US8615490B1 (en) 2008-01-31 2013-12-24 Renew Data Corp. Method and system for restoring information from backup storage media
US8438178B2 (en) 2008-06-26 2013-05-07 Collarity Inc. Interactions among online digital identities
US20100049770A1 (en) * 2008-06-26 2010-02-25 Collarity, Inc. Interactions among online digital identities
US8832070B1 (en) * 2009-01-02 2014-09-09 Google Inc. Pre-computed impression lists
US20150161262A1 (en) * 2009-01-30 2015-06-11 Google Inc. Providing remedial search operation based on analysis of user interaction with search results
US9922122B2 (en) * 2009-01-30 2018-03-20 Google Llc Providing remedial search operation based on analysis of user interaction with search results
US20100223256A1 (en) * 2009-03-02 2010-09-02 Vikram Chalana Adaptive query throttling system and method
US8321447B2 (en) * 2009-03-02 2012-11-27 Winshuttle, Llc Adaptive query throttling system and method
US8782071B1 (en) 2009-06-12 2014-07-15 Google Inc. Fresh related search suggestions
US8412699B1 (en) * 2009-06-12 2013-04-02 Google Inc. Fresh related search suggestions
US20110040749A1 (en) * 2009-08-13 2011-02-17 Politecnico Di Milano Method for extracting, merging and ranking search engine results
US8180768B2 (en) * 2009-08-13 2012-05-15 Politecnico Di Milano Method for extracting, merging and ranking search engine results
US8738668B2 (en) 2009-12-16 2014-05-27 Renew Data Corp. System and method for creating a de-duplicated data set
US8875038B2 (en) 2010-01-19 2014-10-28 Collarity, Inc. Anchoring for content synchronization
US9760634B1 (en) 2010-03-23 2017-09-12 Firstrain, Inc. Models for classifying documents
US8805840B1 (en) 2010-03-23 2014-08-12 Firstrain, Inc. Classification of documents
US8370345B2 (en) 2010-04-09 2013-02-05 International Business Machines Corporation Snippet based proximal search
US20120158765A1 (en) * 2010-12-15 2012-06-21 Microsoft Corporation User Interface for Interactive Query Reformulation
US9251185B2 (en) 2010-12-15 2016-02-02 Girish Kumar Classifying results of search queries
CN102567475A (en) * 2010-12-15 2012-07-11 微软公司 User interface for interactive query reformulation
WO2012142553A3 (en) * 2011-04-15 2012-12-06 Microsoft Corporation Identifying query formulation suggestions for low-match queries
WO2012142553A2 (en) * 2011-04-15 2012-10-18 Microsoft Corporation Identifying query formulation suggestions for low-match queries
US8983995B2 (en) 2011-04-15 2015-03-17 Microsoft Corporation Interactive semantic query suggestion for content search
US20120265784A1 (en) * 2011-04-15 2012-10-18 Microsoft Corporation Ordering semantic query formulation suggestions
US8965872B2 (en) 2011-04-15 2015-02-24 Microsoft Technology Licensing, Llc Identifying query formulation suggestions for low-match queries
US20120290969A1 (en) * 2011-05-11 2012-11-15 Abb Technology Ag Multi-stage method and apparatus for interactively locating device data of an automation system
US8965882B1 (en) 2011-07-13 2015-02-24 Google Inc. Click or skip evaluation of synonym rules
US9965508B1 (en) 2011-10-14 2018-05-08 Ignite Firstrain Solutions, Inc. Method and system for identifying entities
US8782042B1 (en) 2011-10-14 2014-07-15 Firstrain, Inc. Method and system for identifying entities
US20130132418A1 (en) * 2011-11-18 2013-05-23 International Business Machines Corporation Systems, methods and computer program products for discovering a text query from example documents
US8862605B2 (en) * 2011-11-18 2014-10-14 International Business Machines Corporation Systems, methods and computer program products for discovering a text query from example documents
US8909627B1 (en) 2011-11-30 2014-12-09 Google Inc. Fake skip evaluation of synonym rules
CN104011713A (en) * 2011-12-28 2014-08-27 乐天株式会社 Search device, searching method, search program and recording medium
US20150161208A1 (en) * 2011-12-28 2015-06-11 Rakuten, Inc. Search apparatus, search method, search program, and recording medium
US20130173662A1 (en) * 2012-01-03 2013-07-04 International Business Machines Corporation Dependency based prioritization of sub-queries and placeholder resolution
US9152698B1 (en) 2012-01-03 2015-10-06 Google Inc. Substitute term identification based on over-represented terms identification
US8965875B1 (en) 2012-01-03 2015-02-24 Google Inc. Removing substitution rules based on user interactions
US9141672B1 (en) 2012-01-25 2015-09-22 Google Inc. Click or skip evaluation of query term optionalization rule
US8959103B1 (en) * 2012-05-25 2015-02-17 Google Inc. Click or skip evaluation of reordering rules
US8977613B1 (en) 2012-06-12 2015-03-10 Firstrain, Inc. Generation of recurring searches
US9292505B1 (en) 2012-06-12 2016-03-22 Firstrain, Inc. Graphical user interface for recurring searches
US9146966B1 (en) 2012-10-04 2015-09-29 Google Inc. Click or skip evaluation of proximity rules
US20140289236A1 (en) * 2013-03-20 2014-09-25 International Business Machines Corporation Refining search results for a compound search query
US9519703B2 (en) * 2013-03-20 2016-12-13 International Business Machines Corporation Refining search results for a compound search query
US20150066594A1 (en) * 2013-08-27 2015-03-05 New York University System, method and computer accessible medium for determining one or more effects of rankings on consumer behavior
US10002201B2 (en) 2015-09-23 2018-06-19 Google Llc Named URL entry

Also Published As

Publication number Publication date Type
JP2006209757A (en) 2006-08-10 application
EP1684196A1 (en) 2006-07-26 application
KR20060085908A (en) 2006-07-28 application
CN1811763A (en) 2006-08-02 application

Similar Documents

Publication Publication Date Title
US6741984B2 (en) Method, system and storage medium for arranging a database
US6473752B1 (en) Method and system for locating documents based on previously accessed documents
US20080140643A1 (en) Negative associations for search results ranking and refinement
US7398201B2 (en) Method and system for enhanced data searching
US20100077001A1 (en) Search system and method for serendipitous discoveries with faceted full-text classification
US20020040311A1 (en) Web browser page rating system
US7266553B1 (en) Content data indexing
US20110040749A1 (en) Method for extracting, merging and ranking search engine results
US20070198480A1 (en) Query language
US6792419B1 (en) System and method for ranking hyperlinked documents based on a stochastic backoff processes
US7917528B1 (en) Contextual display of query refinements
US20070244863A1 (en) Systems and methods for performing searches within vertical domains
US20070055652A1 (en) Speculative search result for a search query
US7389224B1 (en) Natural language search method and apparatus, including linguistically-matching context data
US20110119243A1 (en) Keyword-based search engine results using enhanced query strategies
US20070073708A1 (en) Generation of topical subjects from alert search terms
US7676462B2 (en) Method, apparatus, and program for refining search criteria through focusing word definition
US8150859B2 (en) Semantic table of contents for search results
US20080016034A1 (en) Search equalizer
US20110072033A1 (en) Suggesting related search queries during web browsing
US20120130978A1 (en) Query suggestions from documents
US20090024605A1 (en) Method and system for user and reference ranking in a database
US20100131563A1 (en) System and methods for automatic clustering of ranked and categorized search objects
US20070118512A1 (en) Inferring search category synonyms from user logs
US20070005588A1 (en) Determining relevance using queries as surrogate content

Legal Events

Date Code Title Description
AS Assignment

Owner name: MICROSOFT CORPORATION, WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WATSON, ERIC B.;REEL/FRAME:016223/0168

Effective date: 20050113

AS Assignment

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034766/0001

Effective date: 20141014