CA2764157A1 - Searching methods and devices - Google Patents

Searching methods and devices Download PDF

Info

Publication number
CA2764157A1
CA2764157A1 CA2764157A CA2764157A CA2764157A1 CA 2764157 A1 CA2764157 A1 CA 2764157A1 CA 2764157 A CA2764157 A CA 2764157A CA 2764157 A CA2764157 A CA 2764157A CA 2764157 A1 CA2764157 A1 CA 2764157A1
Authority
CA
Canada
Prior art keywords
value
user
instance
data processing
correction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA2764157A
Other languages
French (fr)
Inventor
John J. Lee
Andrew William Hogue
Daniel N. Quine
Andriy Bihun
Daniel Loreto
Randolph G. Brown
Yohann R. Coppel
John Alexander Komoroske
Craig Nevill-Manning
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US12/476,110 priority Critical
Priority to US12/476,110 priority patent/US20100306223A1/en
Priority to US12/608,395 priority patent/US20110106819A1/en
Priority to US12/608,395 priority
Application filed by Google LLC filed Critical Google LLC
Priority to PCT/US2010/036949 priority patent/WO2010141502A2/en
Publication of CA2764157A1 publication Critical patent/CA2764157A1/en
Application status is Abandoned legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3325Reformulation based on results of preceding query
    • G06F16/3326Reformulation based on results of preceding query using relevance feedback from the user, e.g. relevance feedback on documents, documents sets, document terms or passages
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for improving search with user corrections. In one aspect, a methods performed by a data processing apparatus include the actions of receiving a value result set, accessing historical records of user corrections stored at one or more data storage devices, the historical records describing user corrections of the characterization of instance attributes by values, determining that the historical records of user corrections describe a first user correction involving a first value in the value result set, and changing a confidence parameter embodying a confidence that the first value correctly characterizes the attribute of the instance.
The value result set comprises a collection of one or more values. The values are candidates for characterizing an attribute of an instance. The first value is involved in the correction as either a corrected value or an uncorrected value.

Claims (24)

1. A method performed by one or more data processing apparatus, the method comprising:
receiving a value result set at the data processing apparatus, the value result set comprising a collection of one or more values, the values being candidates for characterizing an attribute of an instance;
accessing historical records of user corrections stored at one or more data storage devices, the historical records describing user corrections of the characterization of instance attributes by values;
determining that the historical records of user corrections describe a first user correction involving a first value in the value result set, wherein the first value is involved in the correction as either a corrected value or an uncorrected value; and changing a confidence parameter embodying a confidence that the first value correctly characterizes the attribute of the instance.
2. The method of claim 1, further comprising:
ranking the values in the value result set according to the changed confidence parameter; and visually displaying at least a portion of the value result set on a display screen according to the ranking.
3. The method of claim 2, wherein:
visually displaying at least the portion of the value result set comprises presenting a structured presentation to a user;
the structured presentation is populated with a first value included in the value result set; and the first value has a confidence parameter indicating that the first value is the value in the value result set that is most likely to correctly characterize the instance attribute.
4. The method of claim 2, wherein visually displaying at least a portion of the value result set comprises displaying a candidate window that includes candidate values for characterizing an instance attribute.
5. The method of claim 1, wherein changing the confidence parameter comprises applying a delta value suitable to a scaled confidence rating, the scaled confidence rating embodying the confidence that the involved value correctly characterizes the attribute of the instance.
6. The method of claim 5, wherein generating the delta value comprises weighting a category of a user correction of the involved value.
7. The method of claim 5, wherein generating the delta value comprises categorizing the user correction.
8. A computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations, the operations comprising:
receiving a description of a user correction involving a value characterizing an instance attribute, wherein the value is involved in the correction as either a corrected value or an uncorrected value;
changing a confidence parameter reflecting the likelihood that the value correctly characterizes the instance attribute; and ranking a collection of candidate values that includes the value according to respective confidence parameters, including the changed a confidence parameter.
9. The computer storage medium of claim 8, wherein the operations further comprise transmitting a description of the ranked collection of candidate values over a data communication network in response to receipt of a search query, the response to which includes an attribute value for an instance.
10. The computer storage medium of claim 8, wherein receiving the description of the user correction comprises receiving a description of whether that the user confirmed the correction with a source.
11. The computer storage medium of claim 8, wherein receiving the description of the user correction comprises receiving a description that the user did not change an uncorrected value after reviewing an electronic document.
12. The computer storage medium of claim 8, wherein receiving the description of the user correction comprises receiving a description of the uncorrected value prior to the user correction and the corrected value after the user correction.
13. The computer storage medium of claim 8, wherein changing the confidence parameter comprises:
categorizing the user correction; and weighting the impact of the user correction on the confidence parameter according to the categorization of the user correction.
14. The computer storage medium of claim 13, wherein weighting the impact of the user correction comprises weighting user corrections made after confirmation from a source more heavily than user corrections made without confirmation from a source.
15. The computer storage medium of claim 13, wherein weighting the impact of the user correction comprises weighting more recent user corrections more heavily than earlier user corrections.
16. The computer storage medium of claim 8, wherein changing the confidence parameter comprises changing the confidence parameter reflecting the likelihood that an corrected value correctly characterizes the instance attribute.
17. A system comprising:
a client device comprising an input device, a display screen, and a digital data processing device operable to display, on the display screen, characterizations of instance attributes by values and to receive, over the input device, user input correcting characterizations of instance attributes;
a correction tracker operable to interact with the client to track the user input correcting the characterizations of the instance attributes and to store descriptions of the user input in records of the user correction history;
one or more data storage devices storing the records of the user correction history; and a search engine operable to interact with the one or more data storage devices to access the records of the user correction history and to change a confidence that a first value correctly characterizes a first instance attribute in response to identifying a record describing a user correction correcting the characterization of the first instance attribute.
18. The system of claim 17, wherein the display screen displays a structured presentation under the direction of the digital data processing device, the structured presentation associating instance attributes with values.
19. The system of claim 18, wherein the structured presentation comprises interactive elements selectable by a user to identify an instance attribute whose characterization by a value is to be corrected.
20. The system of claim 19, wherein the interactive elements comprise cells of the structured presentation.
21. The system of claim 18, wherein the structured presentation comprises a deck of cards.
22. The system of claim 17, wherein the display screen displays a candidate window under the direction of the digital data processing device, the candidate window presenting candidate corrected values for replacing an uncorrected value characterizing an instance attribute.
23. A method performed by one or more data processing apparatus, the method comprising:
the data processing apparatus receiving a search query at a data processing apparatus, the search query specifying attributes shared by a group of related instances;
the data processing apparatus identifying groups of instance identifiers in an unstructured collection of electronic documents with the data processing apparatus;
the data processing apparatus determining relevance of the groups of instance identifiers to the search query with the data processing apparatus;
the data processing apparatus scoring at least some of the instance identifiers in the groups of instance identifiers individually with the data processing apparatus; and the data processing apparatus ranking the at least some instance identifiers according to the scores with the data processing apparatus.
24. A system comprising:
a client device; and one or more computers programmed to interact with the client device and the data storage device, the computers programmed to perform operations comprising:
receiving a search query from the client device, the search query explicitly or implicitly specifying attributes of instances;
searching an electronic document collection to identify identifiers of instances that may have the attributes specified by the search query;
representing features of the search of the electronic document collection in a vertex-edge graph;
scoring the instance identifiers that may have the attributes specified by the search query according to the features represented in the vertex-edge graph;
and outputting, to the client device, instructions for visually presenting at least some of the instance identifiers.
CA2764157A 2009-06-01 2010-06-01 Searching methods and devices Abandoned CA2764157A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US12/476,110 2009-06-01
US12/476,110 US20100306223A1 (en) 2009-06-01 2009-06-01 Rankings in Search Results with User Corrections
US12/608,395 US20110106819A1 (en) 2009-10-29 2009-10-29 Identifying a group of related instances
US12/608,395 2009-10-29
PCT/US2010/036949 WO2010141502A2 (en) 2009-06-01 2010-06-01 Searching methods and devices

Publications (1)

Publication Number Publication Date
CA2764157A1 true CA2764157A1 (en) 2010-12-09

Family

ID=43298451

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2764157A Abandoned CA2764157A1 (en) 2009-06-01 2010-06-01 Searching methods and devices

Country Status (6)

Country Link
EP (1) EP2438544A2 (en)
KR (1) KR20120038418A (en)
CN (1) CN102460440B (en)
AU (1) AU2010256777A1 (en)
CA (1) CA2764157A1 (en)
WO (1) WO2010141502A2 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10108700B2 (en) * 2013-03-15 2018-10-23 Google Llc Question answering to populate knowledge base
US10255319B2 (en) * 2014-05-02 2019-04-09 Google Llc Searchable index
CN107544972A (en) * 2016-06-23 2018-01-05 腾讯科技(深圳)有限公司 Map editing method and device

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FI946209A0 (en) * 1994-12-30 1994-12-30 Nokia Telecommunications Oy Foerfarande Foer jaemfoerande of attributvaerden hos kontrollerbara objektuttryck in a naetelement
AU769236B2 (en) * 1999-09-15 2004-01-22 Siemens Corporate Research, Inc. Method and system for selecting and automatically updating arbitrary elements from structured documents
US6687696B2 (en) * 2000-07-26 2004-02-03 Recommind Inc. System and method for personalized search, information filtering, and for generating recommendations utilizing statistical latent class models
US20040006559A1 (en) * 2002-05-29 2004-01-08 Gange David M. System, apparatus, and method for user tunable and selectable searching of a database using a weigthted quantized feature vector
US6944612B2 (en) * 2002-11-13 2005-09-13 Xerox Corporation Structured contextual clustering method and system in a federated search engine
US7624143B2 (en) * 2002-12-12 2009-11-24 Xerox Corporation Methods, apparatus, and program products for utilizing contextual property metadata in networked computing environments
US20050076015A1 (en) * 2003-10-02 2005-04-07 International Business Machines Corporation Dynamic query building based on the desired number of results
US7752194B2 (en) * 2007-05-31 2010-07-06 Red Hat, Inc. LDAP revision history

Also Published As

Publication number Publication date
WO2010141502A2 (en) 2010-12-09
AU2010256777A1 (en) 2011-12-22
CN102460440A (en) 2012-05-16
WO2010141502A3 (en) 2011-03-24
KR20120038418A (en) 2012-04-23
CN102460440B (en) 2014-10-08
EP2438544A2 (en) 2012-04-11

Similar Documents

Publication Publication Date Title
TW200926044A (en) Automated most popular media asset creation
WO2008085809A3 (en) Method, system and computer program product for enforcing privacy policies
MXPA05005428A (en) Search engine spam detection using external data.
MX2013012859A (en) Method, computer program, reception apparatus, and information providing apparatus for trigger compaction.
WO2009032780A3 (en) Method and system for efficiently storing data files
GB2477681A (en) Secure document managment
WO2011059291A3 (en) Method and apparatus for transmitting and receiving data
WO2014131029A3 (en) Context aware actions among heterogeneous internet of things (iot) devices
WO2011094454A3 (en) Apparatus, system, and method for determining a read voltage threshold for solid-state storage media
WO2012129149A3 (en) Aggregating search results based on associating data instances with knowledge base entities
WO2009064656A3 (en) Borehole survey method and apparatus
WO2011163065A3 (en) Customizing a search experience using images
WO2007106858A3 (en) System, method, and computer program product for data mining and automatically generating hypotheses from data repositories
WO2011094760A3 (en) Geometric correction of rough wireframe models derived from photographs
WO2011116296A3 (en) Systems and methods to enhance search data with transaction based data
WO2012012396A3 (en) Predictive query suggestion caching
WO2009052189A3 (en) External referencing by portable program modules
WO2009143322A3 (en) Methods and systems for single sign on with dynamic authentication levels
WO2012037578A3 (en) Sales prediction and recommendation system
WO2012030793A3 (en) Providing results to parameterless search queries
WO2011059275A3 (en) Method and apparatus for managing data
NZ552356A (en) Method and apparatus for searching rights objects stored in portable stored device using object location data
RU2013108254A (en) Getting the keywords to search for
WO2012078659A9 (en) Correlating user interactions with interfaces
CA2779289A1 (en) Computer-to-computer communication

Legal Events

Date Code Title Description
FZDE Dead

Effective date: 20160601