CA2764157A1 - Searching methods and devices - Google Patents
Searching methods and devices Download PDFInfo
- Publication number
- CA2764157A1 CA2764157A1 CA2764157A CA2764157A CA2764157A1 CA 2764157 A1 CA2764157 A1 CA 2764157A1 CA 2764157 A CA2764157 A CA 2764157A CA 2764157 A CA2764157 A CA 2764157A CA 2764157 A1 CA2764157 A1 CA 2764157A1
- Authority
- CA
- Canada
- Prior art keywords
- value
- user
- instance
- data processing
- processing apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3325—Reformulation based on results of preceding query
- G06F16/3326—Reformulation based on results of preceding query using relevance feedback from the user, e.g. relevance feedback on documents, documents sets, document terms or passages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
Abstract
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for improving search with user corrections. In one aspect, a methods performed by a data processing apparatus include the actions of receiving a value result set, accessing historical records of user corrections stored at one or more data storage devices, the historical records describing user corrections of the characterization of instance attributes by values, determining that the historical records of user corrections describe a first user correction involving a first value in the value result set, and changing a confidence parameter embodying a confidence that the first value correctly characterizes the attribute of the instance.
The value result set comprises a collection of one or more values. The values are candidates for characterizing an attribute of an instance. The first value is involved in the correction as either a corrected value or an uncorrected value.
The value result set comprises a collection of one or more values. The values are candidates for characterizing an attribute of an instance. The first value is involved in the correction as either a corrected value or an uncorrected value.
Claims (24)
1. A method performed by one or more data processing apparatus, the method comprising:
receiving a value result set at the data processing apparatus, the value result set comprising a collection of one or more values, the values being candidates for characterizing an attribute of an instance;
accessing historical records of user corrections stored at one or more data storage devices, the historical records describing user corrections of the characterization of instance attributes by values;
determining that the historical records of user corrections describe a first user correction involving a first value in the value result set, wherein the first value is involved in the correction as either a corrected value or an uncorrected value; and changing a confidence parameter embodying a confidence that the first value correctly characterizes the attribute of the instance.
receiving a value result set at the data processing apparatus, the value result set comprising a collection of one or more values, the values being candidates for characterizing an attribute of an instance;
accessing historical records of user corrections stored at one or more data storage devices, the historical records describing user corrections of the characterization of instance attributes by values;
determining that the historical records of user corrections describe a first user correction involving a first value in the value result set, wherein the first value is involved in the correction as either a corrected value or an uncorrected value; and changing a confidence parameter embodying a confidence that the first value correctly characterizes the attribute of the instance.
2. The method of claim 1, further comprising:
ranking the values in the value result set according to the changed confidence parameter; and visually displaying at least a portion of the value result set on a display screen according to the ranking.
ranking the values in the value result set according to the changed confidence parameter; and visually displaying at least a portion of the value result set on a display screen according to the ranking.
3. The method of claim 2, wherein:
visually displaying at least the portion of the value result set comprises presenting a structured presentation to a user;
the structured presentation is populated with a first value included in the value result set; and the first value has a confidence parameter indicating that the first value is the value in the value result set that is most likely to correctly characterize the instance attribute.
visually displaying at least the portion of the value result set comprises presenting a structured presentation to a user;
the structured presentation is populated with a first value included in the value result set; and the first value has a confidence parameter indicating that the first value is the value in the value result set that is most likely to correctly characterize the instance attribute.
4. The method of claim 2, wherein visually displaying at least a portion of the value result set comprises displaying a candidate window that includes candidate values for characterizing an instance attribute.
5. The method of claim 1, wherein changing the confidence parameter comprises applying a delta value suitable to a scaled confidence rating, the scaled confidence rating embodying the confidence that the involved value correctly characterizes the attribute of the instance.
6. The method of claim 5, wherein generating the delta value comprises weighting a category of a user correction of the involved value.
7. The method of claim 5, wherein generating the delta value comprises categorizing the user correction.
8. A computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations, the operations comprising:
receiving a description of a user correction involving a value characterizing an instance attribute, wherein the value is involved in the correction as either a corrected value or an uncorrected value;
changing a confidence parameter reflecting the likelihood that the value correctly characterizes the instance attribute; and ranking a collection of candidate values that includes the value according to respective confidence parameters, including the changed a confidence parameter.
receiving a description of a user correction involving a value characterizing an instance attribute, wherein the value is involved in the correction as either a corrected value or an uncorrected value;
changing a confidence parameter reflecting the likelihood that the value correctly characterizes the instance attribute; and ranking a collection of candidate values that includes the value according to respective confidence parameters, including the changed a confidence parameter.
9. The computer storage medium of claim 8, wherein the operations further comprise transmitting a description of the ranked collection of candidate values over a data communication network in response to receipt of a search query, the response to which includes an attribute value for an instance.
10. The computer storage medium of claim 8, wherein receiving the description of the user correction comprises receiving a description of whether that the user confirmed the correction with a source.
11. The computer storage medium of claim 8, wherein receiving the description of the user correction comprises receiving a description that the user did not change an uncorrected value after reviewing an electronic document.
12. The computer storage medium of claim 8, wherein receiving the description of the user correction comprises receiving a description of the uncorrected value prior to the user correction and the corrected value after the user correction.
13. The computer storage medium of claim 8, wherein changing the confidence parameter comprises:
categorizing the user correction; and weighting the impact of the user correction on the confidence parameter according to the categorization of the user correction.
categorizing the user correction; and weighting the impact of the user correction on the confidence parameter according to the categorization of the user correction.
14. The computer storage medium of claim 13, wherein weighting the impact of the user correction comprises weighting user corrections made after confirmation from a source more heavily than user corrections made without confirmation from a source.
15. The computer storage medium of claim 13, wherein weighting the impact of the user correction comprises weighting more recent user corrections more heavily than earlier user corrections.
16. The computer storage medium of claim 8, wherein changing the confidence parameter comprises changing the confidence parameter reflecting the likelihood that an corrected value correctly characterizes the instance attribute.
17. A system comprising:
a client device comprising an input device, a display screen, and a digital data processing device operable to display, on the display screen, characterizations of instance attributes by values and to receive, over the input device, user input correcting characterizations of instance attributes;
a correction tracker operable to interact with the client to track the user input correcting the characterizations of the instance attributes and to store descriptions of the user input in records of the user correction history;
one or more data storage devices storing the records of the user correction history; and a search engine operable to interact with the one or more data storage devices to access the records of the user correction history and to change a confidence that a first value correctly characterizes a first instance attribute in response to identifying a record describing a user correction correcting the characterization of the first instance attribute.
a client device comprising an input device, a display screen, and a digital data processing device operable to display, on the display screen, characterizations of instance attributes by values and to receive, over the input device, user input correcting characterizations of instance attributes;
a correction tracker operable to interact with the client to track the user input correcting the characterizations of the instance attributes and to store descriptions of the user input in records of the user correction history;
one or more data storage devices storing the records of the user correction history; and a search engine operable to interact with the one or more data storage devices to access the records of the user correction history and to change a confidence that a first value correctly characterizes a first instance attribute in response to identifying a record describing a user correction correcting the characterization of the first instance attribute.
18. The system of claim 17, wherein the display screen displays a structured presentation under the direction of the digital data processing device, the structured presentation associating instance attributes with values.
19. The system of claim 18, wherein the structured presentation comprises interactive elements selectable by a user to identify an instance attribute whose characterization by a value is to be corrected.
20. The system of claim 19, wherein the interactive elements comprise cells of the structured presentation.
21. The system of claim 18, wherein the structured presentation comprises a deck of cards.
22. The system of claim 17, wherein the display screen displays a candidate window under the direction of the digital data processing device, the candidate window presenting candidate corrected values for replacing an uncorrected value characterizing an instance attribute.
23. A method performed by one or more data processing apparatus, the method comprising:
the data processing apparatus receiving a search query at a data processing apparatus, the search query specifying attributes shared by a group of related instances;
the data processing apparatus identifying groups of instance identifiers in an unstructured collection of electronic documents with the data processing apparatus;
the data processing apparatus determining relevance of the groups of instance identifiers to the search query with the data processing apparatus;
the data processing apparatus scoring at least some of the instance identifiers in the groups of instance identifiers individually with the data processing apparatus; and the data processing apparatus ranking the at least some instance identifiers according to the scores with the data processing apparatus.
the data processing apparatus receiving a search query at a data processing apparatus, the search query specifying attributes shared by a group of related instances;
the data processing apparatus identifying groups of instance identifiers in an unstructured collection of electronic documents with the data processing apparatus;
the data processing apparatus determining relevance of the groups of instance identifiers to the search query with the data processing apparatus;
the data processing apparatus scoring at least some of the instance identifiers in the groups of instance identifiers individually with the data processing apparatus; and the data processing apparatus ranking the at least some instance identifiers according to the scores with the data processing apparatus.
24. A system comprising:
a client device; and one or more computers programmed to interact with the client device and the data storage device, the computers programmed to perform operations comprising:
receiving a search query from the client device, the search query explicitly or implicitly specifying attributes of instances;
searching an electronic document collection to identify identifiers of instances that may have the attributes specified by the search query;
representing features of the search of the electronic document collection in a vertex-edge graph;
scoring the instance identifiers that may have the attributes specified by the search query according to the features represented in the vertex-edge graph;
and outputting, to the client device, instructions for visually presenting at least some of the instance identifiers.
a client device; and one or more computers programmed to interact with the client device and the data storage device, the computers programmed to perform operations comprising:
receiving a search query from the client device, the search query explicitly or implicitly specifying attributes of instances;
searching an electronic document collection to identify identifiers of instances that may have the attributes specified by the search query;
representing features of the search of the electronic document collection in a vertex-edge graph;
scoring the instance identifiers that may have the attributes specified by the search query according to the features represented in the vertex-edge graph;
and outputting, to the client device, instructions for visually presenting at least some of the instance identifiers.
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/476,110 US20100306223A1 (en) | 2009-06-01 | 2009-06-01 | Rankings in Search Results with User Corrections |
| US12/476,110 | 2009-06-01 | ||
| US12/608,395 US20110106819A1 (en) | 2009-10-29 | 2009-10-29 | Identifying a group of related instances |
| US12/608,395 | 2009-10-29 | ||
| PCT/US2010/036949 WO2010141502A2 (en) | 2009-06-01 | 2010-06-01 | Searching methods and devices |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2764157A1 true CA2764157A1 (en) | 2010-12-09 |
Family
ID=43298451
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2764157A Abandoned CA2764157A1 (en) | 2009-06-01 | 2010-06-01 | Searching methods and devices |
Country Status (6)
| Country | Link |
|---|---|
| EP (1) | EP2438544A2 (en) |
| KR (1) | KR20120038418A (en) |
| CN (1) | CN102460440B (en) |
| AU (1) | AU2010256777A1 (en) |
| CA (1) | CA2764157A1 (en) |
| WO (1) | WO2010141502A2 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10108700B2 (en) * | 2013-03-15 | 2018-10-23 | Google Llc | Question answering to populate knowledge base |
| US10255319B2 (en) * | 2014-05-02 | 2019-04-09 | Google Llc | Searchable index |
| CN107544972B (en) * | 2016-06-23 | 2019-09-13 | 腾讯科技（深圳）有限公司 | Map edit method and apparatus |
| CN110427553B (en) * | 2019-07-26 | 2022-05-17 | 百度在线网络技术（北京）有限公司 | Searching method and device for intelligent sound box, server and storage medium |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FI946209A0 (en) * | 1994-12-30 | 1994-12-30 | Nokia Telecommunications Oy | Foerfarande Foer jaemfoerande av attributvaerden hos kontrollerbara objektuttryck i ett naetelement |
| EP1221078A1 (en) * | 1999-09-15 | 2002-07-10 | Siemens Corporate Research, Inc. | Method and system for selecting and automatically updating arbitrary elements from structured documents |
| US6687696B2 (en) * | 2000-07-26 | 2004-02-03 | Recommind Inc. | System and method for personalized search, information filtering, and for generating recommendations utilizing statistical latent class models |
| US20040006559A1 (en) * | 2002-05-29 | 2004-01-08 | Gange David M. | System, apparatus, and method for user tunable and selectable searching of a database using a weigthted quantized feature vector |
| US6944612B2 (en) * | 2002-11-13 | 2005-09-13 | Xerox Corporation | Structured contextual clustering method and system in a federated search engine |
| US7624143B2 (en) * | 2002-12-12 | 2009-11-24 | Xerox Corporation | Methods, apparatus, and program products for utilizing contextual property metadata in networked computing environments |
| US20050076015A1 (en) * | 2003-10-02 | 2005-04-07 | International Business Machines Corporation | Dynamic query building based on the desired number of results |
| US7752194B2 (en) * | 2007-05-31 | 2010-07-06 | Red Hat, Inc. | LDAP revision history |
-
2010
- 2010-06-01 KR KR1020117031688A patent/KR20120038418A/en not_active Application Discontinuation
- 2010-06-01 EP EP10783951A patent/EP2438544A2/en not_active Withdrawn
- 2010-06-01 CA CA2764157A patent/CA2764157A1/en not_active Abandoned
- 2010-06-01 CN CN201080034010.7A patent/CN102460440B/en not_active Expired - Fee Related
- 2010-06-01 WO PCT/US2010/036949 patent/WO2010141502A2/en active Application Filing
- 2010-06-01 AU AU2010256777A patent/AU2010256777A1/en not_active Abandoned
Also Published As
| Publication number | Publication date |
|---|---|
| WO2010141502A3 (en) | 2011-03-24 |
| CN102460440A (en) | 2012-05-16 |
| CN102460440B (en) | 2014-10-08 |
| AU2010256777A1 (en) | 2011-12-22 |
| WO2010141502A2 (en) | 2010-12-09 |
| KR20120038418A (en) | 2012-04-23 |
| EP2438544A2 (en) | 2012-04-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2018201624B2 (en) | Relevance-based image selection | |
| US9355168B1 (en) | Topic based user profiles | |
| US8965891B1 (en) | Training scoring models optimized for highly-ranked results | |
| US9176988B2 (en) | Image relevance model | |
| JP5801291B2 (en) | Merging search results | |
| US11500954B2 (en) | Learning-to-rank method based on reinforcement learning and server | |
| US9589277B2 (en) | Search service advertisement selection | |
| US20190012392A1 (en) | Method and device for pushing information | |
| US9152702B2 (en) | System and method for selecting search results facets | |
| US20150161482A1 (en) | Refining image relevance models | |
| US20140372349A1 (en) | Method of machine learning classes of search queries | |
| US8189963B2 (en) | Matching advertisements to visual media objects | |
| US11169989B1 (en) | Ranking modifications of a previous query | |
| US20120150850A1 (en) | Search result relevance by determining query intent | |
| US9836554B2 (en) | Method and system for providing query suggestions including entities | |
| US20120330962A1 (en) | Method and Apparatus of Providing Suggested Terms | |
| US8918404B1 (en) | Displaying content in a user interface in a social network system | |
| US20200201915A1 (en) | Ranking image search results using machine learning models | |
| US20130151495A1 (en) | Optimizing a ranker for a risk-oriented objective | |
| US20130290138A1 (en) | Search Method, Apparatus and Server for Online Trading Platform | |
| EP2741220A1 (en) | Apparatus and method for indexing electronic content | |
| WO2014052332A2 (en) | Method and apparatus for graphic code database updates and search | |
| CA2764157A1 (en) | Searching methods and devices | |
| CN112579729A (en) | Training method and device for document quality evaluation model, electronic equipment and medium | |
| US8914398B2 (en) | Methods and apparatus for automated keyword refinement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FZDE | Dead |
Effective date: 20160601 |