US20140142920A1 - Method and apparatus for Utilizing Structural Information in Semi-Structured Documents to Generate Candidates for Question Answering Systems - Google Patents
Method and apparatus for Utilizing Structural Information in Semi-Structured Documents to Generate Candidates for Question Answering Systems Download PDFInfo
- Publication number
- US20140142920A1 US20140142920A1 US12/191,251 US19125108A US2014142920A1 US 20140142920 A1 US20140142920 A1 US 20140142920A1 US 19125108 A US19125108 A US 19125108A US 2014142920 A1 US2014142920 A1 US 2014142920A1
- Authority
- US
- United States
- Prior art keywords
- document
- candidate
- question
- title
- semi
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2452—Query translation
- G06F16/24522—Translation of natural language queries to structured queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/243—Natural language query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation or dialogue systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
- G06F16/83—Querying
- G06F16/835—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/279—Recognition of textual entities
- G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
- G06F40/295—Named entity recognition
Definitions
- the invention relates generally to question answering systems used to generate candidate answers by consulting a possibly heterogeneous collection of structured, semi-structured, and unstructured information resources.
- the present invention provides an approach to candidate answer generation by leveraging structural information in semi-structured resources, such as the title of a document and anchor texts in a document.
- the invention provides a method for candidate generation for question answering including receiving a natural language question and formulating queries used to retrieve search results including documents and passages that are relevant to answering the natural language question; extracting from the search results potential answers to the natural language question; and scoring and ranking the answers to produce a final ranked list of answers with associated confidence scores.
- the method for candidate generation for question answering includes receiving at least one document or passage together with its provenance information; accessing a semi-structured source of information based on the provenance; retrieving substructures/entities including a title of a document and anchor text from the passage within the document; applying a normalization operation, such as replacing the html symbol “&nsp;” with a space character or removing the disambiguation field in a Wikipedia article titles (e.g. removing the text in parenthesis for title Titanic (1997 film)), to the substructure/entity (e.g. titles and anchor texts); and returning the resulting list of candidate answers.
- a normalization operation such as replacing the html symbol “&nsp;” with a space character or removing the disambiguation field in a Wikipedia article titles (e.g. removing the text in parenthesis for title Titanic (1997 film)), to the substructure/entity (e.g. titles and anchor texts); and returning the resulting list of candidate answers.
- the approach improves upon previous generation methods by producing candidate answers in a context-dependent fashion without requiring high accuracy in answer type detection and named entity recognition.
- the approach is applicable to questions with both definitive semantic answer types as well as untyped questions, and in the latter case, improves overall system efficiency by generating a significantly smaller set of candidate answers through leveraging context-dependent structural information.
- FIG. 1 illustrates the components of a canonical question answering system and its workflow
- FIG. 2 is a flow diagram illustrating an approach to candidate answer generation by leveraging structural information in semi-structured resources, such as the title of a document;
- FIG. 3 is a flow diagram illustrating an approach to candidate answer generation by leveraging structural information in semi-structured resources, such as anchor texts in a document.
- the present invention may be described herein in terms of various components and processing steps. It should be appreciated that such components and steps may be realized by any number of hardware and software components configured to perform the specified functions.
- the present invention may employ various electronic control devices, visual display devices, input terminals and the like, which may carry out a variety of functions under the control of one or more control systems, microprocessors or other control devices.
- the present invention may be practiced in any number of contexts and the exemplary embodiments relating to a searching system and method as described herein are merely a few of the exemplary applications for the invention.
- the processing steps may be conducted with one or more computer-based systems through the use of one or more algorithms.
- FIG. 1 illustrates the components of a QA system 100 and its workflow, including question analysis component 104 , search component 106 , candidate generation component 108 and answer selection component 110 .
- the question analysis component 104 receives a natural language question 102 , for example, “Who is the 42nd president of the United States?”
- Question analysis component 104 analyzes the question to produce, minimally, the semantic type of the expected answer (in this example, “president”), and optionally other analysis results for downstream processing.
- the search component 106 formulates queries from the output of question analysis and consults various resources, for example, the world wide web and databases 107 , to retrieve documents, passages, database tuples, and the like, that are relevant to answering the question.
- the candidate generation component 108 then extracts from the search results potential answers to the question, which are then scored and ranked by the answer selection component 110 to produce a final ranked list of answers 112 with associated confidence scores.
- Candidate generation component 108 is an important component in question answering systems in which potential answers to a given question are extracted from the search results.
- candidate answers are identified based on the semantic type match between the answer type as determined by the question analysis component 104 and entities extracted from the search results via a named entity recognizer. For example, for the sample question “Who is the 42nd president of the United States?” all candidate answers will be of the semantic type US president.
- FIGS. 2 and 3 are flow diagrams illustrating an approach to candidate answer generation by leveraging structural information in semi-structured resources, such as the title of a document and anchor texts in a document. This approach improves upon previous candidate generation methods by producing candidate answers in a context-dependent fashion without the reliance requiring high accuracy in on the high accuracy required of answer type detection and named entity recognition.
- This approach is applicable to questions with both definitive semantic answer types as well as untyped questions, and improves overall system efficiency by generating a significantly smaller set of candidate answers through leveraging context-dependent structural information.
- the document title is an excellent candidate answer for properties described in the article about the title entity.
- the following facts are provided: “The First Edition was a rock band, stalwart members being Kenny Rogers, Mickey Jones, and Terry Williams.
- the search component 106 of QA system 100 is likely to include a document 202 , for example “The First Edition” or passage texts 204 extracted from document 202 among its search results.
- candidate generation component 108 performs document title approach 200 by extracting candidate answers from search results. If the search results include documents 202 , then the “title field” of these documents, such as “The First Edition”, is extracted using title retrieval component 208 as illustrated in FIG. 2 .
- title approach 200 may be done through a database table lookup. If the search results include passage texts 204 , then the documents that contain passage texts 202 a are retrieved through document retrieval component 206 . This may be accomplished by retrieving the provenance information of the passage texts. Once the documents containing the passage texts 202 a are obtained, the titles may be retrieved using title retrieval component 208 and are used as candidate answers 210 .
- title retrieval component 208 returns the title of document 202 as a candidate answer 210 .
- search component 106 returns a passage 204 (for example, a short 1 - 3 sentence text snippet), then a document 202 a from which passage 204 has been extracted is searched for and identified using document retrieval component 206 .
- a passage 204 for example, a short 1 - 3 sentence text snippet
- Document retrieval component 206 is configured to match passage 204 against a set of free-text records. These records could be any type of mainly unstructured text, such as newspaper articles, real estate records or paragraphs in a manual. Passages 204 may range from multi-sentence full descriptions of an information need to a few words.
- title retrieval component 208 returns the title of document 202 a as a candidate answer 210 .
- candidate generation component 108 includes anchor text retrieval approach 300 , which leverages anchor texts found in a passage/document 302 to extract candidate answers 210 from text retrieved from passage/document 302 .
- Anchor texts are text strings highlighted in a document to indicate hyperlinks to other documents.
- candidate generation component 108 uses anchor texts 304 as a candidate generation mechanism in QA system 100 .
- retrieve component 306 For each document-oriented search result (i.e. passage or document 302 ) from search component 106 , retrieve component 306 identifies the document from which the retrieved text has been extracted. retrieve component 306 then retrieves all anchor texts 304 that are present in document 302 .
- An implementation of using anchor texts 304 may be through a database lookup in which the database stores pairs of a document ID and a list of all anchor texts in that particular document.
- the document ID of passage/document 302 may either be obtained through provenance information in the search result, if available, or retrieved again through retrieve component 306 .
- the list of anchor texts 304 in that document may be obtained through a simple database query. The subset of the list of anchor texts that are present in passage/document 302 are selected as candidate answers 210 .
- anchor texts 304 are matched against the retrieved text and all anchor texts 304 that are present in the retrieved text are selected as candidate answers 210 .
- anchor text retrieval approach 300 in which candidate generation component 108 uses anchor texts 304 as a candidate generation mechanism in QA system 100 , may be applied to the candidate answers 210 extracted using document title approach 200 . This is performed by treating each extracted candidate answer 210 from approach 200 as a search result (i.e. passage/document 302 ) and further extracting anchor text sub-candidates from within candidate answers 210 . For example, for candidate answer 210 “List of Deserts in Australia”, the candidate answer 210 “Australia” may be generated.
Abstract
An approach to candidate answer generation by leveraging structural information in semi-structured resources, such as the title of a document and anchor texts in a document.
Description
- The invention relates generally to question answering systems used to generate candidate answers by consulting a possibly heterogeneous collection of structured, semi-structured, and unstructured information resources.
- Most question answering (QA) systems suffer from two significant deficiencies. First, the systems rely on the question analysis component correctly identifying the semantic type of the answer and the named entity recognizer correctly identifying the correct answer as that semantic type. Failure at either stage produces an error from which the system cannot recover.
- Second, most QA systems are not amenable to questions without answer types, such as “What was the Parthenon converted into in 1460?” For such questions, oftentimes all noun phrases from the search output are extracted, leading to a large number of extraneous and at times non-sensible candidate answers in the context of the question.
- The present invention provides an approach to candidate answer generation by leveraging structural information in semi-structured resources, such as the title of a document and anchor texts in a document.
- In one aspect, the invention provides a method for candidate generation for question answering including receiving a natural language question and formulating queries used to retrieve search results including documents and passages that are relevant to answering the natural language question; extracting from the search results potential answers to the natural language question; and scoring and ranking the answers to produce a final ranked list of answers with associated confidence scores.
- The method for candidate generation for question answering includes receiving at least one document or passage together with its provenance information; accessing a semi-structured source of information based on the provenance; retrieving substructures/entities including a title of a document and anchor text from the passage within the document; applying a normalization operation, such as replacing the html symbol “&nsp;” with a space character or removing the disambiguation field in a Wikipedia article titles (e.g. removing the text in parenthesis for title Titanic (1997 film)), to the substructure/entity (e.g. titles and anchor texts); and returning the resulting list of candidate answers.
- The approach improves upon previous generation methods by producing candidate answers in a context-dependent fashion without requiring high accuracy in answer type detection and named entity recognition. The approach is applicable to questions with both definitive semantic answer types as well as untyped questions, and in the latter case, improves overall system efficiency by generating a significantly smaller set of candidate answers through leveraging context-dependent structural information.
- The objects and features of the present invention, which are believed to be novel, are set forth with particularity in the appended claims. The present invention, both as to its organization and manner of operation, together with further objects and advantages, may best be understood by reference to the following description, taken in connection with the accompanying drawings.
- The foregoing features and other features of the present invention will now be described with reference to the drawings. In the drawings, the same components have the same reference numerals. The illustrated embodiment is intended to illustrate, but not to limit the invention. The drawings include the following Figures:
-
FIG. 1 illustrates the components of a canonical question answering system and its workflow; -
FIG. 2 is a flow diagram illustrating an approach to candidate answer generation by leveraging structural information in semi-structured resources, such as the title of a document; and -
FIG. 3 is a flow diagram illustrating an approach to candidate answer generation by leveraging structural information in semi-structured resources, such as anchor texts in a document. - The present invention may be described herein in terms of various components and processing steps. It should be appreciated that such components and steps may be realized by any number of hardware and software components configured to perform the specified functions. For example, the present invention may employ various electronic control devices, visual display devices, input terminals and the like, which may carry out a variety of functions under the control of one or more control systems, microprocessors or other control devices.
- In addition, the present invention may be practiced in any number of contexts and the exemplary embodiments relating to a searching system and method as described herein are merely a few of the exemplary applications for the invention. The processing steps may be conducted with one or more computer-based systems through the use of one or more algorithms.
-
FIG. 1 illustrates the components of aQA system 100 and its workflow, includingquestion analysis component 104,search component 106,candidate generation component 108 andanswer selection component 110. - In operation, the
question analysis component 104 receives anatural language question 102, for example, “Who is the 42nd president of the United States?”Question analysis component 104 analyzes the question to produce, minimally, the semantic type of the expected answer (in this example, “president”), and optionally other analysis results for downstream processing. - The
search component 106 formulates queries from the output of question analysis and consults various resources, for example, the world wide web anddatabases 107, to retrieve documents, passages, database tuples, and the like, that are relevant to answering the question. - The
candidate generation component 108 then extracts from the search results potential answers to the question, which are then scored and ranked by theanswer selection component 110 to produce a final ranked list ofanswers 112 with associated confidence scores. -
Candidate generation component 108 is an important component in question answering systems in which potential answers to a given question are extracted from the search results. In a typical question answering system, candidate answers are identified based on the semantic type match between the answer type as determined by thequestion analysis component 104 and entities extracted from the search results via a named entity recognizer. For example, for the sample question “Who is the 42nd president of the United States?” all candidate answers will be of the semantic type US president. -
FIGS. 2 and 3 are flow diagrams illustrating an approach to candidate answer generation by leveraging structural information in semi-structured resources, such as the title of a document and anchor texts in a document. This approach improves upon previous candidate generation methods by producing candidate answers in a context-dependent fashion without the reliance requiring high accuracy in on the high accuracy required of answer type detection and named entity recognition. - This approach is applicable to questions with both definitive semantic answer types as well as untyped questions, and improves overall system efficiency by generating a significantly smaller set of candidate answers through leveraging context-dependent structural information.
- In certain types of documents, such as Encyclopedia articles and the like, the document title is an excellent candidate answer for properties described in the article about the title entity. For example, in a document about the band “The First Edition”, the following facts are provided: “The First Edition was a rock band, stalwart members being Kenny Rogers, Mickey Jones, and Terry Williams. The band formed in 1967, with noted folk musicians Mike Settle and the operatically trained Thelma Camacho completing the lineup” and “The First Edition were (outside of Mickey Jones) made up of former New Christy Minstrels who felt creatively stifled.” Given the question “What is the rock band formed by Kenny Rogers and other members of the New Christy Minstrels in 1967?” the
search component 106 ofQA system 100 is likely to include adocument 202, for example “The First Edition” or passage texts 204 extracted fromdocument 202 among its search results. - In one embodiment of the present invention,
candidate generation component 108 performsdocument title approach 200 by extracting candidate answers from search results. If the search results includedocuments 202, then the “title field” of these documents, such as “The First Edition”, is extracted usingtitle retrieval component 208 as illustrated inFIG. 2 . One implementation oftitle approach 200 may be done through a database table lookup. If the search results include passage texts 204, then the documents that containpassage texts 202 a are retrieved throughdocument retrieval component 206. This may be accomplished by retrieving the provenance information of the passage texts. Once the documents containing thepassage texts 202 a are obtained, the titles may be retrieved usingtitle retrieval component 208 and are used ascandidate answers 210. - In the event that
search component 106 returnsdocument 202 as its search result,title retrieval component 208 returns the title ofdocument 202 as acandidate answer 210. - In the event that
search component 106 returns a passage 204 (for example, a short 1-3 sentence text snippet), then adocument 202 a from which passage 204 has been extracted is searched for and identified usingdocument retrieval component 206. -
Document retrieval component 206 is configured to match passage 204 against a set of free-text records. These records could be any type of mainly unstructured text, such as newspaper articles, real estate records or paragraphs in a manual. Passages 204 may range from multi-sentence full descriptions of an information need to a few words. - Once
document 202 a has been identified,title retrieval component 208 returns the title ofdocument 202 a as acandidate answer 210. - In another embodiment,
candidate generation component 108 includes anchor text retrieval approach 300, which leverages anchor texts found in a passage/document 302 to extractcandidate answers 210 from text retrieved from passage/document 302. Anchor texts are text strings highlighted in a document to indicate hyperlinks to other documents. - As illustrated in
FIG. 3 ,candidate generation component 108 usesanchor texts 304 as a candidate generation mechanism inQA system 100. For each document-oriented search result (i.e. passage or document 302) fromsearch component 106,retrieve component 306 identifies the document from which the retrieved text has been extracted.Retrieve component 306 then retrieves allanchor texts 304 that are present indocument 302. An implementation of usinganchor texts 304 may be through a database lookup in which the database stores pairs of a document ID and a list of all anchor texts in that particular document. Given a search result, such as passage/document 302, the document ID of passage/document 302 may either be obtained through provenance information in the search result, if available, or retrieved again through retrievecomponent 306. Once the document ID is identified, the list of anchor texts 304 in that document may be obtained through a simple database query. The subset of the list of anchor texts that are present in passage/document 302 are selected as candidate answers 210. - Next, in
match component 308, anchor texts 304 are matched against the retrieved text and all anchortexts 304 that are present in the retrieved text are selected as candidate answers 210. - It should be understood that the approaches described above regarding
FIGS. 2 and 3 to candidate answer generation by leveraging structural information in semi-structured resources, such as the title of a document and anchor texts in a document, may be used separately or may be combined. For example, in one embodiment, anchor text retrieval approach 300 in whichcandidate generation component 108 uses anchor texts 304 as a candidate generation mechanism inQA system 100, may be applied to the candidate answers 210 extracted usingdocument title approach 200. This is performed by treating each extractedcandidate answer 210 fromapproach 200 as a search result (i.e. passage/document 302) and further extracting anchor text sub-candidates from within candidate answers 210. For example, forcandidate answer 210 “List of Deserts in Australia”, thecandidate answer 210 “Australia” may be generated. - The invention has been disclosed in an illustrative manner. Accordingly, the terminology employed throughout should be read in an exemplary rather than a limiting manner. Although minor modifications of the invention will occur to those of ordinary skill in the art, it shall be understood that what is intended to be circumscribed within the scope of the patent warranted hereon are all such embodiments that reasonably fall within the scope of the advancement to the art hereby contributed, and that scope shall not be restricted, except in light of the appended claims and their equivalents.
Claims (1)
1. A method for candidate generation for question answering comprising:
receiving a natural language question and formulating queries used to retrieve search results including documents and passages that are relevant to answering the natural language question;
receiving at least one document or passage together with its provenance information;
accessing a semi-structured source of information based on the provenance;
retrieving substructures/entities including a title of a document and anchor texts from the passage within the document;
extracting from the search results candidate answers to the natural language question;
selecting the title and the anchor texts as candidate answers;
applying a normalization operation to the substructure/entity;
scoring and ranking the answers to produce a final ranked list of candidate answers with associated confidence scores; and
returning the resulting list of the candidate answers.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/191,251 US20140142920A1 (en) | 2008-08-13 | 2008-08-13 | Method and apparatus for Utilizing Structural Information in Semi-Structured Documents to Generate Candidates for Question Answering Systems |
US14/721,166 US9529845B2 (en) | 2008-08-13 | 2015-05-26 | Candidate generation in a question answering system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/191,251 US20140142920A1 (en) | 2008-08-13 | 2008-08-13 | Method and apparatus for Utilizing Structural Information in Semi-Structured Documents to Generate Candidates for Question Answering Systems |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/721,166 Continuation US9529845B2 (en) | 2008-08-13 | 2015-05-26 | Candidate generation in a question answering system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140142920A1 true US20140142920A1 (en) | 2014-05-22 |
Family
ID=50728757
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/191,251 Abandoned US20140142920A1 (en) | 2008-08-13 | 2008-08-13 | Method and apparatus for Utilizing Structural Information in Semi-Structured Documents to Generate Candidates for Question Answering Systems |
US14/721,166 Expired - Fee Related US9529845B2 (en) | 2008-08-13 | 2015-05-26 | Candidate generation in a question answering system |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/721,166 Expired - Fee Related US9529845B2 (en) | 2008-08-13 | 2015-05-26 | Candidate generation in a question answering system |
Country Status (1)
Country | Link |
---|---|
US (2) | US20140142920A1 (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9824161B1 (en) * | 2013-07-10 | 2017-11-21 | Google Inc. | Providing third party answers |
WO2019080910A1 (en) * | 2017-10-25 | 2019-05-02 | 中兴通讯股份有限公司 | Information processing system and method thereof for implementing information processing |
US10515073B2 (en) | 2010-09-24 | 2019-12-24 | International Business Machines Corporation | Decision-support application and system for medical differential-diagnosis and treatment using a question-answering system |
CN113032541A (en) * | 2021-04-02 | 2021-06-25 | 同方知网(北京)技术有限公司 | Answer extraction method based on bert and fusion sentence cluster retrieval |
US11443116B2 (en) * | 2018-11-05 | 2022-09-13 | Samsung Electronics Co., Ltd. | Electronic apparatus and control method thereof |
CN116578693A (en) * | 2023-07-14 | 2023-08-11 | 深圳须弥云图空间科技有限公司 | Text retrieval method and device |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180203856A1 (en) | 2017-01-17 | 2018-07-19 | International Business Machines Corporation | Enhancing performance of structured lookups using set operations |
US10853575B2 (en) * | 2017-10-26 | 2020-12-01 | Nec Corporation | System and method for faster interfaces on text-based tasks using adaptive memory networks |
US11409749B2 (en) | 2017-11-09 | 2022-08-09 | Microsoft Technology Licensing, Llc | Machine reading comprehension system for answering queries related to a document |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6704728B1 (en) * | 2000-05-02 | 2004-03-09 | Iphase.Com, Inc. | Accessing information from a collection of data |
US6820075B2 (en) * | 2001-08-13 | 2004-11-16 | Xerox Corporation | Document-centric system with auto-completion |
US6998527B2 (en) * | 2002-06-20 | 2006-02-14 | Koninklijke Philips Electronics N.V. | System and method for indexing and summarizing music videos |
US7543232B2 (en) * | 2004-10-19 | 2009-06-02 | International Business Machines Corporation | Intelligent web based help system |
WO2006053306A2 (en) * | 2004-11-12 | 2006-05-18 | Make Sence, Inc | Knowledge discovery by constructing correlations using concepts or terms |
US7769579B2 (en) | 2005-05-31 | 2010-08-03 | Google Inc. | Learning facts from semi-structured text |
US8140559B2 (en) * | 2005-06-27 | 2012-03-20 | Make Sence, Inc. | Knowledge correlation search engine |
US7873624B2 (en) * | 2005-10-21 | 2011-01-18 | Microsoft Corporation | Question answering over structured content on the web |
US8024653B2 (en) * | 2005-11-14 | 2011-09-20 | Make Sence, Inc. | Techniques for creating computer generated notes |
US8832064B2 (en) * | 2005-11-30 | 2014-09-09 | At&T Intellectual Property Ii, L.P. | Answer determination for natural language questioning |
US7580926B2 (en) | 2005-12-01 | 2009-08-25 | Adchemy, Inc. | Method and apparatus for representing text using search engine, document collection, and hierarchal taxonomy |
US7590628B2 (en) * | 2006-03-31 | 2009-09-15 | Google, Inc. | Determining document subject by using title and anchor text of related documents |
US9002869B2 (en) * | 2007-06-22 | 2015-04-07 | Google Inc. | Machine translation for query expansion |
KR101103766B1 (en) * | 2007-07-03 | 2012-01-12 | 성균관대학교산학협력단 | Terminal, method, recording medium for collecting user preference information using tag information |
US7840569B2 (en) * | 2007-10-18 | 2010-11-23 | Microsoft Corporation | Enterprise relevancy ranking using a neural network |
US8275803B2 (en) * | 2008-05-14 | 2012-09-25 | International Business Machines Corporation | System and method for providing answers to questions |
US7762164B2 (en) * | 2008-06-02 | 2010-07-27 | Eca Medical Instruments | Torque-limiting device |
-
2008
- 2008-08-13 US US12/191,251 patent/US20140142920A1/en not_active Abandoned
-
2015
- 2015-05-26 US US14/721,166 patent/US9529845B2/en not_active Expired - Fee Related
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10515073B2 (en) | 2010-09-24 | 2019-12-24 | International Business Machines Corporation | Decision-support application and system for medical differential-diagnosis and treatment using a question-answering system |
US11163763B2 (en) | 2010-09-24 | 2021-11-02 | International Business Machines Corporation | Decision-support application and system for medical differential-diagnosis and treatment using a question-answering system |
US9824161B1 (en) * | 2013-07-10 | 2017-11-21 | Google Inc. | Providing third party answers |
WO2019080910A1 (en) * | 2017-10-25 | 2019-05-02 | 中兴通讯股份有限公司 | Information processing system and method thereof for implementing information processing |
US11443116B2 (en) * | 2018-11-05 | 2022-09-13 | Samsung Electronics Co., Ltd. | Electronic apparatus and control method thereof |
CN113032541A (en) * | 2021-04-02 | 2021-06-25 | 同方知网(北京)技术有限公司 | Answer extraction method based on bert and fusion sentence cluster retrieval |
CN116578693A (en) * | 2023-07-14 | 2023-08-11 | 深圳须弥云图空间科技有限公司 | Text retrieval method and device |
Also Published As
Publication number | Publication date |
---|---|
US20150254244A1 (en) | 2015-09-10 |
US9529845B2 (en) | 2016-12-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9529845B2 (en) | Candidate generation in a question answering system | |
Gupta et al. | A survey of text question answering techniques | |
CN103229162B (en) | Candidate answers logic synthesis is used to provide problem answers | |
US9449081B2 (en) | Identification of semantic relationships within reported speech | |
US8832064B2 (en) | Answer determination for natural language questioning | |
Plachouras et al. | Interacting with financial data using natural language | |
US20040122846A1 (en) | Fact verification system | |
RU2488877C2 (en) | Identification of semantic relations in indirect speech | |
US20070022099A1 (en) | Question answering system, data search method, and computer program | |
KR20050032937A (en) | Method for automatically creating a question and indexing the question-answer by language-analysis and the question-answering method and system | |
CN109408806A (en) | A kind of Event Distillation method based on English grammar rule | |
Greenwood et al. | A pattern based approach to answering factoid, list and definition questions | |
Hakkani-Tur et al. | Statistical sentence extraction for information distillation | |
JP2004355550A (en) | Natural sentence retrieval device, and its method and program | |
KR100745367B1 (en) | Method of index and retrieval of record based on template and question answering system using as the same | |
Tran et al. | A model of vietnamese person named entity question answering system | |
JP2021096395A (en) | Grammar learning system, server device, data retrieval method, and retrieval program | |
Chen et al. | Chinese named entity abbreviation generation using first-order logic | |
Han et al. | Did You Know? A Rule-Based Approach to Finding Similar Questions on Online Health Forums | |
Greenwood et al. | The University of Sheffield's TREC 2006 Q&A Experiments. | |
Reinanda et al. | Entity network extraction based on association finding and relation extraction | |
CA2914398A1 (en) | Identification of semantic relationships within reported speech | |
Küçük | Exploiting information extraction techniques for automatic semantic annotation and retrieval of news videos in Turkish | |
Li et al. | A Chinese question answering system for specific domain | |
Sabry et al. | Surveying Question Answering Systems: A Comparative Study |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHU-CARROLL, JENNIFER;FAN, JAMES J.;FERRUCCI, DAVID ANGELO;REEL/FRAME:021470/0929 Effective date: 20080902 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |