WO2012040578A3 - User feedback in semi-automatic question answering systems - Google Patents

User feedback in semi-automatic question answering systems Download PDF

Info

Publication number
WO2012040578A3
WO2012040578A3 PCT/US2011/052983 US2011052983W WO2012040578A3 WO 2012040578 A3 WO2012040578 A3 WO 2012040578A3 US 2011052983 W US2011052983 W US 2011052983W WO 2012040578 A3 WO2012040578 A3 WO 2012040578A3
Authority
WO
WIPO (PCT)
Prior art keywords
codes
components
generating
correct
semi
Prior art date
Application number
PCT/US2011/052983
Other languages
French (fr)
Other versions
WO2012040578A2 (en
Inventor
Detlef Koll
Thomas Polzin
Original Assignee
Multimodal Technologies, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/025,051 external-priority patent/US9082310B2/en
Application filed by Multimodal Technologies, Llc filed Critical Multimodal Technologies, Llc
Priority to EP11827611.2A priority Critical patent/EP2619661A4/en
Priority to JP2013530359A priority patent/JP5908910B2/en
Priority to CA2811942A priority patent/CA2811942A1/en
Publication of WO2012040578A2 publication Critical patent/WO2012040578A2/en
Publication of WO2012040578A3 publication Critical patent/WO2012040578A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/04—Billing or invoicing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/205—Parsing
    • G06F40/226—Validation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Development Economics (AREA)
  • General Physics & Mathematics (AREA)
  • Marketing (AREA)
  • Artificial Intelligence (AREA)
  • General Business, Economics & Management (AREA)
  • Finance (AREA)
  • Economics (AREA)
  • Accounting & Taxation (AREA)
  • Health & Medical Sciences (AREA)
  • Strategic Management (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Machine Translation (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

A system applies rules to a set of documents to generate codes, such as billing codes for use in medical billing. A human operator provides input specifying whether the generated codes are correct. Based on the input from the human operator, the system attempts to identify which clause(s) in the rules which were relied on to generate the particular code are correct and which such clause(s) are incorrect. The system then assigns praise to components of the system responsible for generating codes in the correct clauses, and assigns blame to components of the system responsible for generating codes in the incorrect clauses. Such blame and praise may then be used to determine whether particular code-generating components are insufficiently reliable. The system may disable, or take other remedial action in response to, insufficiently reliable code-generating components.
PCT/US2011/052983 2010-09-23 2011-09-23 User feedback in semi-automatic question answering systems WO2012040578A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP11827611.2A EP2619661A4 (en) 2010-09-23 2011-09-23 User feedback in semi-automatic question answering systems
JP2013530359A JP5908910B2 (en) 2010-09-23 2011-09-23 User feedback in a semi-automatic question answering system
CA2811942A CA2811942A1 (en) 2010-09-23 2011-09-23 User feedback in semi-automatic question answering systems

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US38583810P 2010-09-23 2010-09-23
US61/385,838 2010-09-23
US13/025,051 US9082310B2 (en) 2010-02-10 2011-02-10 Providing computable guidance to relevant evidence in question-answering systems
US13/025,051 2011-02-10

Publications (2)

Publication Number Publication Date
WO2012040578A2 WO2012040578A2 (en) 2012-03-29
WO2012040578A3 true WO2012040578A3 (en) 2012-06-14

Family

ID=45874401

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2011/052983 WO2012040578A2 (en) 2010-09-23 2011-09-23 User feedback in semi-automatic question answering systems

Country Status (4)

Country Link
EP (1) EP2619661A4 (en)
JP (1) JP5908910B2 (en)
CA (1) CA2811942A1 (en)
WO (1) WO2012040578A2 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020049628A1 (en) * 2000-10-23 2002-04-25 West William T. System and method providing automated and interactive consumer information gathering
US20080134038A1 (en) * 2006-12-05 2008-06-05 Electronics And Telecommunications Research Interactive information providing service method and apparatus
US7454393B2 (en) * 2003-08-06 2008-11-18 Microsoft Corporation Cost-benefit approach to automatically composing answers to questions by extracting information from large unstructured corpora
US20090287678A1 (en) * 2008-05-14 2009-11-19 International Business Machines Corporation System and method for providing answers to questions

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030105638A1 (en) * 2001-11-27 2003-06-05 Taira Rick K. Method and system for creating computer-understandable structured medical data from natural language reports
WO2007011841A2 (en) * 2005-07-15 2007-01-25 Indxit Systems, Inc. Systems and methods for data indexing and processing
JP5419143B2 (en) * 2009-04-27 2014-02-19 トランス・コスモス株式会社 Code conversion support device, code conversion support method, and code conversion support program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020049628A1 (en) * 2000-10-23 2002-04-25 West William T. System and method providing automated and interactive consumer information gathering
US7454393B2 (en) * 2003-08-06 2008-11-18 Microsoft Corporation Cost-benefit approach to automatically composing answers to questions by extracting information from large unstructured corpora
US20080134038A1 (en) * 2006-12-05 2008-06-05 Electronics And Telecommunications Research Interactive information providing service method and apparatus
US20090287678A1 (en) * 2008-05-14 2009-11-19 International Business Machines Corporation System and method for providing answers to questions

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2619661A4 *

Also Published As

Publication number Publication date
JP5908910B2 (en) 2016-04-26
EP2619661A2 (en) 2013-07-31
JP2013542502A (en) 2013-11-21
CA2811942A1 (en) 2012-03-29
EP2619661A4 (en) 2015-04-22
WO2012040578A2 (en) 2012-03-29

Similar Documents

Publication Publication Date Title
WO2014179475A3 (en) Methods for providing telemedicine services
WO2012056405A3 (en) Pressure sensor assembly and associated method for preventing the development of pressure injuries
EP3584797A3 (en) Preventing inadvertent changes in ambulatory medical devices
WO2010118327A3 (en) Targeted health care content delivery system
MX2017002809A (en) Apparatus and method for sterilizing medical devices.
WO2012131584A3 (en) Method and apparatus for providing projected user interfaces on various surfaces
PH12016502025A1 (en) Electronic lock having usage and wear leveling of a touch surface through randomized code entry
GB2491755A (en) Apparatus and method allowing multiple users to interact with a workspace
WO2013186665A3 (en) Methods and apparatus for storing, suggesting, and/or utilizing lighting settings
WO2014150871A3 (en) Management system for point of care testing
AU2015311681A8 (en) Globin gene therapy for treating hemoglobinopathies
MX2016005252A (en) Infusion system for preventing mischanneling of multiple medicaments.
WO2013087989A3 (en) Method and apparatus for providing information collection using template-based user tasks
WO2014047626A3 (en) Power injector device and method of use
WO2009124133A3 (en) Security features for a medical infusion pump
MX2012005480A (en) Needleless access connectors and valve elements therefor.
WO2012003255A3 (en) Facilitating interaction among users of a social network
EP2738478A3 (en) Intelligent comfort management using natural language processing to interface with a comfort system controller
WO2010111321A3 (en) Conditional electrical stimulation in response to physiological information for pelvic health
WO2013052175A3 (en) Military occupations and skills management system
MX2015004937A (en) Electrolyte formulations for oxygen activated portable heater.
IN2011CH02631A (en)
WO2016050086A8 (en) Interaction method for user interfaces
WO2012149450A8 (en) Method and apparatus for electronic event correlated message delivery
MX358817B (en) Intuitive overlaid readiness indicator for defibrillators.

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11827611

Country of ref document: EP

Kind code of ref document: A2

ENP Entry into the national phase

Ref document number: 2013530359

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2811942

Country of ref document: CA

REEP Request for entry into the european phase

Ref document number: 2011827611

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2011827611

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE