EP3346394A4 - Question answering system training device and computer program therefor - Google Patents

Question answering system training device and computer program therefor Download PDF

Info

Publication number
EP3346394A4
EP3346394A4 EP16841689.9A EP16841689A EP3346394A4 EP 3346394 A4 EP3346394 A4 EP 3346394A4 EP 16841689 A EP16841689 A EP 16841689A EP 3346394 A4 EP3346394 A4 EP 3346394A4
Authority
EP
European Patent Office
Prior art keywords
computer program
training device
question answering
answering system
program therefor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP16841689.9A
Other languages
German (de)
French (fr)
Other versions
EP3346394A1 (en
Inventor
Jonghoon Oh
Kentaro Torisawa
Chikara Hashimoto
Ryu Iida
Masahiro Tanaka
Julien KLOETZER
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
National Institute of Information and Communications Technology
Original Assignee
National Institute of Information and Communications Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by National Institute of Information and Communications Technology filed Critical National Institute of Information and Communications Technology
Publication of EP3346394A1 publication Critical patent/EP3346394A1/en
Publication of EP3346394A4 publication Critical patent/EP3346394A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3329Natural language query formulation or dialogue systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/9032Query formulation
    • G06F16/90332Natural language query formulation or dialogue systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • G06N20/10Machine learning using kernel methods, e.g. support vector machines [SVM]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/01Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/02Knowledge representation; Symbolic representation
    • G06N5/022Knowledge engineering; Knowledge acquisition
    • G06N5/025Extracting rules from data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/04Inference or reasoning models
    • G06N5/041Abduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Databases & Information Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Human Computer Interaction (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Computational Mathematics (AREA)
  • Condensed Matter Physics & Semiconductors (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
EP16841689.9A 2015-08-31 2016-08-26 Question answering system training device and computer program therefor Withdrawn EP3346394A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015170923A JP6618735B2 (en) 2015-08-31 2015-08-31 Question answering system training apparatus and computer program therefor
PCT/JP2016/074903 WO2017038657A1 (en) 2015-08-31 2016-08-26 Question answering system training device and computer program therefor

Publications (2)

Publication Number Publication Date
EP3346394A1 EP3346394A1 (en) 2018-07-11
EP3346394A4 true EP3346394A4 (en) 2019-05-15

Family

ID=58188883

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16841689.9A Withdrawn EP3346394A4 (en) 2015-08-31 2016-08-26 Question answering system training device and computer program therefor

Country Status (6)

Country Link
US (1) US20180246953A1 (en)
EP (1) EP3346394A4 (en)
JP (1) JP6618735B2 (en)
KR (1) KR102640564B1 (en)
CN (1) CN107949841B (en)
WO (1) WO2017038657A1 (en)

Families Citing this family (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10902330B2 (en) * 2016-06-21 2021-01-26 International Business Machines Corporation Cognitive question answering pipeline calibrating
JP6767042B2 (en) * 2016-09-26 2020-10-14 国立研究開発法人情報通信研究機構 Scenario passage classifier, scenario classifier, and computer programs for it
US10699215B2 (en) * 2016-11-16 2020-06-30 International Business Machines Corporation Self-training of question answering system using question profiles
CN107193882B (en) * 2017-04-27 2020-11-20 东南大学 Why-not query answer method based on graph matching on RDF data
JP2019020893A (en) 2017-07-13 2019-02-07 国立研究開発法人情報通信研究機構 Non-factoid type question answering machine
JP6506360B2 (en) * 2017-08-24 2019-04-24 三菱電機インフォメーションシステムズ株式会社 Method of generating teacher data, method of generating learned model, learned model, computer and program
MX2018011305A (en) * 2017-09-18 2019-07-04 Tata Consultancy Services Ltd Techniques for correcting linguistic training bias in training data.
JP7009911B2 (en) * 2017-10-26 2022-01-26 富士通株式会社 Answer output program, answer output method and information processing device
KR102100951B1 (en) * 2017-11-16 2020-04-14 주식회사 마인즈랩 System for generating question-answer data for maching learning based on maching reading comprehension
CN108170749B (en) * 2017-12-21 2021-06-11 北京百度网讯科技有限公司 Dialog method, device and computer readable medium based on artificial intelligence
JP2019133229A (en) * 2018-01-29 2019-08-08 国立研究開発法人情報通信研究機構 Creation method of training data of question answering system and training method of question answering system
JP7052395B2 (en) * 2018-02-13 2022-04-12 富士通株式会社 Learning programs, learning methods and learning devices
JP7126843B2 (en) * 2018-03-29 2022-08-29 エヌ・ティ・ティ・データ先端技術株式会社 Learning target extraction device, learning target extraction method, and learning target extraction program
US10963273B2 (en) 2018-04-20 2021-03-30 Facebook, Inc. Generating personalized content summaries for users
US10978056B1 (en) * 2018-04-20 2021-04-13 Facebook, Inc. Grammaticality classification for natural language generation in assistant systems
US11886473B2 (en) 2018-04-20 2024-01-30 Meta Platforms, Inc. Intent identification for agent matching by assistant systems
US11676220B2 (en) 2018-04-20 2023-06-13 Meta Platforms, Inc. Processing multimodal user input for assistant systems
US11307880B2 (en) 2018-04-20 2022-04-19 Meta Platforms, Inc. Assisting users with personalized and contextual communication content
US11715042B1 (en) 2018-04-20 2023-08-01 Meta Platforms Technologies, Llc Interpretability of deep reinforcement learning models in assistant systems
JP7040610B2 (en) * 2018-04-25 2022-03-23 日本電信電話株式会社 Extended Narikiri Speaking Group Generator, Method and Program
KR102329290B1 (en) * 2018-05-31 2021-11-22 주식회사 마인즈랩 Method for preprocessing structured learning data and Method for learning artificial neural network using the structured learning data
JP7087938B2 (en) * 2018-06-07 2022-06-21 日本電信電話株式会社 Question generator, question generation method and program
WO2019235103A1 (en) * 2018-06-07 2019-12-12 日本電信電話株式会社 Question generation device, question generation method, and program
WO2019244803A1 (en) * 2018-06-18 2019-12-26 日本電信電話株式会社 Answer training device, answer training method, answer generation device, answer generation method, and program
US10678822B2 (en) * 2018-06-29 2020-06-09 International Business Machines Corporation Query expansion using a graph of question and answer vocabulary
CN109376249B (en) * 2018-09-07 2021-11-30 桂林电子科技大学 Knowledge graph embedding method based on self-adaptive negative sampling
CN113535915A (en) * 2018-09-28 2021-10-22 北京百度网讯科技有限公司 Method for expanding a data set
KR20210107723A (en) * 2018-12-14 2021-09-01 (주)하니소프트 Decryption device and method, recording medium AI-based apartment civil complaint processing device and method
US20220237637A1 (en) * 2018-12-18 2022-07-28 Meta Platforms, Inc. Systems and methods for real time crowdsourcing
JP6899973B2 (en) * 2019-01-08 2021-07-07 三菱電機株式会社 Semantic relationship learning device, semantic relationship learning method, and semantic relationship learning program
JP2020123131A (en) * 2019-01-30 2020-08-13 株式会社東芝 Dialog system, dialog method, program, and storage medium
JP7018408B2 (en) * 2019-02-20 2022-02-10 株式会社 日立産業制御ソリューションズ Image search device and teacher data extraction method
US11295077B2 (en) * 2019-04-08 2022-04-05 International Business Machines Corporation Stratification of token types for domain-adaptable question answering systems
US11270077B2 (en) * 2019-05-13 2022-03-08 International Business Machines Corporation Routing text classifications within a cross-domain conversational service
US11544461B2 (en) * 2019-05-14 2023-01-03 Intel Corporation Early exit for natural language processing models
KR102283779B1 (en) * 2019-07-18 2021-07-29 건국대학교 산학협력단 Method of questioning and answering and apparatuses performing the same
US11531818B2 (en) * 2019-11-15 2022-12-20 42 Maru Inc. Device and method for machine reading comprehension question and answer
JP2021096711A (en) 2019-12-18 2021-06-24 富士通株式会社 Information processing program, information processing method, and information processing device
JP7106036B2 (en) * 2020-04-30 2022-07-25 三菱電機株式会社 LEARNING DATA CREATION DEVICE, METHOD AND PROGRAM
CN111858883A (en) * 2020-06-24 2020-10-30 北京百度网讯科技有限公司 Method and device for generating triple sample, electronic equipment and storage medium
KR102280489B1 (en) 2020-11-19 2021-07-22 주식회사 두유비 Conversational intelligence acquisition method for intelligently performing conversation based on training on large-scale pre-trained model
CN113535911B (en) * 2020-12-03 2024-04-12 腾讯科技(深圳)有限公司 Reward model processing method, electronic device, medium and computer program product
CN112507706B (en) * 2020-12-21 2023-01-31 北京百度网讯科技有限公司 Training method and device for knowledge pre-training model and electronic equipment
WO2022249946A1 (en) * 2021-05-28 2022-12-01 国立研究開発法人情報通信研究機構 Conversation device and training device therefor
CN113408299B (en) * 2021-06-30 2022-03-25 北京百度网讯科技有限公司 Training method, device, equipment and storage medium of semantic representation model
WO2023079703A1 (en) * 2021-11-05 2023-05-11 楽天グループ株式会社 Processing execution system, processing execution method, and program

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9063975B2 (en) * 2013-03-15 2015-06-23 International Business Machines Corporation Results of question and answer systems
US8543565B2 (en) 2007-09-07 2013-09-24 At&T Intellectual Property Ii, L.P. System and method using a discriminative learning approach for question answering
US8560567B2 (en) * 2011-06-28 2013-10-15 Microsoft Corporation Automatic question and answer detection
JP5664978B2 (en) * 2011-08-22 2015-02-04 日立コンシューマエレクトロニクス株式会社 Learning support system and learning support method
JP5825676B2 (en) * 2012-02-23 2015-12-02 国立研究開発法人情報通信研究機構 Non-factoid question answering system and computer program
JP5924666B2 (en) * 2012-02-27 2016-05-25 国立研究開発法人情報通信研究機構 Predicate template collection device, specific phrase pair collection device, and computer program therefor
WO2014086101A1 (en) * 2012-12-07 2014-06-12 Wan Jihua Method for translating natural language into computer language, semantic analyzer and human-computer dialogue system
JP6150282B2 (en) * 2013-06-27 2017-06-21 国立研究開発法人情報通信研究機構 Non-factoid question answering system and computer program
CN104572734B (en) * 2013-10-23 2019-04-30 腾讯科技(深圳)有限公司 Method for recommending problem, apparatus and system
CN104834651B (en) * 2014-02-12 2020-06-05 北京京东尚科信息技术有限公司 Method and device for providing high-frequency question answers
CN104050256B (en) * 2014-06-13 2017-05-24 西安蒜泥电子科技有限责任公司 Initiative study-based questioning and answering method and questioning and answering system adopting initiative study-based questioning and answering method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LUCIAN VLAD LITA: "Instance-Based Question Answering", DOCTOR OF PHILOSOPHY THESIS, 1 December 2006 (2006-12-01), Carnegie Mellon University, Pittsburgh, USA, pages 0 - 231, XP055575924, Retrieved from the Internet <URL:https://apps.dtic.mil/dtic/tr/fulltext/u2/a462538.pdf> [retrieved on 20190401] *

Also Published As

Publication number Publication date
US20180246953A1 (en) 2018-08-30
CN107949841B (en) 2022-03-18
WO2017038657A1 (en) 2017-03-09
JP6618735B2 (en) 2019-12-11
EP3346394A1 (en) 2018-07-11
KR20180048624A (en) 2018-05-10
CN107949841A (en) 2018-04-20
KR102640564B1 (en) 2024-02-26
JP2017049681A (en) 2017-03-09

Similar Documents

Publication Publication Date Title
EP3346394A4 (en) Question answering system training device and computer program therefor
EP3393132A4 (en) Display method and display device
EP3297288A4 (en) Display method and display device
EP3109854A4 (en) Display control device, display control method, and computer program
EP3379895A4 (en) Device and method
EP3309774A4 (en) Display device and display method
EP3306944A4 (en) Display method and display device
EP3367366A4 (en) Display control method and display control device
EP3316592A4 (en) Display device and control method therefor
EP3273287A4 (en) Display device and display method therefor
EP3300382A4 (en) Display device and control method therefor
EP3313033A4 (en) Device and method
EP3385942A4 (en) Display control device and display control method
EP3399677A4 (en) Device and method
EP3306598A4 (en) Display method and display device
EP3343939A4 (en) Display device and control method therefor
EP3252974A4 (en) Device and method
EP3385827A4 (en) Display control device and display control method
EP3163392A4 (en) Information processing device and program
EP3382516A4 (en) Tactile sense presentation device and tactile sense presentation method
EP3253104A4 (en) Device and method
EP3253026A4 (en) Cdn-based access control method and relevant device
EP3361808A4 (en) Device and method
EP3170539A4 (en) Program and information processing device
EP3376785A4 (en) Device and method

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20180320

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIO

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20190411

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 16/332 20190101AFI20190405BHEP

17Q First examination report despatched

Effective date: 20200325

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20200608