WO2018022970A1 - Systems and methods for determining an execution path for a natural language query - Google Patents

Systems and methods for determining an execution path for a natural language query Download PDF

Info

Publication number
WO2018022970A1
WO2018022970A1 PCT/US2017/044332 US2017044332W WO2018022970A1 WO 2018022970 A1 WO2018022970 A1 WO 2018022970A1 US 2017044332 W US2017044332 W US 2017044332W WO 2018022970 A1 WO2018022970 A1 WO 2018022970A1
Authority
WO
WIPO (PCT)
Prior art keywords
response
query
correct
execution path
possible response
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2017/044332
Other languages
English (en)
French (fr)
Inventor
Sashikumar Venkataraman
Ahmed Nizam MOHAIDEEN P.
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Adeia Guides Inc
Original Assignee
Rovi Guides Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rovi Guides Inc filed Critical Rovi Guides Inc
Priority to KR1020187018501A priority Critical patent/KR102430625B1/ko
Priority to JP2018534053A priority patent/JP7114467B2/ja
Priority to AU2017302614A priority patent/AU2017302614A1/en
Priority to EP17751183.9A priority patent/EP3391254A1/en
Priority to CA2999091A priority patent/CA2999091A1/en
Publication of WO2018022970A1 publication Critical patent/WO2018022970A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/438Presentation of query results
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2453Query optimisation
    • G06F16/24534Query rewriting; Transformation
    • G06F16/24542Plan optimisation
    • G06F16/24545Selectivity estimation or determination
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/3331Query processing
    • G06F16/334Query execution
    • G06F16/3344Query execution using natural language analysis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/901Indexing; Data structures therefor; Storage structures
    • G06F16/9024Graphs; Linked lists
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the query "Who directed Titanic” may include input entity, "The Titanic,” and unknown term “directed.”
  • the interactive media guidance application retrieves, from a knowledge graph, a plurality of possible responses for the query. For example, the interactive media guidance application may retrieve possible responses based on the entities having a graph connection with the input entity including "Leonardo DiCaprio,” “Kate Winslet,” and “James Cameron.”
  • FIG. 5 shows yet another illustrative example of a display screen generated by an interactive media guidance application in accordance with some embodiments of the disclosure
  • the user equipment device may have a front facing screen and a rear facing screen, multiple front screens, or multiple angled screens.
  • the user equipment device may have a front facing camera and/or a rear facing camera. On these user equipment devices, users may be able to navigate among and locate the same content available through a television.
  • the interactive media guidance application may provide a display screen with media guidance data organized in one of several ways, such as by time and channel in a grid, by time, by channel, by source, by content type, by category (e.g., movies, sports, news, children, or other categories of programming), or other predefined, user-defined, or other organization criteria.
  • media guidance data organized in one of several ways, such as by time and channel in a grid, by time, by channel, by source, by content type, by category (e.g., movies, sports, news, children, or other categories of programming), or other predefined, user-defined, or other organization criteria.
  • Grid 502 may provide media guidance data for non-linear programming including on-demand listing 514, recorded content listing 516, and Internet content listing 518.
  • a display combining media guidance data for content from different types of content sources is sometimes referred to as a "mixed-media" display.
  • Various permutations of the types of media guidance data that may be displayed that are different than display 500 may be based on user selection or guidance application definition (e.g., a display of only recorded and broadcast listings, only on-demand and broadcast listings, etc.).
  • listings 514, 516, and 518 are shown as spanning the entire time block displayed in grid 502 to indicate that selection of these listings may provide access to a display dedicated to on-demand listings, recorded listings, or Internet listings, respectively.
  • Options region 526 may allow the user to access different types of content, interactive media guidance application displays, and/or interactive media guidance application features. Options region 526 may be part of display 500 (and other display screens described herein), or may be invoked by a user by selecting an on-screen option or pressing a dedicated or assignable button on a user input device. The selectable options within options region 526 may concern features related to program listings in grid 502 or may include options available from a main menu display. Features related to program listings may include searching for other air times or ways of receiving a program, recording a program, enabling series recording of a program, setting program and/or channel as a favorite, purchasing a program, or other features.
  • Control circuitry 704 may include video generating circuitry and tuning circuitry, such as one or more analog tuners, one or more MPEG-2 decoders or other digital decoding circuitry, high-definition tuners, or any other suitable tuning or video circuits or combinations of such circuits. Encoding circuitry (e.g., for converting over-the-air, analog, or digital signals to MPEG signals for storage) may also be provided. Control circuitry 704 may also include scaler circuitry for upconverting and downconverting content into the preferred output format of the user equipment 700. Circuitry 704 may also include digital-to-analog converter circuitry and analog-to-digital converter circuitry for converting between digital and analog signals.
  • the user may also set various settings to maintain consistent interactive media guidance application settings across in-home devices and remote devices. Settings include those described herein, as well as channel and program favorites, programming preferences that the guidance application utilizes to make
  • the cloud provides access to services, such as content storage, content sharing, or social networking services, among other examples, as well as access to any content described above, for user equipment devices.
  • Services can be provided in the cloud through cloud computing service providers, or through other providers of online services.
  • the cloud-based services can include a content storage service, a content sharing site, a social networking site, or other services via which user-sourced content is distributed for viewing by others on connected devices. These cloud-based services may allow a user equipment device to store content to the cloud and to receive content from the cloud rather than storing content locally and accessing locally-stored content.
  • a user may use various content capture devices, such as camcorders, digital cameras with video mode, audio recorders, mobile phones, and handheld computing devices, to record content.
  • the user can upload content to a content storage service on the cloud either directly, for example, from user computer equipment 804 or wireless user communications device 806 having content capture feature.
  • the user can first transfer the content to a user equipment device, such as user computer equipment 804.
  • the user equipment device storing the content uploads the content to the cloud using a data transmission service on communications network 814.
  • the user equipment device itself is a cloud resource, and other user equipment devices can access the content directly from the user equipment device on which the user stored the content.
  • control circuitry 704 generates for display an interactive media guidance screen including at least one of the first possible response and the second possible response.
  • control circuitry 704 may generate for display an interactive media guidance screen including the sets of possible responses.
  • control circuitry 704 may respond using natural language speech "Did you mean Shawshank Redemption.”
  • the input from the user indicating feedback comprises one of an indication that the first possible response is correct and an indication that the first possible response is incorrect. For example, in response to "Did you mean Shawshank Redemption," the input from the user may indicate feedback that Shawshank Redemption is an incorrect response.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Library & Information Science (AREA)
  • Operations Research (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • User Interface Of Digital Computer (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
PCT/US2017/044332 2016-07-29 2017-07-28 Systems and methods for determining an execution path for a natural language query Ceased WO2018022970A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
KR1020187018501A KR102430625B1 (ko) 2016-07-29 2017-07-28 자연어 질의를 위한 실행 경로를 결정하기 위한 시스템 및 방법
JP2018534053A JP7114467B2 (ja) 2016-07-29 2017-07-28 自然言語クエリのための実行パスを判定するシステムおよび方法
AU2017302614A AU2017302614A1 (en) 2016-07-29 2017-07-28 Systems and methods for determining an execution path for a natural language query
EP17751183.9A EP3391254A1 (en) 2016-07-29 2017-07-28 Systems and methods for determining an execution path for a natural language query
CA2999091A CA2999091A1 (en) 2016-07-29 2017-07-28 Systems and methods for determining an execution path for a natural language query

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/223,155 US10380169B2 (en) 2016-07-29 2016-07-29 Systems and methods for determining an execution path for a natural language query
US15/223,155 2016-07-29

Publications (1)

Publication Number Publication Date
WO2018022970A1 true WO2018022970A1 (en) 2018-02-01

Family

ID=59579927

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/044332 Ceased WO2018022970A1 (en) 2016-07-29 2017-07-28 Systems and methods for determining an execution path for a natural language query

Country Status (7)

Country Link
US (1) US10380169B2 (enExample)
EP (1) EP3391254A1 (enExample)
JP (1) JP7114467B2 (enExample)
KR (1) KR102430625B1 (enExample)
AU (1) AU2017302614A1 (enExample)
CA (1) CA2999091A1 (enExample)
WO (1) WO2018022970A1 (enExample)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11170768B2 (en) * 2017-04-17 2021-11-09 Samsung Electronics Co., Ltd Device for performing task corresponding to user utterance
US11263405B2 (en) * 2018-10-10 2022-03-01 Healthpointe Solutions, Inc. System and method for answering natural language questions posed by a user
CN109614501B (zh) * 2018-12-13 2020-09-25 浙江工商大学 一种基于知识图谱的工业隐患规范化上报方法及系统
CN109902149B (zh) * 2019-02-21 2021-08-13 北京百度网讯科技有限公司 查询处理方法和装置、计算机可读介质
US11200222B2 (en) 2019-04-24 2021-12-14 International Business Machines Corporation Natural language interface databases
US12159113B2 (en) 2019-08-26 2024-12-03 Healthpointe Solutions, Inc. System and method for diagnosing disease through cognification of unstructured data
US12412670B2 (en) 2019-08-26 2025-09-09 Healthpointe Solutions, Inc. System and method for defining a user experience of medical data systems through a knowledge graph
KR102252459B1 (ko) * 2019-09-18 2021-05-14 주식회사 솔트룩스 지식 그래프 기반의 사용자 맞춤형 질의 응답 시스템
KR102797377B1 (ko) * 2019-11-26 2025-04-21 한국전력공사 지식 그래프 생성 방법 및 이를 이용한 신재생발전 항목 추천 시스템 및 방법
CN111147375A (zh) * 2019-12-31 2020-05-12 秒针信息技术有限公司 一种网络操作方法、装置、计算机设备和介质
JP7118319B2 (ja) * 2020-05-21 2022-08-15 三菱電機株式会社 推論装置、更新方法、及び更新プログラム
US12039459B2 (en) * 2020-09-08 2024-07-16 Fmr Llc Systems and methods for a digital ecosystem
JP7852034B2 (ja) 2021-08-16 2026-04-27 ストール マシーナリ カンパニー,エルエルシー 缶乾燥水分制御システム
KR102788438B1 (ko) * 2021-11-03 2025-03-31 한국전자통신연구원 자가 대화 학습을 위한 지식 기반 대화 시스템 및 이의 학습 방법

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6239794B1 (en) 1994-08-31 2001-05-29 E Guide, Inc. Method and system for simultaneously displaying a television program and information about the program
US20020174430A1 (en) 2001-02-21 2002-11-21 Ellis Michael D. Systems and methods for interactive program guides with personal video recording features
US6564378B1 (en) 1997-12-08 2003-05-13 United Video Properties, Inc. Program guide system with browsing display
US20050251827A1 (en) 1998-07-17 2005-11-10 United Video Properties, Inc. Interactive television program guide system having multiple devices within a household
US7165098B1 (en) 1998-11-10 2007-01-16 United Video Properties, Inc. On-line schedule system with personalization features
WO2010017159A1 (en) * 2008-08-05 2010-02-11 Beliefnetworks, Inc. Systems and methods for concept mapping
US20100153885A1 (en) 2005-12-29 2010-06-17 Rovi Technologies Corporation Systems and methods for interacting with advanced displays provided by an interactive media guidance application
US7761892B2 (en) 1998-07-14 2010-07-20 United Video Properties, Inc. Client server based interactive television program guide system with remote server recording
US8046801B2 (en) 1998-07-17 2011-10-25 United Video Properties, Inc. Interactive television program guide with remote access
US20150278691A1 (en) * 2014-04-01 2015-10-01 Microsoft Corporation User interests facilitated by a knowledge base
WO2016176098A1 (en) * 2015-04-27 2016-11-03 Rovi Guides, Inc. Systems and methods for updating a knowledge graph through user input

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6675159B1 (en) * 2000-07-27 2004-01-06 Science Applic Int Corp Concept-based search and retrieval system
JP5226401B2 (ja) 2008-06-25 2013-07-03 インターナショナル・ビジネス・マシーンズ・コーポレーション 文書データの検索を支援する装置及び方法
US8732208B2 (en) * 2010-04-19 2014-05-20 Facebook, Inc. Structured search queries based on social-graph information
US9928484B2 (en) * 2011-06-24 2018-03-27 Facebook, Inc. Suggesting tags in status messages based on social context
US9183279B2 (en) * 2011-09-22 2015-11-10 International Business Machines Corporation Semantic questioning mechanism to enable analysis of information architectures
KR101208964B1 (ko) * 2012-05-17 2012-12-07 한국과학기술정보연구원 온톨로지 기반 사용자 의도에 따른 정보 제공 방법 및 그 서버
US8996555B2 (en) * 2012-11-26 2015-03-31 Sap Se Question answering framework for structured query languages
WO2014144931A2 (en) * 2013-03-15 2014-09-18 Robert Haddock Intelligent internet system with adaptive user interface providing one-step access to knowledge
US20150112818A1 (en) * 2013-10-22 2015-04-23 Google Inc. Content item selection criteria generation
US20150169758A1 (en) * 2013-12-17 2015-06-18 Luigi ASSOM Multi-partite graph database
US9367629B2 (en) * 2013-12-19 2016-06-14 Facebook, Inc. Grouping recommended search queries on online social networks
US9477760B2 (en) * 2014-02-12 2016-10-25 Facebook, Inc. Query construction on online social networks
US10127316B2 (en) * 2014-08-08 2018-11-13 Facebook, Inc. Identifying and processing recommendation requests
US9703859B2 (en) * 2014-08-27 2017-07-11 Facebook, Inc. Keyword search queries on online social networks
US10031912B2 (en) * 2014-12-29 2018-07-24 International Business Machines Corporation Verification of natural language processing derived attributes
US11023541B2 (en) * 2014-12-30 2021-06-01 Rovi Guides, Inc. Methods and systems for providing media recommendations based on user location
US10147047B2 (en) * 2015-01-07 2018-12-04 International Business Machines Corporation Augmenting answer keys with key characteristics for training question and answer systems
CA2976007C (en) * 2015-02-13 2023-02-21 Thomson Reuters Global Resources Unlimited Company Systems and methods for natural language question answering and analysis
US10586156B2 (en) * 2015-06-25 2020-03-10 International Business Machines Corporation Knowledge canvassing using a knowledge graph and a question and answer system
US20180032930A1 (en) * 2015-10-07 2018-02-01 0934781 B.C. Ltd System and method to Generate Queries for a Business Database
US10248689B2 (en) * 2015-10-13 2019-04-02 International Business Machines Corporation Supplementing candidate answers
US10289729B2 (en) * 2016-03-17 2019-05-14 Google Llc Question and answer interface based on contextual information
US10860936B2 (en) * 2016-05-13 2020-12-08 Cognitive Scale, Inc. Universal quantification of knowledge elements within a cognitive graph

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6239794B1 (en) 1994-08-31 2001-05-29 E Guide, Inc. Method and system for simultaneously displaying a television program and information about the program
US6564378B1 (en) 1997-12-08 2003-05-13 United Video Properties, Inc. Program guide system with browsing display
US7761892B2 (en) 1998-07-14 2010-07-20 United Video Properties, Inc. Client server based interactive television program guide system with remote server recording
US20050251827A1 (en) 1998-07-17 2005-11-10 United Video Properties, Inc. Interactive television program guide system having multiple devices within a household
US8046801B2 (en) 1998-07-17 2011-10-25 United Video Properties, Inc. Interactive television program guide with remote access
US7165098B1 (en) 1998-11-10 2007-01-16 United Video Properties, Inc. On-line schedule system with personalization features
US20020174430A1 (en) 2001-02-21 2002-11-21 Ellis Michael D. Systems and methods for interactive program guides with personal video recording features
US20100153885A1 (en) 2005-12-29 2010-06-17 Rovi Technologies Corporation Systems and methods for interacting with advanced displays provided by an interactive media guidance application
WO2010017159A1 (en) * 2008-08-05 2010-02-11 Beliefnetworks, Inc. Systems and methods for concept mapping
US20150278691A1 (en) * 2014-04-01 2015-10-01 Microsoft Corporation User interests facilitated by a knowledge base
WO2016176098A1 (en) * 2015-04-27 2016-11-03 Rovi Guides, Inc. Systems and methods for updating a knowledge graph through user input

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ESTHER KAUFMANN ET AL: "Querix: A Natural Language Interface to Query Ontologies Based on Clarification Dialogs", 30 November 2006 (2006-11-30), XP055407028, Retrieved from the Internet <URL:https://pdfs.semanticscholar.org/0c17/5b51d158321f332d7c08c861eaf07fb6aabc.pdf> [retrieved on 20170915] *

Also Published As

Publication number Publication date
AU2017302614A1 (en) 2018-07-12
KR20190034490A (ko) 2019-04-02
JP7114467B2 (ja) 2022-08-08
US10380169B2 (en) 2019-08-13
CA2999091A1 (en) 2018-02-01
KR102430625B1 (ko) 2022-08-08
US20180032514A1 (en) 2018-02-01
JP2019526081A (ja) 2019-09-12
EP3391254A1 (en) 2018-10-24

Similar Documents

Publication Publication Date Title
AU2022205155B2 (en) Systems and methods for executing a supplemental function for a natural language query
AU2021245232B2 (en) Systems and methods for determining context switching in conversation
US10380169B2 (en) Systems and methods for determining an execution path for a natural language query
US11798565B2 (en) Systems and methods for identifying users based on voice data and media consumption data
US20250150680A1 (en) Systems and methods for sorting favorite content sources
US11507618B2 (en) Systems and methods for flexibly using trending topics as parameters for recommending media assets that are related to a viewed media asset
US20190327509A1 (en) Systems and methods for optimizing content viewing using digital rights of multiple users
CA2999073C (en) Systems and methods for executing a supplemental function for a natural language query

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2999091

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 20187018501

Country of ref document: KR

Kind code of ref document: A

Ref document number: 2018534053

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2017302614

Country of ref document: AU

Date of ref document: 20170728

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2017751183

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2017751183

Country of ref document: EP

Effective date: 20180716

NENP Non-entry into the national phase

Ref country code: DE