AU2022281319A1 - Data-driven taxonomy for annotation resolution - Google Patents
Data-driven taxonomy for annotation resolution Download PDFInfo
- Publication number
- AU2022281319A1 AU2022281319A1 AU2022281319A AU2022281319A AU2022281319A1 AU 2022281319 A1 AU2022281319 A1 AU 2022281319A1 AU 2022281319 A AU2022281319 A AU 2022281319A AU 2022281319 A AU2022281319 A AU 2022281319A AU 2022281319 A1 AU2022281319 A1 AU 2022281319A1
- Authority
- AU
- Australia
- Prior art keywords
- intent
- confusion
- intents
- graphical representation
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims description 84
- 230000015654 memory Effects 0.000 claims description 49
- 238000007596 consolidation process Methods 0.000 claims description 6
- 238000011156 evaluation Methods 0.000 abstract description 131
- 238000012800 visualization Methods 0.000 description 78
- 239000003795 chemical substances by application Substances 0.000 description 70
- 238000004422 calculation algorithm Methods 0.000 description 68
- 238000010801 machine learning Methods 0.000 description 53
- 230000008569 process Effects 0.000 description 40
- 230000004044 response Effects 0.000 description 36
- 230000008859 change Effects 0.000 description 22
- 238000004891 communication Methods 0.000 description 17
- 238000013145 classification model Methods 0.000 description 15
- 238000004590 computer program Methods 0.000 description 10
- 238000012937 correction Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- 230000009466 transformation Effects 0.000 description 8
- 230000005291 magnetic effect Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000013500 data storage Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000009471 action Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 239000003086 colorant Substances 0.000 description 4
- 230000008878 coupling Effects 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 4
- 238000005859 coupling reaction Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000002776 aggregation Effects 0.000 description 3
- 238000004220 aggregation Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012552 review Methods 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000003442 weekly effect Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000003066 decision tree Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000003064 k means clustering Methods 0.000 description 1
- 238000012417 linear regression Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007477 logistic regression Methods 0.000 description 1
- 239000005022 packaging material Substances 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 238000007637 random forest analysis Methods 0.000 description 1
- 238000011867 re-evaluation Methods 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/01—Customer relationship services
- G06Q30/015—Providing customer assistance, e.g. assisting a customer within a business location or via helpdesk
- G06Q30/016—After-sales
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/169—Annotation, e.g. comment data or footnotes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
- G06F40/35—Discourse or dialogue representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
- G06F40/42—Data-driven translation
- G06F40/44—Statistical methods, e.g. probability models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/20—Drawing from basic elements, e.g. lines or circles
- G06T11/206—Drawing of charts or graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Finance (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Probability & Statistics with Applications (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Heat Sensitive Colour Forming Recording (AREA)
- Information Transfer Between Computers (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US202163192314P | 2021-05-24 | 2021-05-24 | |
| US63/192,314 | 2021-05-24 | ||
| PCT/US2022/030665 WO2022251172A1 (en) | 2021-05-24 | 2022-05-24 | Data-driven taxonomy for annotation resolution |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| AU2022281319A1 true AU2022281319A1 (en) | 2023-11-16 |
| AU2022281319B2 AU2022281319B2 (en) | 2024-07-11 |
Family
ID=82214218
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| AU2022281319A Active AU2022281319B2 (en) | 2021-05-24 | 2022-05-24 | Data-driven taxonomy for annotation resolution |
Country Status (8)
| Country | Link |
|---|---|
| US (2) | US11676156B2 (ja) |
| EP (1) | EP4348494A1 (ja) |
| JP (1) | JP2024521150A (ja) |
| CN (1) | CN117355841A (ja) |
| AU (1) | AU2022281319B2 (ja) |
| CA (1) | CA3218206A1 (ja) |
| IL (1) | IL308086A (ja) |
| WO (1) | WO2022251172A1 (ja) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11875121B2 (en) * | 2021-05-28 | 2024-01-16 | International Business Machines Corporation | Generating responses for live-streamed questions |
| US20230027936A1 (en) * | 2021-07-23 | 2023-01-26 | Verizon Patent And Licensing Inc. | Conversational interaction entity testing |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6216134B1 (en) * | 1998-06-25 | 2001-04-10 | Microsoft Corporation | Method and system for visualization of clusters and classifications |
| US20070266039A1 (en) * | 2006-05-11 | 2007-11-15 | Boykin James R | Simplifying A Visual Depiction of A Graph |
| US8458171B2 (en) * | 2009-01-30 | 2013-06-04 | Google Inc. | Identifying query aspects |
| US20110037766A1 (en) * | 2009-08-17 | 2011-02-17 | Nexidia Inc. | Cluster map display |
| US20130232452A1 (en) * | 2013-02-01 | 2013-09-05 | Concurix Corporation | Force Directed Graph with Time Series Data |
| EP3039821B1 (en) * | 2013-08-26 | 2016-12-21 | Telefonaktiebolaget LM Ericsson (publ) | Apparatus and method for processing data streams in a communication network |
| US8689108B1 (en) * | 2013-09-24 | 2014-04-01 | Palantir Technologies, Inc. | Presentation and analysis of user interaction data |
| US20170337293A1 (en) * | 2016-05-18 | 2017-11-23 | Sisense Ltd. | System and method of rendering multi-variant graphs |
| US10510336B2 (en) * | 2017-06-12 | 2019-12-17 | International Business Machines Corporation | Method, apparatus, and system for conflict detection and resolution for competing intent classifiers in modular conversation system |
| US10963525B2 (en) * | 2017-07-07 | 2021-03-30 | Avnet, Inc. | Artificial intelligence system for providing relevant content queries across unconnected websites via a conversational environment |
| EP3622392A1 (en) | 2017-08-22 | 2020-03-18 | Google LLC | Facilitating user device and/or agent device actions during a communication session |
| US10824962B2 (en) * | 2017-09-29 | 2020-11-03 | Oracle International Corporation | Utterance quality estimation |
| US10884598B2 (en) * | 2017-09-29 | 2021-01-05 | Oracle International Corporation | Analytics for a bot system |
| US10776582B2 (en) * | 2018-06-06 | 2020-09-15 | International Business Machines Corporation | Supporting combinations of intents in a conversation |
| US10832659B2 (en) * | 2018-08-31 | 2020-11-10 | International Business Machines Corporation | Intent authoring using weak supervision and co-training for automated response systems |
| US10902199B2 (en) * | 2019-06-12 | 2021-01-26 | Liveperson, Inc. | Systems and methods for communication system intent analysis |
| US11928611B2 (en) * | 2019-11-18 | 2024-03-12 | International Business Machines Corporation | Conversational interchange optimization |
-
2022
- 2022-05-24 CA CA3218206A patent/CA3218206A1/en active Pending
- 2022-05-24 EP EP22733786.2A patent/EP4348494A1/en active Pending
- 2022-05-24 AU AU2022281319A patent/AU2022281319B2/en active Active
- 2022-05-24 US US17/752,030 patent/US11676156B2/en active Active
- 2022-05-24 CN CN202280037557.5A patent/CN117355841A/zh active Pending
- 2022-05-24 WO PCT/US2022/030665 patent/WO2022251172A1/en active Application Filing
- 2022-05-24 IL IL308086A patent/IL308086A/en unknown
- 2022-05-24 JP JP2023572563A patent/JP2024521150A/ja active Pending
-
2023
- 2023-05-02 US US18/142,092 patent/US20230410123A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022251172A1 (en) | 2022-12-01 |
| EP4348494A1 (en) | 2024-04-10 |
| IL308086A (en) | 2023-12-01 |
| CN117355841A (zh) | 2024-01-05 |
| JP2024521150A (ja) | 2024-05-28 |
| US20230410123A1 (en) | 2023-12-21 |
| AU2022281319B2 (en) | 2024-07-11 |
| US11676156B2 (en) | 2023-06-13 |
| CA3218206A1 (en) | 2022-12-01 |
| US20220374909A1 (en) | 2022-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11847578B2 (en) | Chatbot for defining a machine learning (ML) solution | |
| US20210081848A1 (en) | Techniques for adaptive pipelining composition for machine learning (ml) | |
| US12067571B2 (en) | Systems and methods for generating models for classifying imbalanced data | |
| US20230410123A1 (en) | Data-driven taxonomy for annotation resolution | |
| US11876757B2 (en) | Conversational bot evaluation and reinforcement using meaningful automated connection scores | |
| US12039424B2 (en) | Systems and methods for managing, distributing and deploying a recursive decisioning system based on continuously updating machine learning models | |
| US20210374760A1 (en) | Systems and methods for intent response solicitation and processing | |
| US11610068B2 (en) | Systems and method for intent messaging | |
| US12020170B2 (en) | Systems and methods for intent discovery and process execution | |
| US20240249201A1 (en) | Systems and methods for managing, distributing and deploying a recursive decisioning system based on continuously updating machine learning models | |
| US20230297965A1 (en) | Automated credential processing system |