JP2024503517A - 自然言語処理のための多因子モデリング - Google Patents

自然言語処理のための多因子モデリング Download PDF

Info

Publication number
JP2024503517A
JP2024503517A JP2023543398A JP2023543398A JP2024503517A JP 2024503517 A JP2024503517 A JP 2024503517A JP 2023543398 A JP2023543398 A JP 2023543398A JP 2023543398 A JP2023543398 A JP 2023543398A JP 2024503517 A JP2024503517 A JP 2024503517A
Authority
JP
Japan
Prior art keywords
skill
intent
data
utterance
skills
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2023543398A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2022159461A5 (https=
JP2024503517A5 (https=
Inventor
ジャラルッディン，エリアス・ルクマン
ビシュノイ，ビシャル
ジョンソン，マーク・エドワード
ドゥオング，タン・ロング
シュ，イン
Original Assignee
オラクル・インターナショナル・コーポレイション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オラクル・インターナショナル・コーポレイション filed Critical オラクル・インターナショナル・コーポレイション
Publication of JP2024503517A publication Critical patent/JP2024503517A/ja
Publication of JPWO2022159461A5 publication Critical patent/JPWO2022159461A5/ja
Publication of JP2024503517A5 publication Critical patent/JP2024503517A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/55—Rule-based translation
    • G06F40/56—Natural language generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/02—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
    • G06F40/295—Named entity recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis
    • G06F40/35—Discourse or dialogue representation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Machine Translation (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2023543398A 2021-01-20 2022-01-19 自然言語処理のための多因子モデリング Pending JP2024503517A (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202163139693P 2021-01-20 2021-01-20
US63/139,693 2021-01-20
US17/578,170 US12099816B2 (en) 2021-01-20 2022-01-18 Multi-factor modelling for natural language processing
US17/578,170 2022-01-18
PCT/US2022/012936 WO2022159461A1 (en) 2021-01-20 2022-01-19 Multi-factor modelling for natural language processing

Publications (3)

Publication Number Publication Date
JP2024503517A true JP2024503517A (ja) 2024-01-25
JPWO2022159461A5 JPWO2022159461A5 (https=) 2025-01-17
JP2024503517A5 JP2024503517A5 (https=) 2025-01-17

Family

ID=82406310

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023543398A Pending JP2024503517A (ja) 2021-01-20 2022-01-19 自然言語処理のための多因子モデリング

Country Status (4)

Country Link
US (1) US12099816B2 (https=)
JP (1) JP2024503517A (https=)
CN (1) CN116802629B (https=)
WO (1) WO2022159461A1 (https=)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
CN111126062B (zh) * 2019-12-25 2021-09-24 北京中技华软科技服务有限公司 一种产业自动分类方法及系统
US11550605B2 (en) * 2020-06-30 2023-01-10 Kasisto, Inc. Building and managing cohesive interaction for virtual assistants
US12099816B2 (en) * 2021-01-20 2024-09-24 Oracle International Corporation Multi-factor modelling for natural language processing
US11694018B2 (en) * 2021-01-29 2023-07-04 Salesforce, Inc. Machine-learning based generation of text style variations for digital content items
US11862157B2 (en) * 2021-02-24 2024-01-02 Conversenow Ai Automated ordering system
US11798549B2 (en) * 2021-03-19 2023-10-24 Mitel Networks Corporation Generating action items during a conferencing session
US12340792B2 (en) * 2021-05-17 2025-06-24 Salesforce, Inc. Systems and methods for few-shot intent classifier models
US12288036B2 (en) * 2021-06-01 2025-04-29 Apple Inc. Reform input in flow execution
US11978453B2 (en) * 2021-06-14 2024-05-07 Amazon Technologies, Inc. Natural language processing routing
CN117151090A (zh) * 2022-05-19 2023-12-01 株式会社理光 机器阅读理解模型的训练方法、装置及可读存储介质
US12406149B2 (en) * 2022-07-06 2025-09-02 Tata Consultancy Services Limited System and method for intent discovery from user logs using deep semi-supervised contrastive clustering
US12443796B2 (en) * 2022-07-28 2025-10-14 International Business Machines Corporation Out of domain sentence detection
US12248500B2 (en) * 2023-05-18 2025-03-11 Bank Of America Corporation Dynamic response engine
US12554518B2 (en) * 2023-08-04 2026-02-17 Dell Products L.P. Smart input devices with user behavior predictions
US12482454B2 (en) * 2023-08-10 2025-11-25 Fifth Third Bank Methods and systems for training and deploying natural language understanding models
US12608562B2 (en) * 2023-09-21 2026-04-21 Google Llc Providing personalized prompts to users based on documents in cloud storage
US12475325B2 (en) * 2023-11-09 2025-11-18 Oracle International Corporation Model robustness on operators and triggering keywords in natural language to a meaning representation language system
US12314305B1 (en) * 2024-11-24 2025-05-27 Signet Health Corporation System and method for generating an updated terminal node projection

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008090545A (ja) * 2006-09-29 2008-04-17 Toshiba Corp 音声対話装置および音声対話方法
JP2020518893A (ja) * 2017-04-12 2020-06-25 フェイスブック，インク． 意図に基づいてボットを検索するための技術
US20200342032A1 (en) * 2019-04-26 2020-10-29 Oracle International Corporation Insights into performance of a bot system

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7822699B2 (en) * 2005-11-30 2010-10-26 Microsoft Corporation Adaptive semantic reasoning engine
US10241752B2 (en) * 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
JP5695199B2 (ja) * 2010-08-30 2015-04-01 本田技研工業株式会社 対話システムにおける思考追跡および行動選択
CN106462647A (zh) * 2016-06-28 2017-02-22 深圳狗尾草智能科技有限公司 一种基于多意图的多技能包问答方法、系统和机器人
US10170107B1 (en) * 2016-12-29 2019-01-01 Amazon Technologies, Inc. Extendable label recognition of linguistic input
DK201770431A1 (en) * 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK201770432A1 (en) * 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
US10884598B2 (en) * 2017-09-29 2021-01-05 Oracle International Corporation Analytics for a bot system
US11394667B2 (en) * 2017-10-03 2022-07-19 Rupert Labs, Inc. Chatbot skills systems and methods
US11295735B1 (en) * 2017-12-13 2022-04-05 Amazon Technologies, Inc. Customizing voice-control for developer devices
US11631017B2 (en) * 2018-01-09 2023-04-18 Microsoft Technology Licensing, Llc Federated intelligent assistance
US11416740B2 (en) * 2018-04-13 2022-08-16 Adtran, Inc. Artificial intelligence optimized telecommunications systems
US10811009B2 (en) * 2018-06-27 2020-10-20 International Business Machines Corporation Automatic skill routing in conversational computing frameworks
CN112154465B (zh) * 2018-09-19 2025-02-21 华为技术有限公司 一种意图识别模型的学习方法、装置及设备
US11023787B2 (en) * 2018-10-19 2021-06-01 Oracle International Corporation Method, system and program for generating decision trees for chatbots dialog flow capabilities
US10878805B2 (en) * 2018-12-06 2020-12-29 Microsoft Technology Licensing, Llc Expediting interaction with a digital assistant by predicting user responses
US11355098B1 (en) * 2018-12-13 2022-06-07 Amazon Technologies, Inc. Centralized feedback service for performance of virtual assistant
WO2020163627A1 (en) 2019-02-07 2020-08-13 Clinc, Inc. Systems and methods for machine learning-based multi-intent segmentation and classification
US11978452B2 (en) * 2019-04-26 2024-05-07 Oracle International Corportion Handling explicit invocation of chatbots
US11461311B2 (en) * 2019-04-26 2022-10-04 Oracle International Corporation Bot extensibility infrastructure
US11416755B2 (en) * 2019-08-30 2022-08-16 Accenture Global Solutions Limited Artificial intelligence based system and method for controlling virtual agent task flow
US11928430B2 (en) * 2019-09-12 2024-03-12 Oracle International Corporation Detecting unrelated utterances in a chatbot system
US20220366908A1 (en) * 2019-09-26 2022-11-17 Sony Group Corporation Information processing apparatus and information processing method
US11587551B2 (en) * 2020-04-07 2023-02-21 International Business Machines Corporation Leveraging unpaired text data for training end-to-end spoken language understanding systems
US11625543B2 (en) * 2020-05-31 2023-04-11 Salesforce.Com, Inc. Systems and methods for composed variational natural language generation
JP2023544328A (ja) * 2020-09-30 2023-10-23 オラクル・インターナショナル・コーポレイション チャットボットの自動スコープ外遷移
CN112164391B (zh) 2020-10-16 2024-04-05 腾讯科技（深圳）有限公司 语句处理方法、装置、电子设备及存储介质
US11699444B1 (en) * 2020-10-23 2023-07-11 Amazon Technologies, Inc. Speech recognition using multiple voice-enabled devices
US20240054156A1 (en) * 2020-10-28 2024-02-15 Meta Platforms, Inc. Personalized Labeling for User Memory Exploration for Assistant Systems
US12099816B2 (en) * 2021-01-20 2024-09-24 Oracle International Corporation Multi-factor modelling for natural language processing
US11978453B2 (en) * 2021-06-14 2024-05-07 Amazon Technologies, Inc. Natural language processing routing
US11782964B2 (en) * 2021-10-08 2023-10-10 Adp, Inc. Method to recommend intents based on a weighted ranked hierarchical graph

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008090545A (ja) * 2006-09-29 2008-04-17 Toshiba Corp 音声対話装置および音声対話方法
JP2020518893A (ja) * 2017-04-12 2020-06-25 フェイスブック，インク． 意図に基づいてボットを検索するための技術
US20200342032A1 (en) * 2019-04-26 2020-10-29 Oracle International Corporation Insights into performance of a bot system

Also Published As

Publication number Publication date
US20220230000A1 (en) 2022-07-21
CN116802629A (zh) 2023-09-22
CN116802629B (zh) 2026-04-21
WO2022159461A1 (en) 2022-07-28
US12099816B2 (en) 2024-09-24

Similar Documents

Publication Publication Date Title
US12099816B2 (en) Multi-factor modelling for natural language processing
JP7703667B2 (ja) 固有表現認識モデルを用いたコンテキストタグ統合
JP7721559B2 (ja) 自然言語処理のためのノイズデータ拡張
US12512091B2 (en) Fine-tuning multi-head network from a single transformer layer of pre-trained language model
JP7843760B2 (ja) 自然言語処理のための距離ベースのロジット値
US12288550B2 (en) Framework for focused training of language models and techniques for end-to-end hypertuning of the framework
JP7726995B2 (ja) 自然言語処理のための強化されたロジット
JP7771196B2 (ja) 自然言語プロセッサのための複数特徴均衡化
JP2023520416A (ja) ドメイン外（ｏｏｄ）検出のための改良された技術
JP2023551860A (ja) 自然言語処理のためのドメイン外データ拡張
JP7692482B2 (ja) ニューラルネットワークにおける過剰予測のための方法およびシステム
US12412563B2 (en) Path dropout for natural language processing
KR102821062B1 (ko) 사전-트레이닝된 언어 모델들에 대한 긴 텍스트를 핸들링하기 위한 시스템 및 기술들
JP2024540111A (ja) 文書からの埋め込まれるデータの抽出のための深層学習技術
US12572852B2 (en) Lexical dropout for natural language processing
US20230136965A1 (en) Prohibiting inconsistent named entity recognition tag sequences
CN121936414A (zh) 用于为预训练的语言模型处置长文本的系统和技术

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250108

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20250108

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20251127

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260106

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260403