CN116802629B - 用于自然语言处理的多因素建模 - Google Patents

用于自然语言处理的多因素建模

Info

Publication number
CN116802629B
CN116802629B CN202280010693.5A CN202280010693A CN116802629B CN 116802629 B CN116802629 B CN 116802629B CN 202280010693 A CN202280010693 A CN 202280010693A CN 116802629 B CN116802629 B CN 116802629B
Authority
CN
China
Prior art keywords
skill
intent
data
skills
utterance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202280010693.5A
Other languages
English (en)
Chinese (zh)
Other versions
CN116802629A (zh
Inventor
E·L·贾拉勒丁
V·比什诺伊
M·E·约翰逊
T·L·杜翁
徐莹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oracle International Corp
Original Assignee
Oracle International Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oracle International Corp filed Critical Oracle International Corp
Publication of CN116802629A publication Critical patent/CN116802629A/zh
Application granted granted Critical
Publication of CN116802629B publication Critical patent/CN116802629B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/55—Rule-based translation
    • G06F40/56—Natural language generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
    • G06F40/295—Named entity recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis
    • G06F40/35—Discourse or dialogue representation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/02—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Machine Translation (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN202280010693.5A 2021-01-20 2022-01-19 用于自然语言处理的多因素建模 Active CN116802629B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202163139693P 2021-01-20 2021-01-20
US63/139,693 2021-01-20
US17/578,170 US12099816B2 (en) 2021-01-20 2022-01-18 Multi-factor modelling for natural language processing
US17/578,170 2022-01-18
PCT/US2022/012936 WO2022159461A1 (en) 2021-01-20 2022-01-19 Multi-factor modelling for natural language processing

Publications (2)

Publication Number Publication Date
CN116802629A CN116802629A (zh) 2023-09-22
CN116802629B true CN116802629B (zh) 2026-04-21

Family

ID=82406310

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202280010693.5A Active CN116802629B (zh) 2021-01-20 2022-01-19 用于自然语言处理的多因素建模

Country Status (4)

Country Link
US (1) US12099816B2 (https=)
JP (1) JP2024503517A (https=)
CN (1) CN116802629B (https=)
WO (1) WO2022159461A1 (https=)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
CN111126062B (zh) * 2019-12-25 2021-09-24 北京中技华软科技服务有限公司 一种产业自动分类方法及系统
US11550605B2 (en) * 2020-06-30 2023-01-10 Kasisto, Inc. Building and managing cohesive interaction for virtual assistants
US12099816B2 (en) * 2021-01-20 2024-09-24 Oracle International Corporation Multi-factor modelling for natural language processing
US11694018B2 (en) * 2021-01-29 2023-07-04 Salesforce, Inc. Machine-learning based generation of text style variations for digital content items
US11862157B2 (en) * 2021-02-24 2024-01-02 Conversenow Ai Automated ordering system
US11798549B2 (en) * 2021-03-19 2023-10-24 Mitel Networks Corporation Generating action items during a conferencing session
US12340792B2 (en) * 2021-05-17 2025-06-24 Salesforce, Inc. Systems and methods for few-shot intent classifier models
US12288036B2 (en) * 2021-06-01 2025-04-29 Apple Inc. Reform input in flow execution
US11978453B2 (en) * 2021-06-14 2024-05-07 Amazon Technologies, Inc. Natural language processing routing
CN117151090A (zh) * 2022-05-19 2023-12-01 株式会社理光 机器阅读理解模型的训练方法、装置及可读存储介质
US12406149B2 (en) * 2022-07-06 2025-09-02 Tata Consultancy Services Limited System and method for intent discovery from user logs using deep semi-supervised contrastive clustering
US12443796B2 (en) * 2022-07-28 2025-10-14 International Business Machines Corporation Out of domain sentence detection
US12248500B2 (en) * 2023-05-18 2025-03-11 Bank Of America Corporation Dynamic response engine
US12554518B2 (en) * 2023-08-04 2026-02-17 Dell Products L.P. Smart input devices with user behavior predictions
US12482454B2 (en) * 2023-08-10 2025-11-25 Fifth Third Bank Methods and systems for training and deploying natural language understanding models
US12608562B2 (en) * 2023-09-21 2026-04-21 Google Llc Providing personalized prompts to users based on documents in cloud storage
US12475325B2 (en) * 2023-11-09 2025-11-18 Oracle International Corporation Model robustness on operators and triggering keywords in natural language to a meaning representation language system
US12314305B1 (en) * 2024-11-24 2025-05-27 Signet Health Corporation System and method for generating an updated terminal node projection

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7822699B2 (en) * 2005-11-30 2010-10-26 Microsoft Corporation Adaptive semantic reasoning engine
JP2008090545A (ja) * 2006-09-29 2008-04-17 Toshiba Corp 音声対話装置および音声対話方法
US10241752B2 (en) * 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
JP5695199B2 (ja) * 2010-08-30 2015-04-01 本田技研工業株式会社 対話システムにおける思考追跡および行動選択
CN106462647A (zh) * 2016-06-28 2017-02-22 深圳狗尾草智能科技有限公司 一种基于多意图的多技能包问答方法、系统和机器人
US10170107B1 (en) * 2016-12-29 2019-01-01 Amazon Technologies, Inc. Extendable label recognition of linguistic input
US11025566B2 (en) * 2017-04-12 2021-06-01 Facebook, Inc. Techniques for intent-based search for bots
DK201770431A1 (en) * 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK201770432A1 (en) * 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
US10884598B2 (en) * 2017-09-29 2021-01-05 Oracle International Corporation Analytics for a bot system
US11394667B2 (en) * 2017-10-03 2022-07-19 Rupert Labs, Inc. Chatbot skills systems and methods
US11295735B1 (en) * 2017-12-13 2022-04-05 Amazon Technologies, Inc. Customizing voice-control for developer devices
US11631017B2 (en) * 2018-01-09 2023-04-18 Microsoft Technology Licensing, Llc Federated intelligent assistance
US11416740B2 (en) * 2018-04-13 2022-08-16 Adtran, Inc. Artificial intelligence optimized telecommunications systems
US10811009B2 (en) * 2018-06-27 2020-10-20 International Business Machines Corporation Automatic skill routing in conversational computing frameworks
CN112154465B (zh) * 2018-09-19 2025-02-21 华为技术有限公司 一种意图识别模型的学习方法、装置及设备
US11023787B2 (en) * 2018-10-19 2021-06-01 Oracle International Corporation Method, system and program for generating decision trees for chatbots dialog flow capabilities
US10878805B2 (en) * 2018-12-06 2020-12-29 Microsoft Technology Licensing, Llc Expediting interaction with a digital assistant by predicting user responses
US11355098B1 (en) * 2018-12-13 2022-06-07 Amazon Technologies, Inc. Centralized feedback service for performance of virtual assistant
WO2020163627A1 (en) 2019-02-07 2020-08-13 Clinc, Inc. Systems and methods for machine learning-based multi-intent segmentation and classification
US11978452B2 (en) * 2019-04-26 2024-05-07 Oracle International Corportion Handling explicit invocation of chatbots
US11461311B2 (en) * 2019-04-26 2022-10-04 Oracle International Corporation Bot extensibility infrastructure
EP3959658B1 (en) 2019-04-26 2024-05-29 Oracle International Corporation Insights into performance of a bot system
US11416755B2 (en) * 2019-08-30 2022-08-16 Accenture Global Solutions Limited Artificial intelligence based system and method for controlling virtual agent task flow
US11928430B2 (en) * 2019-09-12 2024-03-12 Oracle International Corporation Detecting unrelated utterances in a chatbot system
US20220366908A1 (en) * 2019-09-26 2022-11-17 Sony Group Corporation Information processing apparatus and information processing method
US11587551B2 (en) * 2020-04-07 2023-02-21 International Business Machines Corporation Leveraging unpaired text data for training end-to-end spoken language understanding systems
US11625543B2 (en) * 2020-05-31 2023-04-11 Salesforce.Com, Inc. Systems and methods for composed variational natural language generation
JP2023544328A (ja) * 2020-09-30 2023-10-23 オラクル・インターナショナル・コーポレイション チャットボットの自動スコープ外遷移
CN112164391B (zh) 2020-10-16 2024-04-05 腾讯科技（深圳）有限公司 语句处理方法、装置、电子设备及存储介质
US11699444B1 (en) * 2020-10-23 2023-07-11 Amazon Technologies, Inc. Speech recognition using multiple voice-enabled devices
US20240054156A1 (en) * 2020-10-28 2024-02-15 Meta Platforms, Inc. Personalized Labeling for User Memory Exploration for Assistant Systems
US12099816B2 (en) * 2021-01-20 2024-09-24 Oracle International Corporation Multi-factor modelling for natural language processing
US11978453B2 (en) * 2021-06-14 2024-05-07 Amazon Technologies, Inc. Natural language processing routing
US11782964B2 (en) * 2021-10-08 2023-10-10 Adp, Inc. Method to recommend intents based on a weighted ranked hierarchical graph

Also Published As

Publication number Publication date
US20220230000A1 (en) 2022-07-21
CN116802629A (zh) 2023-09-22
JP2024503517A (ja) 2024-01-25
WO2022159461A1 (en) 2022-07-28
US12099816B2 (en) 2024-09-24

Similar Documents

Publication Publication Date Title
CN116802629B (zh) 用于自然语言处理的多因素建模
CN116724305B (zh) 上下文标签与命名实体识别模型的集成
CN115398437B (zh) 改进的域外(ood)检测技术
CN114424185B (zh) 用于自然语言处理的停用词数据扩充
CN115398436B (zh) 用于自然语言处理的噪声数据扩充
CN116583837B (zh) 用于自然语言处理的基于距离的logit值
CN116547676B (zh) 用于自然语言处理的增强型logit
US12153885B2 (en) Multi-feature balancing for natural language processors
CN115917553A (zh) 在聊天机器人中实现稳健命名实体识别的实体级数据扩充
CN118140230A (zh) 对经预训练的语言模型的单个转换器层的多头网络进行微调
CN118265981B (zh) 用于为预训练的语言模型处置长文本的系统和技术
CN117296058A (zh) 作为简单有效的对抗攻击方法的变体不一致攻击（via）
CN118202344A (zh) 用于从文档中提取嵌入式数据的深度学习技术
CN116490879A (zh) 用于神经网络中过度预测的方法和系统
JP2024543062A (ja) 自然言語処理のパスのドロップアウト
CN118215920A (zh) 用于使用散列嵌入进行语言检测的宽深网络
CN119183573A (zh) 实体感知数据增强技术
CN118251668A (zh) 用于从数据中提取问题答案对的基于规则的技术
CN116235164B (zh) 聊天机器人的范围外自动转变
CN121936414A (zh) 用于为预训练的语言模型处置长文本的系统和技术
CN120092248A (zh) 基于目标的超参数调谐中的目标函数优化
CN119768794A (zh) 自适应训练数据扩充以促进命名实体识别模型的训练
CN121773407A (zh) 用于将自然语言谈话变换成可视化表示的技术
CN116235164A (zh) 聊天机器人的范围外自动转变

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant