JP7843760B2 - 自然言語処理のための距離ベースのロジット値 - Google Patents

自然言語処理のための距離ベースのロジット値

Info

Publication number
JP7843760B2
JP7843760B2 JP2023532762A JP2023532762A JP7843760B2 JP 7843760 B2 JP7843760 B2 JP 7843760B2 JP 2023532762 A JP2023532762 A JP 2023532762A JP 2023532762 A JP2023532762 A JP 2023532762A JP 7843760 B2 JP7843760 B2 JP 7843760B2
Authority
JP
Japan
Prior art keywords
training
utterance
loss
intent
probability
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2023532762A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023551861A5 (https=
JP2023551861A (ja
Inventor
シュ，イン
ザレムーディ，ポーヤ
ブー，タン・ティエン
ホアン，コン・ズイ・ブー
ブリノフ，ブラディスラフ
ホング，ユ－ヘング
ダルマシリ，ヤクピティヤゲ・ドン・タヌジャ・サモッダイ
ビシュノイ，ビシャル
ジャラルッディン，エリアス・ルクマン
パレク，マニッシュ
ドゥオング，タン・ロング
ジョンソン，マーク・エドワード
Original Assignee
オラクル・インターナショナル・コーポレイション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オラクル・インターナショナル・コーポレイション filed Critical オラクル・インターナショナル・コーポレイション
Publication of JP2023551861A publication Critical patent/JP2023551861A/ja
Publication of JP2023551861A5 publication Critical patent/JP2023551861A5/ja
Application granted granted Critical
Publication of JP7843760B2 publication Critical patent/JP7843760B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis
    • G06F40/35—Discourse or dialogue representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/004—Artificial life, i.e. computing arrangements simulating life
    • G06N3/006—Artificial life, i.e. computing arrangements simulating life based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/02—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/205—Parsing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/253—Grammatical analysis; Style critique

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Machine Translation (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2023532762A 2020-11-30 2021-11-30 自然言語処理のための距離ベースのロジット値 Active JP7843760B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063119459P 2020-11-30 2020-11-30
US63/119,459 2020-11-30
PCT/US2021/061081 WO2022115736A1 (en) 2020-11-30 2021-11-30 Distance-based logit values for natural language processing

Publications (3)

Publication Number Publication Date
JP2023551861A JP2023551861A (ja) 2023-12-13
JP2023551861A5 JP2023551861A5 (https=) 2024-06-20
JP7843760B2 true JP7843760B2 (ja) 2026-04-14

Family

ID=79171079

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023532762A Active JP7843760B2 (ja) 2020-11-30 2021-11-30 自然言語処理のための距離ベースのロジット値

Country Status (5)

Country Link
US (3) US12019994B2 (https=)
EP (1) EP4252143A1 (https=)
JP (1) JP7843760B2 (https=)
CN (1) CN116583837B (https=)
WO (1) WO2022115736A1 (https=)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2569335B (en) * 2017-12-13 2022-07-27 Sage Global Services Ltd Chatbot system
US12431149B2 (en) * 2020-03-24 2025-09-30 Evident Canada, Inc. Compressive sensing for full matrix capture
US11550605B2 (en) * 2020-06-30 2023-01-10 Kasisto, Inc. Building and managing cohesive interaction for virtual assistants
EP4268118A1 (en) * 2020-12-22 2023-11-01 Liveperson, Inc. Conversational bot evaluation and reinforcement using meaningful automated connection scores
US12340792B2 (en) * 2021-05-17 2025-06-24 Salesforce, Inc. Systems and methods for few-shot intent classifier models
EP4363965A1 (en) * 2021-08-06 2024-05-08 Siemens Aktiengesellschaft Source code synthesis for domain specific languages from natural language text
US12019984B2 (en) * 2021-09-20 2024-06-25 Salesforce, Inc. Multi-lingual intent model with out-of-domain detection
US20230169362A1 (en) * 2021-11-30 2023-06-01 Sap France Shared network learning for machine learning enabled text classification
US12204857B2 (en) * 2022-06-24 2025-01-21 Salesforce, Inc. Systems and methods for text classification using label modular prompts
US12170097B2 (en) * 2022-08-17 2024-12-17 Caterpillar Inc. Detection of audio communication signals present in a high noise environment
US12141536B1 (en) * 2023-03-16 2024-11-12 Amazon Technologies, Inc. Chatbot utterance routing in a provider network
US20250245445A1 (en) * 2024-01-31 2025-07-31 Genpact Usa, Inc. Enhanced domain-specific language learning models
US20260037359A1 (en) * 2024-08-05 2026-02-05 Interdigital Patent Holdings, Inc. Methods for Error Cause Determination for Two-Sided Models Independently Trained by Different Vendors
US12367342B1 (en) * 2025-01-15 2025-07-22 Conversational AI Ltd Automated analysis of computerized conversational agent conversational data

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200097496A1 (en) 2018-09-21 2020-03-26 Salesforce.Com, Inc. Intent classification system
JP2020140210A (ja) 2019-02-28 2020-09-03 ネイバー コーポレーションＮＡＶＥＲ Ｃｏｒｐｏｒａｔｉｏｎ 会話システムにおいて意図が不明確なクエリを処理する方法およびシステム
JP2020144905A (ja) 2020-05-12 2020-09-10 ヤフー株式会社 分類装置、分類方法、およびプログラム

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9575963B2 (en) * 2012-04-20 2017-02-21 Maluuba Inc. Conversational agent
EP2987106A4 (en) * 2013-04-18 2016-12-14 Digimarc Corp ACQUIRING AND ANALYZING PHYSIOLOGICAL DATA
US9547471B2 (en) * 2014-07-03 2017-01-17 Microsoft Technology Licensing, Llc Generating computer responses to social conversational inputs
US20160253597A1 (en) * 2015-02-27 2016-09-01 Xerox Corporation Content-aware domain adaptation for cross-domain classification
WO2018029679A1 (en) * 2016-08-07 2018-02-15 Hadasit Medical Research Services And Development Ltd. Methods and system for assessing a cognitive function
US20200342003A1 (en) * 2016-09-27 2020-10-29 Opro Co., Ltd. Synchronization program and connection program for cloud service
US10796217B2 (en) * 2016-11-30 2020-10-06 Microsoft Technology Licensing, Llc Systems and methods for performing automated interviews
US10685293B1 (en) * 2017-01-20 2020-06-16 Cybraics, Inc. Methods and systems for analyzing cybersecurity threats
US10530795B2 (en) * 2017-03-17 2020-01-07 Target Brands, Inc. Word embeddings for anomaly classification from event logs
US11373632B2 (en) * 2017-05-10 2022-06-28 Oracle International Corporation Using communicative discourse trees to create a virtual persuasive dialogue
US10817670B2 (en) 2017-05-10 2020-10-27 Oracle International Corporation Enabling chatbots by validating argumentation
EP3711031A4 (en) * 2017-11-17 2021-01-13 Facebook, Inc. ANALYSIS OF SPATIAL DISTRIBUTED DATA BASED ON DISTRIBUTED NEURAL FOLDING NETWORKS WITH SUBCOLLECTOR
US11200506B2 (en) * 2017-12-15 2021-12-14 Microsoft Technology Licensing, Llc Chatbot integrating derived user intent
US20190205939A1 (en) * 2017-12-31 2019-07-04 OneMarket Network LLC Using Machine Learned Visitor Intent Propensity to Greet and Guide a Visitor at a Physical Venue
US12387131B2 (en) * 2018-05-31 2025-08-12 Microsoft Technology Licensing, Llc Enhanced pipeline for the generation, validation, and deployment of machine-based predictive models
US11423330B2 (en) * 2018-07-16 2022-08-23 Invoca, Inc. Performance score determiner for binary signal classifiers
US11625620B2 (en) 2018-08-16 2023-04-11 Oracle International Corporation Techniques for building a knowledge graph in limited knowledge domains
US11257496B2 (en) * 2018-09-26 2022-02-22 [24]7.ai, Inc. Method and apparatus for facilitating persona-based agent interactions with online visitors
US11194973B1 (en) * 2018-11-12 2021-12-07 Amazon Technologies, Inc. Dialog response generation
US11574144B2 (en) 2019-01-07 2023-02-07 Microsoft Technology Licensing, Llc Performance of a computer-implemented model that acts as a multi-class classifier
CA3074675A1 (en) * 2019-03-04 2020-09-04 Royal Bank Of Canada System and method for machine learning with long-range dependency
US11978452B2 (en) 2019-04-26 2024-05-07 Oracle International Corportion Handling explicit invocation of chatbots
US11657797B2 (en) 2019-04-26 2023-05-23 Oracle International Corporation Routing for chatbots
US11206229B2 (en) 2019-04-26 2021-12-21 Oracle International Corporation Directed acyclic graph based framework for training models
US11775770B2 (en) * 2019-05-23 2023-10-03 Capital One Services, Llc Adversarial bootstrapping for multi-turn dialogue model training
CN110738239A (zh) * 2019-09-20 2020-01-31 浙江大学 一种基于鼠标交互序列区域行为联合建模的搜索引擎用户满意度评估方法
US10825449B1 (en) * 2019-09-27 2020-11-03 CrowdAround Inc. Systems and methods for analyzing a characteristic of a communication using disjoint classification models for parsing and evaluation of the communication
CN110458249B (zh) * 2019-10-10 2020-01-07 点内（上海）生物科技有限公司 一种基于深度学习与概率影像组学的病灶分类系统
CN111598830A (zh) * 2020-02-18 2020-08-28 天津大学 一种基于无监督学习的皮肤癌疾病检测方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200097496A1 (en) 2018-09-21 2020-03-26 Salesforce.Com, Inc. Intent classification system
JP2020140210A (ja) 2019-02-28 2020-09-03 ネイバー コーポレーションＮＡＶＥＲ Ｃｏｒｐｏｒａｔｉｏｎ 会話システムにおいて意図が不明確なクエリを処理する方法およびシステム
JP2020144905A (ja) 2020-05-12 2020-09-10 ヤフー株式会社 分類装置、分類方法、およびプログラム

Also Published As

Publication number Publication date
US20220171947A1 (en) 2022-06-02
CN116583837A (zh) 2023-08-11
CN116583837B (zh) 2025-12-16
US20240126999A1 (en) 2024-04-18
US12019994B2 (en) 2024-06-25
US12210842B2 (en) 2025-01-28
WO2022115736A1 (en) 2022-06-02
JP2023551861A (ja) 2023-12-13
EP4252143A1 (en) 2023-10-04
US20250117591A1 (en) 2025-04-10

Similar Documents

Publication Publication Date Title
JP7843760B2 (ja) 自然言語処理のための距離ベースのロジット値
US12299402B2 (en) Techniques for out-of-domain (OOD) detection
JP7561836B2 (ja) 自然言語処理のためのストップワードデータ拡張
JP7703667B2 (ja) 固有表現認識モデルを用いたコンテキストタグ統合
JP7721559B2 (ja) 自然言語処理のためのノイズデータ拡張
JP7789778B2 (ja) 自然言語処理のためのドメイン外データ拡張
JP7726995B2 (ja) 自然言語処理のための強化されたロジット
JP7828346B2 (ja) 自然言語処理のためのキーワードデータ拡張ツール
JP2024503517A (ja) 自然言語処理のための多因子モデリング
JP7771196B2 (ja) 自然言語プロセッサのための複数特徴均衡化
WO2023064033A1 (en) Fine-tuning multi-head network from a single transformer layer of pre-trained language model
JP2024543062A (ja) 自然言語処理のパスのドロップアウト
JP2024541762A (ja) 事前トレーニングされた言語モデルのための長いテキストを処理するシステムおよび技術
US20240062112A1 (en) Adaptive training data augmentation to facilitate training named entity recognition models
US20260065171A1 (en) Adaptive training data augmentation to facilitate training named entity recognition models

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240612

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240612

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20250521

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250701

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250826

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20251209

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260129

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20260310

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20260331

R150 Certificate of patent or registration of utility model

Ref document number: 7843760

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150