JP7610573B2 - 新語分類技術 - Google Patents

新語分類技術 Download PDF

Info

Publication number
JP7610573B2
JP7610573B2 JP2022505355A JP2022505355A JP7610573B2 JP 7610573 B2 JP7610573 B2 JP 7610573B2 JP 2022505355 A JP2022505355 A JP 2022505355A JP 2022505355 A JP2022505355 A JP 2022505355A JP 7610573 B2 JP7610573 B2 JP 7610573B2
Authority
JP
Japan
Prior art keywords
trigrams
classification
word
data
names
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022505355A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022545335A (ja
JP2022545335A5 (cg-RX-API-DMAC7.html
Inventor
マラック,マイケル
リーバス,ルイス・イー
クライダー,マーク・リー
Original Assignee
オラクル・インターナショナル・コーポレイション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オラクル・インターナショナル・コーポレイション filed Critical オラクル・インターナショナル・コーポレイション
Publication of JP2022545335A publication Critical patent/JP2022545335A/ja
Publication of JP2022545335A5 publication Critical patent/JP2022545335A5/ja
Application granted granted Critical
Publication of JP7610573B2 publication Critical patent/JP7610573B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/284—Lexical analysis, e.g. tokenisation or collocates
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/35—Clustering; Classification
    • G06F16/353—Clustering; Classification into predefined classes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Databases & Information Systems (AREA)
  • Machine Translation (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2022505355A 2019-08-19 2020-08-07 新語分類技術 Active JP7610573B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962888998P 2019-08-19 2019-08-19
US62/888,998 2019-08-19
US16/985,131 2020-08-04
US16/985,131 US11694029B2 (en) 2019-08-19 2020-08-04 Neologism classification techniques with trigrams and longest common subsequences
PCT/US2020/045390 WO2021034517A1 (en) 2019-08-19 2020-08-07 Neologism classification techniques

Publications (3)

Publication Number Publication Date
JP2022545335A JP2022545335A (ja) 2022-10-27
JP2022545335A5 JP2022545335A5 (cg-RX-API-DMAC7.html) 2023-06-22
JP7610573B2 true JP7610573B2 (ja) 2025-01-08

Family

ID=74646235

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022505355A Active JP7610573B2 (ja) 2019-08-19 2020-08-07 新語分類技術

Country Status (5)

Country Link
US (1) US11694029B2 (cg-RX-API-DMAC7.html)
EP (1) EP4018354A1 (cg-RX-API-DMAC7.html)
JP (1) JP7610573B2 (cg-RX-API-DMAC7.html)
CN (1) CN114175018B (cg-RX-API-DMAC7.html)
WO (1) WO2021034517A1 (cg-RX-API-DMAC7.html)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10915233B2 (en) * 2014-09-26 2021-02-09 Oracle International Corporation Automated entity correlation and classification across heterogeneous datasets
US11625535B1 (en) * 2019-12-05 2023-04-11 American Express Travel Related Services Company, Inc. Computer-based systems having data structures configured to execute SIC4/SIC8 machine learning embedded classification of entities and methods of use thereof
JP2022073635A (ja) * 2020-11-02 2022-05-17 富士通株式会社 ベクトル化プログラム、ベクトル化方法および情報処理装置
US12086542B2 (en) * 2021-04-06 2024-09-10 Talent Unlimited Online Services Private Limited System and method for generating contextualized text using a character-based convolutional neural network architecture
US11372828B1 (en) * 2021-08-18 2022-06-28 Rite Software Solutions And Services Llc Methods and systems for data migration based on metadata mapping
US12412033B2 (en) 2022-03-31 2025-09-09 International Business Machines Corporation Knowledge graph driven content generation
US12468889B2 (en) * 2023-02-21 2025-11-11 Tencent America LLC Multi-task self-training for character gender identification
KR102998244B1 (ko) 2024-08-16 2026-07-30 고려대학교 산학협력단 대형 언어 모델을 활용한 oov 단어 처리 장치 및 방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004348239A (ja) 2003-05-20 2004-12-09 Fujitsu Ltd テキスト分類プログラム
US20090043720A1 (en) 2007-08-10 2009-02-12 Microsoft Corporation Domain name statistical classification using character-based n-grams
JP2011248483A (ja) 2010-05-24 2011-12-08 Nippon Telegr & Teleph Corp <Ntt> 文字列ベクトル生成装置、文字列ベクトル生成方法、プログラム、及びプログラムを格納したコンピュータ読み取り可能な記録媒体
JP2013218628A (ja) 2012-04-12 2013-10-24 Nippon Telegr & Teleph Corp <Ntt> 文字列類似度計算装置、方法、及びプログラム
WO2019092868A1 (ja) 2017-11-10 2019-05-16 日本電気株式会社 情報処理装置、情報処理方法及びコンピュータ読み取り可能な記録媒体

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5062143A (en) * 1990-02-23 1991-10-29 Harris Corporation Trigram-based method of language identification
US5276741A (en) * 1991-05-16 1994-01-04 Trw Financial Systems & Services, Inc. Fuzzy string matcher
US6272456B1 (en) * 1998-03-19 2001-08-07 Microsoft Corporation System and method for identifying the language of written text having a plurality of different length n-gram profiles
JP2003016055A (ja) * 2001-06-28 2003-01-17 Mitsubishi Electric Corp 文作成装置及び文作成方法
US7917355B2 (en) * 2007-08-23 2011-03-29 Google Inc. Word detection
US9411800B2 (en) * 2008-06-27 2016-08-09 Microsoft Technology Licensing, Llc Adaptive generation of out-of-dictionary personalized long words
US20130246045A1 (en) * 2012-03-14 2013-09-19 Hewlett-Packard Development Company, L.P. Identification and Extraction of New Terms in Documents
US9070090B2 (en) 2012-08-28 2015-06-30 Oracle International Corporation Scalable string matching as a component for unsupervised learning in semantic meta-model development
CN104915327B (zh) * 2014-03-14 2019-01-29 腾讯科技(深圳)有限公司 一种文本信息的处理方法及装置
US10210246B2 (en) * 2014-09-26 2019-02-19 Oracle International Corporation Techniques for similarity analysis and data enrichment using knowledge sources
US10019438B2 (en) * 2016-03-18 2018-07-10 International Business Machines Corporation External word embedding neural network language models
US9594741B1 (en) * 2016-06-12 2017-03-14 Apple Inc. Learning new words
US10120861B2 (en) * 2016-08-17 2018-11-06 Oath Inc. Hybrid classifier for assigning natural language processing (NLP) inputs to domains in real-time
US10810472B2 (en) * 2017-05-26 2020-10-20 Oracle International Corporation Techniques for sentiment analysis of data using a convolutional neural network and a co-occurrence network
US10885056B2 (en) * 2017-09-29 2021-01-05 Oracle International Corporation Data standardization techniques
US11120086B2 (en) * 2018-02-13 2021-09-14 Oracle International Corporation Toponym disambiguation
US10713441B2 (en) * 2018-03-23 2020-07-14 Servicenow, Inc. Hybrid learning system for natural language intent extraction from a dialog utterance
US11321368B2 (en) * 2018-06-13 2022-05-03 Oracle International Corporation Regular expression generation using longest common subsequence algorithm on combinations of regular expression codes
US11354305B2 (en) * 2018-06-13 2022-06-07 Oracle International Corporation User interface commands for regular expression generation
CN110909540B (zh) * 2018-09-14 2022-05-24 阿里巴巴集团控股有限公司 短信垃圾新词识别方法、装置及电子设备
US10977441B2 (en) * 2018-10-29 2021-04-13 Amazon Technologies, Inc. Normalizing addresses to facilitate sortation and routing solution using natural language text processing
US10810373B1 (en) * 2018-10-30 2020-10-20 Oath Inc. Systems and methods for unsupervised neologism normalization of electronic content using embedding space mapping
US11108710B2 (en) * 2020-01-28 2021-08-31 Verizon Media Inc. Computerized system and method for multi-factor message classification and delivery
US12079282B2 (en) * 2020-03-12 2024-09-03 Oracle International Corporation Name matching engine boosted by machine learning
US11573994B2 (en) * 2020-04-14 2023-02-07 International Business Machines Corporation Encoding entity representations for cross-document coreference

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004348239A (ja) 2003-05-20 2004-12-09 Fujitsu Ltd テキスト分類プログラム
US20090043720A1 (en) 2007-08-10 2009-02-12 Microsoft Corporation Domain name statistical classification using character-based n-grams
JP2011248483A (ja) 2010-05-24 2011-12-08 Nippon Telegr & Teleph Corp <Ntt> 文字列ベクトル生成装置、文字列ベクトル生成方法、プログラム、及びプログラムを格納したコンピュータ読み取り可能な記録媒体
JP2013218628A (ja) 2012-04-12 2013-10-24 Nippon Telegr & Teleph Corp <Ntt> 文字列類似度計算装置、方法、及びプログラム
WO2019092868A1 (ja) 2017-11-10 2019-05-16 日本電気株式会社 情報処理装置、情報処理方法及びコンピュータ読み取り可能な記録媒体

Also Published As

Publication number Publication date
WO2021034517A1 (en) 2021-02-25
JP2022545335A (ja) 2022-10-27
CN114175018B (zh) 2026-01-13
US20210056264A1 (en) 2021-02-25
CN114175018A (zh) 2022-03-11
US11694029B2 (en) 2023-07-04
EP4018354A1 (en) 2022-06-29

Similar Documents

Publication Publication Date Title
US11417131B2 (en) Techniques for sentiment analysis of data using a convolutional neural network and a co-occurrence network
US11947529B2 (en) Generating and analyzing a data model to identify relevant data catalog data derived from graph-based data arrangements to perform an action
US11500880B2 (en) Adaptive recommendations
US12608586B2 (en) Parameter sharing decoder pair for auto composing
JP7781053B2 (ja) 訓練を減らした意図認識技術
US11694029B2 (en) Neologism classification techniques with trigrams and longest common subsequences
US11397873B2 (en) Enhanced processing for communication workflows using machine-learning techniques
US12541555B2 (en) Declarative modeling paradigm for graph-database
US10445062B2 (en) Techniques for dataset similarity discovery
CN106687952B (zh) 利用知识源进行相似性分析和数据丰富化的技术
JP2025530712A (ja) 自然言語インターフェースとして訓練されている機械学習モデルの信頼スコアの較正
CN115485690A (zh) 用于处置聊天机器人的不平衡训练数据的分批技术
US11120086B2 (en) Toponym disambiguation
US12517763B2 (en) Enhanced processing for communication workflows using machine-learning techniques
CN117296058A (zh) 作为简单有效的对抗攻击方法的变体不一致攻击(via)
EP4582968A1 (en) Efficient generation of application programming interface calls using language models, data types, and enriched schema
EP3198484A1 (en) Declarative language and visualization system for recommended data transformations and repairs
US11397614B2 (en) Enhanced processing for communication workflows using machine-learning techniques
US20250307318A1 (en) Intelligent search query interpretation and response
US12456010B2 (en) Predicting text and data variables using customer-specific models
US20250371585A1 (en) Training and deployment framework for machine learning based recommendation system
KR20260053055A (ko) 자연어 대화를 시각화 표현으로 변환하기 위한 기술들

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230613

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230613

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240802

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240903

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20241018

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20241105

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20241114

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20241203

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20241220

R150 Certificate of patent or registration of utility model

Ref document number: 7610573

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150