CN114175018B - 新词分类技术 - Google Patents
新词分类技术Info
- Publication number
- CN114175018B CN114175018B CN202080046031.4A CN202080046031A CN114175018B CN 114175018 B CN114175018 B CN 114175018B CN 202080046031 A CN202080046031 A CN 202080046031A CN 114175018 B CN114175018 B CN 114175018B
- Authority
- CN
- China
- Prior art keywords
- triples
- word
- classification
- input
- name
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/279—Recognition of textual entities
- G06F40/284—Lexical analysis, e.g. tokenisation or collocates
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/35—Clustering; Classification
- G06F16/353—Clustering; Classification into predefined classes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/279—Recognition of textual entities
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0464—Convolutional networks [CNN, ConvNet]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/09—Supervised learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- Biophysics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Databases & Information Systems (AREA)
- Machine Translation (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201962888998P | 2019-08-19 | 2019-08-19 | |
| US62/888,998 | 2019-08-19 | ||
| US16/985,131 | 2020-08-04 | ||
| US16/985,131 US11694029B2 (en) | 2019-08-19 | 2020-08-04 | Neologism classification techniques with trigrams and longest common subsequences |
| PCT/US2020/045390 WO2021034517A1 (en) | 2019-08-19 | 2020-08-07 | Neologism classification techniques |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114175018A CN114175018A (zh) | 2022-03-11 |
| CN114175018B true CN114175018B (zh) | 2026-01-13 |
Family
ID=74646235
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080046031.4A Active CN114175018B (zh) | 2019-08-19 | 2020-08-07 | 新词分类技术 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US11694029B2 (cg-RX-API-DMAC7.html) |
| EP (1) | EP4018354A1 (cg-RX-API-DMAC7.html) |
| JP (1) | JP7610573B2 (cg-RX-API-DMAC7.html) |
| CN (1) | CN114175018B (cg-RX-API-DMAC7.html) |
| WO (1) | WO2021034517A1 (cg-RX-API-DMAC7.html) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10915233B2 (en) * | 2014-09-26 | 2021-02-09 | Oracle International Corporation | Automated entity correlation and classification across heterogeneous datasets |
| US11625535B1 (en) * | 2019-12-05 | 2023-04-11 | American Express Travel Related Services Company, Inc. | Computer-based systems having data structures configured to execute SIC4/SIC8 machine learning embedded classification of entities and methods of use thereof |
| JP2022073635A (ja) * | 2020-11-02 | 2022-05-17 | 富士通株式会社 | ベクトル化プログラム、ベクトル化方法および情報処理装置 |
| US12086542B2 (en) * | 2021-04-06 | 2024-09-10 | Talent Unlimited Online Services Private Limited | System and method for generating contextualized text using a character-based convolutional neural network architecture |
| US11372828B1 (en) * | 2021-08-18 | 2022-06-28 | Rite Software Solutions And Services Llc | Methods and systems for data migration based on metadata mapping |
| US12412033B2 (en) | 2022-03-31 | 2025-09-09 | International Business Machines Corporation | Knowledge graph driven content generation |
| US12468889B2 (en) * | 2023-02-21 | 2025-11-11 | Tencent America LLC | Multi-task self-training for character gender identification |
| KR102998244B1 (ko) | 2024-08-16 | 2026-07-30 | 고려대학교 산학협력단 | 대형 언어 모델을 활용한 oov 단어 처리 장치 및 방법 |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110909540A (zh) * | 2018-09-14 | 2020-03-24 | 阿里巴巴集团控股有限公司 | 短信垃圾新词识别方法、装置及电子设备 |
Family Cites Families (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5062143A (en) * | 1990-02-23 | 1991-10-29 | Harris Corporation | Trigram-based method of language identification |
| US5276741A (en) * | 1991-05-16 | 1994-01-04 | Trw Financial Systems & Services, Inc. | Fuzzy string matcher |
| US6272456B1 (en) * | 1998-03-19 | 2001-08-07 | Microsoft Corporation | System and method for identifying the language of written text having a plurality of different length n-gram profiles |
| JP2003016055A (ja) * | 2001-06-28 | 2003-01-17 | Mitsubishi Electric Corp | 文作成装置及び文作成方法 |
| JP2004348239A (ja) * | 2003-05-20 | 2004-12-09 | Fujitsu Ltd | テキスト分類プログラム |
| US8005782B2 (en) * | 2007-08-10 | 2011-08-23 | Microsoft Corporation | Domain name statistical classification using character-based N-grams |
| US7917355B2 (en) * | 2007-08-23 | 2011-03-29 | Google Inc. | Word detection |
| US9411800B2 (en) * | 2008-06-27 | 2016-08-09 | Microsoft Technology Licensing, Llc | Adaptive generation of out-of-dictionary personalized long words |
| JP5513985B2 (ja) * | 2010-05-24 | 2014-06-04 | 日本電信電話株式会社 | 文字列ベクトル生成装置、文字列ベクトル生成方法、プログラム、及びプログラムを格納したコンピュータ読み取り可能な記録媒体 |
| US20130246045A1 (en) * | 2012-03-14 | 2013-09-19 | Hewlett-Packard Development Company, L.P. | Identification and Extraction of New Terms in Documents |
| JP5676517B2 (ja) * | 2012-04-12 | 2015-02-25 | 日本電信電話株式会社 | 文字列類似度計算装置、方法、及びプログラム |
| US9070090B2 (en) | 2012-08-28 | 2015-06-30 | Oracle International Corporation | Scalable string matching as a component for unsupervised learning in semantic meta-model development |
| CN104915327B (zh) * | 2014-03-14 | 2019-01-29 | 腾讯科技(深圳)有限公司 | 一种文本信息的处理方法及装置 |
| US10210246B2 (en) * | 2014-09-26 | 2019-02-19 | Oracle International Corporation | Techniques for similarity analysis and data enrichment using knowledge sources |
| US10019438B2 (en) * | 2016-03-18 | 2018-07-10 | International Business Machines Corporation | External word embedding neural network language models |
| US9594741B1 (en) * | 2016-06-12 | 2017-03-14 | Apple Inc. | Learning new words |
| US10120861B2 (en) * | 2016-08-17 | 2018-11-06 | Oath Inc. | Hybrid classifier for assigning natural language processing (NLP) inputs to domains in real-time |
| US10810472B2 (en) * | 2017-05-26 | 2020-10-20 | Oracle International Corporation | Techniques for sentiment analysis of data using a convolutional neural network and a co-occurrence network |
| US10885056B2 (en) * | 2017-09-29 | 2021-01-05 | Oracle International Corporation | Data standardization techniques |
| JP7014230B2 (ja) * | 2017-11-10 | 2022-02-01 | 日本電気株式会社 | 情報処理装置、情報処理方法及びプログラム |
| US11120086B2 (en) * | 2018-02-13 | 2021-09-14 | Oracle International Corporation | Toponym disambiguation |
| US10713441B2 (en) * | 2018-03-23 | 2020-07-14 | Servicenow, Inc. | Hybrid learning system for natural language intent extraction from a dialog utterance |
| US11321368B2 (en) * | 2018-06-13 | 2022-05-03 | Oracle International Corporation | Regular expression generation using longest common subsequence algorithm on combinations of regular expression codes |
| US11354305B2 (en) * | 2018-06-13 | 2022-06-07 | Oracle International Corporation | User interface commands for regular expression generation |
| US10977441B2 (en) * | 2018-10-29 | 2021-04-13 | Amazon Technologies, Inc. | Normalizing addresses to facilitate sortation and routing solution using natural language text processing |
| US10810373B1 (en) * | 2018-10-30 | 2020-10-20 | Oath Inc. | Systems and methods for unsupervised neologism normalization of electronic content using embedding space mapping |
| US11108710B2 (en) * | 2020-01-28 | 2021-08-31 | Verizon Media Inc. | Computerized system and method for multi-factor message classification and delivery |
| US12079282B2 (en) * | 2020-03-12 | 2024-09-03 | Oracle International Corporation | Name matching engine boosted by machine learning |
| US11573994B2 (en) * | 2020-04-14 | 2023-02-07 | International Business Machines Corporation | Encoding entity representations for cross-document coreference |
-
2020
- 2020-08-04 US US16/985,131 patent/US11694029B2/en active Active
- 2020-08-07 CN CN202080046031.4A patent/CN114175018B/zh active Active
- 2020-08-07 EP EP20758412.9A patent/EP4018354A1/en not_active Withdrawn
- 2020-08-07 JP JP2022505355A patent/JP7610573B2/ja active Active
- 2020-08-07 WO PCT/US2020/045390 patent/WO2021034517A1/en not_active Ceased
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110909540A (zh) * | 2018-09-14 | 2020-03-24 | 阿里巴巴集团控股有限公司 | 短信垃圾新词识别方法、装置及电子设备 |
Non-Patent Citations (1)
| Title |
|---|
| A Data-driven Approach to Studying Given Names and their Gender and Ethnicity Associations;Shervin Malmasi等;《Proceedings of Australasian Language Technology Association Workshop 2014》;20141231;145−149 * |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021034517A1 (en) | 2021-02-25 |
| JP2022545335A (ja) | 2022-10-27 |
| US20210056264A1 (en) | 2021-02-25 |
| CN114175018A (zh) | 2022-03-11 |
| US11694029B2 (en) | 2023-07-04 |
| EP4018354A1 (en) | 2022-06-29 |
| JP7610573B2 (ja) | 2025-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11417131B2 (en) | Techniques for sentiment analysis of data using a convolutional neural network and a co-occurrence network | |
| JP7610573B2 (ja) | 新語分類技術 | |
| EP4028932B1 (en) | Reduced training intent recognition techniques | |
| US11163527B2 (en) | Techniques for dataset similarity discovery | |
| US11397873B2 (en) | Enhanced processing for communication workflows using machine-learning techniques | |
| US11386176B2 (en) | Inferring logical clauses for answering complex multi-hop open domain questions | |
| CN106687952B (zh) | 利用知识源进行相似性分析和数据丰富化的技术 | |
| US20200097879A1 (en) | Techniques for automatic opportunity evaluation and action recommendation engine | |
| US10296192B2 (en) | Dynamic visual profiling and visualization of high volume datasets and real-time smart sampling and statistical profiling of extremely large datasets | |
| US12541555B2 (en) | Declarative modeling paradigm for graph-database | |
| CN115485690A (zh) | 用于处置聊天机器人的不平衡训练数据的分批技术 | |
| US12517763B2 (en) | Enhanced processing for communication workflows using machine-learning techniques | |
| US11120086B2 (en) | Toponym disambiguation | |
| EP3198484A1 (en) | Declarative language and visualization system for recommended data transformations and repairs | |
| US11397614B2 (en) | Enhanced processing for communication workflows using machine-learning techniques | |
| US12511926B2 (en) | Data categorization using topic modelling | |
| US20220207284A1 (en) | Content targeting using content context and user propensity | |
| US20240169216A1 (en) | Predicting record topic using transitive relations | |
| US11475221B2 (en) | Techniques for selecting content to include in user communications | |
| US12456010B2 (en) | Predicting text and data variables using customer-specific models | |
| KR20260053055A (ko) | 자연어 대화를 시각화 표현으로 변환하기 위한 기술들 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |