GB2604276A - Rare topic detection using hierarchical clustering - Google Patents

Rare topic detection using hierarchical clustering Download PDF

Info

Publication number
GB2604276A
GB2604276A GB2206094.1A GB202206094A GB2604276A GB 2604276 A GB2604276 A GB 2604276A GB 202206094 A GB202206094 A GB 202206094A GB 2604276 A GB2604276 A GB 2604276A
Authority
GB
United Kingdom
Prior art keywords
cluster
clusters
topic model
words
king
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB2206094.1A
Other languages
English (en)
Other versions
GB202206094D0 (en
Inventor
Kiran Ganti Raghu
Srivatsa Mudhakar
Srirangamsridharan Shreeranjani
Lim Yeon-Sup
Agrawal Dakshi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of GB202206094D0 publication Critical patent/GB202206094D0/en
Publication of GB2604276A publication Critical patent/GB2604276A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/35—Clustering; Classification
    • G06F16/353—Clustering; Classification into predefined classes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/334—Query execution
    • G06F16/3347—Query execution using vector based model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/02—Knowledge representation; Symbolic representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/04—Inference or reasoning models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/01—Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Databases & Information Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Machine Translation (AREA)
GB2206094.1A 2019-10-08 2020-09-29 Rare topic detection using hierarchical clustering Withdrawn GB2604276A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/596,399 US12259919B2 (en) 2019-10-08 2019-10-08 Rare topic detection using hierarchical clustering
PCT/IB2020/059112 WO2021070005A1 (en) 2019-10-08 2020-09-29 Rare topic detection using hierarchical clustering

Publications (2)

Publication Number Publication Date
GB202206094D0 GB202206094D0 (en) 2022-06-08
GB2604276A true GB2604276A (en) 2022-08-31

Family

ID=75273583

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2206094.1A Withdrawn GB2604276A (en) 2019-10-08 2020-09-29 Rare topic detection using hierarchical clustering

Country Status (7)

Country Link
US (1) US12259919B2 (https=)
JP (1) JP7539201B2 (https=)
KR (1) KR102862150B1 (https=)
CN (1) CN114424197B (https=)
AU (1) AU2020364386B2 (https=)
GB (1) GB2604276A (https=)
WO (1) WO2021070005A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12259919B2 (en) 2019-10-08 2025-03-25 International Business Machines Corporation Rare topic detection using hierarchical clustering

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11354345B2 (en) * 2020-06-22 2022-06-07 Jpmorgan Chase Bank, N.A. Clustering topics for data visualization
US20230050622A1 (en) * 2021-08-11 2023-02-16 Yanran Wei Evolution of topics in a messaging system
US11941038B2 (en) 2022-05-19 2024-03-26 International Business Machines Corporation Transparent and controllable topic modeling
US12505144B2 (en) 2022-09-21 2025-12-23 International Business Machines Corporation Caching of text analytics based on topic demand and memory constraints
WO2024173841A1 (en) * 2023-02-16 2024-08-22 Jpmorgan Chase Bank, N.A. Systems and methods for seeded neural topic modeling
US20240354375A1 (en) * 2023-04-21 2024-10-24 Gong.Io Ltd. Techniques for aggregating insights of textual data using hierarchical clustering
US12549499B2 (en) 2023-04-24 2026-02-10 Gong.Io Ltd. System and method for generating a chat response on sales deals using a large language model
CN119046457B (zh) * 2024-10-30 2025-03-21 杭州正义先铎网络科技有限公司 基于智能文本解析的自动化内容管理方法、系统及介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103927176A (zh) * 2014-04-18 2014-07-16 扬州大学 一种基于层次主题模型的程序特征树的生成方法
CN103970865A (zh) * 2014-05-08 2014-08-06 清华大学 基于种子词的微博文本层次主题发现方法及系统
US20180232658A1 (en) * 2017-02-14 2018-08-16 Cognitive Scale, Inc. Hierarchical Topic Machine Learning Operation
CN109544632A (zh) * 2018-11-05 2019-03-29 浙江工业大学 一种基于层次主题模型的语义slam对象关联方法

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3791879B2 (ja) 1999-07-19 2006-06-28 富士通株式会社 文書要約装置およびその方法
US7644102B2 (en) 2001-10-19 2010-01-05 Xerox Corporation Methods, systems, and articles of manufacture for soft hierarchical clustering of co-occurring objects
US7882127B2 (en) * 2002-05-10 2011-02-01 Oracle International Corporation Multi-category support for apply output
US7451395B2 (en) 2002-12-16 2008-11-11 Palo Alto Research Center Incorporated Systems and methods for interactive topic-based text summarization
US20070078889A1 (en) 2005-10-04 2007-04-05 Hoskinson Ronald A Method and system for automated knowledge extraction and organization
US7809704B2 (en) * 2006-06-15 2010-10-05 Microsoft Corporation Combining spectral and probabilistic clustering
US7783640B2 (en) * 2006-11-03 2010-08-24 Oracle International Corp. Document summarization
US7912847B2 (en) * 2007-02-20 2011-03-22 Wright State University Comparative web search system and method
US20100153318A1 (en) * 2008-11-19 2010-06-17 Massachusetts Institute Of Technology Methods and systems for automatically summarizing semantic properties from documents with freeform textual annotations
US9031944B2 (en) * 2010-04-30 2015-05-12 Palo Alto Research Center Incorporated System and method for providing multi-core and multi-level topical organization in social indexes
US8645298B2 (en) 2010-10-26 2014-02-04 Microsoft Corporation Topic models
US9430563B2 (en) 2012-02-02 2016-08-30 Xerox Corporation Document processing employing probabilistic topic modeling of documents represented as text words transformed to a continuous space
US8843497B2 (en) * 2012-02-09 2014-09-23 Linkshare Corporation System and method for association extraction for surf-shopping
US9959364B2 (en) * 2014-05-22 2018-05-01 Oath Inc. Content recommendations
US20160034757A1 (en) 2014-07-31 2016-02-04 Chegg, Inc. Generating an Academic Topic Graph from Digital Documents
US11989662B2 (en) * 2014-10-10 2024-05-21 San Diego State University Research Foundation Methods and systems for base map and inference mapping
US9575952B2 (en) 2014-10-21 2017-02-21 At&T Intellectual Property I, L.P. Unsupervised topic modeling for short texts
US9697245B1 (en) * 2015-12-30 2017-07-04 International Business Machines Corporation Data-dependent clustering of geospatial words
US10275444B2 (en) * 2016-07-15 2019-04-30 At&T Intellectual Property I, L.P. Data analytics system and methods for text data
US11645317B2 (en) * 2016-07-26 2023-05-09 Qualtrics, Llc Recommending topic clusters for unstructured text documents
CN108808322A (zh) 2017-05-04 2018-11-13 富士康(昆山)电脑接插件有限公司 电连接器
US12259919B2 (en) 2019-10-08 2025-03-25 International Business Machines Corporation Rare topic detection using hierarchical clustering

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103927176A (zh) * 2014-04-18 2014-07-16 扬州大学 一种基于层次主题模型的程序特征树的生成方法
CN103970865A (zh) * 2014-05-08 2014-08-06 清华大学 基于种子词的微博文本层次主题发现方法及系统
US20180232658A1 (en) * 2017-02-14 2018-08-16 Cognitive Scale, Inc. Hierarchical Topic Machine Learning Operation
CN109544632A (zh) * 2018-11-05 2019-03-29 浙江工业大学 一种基于层次主题模型的语义slam对象关联方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12259919B2 (en) 2019-10-08 2025-03-25 International Business Machines Corporation Rare topic detection using hierarchical clustering

Also Published As

Publication number Publication date
AU2020364386A1 (en) 2022-03-24
KR102862150B1 (ko) 2025-09-18
KR20220050915A (ko) 2022-04-25
CN114424197B (zh) 2025-05-13
WO2021070005A1 (en) 2021-04-15
US12259919B2 (en) 2025-03-25
AU2020364386B2 (en) 2024-01-04
GB202206094D0 (en) 2022-06-08
CN114424197A (zh) 2022-04-29
JP7539201B2 (ja) 2024-08-23
US20210103608A1 (en) 2021-04-08
JP2022552140A (ja) 2022-12-15

Similar Documents

Publication Publication Date Title
GB2604276A (en) Rare topic detection using hierarchical clustering
JP2022552140A5 (https=)
US11210328B2 (en) Apparatus and method for learning narrative of document, and apparatus and method for generating narrative of document
Hingmire et al. Document classification by topic labeling
JP6781760B2 (ja) 複数レイヤの単語表現にわたる言語特徴生成のためのシステム及び方法
Yang et al. Joint relational embeddings for knowledge-based question answering
US9946764B2 (en) Evaluating passages in a question answering computer system
WO2018203147A3 (en) MULTILINGUAL SEMANTIC ANALYZER BASED ON TRANSFERRED LEARNING
MX2021007037A (es) Metodos y sistemas de seguridad.
CN105096953B (zh) 实现多语种混合使用的语音识别方法
GB2601697A (en) Natural language processing using an ontology-based concept embedding model
Chollampatt et al. Adapting grammatical error correction based on the native language of writers with neural network joint models
EP4459567A3 (en) Regularizing machine learning models
WO2019118472A8 (en) System and method for the detection and visualization of reported ethics cases within an organization
Tacarraoucht et al. Team games-language learning model in improving students’ speaking and listening skills viewed from creativity
CN106446022A (zh) 一种基于形式语义推理和深度学习的自然语言知识挖掘方法
US10832146B2 (en) System and method of inferring synonyms using ensemble learning techniques
Sarveswaran et al. ThamizhiUDp: A dependency parser for Tamil
EP4513358A3 (en) Domain-aware autocomplete
GB2579326A (en) Domain-specific lexical analysis
GB2585492A (en) Phonetic patterns for fuzzy matching in natural language processing
CN108829670A (zh) 基于单语义的未登录词处理方法、智能问答方法及装置
Wassie et al. A word sense disambiguation model for amharic words using semi-supervised learning paradigm
Francisca et al. Adapting rule based machine translation from english to bangla
Wawer et al. Predicting sentiment of Polish language short texts

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)