ZA202308290B - Cross-modal fusion-based deep clustering method and system - Google Patents

Cross-modal fusion-based deep clustering method and system

Info

Publication number
ZA202308290B
ZA202308290B ZA2023/08290A ZA202308290A ZA202308290B ZA 202308290 B ZA202308290 B ZA 202308290B ZA 2023/08290 A ZA2023/08290 A ZA 2023/08290A ZA 202308290 A ZA202308290 A ZA 202308290A ZA 202308290 B ZA202308290 B ZA 202308290B
Authority
ZA
South Africa
Prior art keywords
encoder
auto
cross
graph
modal
Prior art date
Application number
ZA2023/08290A
Inventor
Xinzhong Zhu
Huiying Xu
Wenxuan Tu
Jianmin Zhao
Original Assignee
Univ Zhejiang Normal
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Zhejiang Normal filed Critical Univ Zhejiang Normal
Publication of ZA202308290B publication Critical patent/ZA202308290B/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/232—Non-hierarchical techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computational Linguistics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Evolutionary Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present application discloses a cross-modal fusion-based deep clustering system, comprising: an auto-encoder, a graph auto-encoder, a cross-modal information fusion module, and a joint optimization target module; wherein the auto-encoder is configured to perform feature extraction on attribute information of graph data and reconstruct an original attribute matrix; the graph auto-encoder is configured to perform feature extraction on structure information of the graph data and reconstruct an original adjacency matrix and a weighted attribute matrix; the cross-modal information fusion module is configured to integrate modal information of the auto-encoder with modal information of the graph auto-encoder to generate consensus implicit embedding, and initialize a cluster center according to the consensus implicit embedding and pre-calculation to generate a soft assignment distribution and a target distribution; and the joint optimization target module is configured to synchronously guide a parameter updating process of the auto-encoder, the graph auto-encoder, and the cross-modal information fusion module.
ZA2023/08290A 2021-02-04 2023-08-28 Cross-modal fusion-based deep clustering method and system ZA202308290B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110154434.7A CN112906770A (en) 2021-02-04 2021-02-04 Cross-modal fusion-based deep clustering method and system
PCT/CN2021/135894 WO2022166361A1 (en) 2021-02-04 2021-12-07 Deep clustering method and system based on cross-modal fusion

Publications (1)

Publication Number Publication Date
ZA202308290B true ZA202308290B (en) 2023-09-27

Family

ID=76122295

Family Applications (1)

Application Number Title Priority Date Filing Date
ZA2023/08290A ZA202308290B (en) 2021-02-04 2023-08-28 Cross-modal fusion-based deep clustering method and system

Country Status (3)

Country Link
CN (1) CN112906770A (en)
WO (1) WO2022166361A1 (en)
ZA (1) ZA202308290B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112906770A (en) * 2021-02-04 2021-06-04 浙江师范大学 Cross-modal fusion-based deep clustering method and system
CN113792784B (en) * 2021-09-14 2022-06-21 上海任意门科技有限公司 Method, electronic device and storage medium for user clustering
CN113762648B (en) * 2021-10-26 2023-12-19 平安科技（深圳）有限公司 Method, device, equipment and medium for predicting male Wei Heitian goose event
CN115985402B (en) * 2023-03-20 2023-09-19 北京航空航天大学 Cross-modal data migration method based on normalized flow theory
CN116720523B (en) * 2023-04-19 2024-02-06 贵州轻工职业技术学院 Deep text clustering method and device based on multiple cores and storage medium
CN116206133B (en) * 2023-04-25 2023-09-05 山东科技大学 RGB-D significance target detection method
CN117113240B (en) * 2023-10-23 2024-03-26 华南理工大学 Dynamic network community discovery method, device, equipment and storage medium
CN117407697B (en) * 2023-12-14 2024-04-02 南昌科晨电力试验研究有限公司 Graph anomaly detection method and system based on automatic encoder and attention mechanism
CN117727307B (en) * 2024-02-18 2024-04-16 百鸟数据科技(北京)有限责任公司 Bird voice intelligent recognition method based on feature fusion
CN117909910A (en) * 2024-03-19 2024-04-19 成都工业学院 Automatic detection method for system exception log based on graph attention network

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107958216A (en) * 2017-11-27 2018-04-24 沈阳航空航天大学 Based on semi-supervised multi-modal deep learning sorting technique
DE102018100667A1 (en) * 2018-01-12 2019-07-18 Connaught Electronics Ltd. Computer vision pre-fusion and spatiotemporal tracking
CN109376857A (en) * 2018-09-03 2019-02-22 上海交通大学 A kind of multi-modal depth internet startup disk method of fusion structure and attribute information
CN112906770A (en) * 2021-02-04 2021-06-04 浙江师范大学 Cross-modal fusion-based deep clustering method and system

Also Published As

Publication number Publication date
WO2022166361A1 (en) 2022-08-11
CN112906770A (en) 2021-06-04

Similar Documents

Publication Publication Date Title
ZA202308290B (en) Cross-modal fusion-based deep clustering method and system
CN108399427A (en) Natural interactive method based on multimodal information fusion
CN103198828B (en) The construction method of speech corpus and system
WO2018177334A1 (en) Content explanation method and device
CN109543200A (en) A kind of text interpretation method and device
CN107463699A (en) A kind of method for realizing question and answer robot based on seq2seq models
CN110704630A (en) Self-optimization mechanism for identified associated graph
CN106952648A (en) A kind of output intent and robot for robot
CN111885414A (en) Data processing method, device and equipment and readable storage medium
CN103078867A (en) Automatic chatting method and chatting system among robots
CN110008467A (en) A kind of interdependent syntactic analysis method of Burmese based on transfer learning
CN103745208A (en) Face recognition method and device
CN111612160A (en) Incremental Bayesian network learning method based on particle swarm optimization algorithm
CN107643820B (en) VR passive robot and implementation method thereof
CN116415005A (en) Relationship extraction method for academic network construction of scholars
CN110716706A (en) Intelligent human-computer interaction instruction conversion method and system
CN108537253A (en) A kind of adaptive semi-supervised dimension reduction method constrained in pairs based on probability
CN106557464A (en) A kind of data processing method and device for talking with interactive system
CN112019403A (en) Cross-platform automatic mining method and system for message protocol state machine of Internet of things
US20210004603A1 (en) Method and apparatus for determining (raw) video materials for news
CN105653772A (en) Method and system of PBX (Plastic-Bonded Explosives) particle compression moulding numerical simulation automatic modeling
CN106782520B (en) Phonetic feature mapping method under a kind of complex environment
CN115131600A (en) Detection model training method, detection method, device, equipment and storage medium
CN111177370B (en) Algorithm for natural language processing
CN113626596A (en) Subway design specification text analysis and corpus construction method based on deep learning