SG11202106066YA - Cross-modal information retrieval method and device, and storage medium - Google Patents

Cross-modal information retrieval method and device, and storage medium

Info

Publication number
SG11202106066YA
SG11202106066YA SG11202106066YA SG11202106066YA SG11202106066YA SG 11202106066Y A SG11202106066Y A SG 11202106066YA SG 11202106066Y A SG11202106066Y A SG 11202106066YA SG 11202106066Y A SG11202106066Y A SG 11202106066YA SG 11202106066Y A SG11202106066Y A SG 11202106066YA
Authority
SG
Singapore
Prior art keywords
cross
storage medium
information retrieval
retrieval method
modal information
Prior art date
Application number
SG11202106066YA
Inventor
Zihao Wang
Xihui Liu
Jing Shao
Hongsheng Li
lv Sheng
Junjie Yan
Xiaogang Wang
Original Assignee
Shenzhen Sensetime Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Sensetime Technology Co Ltd filed Critical Shenzhen Sensetime Technology Co Ltd
Publication of SG11202106066YA publication Critical patent/SG11202106066YA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/254—Fusion techniques of classification results, e.g. of results related to same input data
    • G06F18/256—Fusion techniques of classification results, e.g. of results related to same input data of results relating to different input data, e.g. multimodal recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)
SG11202106066YA 2019-01-31 2019-04-22 Cross-modal information retrieval method and device, and storage medium SG11202106066YA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910099972.3A CN109816039B (en) 2019-01-31 2019-01-31 Cross-modal information retrieval method and device and storage medium
PCT/CN2019/083636 WO2020155418A1 (en) 2019-01-31 2019-04-22 Cross-modal information retrieval method and device, and storage medium

Publications (1)

Publication Number Publication Date
SG11202106066YA true SG11202106066YA (en) 2021-07-29

Family

ID=66606255

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202106066YA SG11202106066YA (en) 2019-01-31 2019-04-22 Cross-modal information retrieval method and device, and storage medium

Country Status (6)

Country Link
US (1) US20210295115A1 (en)
JP (1) JP2022510704A (en)
CN (1) CN109816039B (en)
SG (1) SG11202106066YA (en)
TW (1) TWI785301B (en)
WO (1) WO2020155418A1 (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110941727B (en) * 2019-11-29 2023-09-29 北京达佳互联信息技术有限公司 Resource recommendation method and device, electronic equipment and storage medium
CN111026894B (en) * 2019-12-12 2021-11-26 清华大学 Cross-modal image text retrieval method based on credibility self-adaptive matching network
CN111461203A (en) 2020-03-30 2020-07-28 北京百度网讯科技有限公司 Cross-modal processing method and device, electronic equipment and computer storage medium
CN112767303B (en) * 2020-08-12 2023-11-28 腾讯科技（深圳）有限公司 Image detection method, device, equipment and computer readable storage medium
CN112101380B (en) * 2020-08-28 2022-09-02 合肥工业大学 Product click rate prediction method and system based on image-text matching and storage medium
CN112989097A (en) * 2021-03-23 2021-06-18 北京百度网讯科技有限公司 Model training and picture retrieval method and device
CN113032614A (en) * 2021-04-28 2021-06-25 泰康保险集团股份有限公司 Cross-modal information retrieval method and device
CN113657478B (en) * 2021-08-10 2023-09-22 北京航空航天大学 Three-dimensional point cloud visual positioning method based on relational modeling
CN115858826A (en) * 2021-09-22 2023-03-28 腾讯科技（深圳）有限公司 Data processing method and device, computer equipment and storage medium
CN113822224B (en) * 2021-10-12 2023-12-26 中国人民解放军国防科技大学 Rumor detection method and device integrating multi-mode learning and multi-granularity structure learning
CN114417875A (en) * 2022-01-25 2022-04-29 腾讯科技（深圳）有限公司 Data processing method, device, equipment, readable storage medium and program product
CN114419351A (en) * 2022-01-28 2022-04-29 深圳市腾讯计算机系统有限公司 Image-text pre-training model training method and device and image-text prediction model training method and device
CN114356852B (en) * 2022-03-21 2022-09-09 展讯通信(天津)有限公司 File retrieval method, electronic equipment and storage medium
CN114693995B (en) * 2022-04-14 2023-07-07 北京百度网讯科技有限公司 Model training method applied to image processing, image processing method and device
CN114782719B (en) * 2022-04-26 2023-02-03 北京百度网讯科技有限公司 Training method of feature extraction model, object retrieval method and device
CN115909317B (en) * 2022-07-15 2024-07-05 广州珠江在线多媒体信息有限公司 Learning method and system for three-dimensional model-text joint expression
CN116108147A (en) * 2023-04-13 2023-05-12 北京蜜度信息技术有限公司 Cross-modal retrieval method, system, terminal and storage medium based on feature fusion
CN117078983B (en) * 2023-10-16 2023-12-29 安徽启新明智科技有限公司 Image matching method, device and equipment
CN117992805A (en) * 2024-04-07 2024-05-07 武汉商学院 Zero sample cross-modal retrieval method and system based on tensor product graph fusion diffusion

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4340939B2 (en) * 1998-10-09 2009-10-07 ソニー株式会社 Learning device and learning method, recognition device and recognition method, and recording medium
US7246043B2 (en) * 2005-06-30 2007-07-17 Oracle International Corporation Graphical display and correlation of severity scores of system metrics
US20130226892A1 (en) * 2012-02-29 2013-08-29 Fluential, Llc Multimodal natural language interface for faceted search
JP6368677B2 (en) * 2015-04-06 2018-08-01 日本電信電話株式会社 Mapping learning method, information compression method, apparatus, and program
US9836671B2 (en) * 2015-08-28 2017-12-05 Microsoft Technology Licensing, Llc Discovery of semantic similarities between images and text
TWI553494B (en) * 2015-11-04 2016-10-11 創意引晴股份有限公司 Multi-modal fusion based Intelligent fault-tolerant video content recognition system and recognition method
CN105760507B (en) * 2016-02-23 2019-05-03 复旦大学 Cross-module state topic relativity modeling method based on deep learning
CN106202256B (en) * 2016-06-29 2019-12-17 西安电子科技大学 Web image retrieval method based on semantic propagation and mixed multi-instance learning
CN107918782B (en) * 2016-12-29 2020-01-21 中国科学院计算技术研究所 Method and system for generating natural language for describing image content
CN107515895B (en) * 2017-07-14 2020-06-05 中国科学院计算技术研究所 Visual target retrieval method and system based on target detection
CN107562812B (en) * 2017-08-11 2021-01-15 北京大学 Cross-modal similarity learning method based on specific modal semantic space modeling
CN107608943B (en) * 2017-09-08 2020-07-28 中国石油大学(华东) Image subtitle generating method and system fusing visual attention and semantic attention
CN107979764B (en) * 2017-12-06 2020-03-31 中国石油大学(华东) Video subtitle generating method based on semantic segmentation and multi-layer attention framework
CN108108771A (en) * 2018-01-03 2018-06-01 华南理工大学 Image answering method based on multiple dimensioned deep learning
CN108304506B (en) * 2018-01-18 2022-08-26 腾讯科技（深圳）有限公司 Retrieval method, device and equipment
CN108932304B (en) * 2018-06-12 2019-06-18 山东大学 Video moment localization method, system and storage medium based on cross-module state

Also Published As

Publication number Publication date
WO2020155418A1 (en) 2020-08-06
CN109816039A (en) 2019-05-28
US20210295115A1 (en) 2021-09-23
CN109816039B (en) 2021-04-20
JP2022510704A (en) 2022-01-27
TWI785301B (en) 2022-12-01
TW202030623A (en) 2020-08-16

Similar Documents

Publication Publication Date Title
SG11202106066YA (en) Cross-modal information retrieval method and device, and storage medium
SG11202104369UA (en) Method and device for cross-modal information retrieval, and storage medium
SG11202108244PA (en) Order picking method and device, and storage medium
EP4024848A4 (en) Information collection device and method, inspection robot and storage medium
EP3893537A4 (en) Information processing and receiving method and device, and storage medium
EP4027726A4 (en) Indication method and device, and storage medium
SG11202108349UA (en) Information processing method and device, and storage medium
EP4044489A4 (en) Information determination method and device, electronic device and storage medium
EP3777761A4 (en) Smart toothbrush-based tooth-brushing evaluation method, apparatus, device and storage medium
EP3866474A4 (en) Video self-adaptation method, related device and storage medium
EP3790333A4 (en) Information indication method and device, and computer storage medium
EP3913554A4 (en) Pickup reminding method, device and equipment, and storage medium
EP3817255A4 (en) Data verification method and apparatus, and storage medium
EP3654195A4 (en) Index data storage and retrieval methods and apparatuses, and storage medium
EP3751395A4 (en) Information exchange method, device, storage medium, and electronic device
EP4029442A4 (en) Information processing device, information processing method, and storage medium
SG11202101410WA (en) Genovariation identification method and device, and storage medium
EP3780751A4 (en) Information indication method and device, and computer storage medium
EP3885939A4 (en) Information query method, apparatus, device, and storage medium
EP3993433A4 (en) Information embedding method and device, apparatus, and computer storage medium
EP3745342A4 (en) Data storage method, apparatus and device, data verification method, apparatus and device, and medium
SG11202107151TA (en) Search method and device, and storage medium
EP3836444A4 (en) Information transmission method and device and storage medium
EP3723437A4 (en) Response information processing method, device and storage medium
EP3739794A4 (en) Information determining method, device, and computer storage medium