CN111832573A - 一种基于类激活映射和视觉显著性的图像情感分类方法 - Google Patents
一种基于类激活映射和视觉显著性的图像情感分类方法 Download PDFInfo
- Publication number
- CN111832573A CN111832573A CN202010536571.2A CN202010536571A CN111832573A CN 111832573 A CN111832573 A CN 111832573A CN 202010536571 A CN202010536571 A CN 202010536571A CN 111832573 A CN111832573 A CN 111832573A
- Authority
- CN
- China
- Prior art keywords
- image
- emotion
- feature
- class activation
- map
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000008451 emotion Effects 0.000 title claims abstract description 160
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000004913 activation Effects 0.000 title claims abstract description 49
- 238000013507 mapping Methods 0.000 title claims abstract description 32
- 230000000007 visual effect Effects 0.000 title claims abstract description 23
- 238000010586 diagram Methods 0.000 claims abstract description 15
- 238000013527 convolutional neural network Methods 0.000 claims abstract description 10
- 238000000605 extraction Methods 0.000 claims description 24
- 238000004364 calculation method Methods 0.000 claims description 18
- 238000012549 training Methods 0.000 claims description 13
- 238000011176 pooling Methods 0.000 claims description 9
- 238000004422 calculation algorithm Methods 0.000 claims description 8
- 238000013461 design Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 7
- 238000013528 artificial neural network Methods 0.000 claims description 5
- 238000005070 sampling Methods 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 claims description 3
- 230000002996 emotional effect Effects 0.000 claims description 3
- 230000004927 fusion Effects 0.000 claims description 3
- 238000013508 migration Methods 0.000 claims description 3
- 230000005012 migration Effects 0.000 claims description 3
- 239000004576 sand Substances 0.000 claims description 3
- 238000002372 labelling Methods 0.000 abstract description 6
- 238000001514 detection method Methods 0.000 abstract description 3
- 238000012545 processing Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 12
- 238000013135 deep learning Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 206010011469 Crying Diseases 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000007635 classification algorithm Methods 0.000 description 1
- 238000013145 classification model Methods 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 238000012733 comparative method Methods 0.000 description 1
- 238000013136 deep learning model Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000008909 emotion recognition Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2415—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/047—Probabilistic or stochastic networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/048—Activation functions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Molecular Biology (AREA)
- Computational Linguistics (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Probability & Statistics with Applications (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Multimedia (AREA)
- Image Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010536571.2A CN111832573B (zh) | 2020-06-12 | 2020-06-12 | 一种基于类激活映射和视觉显著性的图像情感分类方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010536571.2A CN111832573B (zh) | 2020-06-12 | 2020-06-12 | 一种基于类激活映射和视觉显著性的图像情感分类方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111832573A true CN111832573A (zh) | 2020-10-27 |
CN111832573B CN111832573B (zh) | 2022-04-15 |
Family
ID=72899184
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010536571.2A Expired - Fee Related CN111832573B (zh) | 2020-06-12 | 2020-06-12 | 一种基于类激活映射和视觉显著性的图像情感分类方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111832573B (zh) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112465909A (zh) * | 2020-12-07 | 2021-03-09 | 南开大学 | 基于卷积神经网络的类激活映射目标定位方法及系统 |
CN114140792A (zh) * | 2022-02-08 | 2022-03-04 | 山东力聚机器人科技股份有限公司 | 基于动态滑动窗口的微小目标检测方法及装置 |
CN115100390A (zh) * | 2022-08-24 | 2022-09-23 | 华东交通大学 | 一种联合对比学习与自监督区域定位的图像情感预测方法 |
CN116030363A (zh) * | 2023-02-20 | 2023-04-28 | 北京数慧时空信息技术有限公司 | 遥感图像类激活映射图优化方法 |
CN117079103A (zh) * | 2023-10-16 | 2023-11-17 | 暨南大学 | 一种用于神经网络训练的伪标签生成方法及系统 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101814147A (zh) * | 2010-04-12 | 2010-08-25 | 中国科学院自动化研究所 | 一种实现场景图像的分类方法 |
CN104239383A (zh) * | 2014-06-09 | 2014-12-24 | 合肥工业大学 | 一种微博情感可视化方法 |
CN106886580A (zh) * | 2017-01-23 | 2017-06-23 | 北京工业大学 | 一种基于深度学习的图片情感极性分析方法 |
CN107341506A (zh) * | 2017-06-12 | 2017-11-10 | 华南理工大学 | 一种基于多方面深度学习表达的图像情感分类方法 |
CN107679580A (zh) * | 2017-10-21 | 2018-02-09 | 桂林电子科技大学 | 一种基于多模态深度潜在关联的异构迁移图像情感极性分析方法 |
US20190228211A1 (en) * | 2017-08-17 | 2019-07-25 | Ping An Technology (Shenzhen) Co., Ltd. | Au feature recognition method and device, and storage medium |
CN110119688A (zh) * | 2019-04-18 | 2019-08-13 | 南开大学 | 一种利用视觉注意力协同网络的图像情感分类方法 |
CN110619369A (zh) * | 2019-09-23 | 2019-12-27 | 常熟理工学院 | 基于特征金字塔与全局平均池化的细粒度图像分类方法 |
CN110852368A (zh) * | 2019-11-05 | 2020-02-28 | 南京邮电大学 | 全局与局部特征嵌入及图文融合的情感分析方法与系统 |
-
2020
- 2020-06-12 CN CN202010536571.2A patent/CN111832573B/zh not_active Expired - Fee Related
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101814147A (zh) * | 2010-04-12 | 2010-08-25 | 中国科学院自动化研究所 | 一种实现场景图像的分类方法 |
CN104239383A (zh) * | 2014-06-09 | 2014-12-24 | 合肥工业大学 | 一种微博情感可视化方法 |
CN106886580A (zh) * | 2017-01-23 | 2017-06-23 | 北京工业大学 | 一种基于深度学习的图片情感极性分析方法 |
CN107341506A (zh) * | 2017-06-12 | 2017-11-10 | 华南理工大学 | 一种基于多方面深度学习表达的图像情感分类方法 |
US20190228211A1 (en) * | 2017-08-17 | 2019-07-25 | Ping An Technology (Shenzhen) Co., Ltd. | Au feature recognition method and device, and storage medium |
CN107679580A (zh) * | 2017-10-21 | 2018-02-09 | 桂林电子科技大学 | 一种基于多模态深度潜在关联的异构迁移图像情感极性分析方法 |
CN110119688A (zh) * | 2019-04-18 | 2019-08-13 | 南开大学 | 一种利用视觉注意力协同网络的图像情感分类方法 |
CN110619369A (zh) * | 2019-09-23 | 2019-12-27 | 常熟理工学院 | 基于特征金字塔与全局平均池化的细粒度图像分类方法 |
CN110852368A (zh) * | 2019-11-05 | 2020-02-28 | 南京邮电大学 | 全局与局部特征嵌入及图文融合的情感分析方法与系统 |
Non-Patent Citations (3)
Title |
---|
MARIE KATSURAI 等: ""Image sentiment analysis using latent correlations among visual, textual, and sentiment views"", 《IEEE》 * |
王伟凝 等: ""基于多层次深度卷积神经网络的图像情感分类"", 《华南理工大学学报(自然科学版)》 * |
蔡国永 等: ""图像整体与局部区域嵌入的视觉情感分析"", 《计算机应用》 * |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112465909A (zh) * | 2020-12-07 | 2021-03-09 | 南开大学 | 基于卷积神经网络的类激活映射目标定位方法及系统 |
CN112465909B (zh) * | 2020-12-07 | 2022-09-20 | 南开大学 | 基于卷积神经网络的类激活映射目标定位方法及系统 |
CN114140792A (zh) * | 2022-02-08 | 2022-03-04 | 山东力聚机器人科技股份有限公司 | 基于动态滑动窗口的微小目标检测方法及装置 |
CN115100390A (zh) * | 2022-08-24 | 2022-09-23 | 华东交通大学 | 一种联合对比学习与自监督区域定位的图像情感预测方法 |
CN116030363A (zh) * | 2023-02-20 | 2023-04-28 | 北京数慧时空信息技术有限公司 | 遥感图像类激活映射图优化方法 |
CN117079103A (zh) * | 2023-10-16 | 2023-11-17 | 暨南大学 | 一种用于神经网络训练的伪标签生成方法及系统 |
CN117079103B (zh) * | 2023-10-16 | 2024-01-02 | 暨南大学 | 一种用于神经网络训练的伪标签生成方法及系统 |
Also Published As
Publication number | Publication date |
---|---|
CN111832573B (zh) | 2022-04-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111832573B (zh) | 一种基于类激活映射和视觉显著性的图像情感分类方法 | |
Castellano et al. | Deep learning approaches to pattern extraction and recognition in paintings and drawings: An overview | |
He et al. | Emotion recognition by assisted learning with convolutional neural networks | |
Tan et al. | Photograph aesthetical evaluation and classification with deep convolutional neural networks | |
CN108427740B (zh) | 一种基于深度度量学习的图像情感分类与检索算法 | |
Garain et al. | GRA_Net: A deep learning model for classification of age and gender from facial images | |
Roy et al. | Automated detection of substance use-related social media posts based on image and text analysis | |
Oluwasammi et al. | Features to text: a comprehensive survey of deep learning on semantic segmentation and image captioning | |
Balaji et al. | Multi-level feature fusion for group-level emotion recognition | |
CN109508640A (zh) | 一种人群情感分析方法、装置和存储介质 | |
CN112183464A (zh) | 基于深度神经网络和图卷积网络的视频行人识别方法 | |
CN116258990A (zh) | 一种基于跨模态亲和力的小样本参考视频目标分割方法 | |
CN110765285A (zh) | 基于视觉特征的多媒体信息内容管控方法及系统 | |
Zhu et al. | NAGNet: A novel framework for real‐time students' sentiment analysis in the wisdom classroom | |
Juyal et al. | Multilabel image classification using the CNN and DC-CNN model on Pascal VOC 2012 dataset | |
Renjith et al. | Indian sign language recognition: A comparative analysis using cnn and rnn models | |
Sumalakshmi et al. | Fused deep learning based Facial Expression Recognition of students in online learning mode | |
Li | Parallel two-class 3D-CNN classifiers for video classification | |
Cucurull et al. | Deep inference of personality traits by integrating image and word use in social networks | |
Wang | Improved facial expression recognition method based on gan | |
Yang et al. | Attention‐Based Sentiment Region Importance and Relationship Analysis for Image Sentiment Recognition | |
Vivek et al. | A Way to Mark Attentance using Face Recognition using PL | |
Malavath et al. | Natya Shastra: Deep Learning for Automatic Classification of Hand Mudra in Indian Classical Dance Videos. | |
Karim et al. | Bangla Sign Language Recognition using YOLOv5 | |
Bie et al. | FEMFER: feature enhancement for multi-faces expression recognition in classroom images |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20201027 Assignee: Guangxi wisdom Valley Technology Co.,Ltd. Assignor: GUILIN University OF ELECTRONIC TECHNOLOGY Contract record no.: X2022450000202 Denomination of invention: An image emotion classification method based on class activation mapping and visual saliency Granted publication date: 20220415 License type: Common License Record date: 20221125 |
|
EE01 | Entry into force of recordation of patent licensing contract | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20220415 |
|
CF01 | Termination of patent right due to non-payment of annual fee |