CN111095293A - 图像美学处理方法及电子设备 - Google Patents

图像美学处理方法及电子设备 Download PDF

Info

Publication number
CN111095293A
CN111095293A CN201880060615.XA CN201880060615A CN111095293A CN 111095293 A CN111095293 A CN 111095293A CN 201880060615 A CN201880060615 A CN 201880060615A CN 111095293 A CN111095293 A CN 111095293A
Authority
CN
China
Prior art keywords
neural network
image
model
information
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201880060615.XA
Other languages
English (en)
Other versions
CN111095293B (zh
Inventor
张晴
谢淼
芮祥麟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN111095293A publication Critical patent/CN111095293A/zh
Application granted granted Critical
Publication of CN111095293B publication Critical patent/CN111095293B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/004—Artificial life, i.e. computing arrangements simulating life
    • G06N3/006—Artificial life, i.e. computing arrangements simulating life based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G06F18/2148—Generating training patterns; Bootstrap methods, e.g. bagging or boosting characterised by the process organisation or structure, e.g. boosting cascade
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00—Computing arrangements based on specific mathematical models
    • G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/776—Validation; Performance evaluation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30168—Image quality inspection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Mathematical Physics (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Computational Linguistics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Quality & Reliability (AREA)
  • Probability & Statistics with Applications (AREA)
  • Algebra (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Image Analysis (AREA)

Abstract

本申请提供一种图像美学处理方法及电子设备，其中，图像美学评分模型生成方法包括：根据预设的卷积结构集合构建第一神经网络；获取图像分类神经网络，其中，所述图像分类神经网络用于对图像的场景进行分类；根据所述第一神经网络以及所述图像分类神经网络，得到第二神经网络，所述第二神经网络为包含场景信息的神经网络；根据所述第二神经网络，确定图像美学评分模型，所述图像美学评分模型的输出信息包括图像场景分类信息。该方法中，通过在主干神经网络上融合了场景信息，使得所得到的图像美学评分模型具有可解释性，同时，使用预设的卷积结构集合，可以提升图像美学评分模型的评分准确率。

Description

PCT国内申请，说明书已公开。

Claims (35)

  1. PCT国内申请，权利要求书已公开。
CN201880060615.XA 2017-12-15 2018-03-26 图像美学处理方法及电子设备 Active CN111095293B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN2017113512834 2017-12-15
CN201711351283 2017-12-15
PCT/CN2018/080533 WO2019114147A1 (zh) 2017-12-15 2018-03-26 图像美学处理方法及电子设备

Publications (2)

Publication Number Publication Date
CN111095293A true CN111095293A (zh) 2020-05-01
CN111095293B CN111095293B (zh) 2023-09-12

Family

ID=66819909

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880060615.XA Active CN111095293B (zh) 2017-12-15 2018-03-26 图像美学处理方法及电子设备

Country Status (3)

Country Link
US (1) US11314988B2 (zh)
CN (1) CN111095293B (zh)
WO (1) WO2019114147A1 (zh)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112418295A (zh) * 2020-11-18 2021-02-26 北京三快在线科技有限公司 图像处理方法、装置、设备及存储介质
CN112650870A (zh) * 2020-12-30 2021-04-13 北京天广汇通科技有限公司 一种训练图片排序模型的方法、图片排序的方法以及装置
CN112839167A (zh) * 2020-12-30 2021-05-25 Oppo（重庆）智能科技有限公司 图像处理方法、装置、电子设备及计算机可读介质
CN112967358A (zh) * 2021-03-08 2021-06-15 上海微电机研究所(中国电子科技集团公司第二十一研究所) 基于美学质量的数字相册筛选方法、装置和电子设备
CN113744012A (zh) * 2020-08-10 2021-12-03 北京沃东天骏信息技术有限公司 一种信息处理方法、装置和存储介质
CN114283083A (zh) * 2021-12-22 2022-04-05 杭州电子科技大学 一种基于解耦表示的场景生成模型的美学增强方法
CN114970654A (zh) * 2021-05-21 2022-08-30 华为技术有限公司 数据处理方法、装置和终端

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11367222B2 (en) * 2018-04-20 2022-06-21 Hewlett-Packard Development Company, L.P. Three-dimensional shape classification and retrieval using convolutional neural networks and majority vote
US11531840B2 (en) * 2019-02-08 2022-12-20 Vizit Labs, Inc. Systems, methods, and storage media for training a model for image evaluation
US10467504B1 (en) 2019-02-08 2019-11-05 Adhark, Inc. Systems, methods, and storage media for evaluating digital images
CN112258450B (zh) * 2019-07-31 2022-02-25 华为技术有限公司 一种对象评分方法及装置
CN111340073A (zh) * 2020-02-12 2020-06-26 杭州涂鸦信息技术有限公司 一种图像等级评判的深度学习训练方法及系统
US11494886B2 (en) * 2020-05-29 2022-11-08 Adobe Inc. Hierarchical multiclass exposure defects classification in images
CN112559884B (zh) * 2020-12-25 2023-09-26 北京百度网讯科技有限公司 全景图与兴趣点挂接的方法、装置、电子设备及存储介质
CN113012153A (zh) * 2021-04-30 2021-06-22 武汉纺织大学 一种铝型材瑕疵检测方法
CN114494130A (zh) * 2021-12-24 2022-05-13 吉林建筑大学 一种基于最优模型评价准则的产品美学评价体系
CN114324361B (zh) * 2021-12-31 2024-03-15 大连理工大学 一种金相组织劣化评级方法及装置
CN116452904B (zh) * 2023-02-10 2023-09-15 北京航空航天大学 图像美学质量确定方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160098844A1 (en) * 2014-10-03 2016-04-07 EyeEm Mobile GmbH Systems, methods, and computer program products for searching and sorting images by aesthetic quality
US20160179844A1 (en) * 2014-12-17 2016-06-23 Adobe Systems Incorporated Neural Network Image Curation Control
CN107018330A (zh) * 2017-04-19 2017-08-04 中国电子科技集团公司电子科学研究院 一种实时拍照指导方法及装置
CN107146198A (zh) * 2017-04-19 2017-09-08 中国电子科技集团公司电子科学研究院 一种照片智能裁剪方法及装置
US20170347259A1 (en) * 2016-05-31 2017-11-30 Samsung Electronics Co., Ltd. Network use method using virtual sim and apparatus therefor

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104333707B (zh) * 2014-11-25 2017-10-10 广东威创视讯科技股份有限公司 相机参数调整方法和系统
CN105528757B (zh) 2015-12-08 2019-01-29 华南理工大学 一种基于内容的图像美学质量提升方法
CN105787510A (zh) * 2016-02-26 2016-07-20 华东理工大学 基于深度学习实现地铁场景分类的系统及方法
CN107169586A (zh) * 2017-03-29 2017-09-15 北京百度网讯科技有限公司 基于人工智能的资源组合优化方法、装置及存储介质
CN107153838A (zh) 2017-04-19 2017-09-12 中国电子科技集团公司电子科学研究院 一种照片自动分级方法及装置
US10521705B2 (en) * 2017-11-14 2019-12-31 Adobe Inc. Automatically selecting images using multicontext aware ratings

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160098844A1 (en) * 2014-10-03 2016-04-07 EyeEm Mobile GmbH Systems, methods, and computer program products for searching and sorting images by aesthetic quality
US20160179844A1 (en) * 2014-12-17 2016-06-23 Adobe Systems Incorporated Neural Network Image Curation Control
US20170347259A1 (en) * 2016-05-31 2017-11-30 Samsung Electronics Co., Ltd. Network use method using virtual sim and apparatus therefor
CN107018330A (zh) * 2017-04-19 2017-08-04 中国电子科技集团公司电子科学研究院 一种实时拍照指导方法及装置
CN107146198A (zh) * 2017-04-19 2017-09-08 中国电子科技集团公司电子科学研究院 一种照片智能裁剪方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
谢燕娟等: "特征互补的图像美学质量评分方法" *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113744012A (zh) * 2020-08-10 2021-12-03 北京沃东天骏信息技术有限公司 一种信息处理方法、装置和存储介质
CN112418295A (zh) * 2020-11-18 2021-02-26 北京三快在线科技有限公司 图像处理方法、装置、设备及存储介质
CN112650870A (zh) * 2020-12-30 2021-04-13 北京天广汇通科技有限公司 一种训练图片排序模型的方法、图片排序的方法以及装置
CN112839167A (zh) * 2020-12-30 2021-05-25 Oppo（重庆）智能科技有限公司 图像处理方法、装置、电子设备及计算机可读介质
CN112839167B (zh) * 2020-12-30 2023-06-30 Oppo（重庆）智能科技有限公司 图像处理方法、装置、电子设备及计算机可读介质
CN112967358A (zh) * 2021-03-08 2021-06-15 上海微电机研究所(中国电子科技集团公司第二十一研究所) 基于美学质量的数字相册筛选方法、装置和电子设备
CN114970654A (zh) * 2021-05-21 2022-08-30 华为技术有限公司 数据处理方法、装置和终端
CN114283083A (zh) * 2021-12-22 2022-04-05 杭州电子科技大学 一种基于解耦表示的场景生成模型的美学增强方法
CN114283083B (zh) * 2021-12-22 2024-05-10 杭州电子科技大学 一种基于解耦表示的场景生成模型的美学增强方法

Also Published As

Publication number Publication date
WO2019114147A1 (zh) 2019-06-20
US11314988B2 (en) 2022-04-26
US20210182613A1 (en) 2021-06-17
CN111095293B (zh) 2023-09-12

Similar Documents

Publication Publication Date Title
CN111095293A (zh) 图像美学处理方法及电子设备
CN112052787B (zh) 基于人工智能的目标检测方法、装置及电子设备
CN111523621B (zh) 图像识别方法、装置、计算机设备和存储介质
CN110188641B (zh) 图像识别和神经网络模型的训练方法、装置和系统
CN111079639B (zh) 垃圾图像分类模型构建的方法、装置、设备及存储介质
Kao et al. Hierarchical aesthetic quality assessment using deep convolutional neural networks
CN110765860B (zh) 摔倒判定方法、装置、计算机设备及存储介质
JP2022508163A (ja) ユーザタグ生成方法並びにその、装置、コンピュータプログラム及びコンピュータ機器
CN107683469A (zh) 一种基于深度学习的产品分类方法及装置
CN107909038B (zh) 一种社交关系分类模型训练方法、装置、电子设备及介质
CN111368672A (zh) 一种用于遗传病面部识别模型的构建方法及装置
CN111177473B (zh) 人员关系分析方法、装置和可读存储介质
WO2020205049A1 (en) N-ary relation prediction over text spans
CN109919252A (zh) 利用少数标注图像生成分类器的方法
CN110489545A (zh) 文本分类方法及装置、存储介质、计算机设备
CN112508094A (zh) 垃圾图片的识别方法、装置及设备
US11763551B2 (en) Systems and methods for fine tuning image classification neural networks
CN112052816B (zh) 基于自适应图卷积对抗网络的人体行为预测方法及系统
CN112084825B (zh) 烹饪评价方法、烹饪推荐方法、计算机设备及存储介质
CN113536105A (zh) 推荐模型训练方法和装置
CN109656433B (zh) 类目信息处理方法、装置、计算机设备和存储介质
CN117435999A (zh) 一种风险评估方法、装置、设备以及介质
CN116434010A (zh) 一种多视图的行人属性识别方法
Abu-Jamie et al. Classification of Sign-Language Using Deep Learning by ResNet
CN112347893B (zh) 用于视频行为识别的模型训练方法、装置和计算机设备

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant