CN113255915B8 - Knowledge distillation method, device, equipment and medium based on structured example graph - Google Patents

Knowledge distillation method, device, equipment and medium based on structured example graph Download PDF

Info

Publication number
CN113255915B8
CN113255915B8 CN202110551061.7A CN202110551061A CN113255915B8 CN 113255915 B8 CN113255915 B8 CN 113255915B8 CN 202110551061 A CN202110551061 A CN 202110551061A CN 113255915 B8 CN113255915 B8 CN 113255915B8
Authority
CN
China
Prior art keywords
map
detected
structure diagram
network
feature map
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110551061.7A
Other languages
Chinese (zh)
Other versions
CN113255915B (en
CN113255915A (en
Inventor
陈亦新
陈鹏光
沈小勇
吕江波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Smartmore Technology Co Ltd
Shanghai Smartmore Technology Co Ltd
Original Assignee
Shenzhen Smartmore Technology Co Ltd
Shanghai Smartmore Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Smartmore Technology Co Ltd, Shanghai Smartmore Technology Co Ltd filed Critical Shenzhen Smartmore Technology Co Ltd
Priority to CN202110551061.7A priority Critical patent/CN113255915B8/en
Publication of CN113255915A publication Critical patent/CN113255915A/en
Publication of CN113255915B publication Critical patent/CN113255915B/en
Application granted granted Critical
Publication of CN113255915B8 publication Critical patent/CN113255915B8/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/02—Knowledge representation; Symbolic representation
    • G06N5/022—Knowledge engineering; Knowledge acquisition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/253—Fusion techniques of extracted features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/02—Knowledge representation; Symbolic representation
    • G06N5/027—Frames
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Computing Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The application relates to a knowledge distillation method, a device, a computer device and a storage medium based on a structured example graph. According to the method and the device, both the foreground features and the background features in the teacher network can be effectively migrated to the student network, and the accuracy of target detection is further improved. The method comprises the following steps: acquiring training images, and respectively inputting the training images to a teacher network student network to obtain a first feature map and a second feature map; respectively inputting the first feature map and the second feature map into a region candidate network to obtain a first map to be detected and a second map to be detected, wherein the first map to be detected and the second map to be detected comprise boundary frames; encoding based on object examples in each bounding box to obtain a first structure diagram and a second structure diagram; obtaining a distillation loss part based on the first structure diagram and the second structure diagram; obtaining a basic loss part according to the distance between the detection result of the second graph to be detected and the real label; the student network is trained based on the distillation loss portion and the base loss portion.
CN202110551061.7A 2021-05-20 2021-05-20 Knowledge distillation method, device, equipment and medium based on structured example graph Active CN113255915B8 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110551061.7A CN113255915B8 (en) 2021-05-20 2021-05-20 Knowledge distillation method, device, equipment and medium based on structured example graph

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110551061.7A CN113255915B8 (en) 2021-05-20 2021-05-20 Knowledge distillation method, device, equipment and medium based on structured example graph

Publications (3)

Publication Number Publication Date
CN113255915A CN113255915A (en) 2021-08-13
CN113255915B CN113255915B (en) 2022-11-18
CN113255915B8 true CN113255915B8 (en) 2024-02-06

Family

ID=77182967

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110551061.7A Active CN113255915B8 (en) 2021-05-20 2021-05-20 Knowledge distillation method, device, equipment and medium based on structured example graph

Country Status (1)

Country Link
CN (1) CN113255915B8 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113920307A (en) * 2021-09-29 2022-01-11 北京百度网讯科技有限公司 Model training method, device, equipment, storage medium and image detection method
CN113887610B (en) * 2021-09-29 2024-02-02 内蒙古工业大学 Pollen image classification method based on cross-attention distillation transducer
CN114359649B (en) * 2021-11-22 2024-03-22 腾讯科技（深圳）有限公司 Image processing method, apparatus, device, storage medium, and program product
CN114970862B (en) * 2022-04-28 2024-05-28 北京航空航天大学 PDL1 expression level prediction method based on multi-instance knowledge distillation model
CN114882243B (en) * 2022-07-11 2022-11-22 浙江大华技术股份有限公司 Target detection method, electronic device, and computer-readable storage medium
CN115019060A (en) * 2022-07-12 2022-09-06 北京百度网讯科技有限公司 Target recognition method, and training method and device of target recognition model
CN116664840B (en) * 2023-05-31 2024-02-13 博衍科技(珠海)有限公司 Semantic segmentation method, device and equipment based on mutual relationship knowledge distillation

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111462162A (en) * 2019-01-18 2020-07-28 上海大学 Foreground segmentation algorithm for specific class of pictures
CN111898735A (en) * 2020-07-14 2020-11-06 上海眼控科技股份有限公司 Distillation learning method, distillation learning device, computer equipment and storage medium
WO2021090771A1 (en) * 2019-11-08 2021-05-14 Canon Kabushiki Kaisha Method, apparatus and system for training a neural network, and storage medium storing instructions

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180268292A1 (en) * 2017-03-17 2018-09-20 Nec Laboratories America, Inc. Learning efficient object detection models with knowledge distillation
CN110580487A (en) * 2018-06-08 2019-12-17 Oppo广东移动通信有限公司 Neural network training method, neural network construction method, image processing method and device
CN110163344B (en) * 2019-04-26 2021-07-09 北京迈格威科技有限公司 Neural network training method, device, equipment and storage medium
CN111507227B (en) * 2020-04-10 2023-04-18 南京汉韬科技有限公司 Multi-student individual segmentation and state autonomous identification method based on deep learning
CN111914727B (en) * 2020-07-28 2024-04-26 联芯智能(南京)科技有限公司 Small target human body detection method based on balance sampling and nonlinear feature fusion
CN111709497B (en) * 2020-08-20 2020-11-20 腾讯科技（深圳）有限公司 Information processing method and device and computer readable storage medium
CN112164054A (en) * 2020-09-30 2021-01-01 交叉信息核心技术研究院(西安)有限公司 Knowledge distillation-based image target detection method and detector and training method thereof
CN112200318B (en) * 2020-10-10 2021-11-09 广州云从人工智能技术有限公司 Target detection method, device, machine readable medium and equipment
CN112330709A (en) * 2020-10-29 2021-02-05 奥比中光科技集团股份有限公司 Foreground image extraction method and device, readable storage medium and terminal equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111462162A (en) * 2019-01-18 2020-07-28 上海大学 Foreground segmentation algorithm for specific class of pictures
WO2021090771A1 (en) * 2019-11-08 2021-05-14 Canon Kabushiki Kaisha Method, apparatus and system for training a neural network, and storage medium storing instructions
CN111898735A (en) * 2020-07-14 2020-11-06 上海眼控科技股份有限公司 Distillation learning method, distillation learning device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN113255915B (en) 2022-11-18
CN113255915A (en) 2021-08-13

Similar Documents

Publication Publication Date Title
CN113255915B8 (en) Knowledge distillation method, device, equipment and medium based on structured example graph
CN110765921B (en) Video object positioning method based on weak supervised learning and video spatiotemporal features
CN107833213A (en) A kind of Weakly supervised object detecting method based on pseudo- true value adaptive method
EP3910543A3 (en) Method for training object detection model, object detection method and related apparatus
CN110796143A (en) Scene text recognition method based on man-machine cooperation
CN111862115A (en) Mask RCNN-based remote sensing image segmentation method
CN111488873B (en) Character level scene text detection method and device based on weak supervision learning
CN110490099A (en) A kind of subway common location stream of people's analysis method based on machine vision
CN104751153B (en) A kind of method and device of identification scene word
CN110689018A (en) Intelligent marking system and processing method thereof
CN114663904A (en) PDF document layout detection method, device, equipment and medium
CN107330363B (en) Rapid internet billboard detection method
CN114782530A (en) Three-dimensional semantic map construction method, device, equipment and medium under indoor scene
CN116309155A (en) Image restoration method, model and device based on convolution and converter hybrid network
CN114386504A (en) Engineering drawing character recognition method
CN110046595A (en) A kind of intensive method for detecting human face multiple dimensioned based on tandem type
CN115841557B (en) Intelligent crane operation environment construction method based on digital twin technology
CN116993985A (en) Method for realizing Zero-Shot automatic cutting of safety belt based on CLIP
Lai et al. Research on head-up and down behavior computer detection by deep learning and artificial intelligence
CN106557783A (en) A kind of automatic extracting system and method for caricature dominant role
CN112926569B (en) Method for detecting natural scene image text in social network
CN110751153B (en) Semantic annotation method for indoor scene RGB-D image
CN109740618B (en) Test paper score automatic statistical method and device based on FHOG characteristics
CN111091179A (en) Heterogeneous depth model mobility measurement method based on attribution graph
CN112307908B (en) Video semantic extraction method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Chen Yixin

Inventor after: Chen Pengguang

Inventor after: Shen Xiaoyong

Inventor after: Lv Jiangbo

Inventor before: Chen Yixin

Inventor before: Chen Pengguang

Inventor before: Jia Jiaya

Inventor before: Shen Xiaoyong

Inventor before: Lv Jiangbo

CB03 Change of inventor or designer information
GR01 Patent grant
GR01 Patent grant
OR01 Other related matters
OR01 Other related matters
CI03 Correction of invention patent

Correction item: Inventor

Correct: Chen Yixin|Chen Pengguang|Shen Xiaoyong|Lv Jiangbo

False: Chen Yixin|Shen Xiaoyong|Lv Jiangbo

Number: 46-02

Page: The title page

Volume: 38

Correction item: Inventor

Correct: Chen Yixin|Chen Pengguang|Shen Xiaoyong|Lv Jiangbo

False: Chen Yixin|Shen Xiaoyong|Lv Jiangbo

Number: 46-02

Volume: 38

CI03 Correction of invention patent