CN108229667B - 基于人工神经网络类别的修剪 - Google Patents

基于人工神经网络类别的修剪 Download PDF

Info

Publication number
CN108229667B
CN108229667B CN201711214867.7A CN201711214867A CN108229667B CN 108229667 B CN108229667 B CN 108229667B CN 201711214867 A CN201711214867 A CN 201711214867A CN 108229667 B CN108229667 B CN 108229667B
Authority
CN
China
Prior art keywords
neural network
artificial neural
neuron
object type
removal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711214867.7A
Other languages
English (en)
Chinese (zh)
Other versions
CN108229667A (zh
Inventor
罗宾·赛博尔德
陈建丹
汉纳·比约格温斯多蒂尔
马丁·尔永奎斯特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Axis AB
Original Assignee
Axis AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Axis AB filed Critical Axis AB
Publication of CN108229667A publication Critical patent/CN108229667A/zh
Application granted granted Critical
Publication of CN108229667B publication Critical patent/CN108229667B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/40—Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/061—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using biological neurons, e.g. biological neurons connected to an integrated circuit
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Neurology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
CN201711214867.7A 2016-12-21 2017-11-28 基于人工神经网络类别的修剪 Active CN108229667B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16205831.7 2016-12-21
EP16205831.7A EP3340129B1 (en) 2016-12-21 2016-12-21 Artificial neural network class-based pruning

Publications (2)

Publication Number Publication Date
CN108229667A CN108229667A (zh) 2018-06-29
CN108229667B true CN108229667B (zh) 2019-09-10

Family

ID=57583087

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711214867.7A Active CN108229667B (zh) 2016-12-21 2017-11-28 基于人工神经网络类别的修剪

Country Status (6)

Country Link
US (1) US10552737B2 (enExample)
EP (1) EP3340129B1 (enExample)
JP (1) JP6755849B2 (enExample)
KR (1) KR102110486B1 (enExample)
CN (1) CN108229667B (enExample)
TW (1) TWI698807B (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108268947A (zh) * 2016-12-30 2018-07-10 富士通株式会社 用于提高神经网络的处理速度的装置和方法及其应用
US10892050B2 (en) * 2018-04-13 2021-01-12 International Business Machines Corporation Deep image classification of medical images
KR101989793B1 (ko) 2018-10-22 2019-06-17 한국기술교육대학교 산학협력단 컨볼루션 신경망을 위한 가속기 인식 가지 치기 방법 및 기록 매체
KR102796861B1 (ko) 2018-12-10 2025-04-17 삼성전자주식회사 인공 신경망을 압축하기 위한 장치 및 방법
KR102865734B1 (ko) * 2019-01-02 2025-09-26 삼성전자주식회사 뉴럴 네트워크 최적화 장치 및 뉴럴 네트워크 최적화 방법
US11551093B2 (en) * 2019-01-22 2023-01-10 Adobe Inc. Resource-aware training for neural networks
KR102214837B1 (ko) * 2019-01-29 2021-02-10 주식회사 디퍼아이 컨벌루션 신경망 파라미터 최적화 방법, 컨벌루션 신경망 연산방법 및 그 장치
JP7099968B2 (ja) * 2019-01-31 2022-07-12 日立Astemo株式会社 演算装置
JP7225876B2 (ja) 2019-02-08 2023-02-21 富士通株式会社 情報処理装置、演算処理装置および情報処理装置の制御方法
DE102019202816A1 (de) * 2019-03-01 2020-09-03 Robert Bosch Gmbh Training neuronaler Netzwerke für effizientes Implementieren auf Hardware
JP7150651B2 (ja) * 2019-03-22 2022-10-11 株式会社日立ソリューションズ・テクノロジー ニューラルネットワークのモデル縮約装置
KR102368962B1 (ko) 2019-03-22 2022-03-03 국민대학교산학협력단 멤리스터 어레이 회로를 제어하기 위한 게이트 회로를 포함하는 뉴럴 네트워크 시스템
JP2022095999A (ja) * 2019-04-19 2022-06-29 国立大学法人北海道大学 ニューラル計算装置、および、ニューラル計算方法
KR102782971B1 (ko) 2019-05-08 2025-03-18 삼성전자주식회사 인공 신경망 모델을 트레이닝하는 컴퓨팅 장치, 인공 신경망 모델을 트레이닝하는 방법 및 이를 저장하는 메모리 시스템
JP6787444B1 (ja) 2019-05-23 2020-11-18 沖電気工業株式会社 ニューラルネットワーク軽量化装置、ニューラルネットワーク軽量化方法およびプログラム
CN112070221B (zh) * 2019-05-31 2024-01-16 中科寒武纪科技股份有限公司 运算方法、装置及相关产品
US11514311B2 (en) * 2019-07-03 2022-11-29 International Business Machines Corporation Automated data slicing based on an artificial neural network
WO2021040921A1 (en) * 2019-08-29 2021-03-04 Alibaba Group Holding Limited Systems and methods for providing vector-wise sparsity in a neural network
JP7111671B2 (ja) 2019-09-05 2022-08-02 株式会社東芝 学習装置、学習システム、および学習方法
DE102019128715A1 (de) * 2019-10-24 2021-04-29 Krohne Messtechnik Gmbh Verfahren zur Erzeugung eines neuronalen Netzes für ein Feldgerät zur Vorhersage von Feldgerätfehlern und ein entsprechendes System
US11816574B2 (en) * 2019-10-25 2023-11-14 Alibaba Group Holding Limited Structured pruning for machine learning model
JP7396117B2 (ja) 2020-02-27 2023-12-12 オムロン株式会社 モデル更新装置、方法、及びプログラム
JP7495833B2 (ja) * 2020-07-07 2024-06-05 株式会社日立ソリューションズ・テクノロジー Ｄｎｎモデル圧縮システム
EP3945470A1 (en) * 2020-07-31 2022-02-02 Aptiv Technologies Limited Methods and systems for reducing the complexity of a computational network
KR20220048832A (ko) 2020-10-13 2022-04-20 삼성전자주식회사 인공 신경망 프루닝 방법 및 장치
US12340313B2 (en) * 2020-11-30 2025-06-24 Moffett International Co., Limited Neural network pruning method and system via layerwise analysis
JP7700650B2 (ja) * 2021-11-25 2025-07-01 富士通株式会社 モデル削減プログラム、装置、及び方法
GB202118066D0 (en) 2021-12-14 2022-01-26 Univ Dublin Class separation aware artificial neural network pruning method
US12061632B2 (en) * 2022-03-29 2024-08-13 Treasure Data, Inc. Interactive adaptation of machine learning models for time series data
KR20240028055A (ko) * 2022-08-24 2024-03-05 동국대학교 산학협력단 사이버 공격에 강인한 인공 신경망 구조 재구성 장치 및 방법
US20250190694A1 (en) * 2023-12-07 2025-06-12 International Business Machines Corporation Limiting undesired large language model (llm) output

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5787408A (en) * 1996-08-23 1998-07-28 The United States Of America As Represented By The Secretary Of The Navy System and method for determining node functionality in artificial neural networks
CN101310294A (zh) * 2005-11-15 2008-11-19 伯纳黛特·加纳 神经网络的训练方法
CN103209417A (zh) * 2013-03-05 2013-07-17 北京邮电大学 基于神经网络的频谱占用状态的预测方法以及装置
CN105512723A (zh) * 2016-01-20 2016-04-20 南京艾溪信息科技有限公司 一种用于稀疏连接的人工神经网络计算装置和方法
CN105580031A (zh) * 2013-10-28 2016-05-11 高通股份有限公司 在多维范围上对包括可分离子系统的系统的评估

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000298661A (ja) * 1999-04-15 2000-10-24 Fuji Xerox Co Ltd ニューラルネットワーク装置
US7308418B2 (en) * 2004-05-24 2007-12-11 Affinova, Inc. Determining design preferences of a group
JP4175296B2 (ja) * 2004-06-25 2008-11-05 キャタピラージャパン株式会社 建設機械のデータ処理装置及び建設機械のデータ処理方法
US7800490B2 (en) * 2008-01-09 2010-09-21 Sensormatic Electronics, LLC Electronic article surveillance system neural network minimizing false alarms and failures to deactivate
JP5860054B2 (ja) * 2010-10-27 2016-02-16 ソリド デザイン オートメーション インコーポレイティド まれな不良事象率を識別するための方法およびシステム
US9147155B2 (en) * 2011-08-16 2015-09-29 Qualcomm Incorporated Method and apparatus for neural temporal coding, learning and recognition
KR101359352B1 (ko) * 2012-06-28 2014-02-21 한국과학기술원 시각신경 회로장치 및 이를 이용한 시각신경 모방 시스템
US9406017B2 (en) * 2012-12-24 2016-08-02 Google Inc. System and method for addressing overfitting in a neural network
US9747554B2 (en) * 2013-05-24 2017-08-29 Qualcomm Incorporated Learning device with continuous configuration capability
US10373054B2 (en) * 2015-04-19 2019-08-06 International Business Machines Corporation Annealed dropout training of neural networks
US11315018B2 (en) * 2016-10-21 2022-04-26 Nvidia Corporation Systems and methods for pruning neural networks for resource efficient inference

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5787408A (en) * 1996-08-23 1998-07-28 The United States Of America As Represented By The Secretary Of The Navy System and method for determining node functionality in artificial neural networks
CN101310294A (zh) * 2005-11-15 2008-11-19 伯纳黛特·加纳 神经网络的训练方法
CN103209417A (zh) * 2013-03-05 2013-07-17 北京邮电大学 基于神经网络的频谱占用状态的预测方法以及装置
CN105580031A (zh) * 2013-10-28 2016-05-11 高通股份有限公司 在多维范围上对包括可分离子系统的系统的评估
CN105512723A (zh) * 2016-01-20 2016-04-20 南京艾溪信息科技有限公司 一种用于稀疏连接的人工神经网络计算装置和方法

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
A NEW FEEDFORWARD NEURAL NETWORK HIDDEN LAYER NEURON PRUNING ALGORITHM;F. Fnaiech 等;《2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings》;20010511;全文
Transferring and Compressing Convolutional Neural Networks for Face Representations;Jakob Grundstrom 等;《International Conference on Image Analysis and Recognition》;20160701;全文
一种基于神经网络复杂度的修剪算法;张昭昭 等;《控制与决策》;20100630;第25卷(第6期);全文
高阶神经网络结构优化与改进;征进;《中国优秀硕士学位论文全文数据库 信息科技辑》;20110515(第05期);全文

Also Published As

Publication number Publication date
US20180181867A1 (en) 2018-06-28
US10552737B2 (en) 2020-02-04
JP6755849B2 (ja) 2020-09-16
KR102110486B1 (ko) 2020-05-13
EP3340129B1 (en) 2019-01-30
KR20180072562A (ko) 2018-06-29
TWI698807B (zh) 2020-07-11
JP2018129033A (ja) 2018-08-16
CN108229667A (zh) 2018-06-29
TW201824093A (zh) 2018-07-01
EP3340129A1 (en) 2018-06-27

Similar Documents

Publication Publication Date Title
CN108229667B (zh) 基于人工神经网络类别的修剪
JP7127120B2 (ja) ビデオ分類の方法、情報処理の方法及びサーバー、並びにコンピュータ可読記憶媒体及びコンピュータプログラム
CN110807515B (zh) 模型生成方法和装置
US11468331B2 (en) Neural network load reduction device, information processing unit, and neural network load reduction method and computer-readable storage medium
CN113780466B (zh) 模型迭代优化方法、装置、电子设备和可读存储介质
CN110766142A (zh) 模型生成方法和装置
CN114787844A (zh) 模型训练方法、视频处理方法、装置、存储介质及电子设备
WO2018170454A2 (en) Using different data sources for a predictive model
CN111598238A (zh) 深度学习模型的压缩方法及装置
CN109977098A (zh) 非平稳时序数据预测方法、系统、存储介质及计算机设备
US10161269B2 (en) Output efficiency optimization in production systems
CN110705688B (zh) 对操作事件进行风险评估的神经网络系统、方法及装置
CN108769125B (zh) 应用推荐方法、装置、存储介质及计算机设备
KR20200143450A (ko) 화상 처리 방법, 장치, 전자 장치 및 저장 매체
CN114008666B (zh) 动态图像分辨率评估
CN119493679B (zh) 一种基于因果分析的故障溯源方法及装置、电子设备
CN115943379A (zh) 自动化机器学习：统一的、可定制的和可扩展的系统
CN114072809A (zh) 经由神经架构搜索的小且快速的视频处理网络
KR20250071101A (ko) 화질 평가 방법 및 장치
CN114118882B (zh) 基于组合模型的服务数据处理方法、装置、设备和介质
CN120316550A (zh) 一种基于证据理论与级联神经网络的边缘端故障诊断方法
CN118710754A (zh) 基于扩散概率模型的文生图方法、装置、设备及存储介质
CN117577097A (zh) 模型训练方法、装置、电子设备和介质
CN113742593B (zh) 用于推送信息的方法和装置
CN114077664B (zh) 机器学习平台中的文本处理方法、装置及设备

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant