KR102582194B1 - 선택적 역전파 - Google Patents

선택적 역전파 Download PDF

Info

Publication number
KR102582194B1
KR102582194B1 KR1020187012033A KR20187012033A KR102582194B1 KR 102582194 B1 KR102582194 B1 KR 102582194B1 KR 1020187012033 A KR1020187012033 A KR 1020187012033A KR 20187012033 A KR20187012033 A KR 20187012033A KR 102582194 B1 KR102582194 B1 KR 102582194B1
Authority
KR
South Korea
Prior art keywords
class
examples
machine learning
learning model
training
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020187012033A
Other languages
English (en)
Korean (ko)
Other versions
KR20180063189A (ko
Inventor
레건 블라이스 토월
데이비드 조나단 줄리안
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20180063189A publication Critical patent/KR20180063189A/ko
Application granted granted Critical
Publication of KR102582194B1 publication Critical patent/KR102582194B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/047—Probabilistic or stochastic networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Analysis (AREA)
  • Feedback Control In General (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
KR1020187012033A 2015-09-29 2016-09-07 선택적 역전파 Active KR102582194B1 (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201562234559P 2015-09-29 2015-09-29
US62/234,559 2015-09-29
US15/081,780 US20170091619A1 (en) 2015-09-29 2016-03-25 Selective backpropagation
US15/081,780 2016-03-25
PCT/US2016/050539 WO2017058479A1 (en) 2015-09-29 2016-09-07 Selective backpropagation

Publications (2)

Publication Number Publication Date
KR20180063189A KR20180063189A (ko) 2018-06-11
KR102582194B1 true KR102582194B1 (ko) 2023-09-22

Family

ID=58407414

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020187012033A Active KR102582194B1 (ko) 2015-09-29 2016-09-07 선택적 역전파

Country Status (7)

Country Link
US (1) US20170091619A1 (enExample)
EP (1) EP3357003A1 (enExample)
JP (1) JP6859332B2 (enExample)
KR (1) KR102582194B1 (enExample)
CN (1) CN108140142A (enExample)
BR (1) BR112018006288A2 (enExample)
WO (1) WO2017058479A1 (enExample)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11250335B2 (en) * 2015-10-26 2022-02-15 NetraDyne, Inc. Joint processing for embedded data inference
US11995554B2 (en) * 2016-04-15 2024-05-28 Cambricon Technologies Corporation Limited Apparatus and methods for backward propagation in neural networks supporting discrete data
US10970605B2 (en) * 2017-01-03 2021-04-06 Samsung Electronics Co., Ltd. Electronic apparatus and method of operating the same
US11003989B2 (en) 2017-04-27 2021-05-11 Futurewei Technologies, Inc. Non-convex optimization by gradient-accelerated simulated annealing
CN107229968B (zh) * 2017-05-24 2021-06-29 北京小米移动软件有限公司 梯度参数确定方法、装置及计算机可读存储介质
US11517768B2 (en) * 2017-07-25 2022-12-06 Elekta, Inc. Systems and methods for determining radiation therapy machine parameter settings
US11556794B2 (en) * 2017-08-31 2023-01-17 International Business Machines Corporation Facilitating neural networks
WO2019070300A1 (en) * 2017-10-06 2019-04-11 Google Llc SYSTEMS AND METHODS FOR IMAGE SWITCHING
US11615129B2 (en) * 2017-11-28 2023-03-28 International Business Machines Corporation Electronic message text classification framework selection
US11475306B2 (en) 2018-03-22 2022-10-18 Amazon Technologies, Inc. Processing for multiple input data sets
US11461631B2 (en) * 2018-03-22 2022-10-04 Amazon Technologies, Inc. Scheduling neural network computations based on memory capacity
US20190303176A1 (en) * 2018-03-29 2019-10-03 Qualcomm Incorporated Using Machine Learning to Optimize Memory Usage
US11281999B2 (en) * 2019-05-14 2022-03-22 International Business Machines Corporation Armonk, New York Predictive accuracy of classifiers using balanced training sets
JP7295710B2 (ja) * 2019-06-07 2023-06-21 ジオテクノロジーズ株式会社 学習用画像データ生成装置
US12226657B2 (en) 2019-06-20 2025-02-18 Elekta, Inc. Predicting radiotherapy control points using projection images
WO2021040944A1 (en) 2019-08-26 2021-03-04 D5Ai Llc Deep learning with judgment
US20210065054A1 (en) * 2019-09-03 2021-03-04 Koninklijke Philips N.V. Prioritizing tasks of domain experts for machine learning model training
US20210089924A1 (en) * 2019-09-24 2021-03-25 Nec Laboratories America, Inc Learning weighted-average neighbor embeddings
JP7268924B2 (ja) * 2019-11-14 2023-05-08 株式会社アクセル 推論システム、推論装置、推論方法及び推論プログラム
US11077320B1 (en) 2020-02-07 2021-08-03 Elekta, Inc. Adversarial prediction of radiotherapy treatment plans
DE102020207004A1 (de) * 2020-06-04 2021-12-09 Robert Bosch Gesellschaft mit beschränkter Haftung Regularisiertes Training neuronaler Netzwerke
WO2023069973A1 (en) * 2021-10-19 2023-04-27 Emory University Selective backpropagation through time

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5142135B2 (ja) * 2007-11-13 2013-02-13 インターナショナル・ビジネス・マシーンズ・コーポレーション データを分類する技術
CN103763350A (zh) * 2014-01-02 2014-04-30 北京邮电大学 基于误差反向传播神经网络的web服务选择方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Sang-Hoon Oh, Error back-propagation algorithm for classification of imbalanced data , Neurocomputing 74, 1058-1061pages (2011.)*

Also Published As

Publication number Publication date
WO2017058479A1 (en) 2017-04-06
JP2018533138A (ja) 2018-11-08
JP6859332B2 (ja) 2021-04-14
CN108140142A (zh) 2018-06-08
BR112018006288A2 (pt) 2018-10-16
KR20180063189A (ko) 2018-06-11
EP3357003A1 (en) 2018-08-08
US20170091619A1 (en) 2017-03-30

Similar Documents

Publication Publication Date Title
KR102582194B1 (ko) 선택적 역전파
KR102826736B1 (ko) 트레이닝된 머신 학습 모델의 성능을 개선시키는 방법
US11334789B2 (en) Feature selection for retraining classifiers
US10275719B2 (en) Hyper-parameter selection for deep convolutional networks
US10083378B2 (en) Automatic detection of objects in video images
KR102595399B1 (ko) 미지의 클래스들의 검출 및 미지의 클래스들에 대한 분류기들의 초기화
KR102806514B1 (ko) 뉴럴 네트워크들에서의 러닝을 트랜스퍼하기 위한 장치들 및 방법들
KR102570706B1 (ko) 분류를 위한 강제된 희소성
US10515304B2 (en) Filter specificity as training criterion for neural networks
CN107430703A (zh) 对细调特征的顺序图像采样和存储
KR20180036709A (ko) 미디어 분류
CN107533665A (zh) 经由偏置项在深度神经网络中纳入自顶向下信息
JP2023546582A (ja) 個人化ニューラルネットワークプルーニング

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20180426

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20210819

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20230208

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20230701

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20230920

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20230920

End annual number: 3

Start annual number: 1

PG1601 Publication of registration