JP6859332B2 - 選択的バックプロパゲーション - Google Patents

選択的バックプロパゲーション Download PDF

Info

Publication number
JP6859332B2
JP6859332B2 JP2018515936A JP2018515936A JP6859332B2 JP 6859332 B2 JP6859332 B2 JP 6859332B2 JP 2018515936 A JP2018515936 A JP 2018515936A JP 2018515936 A JP2018515936 A JP 2018515936A JP 6859332 B2 JP6859332 B2 JP 6859332B2
Authority
JP
Japan
Prior art keywords
class
examples
training
gradient
sampling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018515936A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018533138A (ja
JP2018533138A5 (enExample
Inventor
トワル、レーガン・ブライス
ジュリアン、デイビッド・ジョナサン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of JP2018533138A publication Critical patent/JP2018533138A/ja
Publication of JP2018533138A5 publication Critical patent/JP2018533138A5/ja
Application granted granted Critical
Publication of JP6859332B2 publication Critical patent/JP6859332B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/047—Probabilistic or stochastic networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Probability & Statistics with Applications (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
  • Feedback Control In General (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
JP2018515936A 2015-09-29 2016-09-07 選択的バックプロパゲーション Active JP6859332B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201562234559P 2015-09-29 2015-09-29
US62/234,559 2015-09-29
US15/081,780 US20170091619A1 (en) 2015-09-29 2016-03-25 Selective backpropagation
US15/081,780 2016-03-25
PCT/US2016/050539 WO2017058479A1 (en) 2015-09-29 2016-09-07 Selective backpropagation

Publications (3)

Publication Number Publication Date
JP2018533138A JP2018533138A (ja) 2018-11-08
JP2018533138A5 JP2018533138A5 (enExample) 2019-09-26
JP6859332B2 true JP6859332B2 (ja) 2021-04-14

Family

ID=58407414

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018515936A Active JP6859332B2 (ja) 2015-09-29 2016-09-07 選択的バックプロパゲーション

Country Status (7)

Country Link
US (1) US20170091619A1 (enExample)
EP (1) EP3357003A1 (enExample)
JP (1) JP6859332B2 (enExample)
KR (1) KR102582194B1 (enExample)
CN (1) CN108140142A (enExample)
BR (1) BR112018006288A2 (enExample)
WO (1) WO2017058479A1 (enExample)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11250335B2 (en) * 2015-10-26 2022-02-15 NetraDyne, Inc. Joint processing for embedded data inference
US11995554B2 (en) * 2016-04-15 2024-05-28 Cambricon Technologies Corporation Limited Apparatus and methods for backward propagation in neural networks supporting discrete data
US10970605B2 (en) * 2017-01-03 2021-04-06 Samsung Electronics Co., Ltd. Electronic apparatus and method of operating the same
US11003989B2 (en) 2017-04-27 2021-05-11 Futurewei Technologies, Inc. Non-convex optimization by gradient-accelerated simulated annealing
CN107229968B (zh) * 2017-05-24 2021-06-29 北京小米移动软件有限公司 梯度参数确定方法、装置及计算机可读存储介质
US11517768B2 (en) * 2017-07-25 2022-12-06 Elekta, Inc. Systems and methods for determining radiation therapy machine parameter settings
US11556794B2 (en) * 2017-08-31 2023-01-17 International Business Machines Corporation Facilitating neural networks
US11823359B2 (en) * 2017-10-06 2023-11-21 Google Llc Systems and methods for leveling images
US11615129B2 (en) * 2017-11-28 2023-03-28 International Business Machines Corporation Electronic message text classification framework selection
US11461631B2 (en) * 2018-03-22 2022-10-04 Amazon Technologies, Inc. Scheduling neural network computations based on memory capacity
US11475306B2 (en) 2018-03-22 2022-10-18 Amazon Technologies, Inc. Processing for multiple input data sets
US20190303176A1 (en) * 2018-03-29 2019-10-03 Qualcomm Incorporated Using Machine Learning to Optimize Memory Usage
US11281999B2 (en) * 2019-05-14 2022-03-22 International Business Machines Corporation Armonk, New York Predictive accuracy of classifiers using balanced training sets
JP7295710B2 (ja) * 2019-06-07 2023-06-21 ジオテクノロジーズ株式会社 学習用画像データ生成装置
CN114206438B (zh) 2019-06-20 2024-05-03 医科达有限公司 使用投影图像预测放射治疗控制点
US11836624B2 (en) * 2019-08-26 2023-12-05 D5Ai Llc Deep learning with judgment
US20210065054A1 (en) * 2019-09-03 2021-03-04 Koninklijke Philips N.V. Prioritizing tasks of domain experts for machine learning model training
US20210089924A1 (en) * 2019-09-24 2021-03-25 Nec Laboratories America, Inc Learning weighted-average neighbor embeddings
JP7268924B2 (ja) * 2019-11-14 2023-05-08 株式会社アクセル 推論システム、推論装置、推論方法及び推論プログラム
US11077320B1 (en) 2020-02-07 2021-08-03 Elekta, Inc. Adversarial prediction of radiotherapy treatment plans
DE102020207004A1 (de) * 2020-06-04 2021-12-09 Robert Bosch Gesellschaft mit beschränkter Haftung Regularisiertes Training neuronaler Netzwerke
WO2023069973A1 (en) * 2021-10-19 2023-04-27 Emory University Selective backpropagation through time
US20240220530A1 (en) * 2022-12-28 2024-07-04 Adobe Inc. Multi-modal sound effects recommendation

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5142135B2 (ja) * 2007-11-13 2013-02-13 インターナショナル・ビジネス・マシーンズ・コーポレーション データを分類する技術
CN103763350A (zh) * 2014-01-02 2014-04-30 北京邮电大学 基于误差反向传播神经网络的web服务选择方法

Also Published As

Publication number Publication date
JP2018533138A (ja) 2018-11-08
BR112018006288A2 (pt) 2018-10-16
US20170091619A1 (en) 2017-03-30
WO2017058479A1 (en) 2017-04-06
EP3357003A1 (en) 2018-08-08
KR102582194B1 (ko) 2023-09-22
KR20180063189A (ko) 2018-06-11
CN108140142A (zh) 2018-06-08

Similar Documents

Publication Publication Date Title
JP6859332B2 (ja) 選択的バックプロパゲーション
JP6776331B2 (ja) 未知クラスの検出および未知クラスのための分類器の初期化
JP7037478B2 (ja) 分類のための強制的なスパース性
JP6862426B2 (ja) トレーニングされた機械学習モデルのパフォーマンスを改善するための方法
CN107209873B (zh) 用于深度卷积网络的超参数选择
JP6869948B2 (ja) ニューラルネットワークにおける転移学習
CN107533669B (zh) 滤波器特异性作为用于神经网络的训练准则
US11334789B2 (en) Feature selection for retraining classifiers
JP2018528521A (ja) メディア分類
JP2018514852A (ja) 逐次画像サンプリングおよび微調整された特徴の記憶
CN108431826A (zh) 自动检测视频图像中的对象
JP2018518740A (ja) バイアス項を介して深層ニューラルネットワーク中にトップダウン情報を組み込むこと
CN117521732A (zh) 一种自定义网络层的检测方法、装置及设备

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180608

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180607

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190814

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20190814

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20200923

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20201006

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201225

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210224

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210325

R150 Certificate of patent or registration of utility model

Ref document number: 6859332

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250