CN106164939A - 尖峰发放深度置信网络(dbn)中的训练、识别、以及生成 - Google Patents

尖峰发放深度置信网络(dbn)中的训练、识别、以及生成 Download PDF

Info

Publication number
CN106164939A
CN106164939A CN201580016027.2A CN201580016027A CN106164939A CN 106164939 A CN106164939 A CN 106164939A CN 201580016027 A CN201580016027 A CN 201580016027A CN 106164939 A CN106164939 A CN 106164939A
Authority
CN
China
Prior art keywords
result set
chain
population
processing nodes
computing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201580016027.2A
Other languages
English (en)
Chinese (zh)
Inventor
V·S·R·安纳普莱蒂
D·J·朱里安
A·莎拉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN106164939A publication Critical patent/CN106164939A/zh
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/049Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/047Probabilistic or stochastic networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0475Generative networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0499Feedforward networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/082Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/088Non-supervised learning, e.g. competitive learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/09Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
CN201580016027.2A 2014-03-26 2015-03-17 尖峰发放深度置信网络(dbn)中的训练、识别、以及生成 Pending CN106164939A (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201461970807P 2014-03-26 2014-03-26
US61/970,807 2014-03-26
US14/659,516 US20150278680A1 (en) 2014-03-26 2015-03-16 Training, recognition, and generation in a spiking deep belief network (dbn)
US14/659,516 2015-03-16
PCT/US2015/021092 WO2015148190A2 (en) 2014-03-26 2015-03-17 Training, recognition, and generation in a spiking deep belief network (dbn)

Publications (1)

Publication Number Publication Date
CN106164939A true CN106164939A (zh) 2016-11-23

Family

ID=54190874

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580016027.2A Pending CN106164939A (zh) 2014-03-26 2015-03-17 尖峰发放深度置信网络(dbn)中的训练、识别、以及生成

Country Status (7)

Country Link
US (1) US20150278680A1 (https=)
EP (1) EP3123405A2 (https=)
JP (1) JP2017513127A (https=)
KR (1) KR20160138002A (https=)
CN (1) CN106164939A (https=)
BR (1) BR112016022268A2 (https=)
WO (1) WO2015148190A2 (https=)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108304912A (zh) * 2017-12-29 2018-07-20 北京理工大学 一种运用抑制信号实现脉冲神经网络监督学习的系统和方法
US11008361B2 (en) 2017-04-18 2021-05-18 Zhejiang Palo Alto Pharmaceuticals, Inc. Liver-specific delivery-based anti-hepatitis C prodrug nucleoside cyclo-phosphate compound and uses thereof
CN115169547A (zh) * 2022-09-09 2022-10-11 深圳时识科技有限公司 神经形态芯片及电子设备

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160034812A1 (en) * 2014-07-31 2016-02-04 Qualcomm Incorporated Long short-term memory using a spiking neural network
US10795935B2 (en) 2016-02-05 2020-10-06 Sas Institute Inc. Automated generation of job flow definitions
US10650046B2 (en) 2016-02-05 2020-05-12 Sas Institute Inc. Many task computing with distributed file system
US10642896B2 (en) 2016-02-05 2020-05-05 Sas Institute Inc. Handling of data sets during execution of task routines of multiple languages
US10650045B2 (en) * 2016-02-05 2020-05-12 Sas Institute Inc. Staged training of neural networks for improved time series prediction performance
US11157798B2 (en) * 2016-02-12 2021-10-26 Brainchip, Inc. Intelligent autonomous feature extraction system using two hardware spiking neutral networks with spike timing dependent plasticity
US11741352B2 (en) * 2016-08-22 2023-08-29 International Business Machines Corporation Area and power efficient implementation of resistive processing units using complementary metal oxide semiconductor technology
DE102016216944A1 (de) * 2016-09-07 2018-03-08 Robert Bosch Gmbh Verfahren zur Berechnung einer Neuronenschicht eines mehrschichtigen Perzeptronenmodells mit vereinfachter Aktivierungsfunktion
CN106570565A (zh) * 2016-11-21 2017-04-19 中国科学院计算机网络信息中心 一种面向大数据的深度学习方法及系统
USD898059S1 (en) 2017-02-06 2020-10-06 Sas Institute Inc. Display screen or portion thereof with graphical user interface
US11151441B2 (en) 2017-02-08 2021-10-19 Brainchip, Inc. System and method for spontaneous machine learning and feature extraction
USD898060S1 (en) 2017-06-05 2020-10-06 Sas Institute Inc. Display screen or portion thereof with graphical user interface
US11301753B2 (en) 2017-11-06 2022-04-12 Samsung Electronics Co., Ltd. Neuron circuit, system, and method with synapse weight learning
US11200484B2 (en) * 2018-09-06 2021-12-14 International Business Machines Corporation Probability propagation over factor graphs
WO2020189704A1 (ja) * 2019-03-20 2020-09-24 日本電気株式会社 ニューラルネットワーク装置、ニューラルネットワークシステム、処理方法および記録媒体
US12346796B2 (en) * 2019-10-03 2025-07-01 International Business Machines Corporation Artificial intelligence hardware with synaptic reuse
USD919656S1 (en) * 2019-10-04 2021-05-18 Butterfly Network, Inc. Display panel or portion thereof with graphical user interface
CN111368647B (zh) * 2020-02-14 2023-02-17 中北大学 一种基于dbn分布集成与冲突证据合成的遥感地物识别方法
SE544261C2 (en) 2020-06-16 2022-03-15 IntuiCell AB A computer-implemented or hardware-implemented method of entity identification, a computer program product and an apparatus for entity identification
TWI725914B (zh) 2020-08-31 2021-04-21 國立清華大學 可轉換邏輯運算之仿神經型態系統及其方法
KR102881284B1 (ko) * 2021-07-07 2025-11-05 삼성전자주식회사 뉴런 모듈 회로 장치 및 그 동작 방법
SE2250135A1 (en) * 2022-02-11 2023-08-12 IntuiCell AB A data processing system comprising first and second networks, a second network connectable to a first network, a method, and a computer program product therefor
SE547197C8 (en) * 2022-02-23 2026-03-20 IntuiCell AB A data processing system comprising a network, a method, and a computer program product
KR20240154584A (ko) * 2022-02-23 2024-10-25 인투이셀 에이비 네트워크를 포함하는 데이터 처리 시스템, 방법 및 컴퓨터 프로그램 제품

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5630024A (en) * 1994-01-19 1997-05-13 Nippon Telegraph And Telephone Corporation Method and apparatus for processing using neural network with reduced calculation amount
US20050231855A1 (en) * 2004-04-06 2005-10-20 Availableip.Com NANO-electronic memory array
US20110016071A1 (en) * 2009-07-20 2011-01-20 Guillen Marcos E Method for efficiently simulating the information processing in cells and tissues of the nervous system with a temporal series compressed encoding neural network
US20130170036A1 (en) * 2012-01-02 2013-07-04 Chung Jen Chang Lens cap

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4208485B2 (ja) * 2001-05-31 2009-01-14 キヤノン株式会社 パルス信号処理回路、並列処理回路、パターン認識装置、及び画像入力装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5630024A (en) * 1994-01-19 1997-05-13 Nippon Telegraph And Telephone Corporation Method and apparatus for processing using neural network with reduced calculation amount
US20050231855A1 (en) * 2004-04-06 2005-10-20 Availableip.Com NANO-electronic memory array
US20110016071A1 (en) * 2009-07-20 2011-01-20 Guillen Marcos E Method for efficiently simulating the information processing in cells and tissues of the nervous system with a temporal series compressed encoding neural network
US20130170036A1 (en) * 2012-01-02 2013-07-04 Chung Jen Chang Lens cap

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
EMRE NEFTCI等: "Event-driven contrastive divergence for spiking neuromorphic systems", 《FRONTIERS IN NEUROSCIENCE》 *
MORRISON等: "Phenomenological models of synaptic plasticity based on spike timing", 《BIOLOGICAL CYBERNETICS》 *
PETER O’CONNOR等: "Real-time classification and sensor fusion with a spiking deep belief network", 《FRONTIERS IN NEUROSCIENCE》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11008361B2 (en) 2017-04-18 2021-05-18 Zhejiang Palo Alto Pharmaceuticals, Inc. Liver-specific delivery-based anti-hepatitis C prodrug nucleoside cyclo-phosphate compound and uses thereof
CN108304912A (zh) * 2017-12-29 2018-07-20 北京理工大学 一种运用抑制信号实现脉冲神经网络监督学习的系统和方法
CN108304912B (zh) * 2017-12-29 2020-12-29 北京理工大学 一种运用抑制信号实现脉冲神经网络监督学习的系统和方法
CN115169547A (zh) * 2022-09-09 2022-10-11 深圳时识科技有限公司 神经形态芯片及电子设备

Also Published As

Publication number Publication date
JP2017513127A (ja) 2017-05-25
KR20160138002A (ko) 2016-12-02
US20150278680A1 (en) 2015-10-01
WO2015148190A2 (en) 2015-10-01
EP3123405A2 (en) 2017-02-01
WO2015148190A3 (en) 2015-12-10
BR112016022268A2 (pt) 2017-08-15

Similar Documents

Publication Publication Date Title
CN106164939A (zh) 尖峰发放深度置信网络(dbn)中的训练、识别、以及生成
CN105229675B (zh) 尖峰网络的高效硬件实现
CN105637541B (zh) 用于神经模拟器的共享存储器架构
CN105684002B (zh) 用于使用监督式学习对种类加标签的方法和装置
US20150120627A1 (en) Causal saliency time inference
US20150242745A1 (en) Event-based inference and learning for stochastic spiking bayesian networks
US20150269481A1 (en) Differential encoding in neural networks
US20150269485A1 (en) Cold neuron spike timing back-propagation
CN105874477A (zh) 配置稀疏神经网络
US20150212861A1 (en) Value synchronization across neural processors
US9652711B2 (en) Analog signal reconstruction and recognition via sub-threshold modulation
CN106663222A (zh) 神经网络中的分解卷积操作
CN105659262A (zh) 在尖峰神经网络中使用重放来实现突触学习
CN106030622A (zh) 原位神经网络协同处理
US9959499B2 (en) Methods and apparatus for implementation of group tags for neural models
CN106133755A (zh) 使用尖峰发放神经网络的图像的不变对象表示
CN106164940A (zh) 在尖峰神经网络中通过全局标量值来调制可塑性
US20150278685A1 (en) Probabilistic representation of large sequences using spiking neural network
US20150242746A1 (en) Dynamic spatial target selection
CN106068519A (zh) 用于共用神经元模型的高效实现的方法和装置
CN105659260B (zh) 动态地指派和检查突触延迟
CN106104586B (zh) 神经元形态模型开发的上下文实时反馈
US9342782B2 (en) Stochastic delay plasticity
US9418332B2 (en) Post ghost plasticity
US20140365413A1 (en) Efficient implementation of neural population diversity in neural system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20161123

WD01 Invention patent application deemed withdrawn after publication