JP2017509951A5 - - Google Patents
Download PDFInfo
- Publication number
- JP2017509951A5 JP2017509951A5 JP2016547855A JP2016547855A JP2017509951A5 JP 2017509951 A5 JP2017509951 A5 JP 2017509951A5 JP 2016547855 A JP2016547855 A JP 2016547855A JP 2016547855 A JP2016547855 A JP 2016547855A JP 2017509951 A5 JP2017509951 A5 JP 2017509951A5
- Authority
- JP
- Japan
- Prior art keywords
- neuron
- neurons
- zero
- model
- updated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 210000002569 neuron Anatomy 0.000 claims 65
- 239000013598 vector Substances 0.000 claims 28
- 238000013528 artificial neural network Methods 0.000 claims 12
- 238000000034 method Methods 0.000 claims 7
- 210000000225 synapse Anatomy 0.000 claims 7
- 238000005457 optimization Methods 0.000 claims 4
Applications Claiming Priority (9)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201461930849P | 2014-01-23 | 2014-01-23 | |
| US201461930858P | 2014-01-23 | 2014-01-23 | |
| US61/930,849 | 2014-01-23 | ||
| US61/930,858 | 2014-01-23 | ||
| US201461939537P | 2014-02-13 | 2014-02-13 | |
| US61/939,537 | 2014-02-13 | ||
| US14/449,101 | 2014-07-31 | ||
| US14/449,101 US10339447B2 (en) | 2014-01-23 | 2014-07-31 | Configuring sparse neuronal networks |
| PCT/US2014/068449 WO2015112262A1 (en) | 2014-01-23 | 2014-12-03 | Configuring sparse neuronal networks |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2017509951A JP2017509951A (ja) | 2017-04-06 |
| JP2017509951A5 true JP2017509951A5 (OSRAM) | 2017-12-21 |
Family
ID=53545086
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2016547855A Pending JP2017509951A (ja) | 2014-01-23 | 2014-12-03 | スパースニューラルネットワークを構成すること |
| JP2016547861A Pending JP2017509953A (ja) | 2014-01-23 | 2014-12-03 | 低スパイキングレートのためのニューラルネットワークを構成すること |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2016547861A Pending JP2017509953A (ja) | 2014-01-23 | 2014-12-03 | 低スパイキングレートのためのニューラルネットワークを構成すること |
Country Status (6)
| Country | Link |
|---|---|
| US (2) | US20150206050A1 (OSRAM) |
| EP (2) | EP3097516A1 (OSRAM) |
| JP (2) | JP2017509951A (OSRAM) |
| CN (2) | CN105900115A (OSRAM) |
| TW (2) | TW201531966A (OSRAM) |
| WO (2) | WO2015112262A1 (OSRAM) |
Families Citing this family (47)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11100397B2 (en) * | 2015-05-21 | 2021-08-24 | Rochester Institute Of Technology | Method and apparatus for training memristive learning systems |
| CN107578099B (zh) * | 2016-01-20 | 2021-06-11 | 中科寒武纪科技股份有限公司 | 计算装置和方法 |
| JP6453785B2 (ja) * | 2016-01-21 | 2019-01-16 | 日本電信電話株式会社 | 回帰分析装置、回帰分析方法および回帰分析プログラム |
| WO2017136665A1 (en) * | 2016-02-05 | 2017-08-10 | Google Inc. | Augmenting neural networks with sparsely-accessed external memory |
| US10643125B2 (en) | 2016-03-03 | 2020-05-05 | International Business Machines Corporation | Methods and systems of neuron leaky integrate and fire circuits |
| US11222263B2 (en) | 2016-07-28 | 2022-01-11 | Samsung Electronics Co., Ltd. | Neural network method and apparatus |
| CN107239825B (zh) * | 2016-08-22 | 2021-04-09 | 赛灵思电子科技(北京)有限公司 | 考虑负载均衡的深度神经网络压缩方法 |
| US11210589B2 (en) | 2016-09-28 | 2021-12-28 | D5Ai Llc | Learning coach for machine learning system |
| CN107886167B (zh) * | 2016-09-29 | 2019-11-08 | 北京中科寒武纪科技有限公司 | 神经网络运算装置及方法 |
| US20180164866A1 (en) * | 2016-12-13 | 2018-06-14 | Qualcomm Incorporated | Low-power architecture for sparse neural network |
| US10679118B2 (en) * | 2016-12-20 | 2020-06-09 | Intel Corporation | Solving matrix inverse problems using neuromorphic computing |
| US10871964B2 (en) * | 2016-12-29 | 2020-12-22 | Qualcomm Incorporated | Architecture for sparse neural network acceleration |
| WO2018133570A1 (zh) * | 2017-01-20 | 2018-07-26 | 清华大学 | 自适应阈值神经元信息处理方法、自适应泄漏值神经元信息处理方法、系统、计算机设备及可读存储介质 |
| KR102390379B1 (ko) * | 2017-03-06 | 2022-04-26 | 삼성전자주식회사 | 뉴럴 네트워크 프로세서, 뉴럴 네트워크 프로세서의 동작 방법, 및 뉴럴 네트워크 장치 |
| EP3602316A4 (en) | 2017-03-24 | 2020-12-30 | D5A1 Llc | LEARNING COACH FOR AUTOMATIC LEARNING SYSTEM |
| WO2018184194A1 (en) * | 2017-04-07 | 2018-10-11 | Intel Corporation | Methods and systems using improved convolutional neural networks for image processing |
| US10795836B2 (en) * | 2017-04-17 | 2020-10-06 | Microsoft Technology Licensing, Llc | Data processing performance enhancement for neural networks using a virtualized data iterator |
| CN108734279B (zh) * | 2017-04-20 | 2021-04-23 | 上海寒武纪信息科技有限公司 | 一种运算装置和方法 |
| EP3699826A1 (en) | 2017-04-20 | 2020-08-26 | Shanghai Cambricon Information Technology Co., Ltd | Operation device and related products |
| CN109146069B (zh) * | 2017-06-16 | 2020-10-13 | 上海寒武纪信息科技有限公司 | 运算装置、运算方法和芯片 |
| US20200143240A1 (en) * | 2017-06-12 | 2020-05-07 | D5Ai Llc | Robust anti-adversarial machine learning |
| KR102601604B1 (ko) | 2017-08-04 | 2023-11-13 | 삼성전자주식회사 | 뉴럴 네트워크의 파라미터들을 양자화하는 방법 및 장치 |
| CN107609641B (zh) * | 2017-08-30 | 2020-07-03 | 清华大学 | 稀疏神经网络架构及其实现方法 |
| TWI653584B (zh) | 2017-09-15 | 2019-03-11 | 中原大學 | 利用非揮發性記憶體完成類神經網路訓練的方法 |
| US10366322B2 (en) | 2017-10-06 | 2019-07-30 | DeepCube LTD. | System and method for compact and efficient sparse neural networks |
| US11580194B2 (en) | 2017-11-01 | 2023-02-14 | Nec Corporation | Information processing apparatus, information processing method, and program |
| CN109902817B (zh) * | 2017-12-11 | 2021-02-09 | 安徽寒武纪信息科技有限公司 | 板卡和神经网络运算方法 |
| US10846621B2 (en) * | 2017-12-12 | 2020-11-24 | Amazon Technologies, Inc. | Fast context switching for computational networks |
| US10803379B2 (en) | 2017-12-12 | 2020-10-13 | Amazon Technologies, Inc. | Multi-memory on-chip computational network |
| CN108268938B (zh) * | 2018-01-24 | 2020-04-21 | 清华大学 | 神经网络及其信息处理方法、信息处理系统 |
| US11321612B2 (en) | 2018-01-30 | 2022-05-03 | D5Ai Llc | Self-organizing partially ordered networks and soft-tying learned parameters, such as connection weights |
| CN110197272B (zh) * | 2018-02-27 | 2020-08-25 | 上海寒武纪信息科技有限公司 | 集成电路芯片装置及相关产品 |
| EP3576019B1 (en) * | 2018-05-29 | 2024-10-09 | Nokia Technologies Oy | Artificial neural networks |
| KR102675781B1 (ko) * | 2018-06-27 | 2024-06-18 | 삼성전자주식회사 | 뉴로모픽 프로세서 및 그것의 동작 방법 |
| US20200019837A1 (en) * | 2018-07-11 | 2020-01-16 | The Board Of Trustees Of The Leland Stanford Junior University | Methods and apparatus for spiking neural network computing based on a multi-layer kernel architecture |
| CA3051429A1 (en) * | 2018-08-08 | 2020-02-08 | Applied Brain Research Inc. | Digital circuits for evaluating neural engineering framework style neural networks |
| US11537855B2 (en) * | 2018-09-24 | 2022-12-27 | International Business Machines Corporation | Low spike count ring buffer mechanism on neuromorphic hardware |
| US11922314B1 (en) | 2018-11-30 | 2024-03-05 | Ansys, Inc. | Systems and methods for building dynamic reduced order physical models |
| US11556778B2 (en) * | 2018-12-07 | 2023-01-17 | Microsoft Technology Licensing, Llc | Automated generation of machine learning models |
| CN110619905A (zh) * | 2019-08-09 | 2019-12-27 | 上海集成电路研发中心有限公司 | 一种基于rram忆阻器单元的集合模块及其形成方法 |
| KR20210023401A (ko) * | 2019-08-23 | 2021-03-04 | 삼성전자주식회사 | 뉴럴 네트워크 연산 방법 및 이를 포함하는 시스템 |
| CN110708341B (zh) * | 2019-11-15 | 2020-09-29 | 中国科学院信息工程研究所 | 一种基于远程桌面加密网络流量模式差异的用户行为检测方法及系统 |
| US11556384B2 (en) | 2020-03-13 | 2023-01-17 | Cisco Technology, Inc. | Dynamic allocation and re-allocation of learning model computing resources |
| CN115335831A (zh) * | 2020-06-05 | 2022-11-11 | 渊慧科技有限公司 | 用于训练稀疏神经网络同时保持稀疏性的系统和方法 |
| DE102020209538A1 (de) * | 2020-07-29 | 2022-02-03 | Robert Bosch Gesellschaft mit beschränkter Haftung | Vorrichtung und Verfahren zum Ermitteln einer physikalischen Eigenschaft eines physikalischen Objekts |
| CN114511062A (zh) * | 2021-11-22 | 2022-05-17 | 北京中科凡语科技有限公司 | 可解释神经解码模型的生成方法、电子设备和存储介质 |
| CN116842993B (zh) * | 2023-06-15 | 2025-07-25 | 北京工业大学 | 一种基于多属性二型模糊神经网络的总氮去除量检测方法 |
Family Cites Families (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030105409A1 (en) | 2001-11-14 | 2003-06-05 | Donoghue John Philip | Neurological signal decoding |
| MY138544A (en) | 2003-06-26 | 2009-06-30 | Neuramatix Sdn Bhd | Neural networks with learning and expression capability |
| JP4848492B2 (ja) | 2006-08-03 | 2011-12-28 | パナソニック電工Sunx株式会社 | 信号識別方法及び信号識別装置 |
| US8095210B2 (en) | 2007-01-19 | 2012-01-10 | California Institute Of Technology | Prosthetic devices and methods and systems related thereto |
| CN101971166B (zh) | 2008-03-14 | 2013-06-19 | 惠普开发有限公司 | 神经形态电路 |
| US8630966B2 (en) | 2009-01-27 | 2014-01-14 | Salk Institute For Biological Studies | Temporally dynamic artificial neural networks |
| US8615476B2 (en) | 2009-04-15 | 2013-12-24 | University Of Southern California | Protecting military perimeters from approaching human and vehicle using biologically realistic neural network |
| US8250010B2 (en) | 2009-05-21 | 2012-08-21 | International Business Machines Corporation | Electronic learning synapse with spike-timing dependent plasticity using unipolar memory-switching elements |
| US10223632B2 (en) | 2009-07-27 | 2019-03-05 | International Business Machines Corporation | Modeling states of an entity |
| US20120117012A1 (en) | 2010-04-08 | 2012-05-10 | Neurosciences Research Foundation, Inc. | Spike-timing computer modeling of working memory |
| US20120023051A1 (en) * | 2010-07-22 | 2012-01-26 | Ramin Pishehvar | Signal coding with adaptive neural network |
| US8606732B2 (en) | 2010-08-04 | 2013-12-10 | Qualcomm Incorporated | Methods and systems for reward-modulated spike-timing-dependent-plasticity |
| US8577820B2 (en) | 2011-03-04 | 2013-11-05 | Tokyo Electron Limited | Accurate and fast neural network training for library-based critical dimension (CD) metrology |
| US8521670B2 (en) | 2011-05-25 | 2013-08-27 | HGST Netherlands B.V. | Artificial neural network application for magnetic core width prediction and modeling for magnetic disk drive manufacture |
| WO2013023068A1 (en) | 2011-08-11 | 2013-02-14 | Greenray Industries, Inc. | Neural network frequency control |
| KR101912165B1 (ko) | 2011-12-09 | 2018-10-29 | 삼성전자주식회사 | 스파이킹 뉴런 기반 작업 기억 장치 |
| US9111225B2 (en) | 2012-02-08 | 2015-08-18 | Qualcomm Incorporated | Methods and apparatus for spiking neural computation |
| US9208431B2 (en) | 2012-05-10 | 2015-12-08 | Qualcomm Incorporated | Method and apparatus for strategic synaptic failure and learning in spiking neural networks |
| US20130325767A1 (en) | 2012-05-30 | 2013-12-05 | Qualcomm Incorporated | Dynamical event neuron and synapse models for learning spiking neural networks |
| US9367798B2 (en) | 2012-09-20 | 2016-06-14 | Brain Corporation | Spiking neuron network adaptive control apparatus and methods |
| US9367519B2 (en) * | 2013-08-30 | 2016-06-14 | Microsoft Technology Licensing, Llc | Sparse matrix data structure |
-
2014
- 2014-07-31 US US14/449,092 patent/US20150206050A1/en not_active Abandoned
- 2014-07-31 US US14/449,101 patent/US10339447B2/en active Active
- 2014-12-03 CN CN201480071680.4A patent/CN105900115A/zh active Pending
- 2014-12-03 CN CN201480071677.2A patent/CN105874477A/zh active Pending
- 2014-12-03 EP EP14819207.3A patent/EP3097516A1/en not_active Withdrawn
- 2014-12-03 WO PCT/US2014/068449 patent/WO2015112262A1/en not_active Ceased
- 2014-12-03 JP JP2016547855A patent/JP2017509951A/ja active Pending
- 2014-12-03 EP EP14824192.0A patent/EP3097519A1/en not_active Withdrawn
- 2014-12-03 WO PCT/US2014/068417 patent/WO2015112261A1/en not_active Ceased
- 2014-12-03 JP JP2016547861A patent/JP2017509953A/ja active Pending
- 2014-12-08 TW TW103142629A patent/TW201531966A/zh unknown
- 2014-12-08 TW TW103142628A patent/TW201531965A/zh unknown
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2017509951A5 (OSRAM) | ||
| US11521043B2 (en) | Information processing apparatus for embedding watermark information, method, and computer readable storage medium | |
| JP2017509953A5 (OSRAM) | ||
| JP2018506785A5 (OSRAM) | ||
| JP2018526733A5 (OSRAM) | ||
| CN106471526B (zh) | 用于处理图像的方法和系统 | |
| EP4651028A3 (en) | Methods and apparatuses for performing artificial intelligence encoding and artificial intelligence decoding on image | |
| CN105224984B (zh) | 一种基于深度神经网络的数据类别识别方法及装置 | |
| JP2021507323A5 (OSRAM) | ||
| JP2020512639A5 (OSRAM) | ||
| WO2019091020A1 (zh) | 权重数据存储方法和基于该方法的神经网络处理器 | |
| JP2014099913A5 (OSRAM) | ||
| JP2017513127A5 (OSRAM) | ||
| JP2017525038A5 (OSRAM) | ||
| EP4235509A3 (en) | Neural network instruction set architecture | |
| JP2017509978A5 (OSRAM) | ||
| WO2016182608A3 (en) | Systems, devices, articles, and methods for quantum processor architecture | |
| JP2017514215A5 (OSRAM) | ||
| JP2018529159A5 (OSRAM) | ||
| Díaz-Cortés et al. | A new metaheuristic optimization methodology based on fuzzy logic | |
| CN107122843A (zh) | 一种基于改进遗传算法的旅行商问题求解方法 | |
| JP2016226019A5 (OSRAM) | ||
| JP2020027399A5 (OSRAM) | ||
| JP2020057286A5 (OSRAM) | ||
| JP2017509956A5 (OSRAM) |