BR112016022195A2 - Codificação diferencial em redes neurais - Google Patents

Codificação diferencial em redes neurais

Info

Publication number
BR112016022195A2
BR112016022195A2 BR112016022195A BR112016022195A BR112016022195A2 BR 112016022195 A2 BR112016022195 A2 BR 112016022195A2 BR 112016022195 A BR112016022195 A BR 112016022195A BR 112016022195 A BR112016022195 A BR 112016022195A BR 112016022195 A2 BR112016022195 A2 BR 112016022195A2
Authority
BR
Brazil
Prior art keywords
differential coding
neural networks
coding
neuron
activation value
Prior art date
Application number
BR112016022195A
Other languages
English (en)
Portuguese (pt)
Inventor
Sreekanta Reddy Annapureddy Venkata
Jonathan Julian David
Blythe Towal Regan
Liu Yinyin
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of BR112016022195A2 publication Critical patent/BR112016022195A2/pt

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • G06N3/0455Auto-encoder networks; Encoder-decoder networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/049Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/048Activation functions
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0495Quantised networks; Sparse networks; Compressed networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/082Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/098Distributed learning, e.g. federated learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Image Analysis (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
BR112016022195A 2014-03-24 2015-03-17 Codificação diferencial em redes neurais BR112016022195A2 (pt)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201461969747P 2014-03-24 2014-03-24
US14/513,155 US20150269481A1 (en) 2014-03-24 2014-10-13 Differential encoding in neural networks
PCT/US2015/021077 WO2015148189A2 (en) 2014-03-24 2015-03-17 Differential encoding in neural networks

Publications (1)

Publication Number Publication Date
BR112016022195A2 true BR112016022195A2 (pt) 2017-08-15

Family

ID=54142454

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112016022195A BR112016022195A2 (pt) 2014-03-24 2015-03-17 Codificação diferencial em redes neurais

Country Status (7)

Country Link
US (1) US20150269481A1 (enExample)
EP (1) EP3123404A2 (enExample)
JP (1) JP2017516192A (enExample)
KR (1) KR20160136381A (enExample)
CN (1) CN107077637B (enExample)
BR (1) BR112016022195A2 (enExample)
WO (1) WO2015148189A2 (enExample)

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150379397A1 (en) 2014-06-28 2015-12-31 Brainchip, Inc. Secure voice signature communications system
US10262259B2 (en) * 2015-05-08 2019-04-16 Qualcomm Incorporated Bit width selection for fixed point neural networks
US11126913B2 (en) * 2015-07-23 2021-09-21 Applied Brain Research Inc Methods and systems for implementing deep spiking neural networks
WO2017068490A1 (en) * 2015-10-23 2017-04-27 Semiconductor Energy Laboratory Co., Ltd. Semiconductor device and electronic device
WO2017132288A1 (en) * 2016-01-25 2017-08-03 Google Inc. Generating images using neural networks
US10528863B2 (en) 2016-04-01 2020-01-07 Numenta, Inc. Feedback mechanisms in sequence learning systems with temporal processing capability
KR102399548B1 (ko) * 2016-07-13 2022-05-19 삼성전자주식회사 뉴럴 네트워크를 위한 방법 및 그 방법을 수행하는 장치
US10949737B2 (en) 2016-07-13 2021-03-16 Samsung Electronics Co., Ltd. Method for neural network and apparatus performing same method
US11238337B2 (en) * 2016-08-22 2022-02-01 Applied Brain Research Inc. Methods and systems for implementing dynamic neural networks
US20180121791A1 (en) * 2016-11-03 2018-05-03 Qualcomm Incorporated Temporal difference estimation in an artificial neural network
CN113537481B (zh) * 2016-12-30 2024-04-02 上海寒武纪信息科技有限公司 用于执行lstm神经网络运算的装置和运算方法
US20190347541A1 (en) * 2016-12-30 2019-11-14 Nokia Technologies Oy Apparatus, method and computer program product for deep learning
CN108345939B (zh) * 2017-01-25 2022-05-24 微软技术许可有限责任公司 基于定点运算的神经网络
US10311339B2 (en) * 2017-02-14 2019-06-04 Google Llc Unsupervised learning techniques for temporal difference models
JP7019138B2 (ja) * 2017-02-28 2022-02-15 国立大学法人電気通信大学 符号化装置、符号化方法およびプログラム
JP6898778B2 (ja) * 2017-06-02 2021-07-07 株式会社日立製作所 機械学習システム及び機械学習方法
KR102410820B1 (ko) * 2017-08-14 2022-06-20 삼성전자주식회사 뉴럴 네트워크를 이용한 인식 방법 및 장치 및 상기 뉴럴 네트워크를 트레이닝하는 방법 및 장치
WO2019040672A1 (en) * 2017-08-22 2019-02-28 Syntiant SYSTEMS AND METHODS FOR DETERMINING EFFECTS AT A CIRCUIT LEVEL ON THE PRECISION OF A CLASSIFIER
US20190102669A1 (en) * 2017-09-29 2019-04-04 Intel Corporation Global and local time-step determination schemes for neural networks
US11651199B2 (en) * 2017-10-09 2023-05-16 Intel Corporation Method, apparatus and system to perform action recognition with a spiking neural network
CN109961133B (zh) * 2017-12-14 2020-04-24 中科寒武纪科技股份有限公司 集成电路芯片装置及相关产品
CN111164615A (zh) * 2017-12-15 2020-05-15 英特尔公司 在尖峰神经网络中使用尖峰波进行基于上下文的搜索
CN111149115A (zh) 2017-12-19 2020-05-12 英特尔公司 用于利用脉冲神经网络的相位差来改变突触权重的设备、系统和方法
US20190034716A1 (en) 2017-12-28 2019-01-31 Intel Corporation Privacy-preserving demographics identification
US11481583B2 (en) * 2017-12-28 2022-10-25 Intel Corporation Algorithm management blockchain
US10825201B2 (en) * 2018-02-20 2020-11-03 Lyft, Inc. Deep direct localization from ground imagery and location readings
KR102091498B1 (ko) * 2018-06-11 2020-03-24 고려대학교 산학협력단 비지도 학습장치 및 그 학습방법
US11030518B2 (en) * 2018-06-13 2021-06-08 United States Of America As Represented By The Secretary Of The Navy Asynchronous artificial neural network architecture
US11200484B2 (en) * 2018-09-06 2021-12-14 International Business Machines Corporation Probability propagation over factor graphs
JP7021052B2 (ja) * 2018-11-06 2022-02-16 株式会社東芝 製品状態推定装置
US11568248B2 (en) * 2020-03-31 2023-01-31 Ati Technologies Ulc Feature reordering based on similarity for improved memory compression transfers during machine learning jobs
EP3917087B1 (en) * 2020-05-26 2023-04-19 Nxp B.V. Controller and transceiver
SE544261C2 (en) 2020-06-16 2022-03-15 IntuiCell AB A computer-implemented or hardware-implemented method of entity identification, a computer program product and an apparatus for entity identification
US12165046B2 (en) * 2021-03-16 2024-12-10 International Business Machines Corporation Enabling hierarchical data loading in a resistive processing unit (RPU) array for reduced communication cost
CN113762487B (zh) * 2021-08-17 2023-11-10 西北大学 基于神经架构搜索及dbn网络的脑功能网络生成方法及系统
CN119053919A (zh) * 2022-03-02 2024-11-29 因图伊塞尔公司 提供表示第一系统的时间动态的方法、中间件系统、控制器系统、计算机程序产品和非临时性计算机可读存储介质
US20240118923A1 (en) * 2022-09-28 2024-04-11 Qualcomm Incorporated Robust scheduling with generative flow networks
KR102593930B1 (ko) 2023-04-18 2023-10-25 주식회사 한국스크랩 친환경 폐 알루미늄 박리 자동화 시스템

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IT1272417B (it) * 1993-04-29 1997-06-23 Alcatel Italia Metodo per la codifica e decodifica differenziale e relativi circuiti
US6185548B1 (en) * 1998-06-19 2001-02-06 Albert Einstein College Of Medicine Of Yeshiva University Neural network methods to predict enzyme inhibitor or receptor ligand potency
US20010025232A1 (en) * 1998-10-02 2001-09-27 Klimasauskas Casimir C. Hybrid linear-neural network process control
US7430546B1 (en) * 2003-06-07 2008-09-30 Roland Erwin Suri Applications of an algorithm that mimics cortical processing
CN1622129A (zh) * 2004-12-13 2005-06-01 中国科学院长春光学精密机械与物理研究所 人工神经网络的优化方法
KR101326914B1 (ko) * 2005-11-15 2013-11-11 베르나데트 가너 신경망 훈련 방법
JP4840494B2 (ja) * 2009-09-16 2011-12-21 沖電気工業株式会社 時系列データ予測ニューラルネットワーク装置
CN101824807A (zh) * 2010-04-16 2010-09-08 同济大学 一种潮汐河流地区取水口咸潮短期预测方法
CN104346801B (zh) * 2013-08-02 2018-07-20 佳能株式会社 图像构图评估装置、信息处理装置及其方法
CN103559538A (zh) * 2013-11-12 2014-02-05 上海电机学院 Bp神经网络结构优化方法

Also Published As

Publication number Publication date
CN107077637B (zh) 2021-07-20
US20150269481A1 (en) 2015-09-24
JP2017516192A (ja) 2017-06-15
WO2015148189A2 (en) 2015-10-01
EP3123404A2 (en) 2017-02-01
CN107077637A (zh) 2017-08-18
WO2015148189A3 (en) 2015-12-17
KR20160136381A (ko) 2016-11-29

Similar Documents

Publication Publication Date Title
BR112016022195A2 (pt) Codificação diferencial em redes neurais
BR112017020260A2 (pt) definição de seleção e conexão de programação entre dispositivos participantes em um enlace de dados de nan
IL273370A (en) Photonic neural network system
SG11202007532TA (en) Neural network accelerator
SG11202003940UA (en) Light distribution structure and element, related method and uses
EP3710990A4 (en) METALERS FOR MULTITASK LEARNING FOR NEURAL NETWORKS
DK3373210T3 (da) Neuralt netværksmatricetransponering i hardware
EP3867885A4 (en) NEURAL VENDING MACHINE
GB201611380D0 (en) Artificial neural network with side input for language modelling and prediction
PL3542316T3 (pl) Oparte na uwadze sieci neuronowe z transdukcją sekwencji
GB201611857D0 (en) An artificial neural network
GB201802414D0 (en) Implementing neural networks in fixed point arithmetric computing systems
EP3472968A4 (en) DISTRIBUTED, CENTRALLY CREATED BLOCKCHAIN NETWORK
EP3529747A4 (en) NEURAL NETWORKS FOR FACIAL MODELING
EP3574442A4 (en) MULTIPLE SINGLE SECURITY LEVELS (MSLS) IN A MULTI-TENANT CLOUD
MA41460A (fr) Agents de liaison à la tnfrsf et leurs utilisations
GB2553451A (en) Implementing a neural network algorithm on a neurosynaptic substrate based on metadata associated with the neural network algorithm
EP3192312A4 (en) Ran rule and condition match reporting for lte-wlan interworking control and management
DK3860003T3 (da) Åbent, modulopbygget og skalærbart optisk linjesystem
EP3089081A4 (en) Hierarchical neural network device, learning method for determination device, and determination method
EP3163843A4 (en) Method and device for providing network service, evaluating policy rule and selecting service assembly
GB2552189B (en) Restored fairness in an 802.11 network implementing resource units
BR112017009554B8 (pt) Dispositivo de inspeção para utilização em um contentor de fluido
BR112017024449A2 (pt) definição de banda estreita para comunicação fortalecida do tipo máquina
BR112018000007A2 (pt) sistema e método para gerenciamento de calibragem de ferramentas

Legal Events

Date Code Title Description
B08F Application dismissed because of non-payment of annual fees [chapter 8.6 patent gazette]

Free format text: REFERENTE A 5A ANUIDADE.

B08K Patent lapsed as no evidence of payment of the annual fee has been furnished to inpi [chapter 8.11 patent gazette]

Free format text: REFERENTE AO DESPACHO 8.6 PUBLICADO NA RPI 2558 DE 14/01/2020.

B350 Update of information on the portal [chapter 15.35 patent gazette]