TWI822792B - 將人工神經網路中之活動特徵化之方法及包含一或多個可執行該方法之計算機之系統 - Google Patents
將人工神經網路中之活動特徵化之方法及包含一或多個可執行該方法之計算機之系統 Download PDFInfo
- Publication number
- TWI822792B TWI822792B TW108119813A TW108119813A TWI822792B TW I822792 B TWI822792 B TW I822792B TW 108119813 A TW108119813 A TW 108119813A TW 108119813 A TW108119813 A TW 108119813A TW I822792 B TWI822792 B TW I822792B
- Authority
- TW
- Taiwan
- Prior art keywords
- neural network
- activity
- artificial neural
- patterns
- input
- Prior art date
Links
- 230000000694 effects Effects 0.000 title claims abstract description 375
- 238000000034 method Methods 0.000 title claims abstract description 142
- 238000013528 artificial neural network Methods 0.000 claims abstract description 546
- 230000000306 recurrent effect Effects 0.000 claims abstract description 171
- 238000012545 processing Methods 0.000 claims abstract description 80
- 230000004044 response Effects 0.000 claims description 39
- 230000007781 signaling event Effects 0.000 claims description 33
- 238000012512 characterization method Methods 0.000 claims description 24
- 230000010365 information processing Effects 0.000 claims description 23
- 230000008054 signal transmission Effects 0.000 claims description 19
- 230000008859 change Effects 0.000 claims description 4
- 230000011664 signaling Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 abstract description 13
- 230000008569 process Effects 0.000 description 71
- 238000012549 training Methods 0.000 description 56
- 238000010586 diagram Methods 0.000 description 39
- 238000004891 communication Methods 0.000 description 29
- 230000002787 reinforcement Effects 0.000 description 28
- 239000013598 vector Substances 0.000 description 27
- 230000000875 corresponding effect Effects 0.000 description 21
- 230000009471 action Effects 0.000 description 15
- 210000004027 cell Anatomy 0.000 description 14
- 239000000178 monomer Substances 0.000 description 13
- 210000002569 neuron Anatomy 0.000 description 13
- 230000005540 biological transmission Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 11
- 238000001514 detection method Methods 0.000 description 10
- 238000005259 measurement Methods 0.000 description 10
- 238000002347 injection Methods 0.000 description 9
- 239000007924 injection Substances 0.000 description 9
- 239000000126 substance Substances 0.000 description 8
- 238000013500 data storage Methods 0.000 description 7
- 238000012634 optical imaging Methods 0.000 description 7
- 230000000877 morphologic effect Effects 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 5
- 230000001537 neural effect Effects 0.000 description 5
- 238000011176 pooling Methods 0.000 description 5
- 230000011218 segmentation Effects 0.000 description 5
- 238000013527 convolutional neural network Methods 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000002829 reductive effect Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000004913 activation Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 230000002457 bidirectional effect Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000000644 propagated effect Effects 0.000 description 3
- 238000013529 biological neural network Methods 0.000 description 2
- 239000000872 buffer Substances 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013515 script Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 210000005056 cell body Anatomy 0.000 description 1
- 238000004581 coalescence Methods 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000002964 excitative effect Effects 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000002401 inhibitory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000005923 long-lasting effect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 210000001331 nose Anatomy 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 210000001082 somatic cell Anatomy 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/004—Artificial life, i.e. computing arrangements simulating life
- G06N3/006—Artificial life, i.e. computing arrangements simulating life based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/004—Artificial life, i.e. computing arrangements simulating life
- G06N3/008—Artificial life, i.e. computing arrangements simulating life based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/01—Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- Evolutionary Computation (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Robotics (AREA)
- Image Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Multi Processors (AREA)
- Mobile Radio Communication Systems (AREA)
Applications Claiming Priority (10)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/004,757 US11893471B2 (en) | 2018-06-11 | 2018-06-11 | Encoding and decoding information and artificial neural networks |
| US16/004,671 | 2018-06-11 | ||
| US16/004,796 US20190378000A1 (en) | 2018-06-11 | 2018-06-11 | Characterizing activity in a recurrent artificial neural network |
| US16/004,796 | 2018-06-11 | ||
| US16/004,837 US11663478B2 (en) | 2018-06-11 | 2018-06-11 | Characterizing activity in a recurrent artificial neural network |
| US16/004,671 US11972343B2 (en) | 2018-06-11 | 2018-06-11 | Encoding and decoding information |
| US16/004,757 | 2018-06-11 | ||
| US16/004,635 US20190378007A1 (en) | 2018-06-11 | 2018-06-11 | Characterizing activity in a recurrent artificial neural network |
| US16/004,635 | 2018-06-11 | ||
| US16/004,837 | 2018-06-11 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW202001693A TW202001693A (zh) | 2020-01-01 |
| TWI822792B true TWI822792B (zh) | 2023-11-21 |
Family
ID=66776339
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW108119813A TWI822792B (zh) | 2018-06-11 | 2019-06-06 | 將人工神經網路中之活動特徵化之方法及包含一或多個可執行該方法之計算機之系統 |
Country Status (5)
| Country | Link |
|---|---|
| EP (5) | EP3803699A1 (fr) |
| KR (5) | KR102497238B1 (fr) |
| CN (5) | CN112567387A (fr) |
| TW (1) | TWI822792B (fr) |
| WO (5) | WO2019238483A1 (fr) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11615285B2 (en) | 2017-01-06 | 2023-03-28 | Ecole Polytechnique Federale De Lausanne (Epfl) | Generating and identifying functional subnetworks within structural networks |
| US11893471B2 (en) | 2018-06-11 | 2024-02-06 | Inait Sa | Encoding and decoding information and artificial neural networks |
| US11663478B2 (en) | 2018-06-11 | 2023-05-30 | Inait Sa | Characterizing activity in a recurrent artificial neural network |
| US11972343B2 (en) | 2018-06-11 | 2024-04-30 | Inait Sa | Encoding and decoding information |
| US11569978B2 (en) | 2019-03-18 | 2023-01-31 | Inait Sa | Encrypting and decrypting information |
| US11652603B2 (en) | 2019-03-18 | 2023-05-16 | Inait Sa | Homomorphic encryption |
| US11610134B2 (en) * | 2019-07-08 | 2023-03-21 | Vianai Systems, Inc. | Techniques for defining and executing program code specifying neural network architectures |
| US11580401B2 (en) | 2019-12-11 | 2023-02-14 | Inait Sa | Distance metrics and clustering in recurrent neural networks |
| US11816553B2 (en) | 2019-12-11 | 2023-11-14 | Inait Sa | Output from a recurrent neural network |
| US11651210B2 (en) | 2019-12-11 | 2023-05-16 | Inait Sa | Interpreting and improving the processing results of recurrent neural networks |
| US11797827B2 (en) | 2019-12-11 | 2023-10-24 | Inait Sa | Input into a neural network |
| TWI769466B (zh) * | 2020-06-17 | 2022-07-01 | 台達電子工業股份有限公司 | 類神經網路系統及其操作方法 |
| CN112073217B (zh) * | 2020-08-07 | 2023-03-24 | 之江实验室 | 一种多网络结构差异向量化方法及装置 |
| CN113219358A (zh) * | 2021-04-29 | 2021-08-06 | 东软睿驰汽车技术（沈阳）有限公司 | 电池包健康状态计算方法、系统及电子设备 |
| TWI769875B (zh) * | 2021-06-24 | 2022-07-01 | 國立中央大學 | 深度學習網路裝置、其使用的記憶體存取方法與非揮發性儲存媒介 |
| CN113626721B (zh) * | 2021-10-12 | 2022-01-25 | 中国科学院自动化研究所 | 基于遗憾探索的推荐方法、装置、电子设备与存储介质 |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7958071B2 (en) * | 2007-04-19 | 2011-06-07 | Hewlett-Packard Development Company, L.P. | Computational nodes and computational-node networks that include dynamical-nanodevice connections |
| JP5844286B2 (ja) * | 2010-02-05 | 2016-01-13 | エコール・ポリテクニーク・フェデラル・ドゥ・ローザンヌ （ウ・ペ・エフ・エル）Ｅｃｏｌｅ Ｐｏｌｙｔｅｃｈｎｉｑｕｅ Ｆｅｄｅｒａｌｅｄｅ Ｌａｕｓａｎｎｅ （Ｅｐｆｌ） | ニューラルネットワークの組織化 |
| US8170971B1 (en) * | 2011-09-28 | 2012-05-01 | Ava, Inc. | Systems and methods for providing recommendations based on collaborative and/or content-based nodal interrelationships |
| US20180053114A1 (en) * | 2014-10-23 | 2018-02-22 | Brighterion, Inc. | Artificial intelligence for context classifier |
| CN106156845A (zh) * | 2015-03-23 | 2016-11-23 | 日本电气株式会社 | 一种用于构建神经网络的方法和设备 |
| CN105095966B (zh) * | 2015-07-16 | 2018-08-21 | 北京灵汐科技有限公司 | 人工神经网络和脉冲神经网络的混合计算系统 |
| US20180005111A1 (en) * | 2016-06-30 | 2018-01-04 | International Business Machines Corporation | Generalized Sigmoids and Activation Function Learning |
| US11544539B2 (en) * | 2016-09-29 | 2023-01-03 | Tsinghua University | Hardware neural network conversion method, computing device, compiling method and neural network software and hardware collaboration system |
| US10748060B2 (en) * | 2016-10-14 | 2020-08-18 | Intel Corporation | Pre-synaptic learning using delayed causal updates |
| CN107247989B (zh) * | 2017-06-15 | 2020-11-24 | 北京图森智途科技有限公司 | 一种实时的计算机视觉处理方法及装置 |
| CN107423814A (zh) * | 2017-07-31 | 2017-12-01 | 南昌航空大学 | 一种采用深度卷积神经网络建立动态网络模型的方法 |
-
2019
- 2019-06-05 KR KR1020207035843A patent/KR102497238B1/ko active IP Right Grant
- 2019-06-05 CN CN201980053465.4A patent/CN112567387A/zh active Pending
- 2019-06-05 EP EP19728962.2A patent/EP3803699A1/fr active Pending
- 2019-06-05 WO PCT/EP2019/064593 patent/WO2019238483A1/fr unknown
- 2019-06-06 TW TW108119813A patent/TWI822792B/zh active
- 2019-06-06 KR KR1020207035847A patent/KR102526132B1/ko active IP Right Grant
- 2019-06-06 CN CN201980053141.0A patent/CN112567389A/zh active Pending
- 2019-06-06 EP EP19728992.9A patent/EP3803707A1/fr active Pending
- 2019-06-06 KR KR1020207035846A patent/KR102465409B1/ko active IP Right Grant
- 2019-06-06 CN CN201980053140.6A patent/CN112567388A/zh active Pending
- 2019-06-06 KR KR1020207035845A patent/KR102475411B1/ko active IP Right Grant
- 2019-06-06 EP EP19728993.7A patent/EP3803708A1/fr active Pending
- 2019-06-06 WO PCT/EP2019/064740 patent/WO2019238512A1/fr unknown
- 2019-06-06 CN CN201980054063.6A patent/CN112585621A/zh active Pending
- 2019-06-06 WO PCT/EP2019/064773 patent/WO2019238522A1/fr unknown
- 2019-06-06 EP EP19728990.3A patent/EP3803706A1/fr active Pending
- 2019-06-06 WO PCT/EP2019/064776 patent/WO2019238523A1/fr unknown
- 2019-06-06 WO PCT/EP2019/064741 patent/WO2019238513A1/fr unknown
- 2019-06-06 KR KR1020207035844A patent/KR102488042B1/ko active IP Right Grant
- 2019-06-06 CN CN201980053463.5A patent/CN112567390A/zh active Pending
- 2019-06-06 EP EP19728989.5A patent/EP3803705A1/fr active Pending
Non-Patent Citations (1)
| Title |
|---|
| 期刊 MICHAEL W. REIMANN ET AL，Cliques of Neurons Bound into Cavities Provide a Missing Link between Structure and Function，FRONTIERS IN COMPUTATIONAL NEUROSIENCE vol. 11，12 June 2017 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3803707A1 (fr) | 2021-04-14 |
| EP3803705A1 (fr) | 2021-04-14 |
| CN112567390A (zh) | 2021-03-26 |
| CN112567388A (zh) | 2021-03-26 |
| KR20210008418A (ko) | 2021-01-21 |
| KR20210008417A (ko) | 2021-01-21 |
| CN112567389A (zh) | 2021-03-26 |
| KR20210008858A (ko) | 2021-01-25 |
| KR102497238B1 (ko) | 2023-02-07 |
| KR20210008419A (ko) | 2021-01-21 |
| EP3803699A1 (fr) | 2021-04-14 |
| KR102526132B1 (ko) | 2023-04-26 |
| CN112567387A (zh) | 2021-03-26 |
| KR102488042B1 (ko) | 2023-01-12 |
| KR20210010894A (ko) | 2021-01-28 |
| WO2019238483A1 (fr) | 2019-12-19 |
| KR102465409B1 (ko) | 2022-11-09 |
| WO2019238523A1 (fr) | 2019-12-19 |
| TW202001693A (zh) | 2020-01-01 |
| EP3803706A1 (fr) | 2021-04-14 |
| CN112585621A (zh) | 2021-03-30 |
| WO2019238522A1 (fr) | 2019-12-19 |
| WO2019238512A1 (fr) | 2019-12-19 |
| EP3803708A1 (fr) | 2021-04-14 |
| KR102475411B1 (ko) | 2022-12-07 |
| WO2019238513A1 (fr) | 2019-12-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI822792B (zh) | 將人工神經網路中之活動特徵化之方法及包含一或多個可執行該方法之計算機之系統 | |
| US11972343B2 (en) | Encoding and decoding information | |
| US11663478B2 (en) | Characterizing activity in a recurrent artificial neural network | |
| US20240176985A1 (en) | Encoding and decoding information and artificial neural networks | |
| US20190378000A1 (en) | Characterizing activity in a recurrent artificial neural network | |
| US20190378007A1 (en) | Characterizing activity in a recurrent artificial neural network | |
| US11853891B2 (en) | System and method with federated learning model for medical research applications | |
| McDonnell et al. | An introductory review of information theory in the context of computational neuroscience | |
| Malik et al. | Architecture, generative model, and deep reinforcement learning for IoT applications: Deep learning perspective | |
| Guo et al. | Privacy-preserving deep learning for enabling big edge data analytics in Internet of Things | |
| US11358061B2 (en) | Computer program for performing drawing-based security authentication | |
| Jeong | Performance of Neural Computing Techniques in Communication Networks | |
| Alhalabi | Ensembles of Pruned Deep Neural Networks for Accurate and Privacy Preservation in IoT Applications | |
| Jafarigol | Uncovering the Potential of Federated Learning: Addressing Algorithmic and Data-driven Challenges under Privacy Restrictions | |
| CN118335070A (zh) | 识别模型的训练方法、装置、计算机设备 | |
| Karthikeyan et al. | Emotion Recognition with a Hybrid VGG-ResNet Deep Learning Model: a Novel Approach for Robust Emotion Classification | |
| CN117195058A (zh) | 基于神经网络的大脑时空数据分析方法及系统 | |
| Polepalli | Scalable Digital Architecture of a Liquid State Machine | |
| Bugajewski | Check for updates Proposal of a System for Prototyping and Validation of Drug Efficacy and Safety Evaluation Methods |