JP7248667B2 - メッセージ・パッシング計算システムのためのメモリ・マップド・インターフェースのシステム、方法及びコンピュータ・プログラム - Google Patents

メッセージ・パッシング計算システムのためのメモリ・マップド・インターフェースのシステム、方法及びコンピュータ・プログラム Download PDF

Info

Publication number
JP7248667B2
JP7248667B2 JP2020520474A JP2020520474A JP7248667B2 JP 7248667 B2 JP7248667 B2 JP 7248667B2 JP 2020520474 A JP2020520474 A JP 2020520474A JP 2020520474 A JP2020520474 A JP 2020520474A JP 7248667 B2 JP7248667 B2 JP 7248667B2
Authority
JP
Japan
Prior art keywords
address
interface
neural network
core
write
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020520474A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021500648A (ja
JP2021500648A5 (cg-RX-API-DMAC7.html
Inventor
キャシディ、アンドリュー、ステファン
アコピャン、フィリップ
アーサー、ジョン、ヴァーノン
デーボレ、マイケル、ヴィンセント
メローラ、ポール
モダ、ダルメーンドラ
潤 澤田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of JP2021500648A publication Critical patent/JP2021500648A/ja
Publication of JP2021500648A5 publication Critical patent/JP2021500648A5/ja
Application granted granted Critical
Publication of JP7248667B2 publication Critical patent/JP7248667B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/06—Addressing a physical block of locations, e.g. base addressing, module addressing, memory dedication
    • G06F12/0615—Address space extension
    • G06F12/063—Address space extension for I/O modules, e.g. memory mapped I/O
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/10—Address translation
    • G06F12/1027—Address translation using associative or pseudo-associative address translation means, e.g. translation look-aside buffer [TLB]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0495—Quantised networks; Sparse networks; Compressed networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11C—STATIC STORES
    • G11C7/00—Arrangements for writing information into, or reading information out from, a digital store
    • G11C7/10—Input/output [I/O] data interface arrangements, e.g. I/O data control circuits, I/O data buffers
    • G11C7/1051—Data output circuits, e.g. read-out amplifiers, data output buffers, data output registers, data output level conversion circuits
    • G11C7/1057—Data output buffers, e.g. comprising level conversion circuits, circuits for adapting load
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11C—STATIC STORES
    • G11C11/00—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor
    • G11C11/54—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor using elements simulating biological cells, e.g. neuron

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Molecular Biology (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Neurology (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Multi Processors (AREA)
  • Advance Control (AREA)
  • Information Transfer Systems (AREA)
  • Computer And Data Communications (AREA)
JP2020520474A 2017-10-20 2018-10-12 メッセージ・パッシング計算システムのためのメモリ・マップド・インターフェースのシステム、方法及びコンピュータ・プログラム Active JP7248667B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/789,472 US10452540B2 (en) 2017-10-20 2017-10-20 Memory-mapped interface for message passing computing systems
US15/789,472 2017-10-20
PCT/IB2018/057922 WO2019077455A1 (en) 2017-10-20 2018-10-12 MAPPED MEMORY INTERFACE FOR MESSAGE PASSING COMPUTER SYSTEMS

Publications (3)

Publication Number Publication Date
JP2021500648A JP2021500648A (ja) 2021-01-07
JP2021500648A5 JP2021500648A5 (cg-RX-API-DMAC7.html) 2021-02-18
JP7248667B2 true JP7248667B2 (ja) 2023-03-29

Family

ID=66171106

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020520474A Active JP7248667B2 (ja) 2017-10-20 2018-10-12 メッセージ・パッシング計算システムのためのメモリ・マップド・インターフェースのシステム、方法及びコンピュータ・プログラム

Country Status (6)

Country Link
US (2) US10452540B2 (cg-RX-API-DMAC7.html)
JP (1) JP7248667B2 (cg-RX-API-DMAC7.html)
CN (1) CN111247775B (cg-RX-API-DMAC7.html)
DE (1) DE112018004382B4 (cg-RX-API-DMAC7.html)
GB (1) GB2581904B (cg-RX-API-DMAC7.html)
WO (1) WO2019077455A1 (cg-RX-API-DMAC7.html)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9924490B2 (en) * 2013-10-09 2018-03-20 International Business Machines Corporation Scaling multi-core neurosynaptic networks across chip boundaries
US9406015B2 (en) 2013-12-27 2016-08-02 International Business Machines Corporation Transform for a neurosynaptic core circuit
US9412063B2 (en) * 2013-12-27 2016-08-09 International Business Machines Corporation Transform architecture for multiple neurosynaptic core circuits
US12210952B2 (en) * 2017-11-29 2025-01-28 Electronics And Telecommunications Research Institute Reorganizable data processing array for neural network computing
EP3716154A1 (en) * 2019-03-27 2020-09-30 GrAl Matter Labs S.A.S. Neuromorphic processing system and method of operating the same
CN114144793B (zh) * 2019-08-05 2024-10-18 华为技术有限公司 数据传输方法、装置、电子设备及可读存储介质
CN112418389A (zh) * 2019-08-23 2021-02-26 北京希姆计算科技有限公司 数据处理方法、装置、电子设备及计算机可读存储介质
CN111241173B (zh) * 2019-12-29 2024-03-12 航天信息股份有限公司 一种用于多个系统间数据交互的方法及系统
DE102020202093A1 (de) 2020-02-19 2021-08-19 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren und Vorrichtung für maschinelles Lernen
KR102891573B1 (ko) 2020-06-30 2025-11-26 삼성전자주식회사 텐서 처리 방법, 가속기 및 이를 포함한 가속기 시스템
US20220101108A1 (en) * 2020-09-30 2022-03-31 International Business Machines Corporation Memory-mapped neural network accelerator for deployable inference systems
US20230133088A1 (en) * 2021-11-01 2023-05-04 Femtosense, Inc. Methods and apparatus for system-on-a-chip neural network processing applications
CN114785907B (zh) * 2022-04-18 2025-06-24 清华大学 通信系统、通信方法、存储介质及程序产品

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150324684A1 (en) 2014-05-08 2015-11-12 International Business Machines Corporation Neuromorphic hardware for neuronal computation and non-neuronal computation
US20160196488A1 (en) 2013-08-02 2016-07-07 Byungik Ahn Neural network computing device, system and method

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5214747A (en) * 1990-12-24 1993-05-25 Eastman Kodak Company Segmented neural network with daisy chain control
JPH05242065A (ja) * 1992-02-28 1993-09-21 Hitachi Ltd 情報処理装置及びシステム
US5956703A (en) * 1995-07-28 1999-09-21 Delco Electronics Corporation Configurable neural network integrated circuit
JP3524250B2 (ja) * 1995-11-27 2004-05-10 キヤノン株式会社 デジタル画像処理プロセッサ
US5848241A (en) * 1996-01-11 1998-12-08 Openframe Corporation Ltd. Resource sharing facility functions as a controller for secondary storage device and is accessible to all computers via inter system links
US7620791B1 (en) * 2006-04-14 2009-11-17 Tilera Corporation Mapping memory in a parallel processing environment
US7624248B1 (en) * 2006-04-14 2009-11-24 Tilera Corporation Managing memory in a parallel processing environment
US8407449B1 (en) * 2010-02-26 2013-03-26 Western Digital Technologies, Inc. Non-volatile semiconductor memory storing an inverse map for rebuilding a translation table
US8943516B2 (en) * 2012-05-31 2015-01-27 International Business Machines Corporation Mechanism for optimized intra-die inter-nodelet messaging communication
CN103117933B (zh) 2013-03-04 2015-12-23 中国科学院高能物理研究所 在多点通信网络中传送数据的方法和系统
US9262712B2 (en) * 2013-03-08 2016-02-16 International Business Machines Corporation Structural descriptions for neurosynaptic networks
CN105027213A (zh) * 2013-03-12 2015-11-04 惠普发展公司,有限责任合伙企业 可编程地址映射和存储器访问操作
US9542643B2 (en) * 2013-05-21 2017-01-10 Qualcomm Incorporated Efficient hardware implementation of spiking networks
CN104915302B (zh) 2014-03-10 2018-07-03 华为技术有限公司 数据传输处理方法和数据传输器
CN105786398B (zh) * 2014-11-18 2019-04-05 财团法人工业技术研究院 存储器映射方法和存储器映射系统
US10417555B2 (en) 2015-05-29 2019-09-17 Samsung Electronics Co., Ltd. Data-optimized neural network traversal
KR102835519B1 (ko) * 2016-09-28 2025-07-17 에스케이하이닉스 주식회사 합성곱 신경망의 연산 장치 및 방법
US10726583B2 (en) * 2016-12-30 2020-07-28 Intel Corporation System and method of encoding and decoding feature maps and weights for a convolutional neural network
US11062203B2 (en) * 2016-12-30 2021-07-13 Intel Corporation Neuromorphic computer with reconfigurable memory mapping for various neural network topologies

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160196488A1 (en) 2013-08-02 2016-07-07 Byungik Ahn Neural network computing device, system and method
US20150324684A1 (en) 2014-05-08 2015-11-12 International Business Machines Corporation Neuromorphic hardware for neuronal computation and non-neuronal computation

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Martin J. Pearson et al.,Implementing Spiking Neural Networks for Real-Time Signal-Processing and Control Applications: A Model-Validated FPGA Approach,IEEE Transactions on Neural Networks,IEEE,2007年09月04日,Vol.18, No.5,pages 1472-1487

Also Published As

Publication number Publication date
CN111247775A (zh) 2020-06-05
US10838860B2 (en) 2020-11-17
CN111247775B (zh) 2022-04-12
DE112018004382T5 (de) 2020-05-14
GB2581904A (en) 2020-09-02
JP2021500648A (ja) 2021-01-07
US10452540B2 (en) 2019-10-22
DE112018004382B4 (de) 2025-04-17
US20200004678A1 (en) 2020-01-02
WO2019077455A1 (en) 2019-04-25
US20190121734A1 (en) 2019-04-25
GB202007034D0 (en) 2020-06-24
GB2581904B (en) 2022-11-16

Similar Documents

Publication Publication Date Title
US10838860B2 (en) Memory-mapped interface to message-passing computing systems
US12335142B2 (en) Network interface for data transport in heterogeneous computing environments
US11409465B2 (en) Systems and methods for managing communication between NVMe-SSD storage device(s) and NVMe-of host unit
US12554961B2 (en) Block transfer of neuron output values through data memory for neurosynaptic processors
US20190108145A1 (en) Dual in-line memory module (dimm) programmable accelerator card
CN105068953B (zh) 用于对等高速外围组件互联存储传输的系统和方法
KR102317657B1 (ko) Nvdimm을 포함하는 장치 및 그것의 엑세스 방법
JP2020505666A (ja) 面積高効率、再設定可能、エネルギ高効率、速度高効率のニューラル・ネットワーク基板
JP2021500648A5 (cg-RX-API-DMAC7.html)
US20250278193A1 (en) Managing i/o operations associated with a compute express link (cxl) memory device
US12436714B2 (en) Access request reordering for memory-based communication queues
JP2019537093A (ja) 極度のスループットのニューラル・ネットワークのためのスケーラブル・ストリーム・シナプス・スーパーコンピュータ
CN109478171A (zh) 提高openfabrics环境中的吞吐量
TWI536772B (zh) 直接提供資料訊息至協定層之技術
US20150227320A1 (en) Storage system
CN101303669A (zh) 具备地址转换存储器访问机构的半导体装置
JPH03100857A (ja) 神経回路網処理装置
US20250258778A1 (en) Ordered store operations in a multiprocessor system
US12619559B2 (en) Smart storage devices
EP4553636A1 (en) Storage device based on cxl interface, operating method of storage device, host device including the same, and operating method of host device
Bonatto et al. Memory subsystem architecture design for multimedia applications

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201222

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210323

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220228

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220405

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20220502

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220629

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221018

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230116

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230228

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230316

R150 Certificate of patent or registration of utility model

Ref document number: 7248667

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150