CN107480080A - 一种基于rdma的零拷贝数据流 - Google Patents
一种基于rdma的零拷贝数据流 Download PDFInfo
- Publication number
- CN107480080A CN107480080A CN201710534535.0A CN201710534535A CN107480080A CN 107480080 A CN107480080 A CN 107480080A CN 201710534535 A CN201710534535 A CN 201710534535A CN 107480080 A CN107480080 A CN 107480080A
- Authority
- CN
- China
- Prior art keywords
- rdma
- zero
- data stream
- stream based
- memory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/14—Handling requests for interconnection or transfer
- G06F13/20—Handling requests for interconnection or transfer for access to input/output bus
- G06F13/28—Handling requests for interconnection or transfer for access to input/output bus using burst mode transfer, e.g. direct memory access DMA, cycle steal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
- G06F12/0871—Allocation or management of cache space
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710534535.0A CN107480080B (zh) | 2017-07-03 | 2017-07-03 | 一种基于rdma的零拷贝数据流 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710534535.0A CN107480080B (zh) | 2017-07-03 | 2017-07-03 | 一种基于rdma的零拷贝数据流 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107480080A true CN107480080A (zh) | 2017-12-15 |
CN107480080B CN107480080B (zh) | 2021-03-23 |
Family
ID=60595311
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710534535.0A Active CN107480080B (zh) | 2017-07-03 | 2017-07-03 | 一种基于rdma的零拷贝数据流 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107480080B (zh) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108804040A (zh) * | 2018-06-05 | 2018-11-13 | 上海孚典智能科技有限公司 | 基于内核旁路技术的Hadoop map-reduce计算加速方法 |
CN109861967A (zh) * | 2018-12-10 | 2019-06-07 | 中国人民银行清算总中心 | 基于Spark Shuffle的远程直接内存访问系统 |
CN110177118A (zh) * | 2019-06-13 | 2019-08-27 | 上海海事大学 | 一种基于rdma的rpc通信方法 |
CN111241011A (zh) * | 2019-12-31 | 2020-06-05 | 清华大学 | 一种分布式持久性内存的全局地址空间管理方法 |
WO2020156259A1 (zh) * | 2019-01-28 | 2020-08-06 | Oppo广东移动通信有限公司 | 内存管理方法、装置、移动终端及存储介质 |
CN113064846A (zh) * | 2021-04-14 | 2021-07-02 | 中南大学 | 基于Rsockets协议的零拷贝数据传输方法 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101150488A (zh) * | 2007-11-15 | 2008-03-26 | 曙光信息产业(北京)有限公司 | 一种零拷贝网络报文接收方法 |
TW201211898A (en) * | 2010-04-30 | 2012-03-16 | Ibm | Zero copy data transmission in a software based RDMA network stack |
CN104038569A (zh) * | 2014-06-24 | 2014-09-10 | 浪潮电子信息产业股份有限公司 | 一种基于地址映射的集群通信模型 |
CN104239249A (zh) * | 2014-09-16 | 2014-12-24 | 国家计算机网络与信息安全管理中心 | Pci-e零拷贝dma数据传输方法 |
US20150026286A1 (en) * | 2013-07-18 | 2015-01-22 | Robert O. Sharp | Iwarp rdma read extensions |
CN104333533A (zh) * | 2014-09-12 | 2015-02-04 | 北京华电天益信息科技有限公司 | 一种用于工业控制系统网络的数据包零拷贝获取方法 |
US20170124451A1 (en) * | 2015-10-28 | 2017-05-04 | Google Inc. | Stream-based accelerator processing of computational graphs |
-
2017
- 2017-07-03 CN CN201710534535.0A patent/CN107480080B/zh active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101150488A (zh) * | 2007-11-15 | 2008-03-26 | 曙光信息产业(北京)有限公司 | 一种零拷贝网络报文接收方法 |
CN101150488B (zh) * | 2007-11-15 | 2012-01-25 | 曙光信息产业(北京)有限公司 | 一种零拷贝网络报文接收方法 |
TW201211898A (en) * | 2010-04-30 | 2012-03-16 | Ibm | Zero copy data transmission in a software based RDMA network stack |
US20150026286A1 (en) * | 2013-07-18 | 2015-01-22 | Robert O. Sharp | Iwarp rdma read extensions |
CN104038569A (zh) * | 2014-06-24 | 2014-09-10 | 浪潮电子信息产业股份有限公司 | 一种基于地址映射的集群通信模型 |
CN104333533A (zh) * | 2014-09-12 | 2015-02-04 | 北京华电天益信息科技有限公司 | 一种用于工业控制系统网络的数据包零拷贝获取方法 |
CN104239249A (zh) * | 2014-09-16 | 2014-12-24 | 国家计算机网络与信息安全管理中心 | Pci-e零拷贝dma数据传输方法 |
US20170124451A1 (en) * | 2015-10-28 | 2017-05-04 | Google Inc. | Stream-based accelerator processing of computational graphs |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108804040A (zh) * | 2018-06-05 | 2018-11-13 | 上海孚典智能科技有限公司 | 基于内核旁路技术的Hadoop map-reduce计算加速方法 |
CN108804040B (zh) * | 2018-06-05 | 2020-07-07 | 上海孚典智能科技有限公司 | 基于内核旁路技术的Hadoop map-reduce计算加速方法 |
CN109861967A (zh) * | 2018-12-10 | 2019-06-07 | 中国人民银行清算总中心 | 基于Spark Shuffle的远程直接内存访问系统 |
WO2020156259A1 (zh) * | 2019-01-28 | 2020-08-06 | Oppo广东移动通信有限公司 | 内存管理方法、装置、移动终端及存储介质 |
CN110177118A (zh) * | 2019-06-13 | 2019-08-27 | 上海海事大学 | 一种基于rdma的rpc通信方法 |
CN110177118B (zh) * | 2019-06-13 | 2022-03-29 | 上海海事大学 | 一种基于rdma的rpc通信方法 |
CN111241011A (zh) * | 2019-12-31 | 2020-06-05 | 清华大学 | 一种分布式持久性内存的全局地址空间管理方法 |
CN111241011B (zh) * | 2019-12-31 | 2022-04-15 | 清华大学 | 一种分布式持久性内存的全局地址空间管理方法 |
CN113064846A (zh) * | 2021-04-14 | 2021-07-02 | 中南大学 | 基于Rsockets协议的零拷贝数据传输方法 |
Also Published As
Publication number | Publication date |
---|---|
CN107480080B (zh) | 2021-03-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107480080A (zh) | 一种基于rdma的零拷贝数据流 | |
US11237880B1 (en) | Dataflow all-reduce for reconfigurable processor systems | |
Zhu et al. | PHDFS: Optimizing I/O performance of HDFS in deep learning cloud computing platform | |
US20180307972A1 (en) | Local multicast in single-host multi-gpu machine for distributed deep learning systems | |
US10768856B1 (en) | Memory access for multiple circuit components | |
US11392740B2 (en) | Dataflow function offload to reconfigurable processors | |
WO2017156968A1 (zh) | 神经网络的计算方法、系统及其装置 | |
CN109426648A (zh) | 用于由智能网络接口控制器处理网络分组的技术 | |
WO2022116424A1 (zh) | 交通流预测模型训练方法、装置、电子设备及存储介质 | |
CN112866059B (zh) | 一种基于人工智能应用的无损网络性能测试方法和装置 | |
JP7389231B2 (ja) | 同期ネットワーク | |
US11336476B2 (en) | Scalable in-network computation for massively-parallel shared-memory processors | |
CN110442532A (zh) | 用于与主机相链接的设备的全球可存储存储器 | |
CN107111576A (zh) | 发布的中断架构 | |
CN113642734A (zh) | 一种深度学习模型的分布式训练方法、装置以及计算设备 | |
CN113449839A (zh) | 一种分布式训练方法、梯度通信方法、装置以及计算设备 | |
Thao Nguyen et al. | Efficient MPI‐AllReduce for large‐scale deep learning on GPU‐clusters | |
CN114564434B (zh) | 一种通用多核类脑处理器、加速卡及计算机设备 | |
CN116070682A (zh) | 神经元计算机操作系统的snn模型动态映射方法及装置 | |
Cui et al. | Scalable deep learning on distributed GPUs with a GPU-specialized parameter server | |
CN105718349B (zh) | 跨管芯接口监听或全局观察消息排序 | |
US12020035B2 (en) | Programmatically controlled data multicasting across multiple compute engines | |
CN116246062A (zh) | 使用图像/文本对执行语义分割训练 | |
US20210004658A1 (en) | System and method for provisioning of artificial intelligence accelerator (aia) resources | |
US20230124193A1 (en) | Distributed Processing Node and Distributed Processing System |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Chen Kai Inventor after: Yang Qiang Inventor before: Yi Bairen Inventor before: Chen Li Inventor before: Chen Kai |
|
CB03 | Change of inventor or designer information | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20201204 Address after: 518000 1803, block C, Dachong business center, Nanshan District, Shenzhen City, Guangdong Province Applicant after: Shenzhen Zhixing Technology Co., Ltd Address before: Room 1701, 17 / F, Shui on centre, 6-8 Harbour Road, Wan Chai, Hong Kong, China Applicant before: RED BIRD TECHNOLOGY Ltd. |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant |