CN113721839B - 用于处理图数据的计算系统和存储分层方法 - Google Patents
用于处理图数据的计算系统和存储分层方法 Download PDFInfo
- Publication number
- CN113721839B CN113721839B CN202110835596.7A CN202110835596A CN113721839B CN 113721839 B CN113721839 B CN 113721839B CN 202110835596 A CN202110835596 A CN 202110835596A CN 113721839 B CN113721839 B CN 113721839B
- Authority
- CN
- China
- Prior art keywords
- data
- volatile memory
- node
- nodes
- root
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 34
- 238000000034 method Methods 0.000 title claims abstract description 23
- 230000015654 memory Effects 0.000 claims abstract description 125
- 238000000547 structure data Methods 0.000 claims description 21
- 238000013528 artificial neural network Methods 0.000 claims description 20
- 238000005070 sampling Methods 0.000 claims description 9
- 239000004744 fabric Substances 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims description 2
- 230000004044 response Effects 0.000 claims description 2
- 238000003491 array Methods 0.000 description 6
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 239000013598 vector Substances 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000004931 aggregating effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9024—Graphs; Linked lists
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0862—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches with prefetch
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/30—Providing cache or TLB in specific location of a processing system
- G06F2212/301—In special purpose processing node, e.g. vector processor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/60—Details of cache memory
- G06F2212/6024—History based prefetching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/60—Details of cache memory
- G06F2212/6028—Prefetching based on hints or prefetch instructions
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Life Sciences & Earth Sciences (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Neurology (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (13)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110835596.7A CN113721839B (zh) | 2021-07-23 | 2021-07-23 | 用于处理图数据的计算系统和存储分层方法 |
US17/866,304 US20230026824A1 (en) | 2021-07-23 | 2022-07-15 | Memory system for accelerating graph neural network processing |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110835596.7A CN113721839B (zh) | 2021-07-23 | 2021-07-23 | 用于处理图数据的计算系统和存储分层方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113721839A CN113721839A (zh) | 2021-11-30 |
CN113721839B true CN113721839B (zh) | 2024-04-19 |
Family
ID=78673823
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110835596.7A Active CN113721839B (zh) | 2021-07-23 | 2021-07-23 | 用于处理图数据的计算系统和存储分层方法 |
Country Status (2)
Country | Link |
---|---|
US (1) | US20230026824A1 (zh) |
CN (1) | CN113721839B (zh) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105612503A (zh) * | 2013-08-09 | 2016-05-25 | 桑迪士克科技股份有限公司 | 持久性数据结构 |
CN108268391A (zh) * | 2016-12-30 | 2018-07-10 | 三星电子株式会社 | 半导体系统及其控制方法 |
CN108475235A (zh) * | 2016-01-11 | 2018-08-31 | 高通股份有限公司 | 利用dram程序高速缓存的非易失性随机存取系统存储器 |
CN108874701A (zh) * | 2017-05-09 | 2018-11-23 | 三星电子株式会社 | 用于混合存储器中的写入和刷新支持的系统和方法 |
WO2020019314A1 (zh) * | 2018-07-27 | 2020-01-30 | 浙江天猫技术有限公司 | 一种图数据存储方法、系统及电子设备 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8819078B2 (en) * | 2012-07-13 | 2014-08-26 | Hewlett-Packard Development Company, L. P. | Event processing for graph-structured data |
US10084877B2 (en) * | 2015-10-22 | 2018-09-25 | Vmware, Inc. | Hybrid cloud storage extension using machine learning graph based cache |
US10977036B2 (en) * | 2016-09-30 | 2021-04-13 | Intel Corporation | Main memory control function with prefetch intelligence |
-
2021
- 2021-07-23 CN CN202110835596.7A patent/CN113721839B/zh active Active
-
2022
- 2022-07-15 US US17/866,304 patent/US20230026824A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105612503A (zh) * | 2013-08-09 | 2016-05-25 | 桑迪士克科技股份有限公司 | 持久性数据结构 |
CN108475235A (zh) * | 2016-01-11 | 2018-08-31 | 高通股份有限公司 | 利用dram程序高速缓存的非易失性随机存取系统存储器 |
CN108268391A (zh) * | 2016-12-30 | 2018-07-10 | 三星电子株式会社 | 半导体系统及其控制方法 |
CN108874701A (zh) * | 2017-05-09 | 2018-11-23 | 三星电子株式会社 | 用于混合存储器中的写入和刷新支持的系统和方法 |
WO2020019314A1 (zh) * | 2018-07-27 | 2020-01-30 | 浙江天猫技术有限公司 | 一种图数据存储方法、系统及电子设备 |
Also Published As
Publication number | Publication date |
---|---|
CN113721839A (zh) | 2021-11-30 |
US20230026824A1 (en) | 2023-01-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10318434B2 (en) | Optimized hopscotch multiple hash tables for efficient memory in-line deduplication application | |
US10176113B2 (en) | Scalable indexing | |
US9563658B2 (en) | Hardware implementation of the aggregation/group by operation: hash-table method | |
US9966152B2 (en) | Dedupe DRAM system algorithm architecture | |
US20120066473A1 (en) | Memory Architecture with Policy Based Data Storage | |
CN112000846B (zh) | 基于gpu分组lsm树索引的方法 | |
US11281585B2 (en) | Forward caching memory systems and methods | |
CN108052541B (zh) | 基于多级页表目录结构的文件系统的实现、访问方法、终端 | |
US12061554B2 (en) | Asynchronous forward caching memory systems and methods | |
CN108959113A (zh) | 用于闪存感知堆存储器管理的方法和系统 | |
US12001716B2 (en) | Key-value data storage system using content addressable memory | |
US10705762B2 (en) | Forward caching application programming interface systems and methods | |
CN115033185A (zh) | 访存处理方法和装置、存储装置、芯片、板卡、电子设备 | |
CN104714898B (zh) | 一种Cache的分配方法和装置 | |
US9261946B2 (en) | Energy optimized cache memory architecture exploiting spatial locality | |
CN115249057A (zh) | 用于图形节点采样的系统和由计算机实现的方法 | |
US20230385258A1 (en) | Dynamic random access memory-based content-addressable memory (dram-cam) architecture for exact pattern matching | |
US10339052B2 (en) | Massive access request for out-of-core textures by a parallel processor with limited memory | |
CN113721839B (zh) | 用于处理图数据的计算系统和存储分层方法 | |
KR101967857B1 (ko) | 다중 캐시 메모리를 구비한 지능형 반도체 장치 및 지능형 반도체 장치에서의 메모리 접근 방법 | |
CN111695685A (zh) | 一种面向图神经网络应用的片上存储系统及方法 | |
WO2020237409A1 (en) | Technologies for memory-efficient key-value lookup | |
US9720970B2 (en) | Efficient storage and retrieval of fragmented data using pseudo linear dynamic byte array | |
US11995005B2 (en) | SEDRAM-based stacked cache system and device and controlling method therefor | |
CN118331923A (zh) | 一种用于加速图挖掘的装置以及加速图挖掘的方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20240305 Address after: 311121 Room 516, floor 5, building 3, No. 969, Wenyi West Road, Wuchang Street, Yuhang District, Hangzhou City, Zhejiang Province Applicant after: Alibaba Dharma Institute (Hangzhou) Technology Co.,Ltd. Country or region after: China Address before: 200131 floor 5, No. 366, Shangke road and No. 2, Lane 55, Chuanhe Road, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai Applicant before: Pingtouge (Shanghai) semiconductor technology Co.,Ltd. Country or region before: China |
|
GR01 | Patent grant | ||
GR01 | Patent grant |