CN108920542A - 一种分布式内存大数据处理系统及其数据处理方法 - Google Patents
一种分布式内存大数据处理系统及其数据处理方法 Download PDFInfo
- Publication number
- CN108920542A CN108920542A CN201810605777.9A CN201810605777A CN108920542A CN 108920542 A CN108920542 A CN 108920542A CN 201810605777 A CN201810605777 A CN 201810605777A CN 108920542 A CN108920542 A CN 108920542A
- Authority
- CN
- China
- Prior art keywords
- data
- request
- module
- processing
- aggregation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Computer And Data Communications (AREA)
Abstract
Description
Claims (7)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810605777.9A CN108920542B (zh) | 2018-06-13 | 2018-06-13 | 一种分布式内存大数据处理系统及其数据处理方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810605777.9A CN108920542B (zh) | 2018-06-13 | 2018-06-13 | 一种分布式内存大数据处理系统及其数据处理方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108920542A true CN108920542A (zh) | 2018-11-30 |
CN108920542B CN108920542B (zh) | 2021-07-20 |
Family
ID=64420962
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810605777.9A Active CN108920542B (zh) | 2018-06-13 | 2018-06-13 | 一种分布式内存大数据处理系统及其数据处理方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108920542B (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111092943A (zh) * | 2019-12-13 | 2020-05-01 | 中国科学院深圳先进技术研究院 | 一种树状结构的多集群遥感方法、系统及电子设备 |
CN116956164A (zh) * | 2023-09-18 | 2023-10-27 | 中国科学院精密测量科学与技术创新研究院 | 基于wasm技术的全高层大气激光雷达数据处理方法 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1520110A (zh) * | 2003-01-30 | 2004-08-11 | ���ǵ�����ʽ���� | 对转发信息进行动态管理的分布式路由器及其方法 |
US7325109B1 (en) * | 2003-10-24 | 2008-01-29 | Network Appliance, Inc. | Method and apparatus to mirror data at two separate sites without comparing the data at the two sites |
CN101291245A (zh) * | 2007-04-16 | 2008-10-22 | 阿里巴巴集团控股有限公司 | 一种分布式处理方法、系统及其装置 |
CN101697168A (zh) * | 2009-10-22 | 2010-04-21 | 中国科学技术大学 | 一种分布式文件系统动态元数据管理方法及系统 |
CN102123136A (zh) * | 2010-12-26 | 2011-07-13 | 广州大学 | 一种分布式DDoS攻击流识别方法 |
CN102148756A (zh) * | 2011-01-26 | 2011-08-10 | 武汉邮电科学研究院 | 一种基于6LoWPAN邻居发现的树状路由方法 |
CN105897646A (zh) * | 2014-09-25 | 2016-08-24 | 高明利 | 一种基于互联网构建泛在网的方法 |
CN105930345A (zh) * | 2016-04-05 | 2016-09-07 | 国网浙江省电力公司湖州供电公司 | 基于分布式实时数据库的层次索引方法 |
-
2018
- 2018-06-13 CN CN201810605777.9A patent/CN108920542B/zh active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1520110A (zh) * | 2003-01-30 | 2004-08-11 | ���ǵ�����ʽ���� | 对转发信息进行动态管理的分布式路由器及其方法 |
US7325109B1 (en) * | 2003-10-24 | 2008-01-29 | Network Appliance, Inc. | Method and apparatus to mirror data at two separate sites without comparing the data at the two sites |
CN101291245A (zh) * | 2007-04-16 | 2008-10-22 | 阿里巴巴集团控股有限公司 | 一种分布式处理方法、系统及其装置 |
CN101697168A (zh) * | 2009-10-22 | 2010-04-21 | 中国科学技术大学 | 一种分布式文件系统动态元数据管理方法及系统 |
CN102123136A (zh) * | 2010-12-26 | 2011-07-13 | 广州大学 | 一种分布式DDoS攻击流识别方法 |
CN102148756A (zh) * | 2011-01-26 | 2011-08-10 | 武汉邮电科学研究院 | 一种基于6LoWPAN邻居发现的树状路由方法 |
CN105897646A (zh) * | 2014-09-25 | 2016-08-24 | 高明利 | 一种基于互联网构建泛在网的方法 |
CN105930345A (zh) * | 2016-04-05 | 2016-09-07 | 国网浙江省电力公司湖州供电公司 | 基于分布式实时数据库的层次索引方法 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111092943A (zh) * | 2019-12-13 | 2020-05-01 | 中国科学院深圳先进技术研究院 | 一种树状结构的多集群遥感方法、系统及电子设备 |
CN111092943B (zh) * | 2019-12-13 | 2022-09-20 | 中国科学院深圳先进技术研究院 | 一种树状结构的多集群遥感方法、系统及电子设备 |
CN116956164A (zh) * | 2023-09-18 | 2023-10-27 | 中国科学院精密测量科学与技术创新研究院 | 基于wasm技术的全高层大气激光雷达数据处理方法 |
Also Published As
Publication number | Publication date |
---|---|
CN108920542B (zh) | 2021-07-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11789925B2 (en) | System and method for conditionally updating an item with attribute granularity | |
US11010240B2 (en) | Tracking status and restarting distributed replication | |
US11327799B2 (en) | Dynamic allocation of worker nodes for distributed replication | |
US20200348852A1 (en) | Distributed object replication architecture | |
US20180332366A1 (en) | Organizing present and future reads from a tiered streaming data storage layer | |
KR101956236B1 (ko) | 데이터베이스 관리 시스템에서의 데이터 복제 기법 | |
US11468015B2 (en) | Storage and synchronization of metadata in a distributed storage system | |
US7783615B1 (en) | Apparatus and method for building a file system index | |
US8918435B2 (en) | System and method for implementing a scalable data storage service | |
US7805416B1 (en) | File system query and method of use | |
US20190245918A1 (en) | Distributed replication of an object | |
US11609697B2 (en) | System and method for providing a committed throughput level in a data store | |
CN106201771B (zh) | 数据存储系统和数据读写方法 | |
CN111913909A (zh) | 一种分布式存储系统中的重新分片方法及系统 | |
US20160350302A1 (en) | Dynamically splitting a range of a node in a distributed hash table | |
US8135763B1 (en) | Apparatus and method for maintaining a file system index | |
CN103795811B (zh) | 一种基于元数据保存存储信息及统计管理数据的方法 | |
CN105025053A (zh) | 基于云存储技术的分布式文件的上传方法及其系统 | |
CN107800808A (zh) | 一种基于Hadoop架构的数据存储系统 | |
CN113377868B (zh) | 一种基于分布式kv数据库的离线存储系统 | |
CN100424699C (zh) | 一种属性可扩展的对象文件系统 | |
CN109445702A (zh) | 一种块级数据去重存储系统 | |
CN108920542A (zh) | 一种分布式内存大数据处理系统及其数据处理方法 | |
CN107181773A (zh) | 分布式存储系统的数据存储及数据管理方法、设备 | |
WO2024021488A1 (zh) | 一种基于分布式键值数据库的元数据存储方法及装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20230710 Address after: 362500 42 shangletao, letao village, XunZhong Town, Dehua County, Quanzhou City, Fujian Province Patentee after: Sun Qingzhu Address before: Room 521, Yuanhe building, 959 Jiayuan Road, Yuanhe street, Xiangcheng District, Suzhou City, Jiangsu Province Patentee before: SUZHOU NIEVA INFORMATION TECHNOLOGY Co.,Ltd. |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20230823 Address after: 710000, No. 5-20001207, 30 Chama Lane, Shuangzhao Village, Yongle Town, Jinghe New City, Xixian New District, Xi'an City, Shaanxi Province Patentee after: Xi'an Xuanyue Cloud Network Technology Co.,Ltd. Address before: 362500 42 shangletao, letao village, XunZhong Town, Dehua County, Quanzhou City, Fujian Province Patentee before: Sun Qingzhu |
|
TR01 | Transfer of patent right |