CN106503058B - 一种数据加载方法、终端和计算集群 - Google Patents

一种数据加载方法、终端和计算集群 Download PDF

Info

Publication number
CN106503058B
CN106503058B CN201610856707.1A CN201610856707A CN106503058B CN 106503058 B CN106503058 B CN 106503058B CN 201610856707 A CN201610856707 A CN 201610856707A CN 106503058 B CN106503058 B CN 106503058B
Authority
CN
China
Prior art keywords
data
subregion
cluster
computing cluster
file destination
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610856707.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN106503058A (zh
Inventor
房浩
毕杰山
莫凯
郭益君
钟超强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201610856707.1A priority Critical patent/CN106503058B/zh
Publication of CN106503058A publication Critical patent/CN106503058A/zh
Priority to PCT/CN2017/087152 priority patent/WO2018058998A1/fr
Application granted granted Critical
Publication of CN106503058B publication Critical patent/CN106503058B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201610856707.1A 2016-09-27 2016-09-27 一种数据加载方法、终端和计算集群 Active CN106503058B (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610856707.1A CN106503058B (zh) 2016-09-27 2016-09-27 一种数据加载方法、终端和计算集群
PCT/CN2017/087152 WO2018058998A1 (fr) 2016-09-27 2017-06-05 Procédé de chargement de données, terminal et grappe de calcul

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610856707.1A CN106503058B (zh) 2016-09-27 2016-09-27 一种数据加载方法、终端和计算集群

Publications (2)

Publication Number Publication Date
CN106503058A CN106503058A (zh) 2017-03-15
CN106503058B true CN106503058B (zh) 2019-01-18

Family

ID=58290036

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610856707.1A Active CN106503058B (zh) 2016-09-27 2016-09-27 一种数据加载方法、终端和计算集群

Country Status (2)

Country Link
CN (1) CN106503058B (fr)
WO (1) WO2018058998A1 (fr)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106503058B (zh) * 2016-09-27 2019-01-18 华为技术有限公司 一种数据加载方法、终端和计算集群
CN110019125B (zh) * 2017-11-27 2021-12-14 北京京东尚科信息技术有限公司 数据库管理的方法和装置
CN110083658B (zh) * 2019-03-11 2021-05-25 北京达佳互联信息技术有限公司 数据同步方法、装置、电子设备及存储介质
CN111090645B (zh) * 2019-10-12 2024-03-01 平安科技（深圳）有限公司 基于云存储的数据传输方法、装置及计算机设备
CN112988034B (zh) * 2019-12-02 2024-04-12 华为云计算技术有限公司 一种分布式系统数据写入方法及装置
CN111651509B (zh) * 2020-04-30 2024-04-02 中国平安财产保险股份有限公司 基于Hbase数据库的数据导入方法、装置、电子设备及介质
CN112799820B (zh) * 2021-02-05 2024-06-11 拉卡拉支付股份有限公司 数据处理方法、装置、电子设备、存储介质及程序产品
CN114860349B (zh) * 2022-07-06 2022-11-08 深圳华锐分布式技术股份有限公司 数据加载方法、装置、设备及介质
CN118018488A (zh) * 2022-11-09 2024-05-10 华为技术有限公司 网络集群系统、报文传输方法及网络设备
CN117271562B (zh) * 2023-11-21 2024-01-19 成都凌亚科技有限公司 一种数据采集处理方法及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102594852A (zh) * 2011-01-04 2012-07-18 中国移动通信集团公司 数据访问方法、节点及系统
CN102833295A (zh) * 2011-06-17 2012-12-19 南京中兴新软件有限责任公司 分布式缓存系统中的数据操作方法和装置
CN105138679A (zh) * 2015-09-14 2015-12-09 桂林电子科技大学 一种基于分布式缓存的数据处理系统及处理方法
EP2977899A2 (fr) * 2014-06-27 2016-01-27 General Electric Company Intégration d'exécution de calcul analytique dans un environnement de traitement mapreduce

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106503058B (zh) * 2016-09-27 2019-01-18 华为技术有限公司 一种数据加载方法、终端和计算集群

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102594852A (zh) * 2011-01-04 2012-07-18 中国移动通信集团公司 数据访问方法、节点及系统
CN102833295A (zh) * 2011-06-17 2012-12-19 南京中兴新软件有限责任公司 分布式缓存系统中的数据操作方法和装置
EP2977899A2 (fr) * 2014-06-27 2016-01-27 General Electric Company Intégration d'exécution de calcul analytique dans un environnement de traitement mapreduce
CN105138679A (zh) * 2015-09-14 2015-12-09 桂林电子科技大学 一种基于分布式缓存的数据处理系统及处理方法

Also Published As

Publication number Publication date
WO2018058998A1 (fr) 2018-04-05
CN106503058A (zh) 2017-03-15

Similar Documents

Publication Publication Date Title
CN106503058B (zh) 一种数据加载方法、终端和计算集群
CN105765578B (zh) 分布式文件系统中的数据的并行访问
CN104462225B (zh) 一种数据读取的方法、装置及系统
US9749445B2 (en) System and method for updating service information for across-domain messaging in a transactional middleware machine environment
US20160132541A1 (en) Efficient implementations for mapreduce systems
JP2018518744A (ja) コンピュートクラスタ内のリソースインスタンスグループの自動スケーリング
CN106331153B (zh) 一种业务请求的过滤方法、装置及系统
CN103312624A (zh) 一种消息队列服务系统和方法
AU2021269201B2 (en) Utilizing coherently attached interfaces in a network stack framework
CN107391033B (zh) 数据迁移方法及装置、计算设备、计算机存储介质
CN110119304A (zh) 一种中断处理方法、装置及服务器
CN114281263B (zh) 容器集群管理系统的存储资源处理方法、系统和设备
CN114244905B (zh) 数据转发方法、装置、计算机设备和存储介质
CN114036031B (zh) 一种企业数字中台中资源服务应用的调度系统和方法
CN112860412B (zh) 业务数据处理方法、装置、电子设备及存储介质
CN111262904B (zh) 服务代理系统及方法
CN115114042A (zh) 存储数据访问方法、装置、电子设备和存储介质
US11962476B1 (en) Systems and methods for disaggregated software defined networking control
CN108829340B (zh) 存储处理方法、装置、存储介质及处理器
US20100281132A1 (en) Multistage online transaction system, server, multistage online transaction processing method and program
CN114172895A (zh) 一种路由方法、装置、计算机设备及存储介质
CN116775510B (zh) 数据访问方法、装置、服务器和计算机可读存储介质
US12086141B1 (en) Coordination of services using PartiQL queries
US10515027B2 (en) Storage device sharing through queue transfer
CN116301610A (zh) 一种数据处理方法以及相关设备

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220217

Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province

Patentee after: Huawei Cloud Computing Technologies Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd.