CN112840334A - 管理分区表的数据的方法、装置、管理节点及存储介质 - Google Patents

管理分区表的数据的方法、装置、管理节点及存储介质 Download PDF

Info

Publication number
CN112840334A
CN112840334A CN201980009896.0A CN201980009896A CN112840334A CN 112840334 A CN112840334 A CN 112840334A CN 201980009896 A CN201980009896 A CN 201980009896A CN 112840334 A CN112840334 A CN 112840334A
Authority
CN
China
Prior art keywords
storage
data
partition
target
target partition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201980009896.0A
Other languages
English (en)
Other versions
CN112840334B (zh
Inventor
冯伟
洪福成
隋琪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN112840334A publication Critical patent/CN112840334A/zh
Application granted granted Critical
Publication of CN112840334B publication Critical patent/CN112840334B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29—Geographical information databases
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0617—Improving the reliability of storage systems in relation to availability
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647—Migration mechanisms
    • G06F3/0649—Lifecycle management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Remote Sensing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种管理分区表的数据的方法、装置、服务器及存储介质，属于大数据技术领域。该方法包括：管理节点获取分区表中的目标分区的数据的生成时长范围，管理节点还获取目标分区所属的地理区域，或者目标分区的历史访问信息，或者目标分区所属的业务类型。然后在目标分区的数据的生成时长范围满足第一存储阶段的预定时间范围，且预设条件得到满足时，管理节点可以将已按照第二存储阶段对应的存储策略存储的目标分区的数据，更改为按照第一存储阶段对应的存储策略进行存储，第一存储阶段的存储性能低于第二存储阶段的存储性能。可以使上层应用不会因为数据过期而无法访问。

Description

PCT国内申请，说明书已公开。

Claims (18)

  1. PCT国内申请，权利要求书已公开。
CN201980009896.0A 2019-09-25 2019-09-25 管理分区表的数据的方法、装置、管理节点及存储介质 Active CN112840334B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/107747 WO2021056243A1 (zh) 2019-09-25 2019-09-25 管理分区表的数据的方法、装置、管理节点及存储介质

Publications (2)

Publication Number Publication Date
CN112840334A true CN112840334A (zh) 2021-05-25
CN112840334B CN112840334B (zh) 2024-06-11

Family

ID=75165458

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980009896.0A Active CN112840334B (zh) 2019-09-25 2019-09-25 管理分区表的数据的方法、装置、管理节点及存储介质

Country Status (4)

Country Link
US (1) US11768856B2 (zh)
EP (1) EP3968173A4 (zh)
CN (1) CN112840334B (zh)
WO (1) WO2021056243A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113111014B (zh) * 2021-04-07 2023-01-06 山东英信计算机技术有限公司 缓存中非热点数据的清理方法、装置、设备及存储介质
US11822573B2 (en) * 2021-06-15 2023-11-21 Baker Hughes Holdings Llc Creation and maintenance of hierarchical industrial asset datasets
CN115695454B (zh) * 2022-06-13 2023-10-27 中移互联网有限公司 一种mec主机的数据存储方法、装置、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102122303A (zh) * 2011-03-15 2011-07-13 浪潮(北京)电子信息产业有限公司 一种进行数据迁移的方法及服务系统及服务器设备
US20150095671A1 (en) * 2013-09-27 2015-04-02 International Business Machines Corporation Method and apparatus for managing power of a storage system
CN108776690A (zh) * 2018-06-05 2018-11-09 上海孚典智能科技有限公司 基于分层治理的hdfs分布式与集中式混合数据存储系统的方法
CN109815219A (zh) * 2019-02-18 2019-05-28 国家计算机网络与信息安全管理中心 支持多数据库引擎的数据生命周期管理的实现方法
CN110096350A (zh) * 2019-04-10 2019-08-06 山东科技大学 基于集群节点负载状态预测的冷热区域划分节能存储方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8473459B2 (en) * 2011-02-28 2013-06-25 International Business Machines Corporation Workload learning in data replication environments
US9619169B1 (en) * 2012-09-30 2017-04-11 EMC IP Holding Company LLC Managing data activity information for data migration in data storage systems
CN106294671A (zh) * 2016-08-03 2017-01-04 杭州华三通信技术有限公司 一种数据迁移方法及装置
US10891201B1 (en) * 2017-04-27 2021-01-12 EMC IP Holding Company LLC Dynamic rule based model for long term retention
US11595474B2 (en) * 2017-12-28 2023-02-28 Cisco Technology, Inc. Accelerating data replication using multicast and non-volatile memory enabled nodes
US11422726B1 (en) * 2018-05-01 2022-08-23 Amazon Technologies, Inc. Efficient storage device data move operation based on priority of garbage collection command
US11061942B2 (en) * 2018-09-07 2021-07-13 Graywell, Inc. Unstructured data fusion by content-aware concurrent data processing pipeline

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102122303A (zh) * 2011-03-15 2011-07-13 浪潮(北京)电子信息产业有限公司 一种进行数据迁移的方法及服务系统及服务器设备
US20150095671A1 (en) * 2013-09-27 2015-04-02 International Business Machines Corporation Method and apparatus for managing power of a storage system
CN108776690A (zh) * 2018-06-05 2018-11-09 上海孚典智能科技有限公司 基于分层治理的hdfs分布式与集中式混合数据存储系统的方法
CN109815219A (zh) * 2019-02-18 2019-05-28 国家计算机网络与信息安全管理中心 支持多数据库引擎的数据生命周期管理的实现方法
CN110096350A (zh) * 2019-04-10 2019-08-06 山东科技大学 基于集群节点负载状态预测的冷热区域划分节能存储方法

Also Published As

Publication number Publication date
US20220156288A1 (en) 2022-05-19
US11768856B2 (en) 2023-09-26
EP3968173A1 (en) 2022-03-16
WO2021056243A1 (zh) 2021-04-01
EP3968173A4 (en) 2022-05-11
CN112840334B (zh) 2024-06-11

Similar Documents

Publication Publication Date Title
CN109815219B (zh) 支持多数据库引擎的数据生命周期管理的实现方法
CN104615606B (zh) 一种Hadoop分布式文件系统及其管理方法
US10459898B2 (en) Configurable-capacity time-series tables
JP4648723B2 (ja) データ価値に基づく階層型ストレージ管理の為の方法と装置
US20180189343A1 (en) Notifications system for content collaborations
CN112840334B (zh) 管理分区表的数据的方法、装置、管理节点及存储介质
US10817472B2 (en) Storage organization system with associated storage utilization values
US11308066B1 (en) Optimized database partitioning
US20190205034A1 (en) Quota controlled movement of data in a tiered storage system
CN107408239B (zh) 通过多个邮箱在通信应用中进行海量数据管理的架构
CN114610680A (zh) 分布式文件系统元数据管理方法、装置、设备及存储介质
US11200205B2 (en) Displaying an alert and options when deleting a file that is associated with a sequence of files
US20220058195A1 (en) Index selection for database query
CA2894048C (en) Aggregation of separate domain data
US20220318201A1 (en) Accessing network based content items by a mobile device while offline
CN112464049B (zh) 号码详单下载方法、装置和设备
US11455309B2 (en) Partition key adjustment based on query workload
US10846264B2 (en) Rule-based archiving of cloud files
CN113076086A (zh) 元数据管理系统和使用其对模型对象进行建模的方法
CN111966533A (zh) 电子文件管理方法、装置、计算机设备和存储介质
CN115718571B (zh) 一种基于多维度特征的数据管理方法和装置
US11199948B2 (en) Displaying a sequence and files associated with the sequence having a missing file
US20210240668A1 (en) Displaying a sequence and files associated with the sequence that are stored in multiple folders
US11108862B2 (en) Bi-directional data sync between a client device and an application server
US20240045852A1 (en) Performing an operation in a tree structure

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20220216

Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province

Applicant after: Huawei Cloud Computing Technologies Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Applicant before: HUAWEI TECHNOLOGIES Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant