CN112513804A - 一种数据处理方法及装置 - Google Patents

一种数据处理方法及装置 Download PDF

Info

Publication number
CN112513804A
CN112513804A CN201880095798.9A CN201880095798A CN112513804A CN 112513804 A CN112513804 A CN 112513804A CN 201880095798 A CN201880095798 A CN 201880095798A CN 112513804 A CN112513804 A CN 112513804A
Authority
CN
China
Prior art keywords
storage space
data
security level
target data
flash memory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201880095798.9A
Other languages
English (en)
Other versions
CN112513804B (zh
Inventor
汪宁
周喜渝
杜维
高翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN112513804A publication Critical patent/CN112513804A/zh
Application granted granted Critical
Publication of CN112513804B publication Critical patent/CN112513804B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/062—Securing storage systems
    • G06F3/0622—Securing storage systems in relation to access
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0688—Non-volatile semiconductor memory arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0632—Configuration or reconfiguration of storage systems by initialisation or re-initialisation of storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/0644—Management of space entities, e.g. partitions, extents, pools
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)
  • Memory System (AREA)

Abstract

本申请实施例提供一种数据处理方法及装置，涉及存储技术领域，有效提高了存储空间的利用率。该方法应用于第一物理存储空间存储第一安全级别的数据块和第二安全级别的数据块，第二物理存储空间存储第二安全级别的数据块的闪存设备，第一安全级别的数据块中每个条带集合由m个相邻的条带组成，且包括一个校验数据组，第二安全级别的数据块仅用于存储用户数据。该方法包括：接收用于请求写入目标数据的写数据请求，并获取目标数据的安全级别；若目标数据的安全级别为第一安全级别，将目标数据写入第一物理存储空间；若目标数据的安全级别为第二安全级别，将目标数据写入第二物理存储空间，或将目标数据写入第二物理存储空间和第一物理存储空间。

Description

PCT国内申请，说明书已公开。

Claims (29)

  1. PCT国内申请，权利要求书已公开。
CN201880095798.9A 2018-07-26 2018-07-26 一种数据处理方法及装置 Active CN112513804B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/097293 WO2020019267A1 (zh) 2018-07-26 2018-07-26 一种数据处理方法及装置

Publications (2)

Publication Number Publication Date
CN112513804A true CN112513804A (zh) 2021-03-16
CN112513804B CN112513804B (zh) 2022-08-19

Family

ID=69182097

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880095798.9A Active CN112513804B (zh) 2018-07-26 2018-07-26 一种数据处理方法及装置

Country Status (3)

Country Link
US (1) US11593000B2 (zh)
CN (1) CN112513804B (zh)
WO (1) WO2020019267A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114415961A (zh) * 2022-01-21 2022-04-29 珠海奔图电子有限公司 Nand flash存储器的坏块处理方法、电子设备及存储介质
CN112513804B (zh) * 2018-07-26 2022-08-19 华为技术有限公司 一种数据处理方法及装置

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11775201B2 (en) * 2018-08-08 2023-10-03 Huawei Technologies Co., Ltd. Apparatus and method for providing one time programmable memory features in a hypervisor of a computing device
US11036887B2 (en) * 2018-12-11 2021-06-15 Micron Technology, Inc. Memory data security
CN112804003A (zh) * 2021-02-19 2021-05-14 上海剑桥科技股份有限公司 一种基于光模块通信的存储方法、系统及终端
CN116257171A (zh) * 2021-12-10 2023-06-13 北京字跳网络技术有限公司 信息写入及读取方法、装置、存储介质和服务器
US11797183B1 (en) * 2022-06-27 2023-10-24 Western Digital Technologies, Inc. Host assisted application grouping for efficient utilization of device resources
CN115459974A (zh) * 2022-08-30 2022-12-09 广东省高峰科技有限公司 一种数据缓存方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488583A (zh) * 2013-09-09 2014-01-01 华中科技大学 一种高性能高可靠的固态盘实现方法
CN104267913A (zh) * 2014-10-20 2015-01-07 北京北亚时代科技有限公司 一种可动态异步调整raid级别的存储方法及存储系统
CN105404469A (zh) * 2015-10-22 2016-03-16 浙江宇视科技有限公司 一种视频数据的存储方法和系统
US20160188211A1 (en) * 2014-12-30 2016-06-30 International Business Machines Corporation Optimizing thin provisioning in a data storage system through selective use of multiple grain sizes
CN106845289A (zh) * 2015-12-07 2017-06-13 国民技术股份有限公司 一种安全芯片及其非易失性存储控制装置、方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9632870B2 (en) * 2007-03-29 2017-04-25 Violin Memory, Inc. Memory system with multiple striping of raid groups and method for performing the same
US8775868B2 (en) * 2010-09-28 2014-07-08 Pure Storage, Inc. Adaptive RAID for an SSD environment
US9348696B2 (en) * 2010-10-01 2016-05-24 Pure Storage, Inc. Distributed multi-level protection in a raid array based storage system
US9251154B2 (en) * 2013-11-15 2016-02-02 International Business Machines Corporation Priority based reliability mechanism for archived data
JPWO2018138813A1 (ja) * 2017-01-25 2019-06-27 株式会社日立製作所 計算機システム
KR20180130140A (ko) * 2017-05-29 2018-12-07 에스케이하이닉스 주식회사 데이터 처리 시스템 및 데이터 처리 방법
US11748196B2 (en) * 2018-06-29 2023-09-05 International Business Machines Corporation Adaptive parity rotation for redundant arrays of independent disks
US10761738B2 (en) * 2018-07-13 2020-09-01 Seagate Technology Llc Raid performance by offloading tasks to expanders
CN112513804B (zh) 2018-07-26 2022-08-19 华为技术有限公司 一种数据处理方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488583A (zh) * 2013-09-09 2014-01-01 华中科技大学 一种高性能高可靠的固态盘实现方法
CN104267913A (zh) * 2014-10-20 2015-01-07 北京北亚时代科技有限公司 一种可动态异步调整raid级别的存储方法及存储系统
US20160188211A1 (en) * 2014-12-30 2016-06-30 International Business Machines Corporation Optimizing thin provisioning in a data storage system through selective use of multiple grain sizes
CN105404469A (zh) * 2015-10-22 2016-03-16 浙江宇视科技有限公司 一种视频数据的存储方法和系统
CN106845289A (zh) * 2015-12-07 2017-06-13 国民技术股份有限公司 一种安全芯片及其非易失性存储控制装置、方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112513804B (zh) * 2018-07-26 2022-08-19 华为技术有限公司 一种数据处理方法及装置
US11593000B2 (en) 2018-07-26 2023-02-28 Huawei Technologies Co., Ltd. Data processing method and apparatus
CN114415961A (zh) * 2022-01-21 2022-04-29 珠海奔图电子有限公司 Nand flash存储器的坏块处理方法、电子设备及存储介质
CN114415961B (zh) * 2022-01-21 2023-10-27 珠海奔图电子有限公司 Nand flash存储器的坏块处理方法、电子设备及存储介质

Also Published As

Publication number Publication date
US20210303181A1 (en) 2021-09-30
CN112513804B (zh) 2022-08-19
US11593000B2 (en) 2023-02-28
WO2020019267A1 (zh) 2020-01-30

Similar Documents

Publication Publication Date Title
CN112513804B (zh) 一种数据处理方法及装置
EP3800554B1 (en) Storage system managing metadata, host system controlling storage system, and storage system operating method
US11281601B2 (en) Multi-device storage system with hosted services on peer storage devices
CN111373362B (zh) 具有分布式读取/写入处理的多设备存储系统
US10860508B2 (en) Offloaded disaggregated storage architecture
CN107111535B (zh) 存储系统中的加速数据恢复
US9910748B2 (en) Rebuilding process for storage array
US8819338B2 (en) Storage system and storage apparatus
CN111433746A (zh) 使用故障存储设备的重建助手
US10146435B2 (en) Storage system and data write method
US8601347B1 (en) Flash memory device and storage control method
US10768838B2 (en) Storage apparatus and distributed storage system
US10108359B2 (en) Method and system for efficient cache buffering in a system having parity arms to enable hardware acceleration
US11288183B2 (en) Operating method of memory system and host recovering data with write error
CN103534688A (zh) 数据恢复方法、存储设备和存储系统
US10282116B2 (en) Method and system for hardware accelerated cache flush
KR20220103378A (ko) 메모리 시스템에 저장된 데이터를 처리하는 장치 및 방법
CN110737395B (zh) I/o管理方法、电子设备和计算机可读存储介质
KR20210131058A (ko) 메모리 시스템 내 데이터를 보호하는 장치 및 방법
KR20220049230A (ko) 메모리 시스템에서 비휘발성 메모리 장치 내 오류를 확인하는 장치 및 방법
US11663080B1 (en) Techniques for performing live rebuild in storage systems that operate a direct write mode

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant