EP3467635A4 - Procédé et appareil d'écriture et de lecture de données, et grappe de stockage d'objet distribuée - Google Patents

Procédé et appareil d'écriture et de lecture de données, et grappe de stockage d'objet distribuée Download PDF

Info

Publication number
EP3467635A4
EP3467635A4 EP16902961.8A EP16902961A EP3467635A4 EP 3467635 A4 EP3467635 A4 EP 3467635A4 EP 16902961 A EP16902961 A EP 16902961A EP 3467635 A4 EP3467635 A4 EP 3467635A4
Authority
EP
European Patent Office
Prior art keywords
data writing
object storage
reading method
storage cluster
distributed object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP16902961.8A
Other languages
German (de)
English (en)
Other versions
EP3467635A1 (fr
Inventor
Li Cao
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Publication of EP3467635A1 publication Critical patent/EP3467635A1/fr
Publication of EP3467635A4 publication Critical patent/EP3467635A4/fr
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • G06F3/0605Improving or facilitating administration, e.g. storage management by facilitating the interaction with a user or administrator
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • G06F3/068Hybrid storage device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608Saving storage space on storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • G06F3/0619Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/064Management of blocks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • G06F9/5016Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
EP16902961.8A 2016-05-25 2016-11-09 Procédé et appareil d'écriture et de lecture de données, et grappe de stockage d'objet distribuée Ceased EP3467635A4 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610351615.8A CN107436725B (zh) 2016-05-25 2016-05-25 一种数据写、读方法、装置及分布式对象存储集群
PCT/CN2016/105175 WO2017201977A1 (fr) 2016-05-25 2016-11-09 Procédé et appareil d'écriture et de lecture de données, et grappe de stockage d'objet distribuée

Publications (2)

Publication Number Publication Date
EP3467635A1 EP3467635A1 (fr) 2019-04-10
EP3467635A4 true EP3467635A4 (fr) 2019-04-24

Family

ID=60411032

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16902961.8A Ceased EP3467635A4 (fr) 2016-05-25 2016-11-09 Procédé et appareil d'écriture et de lecture de données, et grappe de stockage d'objet distribuée

Country Status (4)

Country Link
US (1) US11216187B2 (fr)
EP (1) EP3467635A4 (fr)
CN (1) CN107436725B (fr)
WO (1) WO2017201977A1 (fr)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110244903B (zh) * 2018-03-09 2021-08-13 杭州海康威视系统技术有限公司 一种数据存储方法及装置
CN110209341B (zh) * 2018-03-23 2022-02-01 腾讯科技(深圳)有限公司 一种数据写入方法、装置和存储设备
CN108646981B (zh) * 2018-04-28 2021-09-03 深圳市茁壮网络股份有限公司 一种数据缓存节点管理方法、数据缓存方法和缓存管理节点
CN108710702A (zh) * 2018-05-25 2018-10-26 吴卓航 一种基于分片重组技术实现数据安全存储的方法
CN109085999B (zh) * 2018-06-15 2022-04-22 华为技术有限公司 数据处理方法及处理系统
CN109508143B (zh) * 2018-08-17 2022-04-22 郑州云海信息技术有限公司 一种数据存储方法及装置
CN109359144A (zh) * 2018-08-24 2019-02-19 中国建设银行股份有限公司 数据存储方法及系统、装置和存储介质
CN109286624B (zh) * 2018-09-27 2021-05-18 北京锐安科技有限公司 一种通讯方法、装置、终端与存储介质
CN111936960B (zh) 2018-12-25 2022-08-19 华为云计算技术有限公司 分布式存储系统中数据存储方法、装置及计算机程序产品
CN110245129B (zh) * 2019-04-23 2022-05-13 平安科技(深圳)有限公司 一种分布式全局数据去重方法和装置
CN110290171A (zh) * 2019-05-15 2019-09-27 陈菡 一种数据管理方法及装置、电子设备
CN110602159A (zh) * 2019-07-30 2019-12-20 广州力挚网络科技有限公司 一种数据处理方法与系统
CN111045598B (zh) * 2019-10-10 2023-08-15 深圳市金泰克半导体有限公司 数据存储方法、装置
CN110730185A (zh) * 2019-10-22 2020-01-24 张瑞 一种基于分布式计算的区块链大数据处理方法及系统
CN111026709B (zh) * 2019-12-10 2024-03-12 中盈优创资讯科技有限公司 基于集群访问的数据处理方法及装置
WO2021189311A1 (fr) * 2020-03-25 2021-09-30 Beijing Didi Infinity Technology And Development Co., Ltd. Opération de lecture dans un système de stockage d'objets à l'aide d'une métastructure améliorée
CN112130999B (zh) * 2020-09-23 2024-02-13 南方电网科学研究院有限责任公司 一种基于边缘计算的电力异构数据处理方法
CN112596952B (zh) * 2020-12-25 2022-07-12 苏州浪潮智能科技有限公司 一种集群数据处理方法、系统、设备以及介质
CN112711382B (zh) * 2020-12-31 2024-04-26 百果园技术(新加坡)有限公司 基于分布式系统的数据存储方法、装置和存储节点
CN113126920A (zh) * 2021-04-02 2021-07-16 深圳市杉岩数据技术有限公司 对象存储批量读取及写入方法、客户端、存储网关及介质
CN113238716A (zh) * 2021-06-08 2021-08-10 北京金山云网络技术有限公司 数据访问请求的处理方法、装置和电子设备
CN114936010B (zh) * 2022-07-20 2022-12-27 阿里巴巴(中国)有限公司 数据处理方法、装置、设备及介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110219106A1 (en) * 2010-03-05 2011-09-08 Solidfire, Inc. Data Deletion in a Distributed Data Storage System
US20110225209A1 (en) * 2010-03-12 2011-09-15 Cleversafe, Inc. Dispersed storage network file system directory
US20130086317A1 (en) * 2011-09-30 2013-04-04 Hitachi, Ltd. Passing hint of page allocation of thin provisioning with multiple virtual volumes fit to parallel data access
WO2016053198A1 (fr) * 2014-10-03 2016-04-07 Agency For Science, Technology And Research Système de mémorisation hybride actif distribué

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030233455A1 (en) * 2002-06-14 2003-12-18 Mike Leber Distributed file sharing system
CN100579016C (zh) * 2006-01-24 2010-01-06 华为技术有限公司 一种网络数据的分布式存储下载系统、设备及方法
CN101504670A (zh) * 2009-03-04 2009-08-12 成都市华为赛门铁克科技有限公司 数据操作方法、系统、客户端和数据服务器
CN102004797A (zh) * 2010-12-24 2011-04-06 深圳市同洲电子股份有限公司 一种数据处理方法、装置和系统
CN103942112B (zh) * 2013-01-22 2018-06-15 深圳市腾讯计算机系统有限公司 磁盘容错方法、装置及系统
WO2014205667A1 (fr) * 2013-06-26 2014-12-31 华为技术有限公司 Procédé de création de volume réseau, procédé de stockage de données, dispositif de stockage et système de stockage
CN103955528B (zh) 2014-05-09 2015-09-23 北京华信安天信息科技有限公司 写入文件数据的方法、读取文件数据的方法以及装置
CN105260136B (zh) * 2015-09-24 2019-04-05 北京百度网讯科技有限公司 数据读写方法及分布式存储系统
CN105242881B (zh) * 2015-10-12 2018-02-16 创新科软件技术(深圳)有限公司 分布式存储系统及其数据读写方法
CN105468300B (zh) * 2015-11-20 2018-08-14 华为技术有限公司 Ip硬盘的管理方法和装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110219106A1 (en) * 2010-03-05 2011-09-08 Solidfire, Inc. Data Deletion in a Distributed Data Storage System
US20110225209A1 (en) * 2010-03-12 2011-09-15 Cleversafe, Inc. Dispersed storage network file system directory
US20130086317A1 (en) * 2011-09-30 2013-04-04 Hitachi, Ltd. Passing hint of page allocation of thin provisioning with multiple virtual volumes fit to parallel data access
WO2016053198A1 (fr) * 2014-10-03 2016-04-07 Agency For Science, Technology And Research Système de mémorisation hybride actif distribué

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2017201977A1 *

Also Published As

Publication number Publication date
CN107436725B (zh) 2019-12-20
EP3467635A1 (fr) 2019-04-10
WO2017201977A1 (fr) 2017-11-30
US20190146681A1 (en) 2019-05-16
CN107436725A (zh) 2017-12-05
US11216187B2 (en) 2022-01-04

Similar Documents

Publication Publication Date Title
EP3467635A4 (fr) Procédé et appareil d'écriture et de lecture de données, et grappe de stockage d'objet distribuée
EP3418877A4 (fr) Procédé et appareil d'écriture et de lecture de données, et système de stockage en nuage
EP3686728A4 (fr) Procédé d'écriture de données et dispositif de stockage
EP3462326A4 (fr) Dispositif nvme et procédés de lecture et d'écriture de données nvme
EP3568407A4 (fr) Procédés et systèmes de stockage de données d'adn
EP3694990A4 (fr) Procédés, appareil et systèmes pour le stockage de données d'adn sans amplification
EP3567476A4 (fr) Procédé et appareil de traitement de données d'application, et support d'enregistrement
EP3273334A4 (fr) Procédé de traitement d'informations, terminal et support d'informations pour ordinateur
EP3267300A4 (fr) Procédé et terminal de traitement d'informations, et support de stockage informatique
EP3278850A4 (fr) Terminal et procédé de traitement d'informations, et support de stockage informatique
EP3345664A4 (fr) Procédé de traitement d'informations, terminal et support de stockage informatique
EP3285156A4 (fr) Procédé et terminal de traitement d'informations, et support de stockage informatique
EP3483737A4 (fr) Procédé et appareil de traitement d'informations d'objet et support d'informations
EP3511828A4 (fr) Procédé de traitement d'informations, terminal et support de stockage informatique
EP3698275A4 (fr) Système, appareil, procédé de traitement de données et support d'informations
EP3723379A4 (fr) Procédé de traitement de données multimédia, dispositif informatique et support de stockage
EP3637280A4 (fr) Procédé et dispositif de stockage de données, et support de stockage
EP3471044A4 (fr) Procédé de traitement d'informations, serveur et support d'informations non volatil
EP3690630A4 (fr) Procédé et appareil de lecture et d'écriture de données, et serveur de stockage
EP3217248A4 (fr) Procédé et dispositif d'écriture de données, et système
EP3316149A4 (fr) Procédé et appareil d'acquisition d'informations, dispositif et support de stockage informatique
EP3306486A4 (fr) Procédé, appareil et dispositif de traitement d'informations distribuées sélectivement, et support de stockage informatique non volatil
EP3684105A4 (fr) Dispositif et procédé de traitement de données, et support de stockage informatique
EP3469488A4 (fr) Système de stockage de données et son procédé de mise en uvre
EP3432527A4 (fr) Procédé et dispositif de traitement d'informations, et support de stockage informatique

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20181212

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20190326

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/06 20060101AFI20190320BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20200306

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20211125