CN110546620A - 数据处理方法、存储系统和交换设备 - Google Patents

数据处理方法、存储系统和交换设备 Download PDF

Info

Publication number
CN110546620A
CN110546620A CN201780089594.XA CN201780089594A CN110546620A CN 110546620 A CN110546620 A CN 110546620A CN 201780089594 A CN201780089594 A CN 201780089594A CN 110546620 A CN110546620 A CN 110546620A
Authority
CN
China
Prior art keywords
osd
identifier
offset
network
packet
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780089594.XA
Other languages
English (en)
Other versions
CN110546620B (zh
Inventor
许慧锋
郭海涛
严春宝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202210544122.1A priority Critical patent/CN114880256A/zh
Publication of CN110546620A publication Critical patent/CN110546620A/zh
Application granted granted Critical
Publication of CN110546620B publication Critical patent/CN110546620B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/10—Program control for peripheral devices
    • G06F13/102—Program control for peripheral devices where the programme performs an interfacing function, e.g. device driver
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0662—Virtualisation aspects
    • G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/74—Address processing for routing
    • H04L45/745—Address table lookup; Address filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00—Packet switching elements
    • H04L49/35—Switches specially adapted for specific applications
    • H04L49/356—Switches specially adapted for specific applications for storage area networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0635—Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Stored Programmes (AREA)

Abstract

一种数据处理方法、存储系统和交换设备(300)，存储系统包括相互连接的计算节点(100)和交换设备(300)，计算节点(100)向交换设备(300)发送第一网络报文，该第一网络报文携带有资源标识、第一偏移量和输入输出IO命令(501)，交换设备(300)根据第一偏移量和对象存储设备OSD的大小产生第二偏移量，根据资源标识和第一偏移量获取待进行IO操作的第一OSD所在的第一存储节点(200)的第一网络地址以及第一OSD的标识(502)，并产生第二网络报文并将第二网络报文发送至第一存储节点(200)(503)。可减轻计算节点(100)的计算量，提高计算节点(100)运行的效率。

Description

PCT国内申请，说明书已公开。

Claims (47)

  1. PCT国内申请，权利要求书已公开。
CN201780089594.XA 2017-04-14 2017-04-14 数据处理方法、存储系统和交换设备 Active CN110546620B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210544122.1A CN114880256A (zh) 2017-04-14 2017-04-14 数据处理方法、存储系统和交换设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/080655 WO2018188089A1 (zh) 2017-04-14 2017-04-14 数据处理方法、存储系统和交换设备

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202210544122.1A Division CN114880256A (zh) 2017-04-14 2017-04-14 数据处理方法、存储系统和交换设备

Publications (2)

Publication Number Publication Date
CN110546620A true CN110546620A (zh) 2019-12-06
CN110546620B CN110546620B (zh) 2022-05-17

Family

ID=63793026

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202210544122.1A Pending CN114880256A (zh) 2017-04-14 2017-04-14 数据处理方法、存储系统和交换设备
CN201780089594.XA Active CN110546620B (zh) 2017-04-14 2017-04-14 数据处理方法、存储系统和交换设备

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202210544122.1A Pending CN114880256A (zh) 2017-04-14 2017-04-14 数据处理方法、存储系统和交换设备

Country Status (5)

Country Link
US (1) US10728335B2 (zh)
EP (1) EP3474146B1 (zh)
JP (1) JP6724252B2 (zh)
CN (2) CN114880256A (zh)
WO (1) WO2018188089A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113472688A (zh) * 2020-03-30 2021-10-01 瑞昱半导体股份有限公司 应用在网络装置中的电路及网络装置的操作方法
CN114356232A (zh) * 2021-12-30 2022-04-15 西北工业大学 数据读写方法和装置

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111276110B (zh) * 2018-12-04 2021-10-19 杭州海康威视数字技术股份有限公司 一种字符显示方法、装置及电子设备
WO2021120141A1 (en) * 2019-12-20 2021-06-24 Intel Corporation Asset caching in cloud rendering computing architectures
CN111142801B (zh) * 2019-12-26 2021-05-04 星辰天合（北京）数据科技有限公司 分布式存储系统网络亚健康检测方法及装置
CN111857577B (zh) * 2020-06-29 2022-04-26 烽火通信科技股份有限公司 一种分布式存储系统下物理硬盘的管理方法与装置
CN115426322B (zh) * 2022-08-23 2023-09-19 绿盟科技集团股份有限公司 一种虚拟存储的方法及装置

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050204026A1 (en) * 2004-03-12 2005-09-15 David Hoerl Switchless KVM network with wireless technology
US20120284431A1 (en) * 2011-05-05 2012-11-08 Hitachi, Ltd. Method and apparatus of tier storage management awareness networking
US20140181239A1 (en) * 2009-10-29 2014-06-26 Netapp, Inc. Mapping of logical start addresses to physical start addresses in a system having misalignment between logical and physical data blocks
US20150237402A1 (en) * 2012-09-21 2015-08-20 Lg Electronics Inc. Image display apparatus, server and method for operating the same
CN105391771A (zh) * 2015-10-16 2016-03-09 张陵 一种面向多租户的云网络架构
WO2016054818A1 (zh) * 2014-10-11 2016-04-14 华为技术有限公司 数据处理方法和装置
WO2016101283A1 (zh) * 2014-12-27 2016-06-30 华为技术有限公司 一种数据处理方法装置及系统
CN105900518A (zh) * 2013-08-27 2016-08-24 华为技术有限公司 用于移动网络功能虚拟化的系统及方法

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7382776B1 (en) * 2003-04-15 2008-06-03 Brocade Communication Systems, Inc. Performing block storage virtualization at a switch
JP2004334481A (ja) 2003-05-07 2004-11-25 Fujitsu Ltd 仮想化情報管理装置
US7228320B2 (en) * 2004-11-17 2007-06-05 Hitachi, Ltd. System and method for creating an object-level snapshot in a storage system
US7747836B2 (en) * 2005-03-08 2010-06-29 Netapp, Inc. Integrated storage virtualization and switch system
US7609649B1 (en) * 2005-04-26 2009-10-27 Cisco Technology, Inc. Methods and apparatus for improving network based virtualization performance
US7366808B2 (en) * 2005-11-23 2008-04-29 Hitachi, Ltd. System, method and apparatus for multiple-protocol-accessible OSD storage subsystem
TWI307026B (en) 2005-12-30 2009-03-01 Ind Tech Res Inst System and method for storage management
US7979652B1 (en) * 2007-12-20 2011-07-12 Amazon Technologies, Inc. System and method for M-synchronous replication
JP5537732B2 (ja) 2010-08-11 2014-07-02 株式会社日立製作所 ストレージシステム
US8650359B2 (en) * 2011-08-26 2014-02-11 Vmware, Inc. Computer system accessing object storage system
CN105786414A (zh) * 2016-03-24 2016-07-20 天津书生云科技有限公司 存储系统、存储系统的访问方法和存储系统的访问装置
US9756128B2 (en) * 2013-04-17 2017-09-05 Apeiron Data Systems Switched direct attached shared storage architecture
CN103986602B (zh) * 2014-05-16 2017-12-12 华为技术有限公司 一种启动操作系统的方法、相关设备和系统
KR101996708B1 (ko) * 2014-09-15 2019-07-04 후아웨이 테크놀러지 컴퍼니 리미티드 기입 데이터 요청 처리 방법과 저장소 어레이
SG11201703220SA (en) * 2014-11-06 2017-05-30 Huawei Tech Co Ltd Distributed storage and replication system and method
US9836229B2 (en) * 2014-11-18 2017-12-05 Netapp, Inc. N-way merge technique for updating volume metadata in a storage I/O stack
CN105704098B (zh) * 2014-11-26 2019-03-01 杭州华为数字技术有限公司 一种虚拟化网络的数据传输方法，节点控制器及系统
CN105830059B (zh) * 2014-11-28 2019-09-27 华为技术有限公司 文件访问方法、装置及存储设备
CN107844270A (zh) * 2014-12-31 2018-03-27 华为技术有限公司 一种存储阵列系统及数据写请求处理方法
CN105138281B (zh) * 2015-08-05 2018-12-07 华为技术有限公司 一种物理磁盘的共享方法及装置
WO2017046864A1 (ja) 2015-09-15 2017-03-23 株式会社日立製作所 ストレージシステム、計算機システム、およびストレージシステムの制御方法
CN105516263B (zh) * 2015-11-28 2019-02-01 华为技术有限公司 存储系统中数据分发方法、装置、计算节点及存储系统
CN105657081B (zh) * 2016-04-07 2019-01-18 华为技术有限公司 提供dhcp服务的方法、装置及系统
CN106406758B (zh) * 2016-09-05 2019-06-18 华为技术有限公司 一种基于分布式存储系统的数据处理方法及存储设备

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050204026A1 (en) * 2004-03-12 2005-09-15 David Hoerl Switchless KVM network with wireless technology
US20140181239A1 (en) * 2009-10-29 2014-06-26 Netapp, Inc. Mapping of logical start addresses to physical start addresses in a system having misalignment between logical and physical data blocks
US20120284431A1 (en) * 2011-05-05 2012-11-08 Hitachi, Ltd. Method and apparatus of tier storage management awareness networking
US20150237402A1 (en) * 2012-09-21 2015-08-20 Lg Electronics Inc. Image display apparatus, server and method for operating the same
CN105900518A (zh) * 2013-08-27 2016-08-24 华为技术有限公司 用于移动网络功能虚拟化的系统及方法
WO2016054818A1 (zh) * 2014-10-11 2016-04-14 华为技术有限公司 数据处理方法和装置
WO2016101283A1 (zh) * 2014-12-27 2016-06-30 华为技术有限公司 一种数据处理方法装置及系统
CN105391771A (zh) * 2015-10-16 2016-03-09 张陵 一种面向多租户的云网络架构

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113472688A (zh) * 2020-03-30 2021-10-01 瑞昱半导体股份有限公司 应用在网络装置中的电路及网络装置的操作方法
CN113472688B (zh) * 2020-03-30 2023-10-20 瑞昱半导体股份有限公司 应用在网络装置中的电路及网络装置的操作方法
CN114356232A (zh) * 2021-12-30 2022-04-15 西北工业大学 数据读写方法和装置
CN114356232B (zh) * 2021-12-30 2024-04-09 西北工业大学 数据读写方法和装置

Also Published As

Publication number Publication date
JP6724252B2 (ja) 2020-07-15
WO2018188089A1 (zh) 2018-10-18
US20190222648A1 (en) 2019-07-18
US10728335B2 (en) 2020-07-28
JP2019531563A (ja) 2019-10-31
EP3474146A4 (en) 2019-07-24
EP3474146B1 (en) 2022-02-23
CN114880256A (zh) 2022-08-09
CN110546620B (zh) 2022-05-17
EP3474146A1 (en) 2019-04-24

Similar Documents

Publication Publication Date Title
CN110546620B (zh) 数据处理方法、存储系统和交换设备
CN107508795B (zh) 跨容器集群的访问处理装置及方法
WO2016054818A1 (zh) 数据处理方法和装置
EP4318251A1 (en) Data access system and method, and device and network card
CN111314450B (zh) 数据的传输方法、装置、电子设备和计算机存储介质
CN110798541B (zh) 接口共享、报文转发方法、装置、电子设备及存储介质
CN111327651A (zh) 资源下载方法、装置、边缘节点及存储介质
US20190114076A1 (en) Method and Apparatus for Storing Data in Distributed Block Storage System, and Computer Readable Storage Medium
CN109088957B (zh) Nat规则管理的方法、装置和设备
CN106063226A (zh) 数据处理方法和装置
WO2016101856A1 (zh) 数据访问方法及装置
CN116032930A (zh) 网络存储方法、存储系统、数据处理单元及计算机系统
CN111600833B (zh) 网络操作系统及报文转发方法
CN102710529A (zh) 基于虚拟设备的报文转发方法和设备
CN109445988B (zh) 异构容灾方法、装置、系统、服务器和容灾平台
IL272881B2 (en) Method and device for wireless communication
JP2022525205A (ja) 異常ホストのモニタニング
CN108124285B (zh) 一种报文传输方法和装置
CN105939278B (zh) 一种流量处理方法及装置
CN115729693A (zh) 数据处理方法、装置、计算机设备及计算机可读存储介质
CN115129779A (zh) 数据库的同步方法、装置及可读介质
CN111865794A (zh) 一种逻辑端口的关联方法、系统、设备及数据传输系统
CN117492933B (zh) 数据交换方法、装置、电子设备及存储介质
CN117014403A (zh) 封包交换机及封包管理方法
CN112764666B (zh) 用于存储管理的方法、设备和计算机程序产品

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant