WO2020029602A1 - Time delay detection method and apparatus, and system - Google Patents

Time delay detection method and apparatus, and system Download PDF

Info

Publication number
WO2020029602A1
WO2020029602A1 PCT/CN2019/082363 CN2019082363W WO2020029602A1 WO 2020029602 A1 WO2020029602 A1 WO 2020029602A1 CN 2019082363 W CN2019082363 W CN 2019082363W WO 2020029602 A1 WO2020029602 A1 WO 2020029602A1
Authority
WO
WIPO (PCT)
Prior art keywords
time
storage device
response message
storage
message
Prior art date
Application number
PCT/CN2019/082363
Other languages
French (fr)
Chinese (zh)
Inventor
杨俊涛
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2020029602A1 publication Critical patent/WO2020029602A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852Delays
    • H04L43/0864Round trip delays

Definitions

  • the present application relates to the field of storage technology, and in particular, to a method, a device, and a system for detecting a delay.
  • the storage array used for data storage is composed of a large number of storage units, and each storage unit can store 1-bit binary data (that is, 0 or 1).
  • a storage array works as a single disk by combining multiple disks into an array. When accessing data, the related disks in the storage array are operated together, which greatly reduces the data access time and improves the disk space utilization.
  • Storage area network is a Fibre Channel (FC) technology that connects storage arrays and hosts through FC switches to establish an area network dedicated to data storage.
  • FC Fibre Channel
  • data storage systems can be deployed in the data centers in the two locations, which are called mainframe systems and standby systems.
  • the host system and the standby system run online at the same time and back up each other to ensure data consistency.
  • This kind of data backup method is called Dual-Live Disaster Tolerance (DLDT) technology.
  • DLDT Dual-Live Disaster Tolerance
  • the transmission delay of the transmission link can be used to determine the priority path of data transmission, which will directly affect the performance of the storage system and the customer experience.
  • the storage device A and the storage device B in the two data storage systems detect the link delay between the two data storage systems by testing the write IO service; specific operations include:
  • Step 1 The business application logic on storage device A sends an IO write request to storage device B via the protocol stack and chip of storage device A; the above IO write request is sent to the storage via the chip and protocol stack on storage device B Business application logic on device B;
  • Step 2 The storage device B sends an XFER_RDY command to the storage device A, and notifies the storage device A that a buffer (ie, a buffer) for receiving data on the storage device B is ready;
  • Step 3 The chip of the storage device A starts a Direct Memory Access (DMA) operation after receiving the XFER_RDY command, and sends data to be transmitted to the storage device B through a transmission link;
  • DMA Direct Memory Access
  • Step 4 After the business application logic of storage device B receives the data, it sends an IO completion response to the business application logic of storage device A.
  • Storage device A calculates the time it takes for the application logic on storage device A to send an IO write request to receiving the IO completion response as the link transmission delay between storage device A and storage device B.
  • An embodiment of the present application provides a method for detecting a delay, which is used to improve overall system performance.
  • the method includes:
  • the first storage device and the second storage device are connected through a storage area network, and the method includes:
  • the first storage device calculates a link transmission delay of one bidirectional transmission between the first storage device and the second storage device according to the first time and the fourth time.
  • An embodiment of the present application further provides a device for detecting a delay.
  • the device is a storage device and is connected to a second storage device through a storage area network.
  • the device includes:
  • An obtaining unit configured to obtain a first time when a chip on the device sends a test message and a fourth time when a response message is received; wherein the response message is the second storage device responding to the test message Sent by text;
  • a calculation unit is configured to calculate a link transmission delay in one bidirectional transmission between the apparatus and the second storage device according to the first time and the fourth time.
  • an embodiment of the present application further provides a storage system.
  • the storage system includes at least a first storage device and a second storage device. The first storage device and the second storage device are connected through a storage area network. ;
  • the first storage device is configured to obtain a first time when a chip on the first storage device sends a test message and a fourth time when a response message is received; wherein the response message is the second storage device Sent in response to the test message;
  • the first storage device is further configured to calculate a link transmission delay in one bidirectional transmission between the first storage device and the second storage device according to the first time and the fourth time.
  • the apparatus for detecting time delay provided in another embodiment of the present application includes at least one processor and at least one memory, the at least one memory is configured to store a computer program, and the at least one processor is configured to call the computer program to execute the embodiment. The method described.
  • An embodiment of the present application further provides a computer storage medium, where computer software instructions are stored on the computer storage medium, and after the computer software instructions run, the computer executes the method described in the embodiment.
  • the time when a chip on a storage device sends or receives a message can accurately obtain the link transmission delay of a two-way transmission between the storage devices without being affected by the data processing overhead of the application program. And the impact of the processing delay of the protocol stack.
  • FIG. 1 is a system architecture diagram according to an embodiment of the present application
  • FIG. 2 is a simplified schematic diagram of a system architecture according to an embodiment of the present application.
  • FIG. 3 is a schematic flowchart of a first embodiment of the present application.
  • FIG. 4 is a schematic diagram of a payload of an Echo message in the first embodiment of the present application.
  • FIG. 5 is a schematic diagram of a payload of an Echo message in a second embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of a device for detecting delay according to an embodiment of the present application.
  • the “multiple” referred to in the embodiments of the present application means two or more than two; the terms “first”, “second”, “third”, “fourth” and the like in this application , For the purpose of distinguishing descriptions only, and should not be interpreted as indicating or implying relative importance, nor as indicating or implying order.
  • FIG. 1 The embodiment of the present application relates to a system architecture as shown in FIG. 1, which includes a storage system A and a storage system B.
  • the storage system A and the storage system B are connected through a backbone network.
  • Storage system A includes storage device A and storage area network SAN-A;
  • storage system B includes storage device B and storage area network SAN-B.
  • Storage device A and storage device B can be composed of storage arrays; storage area networks SAN-A and SAN-B can use mesh channel technology and connect storage devices and server hosts through FC switches.
  • the foregoing storage system A and storage system B may be data centers deployed in two different cities, and perform data synchronization operations through a SAN network to implement application scenarios such as active-active disaster recovery.
  • the technical solutions in the embodiments of the present application can also be applied to other network deployment scenarios with severe transmission delay requirements.
  • Both storage device A and storage device B in FIG. 2 may include two components, which are a protocol stack and a chip, respectively.
  • the protocol stack may specifically include a small computer system interface (SCSI) protocol stack and an FC protocol stack, which are important components of a storage system. Both the SCSI protocol stack and the FC protocol stack can be implemented by software.
  • SCSI small computer system interface
  • FC protocol stack which are important components of a storage system. Both the SCSI protocol stack and the FC protocol stack can be implemented by software.
  • the SCSI protocol stack is responsible for the assembly and analysis of SCSI commands, including the processing of SCSI CDB / LBA information and other SCSI information.
  • the FC protocol stack is responsible for the processing of FC2 and FC4 related information, including assembling the payload and address resolution conversion in the FCP command; the FC protocol stack is also responsible for converting the FCP command into an IOB command recognized by the FC chip, and reporting the IOB to the FC chip The commands are converted into FCP commands and submitted to the SCSI protocol stack.
  • the FC chip is a Fibre Channel controller chip capable of handling FC protocols (including the FC0, FC1, FC2, FC3 and FC4 layers).
  • FC protocols including the FC0, FC1, FC2, FC3 and FC4 layers.
  • the FC chip can handle the signal transmission and signal reception of the FC link, can organize and analyze the FC frame structure, and can also perform the operations of FC frame transmission and FC frame reception.
  • This embodiment of the present application only uses an FC chip supporting the FC protocol as an example.
  • the technical solution of the embodiment of the present application is also applicable to a chip supporting a network offload protocol such as IOE (ISCSI Offload Engine) or TOE (TCP Offload Engine).
  • IOE ISCSI Offload Engine
  • TOE TCP Offload Engine
  • network offloading uses an off-chip chip to independently implement the Ethernet communication protocol that originally required storage resources and computing resources; the network offloading protocol is an Ethernet communication protocol implemented on the independent chip, such as The FC protocol, IOE protocol or TOE protocol described above.
  • the network offload protocol is a transport layer protocol and can be applied to storage application scenarios.
  • the network offloading protocol message corresponding to the network offloading protocol may encapsulate the SCSI protocol message.
  • FC network may further include one or more storage area networks, and may further include a backbone network.
  • FIG. 3 it is a schematic diagram of a detailed scheme for detecting a link transmission delay according to the first embodiment of the present application.
  • the protocol stack on the storage device A generates an ECHO command, and sets a tag at a specific position of the payload information of the ECHO command to instruct the ECHO command to detect a link transmission delay;
  • the ECHO command is a non-IO command, and is a FC-ELS (Fibre Channel Extended Link Services) format defined using the FC protocol.
  • FC-ELS Fibre Channel Extended Link Services
  • the content of the payload in the ECHO command can be defined by the user.
  • the protocol stack on the storage device A constructs an input / output block (Input / Output Block, referred to as IOB) recognized by the chip on the storage device A, and sends the IOB to the chip's first-in-first-out FIFO) queue.
  • IOB input / output block
  • the IOB is a data block structure used for interaction between the protocol stack software and the chip; the IOB carries a piece of data with a fixed format and a customizable content.
  • the chip on the storage device A fetches the IOB from the FIFO queue, and obtains the payload information of the ECHO command.
  • the tag of the payload information determines that the ECHO command is a command for detecting a link transmission delay.
  • the chip on the storage device A organizes frame header and frame tail information of the ECHO command message according to the ECHO command, and writes the current timing information T1 into the payload. After performing a Cyclic Redundancy Check (CRC) operation, a chip on the storage device A sends the ECHO command message to the storage device B.
  • CRC Cyclic Redundancy Check
  • the protocol stack of the storage device A generates an ECHO command, and the ECHO command is transmitted to the chip of the storage device A using an IOB to generate a corresponding ECHO command message and sent to the storage device B.
  • the ECHO command message can be regarded as a data message that the chip encapsulates the ECHO command generated by the protocol stack using the FC-ELS format and can be transmitted on the SAN network.
  • the ECHO response message can be regarded as a data message encapsulated by the chip to the protocol stack using the FC-ELS format and can be transmitted on the SAN network.
  • the ECHO command message and ECHO response message here are both ECHO messages.
  • the chip on the storage device B receives the ECHO command message, and after it determines that it is a command message for detecting a link transmission delay through the tag of the payload, writes the current timing information T2 to the ECHO command message. Payload.
  • the chip on the storage device B processes the ECHO command message, assembles the IOB, and sends the corresponding ECHO command to the protocol stack of the storage device B.
  • the protocol stack on the storage device B generates and delivers an ECHO response in response to the above-mentioned ECHO command. Specifically, the protocol stack on the storage device B organizes an ECHO response, and the payload of the ECHO response is the same as the payload of the ECHO command received by the storage device B.
  • the protocol stack on the storage device B constructs an IOB recognizable by the chip on the storage device B, and sends the IOB to the chip's FIFO queue.
  • the chip on the storage device B After the chip on the storage device B removes the IOB from the FIFO queue, and obtains the payload information of the ECHO response, the tag of the payload information determines that it is the response to the command for detecting the link transmission delay, and writes the current timing information T3 Into the payload. After performing CRC processing, the chip on storage device B sends the generated ECHO response packet to storage device A.
  • the current timing information T4 is written to the ECHO response. The payload of the message.
  • the chip on the storage device A assembles the IOB and sends the ECHO response to the protocol stack of the storage device A.
  • the protocol stack on storage device A After receiving the ECHO response, the protocol stack on storage device A obtains T, T2, T3, and T4 from its payload, and is used to calculate the link transmission delay of a two-way transmission between storage device A and storage device B. DT.
  • storage device A can calculate DT by the following formula or its algorithm:
  • FIG. 4 it is a schematic diagram of a payload in an ECHO message according to the first embodiment of the present application. Different fields are defined in the position areas corresponding to different offsets of the payload of the ECHO message.
  • the payload of the ECHO message may specifically include the following:
  • Offset0 represents the field local magic version tag, which is used to identify that the format of the payload message is a custom format.
  • the sender of the ECHO command message needs to fill in the timing information required in the echo cmd send time and echo response time fields;
  • Offset stands for the field remote magic version tag, used to identify whether the remote end supports the command; the initial value of this field can be set to the remote end does not support the command, if the remote end supports, the remote end after receiving the command Fill in the corresponding identification as agreed; if the remote end supports the command, the sender of the ECHO response message needs to fill in the timing information required in the echo cmd received time and echo response time fields;
  • Offset + 1 represents the echo cmd time field, which indicates the time when the sender of the ECHO command message sends the ECHO command message, that is, corresponding to T1 in the first embodiment 304 of the application;
  • Offset + 2 represents the echo cmd time field, which indicates the time when the receiver of the ECHO command message received the ECHO command message, that is, corresponding to T2 in the first embodiment 305 of the application;
  • Offset + 3 represents the echo response time field, which indicates the time at which the sender of the ECHO response message sends the ECHO response message, which corresponds to T3 in the first embodiment 309 of this application;
  • Offset + 4 represents the echo response time field, which indicates the time when the receiver of the ECHO response message receives the ECHO response message, that is, corresponding to T4 in the first embodiment 310 of this application;
  • Offset + 5 to 255 Used to indicate other unformatted content in the payload.
  • T1 and 310 in the first embodiment 304 of the above application.
  • Storage device A sends the above T1 and T4 to the protocol stack through the IOB between the chip and the protocol stack, and is used to calculate the link transmission delay DT of a two-way transmission between storage device A and storage device B.
  • FIG. 5 it is a schematic diagram of a payload of an ECHO message according to a second embodiment of the present application.
  • the third embodiment of the present application provides a method for detecting a delay.
  • the method is applied to a storage system connected between a first storage device and a second storage device through a storage area network.
  • the method includes:
  • the first storage device acquires a fourth time when a chip on the first storage device receives a response message, and the response message is sent by the second storage device in response to the test message;
  • the first storage device calculates a link transmission delay of a bidirectional transmission between the first storage device and the second storage device according to the first time and the fourth time.
  • the response message may further include a second time and a third time, where:
  • the second time is the time when the chip of the second storage device receives the test message;
  • the third time is the time when the chip of the second storage device sends a response message;
  • the first storage device may calculate a link transmission delay of one bidirectional transmission between the first storage device and the second storage device according to the first time, the second time, the third time, and the fourth time.
  • the test message in this application may be an ECHO command message, and the response message may be an ECHO response message.
  • the ECHO command message and ECHO response message are both ECHO messages using the FC-ELS protocol. The first to fourth times involved in the embodiments of the present application are further described below.
  • the first time of this application is the time when the chip of the first storage device sends the ECHO command message to the link, that is, corresponding to T1 in the first embodiment 304 of the application, which can be carried in the echo cmd send time field of the ECHO message. in;
  • the second time of the present application is the time when the chip of the second storage device receives the ECHO command message, that is, corresponding to T2 in the first embodiment 305 of the present application, and can be carried in the echo cmd received time field of the ECHO message;
  • the third time of the present application is the time when the chip of the second storage device sends the ECHO response message, that is, corresponding to T3 in the first embodiment 309 of the present application, and can be carried in the echo response time field of the ECHO message;
  • the fourth time of this application is the time when the chip of the first storage device receives the ECHO response message, that is, corresponding to T4 in the above-mentioned first embodiment 310 of the application, and can be carried in the echo response time field of the ECHO message.
  • the first time can be transmitted to the second storage device through the ECHO command message sent by the first storage device, and then the second storage device sends the first time back to the first storage device through the ECHO response message; the second After the storage device obtains the second time and the third time, it writes the second time and the third time into the ECHO response message and sends it to the first storage device; after receiving the ECHO response message, the chip of the first storage device sends Write the ECHO response message at the fourth time and send it to the protocol stack.
  • the time between sending and receiving a message by using a chip on a storage device can accurately obtain the link transmission delay of a two-way transmission between the storage devices without being processed by the application program data.
  • the embodiment of the present application can obtain the time for transmitting messages between the chips on the storage device through a two-way ECHO interaction at one time, without adding an interface, which is simple to implement and has low overhead.
  • the technical solution of the present application can be used to more accurately determine the priority path of data transmission, thereby improving the integrity of the system.
  • the technical solution provided in the embodiments of the present application can also be used in combination with the existing IO model-based delay statistics technology to quickly determine the performance bottleneck of the storage system to determine the load balancing strategy.
  • the technical solutions provided in the embodiments of the present application can also be used to locate the network configuration and link congestion, and the transmission distance of the actual link can be evaluated by detecting the transmission delay.
  • the apparatus 600 is a storage device and is connected to the second storage device through a storage area network.
  • the apparatus 600 may include an obtaining unit 601 and a computing unit 602.
  • the obtaining unit 601 is configured to obtain a first time when a chip on the device sends a test message and a fourth time when a response message is received; wherein the response message is sent by the second storage device in response to the test message;
  • the calculating unit 602 is configured to calculate a link transmission delay in one bidirectional transmission between the device and the second storage device according to the first time and the fourth time.
  • the response message may include a second time and a third time, where the second time is the time when the chip of the second storage device receives the test message, and the third time is the second storage device The time that the chip sends the response message.
  • the calculation unit 602 calculates a link transmission delay of a two-way transmission between the device and the second storage device according to the first time, the second time, the third time, and the fourth time.
  • the second time and the third time may be written into the response message by the second storage device, and the obtaining unit 601 obtains the second time and the third time from the response message.
  • the first time may be that the device writes into the test message, and is written by the second storage device into the response message after receiving the test message;
  • the fourth time may be The chip writes the response message after receiving the response message. Accordingly, the acquiring unit may acquire the first time and the fourth time from the response message.
  • the present application also discloses a storage system.
  • the storage system includes at least a first storage device and a second storage device according to the foregoing embodiments of the present application.
  • the first storage device and the second storage device are connected through a storage area network.
  • Computer-readable media includes computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another.
  • a storage media may be any available media that can be accessed by a computer.
  • computer-readable media may include RAM, ROM, electrically erasable programmable read-only memory (EEPROM), read-only memory (EEPROM), compact disc-read-only memory (CD-ROM) ROM) or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer. Also. Any connection is properly a computer-readable medium.
  • disks and discs include compact discs (CDs), laser discs, optical discs, digital video discs (DVDs), floppy discs, and Blu-ray discs, among which Discs usually reproduce data magnetically, while discs use lasers to reproduce data optically.
  • CDs compact discs
  • DVDs digital video discs
  • floppy discs floppy discs
  • Blu-ray discs among which Discs usually reproduce data magnetically, while discs use lasers to reproduce data optically. The above combination should also be included in the protection scope of the computer-readable medium.

Abstract

In a time delay detection method provided in embodiments of the present application, a first storage device is connected to a second storage device by means of a storage area network. The method comprises: the first storage device obtains a first time when a chip on the first storage device sends a test message; the first storage device obtains a fourth time that the chip on the first storage device receives a response message, the response message being sent by the second storage device in response to the test message; and the first storage device calculates a link transmission time delay of a bi-directional transmission between the first storage device and the second storage device according to the first time and the fourth time. The use of the method in the embodiments of the present application can accurately obtain the link transmission time delay of the bi-directional transmission between the storage devices without being affected by data processing overhead of an application program and the processing time delay of a protocol stack. Further disclosed in the present application are a time delay detection apparatus and a storage system.

Description

检测时延的方法、装置及系统Method, device and system for detecting time delay 技术领域Technical field
本申请涉及存储技术领域,尤其涉及一种检测时延的方法、装置及系统。The present application relates to the field of storage technology, and in particular, to a method, a device, and a system for detecting a delay.
背景技术Background technique
随着大数据、物联网等技术的发展,数据成为了推动相关技术进步的核心要素,因而数据的存储变得非常重要。With the development of technologies such as big data and the Internet of Things, data has become a core element to promote related technological progress, so data storage has become very important.
用于数据存储的存储阵列(Storage array)由大量的存储单元组成,每个存储单元能存放1位二值数据(即0或1)。存储阵列通过将多个磁盘组成一个阵列,当作单一磁盘使用。存取数据时,存储阵列中的相关磁盘一起被操作,大幅降低了数据的存取时间、并提高了磁盘的空间利用率。The storage array used for data storage is composed of a large number of storage units, and each storage unit can store 1-bit binary data (that is, 0 or 1). A storage array works as a single disk by combining multiple disks into an array. When accessing data, the related disks in the storage array are operated together, which greatly reduces the data access time and improves the disk space utilization.
存储区域网络(Storage Area Network,简称SAN)是采用网状通道(Fibre Channel,简称FC)技术,通过FC交换机连接存储阵列和主机,以建立专用于数据存储的区域网络。Storage area network (SAN) is a Fibre Channel (FC) technology that connects storage arrays and hosts through FC switches to establish an area network dedicated to data storage.
为提供数据的可靠性,可以在两地数据中心分别部署数据存储系统,分别称为主机系统和备机系统。主机系统和备机系统同时在线运行、互为备份以保证数据的一致性。这种数据备份方式称为双活容灾(Dual Live Disaster Tolerance,即DLDT)技术。在双活容灾场景下,任一数据中心发生故障均可以实现数据的零丢失。To provide data reliability, data storage systems can be deployed in the data centers in the two locations, which are called mainframe systems and standby systems. The host system and the standby system run online at the same time and back up each other to ensure data consistency. This kind of data backup method is called Dual-Live Disaster Tolerance (DLDT) technology. In the active-active disaster recovery scenario, any data center failure can achieve zero data loss.
随着SAN网络规模越来越大,主机系统和备机系统所在数据中心之间的距离变得越来越长,两者之间传输数据的时延越来越大。传输链路的传输时延可用来确定数据传输的优先路径,将直接影响存储系统的性能和客户体验。As the size of the SAN network becomes larger and larger, the distance between the host system and the data center where the standby system is located becomes longer and longer, and the time delay for data transmission between the two becomes larger and larger. The transmission delay of the transmission link can be used to determine the priority path of data transmission, which will directly affect the performance of the storage system and the customer experience.
现有技术中,两个数据存储系统中的存储设备A和存储设备B之间通过测试写IO业务来进行检测两个数据存储系统之间的链路时延;具体操作包括:In the prior art, the storage device A and the storage device B in the two data storage systems detect the link delay between the two data storage systems by testing the write IO service; specific operations include:
步骤1:存储设备A上的业务应用逻辑发送IO写请求,经由存储设备A的协议栈和芯片发送到存储设备B;上述IO写请求经过存储设备B上的芯片和协议栈被上送到存储设备B上的业务应用逻辑;Step 1: The business application logic on storage device A sends an IO write request to storage device B via the protocol stack and chip of storage device A; the above IO write request is sent to the storage via the chip and protocol stack on storage device B Business application logic on device B;
步骤2:存储设备B发送XFER_RDY命令到存储设备A,通知存储设备A,存储设备B上用于接收数据的缓存(即Buffer)已准备就绪;Step 2: The storage device B sends an XFER_RDY command to the storage device A, and notifies the storage device A that a buffer (ie, a buffer) for receiving data on the storage device B is ready;
步骤3:存储设备A的芯片接收到XFER_RDY命令后启动直接内存存取(Direct Memory Access,简称DMA)操作,将待传输的数据通过传输链路发送到存储设备B;Step 3: The chip of the storage device A starts a Direct Memory Access (DMA) operation after receiving the XFER_RDY command, and sends data to be transmitted to the storage device B through a transmission link;
步骤4:存储设备B的业务应用逻辑接收到数据后,发送IO完成响应至存储设备A的业务应用逻辑。Step 4: After the business application logic of storage device B receives the data, it sends an IO completion response to the business application logic of storage device A.
存储设备A计算存储设备A上的应用逻辑发送IO写请求至接收到IO完成响应所花的时间,作为存储设备A和存储设备B之间的链路传输时延。Storage device A calculates the time it takes for the application logic on storage device A to send an IO write request to receiving the IO completion response as the link transmission delay between storage device A and storage device B.
现有技术检测时延的方法中,两存储系统之间需要在传输链路上完成双向两次传输才能完成一次IO交互过程,且中间经过了存储系统的业务应用逻辑和协议栈的处理。因此现 有技术方法所获得的时延受应用程序的处理开销比如如系统调度或CPU占用等因素影响;且协议栈的处理也引入时延。因此现有技术方案所获得的传输链路的时延并不准确,用该时延所确定的数据传输的优先路径也不准确,从而导致系统整体性能的降低。In the method for detecting delay in the prior art, two storage systems need to complete two transmissions in both directions on a transmission link to complete an IO interaction process, and the storage system's business application logic and protocol stack are processed in the middle. Therefore, the delay obtained by the existing technical methods is affected by the processing overhead of the application, such as system scheduling or CPU usage, and the processing of the protocol stack also introduces delay. Therefore, the delay of the transmission link obtained by the prior art solution is not accurate, and the priority path of data transmission determined by the delay is also inaccurate, which results in a decrease in overall system performance.
发明内容Summary of the invention
本申请实施例提供一种检测时延的方法,用于提高系统整体性能,所述方法包括:An embodiment of the present application provides a method for detecting a delay, which is used to improve overall system performance. The method includes:
第一存储设备和第二存储设备之间通过存储区域网络连接,所述方法包括:The first storage device and the second storage device are connected through a storage area network, and the method includes:
所述第一存储设备获取所述第一存储设备上的芯片发送测试报文的第一时间;Acquiring, by the first storage device, a first time when a chip on the first storage device sends a test packet;
所述第一存储设备获取所述第一存储设备上的芯片接收到响应报文的第四时间,所述响应报文是所述第二存储设备响应于所述测试报文而发送的;A fourth time when the first storage device obtains a response packet received by a chip on the first storage device, where the response packet is sent by the second storage device in response to the test packet;
所述第一存储设备根据所述第一时间和所述第四时间计算所述第一存储设备和所述第二存储设备之间一次双向传输的链路传输时延。The first storage device calculates a link transmission delay of one bidirectional transmission between the first storage device and the second storage device according to the first time and the fourth time.
本申请实施例还提供一种检测时延的装置,所述装置为一存储设备,并通过存储区域网络与第二存储设备连接,所述装置包括:An embodiment of the present application further provides a device for detecting a delay. The device is a storage device and is connected to a second storage device through a storage area network. The device includes:
获取单元,用于获取所述装置上的芯片发送测试报文的第一时间和接收到响应报文的第四时间;其中所述响应报文是所述第二存储设备响应于所述测试报文而发送的;An obtaining unit, configured to obtain a first time when a chip on the device sends a test message and a fourth time when a response message is received; wherein the response message is the second storage device responding to the test message Sent by text;
计算单元,用于根据所述第一时间和所述第四时间计算所述装置和所述第二存储设备之间一次双向传输的链路传输时延。A calculation unit is configured to calculate a link transmission delay in one bidirectional transmission between the apparatus and the second storage device according to the first time and the fourth time.
另外,本申请实施例还提供了一种存储系统,所述存储系统至少包括第一存储设备和第二存储设备,所述第一存储设备和所述第二存储设备之间通过存储区域网络连接;In addition, an embodiment of the present application further provides a storage system. The storage system includes at least a first storage device and a second storage device. The first storage device and the second storage device are connected through a storage area network. ;
所述第一存储设备用于获取所述第一存储设备上的芯片发送测试报文的第一时间和接收到响应报文的第四时间;其中所述响应报文是所述第二存储设备响应于所述测试报文而发送的;The first storage device is configured to obtain a first time when a chip on the first storage device sends a test message and a fourth time when a response message is received; wherein the response message is the second storage device Sent in response to the test message;
所述第一存储设备还用于根据所述第一时间和所述第四时间计算所述第一存储设备和所述第二存储设备之间一次双向传输的链路传输时延。The first storage device is further configured to calculate a link transmission delay in one bidirectional transmission between the first storage device and the second storage device according to the first time and the fourth time.
本申请另一实施例提供的检测时延的装置装置至少一处理器和至少一存储器,所述至少一个存储器用于存储计算机程序,所述至少一个处理器用于调用所述计算机程序来执行实施例所记载的方法。The apparatus for detecting time delay provided in another embodiment of the present application includes at least one processor and at least one memory, the at least one memory is configured to store a computer program, and the at least one processor is configured to call the computer program to execute the embodiment. The method described.
本申请实施例还提供了一种计算机存储介质,所述计算机存储介质上储存为计算机软 件指令,所述计算机软件指令运行后使计算机执行实施例所记载的方法。An embodiment of the present application further provides a computer storage medium, where computer software instructions are stored on the computer storage medium, and after the computer software instructions run, the computer executes the method described in the embodiment.
通过本申请实施例的技术方案,使用存储设备上的芯片发送或接收报文的时间,可以准确获取存储设备之间一次双向传输的链路传输时延,而不会受应用程序的数据处理开销以及协议栈的处理时延的影响。Through the technical solution of the embodiment of the present application, the time when a chip on a storage device sends or receives a message can accurately obtain the link transmission delay of a two-way transmission between the storage devices without being affected by the data processing overhead of the application program. And the impact of the processing delay of the protocol stack.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本申请实施例所涉及的系统架构图;FIG. 1 is a system architecture diagram according to an embodiment of the present application;
图2为本申请实施例所涉及的系统架构的简化示意图;2 is a simplified schematic diagram of a system architecture according to an embodiment of the present application;
图3为本申请第一实施例的流程示意图;3 is a schematic flowchart of a first embodiment of the present application;
图4为本申请第一实施例中Echo报文的Payload示意图;4 is a schematic diagram of a payload of an Echo message in the first embodiment of the present application;
图5为本申请第二实施例中Echo报文的Payload示意图;FIG. 5 is a schematic diagram of a payload of an Echo message in a second embodiment of the present application; FIG.
图6为本申请实施例提供的检测时延的装置的结构示意图。FIG. 6 is a schematic structural diagram of a device for detecting delay according to an embodiment of the present application.
具体实施方式detailed description
为了更好理解本申请实施例的目的、技术方案和优点,下面将结合说明书附图以及具体的实施方式对本申请实施例中的技术方案进行详细的说明。In order to better understand the purpose, technical solutions, and advantages of the embodiments of the present application, the technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings and specific implementations of the description.
需要说明的是,本申请实施例涉及的“多个”,是指两个或大于两个;本申请中的“第一”、“第二”、“第三”、“第四”等词汇,仅用于区分描述的目的,而不能理解为指示或暗示相对重要性,也不能理解为指示或暗示顺序。It should be noted that the "multiple" referred to in the embodiments of the present application means two or more than two; the terms "first", "second", "third", "fourth" and the like in this application , For the purpose of distinguishing descriptions only, and should not be interpreted as indicating or implying relative importance, nor as indicating or implying order.
本申请实施例涉及如图1所示的系统架构,包括存储系统A和存储系统B,存储系统A和存储系统B通过主干网络连接。存储系统A中包括存储设备A和存储区域网络SAN-A;存储系统B包括存储设备B和存储区域网络SAN-B。The embodiment of the present application relates to a system architecture as shown in FIG. 1, which includes a storage system A and a storage system B. The storage system A and the storage system B are connected through a backbone network. Storage system A includes storage device A and storage area network SAN-A; storage system B includes storage device B and storage area network SAN-B.
存储设备A和存储设备B可以由存储阵列构成;存储区域网络SAN-A和SAN-B可以采用网状通道技术,通过FC交换机来连接存储设备和服务器主机。Storage device A and storage device B can be composed of storage arrays; storage area networks SAN-A and SAN-B can use mesh channel technology and connect storage devices and server hosts through FC switches.
上述存储系统A和存储系统B可以是部署在两个不同城市的数据中心,通过SAN网络进行数据同步操作,实现双活容灾等应用场景。本申请实施例的技术方案也可以应用到其他对传输时延要求苛刻的网络部署场景。The foregoing storage system A and storage system B may be data centers deployed in two different cities, and perform data synchronization operations through a SAN network to implement application scenarios such as active-active disaster recovery. The technical solutions in the embodiments of the present application can also be applied to other network deployment scenarios with severe transmission delay requirements.
为更清晰描述本申请实施例的技术方案,图1所示的系统架构可以简化为图2。图2中的存储设备A和存储设备B都可以包括2个组件,分别是协议栈和芯片。In order to describe the technical solution of the embodiment of the present application more clearly, the system architecture shown in FIG. 1 may be simplified to FIG. 2. Both storage device A and storage device B in FIG. 2 may include two components, which are a protocol stack and a chip, respectively.
协议栈具体可以包括小型计算机系统接口(Small Computer System Interface,简称SCSI)协议栈和FC协议栈,是存储系统重要的组成部分。SCSI协议栈和FC协议栈均可以通过软件的方式实现。The protocol stack may specifically include a small computer system interface (SCSI) protocol stack and an FC protocol stack, which are important components of a storage system. Both the SCSI protocol stack and the FC protocol stack can be implemented by software.
SCSI协议栈用于负责SCSI命令的组装和解析处理,包括SCSI CDB/LBA信息以及其 他SCSI信息的处理。The SCSI protocol stack is responsible for the assembly and analysis of SCSI commands, including the processing of SCSI CDB / LBA information and other SCSI information.
FC协议栈用于负责FC2和FC4相关信息的处理,包括组装FCP命令中payload和地址解析转换;FC协议栈还负责把FCP命令转换成FC芯片可以识别的IOB命令,以及把FC芯片上报的IOB命令转换为FCP命令并提交到SCSI协议栈。The FC protocol stack is responsible for the processing of FC2 and FC4 related information, including assembling the payload and address resolution conversion in the FCP command; the FC protocol stack is also responsible for converting the FCP command into an IOB command recognized by the FC chip, and reporting the IOB to the FC chip The commands are converted into FCP commands and submitted to the SCSI protocol stack.
FC芯片是能够处理FC协议(包括FC0,FC1,FC2,FC3和FC4层)的光纤通道控制器芯片。FC芯片可以处理FC链路的信号发送和信号接收、可以组织和解析FC帧结构、还可以执行FC帧发送和FC帧接收的操作。The FC chip is a Fibre Channel controller chip capable of handling FC protocols (including the FC0, FC1, FC2, FC3 and FC4 layers). The FC chip can handle the signal transmission and signal reception of the FC link, can organize and analyze the FC frame structure, and can also perform the operations of FC frame transmission and FC frame reception.
本申请实施例仅以支持FC协议的FC芯片为例。本申请实施例的技术方案也适用于支持IOE(ISCSI Offload Engine)或TOE(TCP Offload Engine)等网络卸载协议的芯片。This embodiment of the present application only uses an FC chip supporting the FC protocol as an example. The technical solution of the embodiment of the present application is also applicable to a chip supporting a network offload protocol such as IOE (ISCSI Offload Engine) or TOE (TCP Offload Engine).
需要说明的是,网络卸载是用一颗片外的芯片独立去实现本来需要占用存储资源以及运算资源的以太网通信协议;网络卸载协议则是在该独立芯片上实现的以太网通信协议,如上面所述的FC协议,IOE协议或TOE协议。网络卸载协议属于传输层协议,可以应用于存储应用场景。网络卸载协议所对应的网络卸载协议报文中可以封装SCSI协议报文。It should be noted that network offloading uses an off-chip chip to independently implement the Ethernet communication protocol that originally required storage resources and computing resources; the network offloading protocol is an Ethernet communication protocol implemented on the independent chip, such as The FC protocol, IOE protocol or TOE protocol described above. The network offload protocol is a transport layer protocol and can be applied to storage application scenarios. The network offloading protocol message corresponding to the network offloading protocol may encapsulate the SCSI protocol message.
在图2中,存储设备A和存储设备B之间通过FC网络连接,该FC网络可以进一步包括一个或多个存储区域网络,还可以包括主干网络。In FIG. 2, storage device A and storage device B are connected through an FC network. The FC network may further include one or more storage area networks, and may further include a backbone network.
如图3所示,为本申请第一实施例的检测链路传输时延的详细方案示意图。As shown in FIG. 3, it is a schematic diagram of a detailed scheme for detecting a link transmission delay according to the first embodiment of the present application.
301:存储设备A上的协议栈生成ECHO命令,在该ECHO命令的Payload信息的特定位置Tag进行设置,指示该ECHO命令用于检测链路传输时延;301: The protocol stack on the storage device A generates an ECHO command, and sets a tag at a specific position of the payload information of the ECHO command to instruct the ECHO command to detect a link transmission delay;
ECHO命令为非IO命令,是使用FC协议定义的FC-ELS(Fibre Channel Extended Link Services)格式的命令。该ECHO命令中的Payload内容可以由使用者自行定义。The ECHO command is a non-IO command, and is a FC-ELS (Fibre Channel Extended Link Services) format defined using the FC protocol. The content of the payload in the ECHO command can be defined by the user.
302:存储设备A上的协议栈构造存储设备A上的芯片可识别的输入/输出块(Input/Output Block,简称IOB),并将该IOB发送到芯片的先进先出(First Input First Output,简称FIFO)队列。302: The protocol stack on the storage device A constructs an input / output block (Input / Output Block, referred to as IOB) recognized by the chip on the storage device A, and sends the IOB to the chip's first-in-first-out FIFO) queue.
IOB是协议栈软件与芯片之间交互用的数据块结构;IOB上承载的是格式固定,内容可以自定义的一块数据。The IOB is a data block structure used for interaction between the protocol stack software and the chip; the IOB carries a piece of data with a fixed format and a customizable content.
303:存储设备A上的芯片从FIFO队列中取出该IOB,并获取ECHO命令的Payload信息,通过Payload信息的Tag确定该ECHO命令是用于检测链路传输时延的命令。303: The chip on the storage device A fetches the IOB from the FIFO queue, and obtains the payload information of the ECHO command. The tag of the payload information determines that the ECHO command is a command for detecting a link transmission delay.
304:存储设备A上的芯片根据ECHO命令组织ECHO命令报文的帧头和帧尾信息,并将当前计时信息T1写入Payload中。在进行循环冗余校验(Cyclic Redundancy Check,简称CRC)操作后,存储设备A上的芯片将该ECHO命令报文发送到存储设备B。304: The chip on the storage device A organizes frame header and frame tail information of the ECHO command message according to the ECHO command, and writes the current timing information T1 into the payload. After performing a Cyclic Redundancy Check (CRC) operation, a chip on the storage device A sends the ECHO command message to the storage device B.
需要说明的是,存储设备A的协议栈生成的是ECHO命令,该ECHO命令使用IOB传送到存储设备A的芯片中生成对应的ECHO命令报文并发送到存储设备B。It should be noted that the protocol stack of the storage device A generates an ECHO command, and the ECHO command is transmitted to the chip of the storage device A using an IOB to generate a corresponding ECHO command message and sent to the storage device B.
ECHO命令报文可以视为芯片将协议栈生成的ECHO命令使用FC-ELS格式封装的、可以在SAN网络上传输的数据报文。类似地、ECHO响应报文可视为芯片对协议栈生成的ECHO响应使用FC-ELS格式封装的、可以在SAN网络上传输的数据报文。这里的ECHO命令报文和ECHO响应报文都是ECHO报文。The ECHO command message can be regarded as a data message that the chip encapsulates the ECHO command generated by the protocol stack using the FC-ELS format and can be transmitted on the SAN network. Similarly, the ECHO response message can be regarded as a data message encapsulated by the chip to the protocol stack using the FC-ELS format and can be transmitted on the SAN network. The ECHO command message and ECHO response message here are both ECHO messages.
305:存储设备B上的芯片接收ECHO命令报文,在通过其中Payload的Tag确定其是用于检测链路传输时延的命令报文后,将当前计时信息T2写入到该ECHO命令报文的Payload中。305: The chip on the storage device B receives the ECHO command message, and after it determines that it is a command message for detecting a link transmission delay through the tag of the payload, writes the current timing information T2 to the ECHO command message. Payload.
306:存储设备B上的芯片对ECHO命令报文进行处理、组装IOB并将对应的ECHO命令上送到存储设备B的协议栈。306: The chip on the storage device B processes the ECHO command message, assembles the IOB, and sends the corresponding ECHO command to the protocol stack of the storage device B.
307:存储设备B上的协议栈生成并下发响应于上述ECHO命令的ECHO响应。具体地,存储设备B上的协议栈组织ECHO响应,该ECHO响应的Payload与存储设备B接收到的ECHO命令的Payload相同。307: The protocol stack on the storage device B generates and delivers an ECHO response in response to the above-mentioned ECHO command. Specifically, the protocol stack on the storage device B organizes an ECHO response, and the payload of the ECHO response is the same as the payload of the ECHO command received by the storage device B.
308:存储设备B上的协议栈构造存储设备B上的芯片可识别的IOB,并将该IOB发送到芯片的FIFO队列。308: The protocol stack on the storage device B constructs an IOB recognizable by the chip on the storage device B, and sends the IOB to the chip's FIFO queue.
309:存储设备B上的芯片从FIFO队列中取出IOB后,并获取该ECHO响应的Payload信息,通过Payload信息的Tag确定其是检测链路传输时延命令的响应后,将当前计时信息T3写入Payload中。在进行CRC处理后,存储设备B上的芯片将所生成的ECHO响应报文发送到存储设备A。309: After the chip on the storage device B removes the IOB from the FIFO queue, and obtains the payload information of the ECHO response, the tag of the payload information determines that it is the response to the command for detecting the link transmission delay, and writes the current timing information T3 Into the payload. After performing CRC processing, the chip on storage device B sends the generated ECHO response packet to storage device A.
310:存储设备A上的芯片接收到ECHO响应报文、并通过其中Payload的Tag确定该报文是检测链路传输时延命令的响应报文后,将当前计时信息T4写入到该ECHO响应报文的Payload中.310: After receiving the ECHO response message from the chip on the storage device A, and determining that the message is a response message for detecting a link transmission delay command by using the Payload Tag, the current timing information T4 is written to the ECHO response. The payload of the message.
311:存储设备A上的芯片组装IOB并将ECHO响应上送到存储设备A的协议栈。311: The chip on the storage device A assembles the IOB and sends the ECHO response to the protocol stack of the storage device A.
312:存储设备A上的协议栈收到ECHO响应后,从其中的Payload中获取T、T2、T3和T4,用于计算存储设备A和存储设备B之间一次双向传输的链路传输时延DT。312: After receiving the ECHO response, the protocol stack on storage device A obtains T, T2, T3, and T4 from its payload, and is used to calculate the link transmission delay of a two-way transmission between storage device A and storage device B. DT.
具体地,存储设备A可以通过如下公式或其算法计算DT:Specifically, storage device A can calculate DT by the following formula or its algorithm:
DT1=T4-T1DT1 = T4-T1
DT2=T3-T2DT2 = T3-T2
DT=DT1-DT2DT = DT1-DT2
如图4所示,为本申请第一实施例所涉及的ECHO报文中的Payload示意图。ECHO报文的Payload的不同偏移(offset)所对应的位置区域定义了不同的字段。该ECHO报文 的Payload中具体可以包括如下内容:As shown in FIG. 4, it is a schematic diagram of a payload in an ECHO message according to the first embodiment of the present application. Different fields are defined in the position areas corresponding to different offsets of the payload of the ECHO message. The payload of the ECHO message may specifically include the following:
Offset 0:代表字段local magic version tag,用于标识该Payload报文格式是自定义格式,ECHO命令报文的发送方需要填写如下echo cmd send time和echo response received time字段所要求的计时信息;Offset0: represents the field local magic version tag, which is used to identify that the format of the payload message is a custom format. The sender of the ECHO command message needs to fill in the timing information required in the echo cmd send time and echo response time fields;
Offset 1:代表字段remote magic version tag,用于标识该远端是否支持该命令;该字段的初始值可设置为远端不支持该命令,如果远端支持,则远端在接收到该命令后按照约定方式填写对应的标识;在远端支持该命令的情况下,则ECHO响应报文的发送方需要填写如下echo cmd received time和echo response send time字段所要求的计时信息;Offset: stands for the field remote magic version tag, used to identify whether the remote end supports the command; the initial value of this field can be set to the remote end does not support the command, if the remote end supports, the remote end after receiving the command Fill in the corresponding identification as agreed; if the remote end supports the command, the sender of the ECHO response message needs to fill in the timing information required in the echo cmd received time and echo response time fields;
Offset n:n>=1;如n=1,则代表Offset 1;如n>1,则表示非格式化的Payload内容;Offset: n> = 1; if n = 1, it represents Offset1; if n> 1, it means unformatted payload content;
Offset n+1:代表echo cmd send time字段,表示ECHO命令报文的发送方发送ECHO命令报文的时间,即对应本申请上述第一实施例304中的T1;Offset + 1: represents the echo cmd time field, which indicates the time when the sender of the ECHO command message sends the ECHO command message, that is, corresponding to T1 in the first embodiment 304 of the application;
Offset n+2:代表echo cmd received time字段,表示ECHO命令报文的接收方接收到ECHO命令报文的时间,即对应本申请上述第一实施例305中的T2;Offset + 2: represents the echo cmd time field, which indicates the time when the receiver of the ECHO command message received the ECHO command message, that is, corresponding to T2 in the first embodiment 305 of the application;
Offset n+3:代表echo response send time字段,表示ECHO响应报文的发送方发送ECHO响应报文的时间,即对应本申请上述第一实施例309中的T3;Offset + 3: represents the echo response time field, which indicates the time at which the sender of the ECHO response message sends the ECHO response message, which corresponds to T3 in the first embodiment 309 of this application;
Offset n+4:代表echo response received time字段,表示ECHO响应报文的接收方接收到ECHO响应报文的时间,即对应本申请上述第一实施例310中的T4;Offset + 4: represents the echo response time field, which indicates the time when the receiver of the ECHO response message receives the ECHO response message, that is, corresponding to T4 in the first embodiment 310 of this application;
Offset n+5~255:用于表示Payload中其他的非格式化内容。Offset + 5 to 255: Used to indicate other unformatted content in the payload.
作为本申请的第二实施例,存储上设备A和存储设备B之间可以只传输echo cmd received time和echo response send time两个字段,即本申请上述第一实施例304中的T1和310中的T4。存储设备A通过芯片与协议栈之间的IOB,将上述T1和T4上送到协议栈,用于计算存储设备A和存储设备B之间一次双向传输的链路传输时延DT。As the second embodiment of the present application, only two fields, echo, cmd, received time, and echo time, can be transmitted between the storage device A and the storage device B, that is, T1 and 310 in the first embodiment 304 of the above application. T4. Storage device A sends the above T1 and T4 to the protocol stack through the IOB between the chip and the protocol stack, and is used to calculate the link transmission delay DT of a two-way transmission between storage device A and storage device B.
具体计算公式可以为,DT=T4-T1。The specific calculation formula can be: DT = T4-T1.
如图5所示,为本申请第二实施例所涉及的ECHO报文的Payload示意图。As shown in FIG. 5, it is a schematic diagram of a payload of an ECHO message according to a second embodiment of the present application.
本申请第三实施例提供了一种检测时延的方法,该方法应用于第一存储设备和第二存储设备之间通过存储区域网络连接的存储系统,该方法包括:The third embodiment of the present application provides a method for detecting a delay. The method is applied to a storage system connected between a first storage device and a second storage device through a storage area network. The method includes:
第一存储设备获取该第一存储设备上的芯片发送测试报文的第一时间;Obtaining, by a first storage device, a first time at which a chip on the first storage device sends a test packet;
第一存储设备获取该第一存储设备上的芯片接收到响应报文的第四时间,该响应报文是该第二存储设备响应于上述测试报文而发送的;The first storage device acquires a fourth time when a chip on the first storage device receives a response message, and the response message is sent by the second storage device in response to the test message;
该第一存储设备根据第一时间和第四时间计算第一存储设备和第二存储设备之间一次双向传输的链路传输时延。The first storage device calculates a link transmission delay of a bidirectional transmission between the first storage device and the second storage device according to the first time and the fourth time.
作为一种可能的实现方式,上述响应报文中还可以包括第二时间和第三时间,其中:As a possible implementation manner, the response message may further include a second time and a third time, where:
第二时间是第二存储设备的芯片接收到测试报文的时间;第三时间是第二存储设备的 芯片发送响应报文的时间;The second time is the time when the chip of the second storage device receives the test message; the third time is the time when the chip of the second storage device sends a response message;
在该实现方式中,第一存储设备可以根据第一时间、第二时间、第三时间和第四时间计算第一存储设备和第二存储设备之间一次双向传输的链路传输时延。In this implementation manner, the first storage device may calculate a link transmission delay of one bidirectional transmission between the first storage device and the second storage device according to the first time, the second time, the third time, and the fourth time.
本申请的测试报文可以是ECHO命令报文、响应报文可以是ECHO响应报文。ECHO命令报文和ECHO响应报文都是使用FC-ELS协议的ECHO报文。下面对本申请实施例涉及的第一时间至第四时间做进一步说明。The test message in this application may be an ECHO command message, and the response message may be an ECHO response message. The ECHO command message and ECHO response message are both ECHO messages using the FC-ELS protocol. The first to fourth times involved in the embodiments of the present application are further described below.
本申请的第一时间是第一存储设备的芯片发送ECHO命令报文到链路的时间,即对应本申请上述第一实施例304中的T1,可以携带在ECHO报文的echo cmd send time字段中;The first time of this application is the time when the chip of the first storage device sends the ECHO command message to the link, that is, corresponding to T1 in the first embodiment 304 of the application, which can be carried in the echo cmd send time field of the ECHO message. in;
本申请的第二时间是第二存储设备的芯片接收到ECHO命令报文的时间,即对应本申请上述第一实施例305中的T2,可以携带在ECHO报文的echo cmd received time字段中;The second time of the present application is the time when the chip of the second storage device receives the ECHO command message, that is, corresponding to T2 in the first embodiment 305 of the present application, and can be carried in the echo cmd received time field of the ECHO message;
本申请的第三时间是第二存储设备的芯片发送ECHO响应报文的时间,即对应本申请上述第一实施例309中的T3,可以携带在ECHO报文的echo response send time字段中;The third time of the present application is the time when the chip of the second storage device sends the ECHO response message, that is, corresponding to T3 in the first embodiment 309 of the present application, and can be carried in the echo response time field of the ECHO message;
本申请的第四时间是第一存储设备的芯片接收到ECHO响应报文的时间,即对应本申请上述第一实施例310中的T4,可以携带在ECHO报文的echo response received time字段中。The fourth time of this application is the time when the chip of the first storage device receives the ECHO response message, that is, corresponding to T4 in the above-mentioned first embodiment 310 of the application, and can be carried in the echo response time field of the ECHO message.
需要说明的是,第一时间可以通过第一存储设备发送的ECHO命令报文传输到第二存储设备,然后第二存储设备将第一时间通过ECHO响应报文发送回第一存储设备;第二存储设备获取到第二时间和第三时间后,将第二时间和第三时间写入ECHO响应报文中发送到第一存储设备;第一存储设备的芯片在收到ECHO响应报文后将第四时间写入ECHO响应报文并上送到协议栈。It should be noted that the first time can be transmitted to the second storage device through the ECHO command message sent by the first storage device, and then the second storage device sends the first time back to the first storage device through the ECHO response message; the second After the storage device obtains the second time and the third time, it writes the second time and the third time into the ECHO response message and sends it to the first storage device; after receiving the ECHO response message, the chip of the first storage device sends Write the ECHO response message at the fourth time and send it to the protocol stack.
通过本申请实施例的方法,使用存储设备上的芯片发送报文和接收报文的时间,可以准确获取存储设备之间一次双向传输的链路传输时延,而不会受应用程序的数据处理开销(如系统调度或CPU占用等因素)以及协议栈的处理时延的影响。另一方面,本申请实施例通过一次双向ECHO交互,就可以一次性获取存储设备上的芯片之间传输报文的时间,无需新增接口,实现起来简单、开销小。By the method of the embodiment of the present application, the time between sending and receiving a message by using a chip on a storage device can accurately obtain the link transmission delay of a two-way transmission between the storage devices without being processed by the application program data. The impact of overhead (such as system scheduling or CPU usage) and the processing delay of the protocol stack. On the other hand, the embodiment of the present application can obtain the time for transmitting messages between the chips on the storage device through a two-way ECHO interaction at one time, without adding an interface, which is simple to implement and has low overhead.
本申请的技术方案可以用来更准确确定数据传输的优先路径、从而提高系统的整体性。本申请实施例提供的技术方案还可以结合现有的基于IO模型的时延统计技术,用来快速确定存储系统的性能瓶颈,以确定负载均衡策略。本申请实施例提供的技术方案还可以用来定位网络组网配置和链路拥塞,也可以通过对传输时延的检测来评估实际链路的传输距离。The technical solution of the present application can be used to more accurately determine the priority path of data transmission, thereby improving the integrity of the system. The technical solution provided in the embodiments of the present application can also be used in combination with the existing IO model-based delay statistics technology to quickly determine the performance bottleneck of the storage system to determine the load balancing strategy. The technical solutions provided in the embodiments of the present application can also be used to locate the network configuration and link congestion, and the transmission distance of the actual link can be evaluated by detecting the transmission delay.
本申请还公开了一种检测时延的装置600,如图6所示。该装置600为一存储设备,并通过存储区域网络与第二存储设备连接;该装置600可以包括获取单元601和计算单元602。This application also discloses a device 600 for detecting time delay, as shown in FIG. 6. The apparatus 600 is a storage device and is connected to the second storage device through a storage area network. The apparatus 600 may include an obtaining unit 601 and a computing unit 602.
获取单元601用于获取该装置上的芯片发送测试报文的第一时间和接收到响应报文的第四时间;其中响应报文是所述第二存储设备响应于测试报文而发送的;The obtaining unit 601 is configured to obtain a first time when a chip on the device sends a test message and a fourth time when a response message is received; wherein the response message is sent by the second storage device in response to the test message;
计算单元602用于根据第一时间和第四时间计算该装置和第二存储设备之间一次双向传输的链路传输时延。The calculating unit 602 is configured to calculate a link transmission delay in one bidirectional transmission between the device and the second storage device according to the first time and the fourth time.
作为一种可能的实现方式,上述响应报文中可以包括第二时间和第三时间,其中第二时间是第二存储设备的芯片接收到测试报文的时间,第三时间是第二存储设备的芯片发送响应报文的时间。As a possible implementation manner, the response message may include a second time and a third time, where the second time is the time when the chip of the second storage device receives the test message, and the third time is the second storage device The time that the chip sends the response message.
在该实现方式中,计算单元602根据第一时间、第二时间、第三时间和第四时间计算该装置和第二存储设备之间一次双向传输的链路传输时延。In this implementation manner, the calculation unit 602 calculates a link transmission delay of a two-way transmission between the device and the second storage device according to the first time, the second time, the third time, and the fourth time.
需要说明的是,第二时间和第三时间可以是第二存储设备写入所述响应报文中,获取单元601从响应报文中获取第二时间和第三时间。第一时间可以是该装置写入所述测试报文中,且被第二存储设备在接收到测试报文后写到响应报文中;第四时间可以是该装置600在该装置600上的芯片接收到该响应报文后写入响应报文的。相应地,获取单元可以从响应报文中获取第一时间和第四时间。It should be noted that the second time and the third time may be written into the response message by the second storage device, and the obtaining unit 601 obtains the second time and the third time from the response message. The first time may be that the device writes into the test message, and is written by the second storage device into the response message after receiving the test message; the fourth time may be The chip writes the response message after receiving the response message. Accordingly, the acquiring unit may acquire the first time and the fourth time from the response message.
本申请还公开了一种存储系统,该存储系统至少包括如本申请上述实施例的第一存储设备和第二存储设备,第一存储设备和第二存储设备之间通过存储区域网络连接。The present application also discloses a storage system. The storage system includes at least a first storage device and a second storage device according to the foregoing embodiments of the present application. The first storage device and the second storage device are connected through a storage area network.
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到本申请实施例可以用硬件实现,或固件实现,或它们的组合方式来实现。当使用软件实现时,可以将上述功能存储在计算机可读介质中或作为计算机可读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质,其中通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。存储介质可以是计算机能够存取的任何可用介质。以此为例但不限于:计算机可读介质可以包括RAM、ROM、电可擦可编程只读存储器(electrically erasable programmable read only memory,EEPROM)、只读光盘(compact disc read-Only memory,CD-ROM)或其他光盘存储、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质。此外。任何连接可以适当的成为计算机可读介质。例如,如果软件是使用同轴电缆、光纤光缆、双绞线、数字用户线(digital subscriber line,DSL)或者诸如红外线、无线电和微波之类的无线技术从网站、服务器或者其他远程源传输的,那么同轴电缆、光纤光缆、双绞线、DSL或者诸如红外线、无线和微波之类的无线技术包括在所属介质的定影中。如本申请实施例所使用的,盘(disk)和碟(disc)包括压缩光碟(compact disc,CD)、激光碟、光碟、数字通用光碟(digital video disc,DVD)、软盘和蓝光光碟,其中盘通常磁性的复制数据,而碟则用激光来光学的复制数据。上面的组合也应当包括在计算机可读介质的保护范围之内。Through the description of the foregoing implementation manners, those skilled in the art can clearly understand that the embodiments of the present application can be implemented by hardware, firmware, or a combination thereof. When implemented in software, the functions described above may be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media includes computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a computer. Take this as an example but not limited to: computer-readable media may include RAM, ROM, electrically erasable programmable read-only memory (EEPROM), read-only memory (EEPROM), compact disc-read-only memory (CD-ROM) ROM) or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer. Also. Any connection is properly a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technology such as infrared, radio, and microwave, Then coaxial cables, fiber optic cables, twisted pairs, DSL, or wireless technologies such as infrared, wireless, and microwave are included in the fixing of the media. As used in the embodiments of the present application, disks and discs include compact discs (CDs), laser discs, optical discs, digital video discs (DVDs), floppy discs, and Blu-ray discs, among which Discs usually reproduce data magnetically, while discs use lasers to reproduce data optically. The above combination should also be included in the protection scope of the computer-readable medium.
总之,以上所述仅为本申请的实施例而已,并非用于限定本申请的保护范围。凡根据本申请的揭露,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。In short, the above is only an embodiment of the present application, and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of this application shall be included in the protection scope of this application.

Claims (14)

  1. 一种检测时延的方法,其特征在于,第一存储设备和第二存储设备之间通过存储区域网络连接,所述方法包括:A method for detecting a delay, characterized in that a first storage device and a second storage device are connected through a storage area network, and the method includes:
    所述第一存储设备获取所述第一存储设备上的芯片发送测试报文的第一时间;Acquiring, by the first storage device, a first time when a chip on the first storage device sends a test packet;
    所述第一存储设备获取所述第一存储设备上的芯片接收到响应报文的第四时间,所述响应报文是所述第二存储设备响应于所述测试报文而发送的;A fourth time when the first storage device obtains a response packet received by a chip on the first storage device, where the response packet is sent by the second storage device in response to the test packet;
    所述第一存储设备根据所述第一时间和所述第四时间计算所述第一存储设备和所述第二存储设备之间一次双向传输的链路传输时延。The first storage device calculates a link transmission delay of one bidirectional transmission between the first storage device and the second storage device according to the first time and the fourth time.
  2. 根据权利要求1所述的方法,其特征在于,所述响应报文中包括第二时间和第三时间,其中:The method according to claim 1, wherein the response message includes a second time and a third time, wherein:
    所述第二时间是所述第二存储设备的芯片接收到所述测试报文的时间;The second time is the time when the chip of the second storage device receives the test message;
    所述第三时间是所述第二存储设备的芯片发送所述响应报文的时间;The third time is a time when the chip of the second storage device sends the response message;
    所述第一存储设备根据所述第一时间和所述第四时间计算所述第一存储设备和所述第二存储设备之间一次双向传输的链路传输时延具体为:The calculating, by the first storage device according to the first time and the fourth time, a link transmission delay of one bidirectional transmission between the first storage device and the second storage device is specifically:
    所述第一存储设备根据所述第一时间、所述第二时间、所述第三时间和所述第四时间计算所述第一存储设备和所述第二存储设备之间一次双向传输的链路传输时延。The first storage device calculates a one-way transmission between the first storage device and the second storage device based on the first time, the second time, the third time, and the fourth time. Link transmission delay.
  3. 根据权利要求2所述的方法,其特征在于,所述第二时间和所述第三时间被所述第二存储设备写入所述响应报文中;所述第一存储设备从所述响应报文中获取所述第二时间和所述第三时间。The method according to claim 2, wherein the second time and the third time are written into the response message by the second storage device; and the first storage device receives the response from the response The message obtains the second time and the third time.
  4. 根据权利要求1-3中任一项所述的方法,其特征在于,The method according to any one of claims 1-3, wherein:
    所述第一存储设备将所述第一时间写入所述测试报文,且所述第一时间被所述第二存储设备在接收到所述测试报文后写到所述第二存储设备发送的所述响应报文中;The first storage device writes the first time into the test message, and the first time is written to the second storage device by the second storage device after receiving the test message In the response message sent;
    所述第一存储设备将所述第四时间写入所述响应报文;Writing, by the first storage device, the response message at the fourth time;
    所述第一存储设备从所述响应报文中获取所述第一时间和所述第四时间。Obtaining, by the first storage device, the first time and the fourth time from the response message.
  5. 一种检测时延的装置,其特征在于,所述装置为一存储设备,并通过存储区域网络与第二存储设备连接,所述装置包括:A device for detecting delay, characterized in that the device is a storage device and connected to a second storage device through a storage area network, and the device includes:
    获取单元,用于获取所述装置上的芯片发送测试报文的第一时间和接收到响应报文的第四时间;其中所述响应报文是所述第二存储设备响应于所述测试报文而发送的;An obtaining unit, configured to obtain a first time when a chip on the device sends a test message and a fourth time when a response message is received; wherein the response message is the second storage device responding to the test message Sent by text;
    计算单元,用于根据所述第一时间和所述第四时间计算所述装置和所述第二存储设备之间一次双向传输的链路传输时延。A calculation unit is configured to calculate a link transmission delay in one bidirectional transmission between the apparatus and the second storage device according to the first time and the fourth time.
  6. 根据权利要求5所述的装置,其特征在于,所述响应报文中包括第二时间和第三时 间,其中:The apparatus according to claim 5, wherein the response message includes a second time and a third time, wherein:
    所述第二时间是所述第二存储设备的芯片接收到所述测试报文的时间;The second time is the time when the chip of the second storage device receives the test message;
    所述第三时间是所述第二存储设备的芯片发送所述响应报文的时间;The third time is a time when the chip of the second storage device sends the response message;
    所述计算单元根据所述第一时间、所述第二时间、所述第三时间和所述第四时间计算所述装置和所述第二存储设备之间一次双向传输的链路传输时延。The calculation unit calculates a link transmission delay in one bidirectional transmission between the device and the second storage device according to the first time, the second time, the third time, and the fourth time. .
  7. 根据权利要求6所述的装置,其特征在于,所述第二时间和所述第三时间被所述第二存储设备写入所述响应报文中;所述获取单元从所述响应报文中获取所述第二时间和所述第三时间。The apparatus according to claim 6, wherein the second time and the third time are written into the response message by the second storage device; and the obtaining unit receives the response message from the response message. Acquiring the second time and the third time.
  8. 根据权利要求5-7中任一项所述的装置,其特征在于,The device according to any one of claims 5 to 7, wherein:
    所述第一时间被所述装置写入所述测试报文中,且被所述第二存储设备在接收到所述测试报文后写到所述第二存储设备发送的所述响应报文中;所述第四时间被所述装置写入所述响应报文;The first time is written into the test message by the device, and is written by the second storage device to the response message sent by the second storage device after receiving the test message The fourth time is written into the response message by the device;
    所述获取单元从所述响应报文中获取所述第一时间和所述第四时间。The acquiring unit acquires the first time and the fourth time from the response message.
  9. 一种存储系统,其特征在于,所述存储系统至少包括第一存储设备和第二存储设备,所述第一存储设备和所述第二存储设备之间通过存储区域网络连接;A storage system, characterized in that the storage system includes at least a first storage device and a second storage device, and the first storage device and the second storage device are connected through a storage area network;
    所述第一存储设备,用于获取所述第一存储设备上的芯片发送测试报文的第一时间和接收到响应报文的第四时间;其中所述响应报文是所述第二存储设备响应于所述测试报文而发送的;The first storage device is configured to obtain a first time when a chip on the first storage device sends a test message and a fourth time when a response message is received; wherein the response message is the second storage Sent by the device in response to the test message;
    所述第一存储设备还用于根据所述第一时间和所述第四时间计算所述第一存储设备和所述第二存储设备之间一次双向传输的链路传输时延。The first storage device is further configured to calculate a link transmission delay in one bidirectional transmission between the first storage device and the second storage device according to the first time and the fourth time.
  10. 根据权利要求9所述的存储系统,其特征在于,所述响应报文中包括第二时间和第三时间,其中:The storage system according to claim 9, wherein the response message includes a second time and a third time, wherein:
    所述第二时间是所述第二存储设备的芯片接收到所述测试报文的时间;The second time is the time when the chip of the second storage device receives the test message;
    所述第三时间是所述第二存储设备的芯片发送所述响应报文的时间;The third time is a time when the chip of the second storage device sends the response message;
    所述第一存储设备根据所述第一时间、所述第二时间、所述第三时间和所述第四时间计算所述第一存储设备和所述第二存储设备之间一次双向传输的链路传输时延。The first storage device calculates a one-way transmission between the first storage device and the second storage device based on the first time, the second time, the third time, and the fourth time. Link transmission delay.
  11. 根据权利要求10所述的存储系统,其特征在于,所述第二时间和所述第三时间被所述第二存储设备写入所述响应报文中;所述第一存储设备从所述响应报文中获取所述第二时间和所述第三时间。The storage system according to claim 10, wherein the second time and the third time are written into the response message by the second storage device; and the first storage device is downloaded from the second storage device. Obtain the second time and the third time in the response message.
  12. 根据权利要求9-11中任一项所述的存储系统,其特征在于,The storage system according to any one of claims 9 to 11, wherein:
    所述第一存储设备将所述第一时间写入所述测试报文,且所述第一时间被所述第二存 储设备在接收到所述测试报文后写到所述第二存储设备发送的所述响应报文中;The first storage device writes the first time into the test message, and the first time is written to the second storage device by the second storage device after receiving the test message In the response message sent;
    所述第一存储设备将所述第四时间写入所述响应报文;Writing, by the first storage device, the response message at the fourth time;
    所述第一存储设备从所述响应报文中获取所述第一时间和所述第四时间。Obtaining, by the first storage device, the first time and the fourth time from the response message.
  13. 一种检测时延的装置,其特征在于,所述装置至少一处理器和至少一存储器,所述至少一个存储器用于存储计算机程序,所述至少一个处理器用于调用所述计算机程序来执行所述权利要求1至4任一项所述的方法。A device for detecting delay, characterized in that the device has at least one processor and at least one memory, the at least one memory is used to store a computer program, and the at least one processor is used to call the computer program to execute all The method according to any one of claims 1 to 4.
  14. 一种计算机存储介质,所述计算机存储介质上储存为计算机软件指令,所述计算机软件指令运行后使计算机执行权利要求1至4任一项所记载的方法。A computer storage medium stores computer software instructions on the computer storage medium. After the computer software instructions are executed, the computer executes the method according to any one of claims 1 to 4.
PCT/CN2019/082363 2018-08-09 2019-04-12 Time delay detection method and apparatus, and system WO2020029602A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810903973.4 2018-08-09
CN201810903973.4A CN109257246A (en) 2018-08-09 2018-08-09 Detect the method, apparatus and system of time delay

Publications (1)

Publication Number Publication Date
WO2020029602A1 true WO2020029602A1 (en) 2020-02-13

Family

ID=65048813

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/082363 WO2020029602A1 (en) 2018-08-09 2019-04-12 Time delay detection method and apparatus, and system

Country Status (2)

Country Link
CN (1) CN109257246A (en)
WO (1) WO2020029602A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109257246A (en) * 2018-08-09 2019-01-22 华为技术有限公司 Detect the method, apparatus and system of time delay
CN110601776B (en) * 2019-09-10 2022-06-24 惠州市德赛西威汽车电子股份有限公司 Vehicle-mounted wireless module performance test method and system
CN113507394B (en) * 2021-06-10 2023-03-10 广州虎牙科技有限公司 Network performance detection method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106357472A (en) * 2015-07-17 2017-01-25 中兴通讯股份有限公司 Delay measuring method and device
US20170180454A1 (en) * 2015-12-18 2017-06-22 Accenture Global Solutions Limited Tracking a status of a file transfer using feedback files corresponding to file transfer events
CN107147544A (en) * 2017-05-11 2017-09-08 郑州云海信息技术有限公司 A kind of method and device of test network delay
CN108199913A (en) * 2017-12-18 2018-06-22 瑞斯康达科技发展股份有限公司 A kind of method and apparatus for realizing delay testing
CN109257246A (en) * 2018-08-09 2019-01-22 华为技术有限公司 Detect the method, apparatus and system of time delay

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100502324C (en) * 2005-08-31 2009-06-17 华为技术有限公司 Method for obtaining chain circuit evaluating parameter
CN100421395C (en) * 2005-09-19 2008-09-24 华为技术有限公司 Method based on elastic group ring for obtaining link evaluating parameter
US20070115846A1 (en) * 2005-11-01 2007-05-24 Sheridan Kooyers Method for controlling data throughput in a storage area network
US20080159260A1 (en) * 2006-12-15 2008-07-03 Brocade Communications Systems, Inc. Fibre channel over ethernet frame
EP2425341B1 (en) * 2009-05-01 2018-07-11 Citrix Systems, Inc. Systems and methods for establishing a cloud bridge between virtual storage resources
GB201321148D0 (en) * 2013-11-29 2014-01-15 Bridgeworks Ltd Data transfer
CN104954153A (en) * 2014-03-24 2015-09-30 中兴通讯股份有限公司 Method and device for node fault detection
US9992118B2 (en) * 2014-10-27 2018-06-05 Veritas Technologies Llc System and method for optimizing transportation over networks

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106357472A (en) * 2015-07-17 2017-01-25 中兴通讯股份有限公司 Delay measuring method and device
US20170180454A1 (en) * 2015-12-18 2017-06-22 Accenture Global Solutions Limited Tracking a status of a file transfer using feedback files corresponding to file transfer events
CN107147544A (en) * 2017-05-11 2017-09-08 郑州云海信息技术有限公司 A kind of method and device of test network delay
CN108199913A (en) * 2017-12-18 2018-06-22 瑞斯康达科技发展股份有限公司 A kind of method and apparatus for realizing delay testing
CN109257246A (en) * 2018-08-09 2019-01-22 华为技术有限公司 Detect the method, apparatus and system of time delay

Also Published As

Publication number Publication date
CN109257246A (en) 2019-01-22

Similar Documents

Publication Publication Date Title
WO2020029602A1 (en) Time delay detection method and apparatus, and system
US9344347B2 (en) Delay time measuring apparatus, computer readable record medium on which delay time measuring program is recorded, and delay time measuring method
KR101507664B1 (en) Dynamically enabling and disabling write xfr_rdy
US9218266B2 (en) Systems and methods for replication of test results in a network environment
US8804543B2 (en) Test method for network system
US11012955B2 (en) Synchronization of host and client log timestamps
US9253669B2 (en) Network analysis method, information processing device, and computer-readable recording medium
US8948020B2 (en) Detecting and isolating dropped or out-of-order packets in communication networks
JP4443200B2 (en) Information system
US9715477B2 (en) Shared-bandwidth multiple target remote copy
US7549088B2 (en) Communication apparatus and program provided with failure determining method and function
US7526574B2 (en) Method for communicating data transfer requests between data transfer protocols
US8331270B2 (en) In-band communication of network statistics over a FICON network
US8850117B2 (en) Storage apparatus and method maintaining at least an order of writing data
CN114024870B (en) Network connectivity detection method and system
US6205141B1 (en) Method and system for un-tagged command queuing
EP2616938B1 (en) Fault handling systems and methods
US10686754B2 (en) In-band LDAP over FICON
US10176135B2 (en) Multi-packet processing with ordering rule enforcement
US20110191660A1 (en) Apparatus, System, and Method for Specifying Intermediate CRC Locations in a Data Stream
US8005082B2 (en) Concurrent enablement of persistent information unit pacing
US20150180777A1 (en) Data processing apparatus and method
CN108304214B (en) Method and device for verifying integrity of immediate data
CN116939034A (en) Data transmission method, device, gateway, electronic equipment and storage medium
CN117424888A (en) File transmission method, file transmission system and computer storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19846544

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19846544

Country of ref document: EP

Kind code of ref document: A1