CN104424105A

CN104424105A - Memory data reading and writing processing method and device

Info

Publication number: CN104424105A
Application number: CN201310376301.XA
Authority: CN
Inventors: 董建波; 张立新; 侯锐; 李晔
Original assignee: Huawei Technologies Co Ltd; Institute of Computing Technology of CAS
Current assignee: Huawei Technologies Co Ltd; Institute of Computing Technology of CAS
Priority date: 2013-08-26
Filing date: 2013-08-26
Publication date: 2015-03-18
Anticipated expiration: 2033-08-26
Also published as: CN104424105B; WO2015027806A1

Abstract

The invention discloses a memory data reading and writing processing method and device and relates to the technical field of computer systems. The memory data reading and writing processing method and device solve the problem of low transmission efficiency of the prior art due to the fact that a plurality of memory data access operations with small data volume waste a lot of expenditure on data request packets. The memory data reading and writing processing method includes that enabling a source node to acquire each request package to be sent; analyzing the destination node identity of each request package to be sent, and judging whether the destination node identities of the request packages to be sent are the same; using at least two request packages to be sent with the same destination node identity as sub-request packages, and packaging into a combined request package; sending the combined request package to a destination node corresponding to the destination node identity, wherein the combined request package is used for indicating the reading and/or writing operation of the destination node to the memory data of the destination node. The memory data reading and writing processing method and device are used for the memory data reading and writing processing process.

Description

A kind of read-write processing method of internal storage data and device

Technical field

The present invention relates to computer systems technology field, particularly relate to a kind of read-write processing method and device of internal storage data.

Background technology

In multi-node computer system, the data interaction efficiency between local and remote node directly affects the performance of whole system.Remote direct memory access (Remote Direct MemoryAccess, RDMA) be that internal storage data is moved quickly into remote system stored device from a system, and operating system is not had any impact, such as when not having CPU to intervene, the internal storage data of a node is directly sent in the physical memory of another node, and then reduce the impact of data transmission on processing element, the performance of elevator system.

In the read-write operation of RDMA, internal memory and Cache(cache memory) between exchanges data granularity be a Cache Line, size is 64Bytes(byte) or 128Bytes, if the data of each Cache Line are packaged into a request data package to send, there is link bandwidth waste to a certain degree in this small-scale data transmission, such as PCIE(PeripheralComponent Interface Express, peripheral interconnect standard) data packet head may have 16Bytes, if and Payload(useful load) length is 16Bytes, then the utilization factor of link bandwidth only has 50%, therefore the teledata accessing operation that multiple data volume is less can be wasted more expense and wrap in request of data, cause transfer efficiency low.

Summary of the invention

Embodiments of the invention provide a kind of read-write processing method and device of internal storage data, improve the utilization ratio of link.

For achieving the above object, embodiments of the invention adopt following technical scheme:

First aspect, the invention provides a kind of read-write processing method of internal storage data, comprising:

Obtain each request bag to be sent, described request handbag to be sent is drawn together: read request packet, and/or write request bag;

Resolve the destination node mark of each request bag to be sent described, and judge whether the destination node mark of each request bag to be sent described is identical;

Described at least two requests to be sent with identical destination node mark are wrapped as sub-request bag, be packaged as one and merge request bag, described merging request comprises public packet header and at least two son request bags, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described merge bag mark be used to indicate described request bag for described at least two son request package close merging bags, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, described son request handbag is containing son request handbag head and sub-solicited message,

Send to described destination node to identify corresponding destination node the described request bag that merges, described merging request bag is used to indicate described destination node and carries out read and/or write to the internal storage data of described destination node.

In the first possible implementation of first aspect, described in be packaged as one merge request handbag draw together:

Described merging bag mark is set to predetermined value, described predetermined value instruction described request bag for described in the merging bags that close of at least two son request packages;

Obtain the number of son request bag, by described number write described son request bag number mark.

In conjunction with the first possible implementation of first aspect or first aspect, in the implementation that the second is possible, described in described parsing, the destination node of each request bag to be sent identifies, and judges that the destination node of each request bag to be sent described identifies whether identical comprising:

Obtain the destination node mark of carrying in each request bag to be sent;

Judge whether the destination node mark of each request bag to be sent described is identical;

Described be packaged as one merge request handbag draw together:

Extract the destination node mark in described son request bag, and described destination node mark is placed in the described public packet header merging request bag.

In conjunction with the first possible implementation of first aspect or first aspect, in the implementation that the third is possible, described in described parsing, the destination node of each request bag to be sent identifies, and judges that the destination node of each request bag to be sent described identifies whether identical comprising:

Obtain the destination node memory address carried in each request bag to be sent;

According to described destination node memory address, in address attribution table, search the destination node mark of described destination node memory address ownership, the mapping table that for the purpose of described address attribution table, node memory address and destination node identify;

Judge whether the destination node mark of each request bag to be sent described is identical.

The implementation possible in conjunction with the second of first aspect or the third possible implementation, in the 4th kind of possible implementation, described son request handbag draws together write request attached bag and/or read request attached bag, write request attached bag packet header comprises the write request mark identifying described write request attached bag, write request information in described write request attached bag comprises the data of described destination node to be written and described destination node memory address to be written, read request attached bag packet header comprises the read request mark identifying described read request attached bag, read request information in described read request attached bag comprises the described destination node memory address residing for data to be read, described method also comprises:

Receive the write request response message that described destination node sends, in described write request response message, comprise the write request mark that the successful described write request attached bag of write request is corresponding; And/or,

Receive the read request response message that described destination node sends, the read request mark that the successful described read request attached bag of read request is corresponding is comprised in described read request response message, and the useful load read, described useful load is the data that described read request attached bag medium-long range memory address is corresponding.

In conjunction with the first possible implementation of first aspect or first aspect or the possible implementation of the second or the third possible implementation or the 4th kind of possible implementation, in the 5th kind of possible implementation, described in described parsing, the destination node of each request bag to be sent identifies, and judges that the destination node of each request bag to be sent described identifies whether identical comprising:

The destination node mark corresponding according to each request bag to be sent described, search the routed port that described destination node mark is corresponding in the routing table, described routing table comprises routed port corresponding to described destination node mark, and described routed port is the port that described request bag to be sent arrives on the path of described destination node;

Judge that whether the routed port of each request bag to be sent described is identical.

Second aspect, the invention provides a kind of read-write processing method of internal storage data, comprising:

Receive request bag;

Whether judge to carry in the request bag received and merge bag mark, described merging bag mark, described son request handbag is drawn together: read request attached bag, and/or write request attached bag if being used to indicate the merging request bag that described request bag is the conjunction of at least two son request packages;

When carrying merging bag mark in described request bag, determine that described request bag is for merging request bag, described merging request comprises public packet header and son request bag, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, and described son request handbag contains son request handbag head and sub-solicited message;

Merge the sub-request bag number mark and every height request handbag head of carrying in request bag according to described, extract in described merging request bag and ask bag number to identify the sub-request bag of corresponding number with described son;

According to described every height request handbag head and sub-solicited message, the sub-request bag that process is corresponding.

In the first possible implementation of second aspect, described according to described every height request handbag head and sub-solicited message, the sub-request handbag of process correspondence is drawn together:

According to the data to be written in the write request information of the write request mark in write request attached bag packet header, described write request attached bag and destination node memory address to be written, described data to be written are write described destination node memory address; And/or,

According to the read request mark in read request attached bag packet header, and the destination node memory address residing for data to be read in the read request information of described read request attached bag, in described destination node memory address, read described data to be read.

In conjunction with the first possible implementation of second aspect, in the implementation that the second is possible, ask with described son after bag number identifies the sub-request bag of corresponding number, also to comprise in described extraction described merging request bag:

Described source node identification is write in the sub-request handbag head of every height request bag, so that described destination node sends response message to described source node.

In conjunction with the implementation that the second of second aspect is possible, in the implementation that the third is possible, described destination node sends response message to described source node and comprises:

Judge that whether the source node identification that each response message to be sent is corresponding is identical;

To have the response message described to be sent of identical sources node identification as sub-response message, be packaged as one and merge response message bag, described merging response message bag comprises the sub-response message of write request and/or the sub-response message of read request;

Described merging response message bag is sent to the source node that described source node identification is corresponding.

In the 4th kind of possible implementation of second aspect, when described destination node is routed port, ask with described son after bag number identifies the sub-request bag of corresponding number, also to comprise in described extraction described merging request bag:

Extract the source node identification in the described public packet header merging request bag, write in the packet header of every height request bag.

The third aspect, the invention provides a kind of read-write treating apparatus of internal storage data, comprising:

Acquiring unit, for obtaining each request bag to be sent, described request handbag to be sent is drawn together: read request packet, and/or write request bag;

Judging unit, for resolving the destination node mark of each request bag to be sent described, and judges whether the destination node mark of each request bag to be sent described is identical;

Processing unit, for described at least two requests to be sent with identical destination node mark are wrapped as sub-request bag, be packaged as one and merge request bag, described merging request comprises public packet header and at least two son request bags, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described merge bag mark be used to indicate described request bag for described at least two son request package close merging bags, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, described son request handbag is containing son request handbag head and sub-solicited message,

Transmitting element, for sending to described destination node to identify corresponding destination node the described request bag that merges, described merging request bag is used to indicate described destination node and carries out read and/or write to the internal storage data of described destination node.

In the first possible implementation of the third aspect, described processing unit comprises:

First identification module, for described merging bag mark is set to predetermined value, described predetermined value instruction described request bag for described in the merging bags that close of at least two son request packages;

Second identification module, for obtaining the number of son request bag, by described number write described son request bag number mark.

In conjunction with the first possible implementation of the third aspect or the third aspect, in the implementation that the second is possible, described judging unit comprises:

First acquisition module, for obtaining the destination node mark of carrying in each request bag to be sent;

Whether the first judge module is identical for judging the destination node mark of each request bag to be sent described;

Described processing unit also comprises:

3rd identification module, for extracting the destination node mark in described son request bag, and is placed in the described public packet header merging request bag by described destination node mark.

In conjunction with the first possible implementation of the third aspect or the third aspect, in the implementation that the third is possible, described judging unit comprises:

Second acquisition module, for obtaining the destination node memory address carried in each request bag to be sent;

First searches module, for according to described destination node memory address, searches the destination node mark of described destination node memory address ownership, the mapping table that for the purpose of described address attribution table, node memory address and destination node identify in address attribution table;

Whether the second judge module is identical for judging the destination node mark of each request bag to be sent described.

The implementation possible in conjunction with the second of the third aspect or the third possible implementation, in the 4th kind of possible implementation, the described merging that described processing unit obtains asks the sub-request handbag comprised to draw together write request attached bag and/or read request attached bag, write request attached bag packet header comprises the write request mark identifying described write request attached bag, write request information in described write request attached bag comprises the data of described destination node to be written and described destination node memory address to be written, read request attached bag packet header comprises the read request mark identifying described read request attached bag, read request information in described read request attached bag comprises the described destination node memory address residing for data to be read, described device also comprises:

Receiving element, for receiving the write request response message that described destination node sends, comprises the write request mark that the successful described write request attached bag of write request is corresponding in described write request response message; And/or, for receiving the read request response message that described destination node sends, the read request mark that the successful described read request attached bag of read request is corresponding is comprised in described read request response message, and the useful load read, described useful load is the data that described read request attached bag medium-long range memory address is corresponding.

In conjunction with the first possible implementation of the third aspect or the third aspect or the possible implementation of the second or the third possible implementation or the 4th kind of possible implementation, in the 5th kind of possible implementation, described judging unit also comprises:

Second searches module, for the destination node mark corresponding according to each request bag to be sent described, search the routed port that described destination node mark is corresponding in the routing table, described routing table comprises routed port corresponding to described destination node mark, and described routed port is the port that described request bag to be sent arrives on the path of described destination node;

Whether the 3rd judge module is identical for judging the routed port of each request bag to be sent described.

Fourth aspect, the invention provides a kind of read-write treating apparatus of internal storage data, comprising:

Receiving element, for receiving request bag;

Judging unit, for judge receive request bag in whether carry merge bag mark, described merging bag mark is used to indicate the merging request bags that described request bag is the conjunction of at least two son request packages, and described son request handbag is drawn together: read request attached bag, and/or write request attached bag;

Determining unit, for when carrying merging bag mark in described request bag, determine that described request bag is for merging request bag, described merging request comprises public packet header and son request bag, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, and described son request handbag contains son request handbag head and sub-solicited message;

Extraction unit, for merging the sub-request bag number mark and every height request handbag head of carrying in request bag according to described, extracting in described merging request bag and asking bag number to identify the sub-request bag of corresponding number with described son;

Processing unit, for according to described every height request handbag head and sub-solicited message, processes corresponding sub-request bag.

In the first possible implementation of fourth aspect, described processing unit comprises:

First processing module, for according to the data to be written in the write request information of the write request mark in write request attached bag packet header, described write request attached bag and destination node memory address to be written, described data to be written are write described destination node memory address;

Second processing module, for identifying according to the read request in read request attached bag packet header, and the destination node memory address residing for data to be read in the read request information of described read request attached bag, in described destination node memory address, read described data to be read.

In conjunction with the first possible implementation of fourth aspect, in the implementation that the second is possible, described device also comprises:

Mark writing unit, for being write by described source node identification in the sub-request handbag head of every height request bag, so that described destination node sends response message to described source node.

In conjunction with the implementation that the second of fourth aspect is possible, in the implementation that the third is possible, whether described judging unit is also identical for judging the source node identification that each response message to be sent is corresponding;

Described processing unit, also for there is the response message described to be sent of identical sources node identification as sub-response message, be packaged as one and merge response message bag, described merging response message bag comprises the sub-response message of write request and/or the sub-response message of read request;

Described device also comprises:

Transmitting element, for sending to described merging response message bag the source node that described source node identification is corresponding.

In the 4th kind of possible implementation of fourth aspect, when described destination node is routed port, described processing unit, also for extracting the source node identification in the described public packet header merging request bag, writes in the packet header of every height request bag.

The read-write processing method of a kind of internal storage data that the embodiment of the present invention provides and device, source node obtains each request bag to be sent, described request handbag to be sent is drawn together: read request packet, and/or write request bag, then the destination node mark of each request bag to be sent described is resolved, and judge whether the destination node mark of each request bag to be sent described is identical, described at least two requests to be sent with identical destination node mark are wrapped as sub-request bag, be packaged as one and merge request bag, described destination node is sent to identify corresponding destination node the described request bag that merges, described merging request bag is used to indicate described destination node and carries out read and/or write to the internal storage data of described destination node.The embodiment of the present invention solves the less internal storage data read-write operation of multiple data volume in prior art and wastes more expense and wrap in request of data, causes the problem that transfer efficiency is low, improves the utilization ratio of link.

Accompanying drawing explanation

In order to be illustrated more clearly in the technical scheme of the embodiment of the present invention, be briefly described to the accompanying drawing used required in the embodiment of the present invention below, apparently, accompanying drawing described is below only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.

The process flow diagram of the read-write processing method of a kind of internal storage data that Fig. 1 provides for the embodiment of the present invention;

Fig. 2 is a kind of schematic diagram of read request packet form;

Fig. 3 is a kind of schematic diagram of write request packet format;

Fig. 4 is the schematic diagram of another kind of read request packet form;

Fig. 5 is the schematic diagram of another kind of write request packet format;

A kind of schematic diagram merging write request packet format that Fig. 6 provides for the embodiment of the present invention;

A kind of schematic diagram merging read request packet form that Fig. 7 provides for the embodiment of the present invention;

A kind of schematic diagram merging read-write requests packet format that Fig. 8 provides for the embodiment of the present invention;

The schematic diagram of the another kind merging write request packet format that Fig. 9 provides for the embodiment of the present invention;

The schematic diagram of the another kind merging read request packet form that Figure 10 provides for the embodiment of the present invention;

The schematic diagram of the another kind merging read-write requests packet format that Figure 11 provides for the embodiment of the present invention;

The process flow diagram of the read-write processing method of the another kind of internal storage data that Figure 12 provides for the embodiment of the present invention;

The process flow diagram of the read-write processing method of another internal storage data that Figure 13 provides for the embodiment of the present invention;

The structural drawing of the read-write treating apparatus of a kind of internal storage data that Figure 14 provides for the embodiment of the present invention;

The structural drawing of processing unit in the read-write treating apparatus of a kind of internal storage data that Figure 15 provides for the embodiment of the present invention;

The structural drawing of the read-write treating apparatus of another internal storage data that Figure 16 provides for the embodiment of the present invention;

The structural drawing of judging unit in the read-write treating apparatus of a kind of internal storage data that Figure 17 provides for the embodiment of the present invention;

The structural drawing of the read-write treating apparatus of the another kind of internal storage data that Figure 18 provides for the embodiment of the present invention;

The structural drawing of judging unit in the read-write treating apparatus of a kind of internal storage data that Figure 19 provides for the embodiment of the present invention;

The structural drawing of the read-write treating apparatus of the another kind of again internal storage data that Figure 20 provides for the embodiment of the present invention;

The structural drawing of processing unit in the read-write treating apparatus of the another kind of again internal storage data that Figure 21 provides for the embodiment of the present invention;

The structural drawing of the read-write treating apparatus of another internal storage data that Figure 22 provides for the embodiment of the present invention;

The structural drawing of the read-write treating apparatus of another internal storage data again that Figure 23 provides for the embodiment of the present invention;

The hardware structure diagram of the read-write treating apparatus of a kind of internal storage data that Figure 24 provides for the embodiment of the present invention;

The hardware structure diagram of the read-write treating apparatus of another internal storage data that Figure 25 provides for the embodiment of the present invention.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.

When local internal memory and long-distance inner carry out data interaction, more expense can be wasted for the internal storage data read-write operation that data volume is less to wrap in request of data, cause transfer efficiency low, the embodiment of the present invention provides a kind of read-write processing method of internal storage data, the request with identical destination node address is merged, improve the utilization factor of link, the executive agent source node of the method for the embodiment of the present invention can be computer node (also can be described as computing node), as shown in Figure 1, the method comprises the following steps:

101, obtain each request bag to be sent, described request handbag to be sent is drawn together: read request packet, and/or write request bag.

Read request packet drawn together by each request handbag to be sent that described source node obtains, and/or write request bag.

102, resolve the destination node mark of each request bag to be sent described, and judge whether the destination node mark of each request bag to be sent described is identical.

Wherein, above-mentioned steps 102 can be realized by two kinds of modes.

Mode one: first obtain the destination node mark of carrying in each request bag to be sent, then judges whether the destination node mark of each request bag to be sent described is identical.

In mode one, before described source node carries out internal storage data read-write process to destination node, send internal memory with reference to source node described in prior art to described destination node and use request, described destination node accepts or refusal according to the Determines of self EMS memory, after described destination node accepts the request of described source node, the memory address of distribution and address size are sent to described source node by described destination node, described source node is that this section of memory address of described destination node distributes local memory address, and set up address mapping table, described address mapping table is that local memory address and described destination node identify and the map listing of memory address of described destination node.

When described source node reads or writes request bag to described destination node transmission, described request bag comprises the memory address of described source node identification, described destination node mark and described destination node, the memory address of wherein said destination node mark and described destination node, be by described source node after getting the request carrying local memory address, utilize described address mapping table, found by described local memory address, be illustrated in figure 2 read request packet to be sent, Figure 3 shows that write request bag to be sent.By obtaining the destination node mark of carrying in the request bag to be sent shown in Fig. 2 and/or Fig. 3, and judge whether the destination node mark of each request bag to be sent described is identical.

Mode two: obtain the destination node memory address carried in each request bag to be sent; According to described destination node memory address, in address attribution table, search the destination node mark of described destination node memory address ownership, the mapping table that for the purpose of described address attribution table, node memory address and destination node identify; Judge whether the destination node mark of each request bag to be sent described is identical.

In mode two, PCIE is adopted to be example explanation, described read request packet to be sent as shown in Figure 4, described write request bag to be sent as shown in Figure 5, wherein, the address of carrying in described read request packet to be sent and described write request bag to be sent is described destination node memory address, the destination node mark of described destination node memory address ownership is searched in address attribution table, the mapping table that for the purpose of described address attribution table, node memory address and destination node identify, such as, in described address attribution table, when described destination node memory address is 0H1000-0H1fff, corresponding destination node is designated 1, when described destination node memory address is 0H2000-0H2fff, corresponding destination node is designated 2, when described destination node memory address is 0H3000-0H2fff, corresponding destination node is designated 3.After getting the destination node memory address carried in described request bag to be sent, obtain destination node mark corresponding to destination node memory address according to address above mentioned ownership table.

Such as, when the described destination node memory address carried in described read request packet to be sent is 0H1001, when the described destination node memory address carried in described write request bag to be sent is 0H1ff0, described read request packet to be sent and described write request Bao Jun to be sent are present in described destination node and are designated in destination node memory address range corresponding in 1, and therefore described read request packet to be sent is identical with the destination node mark of described write request bag to be sent.

103, described at least two requests to be sent with identical destination node mark are wrapped as sub-request bag, be packaged as one and merge request bag, described merging request comprises public packet header and at least two son request bags, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described merge bag mark be used to indicate described request bag for described at least two son request package close merging bags, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, described son request handbag is containing son request handbag head and sub-solicited message.

When being asked by son bag to be packaged into merging request bag, public packet header and son request bag is comprised in described merging request, comprise in described public packet header and merge bag mark (Combine, C), be used to indicate described request bag for described at least two son request package close merging bags, and described merging bag mark is set to predetermined value, described predetermined value instruction described request bag for described in the merging bags that close of at least two son request packages, such as represent time C=" 1 " that request bag is for merging request bag; Comprise son request bag number mark (Combined Requests Number, CR NUM), be used to indicate the described number merging the sub-request bag that request bag carries, when being packaged as merging request bag, obtain the number of son request bag, by described number write described son request bag number mark; Also comprise source node identification (Requester ID), be used to indicate described merging request and wrap the source node sent, the namely mark of local source node, in the public packet header that described merging request is wrapped in addition, also comprise the public information in each height request handbag head.The described sub-request handbag merged in request bag contains son request handbag head and sub-solicited message, described son request handbag head comprises type (Type) and the length of described son request bag, wherein length is specially transaction layer packet length (Transaction LayPacket, TLP length).Wherein, type is write request attached bag or read request attached bag for distinguishing described son request bag.

Wherein, the write request attached bag with identical destination node mark can be packaged into one and merge write request bag, or the read request attached bag with identical destination node mark is packaged into one and merges read request packet, or in order to improve link utilization further, the write request attached bag and read request attached bag with identical destination node mark are packaged into one and merge read-write requests bag, here do not limit.

Packed in the merging request bag that obtains by the mode one in above-mentioned steps 102, need to extract the destination node mark in described son request bag, and described destination node mark is placed in the described public packet header merging request bag.As shown in Figure 6, being the merging write request bag obtained, as shown in Figure 7, is the merging read request packet obtained, and as shown in Figure 8, is the merging read-write requests bag obtained.

Being packed in the merging request bag that obtains by the mode two in above-mentioned steps 102, being illustrated in figure 9 the merging write request bag obtained, the merging read request packet as shown in Figure 10 for obtaining, the merging read-write requests bag as shown in figure 11 for obtaining.In addition, in the merging request bag obtained in pass-through mode two every height request bag packet header in also comprise request coding, being the coding of described source node antithetical phrase request bag, is the unique identification of every height request bag.

104, send to described destination node to identify corresponding destination node the described request bag that merges, described merging request bag is used to indicate described destination node and carries out read and/or write to the internal storage data of described destination node.

The read-write processing method of a kind of internal storage data that the embodiment of the present invention provides, source node obtains each request bag to be sent, and resolve the destination node mark of each request bag to be sent described, judge whether the destination node mark of each request bag to be sent described is identical, then described at least two requests to be sent with identical destination node mark are wrapped as sub-request bag, be packaged as one and merge request bag, the most described request bag that merges sends to described destination node to identify corresponding destination node, described merging request bag is used to indicate described destination node and carries out read and/or write to the internal storage data of described destination node.The embodiment of the present invention solves the less internal storage data accessing operation of multiple data volume in prior art and wastes more expense and wrap in request of data, causes the problem that transfer efficiency is low, improves the utilization ratio of link.

The embodiment of the present invention also provides a kind of read-write processing method of internal storage data, the executive agent destination node of the method for the embodiment of the present invention, and can be a remote computer node, as shown in figure 12, the method comprises the steps:

1201, request bag is received;

Whether 1202, judge to carry in the request bag of reception to merge bag mark, described merging, described sub-request handbag is drawn together: read request attached bag, and/or write request attached bag if wrapping mark and being used to indicate the merging request bags that described request bag is the conjunction of at least two son request packages.

When described destination node receives request bag, first judging whether to include in described request bag to merge and wrap mark C, such as, when judging C=" 1 ", representing that described request bag asks bag for merging.

1203, when carrying merging bag mark in described request bag, determine that described request bag is for merging request bag, described merging request comprises public packet header and son request bag, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, and described son request handbag contains son request handbag head and sub-solicited message;

1204, merge the sub-request bag number mark and every height request handbag head of carrying in request bag according to described, extract in described merging request bag and ask bag number to identify the sub-request bag of corresponding number with described son.

When the request bag determining to receive is for merging request bag, described merging in the public packet header of request bag merges bag mark except including, also comprise son request bag number mark and source node identification, its neutron request bag number mark is used to indicate the described number merging the sub-request bag that request bag carries, and source node identification is used to indicate described merging request and wraps the source node sent.Son request handbag head and sub-solicited message is comprised in every height request bag.

The sub-request bag number mark and every height request handbag head of carrying in request bag is merged by described, extracting in described merging request bag asks bag number to identify the sub-request bag of corresponding number with described son, wherein, the type in son request bag number mark and every height request handbag head and length can be utilized, or utilize form, type and the length in son request bag number mark and every height request handbag head, extract in described merging request bag and ask bag number to identify the sub-request bag of corresponding number with described son.

1205, according to described every height request handbag head and sub-solicited message, the sub-request bag that process is corresponding.

Wherein, due to write request attached bag and/or read request attached bag may be included in described merging request bag, the form in handbag head and/or type can be asked to carry out differentiation write request attached bag and read request attached bag according to son, thus the write request attached bag of difference request and read request attached bag are carried out different process.

With reference in prior art, for sub-write request, according to the described destination node memory address carried in described write request attached bag and useful load, described useful load is write on described destination node memory address; For sub-read request, according to the described destination node memory address carried in described read request attached bag, read the content on described destination node memory address, and return to described source node.

The read-write processing method of a kind of internal storage data that the embodiment of the present invention provides, whether destination node judges to carry in the request bag received to merge to wrap mark, when carrying merging bag mark in described request bag, determine that described request bag is for merging request bag, then the sub-request bag number mark and every height request handbag head of carrying in request bag is merged according to described, extracting in described merging request bag asks bag number to identify the sub-request bag of corresponding number with described son, final according to described every height request handbag head and sub-solicited message, the sub-request bag that process is corresponding.The embodiment of the present invention solves the less internal storage data accessing operation of multiple data volume in prior art and wastes more expense and wrap in request of data, causes the problem that transfer efficiency is low, improves the utilization ratio of link.

The embodiment of the present invention can be applied in RDMA, the request bag to be sent in the internal storage data of one computing node with identical destination node is carried out packing to merge, send to the remote computing nodes that described destination node is corresponding together, specifically request is sent to local memory controller by local Cache, carry out packing merging treatment, then send to long-distance inner controller to carry out process of unpacking, the request obtained is sent to long-range Cache.The present embodiment is described for PCIE, Fig. 4 is read request packet form in Standard PC IE, Fig. 5 is write request packet format, wherein form and type are used for distinguishing described request bag is read request packet or write request bag, transaction layer packet length is for representing described request packet length, source node identification is used to indicate the source node sending described request bag, address in read request packet represents the address of the internal storage data that described read request packet will read, address in described write request bag represents the useful load of will carry in described write request bag, the memory address write, the implication of other fields can with reference to the packet format of PCIE in prior art.Introduce a kind of read-write processing method of internal storage data below in detail for above-mentioned application scenarios, as shown in figure 13, the method comprises the following steps:

1301, source node obtains each request bag to be sent, and described request handbag to be sent is drawn together: read request packet, and/or write request bag;

1302, described source node resolves the destination node mark of each request bag to be sent described, and judges whether the destination node mark of each request bag to be sent described is identical.

Obtain the destination node memory address carried in each request bag to be sent; According to described destination node memory address, in address attribution table, search the destination node mark of described destination node memory address ownership, the mapping table that for the purpose of described address attribution table, node memory address and destination node identify; Judge whether the destination node mark of each request bag to be sent described is identical.

Described read request packet to be sent as shown in Figure 4, described write request bag to be sent as shown in Figure 5, wherein, the address of carrying in described read request packet to be sent and described write request bag to be sent is described destination node memory address, the destination node mark of described destination node memory address ownership is searched in address attribution table, the mapping table that for the purpose of described address attribution table, node memory address and destination node identify, such as, in described address attribution table, when described destination node memory address is 0H1000-0H1fff, corresponding destination node is designated 1, when described destination node memory address is 0H2000-0H2fff, corresponding destination node is designated 2, when described destination node memory address is 0H3000-0H2fff, corresponding destination node is designated 3.After getting the destination node memory address carried in described request bag to be sent, obtain destination node mark corresponding to destination node memory address according to address above mentioned ownership table.

1303, described at least two requests to be sent with identical destination node mark are wrapped as sub-request bag by described source node, be packaged as one and merge request bag, described merging request comprises public packet header and at least two son request bags, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described merge bag mark be used to indicate described request bag for described at least two son request package close merging bags, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, described son request handbag is containing son request handbag head and sub-solicited message.

Wherein, the write request attached bag with identical destination node mark can be packaged into one and merge write request bag, or the read request attached bag with identical destination node mark is packaged into one and merges read request packet, or in order to improve link utilization further, the write request attached bag and read request attached bag with identical destination node mark are packaged into one and merge read-write requests bag, so described merging request comprises write request attached bag and/or read request attached bag.

When being asked by son bag to be packaged into merging request bag, public packet header and son request bag is comprised in described merging request, comprise in described public packet header and merge bag mark (Combine, C), being used to indicate described request bag is the merging request bag that multiple son request package closes, such as, represent time C=" 1 " that request bag is for merging request bag; Comprise son request bag number mark (Combined RequestsNumber, CR NUM), be used to indicate the described number merging the sub-request bag that request bag carries, also comprise source node identification (Requester ID), be used to indicate the described source node merging request bag and send, the namely mark of local source node, also comprises the public information in each height request handbag head in the public packet header that described merging request is wrapped in addition.The described sub-request handbag merged in request bag contains son request handbag head and sub-solicited message, described son request handbag head comprises the form (Fmt) of described son request bag, type (Type) and length, wherein length is specially transaction layer packet length (Transaction Lay Packet, TLP length).Wherein, form and type are write request attached bag or read request attached bag for distinguishing described son request bag.

In addition, request coding is also comprised in the packet header of every height request bag, it is the coding of described source node antithetical phrase request bag, it is the unique identification of every height request bag, so that described source node is when receiving the response message that described destination node returns, determine the performance of described son request according to the request coding carried in described response message.

Specifically as shown in Figure 10, two read request attached bags are merged and obtains merging read request packet, merging bag mark in figure and son request bag number mark are new extraneous informations of adding, wherein said son request bag number identification length is 4 bits, and the number of the read request attached bag comprised in described merging read request packet can be indicated to be 16.Request coding (namely marking) field is natively included in PCIE, length is 8 bits, in described merging read request packet, high 4 bits of this field are shared, 0-3 bit is used for distinguishing different read request attached bags, can distinguish 16 read request attached bags, the number of asking bag number identification field to represent with described son matches.Wherein, traffic class (TC), pollution reservation position (EP), attribute (Attr) and source node identification (Requester ID) belong to the public packet header in described merging read request packet; Form (Fmt), type (Type), whether have ECRC(TD), transaction layer packet length (TLP length), request coding (Request Coding), last byte-aligned (Last DW BE) and the first byte-aligned (1st DW BE) belong to read request attached bag packet header, the implication of above-mentioned field can with reference to read request packet form in PCIE in prior art.

As shown in Figure 9, two write request attached bags are merged and obtains merging write request bag, comprise the implication comprising field in the implication of field and the merging read request packet shown in Figure 10 in described merging write request bag similar, just also include the useful load that will write destination node in each write request attached bag.

In order to improve link utilization further, the write request attached bag that identical destination node can be identified and read request attached bag are packaged into one and merge request bag, as shown in figure 11.

For the sub-request in above-mentioned merging request bag, packing to be carried out according to the transmission sequencing of described son request and merge.

1304, the described request bag that merges sends to described destination node to identify corresponding destination node by described source node, and described merging request bag is used to indicate described destination node and carries out read and/or write to the internal storage data of described destination node.

1305, described destination node receives request bag;

1306, whether described destination node judges to carry in the request bag received to merge to wrap mark, described merging bag mark is used to indicate the merging request bags that described request bag is the conjunction of at least two son request packages, described son request handbag is drawn together: read request attached bag, and/or write request attached bag.

1307, when carrying merging bag mark in described request bag, determine that described request bag is for merging request bag, described merging request comprises public packet header and son request bag, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, and described son request handbag contains son request handbag head and sub-solicited message;

1308, merge the sub-request bag number mark and every height request handbag head of carrying in request bag according to described, extract in described merging request bag and ask bag number to identify the sub-request bag of corresponding number with described son.

When judging described request bag as merging request bag, according to described son request bag number mark, and the form of every height request bag, type and length, obtain every height request bag.In addition, due to write request attached bag and/or read request attached bag may be included in described merging request bag, the form in handbag head and type can be asked to carry out differentiation write request attached bag and read request attached bag according to son, thus the write request attached bag of difference request and read request attached bag are carried out different process.

1309, according to described every height request handbag head and sub-solicited message, the sub-request bag that process is corresponding.

According to the data to be written in the write request information of the write request mark in write request attached bag packet header, described write request attached bag and destination node memory address to be written, described data to be written are write described destination node memory address; And/or, according to the read request mark in read request attached bag packet header, and the destination node memory address residing for data to be read in the read request information of described read request attached bag, in described destination node memory address, read described data to be read.

Further, after described destination node antithetical phrase request bag processes, be convenient to send response message to described source node, described source node identification is write in the sub-request handbag head of every height request bag, also described other information in public packet header merged in request bag can be write in the sub-request handbag head of every height request bag in addition, make every height request bag convert merging to before form.

In addition, described destination node, after antithetical phrase request process, can return response message to described source node, to inform the performance of the every height request of described source node.Can be fed back by following two kinds of modes:

Mode one:

The response message of the sub-request bag after process sends by described destination node respectively:

Obtain the described source node identification in described write request attached bag;

The source node corresponding to described source node identification sends write request response message, comprises the write request mark that the successful described write request attached bag of write request is corresponding in described write request response message.

Wherein, when described write request attached bag is non-propelling movement type write request, needs described destination node to send feedback to described source node, or the write request attached bag of write request can have been required, all send response message to described source node.

Described source node receives the write request response message that described destination node sends, and comprises the write request mark that the successful described write request attached bag of write request is corresponding in described write request response message.

With reference in prior art, described source node is after receiving write request response message, according to the write request mark of carrying, identify with the write request in the write request attached bag sent and contrast, which can obtain write request attached bag successfully to write in described destination node, which write request attached bag does not write, and successfully asks bag again to send for not having write request.

And/or,

Described destination node obtains the described source node identification in described read request attached bag;

The source node corresponding to described source node identification sends read request response message, the request coding that the successful described read request attached bag of read request is corresponding is comprised in described read request response message, and the useful load obtained, described useful load is the data that described sub-read request obtains.

Described source node receives the read request response message that described destination node sends, the read request mark that the successful described read request attached bag of read request is corresponding is comprised in described read request response message, and the useful load obtained, described useful load is the data that described sub-read request obtains.

Useful load in described read request attached bag is the data that described destination node arrives according to the long-distance inner address acquisition in described read request attached bag, read request response message corresponding for the sub-read request successfully getting useful load is sent to described source node by described destination node, described source node is after receiving described useful load, during according to transmission described read request attached bag, which address of local terminal recorded needs to read data, according to described read request mark, the useful load of correspondence is read back into appropriate address.

Mode two:

Described source node, after getting described merging response message bag, obtains corresponding response message according to the write request mark in this bag and/or read request mark, the processing mode after acquisition with describe in mode one identical, repeat no more herein.

Method in the embodiment of the present invention, also the data transmission between the multiple ports in system can be applied to, the destination node mark corresponding according to each request bag to be sent described, search the routed port that described destination node mark is corresponding in the routing table, described routing table comprises routed port corresponding to described destination node mark, described routed port is the port that described request bag to be sent arrives on the path of described destination node, judge that whether the routed port of each request bag to be sent described is identical, the request bag to be sent with identical routed port is merged, obtain merging request bag, and described merging request bag is sent to described routed port.Described routed port carries out operation of unpacking after receiving described merging request bag, extracts the source node identification in the described public packet header merging request bag, writes in the packet header of every height request bag, then continues forwarding operation below.

The embodiment of the present invention provides a kind of read-write treating apparatus 14 of internal storage data, the read-write treating apparatus 14 of described internal storage data may reside in computing node, also can be exactly a computing node, as shown in figure 14, described device comprises acquiring unit 141, judging unit 142, processing unit 143 and transmitting element 144.

Wherein, acquiring unit 141, for obtaining each request bag to be sent, described request handbag to be sent is drawn together: read request packet, and/or write request bag;

Judging unit 142, for resolving the destination node mark of each request bag to be sent described, and judges whether the destination node mark of each request bag to be sent described is identical;

Processing unit 143, for described at least two requests to be sent with identical destination node mark are wrapped as sub-request bag, be packaged as one and merge request bag, described merging request comprises public packet header and at least two son request bags, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described merge bag mark be used to indicate described request bag for described at least two son request package close merging bags, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, described son request handbag is containing son request handbag head and sub-solicited message,

Transmitting element 144, for sending to described destination node to identify corresponding destination node the described request bag that merges, described merging request bag is used to indicate described destination node and carries out read and/or write to the internal storage data of described destination node.

The read-write treating apparatus of a kind of internal storage data that the embodiment of the present invention provides, obtain each request bag to be sent, and resolve the destination node mark of each request bag to be sent described, judge whether the destination node mark of each request bag to be sent described is identical, then described at least two requests to be sent with identical destination node mark are wrapped as sub-request bag, be packaged as one and merge request bag, the most described request bag that merges sends to described destination node to identify corresponding destination node, described merging request bag is used to indicate described destination node and carries out read and/or write to the internal storage data of described destination node.The embodiment of the present invention solves the less teledata accessing operation of multiple data volume in prior art and wastes more expense and wrap in request of data, causes the problem that transfer efficiency is low, improves the utilization ratio of link.

Optionally, as shown in figure 15, described processing unit comprises:

First identification module 151, for described merging bag mark is set to predetermined value, described predetermined value instruction described request bag for described in the merging bags that close of at least two son request packages;

Second identification module 152, for obtaining the number of son request bag, by described number write described son request bag number mark.

Optionally, as shown in figure 16, described judging unit comprises:

First acquisition module 161, for obtaining the destination node mark of carrying in each request bag to be sent;

Whether the first judge module 162 is identical for judging the destination node mark of each request bag to be sent described;

Described processing unit also comprises:

3rd identification module 163, for extracting the destination node mark in described son request bag, and is placed in the described public packet header merging request bag by described destination node mark.

Optionally, as shown in figure 17, described judging unit comprises:

Second acquisition module 171, for obtaining the destination node memory address carried in each request bag to be sent;

First searches module 172, for according to described destination node memory address, the destination node mark of described destination node memory address ownership is searched, the mapping table that for the purpose of described address attribution table, node memory address and destination node identify in address attribution table;

Whether the second judge module 173 is identical for judging the destination node mark of each request bag to be sent described.

Optionally, the described merging that described processing unit obtains asks the sub-request handbag comprised to draw together write request attached bag and/or read request attached bag, write request attached bag packet header comprises the write request mark identifying described write request attached bag, write request information in described write request attached bag comprises the data of described destination node to be written and described destination node memory address to be written, read request attached bag packet header comprises the read request mark identifying described read request attached bag, read request information in described read request attached bag comprises the described destination node memory address residing for data to be read, as shown in figure 18, described device also comprises:

Receiving element 181, for receiving the write request response message that described destination node sends, comprises the write request mark that the successful described write request attached bag of write request is corresponding in described write request response message; And/or, for receiving the read request response message that described destination node sends, the read request mark that the successful described read request attached bag of read request is corresponding is comprised in described read request response message, and the useful load read, described useful load is the data that described read request attached bag medium-long range memory address is corresponding.

Optionally, as shown in figure 19, described judging unit also comprises:

Second searches module 191, for the destination node mark corresponding according to each request bag to be sent described, search the routed port that described destination node mark is corresponding in the routing table, described routing table comprises routed port corresponding to described destination node mark, and described routed port is the port that described request bag to be sent arrives on the path of described destination node;

Whether the 3rd judge module 192 is identical for judging the routed port of each request bag to be sent described.

Correspondingly, the embodiment of the present invention also provides a kind of read-write treating apparatus 20 of internal storage data, the read-write treating apparatus 20 of described internal storage data may reside in computing node, also can be exactly a computing node, as shown in figure 20, described device comprises receiving element 201, judging unit 202, determining unit 203, extraction unit 204 and processing unit 205.

Receiving element 201, for receiving request bag;

Judging unit 202, for judge receive request bag in whether carry merge bag mark, described merging bag mark is used to indicate the merging request bags that described request bag is the conjunction of at least two son request packages, and described son request handbag is drawn together: read request attached bag, and/or write request attached bag;

Determining unit 203, for when carrying merging bag mark in described request bag, determine that described request bag is for merging request bag, described merging request comprises public packet header and son request bag, comprise in described public packet header and merge bag mark, son request bag number mark and source node identification, described son request bag number mark is used to indicate the number that the sub-request bag carried is wrapped in described merging request, and described son request handbag contains son request handbag head and sub-solicited message;

Extraction unit 204, for merging the sub-request bag number mark and every height request handbag head of carrying in request bag according to described, extracting in described merging request bag and asking bag number to identify the sub-request bag of corresponding number with described son;

Processing unit 205, for according to described every height request handbag head and sub-solicited message, processes corresponding sub-request bag.

The read-write treating apparatus of a kind of internal storage data that the embodiment of the present invention provides, judge whether to carry in the request bag received and merge bag mark, when carrying merging bag mark in described request bag, determine that described request bag is for merging request bag, then the sub-request bag number mark and every height request handbag head of carrying in request bag is merged according to described, extracting in described merging request bag asks bag number to identify the sub-request bag of corresponding number with described son, final according to described every height request handbag head and sub-solicited message, the sub-request bag that process is corresponding.The embodiment of the present invention solves the less teledata accessing operation of multiple data volume in prior art and wastes more expense and wrap in request of data, causes the problem that transfer efficiency is low, improves the utilization ratio of link.

Optionally, as shown in figure 21, described processing unit comprises:

First processing module 211, for according to the data to be written in the write request information of the write request mark in write request attached bag packet header, described write request attached bag and destination node memory address to be written, described data to be written are write described destination node memory address;

Second processing module 212, for identifying according to the read request in read request attached bag packet header, and the destination node memory address residing for data to be read in the read request information of described read request attached bag, in described destination node memory address, read described data to be read.

Optionally, as shown in figure 22, described device also comprises:

Mark writing unit 221, for being write by described source node identification in the sub-request handbag head of every height request bag, so that described destination node sends response message to described source node.

Optionally, whether described judging unit is also identical for judging the source node identification that each response message to be sent is corresponding;

As shown in figure 23, described device also comprises:

Transmitting element 231, for sending to described merging response message bag the source node that described source node identification is corresponding.

Optionally, when described destination node is routed port, described processing unit, also for extracting the source node identification in the described public packet header merging request bag, writes in the packet header of every height request bag.

The operating process of said apparatus 14 and device 20, see the processing procedure of the read-write processing method of above-mentioned internal storage data.

The read-write treating apparatus of the internal storage data shown in above-mentioned Figure 14 to Figure 19 can realize based on the hardware configuration of computing machine or other network equipments, as shown in figure 24, the hardware configuration of the read-write treating apparatus 24 of internal storage data comprises storer 241, transceiver 242, processor 243 and bus 244.

Wherein, processor 243, storer 241 are connected by bus 244 with transceiver 242.

Storer 241 can be ROM (read-only memory) (Read Only Memory, ROM), static storage device, dynamic memory or random access memory (Random Access Memory, RAM).Storer 241 can store instruction and the application data of operating system and other application programs.The instruction stored in storer 241 runs execution by processor 243.

In the embodiment of the present invention, storer 241 can be used for storing and realizes the instruction of Figure 14 to each functional unit in embodiment illustrated in fig. 19.

Transceiver 242 is used for realizing the read-write treating apparatus 24 of internal storage data and the communication of other equipment.

In the embodiment of the present invention, transceiver 242 merges request bag for sending and receives response message.

Processor 243 can adopt general central processing unit (Central ProcessingUnit, CPU), microprocessor, application specific integrated circuit (Application SpecificIntegrated Circuit, ASIC), or one or more integrated circuit, for performing relative program.

In the embodiment of the present invention, processor 243, for the instruction in execute store 241, specifically performs:

Send to described destination node to identify corresponding destination node by transceiver 242 the described request bag that merges, described merging request bag is used to indicate described destination node and carries out read and/or write to the internal storage data of described destination node.

Wherein, the concrete processing procedure in processor 243 can reference method embodiment part and the device embodiment part shown in Figure 14 to Figure 19, repeats no more here.

Bus 244 can comprise a path, between the read-write treating apparatus all parts (such as processor 243, storer 241 and transceiver 242) of internal storage data, transmit information.

The read-write treating apparatus of the internal storage data shown in above-mentioned Figure 20 to Figure 23 all can realize by computer based hardware configuration, as shown in figure 25, the hardware configuration of the read-write treating apparatus 25 of internal storage data comprises storer 251, transceiver 252, processor 253 and bus 254.

Wherein, processor 253, storer 251 and transceiver 252 are communicated to connect by bus 254.

Storer 251 can be ROM (read-only memory) (Read Only Memory, ROM), static storage device, dynamic memory or random access memory (Random Access Memory, RAM).Storer 251 can store instruction and the application data of operating system and other application programs.The instruction stored in storer 251 runs execution by processor 253.

In the embodiment of the present invention, storer 251 can be used for storing and realizes the instruction of Figure 20 to each functional unit in embodiment illustrated in fig. 23.

Transceiver 252 is used for realizing the communication between the read-write treating apparatus 25 of internal storage data and other equipment.

In the embodiment of the present invention, transceiver 252 merges request bag for receiving and sends response message.

Processor 253 can adopt general central processing unit (Central ProcessingUnit, CPU), microprocessor, application specific integrated circuit (Application SpecificIntegrated Circuit, ASIC), or one or more integrated circuit, for performing relative program.

In the embodiment of the present invention, processor 253, for the instruction in execute store 251, specifically performs:

Request bag is received by transceiver 252;

Wherein, the concrete processing procedure in processor 253 can reference method embodiment part and the device embodiment part shown in Figure 20 to Figure 23, repeats no more here.

Bus 254 can comprise a path, between the read-write treating apparatus all parts (such as processor 253, storer 251 and transceiver 252) of internal storage data, transmit information.

Those skilled in the art can be well understood to, for convenience and simplicity of description, only be illustrated with the division of above-mentioned each functional module, in practical application, can distribute as required and by above-mentioned functions and be completed by different functional modules, inner structure by device is divided into different functional modules, to complete all or part of function described above.The system of foregoing description, the specific works process of device and unit, with reference to the corresponding process in preceding method embodiment, can not repeat them here.

In several embodiments that the application provides, should be understood that, disclosed system, apparatus and method, can realize by another way.Such as, device embodiment described above is only schematic, such as, the division of described module or unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of device or unit or communication connection can be electrical, machinery or other form.

The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.

In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form of SFU software functional unit also can be adopted to realize.

If described integrated unit using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or all or part of of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) or processor (processor) perform all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various can be program code stored medium.

The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; change can be expected easily or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection domain of described claim.

Claims

1. a read-write processing method for internal storage data, is characterized in that, comprising:

2. the read-write processing method of internal storage data according to claim 1, is characterized in that, described in be packaged as one merge request handbag draw together:

3. the read-write processing method of internal storage data according to claim 1 and 2, is characterized in that, described in described parsing, the destination node of each request bag to be sent identifies, and judges that the destination node of each request bag to be sent described identifies whether identical comprising:

Obtain the destination node mark of carrying in each request bag to be sent;

Described be packaged as one merge request handbag draw together:

4. the read-write processing method of internal storage data according to claim 1 and 2, is characterized in that, described in described parsing, the destination node of each request bag to be sent identifies, and judges that the destination node of each request bag to be sent described identifies whether identical comprising:

5. the read-write processing method of the internal storage data according to claim 3 or 4, it is characterized in that, described son request handbag draws together write request attached bag and/or read request attached bag, write request attached bag packet header comprises the write request mark identifying described write request attached bag, write request information in described write request attached bag comprises the data of described destination node to be written and described destination node memory address to be written, read request attached bag packet header comprises the read request mark identifying described read request attached bag, read request information in described read request attached bag comprises the described destination node memory address residing for data to be read, described method also comprises:

6. the read-write processing method of the internal storage data according to any one of claim 1-5, it is characterized in that, described in described parsing, the destination node of each request bag to be sent identifies, and judges that the destination node of each request bag to be sent described identifies whether identical comprising:

7. a read-write processing method for internal storage data, is characterized in that, comprising:

Receive request bag;

8. the read-write processing method of internal storage data according to claim 7, is characterized in that, described according to described every height request handbag head and sub-solicited message, and the sub-request handbag of process correspondence is drawn together:

9. the read-write processing method of internal storage data according to claim 8, is characterized in that, asks after bag number identifies the sub-request bag of corresponding number, also to comprise in described extraction described merging request bag with described son:

10. the read-write processing method of internal storage data according to claim 9, is characterized in that, described destination node sends response message to described source node and comprises:

The read-write processing method of 11. internal storage datas according to claim 7, it is characterized in that, when described destination node is routed port, ask with described son after bag number identifies the sub-request bag of corresponding number, also to comprise in described extraction described merging request bag:

The read-write treating apparatus of 12. 1 kinds of internal storage datas, is characterized in that, comprising:

The read-write treating apparatus of 13. internal storage datas according to claim 12, is characterized in that, described processing unit comprises:

The read-write treating apparatus of 14. internal storage datas according to claim 12 or 13, is characterized in that,

Described judging unit comprises:

Described processing unit also comprises:

The read-write treating apparatus of 15. internal storage datas according to claim 12 or 13, it is characterized in that, described judging unit comprises:

The read-write treating apparatus of 16. internal storage datas according to claims 14 or 15, it is characterized in that, the described merging that described processing unit obtains asks the sub-request handbag comprised to draw together write request attached bag and/or read request attached bag, write request attached bag packet header comprises the write request mark identifying described write request attached bag, write request information in described write request attached bag comprises the data of described destination node to be written and described destination node memory address to be written, read request attached bag packet header comprises the read request mark identifying described read request attached bag, read request information in described read request attached bag comprises the described destination node memory address residing for data to be read, described device also comprises:

The read-write treating apparatus of 17. internal storage datas according to any one of claim 12-16, it is characterized in that, described judging unit also comprises:

The read-write treating apparatus of 18. 1 kinds of internal storage datas, is characterized in that, comprising:

Receiving element, for receiving request bag;

The read-write treating apparatus of 19. internal storage datas according to claim 18, is characterized in that, described processing unit comprises:

The read-write treating apparatus of 20. internal storage datas according to claim 19, is characterized in that, described device also comprises:

The read-write treating apparatus of 21. internal storage datas according to claim 20, is characterized in that,

Whether described judging unit is also identical for judging the source node identification that each response message to be sent is corresponding;

Described device also comprises:

The read-write treating apparatus of 22. internal storage datas according to claim 18, it is characterized in that, when described destination node is routed port, described processing unit, also for extracting the source node identification in the described public packet header merging request bag, write in the packet header of every height request bag.