CN111491038B - Data transmission system in static network and method thereof - Google Patents
Data transmission system in static network and method thereof Download PDFInfo
- Publication number
- CN111491038B CN111491038B CN202010600025.0A CN202010600025A CN111491038B CN 111491038 B CN111491038 B CN 111491038B CN 202010600025 A CN202010600025 A CN 202010600025A CN 111491038 B CN111491038 B CN 111491038B
- Authority
- CN
- China
- Prior art keywords
- capacity
- memory
- data
- level
- transmission register
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 666
- 230000003068 static effect Effects 0.000 title claims abstract description 83
- 238000000034 method Methods 0.000 title claims description 45
- 230000015654 memory Effects 0.000 claims abstract description 1057
- 238000000638 solvent extraction Methods 0.000 claims abstract description 52
- 238000012546 transfer Methods 0.000 claims abstract description 29
- 208000032370 Secondary transmission Diseases 0.000 claims description 193
- 230000011218 segmentation Effects 0.000 claims description 14
- 208000032369 Primary transmission Diseases 0.000 description 20
- 230000008569 process Effects 0.000 description 16
- 238000012545 processing Methods 0.000 description 15
- 238000005192 partition Methods 0.000 description 11
- 239000002699 waste material Substances 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 239000000470 constituent Substances 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000010187 selection method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000004148 unit process Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
- H04L67/1078—Resource delivery mechanisms
- H04L67/108—Resource delivery mechanisms characterised by resources being split in blocks or fragments
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a data transmission system in a static network, wherein the static network at least comprises a data sending device and a data receiving device. And the data partitioning and transferring unit of the data sending equipment is used for selecting a second-level sending and registering memory special for storage allowance from two second-level sending and registering memories with the preset capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level sending and registering memory with the minimum capacity, otherwise selecting a maximum second-level sending and registering memory with the capacity smaller than or equal to the size of the data block to be transmitted from all the second-level sending and registering memories, and transferring the maximum data subblocks sequentially partitioned from the data block to be transmitted into the selected second-level sending and registering memory according to the capacity of the selected second-level sending and registering memory. And the data merging and transferring unit of the data receiving equipment merges and transfers the data subblocks received in the second-level receiving and registering memory group into the first-level receiving memory according to the descending order.
Description
Technical Field
The present disclosure relates to a data transmission technology, and more particularly, to a data transmission system and a method thereof for saving data transmission overhead in a static network.
Background
With the popularization of distributed computing, a large job is divided to deploy different parts of data to each computing device of different distributed data processing systems for processing, so that in the processing process of a specific job, a computing intermediate parameter or result deployed on one computing device becomes input data of a computing task on another computing device, and in order to achieve data synchronization of the intermediate parameter, data transmission overhead between the computing devices is caused. Poor network performance communication performance affects the speed-up ratio and expansibility of a multi-machine distributed data processing architecture.
In a static distributed data processing architecture, a registered memory with a fixed capacity is adopted for data transportation or transmission. When data is transmitted, the entire capacity of the entire registered memory is generally transmitted. However, in the actual data processing process, in order to ensure that the registered memory does not cause memory overflow, the data blocks that need to be stored do not exceed the capacity of the registered memory. In the static network, when the data of the registered memory is transmitted, the capacity of the whole registered memory is transmitted. In this case, since the data block size of the registered memory is usually smaller than the capacity of the registered memory, the actual amount of data to be transmitted is usually larger than the actual data block size of the registered memory. For example, the capacity of the registered memory is 64M, and the size of the actual data block is 16M, and during data transmission, the data is still transmitted according to the entire capacity 64M of the registered memory, which causes a large amount of additional transmission overhead and also reduces transmission efficiency. If a dynamic application mode is adopted for the transmitted memory, the registration overhead is increased.
Therefore, how to improve the data transmission efficiency between the registered memories and reduce the data transmission overhead is very important for the static network, and is also a technical problem to be solved urgently in the field.
Disclosure of Invention
The present invention is to solve at least one of the above problems, and in particular, the present disclosure provides a data transmission system in a static network, the static network including at least one data transmission device and one data reception device, wherein the data transmission device includes: the first-stage sending memory has fixed capacity and is used for storing the data block to be transmitted; the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; the data partitioning and unloading unit is used for selecting a second-level transmission register memory special for storage allowance from two second-level transmission register memories with the capacity being a preset capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, otherwise selecting a maximum second-level transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories, and unloading the maximum data sub-blocks sequentially partitioned from the data block to be transmitted into the selected second-level transmission register memory according to the capacity of the selected second-level transmission register memory; the data receiving apparatus includes: a first-level receiving memory having the same capacity as the first-level transmitting memory; a second-level reception registration memory group including a second-level reception registration memory having the same capacity as and corresponding to each of the second-level transmission registration memory groups; the data merging and transferring unit merges and transfers the data subblocks received in the second-level receiving and registering memory group into the first-level receiving memory from big to small; and the data transmission unit is arranged between each pair of the second-level transmitting and registering memories and the second-level receiving and registering memories, obtains a transmission instruction when the selected second-level transmitting and registering memory is transferred and stored with the maximum data sub-block to be transmitted, and transmits the maximum data sub-block in the selected second-level transmitting and registering memory to the corresponding second-level receiving and registering memory.
According to another aspect of the present disclosure, there is also provided a data transmission system in a static network, the static network including at least one data transmitting device and one data receiving device, wherein the data transmitting device includes: the first-stage sending memory has preset capacity and is used for storing the data block to be transmitted; the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; a data dividing and unloading unit, configured to select a second-level transmission register memory dedicated for a storage margin from two second-level transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the smallest capacity, otherwise select a second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and select a largest second-level transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories when there is no second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, transferring the maximum data sub-blocks divided from the data blocks to be transmitted in sequence into the selected second-level transmission register memory according to the capacity of the selected second-level transmission register memory; the data receiving apparatus includes: a first-level receiving memory having the same capacity as the first-level transmitting memory; a second-level reception registration memory group including a second-level reception registration memory having the same capacity as and corresponding to each of the second-level transmission registration memory groups; the data merging and transferring unit merges and transfers the data subblocks received in the second-level receiving and registering memory group into the first-level receiving memory from big to small; and the data transmission unit is arranged between each pair of the second-level transmitting and registering memories and the second-level receiving and registering memories, obtains a transmission instruction when the selected second-level transmitting and registering memory is transferred and stored with the maximum data sub-block to be transmitted, and transmits the maximum data sub-block in the selected second-level transmitting and registering memory to the corresponding second-level receiving and registering memory.
According to still another aspect of the present disclosure, there is provided a data transmission system in a static network, the static network including at least one data transmission device and one data reception device, wherein the data transmission device includes: the first-stage sending memory has preset capacity and is used for storing the data block to be transmitted; the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; the data segmentation and unloading unit is used for selecting a second-level transmission register memory special for storage allowance from two second-level transmission register memories with the capacity being a preset capacity modulus when the size of a data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, otherwise selecting a maximum second-level transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories, recording the selected second-level transmission register memory and maximum data subblocks which can be sequentially segmented from the data block to be transmitted according to the capacity of the selected second-level transmission register memory, and unloading all the segmented maximum data subblocks into the selected second-level transmission register memory correspondingly based on the record; the data receiving apparatus includes: a first-level receiving memory having the same capacity as the first-level transmitting memory; a second-level reception registration memory group including a second-level reception registration memory having the same capacity as and corresponding to each of the second-level transmission registration memory groups; the data merging and transferring unit merges and transfers the data subblocks received in the second-level receiving and registering memory group into the first-level receiving memory from big to small; and the data transmission unit is arranged between each pair of the second-level transmitting and registering memories and the second-level receiving and registering memories, obtains a transmission instruction when the selected second-level transmitting and registering memory is transferred and stored with the maximum data sub-block to be transmitted, and transmits the maximum data sub-block in the selected second-level transmitting and registering memory to the corresponding second-level receiving and registering memory.
According to still another aspect of the present disclosure, there is provided a data transmission system in a static network, the static network including at least one data transmission device and one data reception device, wherein the data transmission device includes: the first-stage sending memory has preset capacity and is used for storing the data block to be transmitted; the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; a data dividing and unloading unit, configured to select a second-level transmission register memory dedicated for a storage margin from two second-level transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the smallest capacity, otherwise select a second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and select a largest second-level transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories when there is no second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, recording the selected second-level transmission register memory and the maximum data subblocks which can be divided from the data block to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and correspondingly transferring all the divided maximum data subblocks to the selected second-level transmission register memory based on the record; the data receiving apparatus includes: a first-level receiving memory having the same capacity as the first-level transmitting memory; a second-level reception registration memory group including a second-level reception registration memory having the same capacity as and corresponding to each of the second-level transmission registration memory groups; the data merging and transferring unit merges and transfers the data subblocks received in the second-level receiving and registering memory group into the first-level receiving memory from big to small; and the data transmission unit is arranged between each pair of the second-level transmitting and registering memories and the second-level receiving and registering memories, obtains a transmission instruction when the selected second-level transmitting and registering memory is transferred and stored with the maximum data sub-block to be transmitted, and transmits the maximum data sub-block in the selected second-level transmitting and registering memory to the corresponding second-level receiving and registering memory.
According to still another aspect of the present disclosure, there is provided a data transmission method in a static network, including: when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission registration memory with the minimum capacity, selecting a second-level transmission registration memory special for the storage allowance from the two second-level transmission registration memories with the capacity of a preset capacity modulus, otherwise, selecting a maximum second-level transmission registration memory with the capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission registration memories; dividing the maximum data sub-blocks from the data block to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and transferring the divided maximum data sub-blocks into the selected second-level transmission register memory; when the selected second-level transmission register memory is transferred and stored with the data subblocks to be transmitted, transmitting the maximum data subblock in the selected second-level transmission register memory to a second-level receiving register memory corresponding to the selected second-level transmission register memory based on the transmission instruction; and merging and transferring the data subblocks in the second-level receiving register memory into the first-level receiving memory from large to small.
According to still another aspect of the present disclosure, there is provided a data transmission method in a static network, including: when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, selecting a second-level transmission register memory which is exclusively used for storing the allowance from two second-level transmission register memories with the capacity of a preset capacity modulus, otherwise, selecting a second-level transmission register memory of which the capacity is larger than the size of the data block to be transmitted and the difference value between the capacity and the size of the data block to be transmitted is smaller than the preset capacity modulus from all second-level transmission register memories, and selecting a maximum second-level transmission register memory of which the capacity is smaller than or equal to the size of the data block to be transmitted from all second-level transmission register memories when no second-level transmission register memory of which the capacity is larger than the size of the data block to be transmitted and the difference value between the capacity and the size of the data block to be transmitted is smaller than the preset capacity modulus exists in all second-level transmission register memories; dividing the maximum data sub-blocks from the data block to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and transferring the divided maximum data sub-blocks into the selected second-level transmission register memory; when the selected second-level transmission register memory is transferred and stored with the data subblocks to be transmitted, transmitting the maximum data subblock in the selected second-level transmission register memory to a second-level receiving register memory corresponding to the selected second-level transmission register memory based on the transmission instruction; and merging and transferring the data subblocks in the second-level receiving register memory into the first-level receiving memory from large to small.
According to still another aspect of the present disclosure, there is provided a data transmission method in a static network, including: when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission registration memory with the minimum capacity, selecting a second-level transmission registration memory special for the storage allowance from the two second-level transmission registration memories with the capacity of a preset capacity modulus, otherwise, selecting a maximum second-level transmission registration memory with the capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission registration memories; recording the selected second-level transmission register memory and the maximum data subblocks which can be sequentially divided from the data block to be transmitted according to the capacity of the selected second-level transmission register memory; based on the record, dividing the maximum data sub-blocks into the data blocks to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and correspondingly transferring all the divided maximum data sub-blocks into the selected second-level transmission register memory; when the selected second-level transmission register memory is transferred and stored with the data subblocks to be transmitted, transmitting the maximum data subblock in the selected second-level transmission register memory to a second-level receiving register memory corresponding to the selected second-level transmission register memory based on the transmission instruction; and merging and transferring the data subblocks in the second-level receiving register memory into the first-level receiving memory from large to small.
According to still another aspect of the present disclosure, there is provided a data transmission method in a static network, including: when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, selecting a second-level transmission register memory which is exclusively used for storing the allowance from two second-level transmission register memories with the capacity of a preset capacity modulus, otherwise, selecting a second-level transmission register memory of which the capacity is larger than the size of the data block to be transmitted and the difference value between the capacity and the size of the data block to be transmitted is smaller than the preset capacity modulus from all second-level transmission register memories, and selecting a maximum second-level transmission register memory of which the capacity is smaller than or equal to the size of the data block to be transmitted from all second-level transmission register memories when no second-level transmission register memory of which the capacity is larger than the size of the data block to be transmitted and the difference value between the capacity and the size of the data block to be transmitted is smaller than the preset capacity modulus exists in all second-level transmission register memories; recording the selected second-level transmission register memory and the maximum data subblocks which can be sequentially divided from the data block to be transmitted according to the capacity of the selected second-level transmission register memory; based on the record, dividing the maximum data sub-blocks into the data blocks to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and correspondingly transferring all the divided maximum data sub-blocks into the selected second-level transmission register memory; when the selected second-level transmission register memory is transferred and stored with the data subblocks to be transmitted, transmitting the maximum data subblock in the selected second-level transmission register memory to a second-level receiving register memory corresponding to the selected second-level transmission register memory based on the transmission instruction; and merging and transferring the data subblocks in the second-level receiving register memory into the first-level receiving memory from large to small.
According to still another aspect of the present disclosure, there is provided a data transmission multiplexing component in a static network, the static network including a plurality of pairs of primary transmission memories and reception registration memories, the data transmission multiplexing component including: the secondary transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the main transmission memory, and comprises two secondary transmission register memories with the capacity being the preset capacity modulus and a plurality of secondary transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; the data segmentation and unloading unit is used for selecting a secondary transmission register memory special for storage allowance from two secondary transmission register memories with preset capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the secondary transmission register memory with the minimum capacity, otherwise selecting a maximum secondary transmission register memory with the capacity smaller than or equal to the size of the data block to be transmitted from all the secondary transmission register memories, and unloading the maximum data subblocks sequentially segmented from the data block to be transmitted into the selected secondary transmission register memory according to the capacity of the selected secondary transmission register memory; a secondary reception registration memory group including secondary reception registration memories corresponding to each of the secondary transmission registration memory groups and having the same capacity; the data transmission unit arranged between each pair of the secondary transmission register memories and the secondary receiving register memories obtains a transmission instruction when the selected secondary transmission register memory is transferred and stored with the maximum data subblock to be transmitted, and transmits the maximum data subblock in the selected secondary transmission register memory to the corresponding secondary receiving register memory; and the data merging and unloading unit merges and unloads the data subblocks received in the secondary receiving register memory group into one of the primary receiving memories according to the descending order.
According to still another aspect of the present disclosure, there is provided a data transmission multiplexing component in a static network, the static network including a plurality of pairs of primary transmission memories and reception registration memories, the data transmission multiplexing component including: the secondary transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the main transmission memory, and comprises two secondary transmission register memories with the capacity being the preset capacity modulus and a plurality of secondary transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; a data dividing and unloading unit, configured to select a secondary transmission register memory dedicated for storage margin from two secondary transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the secondary transmission register memory with the smallest capacity, otherwise select a secondary transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all secondary transmission register memories, and select a largest secondary transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all secondary transmission register memories when there is no secondary transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all secondary transmission register memories, transferring the maximum data subblocks sequentially divided from the data block to be transmitted into the selected secondary transmission register memory according to the capacity of the selected secondary transmission register memory; a secondary reception registration memory group including secondary reception registration memories corresponding to each of the secondary transmission registration memory groups and having the same capacity; the data transmission unit arranged between each pair of the secondary transmission register memories and the secondary receiving register memories obtains a transmission instruction when the selected secondary transmission register memory is transferred and stored with the maximum data subblock to be transmitted, and transmits the maximum data subblock in the selected secondary transmission register memory to the corresponding secondary receiving register memory; and the data merging and unloading unit merges and unloads the data subblocks received in the secondary receiving register memory group into one of the primary receiving memories according to the descending order.
According to still another aspect of the present disclosure, there is provided a data transmission multiplexing component in a static network, the static network including a plurality of pairs of primary transmission memories and reception registration memories, the data transmission multiplexing component including: the secondary transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the main transmission memory, and comprises two secondary transmission register memories with the capacity being the preset capacity modulus and a plurality of secondary transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; the data segmentation and unloading unit is used for selecting a secondary transmission register memory special for storage allowance from two secondary transmission register memories with the capacity being a preset capacity modulus when the size of a data block to be transmitted is smaller than or equal to the capacity of the secondary transmission register memory with the minimum capacity, otherwise selecting a maximum secondary transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the secondary transmission register memories, recording the selected secondary transmission register memory and maximum data subblocks which can be sequentially segmented from the data block to be transmitted according to the capacity of the selected secondary transmission register memory, and unloading all the segmented maximum data subblocks into the selected secondary transmission register memory correspondingly based on the record; a secondary reception registration memory group including secondary reception registration memories corresponding to each of the secondary transmission registration memory groups and having the same capacity; the data transmission unit arranged between each pair of the secondary transmission register memories and the secondary receiving register memories obtains a transmission instruction when the selected secondary transmission register memory is transferred and stored with the maximum data subblock to be transmitted, and transmits the maximum data subblock in the selected secondary transmission register memory to the corresponding secondary receiving register memory; and the data merging and unloading unit merges and unloads the data subblocks received in the secondary receiving register memory group into one of the primary receiving memories according to the descending order.
According to still another aspect of the present disclosure, there is provided a data transmission multiplexing component in a static network, the static network including a plurality of pairs of primary transmission memories and reception registration memories, the data transmission multiplexing component including: the secondary transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the main transmission memory, and comprises two secondary transmission register memories with the capacity being the preset capacity modulus and a plurality of secondary transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; a data dividing and unloading unit, configured to select a secondary transmission register memory dedicated for storage margin from two secondary transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the secondary transmission register memory with the smallest capacity, otherwise select a secondary transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all secondary transmission register memories, and select a largest secondary transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all secondary transmission register memories when there is no secondary transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all secondary transmission register memories, recording the selected secondary transmission register memory and the maximum data subblocks which can be sequentially divided from the data block to be transmitted according to the capacity of the selected secondary transmission register memory, and correspondingly transferring all the divided maximum data subblocks to the selected secondary transmission register memory based on the record; a secondary reception registration memory group including secondary reception registration memories corresponding to each of the secondary transmission registration memory groups and having the same capacity; the data transmission unit arranged between each pair of the secondary transmission register memories and the secondary receiving register memories obtains a transmission instruction when the selected secondary transmission register memory is transferred and stored with the maximum data subblock to be transmitted, and transmits the maximum data subblock in the selected secondary transmission register memory to the corresponding secondary receiving register memory; and the data merging and unloading unit merges and unloads the data subblocks received in the secondary receiving register memory group into one of the primary receiving memories according to the descending order.
According to still another aspect of the present disclosure, there is provided a partitioning system for transmitting data in a static network including at least one data transmitting device and one data receiving device, wherein the partitioning system includes: the first-stage sending memory has a preset fixed capacity and is used for storing the data block to be transmitted; the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; and the data segmentation and unloading unit is used for selecting a second-level transmission register memory special for storage allowance from two second-level transmission register memories with the capacity being a preset capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, otherwise selecting a maximum second-level transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories, and unloading the maximum data sub-blocks sequentially segmented from the data block to be transmitted into the selected second-level transmission register memory according to the capacity of the selected second-level transmission register memory.
According to still another aspect of the present disclosure, there is provided a partitioning system for transmitting data in a static network including at least one data transmitting device and one data receiving device, wherein the partitioning system includes: the first-stage sending memory has a preset fixed capacity and is used for storing the data block to be transmitted; the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; and a data dividing and unloading unit, configured to select a second-level transmission register memory dedicated for a storage margin from two second-level transmission register memories having a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory having the smallest capacity, otherwise select a second-level transmission register memory having a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and select a largest second-level transmission register memory having a capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories when there is no second-level transmission register memory having a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and transferring the maximum data sub-blocks divided from the data blocks to be transmitted in sequence into the selected second-level transmission register memory according to the capacity of the selected second-level transmission register memory.
According to still another aspect of the present disclosure, there is provided a partitioning system for transmitting data in a static network including at least one data transmitting device and one data receiving device, wherein the partitioning system includes: the first-stage sending memory has preset capacity and is used for storing the data block to be transmitted; the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; and the data segmentation and unloading unit is used for selecting a second-level transmission register memory special for storage allowance from two second-level transmission register memories with the capacity being a preset capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, otherwise selecting a maximum second-level transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories, recording the selected second-level transmission register memory and maximum data subblocks which can be sequentially segmented from the data block to be transmitted according to the capacity of the selected second-level transmission register memory, and unloading all the segmented maximum data subblocks into the selected second-level transmission register memory correspondingly based on the record.
According to still another aspect of the present disclosure, there is provided a partitioning system for transmitting data in a static network including at least one data transmitting device and one data receiving device, wherein the partitioning system includes: the first-stage sending memory has a preset fixed capacity and is used for storing the data block to be transmitted; the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; and a data dividing and unloading unit, configured to select a second-level transmission register memory dedicated for a storage margin from two second-level transmission register memories having a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory having the smallest capacity, otherwise select a second-level transmission register memory having a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and select a largest second-level transmission register memory having a capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories when there is no second-level transmission register memory having a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and recording the selected second-level transmission register memory and the maximum data sub-blocks which can be divided from the data block to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and correspondingly transferring all the divided maximum data sub-blocks to the selected second-level transmission register memory based on the record.
By the data transmission system and the method in the static network, the large data block is divided into a plurality of small data blocks, and the small data blocks are transferred to the second-level sending register memory with smaller register content capacity, so that only the data with the capacity size of the second-level sending register memory in which the data sub-blocks are transferred is sent during data transmission, the actual transmission capacity is enabled to be completely equal to or very close to the size of the data block to be transmitted, the invalid sending of the blank part capacity in the first-level sending memory is eliminated, the data transmission overhead between the register memories in the static network is reduced, the data transmission efficiency is improved, and the data processing speed of the whole static network is further improved.
Moreover, with the data transmission multiplexing component for use in a static network according to the present disclosure, there is no need to set a data transmission component between each pair of primary transmission and reception registered memories, which includes a secondary transmission registered memory group, a data division dump unit, a secondary reception registered memory group, a data merging dump unit, and a data transmission unit between each pair of primary transmission and reception registered memories, and by performing time division multiplexing between a plurality of pairs of primary transmission and reception registered memories, the need for setting a secondary transmission registered memory group and a secondary reception registered memory group can be effectively reduced, the amount of resource demand can be effectively reduced, and thus the device cost can be reduced.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention.
Drawings
Fig. 1 is a schematic structural diagram of a data transmission system of a static network according to the present disclosure.
Fig. 2 is a schematic structural diagram of a data transmission multiplexing component of a static network according to the present disclosure.
Fig. 3 is a flowchart illustrating a data transmission method for a static network according to a first embodiment of the present disclosure.
Fig. 4 is a flowchart illustrating a data transmission method for a static network according to a second embodiment of the present disclosure.
Fig. 5 is a flowchart illustrating a data transmission method for a static network according to a third embodiment of the present disclosure.
Fig. 6 is a flowchart illustrating a data transmission method for a static network according to a fourth embodiment of the present disclosure.
Detailed Description
The present invention will be described in further detail with reference to the following examples and the accompanying drawings so that those skilled in the art can practice the invention with reference to the description.
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. Furthermore, the reference to "first" does not imply the presence of "second," and sometimes the reference to first or second is only used for simplicity. For example, one of the two possible devices may be referred to hereinafter as secondary transmission registry 01 and may also be referred to hereinafter as secondary transmission registry 02, and similarly, one of the two possible devices may be referred to as the second computing device and may also be referred to as the first computing device, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
For a better understanding of the present disclosure, reference is made to the following detailed description taken in conjunction with the accompanying drawings.
Fig. 1 is a schematic structural diagram of a data transmission system of a static network according to the present disclosure. As shown in fig. 1, a data transmission system of a static network according to the present disclosure is deployed on a first computing device and a second computing device constituting the static network. For convenience of description, only the respective data transmitting device and data receiving device on the two computing devices are shown in fig. 1, and other conventional configuration units on the respective computing devices are omitted in order to simplify the view. In practice there may be multiple computing devices, e.g., 3, 4, 5 or more, and there may be multiple data sending devices and/or multiple data receiving devices on the same computing device. Each computing device has substantially the same constituent components.
As shown in fig. 1, in the static network system, in order to implement streaming of data, a registered memory is used for caching data that needs to be handled between different computing devices. As an example, a data sending device 100 on a computing device that needs to send data may register a fixed amount of memory for the data to be sent. On one computing device, there may be multiple computing units or computing executors that produce data to be sent to computing units or computing executors on another computing device for use by another computing unit or computing executors in performing operations. In order to implement streaming data transport in a static computing network, a fixed address is determined for such data transported across computers, and therefore a registered memory is required for locking. As shown in fig. 1, the data transmission apparatus 100 includes a first-level transmission memory. Typically, the size of such a memory registration application is 128M or 64M. Other sizes of registered memory are also possible, such as 127M or 129M. The capacity of the first-stage transmission memory may be an integer multiple of the specified capacity modulus of the data transmission system, or may not be an integer multiple of the specified capacity modulus of the data transmission system. The capacity modulus B is, for example, 8M or 4M. As one example of the present disclosure, B is set to 8M for the sake of simplicity of description. Equivalently, a first-level receiving memory is provided on the data receiving device 200 side, and the capacity is usually registered as 128M or 64M.
In a general case, a data transmission unit is disposed between the first-level transmitting memory and the first-level receiving memory, so that when a data block to be transmitted is obtained in the first-level transmitting memory, the data transmission unit obtains a message, and transmits the entire data capacity (e.g., 128M) of the first-level transmitting memory containing the data block to be transmitted to the first-level receiving memory in an RDMA protocol manner as a whole based on the message. At this time, since the entire direct memory access method is used for data transmission, the transmission amount of data is the capacity of the entire registered memory, which is much larger than the size (for example, 50M) of the data block stored in the transmission registered memory. The inability of inter-device data transfer in the static computing network to store these data blocks using dynamic memory (dynamic memory can apply for memory capacity based on data size) results in a significant amount of wasted transmission overhead, such as 78M in the above example, for inter-device data transfer in the static computing network.
In order to reduce such waste, the present disclosure provides a plurality of second-level transmission register memories in the first-level transmission memory in the data transmission device 100, forming a second-level transmission register memory group. And a data division and transfer unit is arranged between the first-level transmission memory and the second-level transmission register memory group. In the static computing network system, all execution components are started in a message communication mode. For example, when the data execution body of the first-level transmission memory is used to store the data in the first-level transmission memory, a message is sent to the data segmentation and dump unit, and the message informs the data segmentation and dump unit that the first-level transmission memory has cached the data, so that the data execution body can execute operations on the data in the first-level transmission memory. The data partitioning dump unit manages the second-level transmission register memory group subordinate thereto. In a popular way, the data partitioning and unloading unit stores the data generated by the operation thereof in one or more second-level transmission register memories in the second-level transmission register memory group in a targeted manner.
Each capacity in the second-level transmission register memory group is an integral multiple of a preset capacity modulus B. As an example, the capacity of the second-stage transmission registration memory 01 is 64M, the capacity of the second-stage transmission registration memory 02 is 32M, the capacity of the second-stage transmission registration memory 03 is 16M, the capacity of the second-stage transmission registration memory 04 is 8M, and the capacity of the second-stage transmission registration memory 05 is 8M. In these two 8M second level send register memories, one of them is designated to be dedicated to storing the split margin. The total capacity of the second-level transmission register memory group is 128M of the capacity of the first-level transmission memory group. Therefore, the second-stage transmission register memory group comprises two second-stage transmission register memories with the capacity of basic capacity modulus and a plurality of basic capacity modulus-based transmission register memoriesAnd sending the second stage with the same proportion increased to the register memory. If the preset capacity modulus is B and the equal ratio is A, the capacity of each second-level transmission register memory in the second-level transmission register memory group is B, BA and BA from small to large in sequence2、BA3、BA4…. Typically the scaling factor is 2.
Generally, the total capacity of the second-level transmission register memory set is equal to or greater than the fixed capacity of the first-level transmission memory, but the difference between the two is not greater than a basic capacity modulus. Therefore, although six second-level transmission register memories are shown in fig. 1 in the second-level transmission register memory group, the number of the second-level transmission register memories may be set according to actual situations, for example, only four, five, seven, and so on. If the capacity of the first level transmit memory group is 128M and the modulus B is 4M, there will be six second level transmit register memories in the second level transmit register memory group. As shown in fig. 1, the capacities of the six second-level transmission register memories are 4M, 8M, 16M, 32M, and 64M in sequence from small to large. Also, one of the two 4M second level send register memories is designated for storing the split margin.
When obtaining a message sent by an execution unit or an execution body (not shown) to which a first-stage transmission memory belongs, the data partitioning and unloading unit starts to partition a data block to be transmitted in the first-stage transmission memory, and specifically compares the capacity of all second-stage transmission registered memories in a second-stage transmission registered memory group with the size of the data block to be transmitted stored in the first-stage transmission memory based on the capacity of the second-stage transmission registered memories. Selecting the second-level transmission register memory with the smallest absolute value of the difference between the capacity of all the second-level transmission register memories and the size of the data block to be transmitted stored in the first-level register memory, dividing the data block to be transmitted from the initial address of the data block to be transmitted stored in the first-level transmission memory based on the capacity of the selected second-level transmission register memory to obtain the largest data sub-block, and transferring the divided largest data sub-block to the selected second-level transmission register memory. This is to maximize the capacity of the second level transmission register memory. For example, if B is 8M, the data block to be transmitted is 57M, the registered memories are sent according to the five second-level sending methods, the capacity of the registered memory 01 for second-level sending is 64M, the difference between the registered memory 01 for second-level sending and the data block to be transmitted is 7M, and the difference between the registered memory for second-level sending and other second-level sending methods is 25M, 31M, 49M, and 49M, so that the capacity of the registered memory 01 for second-level sending is 64M greater than the data block 57M to be transmitted, and the difference is smaller than the basic capacity modulus B, and therefore, the wasted overhead can be reduced to the maximum extent by selecting the registered memory 01 for second-level sending as the transfer destination of the data block. Obviously, in order to divide the largest data sub-blocks at a time and enable only one data transmission, the second-level transmission register memory 01 may be selected as a transfer destination register memory, so that the whole data block to be transmitted is directly transferred to the second-level transmission register memory 01 as a 57M data sub-block, so that the total size of the data block to be transmitted is 64M during the subsequent data transmission, which reduces the actual data amount to be transmitted by half, i.e., 64M, compared to the data of the capacity of the first-level transmission memory that directly transmits 128M, and the wasted transmission overhead is also reduced from 71M to 7M. This greatly increases the rate and efficiency of data transmission. Moreover, the selection mode can once transfer the data block to be transmitted to the selected second-level sending register buffer 01 without subsequent selection, thereby reducing the operation cost of selecting and dividing the transfer. When the data block is divided, if the size of the data block is too small, for example, less than the minimum capacity of the second-level transmission register memory, that is, the predetermined capacity modulus, the data division unloading unit directly selects the data block dedicated for unloading the data block division margin
Although the above selection method may select the second-level transmission registration memory at one time, the overhead waste still exists in the subsequent data transmission process, and therefore, optionally, the second-level transmission registration memory with the largest capacity in the second-level transmission registration memories with the capacity smaller than the data block to be transmitted may be selected. Thus, for example, if B is 8M and the data block to be transmitted is 57M, the second level send register 02 will be selected first. In this way, the largest data sub-blocks, that is, 32M, are first partitioned in the order of storage addresses from the second-level transmission/registration memory 02 with a comparison capacity of 32M, where the data block to be transmitted is 57M, and then 25M remains. And then, for the remaining data blocks to be transmitted, selecting the second-level transmission registered memory with the largest capacity from the second-level transmission registered memories with the capacity smaller than that of the data blocks to be transmitted again, so as to select the 16M second-level transmission registered memory 03. Similarly, for the remaining 9M data blocks to be transmitted, the selection is performed again in a manner of selecting the second-level transmission registered memory with the largest capacity from the second-level transmission registered memories with the capacity smaller than that of the data blocks to be transmitted, so as to select one of the 8M second-level transmission registered memories, for example, the second-level transmission registered memory 04 or 05. Finally, the last 8M second-level transmission register memory, for example, the second-level transmission register memory 05 or 04, is selected for the remaining 1M data blocks to be transmitted. By filling the second-level transmission register memory before the last selection, the difference between the actual amount of data to be transmitted and the size of the initial data block to be transmitted is very small, for example, only 7M more in the above example. That is, by adopting the selective division manner, the data which originally needs to be transmitted by 128M can be reduced to only 64M in the subsequent transmission process.
By adopting the mode, when the data block to be transmitted initially is integral multiple of the basic capacity modulus, the data block can be completely divided into the second-level sending register memory group without causing any redundant data transmission overhead. For example, for a 48M data block to be transmitted, 32M second-level transmission register memory 02 and 16M second-level transmission register memory 03 may be selected as the transfer destination register memory. In this way, although the data is transferred twice and needs to be transferred twice separately, no redundant data transmission is generated in the data transmission process, and the sum of the capacities of the transmission register memories of the actual data is exactly equal to the size of the data block to be transmitted, so that no additional data transmission overhead is caused.
In summary, in a popular way, the data partitioning and unloading unit uses the capacities of all the second-level transmission registered memories in the second-level transmission registered memory group as the selection window to compare the data blocks to be transmitted stored in the first-level registered memory, and selects the second-level transmission registered memory as the destination to be unloaded when which of the second-level transmission registered memory framed data sub-block is the largest. After the data subblock with the largest selected and divided position is transferred, if the data block to be transmitted of the first-level transmission memory has the remaining part, the data division transfer unit is adopted again for the remaining data block to take the capacity of all second-level transmission registered memories in the second-level transmission registered memory group as a selection window to one-to-one compare quantity of the data block to be transmitted stored in the first-level registered memory, and which second-level transmission registered memory defines the largest data subblock, the second-level transmission registered memory is selected as the destination to be transferred. Repeating the steps until the data block to be transmitted stored in the first-level register memory is divided and transferred. After the data is divided and transferred, the difference between the actually used registered memory capacity and the size of the initial data block to be transmitted does not exceed the basic capacity modulus set for the second-level transmission registered memory group, so that the waste amount of the transmission overhead caused by the difference does not exceed the set B value.
Alternatively, the data partitioning and unloading unit may record, after each selection of the second-level transmission registered memory is made, the number of the selected second-level transmission registered memory and the size of the largest data subblock that can be partitioned by the second-level transmission registered memory, and accumulate offsets of the starting pointers relative to the initial data block to be transmitted according to the partitioning order, so as to record the starting point and the ending point of the number of blocks to be partitioned from the initial data block to be transmitted by each selected second-level transmission registered memory. And after the transmission data block is predicted to be divided, actually dividing the transmission data block according to the recorded number of the selected second-level transmission register memory, the corresponding division starting offset and the corresponding division end offset, and transferring all the divided data sub-blocks to the selected second-level transmission register memory at one time.
In this way, after the data partitioning and transferring unit partitions and transfers the data block to be transmitted stored in the first-level registered memory into one or more second-level transmission registered memories in the second-level transmission registered memory group, or after the data partitioning and transferring unit partitions and transfers a maximum data sub-block into one of the second-level transmission registered memories, a message is sent to a data transmission unit connected to the second-level transmission registered memory serving as a data sub-block transferring destination, for example, the data transmission unit 01 connected to the second-level transmission registered memory 01, so that the data transmission unit 01 performs data transmission processing based on the message, and thus transmits the maximum data sub-block in the second-level transmission registered memory 01 to the second-level reception registered memory 01 of the corresponding data reception device 200.
The data transmission unit 01 transmits a message to the data merge dump unit of the data receiving device 200 while transmitting the largest data subblock from the second-level transmission register memory 01 to the second-level reception register memory 01. The data merging and unloading unit executes unloading processing on the largest data subblock in the second-level receiving and registering memory 01 based on the message, so as to sequentially unload the data into the first-level receiving memory. And finally, when all the partitioned data sub-blocks which are partitioned and transferred to the second-level receiving register memory group are transferred to the first-level receiving memory in sequence, the partitioned data sub-blocks are recombined into an integral data block, and the integral data block is the same as the data block to be transmitted in the first-level sending memory.
Although the processes of dividing, selectively unloading, transferring, and combining the data blocks are described above with the second-stage transmission registration memory 01, the data transfer unit 01, and the second-stage reception registration memory 01, the same processes are the same in other transfer paths. For example, when the second-level transmission/registration memory 03 is selected, the divided maximum data subblocks are transferred thereto, and then the data transfer unit 03 transfers the maximum data subblocks to the second-level reception/registration memory 03, and finally, the maximum data subblocks are transferred and combined to the first-level reception memory. In addition, the transmitting end of the data transmission system in fig. 1 may directly and individually form a complete data transmission dividing system, which is used to divide data into multiple data for respective transmission, thereby reducing the waste of transmission overhead.
Fig. 2 is a schematic structural diagram of a data transmission multiplexing component of a static network according to the present disclosure. As shown in fig. 2, the input end of the data transmission multiplexing component 300 is connected to a plurality of primary transmission memories, such as a primary transmission memory 01, a primary transmission memory 02, a primary transmission memory 03, a primary transmission memory 04, and so on. The output end of the data transmission multiplexing component 300 is connected to a plurality of primary receiving memories, such as primary receiving memory 01, primary receiving memory 02, primary receiving memory 03, primary receiving memory 04, and so on. The data transmission multiplexing component 300 includes a data dividing dump unit, a secondary sending register memory set, a data transmission unit set, a secondary receiving register memory set, and a data merging dump unit. The secondary transmission register memory group comprises a plurality of secondary transmission register memories. Typically the total capacity of the set of secondary send register memories is equal to the fixed capacity of the primary send memory.
In general, the total capacity of the secondary send register memory set is equal to or greater than the fixed capacity of the primary send memory, but the difference between the two is not greater than a basic capacity modulus. Although 6 are shown in fig. 2, it may be set according to actual situations, for example, there are only four, five, seven secondary transmission registers, and so on. If the capacity of the first level transmit memory group is 128M and the modulus B is 4M, there will be six secondary transmit register memories in the second level transmit register memory group. As shown in fig. 2, the capacity of the six secondary transmission register memories is 4M, 8M, 16M, 32M, and 64M in order from small to large. If the modulus B is 8M, the capacity of the secondary transmission registration memory 01 is 64M, the capacity of the secondary transmission registration memory 02 is 32M, the capacity of the secondary transmission registration memory 03 is 16M, the capacity of the secondary transmission registration memory 04 is 8M, and the capacity of the secondary transmission registration memory 05 is 8M. If B is 2M, the capacity of the secondary transmission registration memory 05 is 4M, and the capacity of the secondary transmission registration memory 06 is 2M, and thus seven secondary transmission registration memories are provided. The sum of the capacities of all the secondary transmission register memories of the secondary transmission register memory group is equal to the maximum fixed capacity of all the primary transmission memories. Therefore, the sum of the capacities of all the secondary transmission register memories of the secondary transmission register memory group may be larger than the fixed capacity of the primary transmission memory of some of all the primary transmission memories.
The secondary receiving register memory group and the secondary sending register memory group are correspondingly arranged. The secondary reception registered memory group includes secondary reception registered memories corresponding to each of the secondary transmission registered memory groups and having the same capacity. When any one of the main levels sends the data block to be transmitted stored in the memory, the data dividing and unloading unit executes dividing and unloading processing on the data block to be transmitted. And the data division and dump unit processes the data blocks to be transmitted stored in each main-level transmission memory one by one according to the time sequence. Specifically, the data partitioning and unloading unit compares the size of the data block to be transmitted stored in the primary transmission memory with the capacity of each secondary transmission register memory in the secondary transmission register memory group, selects one secondary transmission register memory with the smallest absolute value of the difference between the capacity of the selected secondary transmission register memory and the size of the data block to be transmitted stored in the primary transmission memory, and unloads the largest data subblock sequentially partitioned from the data block to be transmitted stored in the primary transmission memory into the selected secondary transmission register memory based on the capacity of the selected secondary transmission register memory.
As shown in fig. 2, for example, if the data block to be transmitted stored in the primary transmission memory 03 is 74M, the data partitioning and unloading unit obtains the difference between the block size of the data block to be transmitted and the capacities of the secondary transmission register memories 03 and 04 and 05 of the secondary transmission register memories 01 and 16M of the secondary transmission register memories 01 and 32M and 8M of the secondary transmission register memories 64M and 32M by comparing the capacity of the secondary transmission register memory in the secondary transmission register memory group with the data block to be transmitted of 74M, and sequentially sets the difference to be 10M, 42M, 58M, 66M, and 66M. The data division dump unit first selects the secondary transmission register memory 01 as the dump destination register memory because the difference is the smallest, and can store the largest data subblock without wasting the storage space. Therefore, the data division and dump unit divides 64M from the start address of the data block to be transmitted as the largest data sub-block to be dumped into the secondary transmission register memory 01. At this time, the primary sends 10M of data remaining in the memory 03. For this, the data partitioning and unloading unit obtains the block size of the data to be transmitted and the differences between the capacities of the secondary transmission registered memories 03 and 04 and 05 of the secondary transmission registered memories 02 and 16M and 8M of the secondary transmission registered memories 32M, respectively, as 22M, 6M, 2M, and 2M by comparing the capacity of the secondary transmission registered memory in the secondary transmission registered memory group with the remaining data blocks to be transmitted of 10M. The data division dumping unit selects the secondary transmission registration memory 04 or 05 as the dumping destination registration memory again because the difference is the smallest, and can store the largest data subblock without wasting the storage space. Therefore, the data division and dump unit divides 8M from the start address of the remaining data block to be transmitted as the largest data sub-block to be dumped to the secondary transmission register memory 04. Finally, the data partitioning and unloading unit obtains the difference between the block size of the data to be transmitted and the capacity of the secondary transmission register memories 03 and 04 or 05 of the secondary transmission register memories 02 and 16M and 8M of the secondary transmission register memories 32M, 30M, 14M and 0M in sequence by comparing the capacity of the secondary transmission register memory in the secondary transmission register memory group with the remaining data blocks to be transmitted of 2M. The data division dumping unit selects the secondary transmission registration memory 04 or 05 as the dumping destination registration memory again because the difference is the smallest, and can store the largest data subblock without wasting the storage space. Therefore, the secondary transmission register memories 01, 04 and 05 selected for the data block to be transmitted are finally transmitted by the progressive division. Thus, during subsequent data transfers, only 80M of the data needs to be transferred, which is a 48M reduction over 128M for direct transfer of the primary send memory. Although this reduces the amount of data transfer by 48M, there is still a transfer overhead of 6M more than the actual amount of data. For this purpose, optionally, in order to reduce the number of data divisions, when the remaining transmission data is 10M, the 16M secondary transmission register memory 03 may be directly selected, where the selection condition is to select a secondary transmission register memory whose capacity is greater than the data block to be transmitted or the remaining data block to be transmitted (for example, 10M) and whose difference 6M is smaller than the predetermined capacity modulus B (8M). Thus, secondary transmission registers 01 and 03 are finally selected for the initial data block to be transmitted of 74M. Although the final data volume of subsequent transmission is still 80M in the selection mode, the number of times of selecting the division operation is reduced, and the operation efficiency is improved. If B is 4M or 2M, the difference of 6M between the remaining data blocks to be transmitted in 10M and the secondary transmission register memory 03 in 16M is greater than B in 4M or 2M, so that the secondary transmission register memory 03 is not selected, but is selected from smaller secondary transmission register memories, for example, the 8M secondary transmission register memory 04 and the secondary transmission register memory 05 or 06 in 4M (B is 4M), or the 8M secondary transmission register memory 04 and the secondary transmission register memory 06 or 07 in 2M (B is 2M). In the case of B being 2M, there will be no waste of transmission overhead for the initial data block to be transmitted of 74M.
In this way, after the data partitioning and unloading unit partitions and transfers the data block to be transmitted stored in the primary registered memory into one or more secondary registered memories for transmission in the secondary registered memory group for transmission, or after the data partitioning and unloading unit partitions and unloads one maximum data subblock into one of the secondary registered memories for transmission, a message is transmitted to a data transmission unit connected to the secondary registered memory for transmission as a destination of the data subblock, for example, the data transmission unit 01 connected to the secondary registered memory for transmission 01, so that the data transmission unit 01 performs data transmission processing based on the message, and transmits the maximum data subblock in the secondary registered memory for transmission to the secondary registered memory for reception 01 of the corresponding data reception device 200.
The data transmission unit 01 transmits a message to the data merge dump unit while transmitting the largest data subblock from the secondary transmission register memory 01 to the secondary reception register memory 01. The data merge dump unit performs the dump process on the largest data subblock in the secondary receiving register memory 01 based on the message, thereby sequentially dumping the largest data subblock into the primary receiving memory 03. Finally, when all the partitioned data sub-blocks transferred to the secondary receiving register memory group are transferred to the primary receiving memory 03 in sequence, the partitioned data sub-blocks are recombined into an integral data block, and the integral data block is the same as the data block to be transmitted in the primary sending memory 03.
A plurality of primary transmission memories and a corresponding number of primary reception memories are connected in parallel to the data transmission multiplexing assembly 300 according to the present disclosure, which can reduce the consumption of the registration memories, reduce the requirements on memory resources, and simultaneously improve the utilization rates of the secondary transmission registration memories and the secondary reception registration memories.
Fig. 3 is a flow chart illustrating a first embodiment of a data transmission method for a static network according to the present disclosure. As shown in fig. 3, in step S300, the data partitioning and unloading unit obtains the size of the data block to be transmitted stored in the first-level transmission memory. Next, at step S310, the size of the data block to be transmitted stored in the first-level transmission memory is compared with the capacity of each second-level transmission register memory in the second-level transmission register memory group. Subsequently, at step S320, it is determined whether the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the smallest capacity, that is, smaller than or equal to the predetermined capacity modulus B, based on the comparison result. If the determination result is "no", in step S330, the data partitioning and unloading unit selects the second-level transmission registration memory having the largest capacity and smaller than the size of the data block to be transmitted. For example, if the data block to be transmitted is 48M and B is 8M, the determination result is no at step S320, so that 32M of second-level transmission register memory 02 is selected. Next, in step S340, the data partitioning dump unit obtains the largest data subblock that can be partitioned according to the capacity of the selected second-level transmission register memory. Specifically, the maximum data sub-block is divided from the data block to be transmitted in the first transmission registered memory according to the storage address sequence, that is, the start address offset and the end address offset of the data to be divided in the first transmission registered memory are obtained. As described above, when the data block to be transmitted is 48M and B is 8M, the maximum data sub-block of 32M is directly divided from the start address of the data block to be transmitted.
Next, in step S350, the data dividing and unloading unit divides the largest data sub-block according to the acquired address and unloads the largest data sub-block into the selected second-level transmission register memory. Subsequently, in step S360, the data partitioning and unloading unit determines whether there is a remaining data portion after the data block to be transmitted in the first transmission registration memory is partitioned based on the process of partitioning. If the judgment result is 'no', the segmentation and unloading processing is ended, and if the judgment result is 'yes', the process returns to the step S300, and the residual data part in the first sending registration memory is used as the data block to be transmitted to execute the steps again.
If the determination result in step S320 is yes, this means that the data block to be transmitted only needs to be transferred to the second-level transmission register memory for storing the segmentation margin, so that all the data blocks to be transmitted can be completely segmented. Therefore, in step S390, the data division unloading unit selects the second level register transmission memory with the smallest capacity for storing the remaining amount of the data block to be transmitted. Then, the process returns to step S340, and in step S340, the data partitioning and unloading unit partitions the largest data sub-blocks from the data blocks to be transmitted in the first transmission registered memory according to the capacity of the selected second transmission registered memory according to the storage address sequence. And if the capacity of the selected second-level transmission register memory is greater than or equal to the data block to be transmitted in the first-level transmission register memory and the corresponding absolute value is less than the preset capacity modulus B, taking the whole data block to be transmitted as the maximum data sub-block.
Returning to step S350. In step S350, while the data dividing and unloading unit unloads the divided maximum data sub-block into the selected second-level transmission register memory, a message is sent to the corresponding data transmission unit to inform the data transmission unit that the data transmission unit can perform transmission processing on the data in the second-level transmission register memory where the maximum data sub-block is unloaded. Thus, at step S370, the data transmission unit transmits the data of the entire capacity of the second-level transmission registered memory to the corresponding second-level reception registered memory. Subsequently, in step S380, the data merge/dump unit sequentially dumps the data in the second-level receiving register memory that receives the largest data sub-block into the first-level receiving memory, so as to finally merge the data block that is the same as the initial data block to be transmitted in the first-level sending memory.
The process of the data partitioning and transferring unit for partitioning and transferring the data blocks to be transmitted in the first-level transmission memory to the second-level transmission register memory in the second-level transmission register memory group is realized by adopting a greedy algorithm according to the following formula:
wherein X is the size of the data block to be transmitted in the first-level transmission memory,
and R is the capacity of the first-level transmission memory. For example, when the first-level transmission memory capacity is 128M,
when the first-level transmission memory capacity is 64M,
. Where B is a predetermined modulus, which may typically take the value of 2M, 4M or 8M, for example. In the second-level reception registration memory of the second-level reception registration memory group, the capacity of the second-level reception registration memory having the smallest capacity is B.
For selection, the second stage, which has the smallest capacity, receives the coefficients of the registered memory,
the method is generally used for storing residual data subblocks which are left after the data blocks to be transmitted are divided and are smaller than a preset capacity modulus, or directly storing initial data blocks to be transmitted, the size of which is smaller than the preset capacity modulus.
The coefficients of the registered memory are received for other, progressively larger, second stages, wherein,
i.e., 0 or 1.
The coefficients of the registered memory are also received for the second level of least capacity.
For the present disclosure, in the above formula, the size X of the data to be transmitted and the capacity of the corresponding second-level reception registered memory are known quantities, and the solution object is a coefficient corresponding to each second-level reception registered memory. And solving one of the selection constraints as whether the size X of the data to be transmitted is smaller than the capacity of one of the second-level receiving and registering memories in the second-level receiving and registering memory group and whether the difference value of the size X of the data to be transmitted and the capacity of the second-level receiving and registering memory group is smaller than a preset capacity modulus B or selecting the second-level receiving and registering memory with the maximum capacity smaller than the size X of the data to be transmitted under the opposite condition. And solving the value of each second-stage receiving and registering memory coefficient corresponding to the formula through a greedy algorithm, and selecting the second-stage receiving and registering memory corresponding to the coefficient when a certain coefficient is not 0. Therefore, when the second-level receiving register memory is selected from large to small according to the capacity size, the largest data sub-block is always divided according to the selected second-level receiving register memory.
Fig. 4 is a flowchart illustrating a second embodiment of a data transmission method for a static network according to the present disclosure. As shown in fig. 4, in step S400, the data partitioning and unloading unit obtains the size of the data block to be transmitted stored in the first-level transmission memory. Next, in step S410, the size of the data block to be transmitted stored in the first-level transmission memory is compared with the capacity of each second-level transmission register memory in the second-level transmission register memory group, and the difference between the sizes is calculated. Subsequently, at step S415, it is determined whether the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the smallest capacity, that is, smaller than or equal to the predetermined capacity modulus B, based on the comparison result. If the determination result is "no", at step S420, it is determined whether there is a difference smaller than the predetermined capacity modulus B and corresponding to a case where the capacity of the second-level transmission register memory is larger than the size of the data block to be transmitted, based on the comparison result. If the determination result is "no", in step S430, the data partitioning and unloading unit selects the second-level transmission registration memory having the largest capacity and smaller than the size of the data block to be transmitted. For example, if the data block to be transmitted is 48M and B is 8M, the determination result is no in step S415, so that 32M of the second-level transmission register memory 02 is selected. Next, in step S440, the data partitioning dump unit obtains the largest data subblock that can be partitioned according to the capacity of the selected second-level transmission register memory. Specifically, the maximum data sub-block is divided from the data block to be transmitted in the first transmission registered memory according to the storage address sequence, that is, the start address offset and the end address offset of the data to be divided in the first transmission registered memory are obtained. As described above, when the data block to be transmitted is 48M and B is 8M, the maximum data sub-block of 32M is directly divided from the start address of the data block to be transmitted.
Next, in step S450, the data dividing and unloading unit divides the largest data sub-block according to the acquired address and unloads the largest data sub-block into the selected second-level transmission register memory. Subsequently, at step S460, the data partitioning and unloading unit determines whether there is a remaining data portion after the data block to be transmitted in the first transmission registration memory is partitioned based on the process of partitioning. If the judgment result is 'no', the segmentation and unloading processing is ended, and if the judgment result is 'yes', the process returns to the step S400, and the residual data part in the first sending registration memory is used as the data block to be transmitted to re-execute the steps.
If the determination result in step S415 is yes, this means that the data block to be transmitted only needs to be transferred to the second-level transmission register memory for storing the segmentation margin, so that all the data blocks to be transmitted can be completely segmented. Therefore, in step S490, the data partitioning and unloading unit selects the second level register transmission memory with the smallest capacity for storing the remaining amount of the data block to be transmitted. Then, the process returns to step S440, and in step S440, the data partitioning and unloading unit partitions the largest data sub-blocks from the data blocks to be transmitted in the first transmission registered memory according to the capacity of the selected second transmission registered memory according to the storage address order. If the determination result in step S420 is "yes", that is, there is a data block to be transmitted in the second-level transmission registered memory whose capacity is greater than or equal to the data block to be transmitted in the first transmission registered memory and the corresponding difference value is smaller than the predetermined capacity modulus B, the whole data block to be transmitted is regarded as the maximum data sub-block, that is, the process selects, in step S495, the second-level registration transmission memory whose difference value is smaller than the predetermined capacity modulus B and whose capacity corresponding to the difference value is larger than the size of the data block to be transmitted. The process then returns to step S440.
Returning to step S450. In step S450, the data dividing and unloading unit will send a message to the corresponding data transmission unit to inform the data transmission unit that the data transmission unit can perform transmission processing on the data in the second-level transmission register memory in which the maximum data sub-block is unloaded, while unloading the divided maximum data sub-block into the selected second-level transmission register memory. Thus, at step S470, the data transmission unit transmits the data of the entire capacity of the second-level transmission registered memory to the corresponding second-level reception registered memory. Subsequently, in step S480, the data merge/dump unit sequentially dumps the data in the second-level reception register memory that receives the largest data sub-block into the first-level reception memory, so as to finally merge the data block that is the same as the initial data block to be transmitted in the first-level transmission memory.
The process of the data partitioning and transferring unit for partitioning and transferring the data blocks to be transmitted in the first-level transmission memory to the second-level transmission register memory in the second-level transmission register memory group is realized by adopting a greedy algorithm according to the following formula:
wherein X is the size of the data block to be transmitted in the first-level transmission memory,
and R is the capacity of the first-level transmission memory. For example, when the first-level transmission memory capacity is 128M,
when the first-level transmission memory capacity is 64M,
. Where B is a predetermined modulus, which may typically take the value of 2M, 4M or 8M, for example. In the second-level reception registration memory of the second-level reception registration memory group, the capacity of the second-level reception registration memory having the smallest capacity is B.
For selection, the second stage, which has the smallest capacity, receives the coefficients of the registered memory,
the method is generally used for storing residual data subblocks which are left after the data blocks to be transmitted are divided and are smaller than a preset capacity modulus, or directly storing initial data blocks to be transmitted, the size of which is smaller than the preset capacity modulus.
The coefficients of the registered memory are received for other, progressively larger, second stages, wherein,
i.e., 0 or 1.
The coefficients of the registered memory are also received for the second level of least capacity.
For the present disclosure, in the above formula, the size X of the data to be transmitted and the capacity of the corresponding second-level reception registered memory are known quantities, and the solution object is a coefficient corresponding to each second-level reception registered memory. And solving one of the selection constraints as whether the size X of the data to be transmitted is smaller than the capacity of one of the second-level receiving and registering memories in the second-level receiving and registering memory group and whether the difference value of the size X of the data to be transmitted and the capacity of the second-level receiving and registering memory group is smaller than a preset capacity modulus B or selecting the second-level receiving and registering memory with the maximum capacity smaller than the size X of the data to be transmitted under the opposite condition. And solving the value of each second-stage receiving and registering memory coefficient corresponding to the formula through a greedy algorithm, and selecting the second-stage receiving and registering memory corresponding to the coefficient when a certain coefficient is not 0. Therefore, when the second-level receiving register memory is selected from large to small according to the capacity size, the largest data sub-block is always divided according to the selected second-level receiving register memory.
Fig. 5 is a flowchart illustrating a data transmission method for a static network according to a third embodiment of the present disclosure. The embodiment shown in fig. 5 is substantially the same as the embodiment shown in fig. 3, that is, steps S500 to S540, S560, S570 and S580 in fig. 5 are the same as steps S300 to S340, S360, S370 and S380 in fig. 3, but the difference between them is that fig. 3 selects the second-level transmission register memory and performs the partition and dump one by one, and the embodiment shown in fig. 5 does not perform the partition and dump directly after selecting the second-level transmission register memory each time, but records the number of the selected second-level transmission register memory and calculates and records the maximum data subblock that can be partitioned by the selected second-level transmission register memory, so as to calculate the offset of the start address of the data subblock that can be partitioned with respect to the initial data block to be transmitted in the first-level transmission memory based on the size of the maximum data subblock. Finally, after the division (i.e., the preset division manner) of the initial data block to be transmitted is completed, in step S565, based on the recorded second-level transmission registration memory and the address offset, the initial data block to be transmitted is divided and transferred to the selected corresponding second-level transmission registration memory at one time.
Fig. 6 is a flowchart illustrating a data transmission method for a static network according to a fourth embodiment of the present disclosure. The embodiment shown in fig. 5 is substantially the same as the embodiment shown in fig. 3, that is, steps S500 to S540, S560, S570 and S580 in fig. 5 are the same as steps S300 to S340, S360, S370 and S380 in fig. 3, but the difference between them is that fig. 3 selects the second-level transmission register memory and performs the partition and dump one by one, and the embodiment shown in fig. 5 does not perform the partition and dump directly after selecting the second-level transmission register memory each time, but records the number of the selected second-level transmission register memory and calculates and records the maximum data subblock that can be partitioned by the selected second-level transmission register memory, so as to calculate the offset of the start address of the data subblock that can be partitioned with respect to the initial data block to be transmitted in the first-level transmission memory based on the size of the maximum data subblock. Finally, after the division (i.e., the preset division manner) of the initial data block to be transmitted is completed, in step S565, based on the recorded second-level transmission registration memory and the address offset, the initial data block to be transmitted is divided and transferred to the selected corresponding second-level transmission registration memory at one time. .
The basic principles of the present disclosure have been described in connection with specific embodiments, but it should be noted that it will be understood by those skilled in the art that all or any of the steps or components of the method and apparatus of the present disclosure may be implemented in any computing device (including processors, storage media, etc.) or network of computing devices, in hardware, firmware, software, or a combination thereof, which can be implemented by those skilled in the art using their basic programming skills after reading the description of the present disclosure.
Thus, the objects of the present disclosure may also be achieved by running a program or a set of programs on any computing device. The computing device may be a general purpose device as is well known. Thus, the object of the present disclosure can also be achieved merely by providing a program product containing program code for implementing the method or apparatus. That is, such a program product also constitutes the present disclosure, and a storage medium storing such a program product also constitutes the present disclosure. It is to be understood that the storage medium may be any known storage medium or any storage medium developed in the future.
It is also noted that in the apparatus and methods of the present disclosure, it is apparent that individual components or steps may be disassembled and/or re-assembled. These decompositions and/or recombinations are to be considered equivalents of the present disclosure. Also, the steps of executing the series of processes described above may naturally be executed chronologically in the order described, but need not necessarily be executed chronologically. Some steps may be performed in parallel or independently of each other.
The above detailed description should not be construed as limiting the scope of the disclosure. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.
Claims (16)
1. A data transmission system in a static network, said static network comprising at least one data transmitting device and one data receiving device,
the data transmission apparatus includes:
the first-stage sending memory has fixed capacity and is used for storing the data block to be transmitted;
the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number;
the data partitioning and unloading unit is used for selecting a second-level transmission register memory special for storage allowance from two second-level transmission register memories with the capacity being a preset capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, otherwise selecting a maximum second-level transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories, and unloading the maximum data sub-blocks sequentially partitioned from the data block to be transmitted into the selected second-level transmission register memory according to the capacity of the selected second-level transmission register memory;
the data receiving apparatus includes:
a first-level receiving memory having the same capacity as the first-level transmitting memory;
a second-level reception registration memory group including a second-level reception registration memory having the same capacity as and corresponding to each of the second-level transmission registration memory groups; and
the data merging and transferring unit merges and transfers the data subblocks received in the second-level receiving and registering memory group into the first-level receiving memory from big to small; and
and the data transmission unit arranged between each pair of the second-level transmitting and registering memory and the second-level receiving and registering memory obtains a transmission instruction when the selected second-level transmitting and registering memory is transferred and stored with the maximum data sub-block to be transmitted, and transmits the maximum data sub-block in the selected second-level transmitting and registering memory to the corresponding second-level receiving and registering memory.
2. A data transmission system in a static network, said static network comprising at least one data transmitting device and one data receiving device,
the data transmission apparatus includes:
the first-stage sending memory has fixed capacity and is used for storing the data block to be transmitted;
the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number;
a data dividing and unloading unit, configured to select a second-level transmission register memory dedicated for a storage margin from two second-level transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the smallest capacity, otherwise select a second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and select a largest second-level transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories when there is no second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, transferring the maximum data sub-blocks divided from the data blocks to be transmitted in sequence into the selected second-level transmission register memory according to the capacity of the selected second-level transmission register memory;
the data receiving apparatus includes:
a first-level receiving memory having the same capacity as the first-level transmitting memory;
a second-level reception registration memory group including a second-level reception registration memory having the same capacity as and corresponding to each of the second-level transmission registration memory groups; and
the data merging and transferring unit merges and transfers the data subblocks received in the second-level receiving and registering memory group into the first-level receiving memory from big to small; and
and the data transmission unit arranged between each pair of the second-level transmitting and registering memory and the second-level receiving and registering memory obtains a transmission instruction when the selected second-level transmitting and registering memory is transferred and stored with the maximum data sub-block to be transmitted, and transmits the maximum data sub-block in the selected second-level transmitting and registering memory to the corresponding second-level receiving and registering memory.
3. A data transmission system in a static network, said static network comprising at least one data transmitting device and one data receiving device,
the data transmission apparatus includes:
the first-stage sending memory has a fixed capacity which is an integral multiple of a preset capacity modulus and is used for storing a data block to be transmitted;
the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number;
the data segmentation and unloading unit is used for selecting a second-level transmission register memory special for storage allowance from two second-level transmission register memories with the capacity being a preset capacity modulus when the size of a data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, otherwise selecting a maximum second-level transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories, recording the selected second-level transmission register memory and maximum data subblocks which can be sequentially segmented from the data block to be transmitted according to the capacity of the selected second-level transmission register memory, and unloading all the segmented maximum data subblocks into the selected second-level transmission register memory correspondingly based on the record;
the data receiving apparatus includes:
a first-level receiving memory having the same capacity as the first-level transmitting memory;
a second-level reception registration memory group including a second-level reception registration memory having the same capacity as and corresponding to each of the second-level transmission registration memory groups; and
the data merging and transferring unit merges and transfers the data subblocks received in the second-level receiving and registering memory group into the first-level receiving memory from big to small; and
and the data transmission unit arranged between each pair of the second-level transmitting and registering memory and the second-level receiving and registering memory obtains a transmission instruction when the selected second-level transmitting and registering memory is transferred and stored with the maximum data sub-block to be transmitted, and transmits the maximum data sub-block in the selected second-level transmitting and registering memory to the corresponding second-level receiving and registering memory.
4. A data transmission system in a static network, said static network comprising at least one data transmitting device and one data receiving device,
the data transmission apparatus includes:
the first-stage sending memory has fixed capacity and is used for storing the data block to be transmitted;
the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number;
a data dividing and unloading unit, configured to select a second-level transmission register memory dedicated for a storage margin from two second-level transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the smallest capacity, otherwise select a second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and select a largest second-level transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories when there is no second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, recording the selected second-level transmission register memory and the maximum data subblocks which can be divided from the data block to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and correspondingly transferring all the divided maximum data subblocks to the selected second-level transmission register memory based on the record;
the data receiving apparatus includes:
a first-level receiving memory having the same capacity as the first-level transmitting memory;
a second-level reception registration memory group including a second-level reception registration memory having the same capacity as and corresponding to each of the second-level transmission registration memory groups; and
the data merging and transferring unit merges and transfers the data subblocks received in the second-level receiving and registering memory group into the first-level receiving memory from big to small; and
and the data transmission unit arranged between each pair of the second-level transmitting and registering memory and the second-level receiving and registering memory obtains a transmission instruction when the selected second-level transmitting and registering memory is transferred and stored with the maximum data sub-block to be transmitted, and transmits the maximum data sub-block in the selected second-level transmitting and registering memory to the corresponding second-level receiving and registering memory.
5. A method of data transmission in a static network, comprising:
when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission registration memory with the minimum capacity, selecting a second-level transmission registration memory special for the storage allowance from the two second-level transmission registration memories with the capacity of a preset capacity modulus, otherwise, selecting a maximum second-level transmission registration memory with the capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission registration memories;
transferring the maximum data subblocks sequentially divided from the data block to be transmitted into the selected second-level transmission register memory according to the capacity of the selected second-level transmission register memory;
when the selected second-level transmission register memory is transferred and stored with the data subblocks to be transmitted, transmitting the maximum data subblock in the selected second-level transmission register memory to a second-level receiving register memory corresponding to the selected second-level transmission register memory based on the transmission instruction; and
and merging and transferring the data subblocks in the second-level receiving register memory into the first-level receiving memory from big to small.
6. A method of data transmission in a static network, comprising:
when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, selecting a second-level transmission register memory which is exclusively used for storing the allowance from two second-level transmission register memories with the capacity of a preset capacity modulus, otherwise, selecting a second-level transmission register memory of which the capacity is larger than the size of the data block to be transmitted and the difference value between the capacity and the size of the data block to be transmitted is smaller than the preset capacity modulus from all second-level transmission register memories, and selecting a maximum second-level transmission register memory of which the capacity is smaller than or equal to the size of the data block to be transmitted from all second-level transmission register memories when no second-level transmission register memory of which the capacity is larger than the size of the data block to be transmitted and the difference value between the capacity and the size of the data block to be transmitted is smaller than the preset capacity modulus exists in all second-level transmission register memories;
dividing the maximum data sub-blocks from the data block to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and transferring the divided maximum data sub-blocks into the selected second-level transmission register memory;
when the selected second-level transmission register memory is transferred and stored with the data subblocks to be transmitted, transmitting the maximum data subblock in the selected second-level transmission register memory to a second-level receiving register memory corresponding to the selected second-level transmission register memory based on the transmission instruction; and
and merging and transferring the data subblocks in the second-level receiving register memory into the first-level receiving memory from big to small.
7. A method of data transmission in a static network, comprising:
when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission registration memory with the minimum capacity, selecting a second-level transmission registration memory special for the storage allowance from the two second-level transmission registration memories with the capacity of a preset capacity modulus, otherwise, selecting a maximum second-level transmission registration memory with the capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission registration memories;
recording the selected second-level transmission register memory and the maximum data subblocks which can be sequentially divided from the data block to be transmitted according to the capacity of the selected second-level transmission register memory;
based on the record, dividing the maximum data sub-blocks into the data blocks to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and correspondingly transferring all the divided maximum data sub-blocks into the selected second-level transmission register memory;
when the selected second-level transmission register memory is transferred and stored with the data subblocks to be transmitted, transmitting the maximum data subblock in the selected second-level transmission register memory to a second-level receiving register memory corresponding to the selected second-level transmission register memory based on the transmission instruction; and
and merging and transferring the data subblocks in the second-level receiving register memory into the first-level receiving memory from big to small.
8. A method of data transmission in a static network, comprising:
when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, selecting a second-level transmission register memory which is exclusively used for storing the allowance from two second-level transmission register memories with the capacity of a preset capacity modulus, otherwise, selecting a second-level transmission register memory of which the capacity is larger than the size of the data block to be transmitted and the difference value between the capacity and the size of the data block to be transmitted is smaller than the preset capacity modulus from all second-level transmission register memories, and selecting a maximum second-level transmission register memory of which the capacity is smaller than or equal to the size of the data block to be transmitted from all second-level transmission register memories when no second-level transmission register memory of which the capacity is larger than the size of the data block to be transmitted and the difference value between the capacity and the size of the data block to be transmitted is smaller than the preset capacity modulus exists in all second-level transmission register memories;
recording the selected second-level transmission register memory and the maximum data subblocks which can be sequentially divided from the data block to be transmitted according to the capacity of the selected second-level transmission register memory;
based on the record, dividing the maximum data sub-blocks into the data blocks to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and correspondingly transferring all the divided maximum data sub-blocks into the selected second-level transmission register memory;
when the selected second-level transmission register memory is transferred and stored with the data subblocks to be transmitted, transmitting the maximum data subblock in the selected second-level transmission register memory to a second-level receiving register memory corresponding to the selected second-level transmission register memory based on the transmission instruction; and
and merging and transferring the data subblocks in the second-level receiving register memory into the first-level receiving memory from big to small.
9. A data transmission multiplexing component in a static network, the static network comprising a plurality of pairs of primary sending memories and receiving register memories, the data transmission multiplexing component comprising:
the secondary transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the main transmission memory, and comprises two secondary transmission register memories with the capacity being the preset capacity modulus and a plurality of secondary transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number;
the data segmentation and unloading unit is used for selecting a secondary transmission register memory special for storage allowance from two secondary transmission register memories with preset capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the secondary transmission register memory with the minimum capacity, otherwise selecting a maximum secondary transmission register memory with the capacity smaller than or equal to the size of the data block to be transmitted from all the secondary transmission register memories, and unloading the maximum data subblocks sequentially segmented from the data block to be transmitted into the selected secondary transmission register memory according to the capacity of the selected secondary transmission register memory;
a secondary reception registration memory group including secondary reception registration memories corresponding to each of the secondary transmission registration memory groups and having the same capacity;
the data transmission unit arranged between each pair of the secondary transmission register memories and the secondary receiving register memories obtains a transmission instruction when the selected secondary transmission register memory is transferred and stored with the maximum data subblock to be transmitted, and transmits the maximum data subblock in the selected secondary transmission register memory to the corresponding secondary receiving register memory; and
and the data merging and unloading unit merges and unloads the data subblocks received in the secondary receiving register memory group into one of the primary receiving memories from big to small.
10. A data transmission multiplexing component in a static network, the static network comprising a plurality of pairs of primary sending memories and receiving register memories, the data transmission multiplexing component comprising:
the secondary transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the main transmission memory, and comprises two secondary transmission register memories with the capacity being the preset capacity modulus and a plurality of secondary transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number;
a data dividing and unloading unit, configured to select a secondary transmission register memory dedicated for storage margin from two secondary transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the secondary transmission register memory with the smallest capacity, otherwise select a secondary transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all secondary transmission register memories, and select a largest secondary transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all secondary transmission register memories when there is no secondary transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all secondary transmission register memories, transferring the maximum data subblocks sequentially divided from the data block to be transmitted into the selected secondary transmission register memory according to the capacity of the selected secondary transmission register memory;
a secondary reception registration memory group including secondary reception registration memories corresponding to each of the secondary transmission registration memory groups and having the same capacity;
the data transmission unit arranged between each pair of the secondary transmission register memories and the secondary receiving register memories obtains a transmission instruction when the selected secondary transmission register memory is transferred and stored with the maximum data subblock to be transmitted, and transmits the maximum data subblock in the selected secondary transmission register memory to the corresponding secondary receiving register memory; and
and the data merging and unloading unit merges and unloads the data subblocks received in the secondary receiving register memory group into one of the primary receiving memories from big to small.
11. A data transmission multiplexing component in a static network, the static network comprising a plurality of pairs of primary sending memories and receiving register memories, the data transmission multiplexing component comprising:
the secondary transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the main transmission memory, and comprises two secondary transmission register memories with the capacity being the preset capacity modulus and a plurality of secondary transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number;
the data segmentation and unloading unit is used for selecting a secondary transmission register memory special for storage allowance from two secondary transmission register memories with the capacity being a preset capacity modulus when the size of a data block to be transmitted is smaller than or equal to the capacity of the secondary transmission register memory with the minimum capacity, otherwise selecting a maximum secondary transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the secondary transmission register memories, recording the selected secondary transmission register memory and maximum data subblocks which can be sequentially segmented from the data block to be transmitted according to the capacity of the selected secondary transmission register memory, and unloading all the segmented maximum data subblocks into the selected secondary transmission register memory correspondingly based on the record;
a secondary reception registration memory group including secondary reception registration memories corresponding to each of the secondary transmission registration memory groups and having the same capacity;
the data transmission unit arranged between each pair of the secondary transmission register memories and the secondary receiving register memories obtains a transmission instruction when the selected secondary transmission register memory is transferred and stored with the maximum data subblock to be transmitted, and transmits the maximum data subblock in the selected secondary transmission register memory to the corresponding secondary receiving register memory; and
and the data merging and unloading unit merges and unloads the data subblocks received in the secondary receiving register memory group into one of the primary receiving memories from big to small.
12. A data transmission multiplexing component in a static network, the static network comprising a plurality of pairs of primary sending memories and receiving register memories, the data transmission multiplexing component comprising:
the secondary transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the main transmission memory, and comprises two secondary transmission register memories with the capacity being the preset capacity modulus and a plurality of secondary transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number;
a data dividing and unloading unit, configured to select a secondary transmission register memory dedicated for storage margin from two secondary transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the secondary transmission register memory with the smallest capacity, otherwise select a secondary transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all secondary transmission register memories, and select a largest secondary transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all secondary transmission register memories when there is no secondary transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with respect to the size of the data block to be transmitted smaller than the predetermined capacity modulus from all secondary transmission register memories, recording the selected secondary transmission register memory and the maximum data subblocks which can be sequentially divided from the data block to be transmitted according to the capacity of the selected secondary transmission register memory, and correspondingly transferring all the divided maximum data subblocks to the selected secondary transmission register memory based on the record;
a secondary reception registration memory group including secondary reception registration memories corresponding to each of the secondary transmission registration memory groups and having the same capacity;
the data transmission unit arranged between each pair of the secondary transmission register memories and the secondary receiving register memories obtains a transmission instruction when the selected secondary transmission register memory is transferred and stored with the maximum data subblock to be transmitted, and transmits the maximum data subblock in the selected secondary transmission register memory to the corresponding secondary receiving register memory; and
and the data merging and unloading unit merges and unloads the data subblocks received in the secondary receiving register memory group into one of the primary receiving memories from big to small.
13. A partitioning system for transmitting data in a static network, said static network comprising at least one data transmitting device and one data receiving device, wherein said partitioning system comprises:
the first-stage sending memory has fixed capacity and is used for storing the data block to be transmitted;
the second-stage transmission register memory group has the sum of capacities which is integral multiple of the preset capacity modulus and is larger than or equal to the fixed capacity of the first-stage transmission memory, and comprises two second-stage transmission register memories with the capacity being the preset capacity modulus and a plurality of second-stage transmission register memories with the capacities being increased in equal proportion by taking the preset capacity modulus as a base number; and
and the data partitioning and unloading unit is used for selecting a second-level transmission register memory special for storage allowance from two second-level transmission register memories with the capacity being a preset capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, otherwise selecting a maximum second-level transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories, and unloading the maximum data sub-blocks sequentially partitioned from the data block to be transmitted into the selected second-level transmission register memory according to the capacity of the selected second-level transmission register memory.
14. A partitioning system for transmitting data in a static network, said static network comprising at least one data transmitting device and one data receiving device, wherein said partitioning system comprises:
the first-stage sending memory has a fixed capacity which is an integral multiple of a preset capacity modulus and is used for storing a data block to be transmitted;
the second-stage sending register memory group has the sum of the capacities equal to the fixed capacity of the first-stage sending memory and comprises two second-stage sending register memories with the capacity of a preset capacity modulus and a plurality of second-stage sending register memories with the capacities increased in equal proportion by taking the preset capacity modulus as a base number; and
a data dividing and unloading unit, configured to select a second-level transmission register memory dedicated for a storage margin from two second-level transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the smallest capacity, otherwise select a second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and select a largest second-level transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories when there is no second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and transferring the maximum data sub-blocks divided from the data blocks to be transmitted in sequence into the selected second-level transmission register memory according to the capacity of the selected second-level transmission register memory.
15. A partitioning system for transmitting data in a static network, said static network comprising at least one data transmitting device and one data receiving device, wherein said partitioning system comprises:
the first-stage sending memory has a fixed capacity which is an integral multiple of a preset capacity modulus and is used for storing a data block to be transmitted;
the second-stage sending register memory group has the sum of the capacities equal to the fixed capacity of the first-stage sending memory and comprises two second-stage sending register memories with the capacity of a preset capacity modulus and a plurality of second-stage sending register memories with the capacities increased in equal proportion by taking the preset capacity modulus as a base number; and
and the data partitioning and unloading unit is used for selecting a second-level transmission register memory special for storage allowance from two second-level transmission register memories with the capacity being a preset capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the minimum capacity, otherwise selecting a maximum second-level transmission register memory with the capacity being smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories, recording the selected second-level transmission register memory and maximum data subblocks which can be sequentially divided from the data block to be transmitted according to the capacity of the selected second-level transmission register memory, and correspondingly unloading all the maximum data subblocks which can be divided into the selected second-level transmission register memory based on the recording.
16. A partitioning system for transmitting data in a static network, said static network comprising at least one data transmitting device and one data receiving device, wherein said partitioning system comprises:
the first-stage sending memory has a fixed capacity which is an integral multiple of a preset capacity modulus and is used for storing a data block to be transmitted;
the second-stage sending register memory group has the sum of the capacities equal to the fixed capacity of the first-stage sending memory and comprises two second-stage sending register memories with the capacity of a preset capacity modulus and a plurality of second-stage sending register memories with the capacities increased in equal proportion by taking the preset capacity modulus as a base number; and
a data dividing and unloading unit, configured to select a second-level transmission register memory dedicated for a storage margin from two second-level transmission register memories with a predetermined capacity modulus when the size of the data block to be transmitted is smaller than or equal to the capacity of the second-level transmission register memory with the smallest capacity, otherwise select a second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and select a largest second-level transmission register memory with a capacity smaller than or equal to the size of the data block to be transmitted from all the second-level transmission register memories when there is no second-level transmission register memory with a capacity larger than the size of the data block to be transmitted and a difference value with the size of the data block to be transmitted smaller than the predetermined capacity modulus from all the second-level transmission register memories, and recording the selected second-level transmission register memory and the maximum data sub-blocks which can be divided from the data block to be transmitted in sequence according to the capacity of the selected second-level transmission register memory, and correspondingly transferring all the divided maximum data sub-blocks to the selected second-level transmission register memory based on the record.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010600025.0A CN111491038B (en) | 2020-06-29 | 2020-06-29 | Data transmission system in static network and method thereof |
| PCT/CN2021/103001 WO2022002020A1 (en) | 2020-06-29 | 2021-06-29 | Data transmission system and method in static network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010600025.0A CN111491038B (en) | 2020-06-29 | 2020-06-29 | Data transmission system in static network and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111491038A CN111491038A (en) | 2020-08-04 |
| CN111491038B true CN111491038B (en) | 2020-10-09 |
Family
ID=71813768
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010600025.0A Active CN111491038B (en) | 2020-06-29 | 2020-06-29 | Data transmission system in static network and method thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111491038B (en) |
| WO (1) | WO2022002020A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111491038B (en) * | 2020-06-29 | 2020-10-09 | 北京一流科技有限公司 | Data transmission system in static network and method thereof |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107395669A (en) * | 2017-06-01 | 2017-11-24 | 华南理工大学 | A kind of collecting method and system based on the real-time distributed big data of streaming |
| CN107948334A (en) * | 2018-01-09 | 2018-04-20 | 无锡华云数据技术服务有限公司 | Data processing method based on distributed memory system |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004066571A1 (en) * | 2003-01-20 | 2004-08-05 | Fujitsu Limited | Network switch apparatus and network switch method |
| US8255496B2 (en) * | 2008-12-30 | 2012-08-28 | Juniper Networks, Inc. | Method and apparatus for determining a network topology during network provisioning |
| CN107147590A (en) * | 2017-07-12 | 2017-09-08 | 郑州云海信息技术有限公司 | A kind of method and system based on rdma protocol message communicating |
| CN109194721A (en) * | 2018-08-15 | 2019-01-11 | 无锡江南计算技术研究所 | A kind of asynchronous RDMA communication dynamic memory management method and system |
| CN109117273B (en) * | 2018-08-17 | 2021-09-07 | 腾讯科技（深圳）有限公司 | Data storage method, device and equipment |
| CN111491038B (en) * | 2020-06-29 | 2020-10-09 | 北京一流科技有限公司 | Data transmission system in static network and method thereof |
-
2020
- 2020-06-29 CN CN202010600025.0A patent/CN111491038B/en active Active
-
2021
- 2021-06-29 WO PCT/CN2021/103001 patent/WO2022002020A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107395669A (en) * | 2017-06-01 | 2017-11-24 | 华南理工大学 | A kind of collecting method and system based on the real-time distributed big data of streaming |
| CN107948334A (en) * | 2018-01-09 | 2018-04-20 | 无锡华云数据技术服务有限公司 | Data processing method based on distributed memory system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022002020A1 (en) | 2022-01-06 |
| CN111491038A (en) | 2020-08-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101764835B (en) | Task allocation method and device based on MapReduce programming framework | |
| JP5238791B2 (en) | Storage apparatus and data processing method in which memory nodes having transfer function are connected to each other | |
| US8930593B2 (en) | Method for setting parameters and determining latency in a chained device system | |
| US11343175B2 (en) | Packet forwarding | |
| US20150127649A1 (en) | Efficient implementations for mapreduce systems | |
| US20120265835A1 (en) | Query performance data on parallel computer system having compute nodes | |
| WO2017156968A1 (en) | Neural network computing method, system and device therefor | |
| CN104394096A (en) | Multi-core processor based message processing method and multi-core processor | |
| US20160125566A1 (en) | SYSTEM AND METHOD FOR PROCESSING LARGE-SCALE GRAPHS USING GPUs | |
| CN107391033B (en) | Data migration method and device, computing equipment and computer storage medium | |
| CN111491038B (en) | Data transmission system in static network and method thereof | |
| US6901496B1 (en) | Line rate buffer using single ported memories for variable length packets | |
| CN106325995A (en) | GPU resource distribution method and system | |
| CN106325996A (en) | GPU resource distribution method and system | |
| US20190187927A1 (en) | Buffer systems and methods of operating the same | |
| CN103064749A (en) | Inter-process communication method | |
| CN106933882B (en) | Big data increment calculation method and device | |
| CN102646058A (en) | Method and device for selecting node where shared memory is located in multi-node computing system | |
| CN102045262B (en) | Updating method, device and network equipment of media access control address table | |
| EP3073378B1 (en) | Processing apparatus and control method thereof | |
| CN102780620A (en) | Network processor and message processing method | |
| US20150301963A1 (en) | Dynamic Temporary Use of Packet Memory As Resource Memory | |
| CN113328948A (en) | Resource management method, device, network equipment and computer readable storage medium | |
| JP2013145592A (en) | Storage devices mutually connected by memory node having transfer function and data processing method | |
| CN115686342A (en) | Data storage method and device in storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |