WO2008040231A1

WO2008040231A1 - Method and device for reassembling fragment data

Info

Publication number: WO2008040231A1
Application number: PCT/CN2007/070703
Authority: WO
Inventors: Yao Liu
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2006-09-18
Filing date: 2007-09-17
Publication date: 2008-04-10
Also published as: CN100464536C; CN1929453A

Abstract

A method for reassembling fragment data is provided. The method includes: extracting the characteristic value from the fragment data needing to be reassembled; searching the memory for the information corresponding to the characteristic value; when the information corresponding to the characteristic value is found, obtaining the reassembly information of the fragment data; when all the fragments needing to be reassembled arrive, reassembling the fragments according to their reassembly information. A device for reassembling fragment data is also provided. Using the above method and device, not only the flexibility of software reassembly is kept, but also the high-speed performance of hardware reassembly is kept. Moreover the security leak and the resource utilization hidden trouble caused by the resource of Content Addressable Memory occupied for a long time by the established reassembly information of fragment data can be avoided.

Description

Method and device for re-sampling data

This application claims priority to Chinese Patent Application No. 200610154184. 2, entitled "Method and Apparatus for Heavy-Piece Sheet Data", filed on September 18, 2006, the entire contents of which are incorporated by reference. In this application.

Technical field

The present invention relates to the field of data processing in network communication systems, and more particularly to a method and apparatus for reassembling slice data.

Background technique

In the network, the data transmission link has a limitation of a maximum transmission unit (MTU, Maxima Transmi t Uni t), that is, only data transmitted on the designated link that is less than or equal to the maximum transmission unit of the link can be transmitted. If the data that can be transmitted by the maximum transmission unit of the specified link is exceeded, then the intermediate node or the data source is fragmented, and then the reassembly of the fragmented data is performed at the receiving end or the intermediate node.

The methods of data reorganization in the prior art include: software reorganization, firmware reorganization, and hardware reorganization. The software reorganization is performed by software running in a central processing unit (CPU, Centra l Proces s ing Uni t), and the entire reorganization process needs to occupy an arithmetic processing unit and a dynamic memory (DRAM, Dynamic Random-Acces). s Memory ) resources. The firmware reorganization is a software implemented by assembly language to complete the reassembly of the fragment data, and the firmware reorganization is for the reorganization of the specific fragment data, wherein the firmware is run in a dedicated device such as a digital signal processor or a network processor. Software implemented in pure assembly language. The hardware reorganization is the reassembly of specific fragmentation data or a specific number of fragmentation data by dedicated hardware.

In the process of implementing the present invention, the inventors have found through research that: The software running in the central processing unit is responsible for the reorganization of the data in a fragmented reorganization manner, but it requires a large amount of resources of the central processing unit, and the reorganization speed is slow, Meet the requirements of high-speed data transfer; 固件 Recombining data in firmware reorganization mode is faster than software running in central processing unit responsible for fragment reorganization, but the firmware reorganization speed is still low, and it requires a large amount of firmware storage resources. The speed of reorganizing data in hardware reorganization is much faster than the first two reorganization methods, but the hardware is generally only for the reorganization of specific fragmentation data, or can only process a certain number of fragmentation data, flexibility. Poor, can not meet the needs of high-speed, flexible restructuring. By the above three reorganization methods It is known that the drawback of the prior art is that the data cannot be reorganized to meet both high speed and flexible requirements. Summary of the invention

Embodiments of the present invention provide a method and apparatus for reassembling slice data, which can simultaneously satisfy high speed and flexible recombination requirements.

In an embodiment of the present invention, a method for reassembling slice data may be provided, including: extracting feature values for slice data that needs to be reorganized, and searching corresponding information of the feature values in a memory;

When the corresponding information of the feature value is searched, the reassembly information of the fragment data is acquired; when all the fragment data that needs to be reassembled arrives, the fragment data is reorganized according to the recombination information of the fragment data.

In another embodiment of the present invention, an apparatus for reassembling slice data may be provided, including: firmware for extracting feature values for slice data that needs to be reorganized, and when searching for corresponding information of the feature values Obtaining the reassembly information of the fragment data, and determining that all the fragmentation data that needs to be reassembled arrives, and reorganizing the fragmentation data according to the acquired reorganization information;

And a content address storage, configured to create the piecemeal data information that needs to be reorganized, and search for corresponding information of the feature value according to the feature value provided by the firmware, and feed back the search result to the firmware.

In another embodiment of the present invention, an apparatus for reassembling slice data may be provided, including: an extracting unit, configured to extract feature values for the fragment data that needs to be reorganized;

a searching unit, configured to search, in the memory, corresponding information of the feature value according to the feature value extracted by the extracting unit;

And an obtaining unit, configured to acquire, when the search unit searches for corresponding information of the feature value, reassembly information of the fragment data;

And a recombining unit, configured to reassemble the fragment data according to the recombination information of the fragment data when all the fragment data that needs to be reassembled arrives.

Because the embodiment of the present invention extracts feature values for the fragment data that needs to be reorganized, the created fragment data information is searched by the content address memory, and then the fragment data is reorganized by the content address memory and the firmware. In the embodiment of the present invention, the created fragment data information is searched by using the content address memory, and the speed thereof is much higher than the search speed of the central processing unit, and the firmware is The processing speed is almost the same as that of the hardware, so that the reorganization of high-speed fragmentation data can be completed.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description For some embodiments of the present invention, other drawings may be obtained from those skilled in the art without departing from the drawings.

Figure 1 is a flow chart of an embodiment of the method of the present invention;

2 is a flow chart of another embodiment of the method of the present invention;

Figure 3 is a schematic illustration of an embodiment of the apparatus of the present invention;

Figure 4 is a schematic illustration of another embodiment of the apparatus of the present invention.

detailed description

BRIEF DESCRIPTION OF THE DRAWINGS The technical solutions in the embodiments of the present invention will be described in detail below with reference to the accompanying drawings. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative work are within the scope of the present invention.

An embodiment of the present invention provides a method for reassembling slice data: extracting feature values according to fragment data that needs to be reorganized, and the content address memory searches for the created fragment data information according to the feature value; determining the content address memory according to the search result Whether the fragmentation data information that needs to be reorganized has been created, and if so, the reassembly information of the fragmentation data is obtained from the content address memory, otherwise the process ends; determining whether all the fragmentation data that needs to be reassembled arrives, and if so, according to The acquired reorganization information reorganizes the fragmentation data, otherwise the process ends.

The specific technical solutions of the method of the embodiment of the present invention are described in detail below with reference to the accompanying drawings. Referring to FIG. 1 , FIG. 1 is a flowchart of an embodiment of a method according to the present invention. The process specifically includes the following steps: Step 101: Performing firmware extraction on a firmware of a dedicated device such as a digital signal processor or a network processor according to requirements Value, and searching for the content address memory according to the feature value, and then writing the feature value of the slice data, the related data structure, and the flag bit into the content address memory to form reassembly information of the slice data, wherein the data structure and the flag bit are The firmware is first created and then written to the content address memory.

Step 102: The content address memory searches for the created fragmented data signal according to the feature value provided by the firmware. Search and return the search results to the firmware.

Step 103: The firmware determines, according to the search result, whether the content address memory has created the fragment data information, and if yes, performs step 104; otherwise, the process ends.

Step 104: The firmware acquires reassembly information of the fragment data from the content address memory, where the reassembly information is information created by the firmware on the content address memory, and specifically includes a feature value, a related data structure, and a flag bit.

Step 105: Determine whether all the fragment data that needs to be reassembled has arrived. If yes, go to step 106, otherwise end the process.

Step 106: Reassemble all the fragment data according to the acquired reassembly information, and send the reassembly data to the data link.

The embodiment of the present invention selects a content address memory (CAM, Content Addres sab le Memory) to search for the created fragment data information, because the content address memory is used to search for the created fragment data information. Higher than the search speed of the central processing unit, of course, does not exclude the use of the central processing unit to search for the created fragmentation data information. In addition, the firmware is software running in a dedicated device such as a digital signal processor or a network processor, and the processing speed of the firmware is almost the same as that of the hardware. Therefore, in the embodiment of the present invention, the firmware and the content address memory cooperate to complete the data reorganization, and thus The reorganization of high-speed fragmentation data can be completed. At the same time, the firmware is generally software programmable, so that it can be adjusted according to actual needs, thus maintaining the flexibility of software fragmentation and reorganization in the central processing unit.

Referring to FIG. 2, FIG. 2 is a flowchart of another embodiment of the method according to the present invention. The embodiment reorganizes the fragment data into two types: data reorganization under normal conditions and data reorganization under abnormal conditions. The process specifically includes the following steps. :

Step 201: The fragmented data enters the system.

Step 202: The firmware running in a dedicated device such as a digital signal processor or a network processor determines whether the data needs to be reassembled according to the content of the fragmented data. If yes, step 203 is performed; otherwise, the process ends.

Step 203: The firmware extracts the feature value according to the fragment data that needs to be reassembled, and searches the content address memory according to the feature value, and then writes the feature value of the fragment data, the related data structure, and the flag bit into the content address memory to form a fragment. Data reorganization information, where the data structure and flag bits are The firmware is first created and then written to the content address memory.

Step 204: The content address memory searches for the created fragment data information, and returns the search result to the firmware.

Step 205: The firmware determines, according to the search result, whether the content address memory has created the fragmentation data information, and if yes, step 208 is performed, otherwise step 206 is performed.

Step 206: The firmware initializes the content address memory according to the feature value, and also initializes the related data structure and flag.

Step 207: Put the fragment data into the data fragment chain, and wait for the next fragment data, and end the process. Step 208: The firmware acquires reassembly information of the fragment data from the content address storage.

Step 209: The central processing unit determines whether the storage time of the reassembly information of the fragment data in the content address memory exceeds a preset time. If yes, it indicates that the reorganization process is abnormal, and then performs step 21 0; otherwise, step 21 1 is performed.

Step 21: The central processing unit performs aging processing on the reorganization information stored in the content address memory, and clears the reorganization information of the long-term occupied content address memory resources, so as to ensure that the fragmented data that needs to be reorganized subsequently can apply for the available content. The address memory resource, therefore, the central processing unit needs to periodically age the recombination information existing in the content address memory, thereby ensuring the rational use of resources.

Step 21 1. Determine whether all the fragment data has arrived. If yes, go to step 212. Otherwise, go to step 21 3.

Step 212: Reorganize all the fragment data according to the acquired reassembly information, and send the reassembly data to the data link, and end the process.

Step 21 3. Set the identification bit, for example, which fragment data has been reached, and then put the fragmentation data into the data fragmentation chain, wait for the next fragmentation data, and end the process.

Step 209 and step 21 0 are an exception processing process for the reassembly information of the fragment data to occupy the content address memory resource for a long time. If the entire reorganization process is normal, step 209 and step 21 0 may be removed.

It can be seen from the above that in the embodiment of the present invention, the created fragmentation data information is assisted by the content address memory, and in addition, the created fragmentation data information can be searched by the central processing unit. In addition, the embodiment of the present invention is a reorganization letter stored in the content address memory by the central processing unit. The aging process is performed, and the reorganization information can be aged by the firmware.

In addition, it should be understood that those skilled in the art can understand that all or part of the steps of implementing the above embodiments may be completed by hardware related to program instructions, and the program may be stored in a computer readable storage medium. The storage medium is, for example, a ROM/RAM, a magnetic disk, an optical disk, or the like.

An embodiment of the present invention also provides an apparatus for reassembling slice data, the apparatus comprising firmware and a content address memory, wherein: firmware is used to extract feature values according to fragment data that needs to be reorganized, and the content address memory is provided according to firmware The feature value searches for the created fragment data information;

The firmware determines, according to the search result, whether the fragmentation data information that needs to be reassembled has been created in the content address memory, and acquires the reorganization information of the fragmentation data from the content address storage when the fragmentation data information that needs to be reorganized has been created. ;

The firmware then determines whether all the fragmentation data that needs to be reassembled arrives, and reassembles the fragmentation data according to the acquired reassembly information when all the fragmentation data that needs to be reassembled arrives.

Referring to FIG. 3, FIG. 3 is a schematic diagram of an embodiment of the apparatus of the present invention. The apparatus includes at least a firmware 301, a content address memory 302, and may further include a central processing unit 303.

The firmware 301 is configured to extract feature values from the fragment data that needs to be reassembled, search the content address memory 302 according to the feature values, and write the feature values, related data structures, and flag bits that need to be reorganized into the content address memory. 302 forms reassembly information, wherein the data structure and flag bits are both created by firmware 301 and then written to content address memory 302.

The content address memory 302 is configured to search for the created fragment data information according to the fragment data feature value provided by the firmware 301, and return the search result to the firmware 301;

The central processing unit 303 is configured to determine whether the time occupied by the reassembly information of the fragmentation data in the content address memory 302 exceeds a preset time, and aging the reassembly information when the reorganization information occupation time exceeds a preset time. . The aging process is to clear the reassembly information, and release the content address storage 302 resource occupied by the reorganization information.

The firmware 301 extracts the feature value from the fragment data that needs to be reassembled, searches the content address memory 302 according to the feature value, and writes the feature value into the content address memory 302; the content address memory 302 is based on the fragment data feature value provided by the firmware 301. The created piecemeal data information is searched and the search result is returned to the firmware 301. The firmware 301 determines whether the content address memory 302 has created the slice data information based on the search result, and acquires the reassembly information of the slice data from the content address memory 302 if the slice data information has been created.

The central processing unit 303 determines whether the storage time of the reassembly information of the fragmentation data on the content address memory 302 exceeds a preset time, and stores the content address memory 302 in the case where the reorganization information is stored in the content address memory 302 for a preset time. The reassembly information is subjected to aging processing, and the reassembly information of the resource occupies the content address memory 302 for a long time is cleared, so that the shard data that needs to be reassembled can be applied to the available content address memory resource.

The firmware 301 determines whether all the fragmentation data that needs to be reassembled has arrived, and reassembles all the fragmentation data according to the reassembly information when all the fragmentation data has arrived, and then transmits the reassembled data to the data link.

It can be seen from the embodiment of the present invention that the central processing unit 303 aging the fragment data recombination information stored in the content address memory 302 by the central processing unit 303, and it may also age the recombination information by the firmware 301, if the firmware 301 is reorganized. The information is aging, and the central processing unit 303 is required to send the determination result of whether the storage time exceeds the preset time to the firmware 301, and the firmware 301 determines whether the reorganization information needs to be aged according to the determination result. In addition, in the embodiment of the present invention, the created fragment data information is searched by the content address memory 302. The embodiment of the present invention does not exclude the use of the central processing unit 303 to search for the created fragment data information.

As shown in FIG. 4, it is a schematic diagram of another embodiment of the apparatus of the present invention. The apparatus at least includes: an extracting unit 401, a searching unit 402, an obtaining unit 403, and a recombining unit 404; wherein:

The extracting unit 401 is configured to extract feature values for the fragment data that needs to be reorganized;

The searching unit 402 is configured to search for the corresponding information of the feature value in the content address memory 400 according to the feature value extracted by the extracting unit 401;

The obtaining unit 403 is configured to determine, according to the search result of the searching unit 402, that the content address memory 400 has created the fragmentation data information that needs to be reorganized, and when the searching unit searches for the corresponding information of the feature value, acquire the fragmentation data. Reorganization information;

The reorganization unit 404 is configured to reassemble the fragment data according to the reassembly information of the fragment data when all the fragment data that needs to be reassembled arrives.

Referring to FIG. 4, the apparatus may further include a first determining unit 405, configured to enter the system according to The fragmented data content determines that the fragmentation data needs to be reorganized, and the extraction unit 401 is triggered.

The device may further include a second determining unit 406 and an aging unit 407, wherein: the second determining unit 406 is configured to determine whether the storage time of the reorganization information in the content address memory 400 exceeds a preset time, and outputting the discriminating when the preset time is exceeded. Result

The aging unit 407 is configured to age the recombination information according to the discriminating result.

The reassembly information of the acquired fragment data may include a feature value, a data structure, and a flag bit of the fragment data.

The device may further include an initialization unit 408, configured to initialize the content address memory 400 according to the feature value when the content address memory 400 does not create the fragment data information according to the search result of the search unit 402, that is, the The feature values, data structures, and flag bits of the slice data are written in the content address memory 400.

In addition, the apparatus may further include a marking unit 409, configured to set the identification bit when only a part of the fragmentation data to be reassembled arrives, put the fragmentation data into the data fragmentation chain, and wait for the next fragmentation data.

It should be noted that the foregoing second judging unit 406 and the aging unit 407 may be disposed in the central processing unit in addition to the foregoing embodiment of the apparatus of the present invention, and may reassemble the fragment data stored in the content address memory 400. Performing aging; or the second judging unit 406 is disposed in the central processing unit, and the aging unit 407 is disposed in the content address memory 400, so that the second judging unit 406 in the central processing unit is required to store the storage time exceeding the preset. The result of the determination of the time is sent to the aging unit 407 provided in the content address memory 400, and the aging unit 407 determines whether the reorganization information needs to be aged according to the judgment result.

In addition, the above-described initializing unit 408 and search unit 402 also do not exclude the possibility of being set in the content address memory 400. The search unit 402 can be set to search the created slice data information in the content address memory 400, and does not exclude the possibility of being set in the central processing unit.

The embodiment of the present invention extracts feature values for the fragment data that needs to be recombined, and then searches for the created fragment data information by the content address memory, and then completes the reorganization of the fragment data by the content address memory and the firmware. In the example, the content of the created fragmented data is searched by using the content address memory, which is much faster than the search speed of the central processing unit, and the processing speed of the firmware is almost the same as that of the hardware, so that the high-speed fragmented data can be completed. Reorganization work, another, The firmware is generally software programmable, so that it can be adjusted according to actual needs, thus maintaining the flexibility of software fragmentation re-running in the central processing unit.

Secondly, since the central processing unit determines whether the storage time of the reorganization information in the content address memory exceeds the preset time by the central processing unit, if the storage time exceeds the preset time, the central processing unit or firmware points to the content address memory. The data reassembly information is aging, and the reassembly information that occupies the content address memory resource for a long time is cleared, so that the fragment data that needs to be reassembled can be applied to the available content address memory resource, thereby ensuring the rational use of the resource, and further Avoid the security vulnerabilities and resource utilization risks caused by the reorganization information of the created fragmented data for a long time.

The method and apparatus for a heavy component slice data provided by the present invention are described in detail above, and the description is only for helping to understand the method of the present invention and its core idea; meanwhile, for those skilled in the art, according to the present invention, The present invention is not limited by the scope of the present invention.

Claims

Rights request

A method for weighting slice data, comprising:

Extracting feature values for the fragment data that needs to be reorganized, and searching corresponding information of the feature values in the memory;

The method of extracting feature data according to claim 1, wherein the step of extracting feature values for the piece of data to be reassembled further comprises:

It is determined that the fragment data needs to be reorganized according to the content of the fragment data entering the system.

The method of reassembling slice data according to claim 1 or 2, wherein the obtaining the reassembly information of the fragment data further comprises:

And determining that the reorganization information is stored in the memory for more than a preset time, and then performing the aging processing on the reassembly information.

The method of reassembling slice data according to claim 3, wherein the recombination information of the acquired slice data comprises a feature value, a data structure, and a flag bit of the slice data.

The method for reassembling the slice data according to claim 1, further comprising: determining, according to the search result, that the memory does not create the slice data information, and then using the feature value and data of the slice data Structure and flag bits are written to the memory.

The method for reassembling slice data according to claim 1, further comprising: setting a flag bit when only a part of the fragment data to be reassembled arrives, and then placing the slice data into the data slice chain , waiting for the next fragmentation data.

7. A device for re-sampling data, comprising:

Firmware, configured to extract feature values for the fragment data that needs to be reorganized, and obtain the recombination information of the fragment data when the corresponding information of the feature values is searched, and determine that all the fragment data that needs to be reassembled arrives Reorganizing the fragmented data according to the acquired reorganization information;

8. The apparatus of claim 7, wherein the method further comprises:

The central processing unit is configured to determine that the reorganization information is stored in the content address memory for more than a preset time, and then the reassembly information is aged.

9. The apparatus of claim 7, wherein the method further comprises:

a central processing unit, configured to determine that the reorganization information is stored in the content address memory for more than a preset time;

The firmware is further configured to age the recombination information according to a determination result of the central processing unit.

10. The apparatus for reassembling slice data according to claim 7 or 9, wherein the firmware is further configured to write feature values, data structures, and flag bits of the slice data into the content address memory. .

11. A device for re-sampling data, comprising:

An extracting unit, configured to extract feature values from the fragment data that needs to be reorganized;

12. The apparatus of claim 11, wherein the method further comprises:

The first determining unit is configured to determine that the fragment data needs to be reassembled according to the content of the fragmented data entering the system, and trigger the extracting unit.

The apparatus for re-sampling data according to claim 11 or 12, further comprising:

a second determining unit, configured to determine whether the storage time of the reorganization information in the memory exceeds a preset time, and output a determination result when the preset time is exceeded; The aging unit is configured to age the recombination information according to the determination result output by the second determining unit.

14. The apparatus for reassembling slice data according to claim 13, wherein the reassembly information of the acquisition fragment data comprises a feature value, a data structure, and a flag bit of the slice data.

The apparatus of claim 11, further comprising: an initializing unit, configured to determine, according to a search result of the searching unit, that the content address memory does not create the fragment data information And writing the feature values, data structures, and flag bits of the slice data into the memory.

The apparatus for reassembling slice data according to claim 11, further comprising: a marking unit, configured to: when only a part of the fragmentation data that needs to be reassembled arrives, set the identification bit, and put the fragmentation data into Data segmentation chain.