CN109726181A - A kind of data processing method and data processing equipment - Google Patents
A kind of data processing method and data processing equipment Download PDFInfo
- Publication number
- CN109726181A CN109726181A CN201811621556.7A CN201811621556A CN109726181A CN 109726181 A CN109726181 A CN 109726181A CN 201811621556 A CN201811621556 A CN 201811621556A CN 109726181 A CN109726181 A CN 109726181A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- file
- original
- transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The embodiment of the present application provides a kind of data processing method and data processing equipment, which comprises obtains data message；Restore the carrying data in the data message；Based on the carrying data, transmission data are generated；The transmission data are transmitted to the data management module being pre-created, wherein, the data management module receives and the transmission data is written to mapping memory, and after received transmission data form a complete also original, the also original is stored into storage medium corresponding to the mapping memory.The storage operation of reduction parsing operation and the carrying data restored to data message can be separated progress, more preferably performance is provided when the carrying data in data message and the reduction data message to obtain, improve operating efficiency, guarantee that data message will not be lost, ensure that the integrality of also original.
Description
Technical field
This application involves data convert field, especially a kind of data processing method and data processing equipment.
Background technique
Currently, realizing that one is elder generations from network interface card queue when reduction to the file data information in message
A data message is grabbed, protocol analysis is then carried out, restores a carrying data, carrying data are then written to storage
On medium；After having handled a message, continuation grabs next data message from network interface card queue, then carries out protocol analysis reduction
Data are carried out, and storage medium is written into carrying data, are comprised the concrete steps that and are opened file, write-in carrying data, close file,
One data message of every parsing, a carrying data, which are written, will carry out these three steps.File reduction process ceaselessly carries out
File Open and closing need ceaselessly to carry out the reading and write operation of data, seriously affect reduction efficiency.Simultaneously as
The message number that network interface card queue can cache is limited, if network interface card number of queues is full, the subsequent data message for reaching network interface card will be by
It abandons, and file restores process due to being serial process message, when carrying writing speed is slower, has little time from network interface card
Queue acquires data message, will lead to the packet loss processing carried out due to network interface card queue full, and then causes file reduction endless
It is whole.
Another file writing mode is file to be opened when first carrying data is written, in writing data blocks
Afterwards, it is not related to closed file, only closes file after all carrying data write.But this mode needs file that also original system is
One filec descriptor of file maintenance of each opening, this needs more resources for consuming file reduction process.Meanwhile it operating
The number that system opens filec descriptor to its affiliated process be it is conditional, open file number when file reduction process and reach
After the upper limit, operating system does not allow file reduction process to create new file again, this also results in file reduction process and then loses
Lose also original.
Summary of the invention
In view of the above-mentioned problems in the prior art, this application provides a kind of carrying data that will be restored separately
Storage improves the data processing method and data processing equipment of file reduction efficiency to form completely also original.
The embodiment of the present application provides a kind of data processing method, comprising:
Obtain data message；
Restore the carrying data in the data message；
Based on the carrying data, transmission data are generated；
The transmission data are transmitted to the data management module being pre-created, wherein the data management module receives
And the transmission data are written to mapping memory, and after received transmission data form a complete also original, by institute
It states also original and stores storage medium corresponding to the mapping memory.
It is described to be based on the carrying data in some embodiments of the present application, generate transmission data, comprising:
Based on the carrying data, generation includes in file description information, file data information or closing of a file information
One or more of transmission data, to make institute after the transmission data are transmitted to the data management module being pre-created
The information that data management module is stated according to the transmission data received carries out respective handling, wherein the file description information, institute
Stating in file data information and the closing of a file information includes identification information.
It is described to be based on the carrying data in some embodiments of the present application, generate transmission data, comprising:
If the carrying data are first carrying data of also original, the carrying data are based on, generate file
Description information, to be retouched by the file after the file description information is transmitted to the data management module being pre-created
State the also original that information creation in the corresponding storage catalogue of the mapping memory includes the identification information；
If the carrying data are not first carrying data of also original, nor last of the also original
A carrying data are then based on the carrying data, file data information are generated, the file data information is being transmitted to institute
After stating the data management module being pre-created, by by the file data information be added to in the file data information
In the also original that identification information matches；
If the carrying data are the last one carrying data of also original, the carrying data are based on, text is generated
Part closing information, with after the closing of a file information to be transmitted to the data management module being pre-created, by described
Closing of a file information closes the also original to match with the identification information in the closing of a file information.
It is described that the transmission data are transmitted to the data management mould being pre-created in some embodiments of the present application
Block, comprising:
The transmission data are written to lock-free queue, are transmitted to the transmission data by the lock-free queue described
The data management module being pre-created, wherein the lock-free queue is the data management module by shared drive creation, and
The quantity of the lock-free queue is identical as the also quantity of original process of carrying data in the reduction data message.
In some embodiments of the present application, the method be applied to the first electronic equipment, first electronic equipment with
The communication connection of second electronic equipment, when the data management module being pre-created is set on second electronic equipment, institute
It states and the transmission data is transmitted to the data management module being pre-created, comprising:
The transmission data are transmitted to data channel, are transmitted to the transmission data by the data channel described
The data management module being pre-created, wherein the data channel is to make first electronic equipment and second electronics
Data interaction is carried out between equipment.
In some embodiments of the present application, the data management module is carried out according to the information of the transmission data received
Respective handling, comprising:
If including the file description information in the information of received transmission data, characterizing the transmission data is also
First transmission data of original create in the corresponding storage catalogue of the mapping memory according to the file description information
It include the also original of the identification information；
If only including the file data information in the information of received transmission data, by the file data information
It is added in the also original to match with the identification information in the file data information；
If including the closing of a file information in the information of received transmission data, characterizing the transmission data is also
The last one transmission data of original close the also original according to the closing of a file information, to characterize the reduction
File, which has restored, to be finished, and the also original is stored to the storage medium.
The embodiment of the present application also provides a kind of data processing equipments, comprising:
Module is obtained, is used to obtain data message
Recovery module is used to restore the carrying data in the data message；
Generation module is used to generate transmission data based on the carrying data；
Transmission module is used to the transmission data being transmitted to the data management module being pre-created, wherein the number
It is received according to management module and the transmission data is written to mapping memory, and form one completely also in received transmission data
After original, the also original is stored into storage medium corresponding to the mapping memory.
In some embodiments of the present application, the generation module is specifically used for:
Based on the carrying data, generation includes in file description information, file data information or closing of a file information
One or more of transmission data, to make institute after the transmission data are transmitted to the data management module being pre-created
The information that data management module is stated according to the transmission data received carries out respective handling, wherein the file description information, institute
Stating in file data information and the closing of a file information includes identification information.
In some embodiments of the present application, the transmission module is specifically used for:
The transmission data are written to lock-free queue, are transmitted to the transmission data by the lock-free queue described
The data management module being pre-created, wherein the lock-free queue is the data management module by shared drive creation, and
The quantity of the lock-free queue is identical as the also quantity of original process of carrying data in the reduction data message.
In some embodiments of the present application, the data processing equipment and the second electronic equipment are communicated to connect, the number
When being set on second electronic equipment according to management module, the transmission module is specifically used for:
The transmission data are transmitted to data channel, are transmitted to the transmission data by the data channel described
The data management module being pre-created, wherein the data channel is to make first electronic equipment and second electronics
Data interaction is carried out between equipment.
Compared with prior art, the beneficial effects of the present application are as follows: held according to what is restored from the data message of acquisition
Data are carried, generate transmission data, and then transmission data are transmitted to the data management module being pre-created, and will not be restored
Carrying data write direct storage medium, can be by the reduction parsing operation to data message and the carrying data that restore
Storage operation separately carries out, and can provide more preferably when the carrying data in data message and the reduction data message to obtain
Performance, improve operating efficiency, and can't be to obtaining to the transmission data of generation storage itself by data management module
Extract operation and restoring operation cause excessive influence, simultaneously, additionally it is possible to guarantee that data message will not be lost, ensure that and go back original text
The integrality of part.
Detailed description of the invention
Fig. 1 is the flow chart of the data processing method in the embodiment of the present application；
Fig. 2 is the block diagram of the data processing equipment in the embodiment of the present application.
Specific embodiment
To make those skilled in the art better understand the technical solution of the application, with reference to the accompanying drawing and specific embodiment party
Formula elaborates to the application.
The various schemes and feature of the application are described herein with reference to attached drawing.
By the description of the preferred form with reference to the accompanying drawings to the embodiment for being given as non-limiting example, the application's
These and other characteristic will become apparent.
It is also understood that although the application is described referring to some specific examples, those skilled in the art
Member realizes many other equivalents of the application in which can determine, they have feature as claimed in claim and therefore all
In the protection scope defined by whereby.
When read in conjunction with the accompanying drawings, in view of following detailed description, above and other aspect, the feature and advantage of the application will become
It is more readily apparent.
The specific embodiment of the application is described hereinafter with reference to attached drawing；It will be appreciated, however, that the embodiment invented is only
Various ways implementation can be used in the example of the application.Known and/or duplicate function and structure is simultaneously not described in detail with basis
True intention is distinguished in the operation of the history of user, and unnecessary or extra details is avoided to make the application smudgy.Cause
This, the specific structural and functional details invented herein are not intended to restriction, but as just the base of claim
Plinth and representative basis are used to that those skilled in the art to be instructed diversely to use this Shen with substantially any appropriate detailed construction
Please.
This specification can be used phrase " in one embodiment ", " in another embodiment ", " in another embodiment
In " or " in other embodiments ", it can be referred to one or more of the identical or different embodiment according to the application.
The embodiment of the present application provides a kind of data processing method, comprising:
Obtain data message；
Restore the carrying data in the data message；
Based on the carrying data, transmission data are generated；
The transmission data are transmitted to the data management module being pre-created, wherein the data management module receives
And the transmission data are written to mapping memory, and after received transmission data form a complete also original, by institute
It states also original and stores storage medium corresponding to the mapping memory.
It can be seen that by above-mentioned method according to the carrying data restored from the data message of acquisition, generate and pass
Transmission of data, and then transmission data are transmitted to the data management module being pre-created, and it is not that the carrying data restored are straight
Write-in storage medium is connect, the storage operation of reduction parsing operation and the carrying data restored to data message can be separated
It carries out, more preferably performance can be provided when the carrying data in data message and the reduction data message to obtain, improved
Operating efficiency, and passing through data management module can't operate and go back to obtaining to the transmission data storage of generation itself
Origin operation causes excessive influence, simultaneously, additionally it is possible to guarantee that data message will not be lost, ensure that the integrality of also original.
In order to simpler, detailed understanding above-mentioned technical proposal, below with reference to embodiment and attached drawing to above-mentioned
Data processing method is described in detail.
As shown in FIG. 1, FIG. 1 is the flow chart of data processing method in the embodiment of the present application, the data processing method packet
Include following steps:
Step 101: obtaining data message specifically, can be and read original data message from network interface card queue.
Step 102: restoring the carrying data in the data message.After getting data message, just to data message
It is parsed, and then restores the carrying data in data message, wherein the carrying data are gone back by what data message included
The partial document information of original, it is of course also possible to whole the file informations of also original.Above-mentioned to the data message
It is parsed and is generated in carrying data procedures, required memory is obtained from shared drive, wherein this is shared
The physical memory of the size of the physical memory for the electronic equipment that the size of memory is applied to depending on this method, electronics and equipment is got over
Greatly, which can also be bigger, meanwhile, which can be in acquisition, parsing and the reduction for carrying out carrying data
When use.
Step 103: being based on the carrying data, generate transmission data.Specifically, it can be according to the carrying number restored
According to which part for being specially also original, and then generate corresponding transmission data.
It is described to be based on the carrying data in some embodiments of the present application, generate transmission data, comprising: be based on institute
Carrying data are stated, generation includes one or more of file description information, file data information or closing of a file information
Data are transmitted, to make the data management module after the transmission data are transmitted to the data management module being pre-created
Information according to the transmission data received carries out respective handling, wherein the file description information, the file data information
It and in the closing of a file information include identification information.It specifically, include mark letter in the file description information
It ceases, go back old file name and satellite information, wherein the satellite information can be configured according to actual needs；The number of files
It is believed that including identification information and blocks of files in breath, wherein blocks of files can be the partial data in the carrying data；It is described
Identification information is comprised only in closing of a file information.
It is described to be based on the carrying data in some embodiments of the present application, generate transmission data, comprising: if described
Carrying data are first carrying data of also original, then are based on the carrying data, generate file description information, specifically
Ground can be the adeditive attribute based on carrying data and generate file description information, wherein adeditive attribute can be for such as mark letter
Breath, file authentic document name, transport protocol etc., the file description information to be transmitted to the data management mould being pre-created
After block, being created in the corresponding storage catalogue of the mapping memory by the file description information includes the identification information
Also original when the adeditive attribute based on carrying data generates file description information, can also be held certainly based on described
It carries data and generates file data information, to include the identification information and after original having created, can also will be based on
The carrying data generation file data information is added to this and goes back in original；If the carrying data are not the of also original
One carrying data, nor the last one carrying data of the also original, then be based on the carrying data, generate file
Data information, with after the file data information to be transmitted to the data management module being pre-created, by will be described
File data information is added in the also original to match with the identification information in the file data information；If the carrying
Data are the last one carrying data of also original, then are based on the carrying data, generate closing of a file information, specifically,
It can be the adeditive attribute (here only have identification information) based on carrying data and generate a closing of a file information, with will be described
After closing of a file information is transmitted to the data management module being pre-created, by the closing of a file information close with it is described
The also original that identification information in closing of a file information matches.
Step 104: the transmission data being transmitted to the data management module being pre-created, wherein the data management
Module receives and the transmission data is written to mapping memory, and forms one in received transmission data and completely go back original
Afterwards, the also original is stored into storage medium corresponding to the mapping memory.Specifically, the mapping memory can be with
Catalogue in storage medium is corresponding.And a complete also original is formed in received transmission data and deposits the also original
Storage to described in after the corresponding storage medium of the mapping memory, can also being stored in the mapping memory and also original into
Row is deleted, and then discharges the space of the mapping memory, and other also originals are stored and restored so as to subsequent.
It is described that the transmission data are transmitted to the data management mould being pre-created in some embodiments of the present application
Block, comprising: the transmission data are written to lock-free queue, are transmitted to the transmission data by the lock-free queue described
The data management module being pre-created, wherein the lock-free queue is the data management module by shared drive creation, and
The quantity of the lock-free queue is identical as the also quantity of original process of carrying data in the reduction data message,
So that each also original process both corresponds to a lock-free queue, so that each also original can be by same
A lock-free queue is transmitted, and improves efficiency of transmission, and guarantee the accuracy of also original.
In some embodiments of the present application, the method be applied to the first electronic equipment, first electronic equipment with
The communication connection of second electronic equipment, certainly, the method can also be applied to multiple first electronic equipments simultaneously, and multiple described
First electronic equipment is communicated to connect with second electronic equipment, is set in the data management module being pre-created described
It is described that the transmission data are transmitted to the data management module being pre-created, comprising: by the biography when on the second electronic equipment
Transmission of data is transmitted to data channel, and the transmission data are transmitted to the data pipe being pre-created by the data channel
Manage module, wherein the data channel carries out data between first electronic equipment and second electronic equipment to make
Interaction.Specifically, it can be and the transmission data on multiple first electronic equipments be transmitted to second by the data channel
Electronic equipment, in the present embodiment, the data channel can be the channel Socket or other read/write channels etc..
The embodiment of the present application also provides a kind of data processing equipments, as shown in Figure 2, comprising:
Module 1 is obtained, is used to obtain data message
Recovery module 2 is used to restore the carrying data in the data message；
Generation module 3 is used to generate transmission data based on the carrying data；
Transmission module 4 is used to the transmission data being transmitted to the data management module being pre-created, wherein described
Data management module receives and the transmission data is written to mapping memory, and forms one completely in received transmission data
Also after original, the also original is stored into storage medium corresponding to the mapping memory.
In some embodiments of the present application, the generation module 3 is specifically used for:
Based on the carrying data, generation includes in file description information, file data information or closing of a file information
One or more of transmission data, to make institute after the transmission data are transmitted to the data management module being pre-created
The information that data management module is stated according to the transmission data received carries out respective handling, wherein the file description information, institute
Stating in file data information and the closing of a file information includes identification information.
In some embodiments of the present application, the generation module 3 is specifically used for:
If the carrying data are first carrying data of also original, the carrying data are based on, generate file
Description information, to be retouched by the file after the file description information is transmitted to the data management module being pre-created
State the also original that information creation in the corresponding storage catalogue of the mapping memory includes the identification information；
If the carrying data are not first carrying data of also original, nor last of the also original
A carrying data are then based on the carrying data, file data information are generated, the file data information is being transmitted to institute
After stating the data management module being pre-created, by by the file data information be added to in the file data information
In the also original that identification information matches；
If the carrying data are the last one carrying data of also original, the carrying data are based on, text is generated
Part closing information, with after the closing of a file information to be transmitted to the data management module being pre-created, by described
Closing of a file information closes the also original to match with the identification information in the closing of a file information.
In some embodiments of the present application, the transmission module 4 is specifically used for:
The transmission data are written to lock-free queue, are transmitted to the transmission data by the lock-free queue described
The data management module being pre-created, wherein the lock-free queue is the data management module by shared drive creation, and
The quantity of the lock-free queue is identical as the also quantity of original process of carrying data in the reduction data message.
In some embodiments of the present application, the data processing equipment and the second electronic equipment are communicated to connect, the number
When being set on second electronic equipment according to management module, the transmission module 4 is specifically used for:
The transmission data are transmitted to data channel, are transmitted to the transmission data by the data channel described
The data management module being pre-created, wherein the data channel is to make first electronic equipment and second electronics
Data interaction is carried out between equipment.
In some embodiments of the present application, the data management module is carried out according to the information of the transmission data received
Respective handling, comprising:
If including the file description information in the information of received transmission data, characterizing the transmission data is also
First transmission data of original create in the corresponding storage catalogue of the mapping memory according to the file description information
It include the also original of the identification information；
If only including the file data information in the information of received transmission data, by the file data information
It is added in the also original to match with the identification information in the file data information；
If including the closing of a file information in the information of received transmission data, characterizing the transmission data is also
The last one transmission data of original close the also original according to the closing of a file information, to characterize the reduction
File, which has restored, to be finished, and the also original is stored to the storage medium.
The storage medium introduced by the present embodiment, electronic equipment are method institute that processing is instructed in the embodiment of the present application
Corresponding storage medium, electronic equipment, so, based on command processing method in the embodiment of the present application, those skilled in the art
The specific embodiment and its various change form of storage medium in the embodiment of the present application, electronic equipment can be understood, so
The storage medium, electronic equipment are no longer discussed in detail herein.As long as technical staff described in this field implements the application implementation
Storage medium, the electronic equipment of command processing method, belong to the range to be protected of the application in example.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processing module of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices with
A machine is generated, so that generating use by the instruction that the processing module of computer or other programmable data processing devices executes
In the function that realization is specified in one box or multiple boxes of one process or multiple processes and/or block diagrams of flow chart
Device.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
The manufacture of device is enabled, which realizes in a side of one process or multiple processes and/or block diagrams of flow chart
The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing devices, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one process or multiple processes and/or block diagrams of flow chart
One box or multiple boxes in specify function the step of.
Above embodiments are only the exemplary embodiment of the application, are not used in limitation the application, the protection scope of the application
It is defined by the claims.Those skilled in the art can make respectively the application in the essence and protection scope of the application
Kind modification or equivalent replacement, this modification or equivalent replacement also should be regarded as falling within the scope of protection of this application.
Claims (10)
1. a kind of data processing method characterized by comprising
Obtain data message；
Restore the carrying data in the data message；
Based on the carrying data, transmission data are generated；
The transmission data are transmitted to the data management module being pre-created, wherein the data management module is received and incited somebody to action
The transmission data are written to mapping memory, and after received transmission data formation one completely goes back original, described will go back
Original stores storage medium corresponding to the mapping memory.
2. data processing method according to claim 1, which is characterized in that it is described to be based on the carrying data, it generates and passes
Transmission of data, comprising:
Based on the carrying data, generation includes one in file description information, file data information or closing of a file information
Kind or several transmission data, to make the number after the transmission data are transmitted to the data management module being pre-created
Information according to management module according to the transmission data received carries out respective handling, wherein the file description information, the text
It include identification information in part data information and the closing of a file information.
3. data processing method according to claim 2, which is characterized in that it is described to be based on the carrying data, it generates and passes
Transmission of data, comprising:
If the carrying data are first carrying data of also original, the carrying data are based on, generate file description
Information, to describe to believe by the file after the file description information is transmitted to the data management module being pre-created
Cease the also original that the creation in the corresponding storage catalogue of the mapping memory includes the identification information；
If the carrying data are not first carrying data of also original, nor the last one of the also original is held
Carry data, then be based on the carrying data, generate file data information, with the file data information is transmitted to it is described pre-
After the data management module first created, by the way that the file data information is added to and the mark in the file data information
In the also original that information matches；
If the carrying data are the last one carrying data of also original, the carrying data are based on, file is generated and closes
Information is closed, to pass through the file after the closing of a file information to be transmitted to the data management module being pre-created
Closing information closes the also original to match with the identification information in the closing of a file information.
4. data processing method according to claim 2, which is characterized in that described to be transmitted to the transmission data in advance
The data management module of creation, comprising:
The transmission data are written to lock-free queue, by the lock-free queue by the transmission data be transmitted to it is described in advance
The data management module of creation, wherein the lock-free queue is created for the data management module by shared drive, and described
The quantity of lock-free queue is identical as the also quantity of original process of carrying data in the reduction data message.
5. data processing method according to claim 2, which is characterized in that the method is applied to the first electronic equipment,
First electronic equipment and the second electronic equipment communicate to connect, and are set to described the in the data management module being pre-created
It is described that the transmission data are transmitted to the data management module being pre-created when on two electronic equipments, comprising:
The transmission data are transmitted to data channel, by the data channel by the transmission data be transmitted to it is described in advance
The data management module of creation, wherein the data channel is to make first electronic equipment and second electronic equipment
Between carry out data interaction.
6. data processing method according to claim 2, which is characterized in that the data management module foundation received
The information for transmitting data carries out respective handling, comprising:
If including the file description information in the information of received transmission data, characterizing the transmission data is to go back original text
First transmission data of part, create in the corresponding storage catalogue of the mapping memory according to the file description information and include
There is the also original of the identification information；
If only including the file data information in the information of received transmission data, the file data information is added
Into the also original to match with the identification information in the file data information；
If including the closing of a file information in the information of received transmission data, characterizing the transmission data is to go back original text
The last one transmission data of part close the also original according to the closing of a file information, to characterize the also original
It has restored and has finished, and the also original has been stored to the storage medium.
7. a kind of data processing equipment characterized by comprising
Module is obtained, is used to obtain data message
Recovery module is used to restore the carrying data in the data message；
Generation module is used to generate transmission data based on the carrying data；
Transmission module is used to the transmission data being transmitted to the data management module being pre-created, wherein the data pipe
Reason module receives and the transmission data is written to mapping memory, and forms one in received transmission data and completely go back original text
After part, the also original is stored into storage medium corresponding to the mapping memory.
8. data processing equipment according to claim 7, which is characterized in that the generation module is specifically used for:
Based on the carrying data, generation includes one in file description information, file data information or closing of a file information
Kind or several transmission data, to make the number after the transmission data are transmitted to the data management module being pre-created
Information according to management module according to the transmission data received carries out respective handling, wherein the file description information, the text
It include identification information in part data information and the closing of a file information.
9. data processing equipment according to claim 8, which is characterized in that the transmission module is specifically used for:
The transmission data are written to lock-free queue, by the lock-free queue by the transmission data be transmitted to it is described in advance
The data management module of creation, wherein the lock-free queue is created for the data management module by shared drive, and described
The quantity of lock-free queue is identical as the also quantity of original process of carrying data in the reduction data message.
10. data processing equipment according to claim 8, which is characterized in that the data processing equipment and the second electronics
Equipment communication connection, when the data management module is set on second electronic equipment, the transmission module is specifically used for:
The transmission data are transmitted to data channel, by the data channel by the transmission data be transmitted to it is described in advance
The data management module of creation, wherein the data channel is to make first electronic equipment and second electronic equipment
Between carry out data interaction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811621556.7A CN109726181B (en) | 2018-12-28 | 2018-12-28 | Data processing method and data processing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811621556.7A CN109726181B (en) | 2018-12-28 | 2018-12-28 | Data processing method and data processing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109726181A true CN109726181A (en) | 2019-05-07 |
| CN109726181B CN109726181B (en) | 2021-02-19 |
Family
ID=66297431
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811621556.7A Active CN109726181B (en) | 2018-12-28 | 2018-12-28 | Data processing method and data processing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109726181B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112925758A (en) * | 2021-02-05 | 2021-06-08 | 深圳市优必选科技股份有限公司 | Method and device for generating compressed packet and terminal equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8612439B2 (en) * | 2009-06-30 | 2013-12-17 | Commvault Systems, Inc. | Performing data storage operations in a cloud storage environment, including searching, encryption and indexing |
| CN104484242A (en) * | 2014-12-10 | 2015-04-01 | 上海爱数软件有限公司 | Method for breaking-point transmission in copy-on-write snapshot backup process |
| CN108023767A (en) * | 2017-11-29 | 2018-05-11 | 四川无声信息技术有限公司 | Internet behavior method for tracing, device and server |
| US20180225324A1 (en) * | 2017-02-06 | 2018-08-09 | Qualcomm Incorporated | Providing Retry Schedules For File Repair Over Broadcast Networks |
| CN108763108A (en) * | 2018-06-04 | 2018-11-06 | 中国电子科技集团公司第十四研究所 | The device and method of recorded message data |
-
2018
- 2018-12-28 CN CN201811621556.7A patent/CN109726181B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8612439B2 (en) * | 2009-06-30 | 2013-12-17 | Commvault Systems, Inc. | Performing data storage operations in a cloud storage environment, including searching, encryption and indexing |
| CN104484242A (en) * | 2014-12-10 | 2015-04-01 | 上海爱数软件有限公司 | Method for breaking-point transmission in copy-on-write snapshot backup process |
| US20180225324A1 (en) * | 2017-02-06 | 2018-08-09 | Qualcomm Incorporated | Providing Retry Schedules For File Repair Over Broadcast Networks |
| CN108023767A (en) * | 2017-11-29 | 2018-05-11 | 四川无声信息技术有限公司 | Internet behavior method for tracing, device and server |
| CN108763108A (en) * | 2018-06-04 | 2018-11-06 | 中国电子科技集团公司第十四研究所 | The device and method of recorded message data |
Non-Patent Citations (1)
| Title |
|---|
| 刘文敏: "基于数据包捕获的数据内容还原分析技术研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112925758A (en) * | 2021-02-05 | 2021-06-08 | 深圳市优必选科技股份有限公司 | Method and device for generating compressed packet and terminal equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109726181B (en) | 2021-02-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP4206944A1 (en) | Blockchain-based method and apparatus for data processing, device, and readable storage medium | |
| CN107395665A (en) | A kind of block chain service handling and business common recognition method and device | |
| US8422786B2 (en) | Analyzing documents using stored templates | |
| US11775576B2 (en) | Container image size reduction via runtime analysis | |
| CN110457873A (en) | A kind of watermark embedding and detection method and device | |
| WO2012063755A1 (en) | Distributed archive system, data archive device, and data restoring device | |
| KR20170092595A (en) | Neural network structure and a method therto | |
| CN105939284B (en) | The matching process and device of message control strategy | |
| WO2022116487A1 (en) | Voice processing method and apparatus based on generative adversarial network, device, and medium | |
| CN107516045A (en) | Document protection method and device | |
| CN108171189A (en) | A kind of method for video coding, video coding apparatus and electronic equipment | |
| CN109033148A (en) | One kind is towards polytypic unbalanced data preprocess method, device and equipment | |
| CN109885577A (en) | Data processing method, device, terminal and storage medium | |
| CN109726181A (en) | A kind of data processing method and data processing equipment | |
| WO2016048734A1 (en) | Processing parameters for operations on blocks while decoding images | |
| EP3767545A1 (en) | Method for detecting if a machine learning model has been copied | |
| CN113032001A (en) | Intelligent contract classification method and device | |
| CN112099870A (en) | Document processing method and device, electronic equipment and computer readable storage medium | |
| CN109977675A (en) | A kind of open source software recognition methods and device | |
| CN112989364A (en) | Method, apparatus and computer program product for data simulation | |
| Julián-Moreno et al. | On the feasibility of 40 gbps network data capture and retention with general purpose hardware | |
| CN111414339A (en) | File processing method, system, device, equipment and medium | |
| JP2006146294A (en) | Data storage control system | |
| CN105677249B (en) | The division methods of data block, apparatus and system | |
| WO2021108813A3 (en) | System and method of communications using parallel data paths |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |