CN108460044A - The treating method and apparatus of data - Google Patents
The treating method and apparatus of data Download PDFInfo
- Publication number
- CN108460044A CN108460044A CN201710091632.7A CN201710091632A CN108460044A CN 108460044 A CN108460044 A CN 108460044A CN 201710091632 A CN201710091632 A CN 201710091632A CN 108460044 A CN108460044 A CN 108460044A
- Authority
- CN
- China
- Prior art keywords
- data
- current
- historical
- current data
- match
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2255—Hash tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
Abstract
This application discloses a kind for the treatment of method and apparatus of data.Wherein, this method includes：Obtain collected current data, wherein the current data is at least used to record the network state executed during business operation；Detect whether there is the historical data to match with the current data；If it is detected that in the presence of the historical data to match with the current data, then in the region of memory for handling the historical data, the history handling result that the historical data is updated according to the current data obtains the corresponding currently processed result of the current data.Present application addresses processing mass data to occupy the technical issues of resource is more, time-consuming.
Description
Technical field
This application involves data processing fields, in particular to a kind for the treatment of method and apparatus of data.
Background technology
Virtual machine is the operating in a completely isolated environment with complete hardware system function simulated by software
Computer system, in the prior art, in virtual machine system, each virtual machine needs to carry a large amount of service traffics sometimes, should
Service traffics can be the TCP data stream of million rank per second.In the TCP five-tuples of monitoring full dose, flow, packet loss and delay
In the process, the TCP data stream of million rank per second need to be acquired, handled and exported.
Specifically, TCP data stream (in that case, the number of million rank per second is acquired from the kernel of server
Kernel state according to stream) after, according to character string form a line a line the information for recording the acquisition (at this time by the number of kernel state
Copied according to stream, obtain the data flow of User space), after handling on the server the data of the character string forms, obtain
To output data packet, output data packet is exported by output channel to analysis system, by analysis system to output data packet into
The analysis of row network quality, network flow topology etc..
In the prior art, the data of the above-mentioned character string forms in the process of processing, handle the character one by one
The data of string form apply for the memory for handling the data when processing is per data, and pending data are stored in Shen
The memory that please be arrived parses the data of this string format in the memory, and format transformation or according to pre- set pattern
It is then handled, after processing is completed, obtains output data packet corresponding with the data, the output data packet is logical by exporting
Road exports and discharges the memory.
As shown in the above, when handling the data of every string format, application for execution memory, parsing character are both needed to
String is handled, the operation of output data packet and releasing memory by predetermined format, and the TCP data stream of million rank per second is come
It says, execution aforesaid operations need to take a substantial amount of time and resource, some situations can occupy the CPU time of monokaryon 80%, in this way meeting
Cause traffic fluctuations.
The problem of resource is more, time-consuming are occupied for above-mentioned processing mass data, not yet propose effective solution side at present
Case.
Invention content
The embodiment of the present application provides a kind for the treatment of method and apparatus of data, is occupied at least solving processing mass data
The technical issues of resource is more, time-consuming.
According to the one side of the embodiment of the present application, a kind of processing method of data is provided, including：It obtains collected
Current data, wherein the current data is at least used to record the network state executed during business operation；It detects whether to deposit
In the historical data to match with the current data；If it is detected that in the presence of the historical data to match with the current data,
Then in the region of memory for handling the historical data, at history that the historical data is updated according to the current data
Reason is as a result, obtain the corresponding currently processed result of the current data.
According to the another aspect of the embodiment of the present application, a kind of processing unit of data is additionally provided, including：First obtains list
Member, for obtaining collected current data, wherein the current data is at least used to record during execution business operation
Network state；Detection unit, for detecting whether in the presence of the historical data to match with the current data；Processing unit is used
In if it is detected that in the presence of the historical data to match with the current data, in the memory field for handling the historical data
In domain, the history handling result of the historical data is updated according to the current data, obtains that the current data is corresponding to be worked as
Pre-treatment result.
According to the another aspect of the embodiment of the present application, a kind of processing method of data is additionally provided, including：Acquisition collects
Current data；Detect whether there is the history number to match with the current data according to the property parameters of the current data
According to；If it is detected that in the presence of the historical data to match with the current data, it is determined that for handling the interior of the historical data
Deposit region；In the region of memory for handling the historical data, the current data is handled.
According to the application, (e.g., have with current data with the historical data of the current data match detecting to exist
The data of the purpose of identical sources) after, it is corresponding with the current data without obtaining without discharging the memory of the historical data
Region of memory is updated the history handling result of historical data, obtains in the region of memory for handling historical data
The current data is corresponding currently processed as a result, reduce the operation that processor need to execute, while decreasing EMS memory occupation, solves
Processing mass data in the prior art of having determined occupies the technical issues of resource is more, time-consuming, realizes in processing mass data mistake
The middle effect for reducing resource occupation and reducing time loss.
Description of the drawings
Attached drawing described herein is used for providing further understanding of the present application, constitutes part of this application, this Shen
Illustrative embodiments and their description please do not constitute the improper restriction to the application for explaining the application.In the accompanying drawings：
Fig. 1 is the network environment schematic diagram according to a kind of processing method using data of the embodiment of the present application；
Fig. 2 is the flow chart according to a kind of processing method of optional data of the embodiment of the present application；
Fig. 3 is according to a kind of schematic diagram of the data of optional string format in the prior art；
Fig. 4 is the schematic diagram according to a kind of data of optional binary format of the embodiment of the present application；
Fig. 5 is the flowchart 2 according to a kind of processing method of optional data of the embodiment of the present application；
Fig. 6 is the flow chart 3 according to a kind of processing method of optional data of the embodiment of the present application；
Fig. 7 is the flow chart four according to a kind of processing method of optional data of the embodiment of the present application；
Fig. 8 is the structure according to a kind of terminal of optional processing method using data of the embodiment of the present application
Schematic diagram；
Fig. 9 is the schematic diagram according to a kind of processing unit of optional data of the embodiment of the present application；
Figure 10 is the hardware according to a kind of terminal of processing method for realizing data of the embodiment of the present application
Structure diagram.
Specific implementation mode
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, technical solutions in the embodiments of the present application are clearly and completely described, it is clear that described embodiment is only
The embodiment of the application part, instead of all the embodiments.Based on the embodiment in the application, ordinary skill people
The every other embodiment that member is obtained without making creative work should all belong to the model of the application protection
It encloses.
It should be noted that term " first " in the description and claims of this application and above-mentioned attached drawing, "
Two " etc. be for distinguishing similar object, without being used to describe specific sequence or precedence.It should be appreciated that using in this way
Data can be interchanged in the appropriate case, so as to embodiments herein described herein can in addition to illustrating herein or
Sequence other than those of description is implemented.In addition, term " comprising " and " having " and their any deformation, it is intended that cover
It includes to be not necessarily limited to for example, containing the process of series of steps or unit, method, system, product or equipment to cover non-exclusive
Those of clearly list step or unit, but may include not listing clearly or for these processes, method, product
Or the other steps or unit that equipment is intrinsic.
First, the part noun or term occurred during the embodiment of the present application is described is suitable for following solution
It releases：
IDC：Internet data center.Data center is a part for network foundation resource, for providing data transmission clothes
Business and high-peed connection service.Internet data center has large-scale computer room setting, the reliable inside and outside network environment of high speed
And the monitoring support means of systematization.Data center also provides for supervising server for providing fast and safely network
Service in terms of the network managements such as pipe, traffic monitoring.
TCP：It is a kind of connection-oriented, reliable transport layer communication protocol based on byte stream, by the RFC793 of IETF
Definition.
TCP five-tuples, by this five amount groups of source IP address, source port, purpose IP address, destination interface and transport layer protocol
At collection be collectively referred to as TCP five-tuples.Five-tuple based on Transmission Control Protocol is TCP five-tuples, for example, 192.168.1.1
100000TCP 121.14.88.76 80 constitute a TCP five-tuple, and meaning is：One IP address is 192.168.1.1
Terminal by port 100000, be 121.14.88.76 using Transmission Control Protocol and IP address, the terminal that port is 80 is connected
It connects.Different sessions can be distinguished using five-tuple, and the corresponding session of a five-tuple is unique.
KO：Nucleus module kernel module arrive one section of code insertion using module insert module technologies are inserted into
Kernel address space, this section of code are used to access other data-interfaces of kernel.
HASH：Chinese is hash or Hash, is exactly the input random length, by hashing algorithm, is transformed into solid
The output of measured length, the output valve are exactly hashed value, are exactly briefly a kind of message compression by random length to a certain fixation
The function of the eap-message digest of length.
Virtual machine, be by software simulate with hardware system function, operate in a completely isolated environment
Computer system.
Packet loss：Refer to communication data packet loss in the communications.
Asynchronous communication is a kind of most typical middleware Technology being made of message transfer mechanism or SMS queue's pattern.
Reliable asynchronous communication can be carried out by message-oriented middleware, between application program or component carrys out coupling between reduction system
Degree, to improve the scalability and availability of whole system.
Bic, Binary Increase Congestion, a kind of TCP congestion avoidance algorithms.
Hooking function hook (also known as Hook Function), the message of specified window can be monitored by the function, works as message
After reaching, before the message does not reach target window, captures and handle the message.In practical applications, to being specifically
After system event is linked up with, once the system event occurs, the program linked up with to the system event can receive system
Notice.
Ack：Acknowledgement confirms character, in data communication, receiving station issues a kind of biography of dispatching station
Defeated class control character, for indicating that the data that dispatching station is sent have confirmed that reception is errorless.
Embodiment 1
According to the embodiment of the present application, a kind of embodiment of the processing method of data is additionally provided, it should be noted that attached
The step of flow of figure illustrates can execute in the computer system of such as a group of computer-executable instructions, though also,
So logical order is shown in flow charts, but in some cases, it can be with different from shown by sequence execution herein
Or the step of description.
The embodiment of the method that the embodiment of the present application one is provided can be in mobile terminal, terminal or similar fortune
It calculates and is executed in device.
In a kind of alternative embodiment, which can be applied to data center IDC, as shown in Figure 1, host 20
The service traffics got are sent to data center, the number by the service traffics for obtaining record network state by network
May include multiple servers 10 according to center.Server 10 can be the server for processing business flow, every server
On can execute the processing methods of the data.Wherein, network connection can be LAN connection, wide area network connection, internet
Connection or the connection of other kinds of data network.
Optionally, server 10 is the operating in an isolation environment with hardware system function simulated by software
Virtual machine or server 10 be entity physical machine.
Specifically, during terminal execution business, a large amount of service traffics are will produce, the data of service traffics include
For indicate execute business operation during network state (in such as network delay and Network Packet Loss state) information,
In, business operation may include：Virtual resource swap operation, video play operation etc..
In the TCP five-tuples of monitoring full dose, flow, packet loss and the application scenarios of delay, host 20 (wraps service traffics
Include multiple data) it is sent to data center.
Optionally, which is distributed to the different server 10 of data center, the Business Stream that server 10 receives
For amount when the system of execution calling (as received data) is absorbed in and being executed in kernel code, which is referred to as kernel state number
According to processor is in highest (0 grade) kernel code of level of privilege and executes at this time.
When server handles service traffics, that is, when data processing process is in the code for executing user oneself
When (code of the processing method in such as the embodiment of the present application for executing data), which is referred to as user's run mode
(User space).In this embodiment, User space data are the TCP data stream of million rank per second.
Optionally, it after being handled according to scheduled processing rule the data in collected service traffics, obtains
Output data packet, output data packet are exported by output channel to analysis system, are carried out to output data packet using analysis system
The analysis of network quality, network flow topology etc..Wherein, analysis system can be by being mounted on a terminal or service
Analysis software on device cluster realizes analytic function.
Optionally, after server receives service traffics, using bic congestion avoidance algorithms out of terminal
The data such as TCP five-tuples, flow and packet loss are captured in core.
Specifically, by being inserted into a hooking function hook in the congestion control algorithm, this hooking function hook can be in business
When the processing window of flow sends out confirmation character ack, TCP five-tuples, the information such as flow and packet loss are captured.
In a kind of optional embodiment, after the data in collecting computer inner core using hooking function, to adopting
The data collected are handled, and this application provides the processing methods of data as shown in Figure 2, it should be noted that in data
The processing method of the data can be executed on every terminal of the heart, in a terminal in the embodiment of the present application
For, the specific implementation that terminal executes the processing method of the data is described in detail.
Fig. 2 is according to a kind of flow chart of the processing method of optional data of the embodiment of the present application, as shown in Fig. 2, should
Embodiment may include steps of：
Step S202：Obtain collected current data, wherein current data is at least used to record to execute business operation mistake
Network state in journey.
Wherein, network state can by network flow, Network Packet Loss information and network delay information at least it
One reflects.Network flow is used to indicate that the data volume of transmission over networks, Network Packet Loss information to be for being recorded in communication process
The middle information for losing communication data packet, optionally, data are transmitted as unit of data packet on a communication network, each data
Bao Zhongyou indicates data information and provides the frame of data routing, since data are not to continuously transmit in a linear fashion, number
According to the transmission of packet because of reasons such as physical circuit failure, physical equipment failure, virus attack, routing iinformation mistakes, have certain
Loss, that is, occur the loss of communication data packet, and packet loss information can also be reflected in the network state during execution business.Net
Network delay refers to that a data packet is sent to Website server from the computer of user, then returns to user's meter from Website server
The turnaround time of calculation machine.
Optionally, collected data are indicated with character string forms.As shown in figure 3, in the processor acquisition of server
After the data of core state, the data that the processor of server need to indicate string format parse, after being parsed
After data, execute subsequent processing operation, during being parsed to the data that string format indicates, need according to
Scheduled rule determines the information of each byte representation one by one, and it is time-consuming longer to carry out parsing to character string.
In order to reduce the processing time to data, in an alternative embodiment, processor by the data got into
Data after coding are put into cyclic buffer by row binary coding.Wherein, buffering area is for temporarily storing data.
As shown in figure 4, after carrying out binary coding to the data of string format, the number of binary format can be obtained
According to, binary system is made of 1 and 0 two number, binary coding be with prespecified method by word, number or other
Object programs binary number, and in this embodiment, the data that the string format got is indicated carry out binary system volume
Code, obtains the data of binary format, since binary system only has 1 and 0 two number, compared with character string, computer disposal two
Faster, and data of binary format, data type is identical, and the physical memory size of occupancy is fixed for the speed of system, from
When obtaining information in data, without executing parsing operation, data can be obtained by executing bit manipulation to the data of binary format
Information.
Since bit manipulation is the unitary and dual operation in program to bit pattern step-by-step or binary number, the processing of bit arithmetic
Speed is also faster than the service speed of plus and minus calculation, obtains information from data using bit manipulation, can greatly improve to data
Processing speed.
By above-described embodiment, after the data of binary format are put into cyclic buffer, processor is to the cycle
Data in buffering area execute following step S204, the data to be further processed.It in this embodiment will be current
The data handled are denoted as current data, and processed data are denoted as historical data.
Step S204：Detect whether there is the historical data to match with current data.
Wherein, if it is detected that in the presence of the historical data to match with current data, S206 is thened follow the steps；If it is detected that not
In the presence of the historical data to match with current data, S208 is thened follow the steps.
By detecting whether there is the historical data that matches with current data, come determine whether by current data with
Historical data merging treatment, if in the presence of the historical data with the current data match, it can be by the current data and history
Data merge processing, without being handled to its application for execution memory, according to pre-defined rule, in output data packet and release
The complete process flow deposited, to reduce the operation of processor execution, for mass data, each data reduce one
Or multiple execution steps, the time loss brought to the processing of mass data can be greatly shortened, further, processor is held
Capable operation is reduced, and executing the occupied resource of operation can also be reduced.
In an alternative embodiment, the data of identical source and destination can be merged processing, it further, can
With by executing following steps shown in fig. 5, to detect whether to have the historical data to match with current data：
Step S501：The current attribute parameter of current data is obtained from current data.
Optionally, the current attribute parameter of current data indicates the session attribute of current data, specifically, the current attribute
Data at least can be used to indicate the source and destination of the current data, wherein source can be indicated using source IP and source port, mesh
Can be indicated using destination IP and destination interface.
Since TCP five-tuples can use TCP five-tuples to indicate the session category of current data with unique mark session
Property, wherein TCP five-tuples include：Source port, source IP address, destination interface, purpose IP address and the transmission association of current data
View, that is, in this embodiment it is possible to current attribute parameter using TCP five-tuples as current data.
Another kind is it is alternatively possible to directly use the session identification of current data to join as the current attribute of current data
Number.
Step S503：Detect whether the historical status parameter for having with current attribute match parameters.
Wherein, if it is detected that in the presence of the historical status parameter with current attribute match parameters, S505 is thened follow the steps：Really
Regular inspection is measured in the presence of the historical data to match with current data；If it is detected that there is no gone through with current attribute match parameters
History property parameters, then follow the steps S507：It determines and detects that there is no the historical datas to match with current data.
Optionally, by detecting whether there are the property parameters consistent with the session attribute of current data, to determine and work as
The identical historical data of source and destination of preceding data.
In an alternative embodiment, it after the current attribute parameter for obtaining current data, is calculated using intended conversion
Method can convert the session attribute of current data, obtain the first change data.Further, detect whether exist with
The historical status parameter of current attribute match parameters includes：It detects whether to exist using the first change data and join with current attribute
The historical status parameter that number matches.
Wherein, intended conversion algorithm is used to be converted to the data of the first length the data of the second length, and the first length is long
In the second length.In this embodiment, the session attribute of the current data of the first length is converted to first turn of the second length
Change data, it is possible to reduce the treating capacity of detection.
Optionally, the historical status parameter for having with current attribute match parameters is detected whether using the first change data
It can be achieved by the steps of：
Detect whether there is second change data consistent with the first change data, wherein the second change data is to utilize
Intended conversion algorithm, data obtained from being converted to the session attribute of historical data.
Wherein, if in the presence of second change data consistent with the first change data, it is determined that detect exist and current category
The historical status data of property match parameters；If second change data consistent with the first change data is not present, it is determined that inspection
Measure the historical status data being not present with current attribute match parameters.
In an alternative embodiment, intended conversion algorithm can be length transition algorithm, or Encryption Algorithm,
For example, intended conversion algorithm is hash algorithm.
In the case where intended conversion algorithm is hash algorithm, the session attribute of current data is carried out using hash algorithm
Cryptographic operation obtains the cryptographic Hash of the session attribute of current data；And obtain storage using hash algorithm to historical data
Operation is encrypted in session attribute, obtains the cryptographic Hash of the session attribute of historical data；Whether consistent compare two cryptographic Hash,
To detect whether to have second change data consistent with the first change data.
It should be noted that after handling current data, by the corresponding cryptographic Hash of the current data store to
Predetermined space, after getting new data, the corresponding cryptographic Hash of the current data is known as the cryptographic Hash of historical data, this is new
Data be designated as current data, detect whether exist match with current data historical data when, by current data
Session attribute carries out Hash calculation and obtains the corresponding cryptographic Hash of current data, is searched whether in the cryptographic Hash of predetermined space storage
In the presence of cryptographic Hash corresponding with the current data, if finding cryptographic Hash corresponding with the current data, it is determined that detect to deposit
In the historical data with the current data match；If not finding cryptographic Hash corresponding with the current data, it is determined that detection
Go out the historical data with the current data match is not present.
Step S206：In the region of memory for handling historical data, historical data is updated according to current data, is obtained
The corresponding currently processed result of current data.
By above-described embodiment, detecting to have historical data corresponding with the current data (that is, and current data
The data of purpose with identical sources) after, without discharging the memory of the historical data, without acquisition and the current data pair
The region of memory answered is updated the history handling result of historical data, obtains in the region of memory where the historical data
It is corresponding currently processed to the current data as a result, reduce the operation that processor need to execute, while decreasing EMS memory occupation.
In an alternative embodiment, the handling result of data includes the content of property content and network state,
In, property content is corresponding with the property parameters of data, if for example, using TCP five-tuples expression data, is wrapped in the result of data
Information containing the TCP five-tuples；The content of the network state is for recording network flow, Network Packet Loss information and network delay
At least one of, the information for the network state that different data include is inconsistent, in the above-described embodiments, utilizes the meeting of data
Words attribute carries out the matching of data, if that is, be matched to historical data, in the handling result of historical data property content with
Property content is also consistent in the handling result of current data, in an alternative embodiment, is updated using current data
Partial content in the history handling result of historical data, you can it is corresponding currently processed as a result, in the processing to obtain current data
In the process, it is not necessarily to execute complete process flow to current data, while can ensure the accuracy of handling result, improve place
Manage efficiency.
According to the embodiment of the present application, collected current data is obtained；It is detected whether according to the property parameters of current data
In the presence of the historical data to match with current data；If it is detected that in the presence of the historical data to match with current data, it is determined that
Region of memory for handling historical data；In the region of memory for handling historical data, current data is handled.
By above-described embodiment, detect to exist with the historical data of the current data match (e.g., with current data
The data of purpose with identical sources) after, without discharging the memory of the historical data, without acquisition and the current data pair
The region of memory answered is updated the history handling result of historical data in the region of memory for handling historical data,
It is corresponding currently processed as a result, reduce the operation that processor need to execute to obtain the current data, while decreasing memory and accounting for
With solving processing mass data in the prior art and occupy that resource is more, the technical issues of time-consuming, realize and largely counted in processing
According to the excessively middle effect for reducing resource occupation and reducing time loss.
Still optionally further, the history handling result for historical data being updated according to current data can be by as shown in Figure 6
The step of realize：
Step S602：Current status data is obtained from current data, wherein current status data executes industry for indicating
The network state of business.
Step S604：In the region of memory for handling historical data, by the historic state number in history handling result
According to being revised as current status data.
By above-described embodiment, when building currently processed result (such as data packet) of current data, if it is detected that in the presence of
With the historical data of the current data match, then the history handling result of the historical data is obtained, it will be in history handling result
Data directly hang in the new data packets of current data, and change the numerical part of the network state in the new data packets, obtain
To the currently processed result of current data.
Step S208：Obtain the region of memory for handling current data.
After detecting whether to have the historical data that matches with current data, if it is detected that being not present and current data
The historical data to match then obtains the region of memory for handling current data.
Step S210：In the region of memory got, predetermined operation is executed to current data, obtains current data correspondence
Currently processed result.
In the above-described embodiments, by the way that the data of string format to be converted to the data of binary format, make original
Character string parsing is converted to bit manipulation, improves service speed；And due to the business side of data center's IDC internal machines interaction
It is relatively fixed, therefore within a predetermined period of time, the identical data of source and destination is handled in same memory, specifically,
Hash is established using TCP five-tuples, hash hits are then directly multiplexed the data of upper minute, only change flow, packet loss and delay
Data value reduces handling duration and process resource.
A kind of optional realization method of the application is described in detail with reference to Fig. 7 and Fig. 8.
As shown in fig. 7, the embodiment may include steps of：
Step S701：The gathered data from the kernel of terminal.
Wherein, which can be executed by nucleus module 81 shown in Fig. 8 in kernel address space 82, wherein should
Terminal can run the operating system of Linux, which can be linux kernel address space, TCP/
IP protocol stack can be in this space motion.
Optionally, nucleus module enters kernel address space operation by being inserted into the technology of module, to reach direct access
The purpose of TCP window data is specifically inserted into a hooking function hook, this hooking function in the congestion avoidance algorithm of bic
Hook can capture TCP five-tuples, flow and packet loss when window reads symbol ack responses really, to collect data.
Step S702：By collected data carry out binary coding, by after coding data deposit buffer circle (or
Referred to as cyclic buffer 83).
Optionally, data nucleus module KO acquired are by original character string again layout in a binary format, by layout
The data of binary format afterwards are put into cyclic buffer.
Step S703：Step-by-step parsing is carried out to the current data of binary format, and generates the cryptographic Hash of parsing data.It is logical
It crosses parsing module 84 and step-by-step parsing is carried out to the current data of binary format.
It should be noted that binary data type is identical, the physical memory size of occupancy is just fixed, according to this original
Reason, as long as offset is arranged when the data to binary format do data parsing, so that it may to directly acquire corresponding data, and
Without executing time-consuming character string parsing.
By above-described embodiment, the data acquired in TCP window are to be mapped to User space in a binary format, user
State can be operated in progress in the subsequent processing, with step-by-step or offset, is greatly improved message, is reduced loss.
Step S704：Whether the cryptographic Hash of detection current data hits the cryptographic Hash of historical storage.
Optionally, the cryptographic Hash of historical storage can be stored in Hash list HASH LIST.
If so, thening follow the steps S705；If it is not, thening follow the steps S706.
Step S705：Change the value of network status data in the data packet of the historical data of hit.
The data packet that module 85 generates the new data of hit is hit by Hash.
In this embodiment, each minute all can be input to output channel there are one data packet (handling results of data)
On, data packet is exactly flow data one by one, includes TCP five-tuples, flow, packet loss and delay in the data packet.It is generating
After data packet, Hash HASH is established according to the TCP five-tuples of the data packet of generation, is hung on Hash list HASH LIST.
When handling new data, if HASH is hit, directly the data of upper one minute are hung in new data packets, change flow, packet loss
With the numerical part of delay, avoids the destruction of memory and apply again.
Step S706：Again apply for memory.
Apply for the memory for handling new data again by Hash storage allocation module 86.
Step S707：TCP five-tuples, flow, packet loss and delay content are filled, new data packet is generated.
Optionally, by database population module 87, the data in the data packet of new data are filled.
Step S708：Newly-generated data packet equally establishes HASH LIST, prepares for new data packets.
Optionally, the Hash list that module 88 establishes new data packet is established by Hash list.
Step S709：New data packets are exported by network interface card.
Optionally, new data packets are exported by terminal by network interface card by output channel 89, new data packets are defeated
Enter analysis system.
By above-described embodiment, since the business of every terminal (such as server) interaction is relatively fixed, so TCP
Five-tuple is stablized relatively, in the above-described embodiments, HASH is established according to TCP five-tuples, and data-reusing degree reaches 90%, avoids frequency
Numerous content application and copy are reduced to 0.4% so that User space is taken from monokaryon 80%.
It should be noted that for each method embodiment above-mentioned, for simple description, therefore it is all expressed as a series of
Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because
According to the application, certain steps can be performed in other orders or simultaneously.Secondly, those skilled in the art should also know
It knows, embodiment described in this description belongs to preferred embodiment, involved action and module not necessarily the application
It is necessary.
Through the above description of the embodiments, those skilled in the art can be understood that according to above-mentioned implementation
The method of example can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but it is very much
In the case of the former be more preferably embodiment.Based on this understanding, the technical solution of the application is substantially in other words to existing
The part that technology contributes can be expressed in the form of software products, which is stored in a storage
In medium (such as ROM/RAM, magnetic disc, CD), including some instructions are used so that a station terminal equipment (can be mobile phone, calculate
Machine, server or network equipment etc.) execute each embodiment of the application described in method.
Embodiment 2
According to the embodiment of the present application, a kind of processing unit for implementing the processing method of above-mentioned data is additionally provided, such as
Shown in Fig. 9, which includes：
First acquisition unit 91, for obtaining collected current data, wherein current data is at least used to record to execute
Network state during business operation；
Detection unit 93, for detecting whether in the presence of the historical data to match with current data；
Processing unit 95, for if it is detected that in the presence of the historical data to match with current data, being gone through for handling
In the region of memory of history data, the history handling result of historical data is updated according to current data, it is corresponding to obtain current data
Currently processed result.
By detecting whether there is the historical data that matches with current data, come determine whether by current data with
Historical data merging treatment, if in the presence of the historical data with the current data match, it can be for handling historical data
Region of memory in, the current data and historical data are merged into processing, without to its application for execution memory, according to pre-
The complete process flow for determining rule process, output data packet and releasing memory is right to reduce the operation of processor execution
For mass data, each data reduce it is one or more execute steps, can greatly shorten the processing to mass data and
The time loss brought, further, the operation that processor executes are reduced, and executing the occupied resource of operation can also be reduced.
Further, it is detecting to have historical data corresponding with the current data (that is, there is phase with current data
The data of homologous purpose) after, it is corresponding with the current data interior without obtaining without discharging the memory of the historical data
Region is deposited, in the region of memory where the historical data, the history handling result of historical data is updated, is deserved
Preceding data are corresponding currently processed as a result, reduce the operation that processor need to execute, while decreasing EMS memory occupation.
Optionally, detection unit includes：First acquisition module, the current category for obtaining current data from current data
Property parameter；Detection sub-unit, for detecting whether in the presence of the historical status parameter with current attribute match parameters；First determines
Module, for if it is detected that in the presence of the historical status parameter with current attribute match parameters, it is determined that exist and current data
The historical data to match.
According to above-described embodiment, current attribute parameter is used to indicate the session attribute of current data, wherein device also wraps
It includes：Converting unit is used for after the current attribute parameter for obtaining current data, using intended conversion algorithm, to current data
Session attribute converted, obtain the first change data；Detection sub-unit includes：Detection module, for utilizing the first conversion
Data Detection is with the presence or absence of the historical status parameter with current attribute match parameters.
In an alternative embodiment, detection module may include：Detection sub-module, for detecting whether in the presence of with
The second consistent change data of one change data, wherein if in the presence of second change data consistent with the first change data, really
Regular inspection is measured in the presence of the historical status data with current attribute match parameters, wherein the second change data is to be turned using predetermined
Scaling method, data obtained from being converted to the session attribute of historical data.
Optionally, intended conversion algorithm is hash algorithm, and the first change data indicates the Kazakhstan of the session attribute of current data
Uncommon value, the second change data indicate the cryptographic Hash of the session attribute of historical data.
Wherein, the session attribute of current data includes：The source port of current data, source IP address, destination interface, destination IP
Address and transport protocol.
Still optionally further, device further includes：Coding unit, for after obtaining collected current data and
Before detecting whether to have the historical data to match with current data, the current data indicated with string format is carried out two
Scale coding, the current data indicated in binary form.
Optionally, processing unit includes：Second acquisition module, for obtaining current status data from current data,
In, current status data is used to indicate the network state of execution business；Modified module, for for handling in historical data
It deposits in region, the historical state data in history handling result is revised as current status data.
Wherein, network state includes：At least one of network flow, Network Packet Loss information and network delay information.
Further, device can also include：Second acquisition unit, for detecting whether exist and current data phase
After the historical data matched, if it is detected that there is no the historical data to match with current data, obtain for handling current number
According to region of memory；Execution unit, in the region of memory got, executing predetermined operation to current data, being worked as
The corresponding currently processed result of preceding data.
Herein it should be noted that above-mentioned module is identical as example and application scenarios that corresponding step is realized, but not
It is limited to above-described embodiment disclosure of that.It should be noted that above-mentioned module may operate in as a part for device
It states in hardware environment shown in embodiment, can also pass through hardware realization by software realization, wherein hardware environment packet
Include network environment.
Embodiment 3
Embodiments herein can provide a kind of terminal, which can be in terminal group
Any one computer terminal.Optionally, in the present embodiment, above computer terminal can also replace with mobile whole
The terminal devices such as end.
Figure 10 shows a kind of hardware knot of the terminal (or mobile device) of the processing method for realizing data
Structure.As shown in Figure 10, terminal may include one or more (to use 102a, 102b ... ... in figure, 102n to show)
(processor 102 can include but is not limited to the processing dress of Micro-processor MCV or programmable logic device FPGA etc. to processor 102
Set), memory 104 for storing data and the transmission module 106 for communication function.In addition to this, it can also wrap
It includes：Display, input/output interface (I/O interfaces), the port universal serial bus (USB) (can be as the ports of I/O interfaces
In a port by including), network interface, power supply and/or camera.It will appreciated by the skilled person that Figure 10 institutes
The structure shown is only to illustrate, and does not cause to limit to the structure of above-mentioned electronic device.For example, terminal may also include ratio
More either less components shown in Figure 10 or with the configuration different from shown in Figure 10.
It is to be noted that said one or multiple processors 102 and/or other data processing circuits lead to herein
Can often it be referred to as " data processing circuit ".The data processing circuit all or part of can be presented as software, hardware, firmware
Or any other combination.In addition, data processing circuit can be single independent processing module or all or part of be attached to meter
In any one in other elements in calculation machine terminal 10 (or mobile device).As involved in the embodiment of the present application,
The data processing circuit controls (such as the selection for the variable resistance end path being connect with interface) as a kind of processor.
Memory 104 can be used for storing the software program and module of application software, such as the data in the embodiment of the present application
The corresponding program instruction/data storage device of processing method, processor 102 by operation be stored in it is soft in memory 104
Part program and module realize the processing method of above-mentioned data to perform various functions application and data processing.It deposits
Reservoir 104 may include high speed random access memory, may also include nonvolatile memory, as one or more magnetic storage fills
It sets, flash memory or other non-volatile solid state memories.In some instances, memory 104 can further comprise relative to place
The remotely located memory of device 102 is managed, these remote memories can pass through network connection to terminal 10.Above-mentioned network
Example include but not limited to internet, intranet, LAN, mobile radio communication and combinations thereof.
Transmitting device 106 is used to receive via a network or transmission data.Above-mentioned network specific example may include
The wireless network that the communication providers of terminal 10 provide.In an example, transmitting device 106 includes that a network is suitable
Orchestration (Network Interface Controller, NIC), can be connected with other network equipments by base station so as to
Internet is communicated.In an example, transmitting device 106 can be radio frequency (Radio Frequency, RF) module,
For wirelessly being communicated with internet.
Display can such as touch-screen type liquid crystal display (LCD), which may make that user can be with
The user interface of terminal 10 (or mobile device) interacts.
Optionally, in the present embodiment, above computer terminal can be located at multiple nets of computer network shown in FIG. 1
At least one of the network equipment network equipment.
Processor can call the information and application program of memory storage by transmitting device, to execute following step：
Obtain collected current data, wherein current data is at least used to record the net executed during business operation
Network state；Detect whether there is the historical data to match with current data；If it is detected that in the presence of matching with current data
Historical data, then in the region of memory for handling historical data, the history that historical data is updated according to current data is handled
As a result, obtaining the corresponding currently processed result of current data.
Processor can call the information and application program of memory storage by transmitting device, to execute following step,
To detect whether to have the historical data to match with current data：The current attribute ginseng of current data is obtained from current data
Number；Detect whether the historical status parameter for having with current attribute match parameters；If it is detected that in the presence of with current attribute parameter
The historical status parameter to match, it is determined that there is the historical data to match with current data.
Optionally, current attribute parameter is used to indicate the session attribute of current data.
Processor can call the information and application program of memory storage by transmitting device, to execute following step：
After the current attribute parameter for obtaining current data, using intended conversion algorithm, the session attribute of current data is turned
It changes, obtains the first change data；It detects whether to exist and includes with the historical status parameter of current attribute match parameters：Utilize
One change data detects whether the historical status parameter for having with current attribute match parameters.
Processor can call the information and application program of memory storage by transmitting device, to execute following step,
With the historical status parameter for detecting whether to have with current attribute match parameters using the first change data：Detect whether exist
Second change data consistent with the first change data, wherein if in the presence of second change data consistent with the first change data,
Then determine the historical status data for detecting there is with current attribute match parameters, wherein the second change data is using pre-
Determine transfer algorithm, data obtained from being converted to the session attribute of historical data.
Optionally, intended conversion algorithm is hash algorithm, and the first change data indicates the Kazakhstan of the session attribute of current data
Uncommon value, the second change data indicate the cryptographic Hash of the session attribute of historical data.
Optionally, the session attribute of current data includes：The source port of current data, source IP address, destination interface, purpose
IP address and transport protocol.
Processor can call the information and application program of memory storage by transmitting device, to execute following step,
It, will after obtaining collected current data and before detecting whether in the presence of the historical data to match with current data
Binary coding, the current data indicated in binary form are carried out with the current data that string format indicates.
Processor can call the information and application program of memory storage by transmitting device, to execute following step,
To update the history handling result of historical data according to current data：Current status data is obtained from current data, wherein when
Preceding status data is used to indicate the network state of execution business；In the region of memory for handling historical data, at history
Historical state data in reason result is revised as current status data.
Wherein, network state includes：At least one of network flow, Network Packet Loss information and network delay information.
Processor can call the information and application program of memory storage by transmitting device, to execute following step：
If it is detected that there is no the historical data to match with current data, the region of memory for handling current data is obtained；It is obtaining
In the region of memory got, predetermined operation is executed to current data, obtains the corresponding currently processed result of current data.
It will appreciated by the skilled person that structure shown in Fig. 10 is only to illustrate, terminal can also be
Smart mobile phone (such as Android phone, iOS mobile phones), tablet computer, palm PC and mobile internet device (Mobile
Internet Devices, MID), the terminal devices such as PAD.Figure 10 it does not cause to limit to the structure of above-mentioned electronic device.Example
Such as, terminal 10 may also include more than shown in Figure 10 or less component (such as network interface, display device),
Or with the configuration different from shown in Figure 10.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
To be completed come command terminal device-dependent hardware by program, which can be stored in a computer readable storage medium
In, storage medium may include：Flash disk, read-only memory (Read-Only Memory, ROM), random access device (Random
Access Memory, RAM), disk or CD etc..
Embodiments herein additionally provides a kind of storage medium.Optionally, in the present embodiment, above-mentioned storage medium can
For preserving the program code performed by the processing method for the data that above-described embodiment is provided.
Optionally, in the present embodiment, above-mentioned storage medium can be located in computer network Computer terminal group
In any one terminal, or in any one mobile terminal in mobile terminal group.
Optionally, in the present embodiment, storage medium is arranged to store the program code for executing following steps：
Obtain collected current data, wherein current data is at least used to record the net executed during business operation
Network state；Detect whether there is the historical data to match with current data；If it is detected that in the presence of matching with current data
Historical data, then in the region of memory for handling historical data, the history that historical data is updated according to current data is handled
As a result, obtaining the corresponding currently processed result of current data.
Storage medium is arranged to store the program code for executing following steps, obtains collected current data,
Wherein, current data is at least used to record to execute business operation, to detect whether to have the history number to match with current data
According to：The current attribute parameter of current data is obtained from current data；Detect whether exist and current attribute match parameters
Historical status parameter；If it is detected that in the presence of the historical status parameter with current attribute match parameters, it is determined that exist with currently
The historical data of data match.
Optionally, current attribute parameter is used to indicate the session attribute of current data.
Storage medium is arranged to store the program code for executing following steps：In the current category for obtaining current data
After property parameter, using intended conversion algorithm, the session attribute of current data is converted, obtains the first change data；Inspection
It surveys and includes with the presence or absence of the historical status parameter with current attribute match parameters：Detect whether exist using the first change data
With the historical status parameter of current attribute match parameters.
Storage medium is arranged to store the program code for executing following steps, to be detected using the first change data
With the presence or absence of the historical status parameter with current attribute match parameters：Detect whether to exist consistent with the first change data the
Two change datas, wherein if in the presence of second change data consistent with the first change data, it is determined that detect exist with it is current
The historical status data that property parameters match, wherein the second change data is using intended conversion algorithm, to historical data
Data obtained from session attribute is converted.
Optionally, intended conversion algorithm is hash algorithm, and the first change data indicates the Kazakhstan of the session attribute of current data
Uncommon value, the second change data indicate the cryptographic Hash of the session attribute of historical data.
Optionally, the session attribute of current data includes：The source port of current data, source IP address, destination interface, purpose
IP address and transport protocol.
Storage medium is arranged to store the program code for executing following steps, is obtaining collected current data
Later and before detecting whether in the presence of the historical data to match with current data, it will indicate current with string format
Data carry out binary coding, the current data indicated in binary form.
Storage medium is arranged to store the program code for executing following steps, with according to current data more new historical
The history handling result of data：Current status data is obtained from current data, wherein current status data is executed for indicating
The network state of business；In the region of memory for handling historical data, by the historical state data in history handling result
It is revised as current status data.
Wherein, network state includes：At least one of network flow, Network Packet Loss information and network delay information.
Storage medium is arranged to store the program code for executing following steps：If it is detected that being not present and current number
According to the historical data to match, the region of memory for handling current data is obtained；In the region of memory got, to current
Data execute predetermined operation, obtain the corresponding currently processed result of current data.
Above-mentioned the embodiment of the present application serial number is for illustration only, can not represent the quality of embodiment.
In above-described embodiment of the application, all emphasizes particularly on different fields to the description of each embodiment, do not have in some embodiment
The part of detailed description may refer to the associated description of other embodiment.
In several embodiments provided herein, it should be understood that disclosed technology contents can pass through others
Mode is realized.Wherein, the apparatus embodiments described above are merely exemplary, for example, the unit division, only
A kind of division of logic function, formula that in actual implementation, there may be another division manner, such as multiple units or component can combine or
Person is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual
Between coupling, direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, unit or module
It connects, can be electrical or other forms.
The unit illustrated as separating component may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, you can be located at a place, or may be distributed over multiple
In network element.Some or all of unit therein can be selected according to the actual needs to realize the mesh of this embodiment scheme
's.
In addition, each functional unit in each embodiment of the application can be integrated in a processing unit, it can also
It is that each unit physically exists alone, it can also be during two or more units be integrated in one unit.Above-mentioned integrated list
The form that hardware had both may be used in member is realized, can also be realized in the form of SFU software functional unit.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can be stored in a computer read/write memory medium.Based on this understanding, the technical solution of the application is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or network equipment etc.) execute each embodiment the method for the application whole or
Part steps.And storage medium above-mentioned includes：USB flash disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), mobile hard disk, magnetic disc or CD etc. are various can to store program code
Medium.
The above is only the preferred embodiment of the application, it is noted that for the ordinary skill people of the art
For member, under the premise of not departing from the application principle, several improvements and modifications can also be made, these improvements and modifications are also answered
It is considered as the protection domain of the application.
Claims (12)
1. a kind of processing method of data, which is characterized in that including：
Obtain collected current data, wherein the current data is at least used to record the net executed during business operation
Network state；
Detect whether there is the historical data to match with the current data；
If it is detected that in the presence of the historical data to match with the current data, in the memory for handling the historical data
In region, the history handling result of the historical data is updated according to the current data, it is corresponding to obtain the current data
Currently processed result.
2. processing method according to claim 1, which is characterized in that after obtaining collected current data and
Before detecting whether to have the historical data to match with the current data, the method further includes：
The current data indicated with string format is subjected to binary coding, the current number indicated in binary form
According to.
3. processing method according to claim 1, which is characterized in that in the region of memory for handling the historical data
In, the history handling result that the historical data is updated according to the current data includes：
Current status data is obtained from the current data, wherein the current status data is for indicating execution business
Network state；
In the region of memory for handling the historical data, the historical state data in the history handling result is changed
For current status data.
4. processing method according to claim 3, which is characterized in that the network state includes：Network flow, network are lost
At least one of package informatin and network delay information.
5. processing method according to claim 1, which is characterized in that detecting whether exist and the current data phase
After the historical data matched, the method further includes：
If it is detected that there is no the historical data to match with the current data, obtain for handling the interior of the current data
Deposit region；
In the region of memory got, predetermined operation is executed to the current data, obtains that the current data is corresponding to be worked as
Pre-treatment result.
6. processing method according to claim 1, which is characterized in that detect whether exist match with the current data
Historical data include：
The current attribute parameter of the current data is obtained from the current data；
Detect whether the historical status parameter for having with the current attribute match parameters；
If it is detected that in the presence of the historical status parameter with the current attribute match parameters, it is determined that exist and the current number
According to the historical data to match.
7. processing method according to claim 6, which is characterized in that the current attribute parameter is for indicating described current
The session attribute of data, wherein
After the current attribute parameter for obtaining the current data, the method further includes：Using intended conversion algorithm, to institute
The session attribute for stating current data is converted, and the first change data is obtained；
It detects whether to exist and includes with the historical status parameter of the current attribute match parameters：Number is converted using described first
According to the historical status parameter for detecting whether to have with the current attribute match parameters.
8. processing method according to claim 6, which is characterized in that detect whether exist using first change data
Historical status parameter with the current attribute match parameters includes：
Detect whether there is second change data consistent with first change data, wherein if the presence and described the
The second consistent change data of one change data, it is determined that detect the history category for having with the current attribute match parameters
Property data,
Wherein, second change data is to utilize the intended conversion algorithm, is carried out to the session attribute of the historical data
Data obtained from conversion.
9. processing method according to claim 6, which is characterized in that the intended conversion algorithm is hash algorithm, described
First change data indicates that the cryptographic Hash of the session attribute of the current data, second change data indicate the history number
According to session attribute cryptographic Hash.
10. processing method according to claim 6, which is characterized in that the session attribute of the current data includes：It is described
Source port, source IP address, destination interface, purpose IP address and the transport protocol of current data.
11. a kind of processing method of data, which is characterized in that including：
Obtain collected current data；
Detect whether there is the historical data to match with the current data according to the property parameters of the current data；
If it is detected that in the presence of the historical data to match with the current data, it is determined that for handling the interior of the historical data
Deposit region；
In the region of memory for handling the historical data, the current data is handled.
12. a kind of processing unit of data, which is characterized in that including：
First acquisition unit, for obtaining collected current data, wherein the current data is at least used to record to execute industry
The network state being engaged in operating process；
Detection unit, for detecting whether in the presence of the historical data to match with the current data；
Processing unit, for if it is detected that in the presence of the historical data to match with the current data, described for handling
In the region of memory of historical data, the history handling result of the historical data is updated according to the current data, is obtained described
The corresponding currently processed result of current data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710091632.7A CN108460044B (en) | 2017-02-20 | 2017-02-20 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710091632.7A CN108460044B (en) | 2017-02-20 | 2017-02-20 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108460044A true CN108460044A (en) | 2018-08-28 |
| CN108460044B CN108460044B (en) | 2022-06-14 |
Family
ID=63221695
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710091632.7A Active CN108460044B (en) | 2017-02-20 | 2017-02-20 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108460044B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112880201A (en) * | 2021-01-28 | 2021-06-01 | 珠海格力电器股份有限公司 | Water heater parameter adjusting method, device, equipment and storage medium |
| CN114038187A (en) * | 2021-11-02 | 2022-02-11 | 北京红山信息科技研究院有限公司 | Road section state updating method, device, equipment and medium |
| CN117215500A (en) * | 2023-11-09 | 2023-12-12 | 北京友友天宇系统技术有限公司 | Method and system for breaking through LMDBKey length |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344893A (en) * | 2008-07-17 | 2009-01-14 | 中兴通讯股份有限公司 | History data access method and apparatus |
| CN101499026A (en) * | 2008-02-01 | 2009-08-05 | 凯迈（洛阳）测控有限公司 | Miniature data backup method of data acquisition system based on FLASH ROM |
| US20110066496A1 (en) * | 2009-09-11 | 2011-03-17 | Zengyan Zhang | Combining Historical CTR and Bid Amount in Search Message Selection |
| CN101996139A (en) * | 2009-08-28 | 2011-03-30 | 百度在线网络技术（北京）有限公司 | Data matching method and data matching device |
| US20150332414A1 (en) * | 2014-05-13 | 2015-11-19 | Mastercard International Incorporated | System and method for predicting items purchased based on transaction data |
-
2017
- 2017-02-20 CN CN201710091632.7A patent/CN108460044B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101499026A (en) * | 2008-02-01 | 2009-08-05 | 凯迈（洛阳）测控有限公司 | Miniature data backup method of data acquisition system based on FLASH ROM |
| CN101344893A (en) * | 2008-07-17 | 2009-01-14 | 中兴通讯股份有限公司 | History data access method and apparatus |
| CN101996139A (en) * | 2009-08-28 | 2011-03-30 | 百度在线网络技术（北京）有限公司 | Data matching method and data matching device |
| US20110066496A1 (en) * | 2009-09-11 | 2011-03-17 | Zengyan Zhang | Combining Historical CTR and Bid Amount in Search Message Selection |
| US20150332414A1 (en) * | 2014-05-13 | 2015-11-19 | Mastercard International Incorporated | System and method for predicting items purchased based on transaction data |
Non-Patent Citations (1)
| Title |
|---|
| 徐计 等: ""基于粒计算的大数据处理"", 《计算机学报》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112880201A (en) * | 2021-01-28 | 2021-06-01 | 珠海格力电器股份有限公司 | Water heater parameter adjusting method, device, equipment and storage medium |
| CN112880201B (en) * | 2021-01-28 | 2022-03-18 | 珠海格力电器股份有限公司 | Water heater parameter adjusting method, device, equipment and storage medium |
| CN114038187A (en) * | 2021-11-02 | 2022-02-11 | 北京红山信息科技研究院有限公司 | Road section state updating method, device, equipment and medium |
| CN114038187B (en) * | 2021-11-02 | 2022-09-30 | 北京红山信息科技研究院有限公司 | Road section state updating method, device, equipment and medium |
| CN117215500A (en) * | 2023-11-09 | 2023-12-12 | 北京友友天宇系统技术有限公司 | Method and system for breaking through LMDBKey length |
| CN117215500B (en) * | 2023-11-09 | 2024-01-23 | 北京友友天宇系统技术有限公司 | Method and system for breaking through LMDB Key length |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108460044B (en) | 2022-06-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104580168B (en) | A kind of processing method of Attacking Packets, apparatus and system | |
| CN103905447B (en) | Service link selects control method and equipment | |
| WO2017031460A1 (en) | Device and method for establishing connection in load-balancing system | |
| CN110069441A (en) | A kind of FPGA network and stream calculation System and method for for stream calculation | |
| CN106453474A (en) | Network transfer of large files in unstable network environments | |
| CN107948324A (en) | Ask Transmission system, method, apparatus and storage medium | |
| CN109947795A (en) | The acquisition methods and device of target data | |
| CN108460044A (en) | The treating method and apparatus of data | |
| JP2015057931A (en) | Network apparatus, communication system, and detection method and program for abnormal traffic | |
| KR20160095554A (en) | Physical address determination apparatus based SDN and method therefor | |
| CN110213208A (en) | A kind of method and apparatus and storage medium of processing request | |
| CN109714266A (en) | A kind of data processing method and the network equipment | |
| JP2017118438A (en) | Packet transmission program, information processing device and failure detection method | |
| CN105847179B (en) | The method and device that Data Concurrent reports in a kind of DPI system | |
| CN110300045A (en) | Network accelerating method, device, equipment and the readable medium of application program | |
| CN109417507A (en) | The message of section retards accesses | |
| CN107181605A (en) | Message detecting method and system, contents extraction device, flow matches device | |
| CN108462590A (en) | The monitoring method and device of network flow, terminal | |
| CN107249038A (en) | Business datum retransmission method and system | |
| CN106598747A (en) | Network data package parallel processing method and device | |
| CN107332739B (en) | Network detecting method, network detection device and intelligent terminal | |
| CN110474789A (en) | Network state information processing method, device and system | |
| CN107819697A (en) | Data transmission method, interchanger and data center | |
| CN107864199A (en) | The realization device of Internet of Things communication means, device and Internet of Things Network Communication | |
| CN109617779B (en) | Routing table maintenance method and device based on VTEP |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |