Specific embodiment
In order to make those skilled in the art more fully understand the technical solution in this specification, below in conjunction with this explanation
Attached drawing in book embodiment is clearly and completely described the technical solution in this specification embodiment, it is clear that described
Embodiment be only this specification a part of the embodiment, instead of all the embodiments.The embodiment of base in this manual,
Every other embodiment obtained by those of ordinary skill in the art without making creative efforts, all should belong to
The range of this specification protection.
In view of the determination method of existing data processing method is by technical staff mostly according to system running environment
(such as occupancy situation of memory etc.), in conjunction with the processing of specific target data, artificial setting determines suitable data processing method
Really it establishes rules then, so that the decision-making module (or decision logic) in data processing link can be based on above-mentioned data processing method
Really it establishes rules, carries out decision judgement, to determine suitable, stable data processing method, target data is carried out specific
Data processing.For example, as shown in fig.1, the risk for the case where operating load when system entirety is larger, and there are system exceptions
Under, it needs, in conjunction with experience, to manually adjust according to system situation by technical staff, modify decision-making module in data processing link
Applied processing mode is established rules then really;So that decision-making module can establish rules really according to adjustment, modified processing mode
Then, it according to target data and system operational parameters, is determined from more appropriate data from three kinds of preset data processing methods
Reason mode 2 is used as target processing mode, carries out data processing to target data.
Since the above method is during realization, need to rely on technical staff according to the real-time change feelings of system running environment
Condition modification adjusts corresponding processing mode and establishes rules then really, and establishes rules really then modifying and adjusting processing mode again by skill
The experience manual amendment of art personnel, cause it is above-mentioned realize when, for artificial O&M, the cost is relatively high, and handle efficiency
It is also not sufficiently stable with accuracy.
For above situation, this specification consideration can use trained preset decision Matching Model instead of skill
Art personnel in time, efficiently determine to run feelings with current system automatically according to the real-time transform situation of system running environment
The matched data processing method of condition is established rules then really, and then can be established rules really according to above-mentioned processing mode, is carried out decision and is sentenced
It is disconnected, determine that suitable target processing mode carries out data processing with stabilization, efficiently to target data, to reduce implementation
Cost improves efficiency and accuracy that data processing method determines.
This specification embodiment provides a kind of determination method of data processing method, the determination of the data processing method
Method can be applied to include multiple servers (or processor) system architecture, or the service including multiple program modules
Device.
In the present embodiment, one or more servers in above-mentioned multiple servers are responsible for decision-making management link,
His server is responsible for data processing link.
Specifically, being provided with decision-making management module on above-mentioned decision-making management chain road (such as can be responsible for decision-making management
The program code of logic), decision-making module and processing module are provided on above-mentioned data processing chain road (such as can be responsible for counting
According to the program code of processing main logic).Wherein, above-mentioned decision-making management link and data processing link are mutually indepedent, thus make
Decision-making management module is obtained in the case where generation processing mode is established rules then really, above-mentioned processing mode can be established rules really, be sent out
The decision-making module into data processing link is sent, establishes rules then, determines pair really so that decision-making module is based on above-mentioned processing mode
The data processing method that target data is handled;It is coupled again due to that will not exist with data processing link simultaneously, passes through decision
Processing mode used in the logic Modification decision-making module of link management is established rules then really, will not be to the logic on data process chain road
It has an impact.
In the present embodiment, above-mentioned decision-making management module specifically can be used for obtaining target data and system to be processed
Operating parameter;Further according to preset decision Matching Model, determine with the matched processing mode of the system operational parameters really
Set pattern then (such as can include determining that in processing mode institute's decision rule to be used or algorithm, and the index ginseng being related to
Number);And above-mentioned processing mode is established rules really, it is sent to decision-making module.
In the present embodiment, on the one hand above-mentioned decision-making module, can pass through network communication (or passing through synchronization module) etc.
The processing mode that mode receives the transmission of the decision-making management module in decision-making management link is established rules then really, and according to above-mentioned processing side
The determination rules modification of formula updates processing mode used in decision-making module and establishes rules really then, allow decision-making module with certainly
Plan management module is synchronous.On the other hand it can be transported by the target data and system of data processing link receiving processing module
Row parameter, and established rules really according to processing mode, decision judgement is carried out, determines suitable processing mode as target processing
Mode.
In the present embodiment, above-mentioned processing module specifically can be used for receiving the processing of target determined by decision-making module
Mode, and specific data processing is carried out to target data according to above-mentioned target processing mode.
In the present embodiment, above-mentioned server concretely one there is data operation, store function and network to hand over
The electronic equipment of mutual function;Or run in the electronic equipment, support is provided for data processing, storage and network interaction
Software.Do not limit the quantity of the server specifically in the present embodiment.The server can be a server,
It can also be several servers, alternatively, the server cluster that several servers are formed.
In a Sample Scenario, can with as shown in fig.2, using this specification embodiment provide processing mode really
Determine method to take into account the stability of system running environment, automatically, efficiently determines suitable processing mode to target
Data carry out data processing.
In this Sample Scenario, when it is implemented, the decision-making management module in decision-making management link can be in real time or regular
Acquire current system operating parameter.
Wherein, above system operating parameter specifically can be understood as the ginseng of the performance for characterizing system running environment situation
Number.Specifically, above system operating parameter may include: memory usage, hard disk remaining capacity, I/O interface (input/output
Interface) read or write speed, the health index of system environments etc..Certainly, it should be noted that above-mentioned cited system runs ginseng
Number is intended merely to that this specification embodiment is better described.When it is implemented, can also be according to specific application scenarios and reality
Requirement is applied, other kinds of performance parameter is introduced, such as amount of access that may be incorporated into system database etc. is used as above system
Operating parameter.In this regard, this specification is not construed as limiting.
Decision-making management module after obtaining system operational parameters, consider in order to guarantee the operation of system can stablize, it is high
Effect can call trained preset decision Matching Model to determine to be suitable for current according to running situation
The processing mode of system running environment is established rules then really, i.e., establishes rules really then with the matched processing mode of system operational parameters.This
The decision-making module of sample follow-up data process chain road can establish rules really according to above-mentioned processing mode, determine to be suitble to current system
The target processing mode to target data for operating condition of uniting.
Wherein, above-mentioned processing mode is established rules really, specifically can be understood as a kind of data for determining to target data
The decision-making technique and foundation of processing mode, it can established rules really according to above-mentioned processing mode, carry out decision judgement to determine
To the data processing method of target data.
Above-mentioned data processing method specifically can be understood as carrying out in data processing link optionally in target data
The embodiment of specific data processing.It usually can be real by the embodiment of plurality of optional to the data processing of target data
It is existing, it can data processing is carried out to target data by the data processing method of plurality of optional.Wherein, at different data
Requirement of the reason mode when implementing to the occupancy, performance of resource, and obtain processing result and can have differences.
Above-mentioned target processing mode, specifically can be understood as the operating condition in a variety of data processing methods with current system
Matching can stablize, efficiently complete the data processing method for carrying out data processing to target data.
For example, target data can be the data W to be calculated of an input, need to carry out calculation processing to the data,
Obtain corresponding calculated result E.At this moment may exist two kinds of optional data processing methods in data processing link, i.e., at data
Reason mode a and data processing method b.It wherein, can be according to number according to above-mentioned data processing method a or data processing method b
Calculated result E is calculated according to W.But it is a kind of relatively simple calculation, which pair that data processing method a is corresponding
Resource occupation is relatively fewer, and the requirement to system performance is relatively low, and the accuracy for the calculated result E being calculated is relatively
It is low.And it is a kind of more complicated calculation that data processing method b is corresponding, which is relatively large to resource occupation, right
The requirement of system performance is relatively high, and the accuracy for the calculated result E being calculated is also relatively high.If current system can
Less with resource, data processing is lower to the precise requirements of calculated result E, carries out in order to stabilization, efficiently to data W
Processing, the matched target processing mode of institute can be data processing method a.If the available resources of current system are more, data
Processing is higher to the precise requirements of calculated result E, and the matched target processing mode of institute then can be data processing method b.
Above-mentioned processing mode is established rules really, specifically can be understood as determining target from multiple optional processing modes
The method and foundation of processing mode.It is above-mentioned to establish rules really with the matched processing mode of system operational parameters, specifically it can be understood as
It is based on current system operating condition, the processing mode that can preferably take into account system run all right is established rules then really.
Above-mentioned processing mode is established rules really, can specifically include: decision rule and index parameter etc..Wherein, above-mentioned decision
Rule specifically can be a kind of judgement algorithm (also referred to as decision making algorithm), judgment rule etc..Specifically, can based on above-mentioned decision rule
Judge whether system operational parameters meet preset condition to pass through, to determine using which kind of corresponding data processing method.Such as
Judgment rule: selecting No.1 data processing method as target processing mode if the occupancy of CPU is less than threshold value j, if
The occupancy of CPU is more than or equal to threshold value j and then selects two number processing modes as target processing mode;Or it is calculated by classification
Method judgement meets a certain type condition can be understood as being a kind of decision rule using corresponding data processing method etc..It is above-mentioned
Index parameter specifically can be understood as when carrying out condition judgement using above-mentioned decision rule, and involved is used for multilevel iudge
Whether system operational parameters etc. meet the index parameter or parameter threshold of preset condition.For example, judgment rule: if CPU
Occupancy is less than threshold value j and No.1 data processing method is then selected to may be considered one kind as the threshold value j in target processing mode
Parameter index.Certainly, it should be noted that above-mentioned cited decision rule and parameter index are intended merely to that this is better described
Specification embodiment.When it is implemented, corresponding decision rule and index can be arranged with processing requirement as the case may be
Parameter.In this regard, this specification is not construed as limiting.
Above-mentioned preset decision Matching Model specifically can be understood as one kind in advance by the history number to data processing
It is obtained according to being learnt, being trained, suitable processing mode can be determined according to the concrete condition of the running environment of system
Really the model established rules then.For example, current system running environment is poor, obtained processing mode is established rules really, can be tended to
It determines and requires lower data processing method as target processing mode running environment.In this way it is subsequent can based on determined by
Processing mode is established rules really, determines that data processing can be carried out to target data and current system operation conditions is matched
Target processing mode efficiently, accurately, steadily to carry out the data processing of target data.
In this Sample Scenario, as shown in fig.3, decision-making management module can be using current system operating parameter as defeated
Enter, is input to above-mentioned preset decision Matching Model;Preset decision Matching Model can be based on the system operation ginseng inputted
Number, output are matched with the system operational parameters as a result, i.e. to be determined and the matched processing mode of system operational parameters
Determine rule (including corresponding decision rule and index parameter).
It, can basis after decision-making management module has obtained establishing rules then really with the matched processing mode of system operational parameters
Above-mentioned processing mode is established rules really, generates corresponding configuration data, wherein is included at least corresponding decision in configuration data and is advised
Then and index parameter;And above-mentioned configuration data is sent to the decision in data processing link by modes such as network communications
Module.
It should be noted that same set of agreement, standard specifically can be used in above-mentioned decision-making module and decision-making management module.Cause
This, decision-making module can be parsed by data from above-mentioned after receiving above-mentioned configuration data according to same set of agreement, standard
It obtains processing mode determined by decision-making management module in configuration data to establish rules really then, i.e. decision rule and index parameter;Into
And can be established rules really according to above-mentioned the processing mode original decision rule then, use decision module local and index parameter
It modifies and updates, i.e., it is decision rule used in decision-making module local is synchronous with index parameter modification for decision-making management mould
Decision rule and index parameter determined by block.
Further, decision rule and index parameter after decision-making module can be synchronized based on above-mentioned modification, according to be processed
Target data and system operational parameters, the processing module data processing method to be used in data process chain road is judged
It determines.Specifically, decision rule and index parameter after being synchronized based on above-mentioned modification, according in data processing link wait locate
The target data and system operational parameters of reason are determined to stablize, in current system running environment efficiently to target
Data carry out the data processing method of data processing as target processing mode, so as to processing module can be according to above-mentioned target at
Reason mode is stable, efficiently carries out data processing.
Specifically, decision-making module can be first according to the target data, determination is matched multiple pre- with the target data
If data processing method;The system operational parameters and the index parameter again, obtain comparison result;Finally according to institute
Decision rule is stated, is determined from the multiple preset data processing method and the matched preset data of the comparison result
Processing mode is as the target processing mode.
For example, decision-making module first can go out multiple suitable number of targets according to Feature Selections such as the type of target data and quantity
According to data processing method as with the matched preset data processing method of target data.And then it can will be acquired current
System operational parameters and index parameter are compared, and obtain specific comparison result.Such as determine: memory usage, which is greater than, to be accounted for
It is greater than residual capacity threshold value with rate threshold value, hard disk remaining capacity, (there are delay machines lower than index threshold for the health index of system environments
Risk) etc. be used as above-mentioned comparison result.Current system may further be judged according to decision rule and above-mentioned comparison result
The preset condition that running environment is met, so can choose data processing method corresponding with preset condition make with than
Compared with the matched data processing method of result, obtain be suitble to current system operating condition and meanwhile target data can be counted
According to the target processing mode of processing.
Target processing mode can be supplied in data processing link by decision-making module after target processing mode has been determined
Processing module, and then processing module efficiently, steadily can carry out target data specific according to above-mentioned target processing mode
Data processing.
By above-mentioned Sample Scenario as it can be seen that the determination method for the processing mode that this specification provides has been trained by utilizing
Preset decision Matching Model determined and the matched processing of system operational parameters automatically according to the specific running environment of system
Mode is established rules then really;Establish rules really further according to processing mode, determine preferably to take into account system run all right etc. because
Element, and the target processing mode of the data processing of suitable target data, to carry out specific data processing to target data, from
And implementation cost is reduced, and efficiency and accuracy that data processing method determines are improved, it can be by being based on above-mentioned processing mode
Really establish rules then determined by target processing mode, efficiently, steadily carry out the data processing of target data.
In another Sample Scenario, it is emphasized that data processing link is mutually indepedent with decision-making management link.
Wherein, decision-making management chain road can be set decision-making management module, data processing chain road can be set decision-making module and
Handle model.Decision-making management link is responsible for generating processing mode establishes rules then really, and by modes such as network communications by above-mentioned place
Reason mode is established rules really, is sent to the decision-making module of data processing chain road.Data processing link is responsible for passing through decision-making module base
It establishes rules really in above-mentioned processing mode, determines target processing mode, then by processing module according to above-mentioned target processing mode
Complete the data processing to target data.
Based on above structure and connection type, decision-making module can obtain decision-making management chain road decision by network communication
It includes configuration data that processing mode is established rules then really that management module is generated, and is modified according to above-mentioned configuration data and more
Itself new used processing mode is established rules then really, with synchronous with the holding of decision-making management module.Simultaneously as decision-making module is
It is packaged in data processing link and is connected with processing module, it is therefore contemplated that being one is coupled in data processing link
In decision logic.It can rapidly be established rules really then according to mode to be processed based on the decision-making module, the target of combination processing
Data and system operational parameters efficiently and accurately determine corresponding target processing mode, and then processing module can be according to upper
It states target processing mode and data processing is carried out to target data.
It is weaker with data processing link couples because decision-making management link is independently of data processing link setting,
It generates processing mode to establish rules then really, and sends above-mentioned processing mode to decision-making module and establish rules really, not will receive at data
The influence of link is managed, therefore can more accurately and rapidly determine to establish rules really with the matched processing mode of system operational parameters
Then, and by network communication, above-mentioned processing mode is established rules really, is sent to decision-making module, to use decision module local
Decision rule and index parameter modify, update, so that the decision-making module being set in data processing link can basis
Modification, the decision rule updated and index parameter determine target processing mode, so that the processing in data processing link
Module can carry out data processing according to target processing mode.To reduce to other programmed logics in data process chain road
It impacts, reduces the difficulty and cost of variation, but also introducing other data more from the external of data processing link
It is easy, conveniently, further improves treatment effeciency.
As shown in fig.4, this specification embodiment provides a kind of determination method of data processing method.Specific implementation
When, this method may include the following contents.
S41: target data and system operational parameters to be processed are obtained.
In the present embodiment, above-mentioned target data specifically can be understood as the business datum for needing to carry out data processing.
Wherein, above-mentioned target data specifically can be text data, be also possible to numeric data, can also be image data etc..It is right
In the concrete form and content of above-mentioned target data, this specification is not construed as limiting.
In the present embodiment, above system operating parameter specifically can be understood as characterizing system running environment situation
Performance parameter.Specifically, above system operating parameter may include: memory usage, hard disk remaining capacity, I/O interface
Read or write speed, health index of system environments etc..Certainly, it should be noted that above-mentioned cited system operational parameters are
In order to which this specification embodiment is better described.When it is implemented, according to specific application scenarios and can also implement to require,
Other kinds of performance parameter is introduced as system operational parameters.In this regard, this specification is not construed as limiting.
S42: it according to preset decision Matching Model, determines with the matched processing mode of the system operational parameters really
Set pattern is then, wherein the processing mode is established rules then really for determining in conjunction with the target data and the system operational parameters
To the data processing method of the target data.
In the present embodiment, above-mentioned processing mode (i.e. data processing method) specifically can be understood as data processing link
In optionally in the embodiment for carrying out specific data processing to target data.It usually can be with to the data processing of target data
It is realized by the embodiment of plurality of optional, it is possible to which the data processing method that can have plurality of optional can be realized to mesh
Mark the data processing of data.Wherein, different data processing methods when realizing may occupancy, performance to resource requirement,
And it obtains result and can have differences.
In the present embodiment, above-mentioned processing mode is established rules really, specifically can be understood as a kind of for determining to target
The decision-making technique and foundation of the data processing method of data, when it is implemented, can be established rules really then according to above-mentioned processing mode
The target processing mode of the progress data processing to target data is determined by decision judgement.
In the present embodiment, above-mentioned to establish rules really then with the matched processing mode of the system operational parameters, specifically may be used
To be interpreted as being suitable for the running environment of current system, can tend to determine so that system it is stable, health operation, keep away as far as possible
Exempt to occur establishing rules really then including the target processing mode of the operation problems such as delay machine, database exception.
Above-mentioned processing mode is established rules really, can specifically include: decision rule and index parameter etc..Wherein, above-mentioned decision
Rule specifically can be a kind of judgement algorithm (or decision making algorithm), judgment rule etc..Specifically, can based on above-mentioned decision rule
Judge whether system operational parameters meet preset condition to pass through, to determine using which kind of corresponding data processing method.Such as
Judgment rule: selecting No.1 data processing method as target processing mode if the occupancy of CPU is less than threshold value j, if
The occupancy of CPU is more than or equal to threshold value j and then selects two number processing modes as target processing mode;Or it is calculated by classification
Method judgement meets a certain type condition can be understood as being a kind of decision rule using corresponding data processing method etc..It is above-mentioned
Index parameter specifically can be understood as when carrying out condition judgement using above-mentioned decision rule, and involved is used for multilevel iudge
Whether system operational parameters etc. meet the index parameter or parameter threshold of preset condition.Certainly, it should be noted that above-mentioned institute
The decision rule and parameter index enumerated are intended merely to that this specification embodiment is better described.When it is implemented, can root
According to concrete condition and processing requirement, corresponding decision rule and index parameter are set.In this regard, this specification is not construed as limiting.
In the present embodiment, above-mentioned preset decision Matching Model specifically can be understood as a kind of passing through logarithm in advance
Learnt according to the historical data of processing, train obtained, can be determined according to the concrete condition of the running environment of system
The model that suitable processing mode is established rules then really.When it is implemented, can be using system operational parameters as mode input, input
Extremely in above-mentioned preset decision Matching Model, to obtain for the determining and matched target processing side of current system operation situation
The processing mode of formula is established rules then really.
In the present embodiment, above-mentioned according to preset decision Matching Model, it determines and the system operational parameters
The processing mode matched is established rules then really, when it is implemented, may include the following contents: passing through the decision pipe in decision-making management link
It manages module and calls the preset decision Matching Model, to determine with the matched processing mode of the system operational parameters really
Set pattern is then, wherein the processing mode is established rules really then includes at least index parameter and decision rule.
In the present embodiment, above-mentioned decision-making management link specifically can be used for through the decision pipe in decision-making management link
Module (or decision-making management logic) is managed according to the determining matched processing side of operation conditions with current system of system operational parameters
Formula is established rules then really;And above-mentioned processing mode is sent by network communication and is established rules really then, by determining in data processing link
The determination rules modification of processing mode used in plan module (or decision logic) is updated to above-mentioned and system operational parameters
The processing mode matched is established rules then really.Above-mentioned data processing link specifically can be used for through the decision model root tuber in data link
It establishes rules really according to processing mode then, judges to determine at target by decision in conjunction with system operational parameters and target data to be processed
Reason mode;Data processing is carried out to target data according to target processing mode by the processing module in data processing link.
In the present embodiment, above-mentioned decision-making management link and above-mentioned data processing link are mutually indepedent, mutual
Coupling is relatively weak, association influence is also relatively small.Therefore, it is based on above structure and connection relationship, decision-making management module is true
The fixed and matched processing mode of system operational parameters is established rules then really, and the decision-making module into data processing link is sent
It states processing mode to establish rules really then, the implementation process established rules really then with processing mode used in Change Strategy module is to data
Influence and the variation for handling other logic modules in link in addition to decision-making module are relatively small, to reduce modification change
The implementation cost that processing mode in decision-making module is established rules then really;Simultaneously by decision-making management link, so that from data processing
It is more convenient, efficient that the outside of link introduces other data progress decision interpretations.
In the present embodiment, processing mode described above is established rules really, specifically can be used in conjunction with the target data
With the system operational parameters, the data processing method to the target data is determined.
In the present embodiment, the decision-making module in data processing link has acquired above-mentioned and system operational parameters
After matched processing mode is established rules then really, further, can be established rules really according to processing mode then, target data, system
Operating parameter is determined preferably to carry out data processing to target data and takes into account the stability of system operation, is suitble to
Data processing method with the running environment of current system is as target processing mode.Pass through the processing in data processing link again
Module carries out data processing to target data according to above-mentioned target processing mode, so that the data processing of target data is more
Stabilization, efficiently.
In the present embodiment, it is above-mentioned established rules really according to processing mode then, target data, system operational parameters, determine
Target processing mode out, as the data processing method to the target data, when it is implemented, may include the following contents:
According to the target data, the determining and matched multiple preset data processing methods of the target data;Compare the system
Operating parameter and the index parameter, obtain comparison result;According to the decision rule, from the multiple preset data processing
It is determined in mode with the matched preset data processing method of the comparison result as the target processing mode.
In the present embodiment, above-mentioned according to the target data, it is determining matched multiple default with the target data
Data processing method, can specifically include: according to features such as the type of target data, quantity, selecting suitable target data
(i.e. matched with the target data) data processing method of feature is as preset data processing method.
In the present embodiment, above-mentioned preset data processing method can be it is pre-defined, set for data at
The optional data processing method that decision-making module in reason link is selected as the case may be, determined.
In the present embodiment, the above-mentioned system operational parameters and the index parameter, obtain comparison result, tool
Body can be is compared the parameters in system operational parameters with corresponding index parameter respectively, obtains corresponding comparison
As a result.For example, hard disk remaining capacity (system operational parameters) is less than capacity threshold (corresponding index parameter).
In the present embodiment, above-mentioned according to the decision rule, from the multiple preset data processing method really
It makes with the matched preset data processing method of the comparison result as the target processing mode, can specifically include:
According to decision rule, the foundation that comparison result is judged as decision determines current target data processing and system operation
Which kind of preset condition environment meets, and then preset data processing method corresponding with the preset condition met can be chosen to make
For target processing mode.
After determining target processing mode, the processing module in data processing link can be according to target processing mode pair
Target data carries out efficient, stable data processing, while can also take into account the stabilization and health of system entirety.
Therefore this specification provide processing mode determination method pass through using it is trained it is preset certainly
Plan Matching Model determines the determination with the matched processing mode of system operational parameters automatically according to the specific running environment of system
Rule;Establish rules really further according to processing mode, determine preferably to take into account the factors such as system run all right and
The target processing mode of the data processing of the target data of conjunction, to carry out specific data processing to target data, to reduce
Implementation cost improves efficiency and accuracy that data processing method determines, can pass through the target based on determined by above-mentioned rule
Processing mode efficiently, steadily carries out the data processing of target data.
In one embodiment, it according to preset decision Matching Model, determines to match with the system operational parameters
Processing mode establish rules really then, when it is implemented, may include content: by decision-making management link (in decision-making management mould
Block), the preset decision Matching Model is called, to determine the determination with the matched processing mode of the system operational parameters
Rule, wherein the processing mode is established rules really then includes at least index parameter and decision rule;
Correspondingly, being determined and the matched processing side of the system operational parameters according to preset decision Matching Model
After formula is established rules then really, the method can also include the following contents: pass through data processing link (in decision-making module), root
According to the processing mode establish rules really then, the target data, the system operational parameters, determine target processing mode, make
For the data processing method to the target data;By the data processing link (in processing module), according to the mesh
Processing mode is marked, data processing is carried out to the target data;Wherein, the decision-making management link is independently of the data processing
Link.
It should be noted that the decision-making management link specifically can be understood as independently of the data processing link it is in office
Functionally, decision-making management link and the division of labor of data process chain road are different, independently of each other for business;In structure, decision-making management link and
Data processing link couples are weaker, influence each other smaller.
In the present embodiment, above system operating parameter specifically can be understood as characterizing system running environment situation
Performance parameter.Specifically, above system operating parameter may include: memory usage, hard disk remaining capacity, I/O interface
Read or write speed, health index of system environments etc..Wherein, the health index of above system environment, which can refer to, integrally transports system
The evaluation parameter of the health status of row environment.For example, there are the risks such as delay machine, exception in system overall operation safety or system
It is relatively high.Certainly, it should be noted that above-mentioned cited system operational parameters are that one kind schematically illustrates, and are not answered
Constitute the improper restriction to this specification.
In the present embodiment, above-mentioned decision-making management link can specifically include decision-making management, specifically can be used for passing through
Decision-making management module (or decision-making management logic) in decision-making management link is according to system operational parameters determination and current system
The matched processing mode of operation conditions establish rules really then;And above-mentioned processing mode is established rules really by network communication, it sends
In decision-making module (or decision logic) into data processing link, so as to processing mode used in Change Strategy module local
Really it establishes rules, repairs.Above-mentioned data processing link can specifically include decision-making module and processing module, specifically for passing through data
Decision-making module in link is established rules then really according to above-mentioned processing mode, passes through decision in conjunction with system operational parameters and target data
Judge to determine suitable targets processing mode;It can be according to target processing mode to mesh by the processing module in data processing link
It marks data and carries out data processing.
And in the conventional method, often there is no decision-making management module, not independently of the decision pipe of data processing link yet
Link is managed, is only coupled and the decision-making module in data processing link.Based on the structure and connection relationship in existing method, decision
Coupling between module and data processing link is compared with strong, relevance is larger.Therefore, to the processing mode in decision-making module really
When set pattern is then modified, the logic module of other parts in data process chain road will certainly be had an impact, for example, it may be possible to need
The logic modules such as processing module in data process chain road are modified accordingly, be adjusted.Cause to use decision-making module
Processing mode establish rules really, change that the cost is relatively high;In addition, being introduced except data processing link other
The difficulty of related data is also relatively large.
And based on structure and connection relationship in present embodiment, the determination of decision-making management module is matched with system operational parameters
Processing mode is established rules then really, and is sent above-mentioned processing mode to decision-making module and established rules really then, so that decision-making module is according to institute
Processing mode used in the determination Policy Updates modification local of the processing mode received is established rules then really, above process logarithm
It is relatively small according to the influence and variation of the logic module of the other parts in processing link in addition to decision-making module, to reduce
The implementation cost that processing mode in modification Change Strategy module is established rules then really;Simultaneously by decision-making management link, so that from
It is more convenient, efficient that the other data of external introducing of data processing link carry out decisions judgement.
In one embodiment, it is above-mentioned according to the processing mode establish rules really then, the target data, the system
Operating parameter determines target processing mode, when it is implemented, may comprise steps of:
S1: according to the target data, the determining and matched multiple preset data processing methods of the target data;
S2: the system operational parameters and the index parameter obtain comparison result;
S3: it according to the decision rule, determines to tie compared with described from the multiple preset data processing method
The matched preset data processing method of fruit is as the target processing mode.
In the present embodiment, the target processing mode determined specifically can be understood as one kind can be preferably right
Target data carries out data processing, and can combine the stable and safe data processing method of system entirety.
In one embodiment, the preset decision Matching Model specifically can be establishes in the following way:
The historical data of the data processing of acquisition system, wherein the historical data of the data processing includes at least: data processing is made
Processing mode is established rules really, the operating parameter of data processing, data processing obtain result data, data processing it is anti-
Feedforward information;It is trained using the historical data of the data processing, foundation obtains the preset decision Matching Model.
In the present embodiment, the historical data of above-mentioned data processing can specifically include in data handling procedure in history
Data relevant to hardware components, for example, processing mode used in data processing establish rules really then, the system of data processing
Operating parameter etc., also may include data relevant to data processing business in data handling procedure, such as data in history
Handle obtained result data, the feedback information of data processing, the success rate of data processing and failure rate etc..When it is implemented,
Historical data of the data of suitable type as above-mentioned data processing can be introduced as the case may be.In this regard, this specification is not
It limits.
In the present embodiment, the historical data of the data processing of above system can specifically refer to every in history in system
Secondary carry out data processing, the processing mode being based on establish rules then (such as used in decision rule and index parameter), every really
The operating parameter (such as CPU occupation rate, hard disk remaining capacity etc.) of system, each data processing obtain when secondary progress data processing
Result data, with the feedback information of data processing (such as processing failure, delay machine occur abnormal etc.).Certainly, above-mentioned cited
The historical data of data processing be that one kind schematically illustrates.For the particular content of the historical data of above-mentioned data processing,
This specification is not construed as limiting.
In the present embodiment, the historical data of the data processing of system is obtained, when it is implemented, may include: to obtain
The feedback result of log recording and user in system to each data processing;Above-mentioned log recording is parsed, extraction is counted
Establish rules really according to processing mode used in handling, the obtained result data of the operating parameter of data processing, data processing;Root
According to user to the feedback result of each data processing, the feedback information etc. of data processing is determined.Certainly, above-mentioned cited acquisition
The mode of the historical data of the data processing of system is that one kind schematically illustrates.When it is implemented, according to specific scene,
The historical data of the data processing of system can be obtained using other reasonable manners.In this regard, this specification is not construed as limiting.
It in the present embodiment, can will be above-mentioned after the historical data for the data processing for having acquired above system
The historical data of the data processing of system carries out learning training as sample data, to models such as neural networks, to set up energy
Enough reflect that system operational parameters, data processing method are established rules the moulds of then mapping relations between system run all right really
Type to get arrive the preset decision Matching Model.Therefore, it can be transported according to system using above-mentioned preset decision Matching Model
Row parameter, which is found, can tend to so that the processing mode of system run all right, safety is established rules then really as above-mentioned and system ginseng
The matched processing mode of number is established rules then really.
In one embodiment, the system operational parameters can specifically include at least one of: memory usage,
Hard disk remaining capacity, the read or write speed of I/O interface, health index of system environments etc..Certainly, it should be noted that above-mentioned institute
The system operational parameters enumerated are that one kind schematically illustrates.When it is implemented, may be incorporated into other classes as the case may be
The parameter of type is as above system operating parameter.In this regard, this specification is not construed as limiting.
Therefore this specification provide processing mode determination method pass through using it is trained it is preset certainly
Plan Matching Model determines the determination with the matched processing mode of system operational parameters automatically according to the specific running environment of system
Rule;Establish rules really further according to processing mode, determine preferably to take into account the factors such as system run all right and
The target processing mode of the data processing of the target data of conjunction, to carry out specific data processing to target data, to reduce
Implementation cost improves efficiency and accuracy that data processing method determines, can pass through the target based on determined by above-mentioned rule
Processing mode efficiently, steadily carries out the data processing of target data;Also by utilizing determining independently of data processing chain road
Plan management module is established rules then really to determine and send processing mode, so that decision-making module can change institute in data processing link
The processing mode used is established rules then really, to weaken existing structure since there are the couplings of stronger logic to data process chain road
Influence caused by the change of middle decision-making module, reduce determine and modification processing mode establish rules really, difficulty and be implemented as
This, improves treatment effeciency.
As shown in fig.5, this specification embodiment provides a kind of data processing method.When it is implemented, this method can
To include the following contents
S51: target data and system operational parameters to be processed are obtained;
S52: it according to preset decision Matching Model, determines with the matched processing mode of the system operational parameters really
Set pattern is then;
S53: according to the processing mode establish rules really then, the target data, the system operational parameters, determine mesh
Processing mode is marked, as the data processing method to the target data;
S54: according to the target processing mode, data processing is carried out to the target data.
In the present embodiment, above-mentioned preset decision Matching Model specifically can be understood as a kind of passing through logarithm in advance
Learnt according to the historical data of processing, train obtained, can be determined according to the concrete condition of the running environment of system
The model that suitable processing mode is established rules then really.When it is implemented, can be using system operational parameters as mode input, input
Extremely in above-mentioned preset decision Matching Model, to obtain for the determining and matched target processing side of current system operation situation
The processing mode of formula is established rules then really.
In the present embodiment, when it is implemented, can be determined by obtaining and according to current system operating parameter
It establishes rules really then with the matched processing mode of system operational parameters;It establishes rules really then further according to above-mentioned processing mode, combining target
Data and system operational parameters determine that the factors such as data processing and the system run all right of target data can be taken into account
Data processing method is as target processing mode;And then it can be according to above-mentioned target data processing mode, efficiently, steadily to mesh
It marks data and carries out specific data processing.
In one embodiment, above-mentioned according to preset decision Matching Model, it determines and the system operational parameters
Matched processing mode is established rules then really, when it is implemented, may include: by decision-making management link (in decision-making management mould
Block) the preset decision Matching Model is called, to determine the determination with the matched processing mode of the system operational parameters
Rule, wherein the processing mode is established rules really then includes at least index parameter and decision rule.Correspondingly, according to the place
Reason mode establish rules really then, the target data, the system operational parameters, target processing mode is determined, as to described
The data processing method of target data;According to the target processing mode, data processing is carried out to the target data, specifically may be used
With include: by data processing link (in decision-making module) according to the processing mode establish rules really then, the target data,
The system operational parameters determine target processing mode, as the data processing method to the target data;And pass through institute
Data processing link (in processing module) is stated according to the target processing mode, data processing is carried out to the target data.
In one embodiment, the preset decision Matching Model when it is implemented, can build in the following way
It is vertical: to obtain the historical data of the data processing of system, wherein the historical data of the data processing includes at least: data processing
Used processing mode is established rules really, the operating parameter of data processing, data processing obtain result data, data processing
Feedback information;It is trained using the historical data of the data processing, establishes the preset decision Matching Model.
Therefore the data processing method that this specification provides using trained preset decision by being matched
Model is determined to establish rules really then with the matched processing mode of system operational parameters automatically according to the specific running environment of system;Again
Established rules really according to processing mode, determine preferably to take into account the factors such as system run all right and target
The target processing mode of the data processing of data allows system efficient, steady to carry out specific data processing to target data
Surely carry out the data processing of target data, there are the risks such as delay machine, exception in the system of reducing, improve system safety and
Stability.
This specification embodiment additionally provides a kind of server, including processor and refers to for storage processor to be executable
The memory of order, the processor can be according to instruction execution following steps when being embodied: obtaining target data to be processed
And system operational parameters;According to preset decision Matching Model, determine and the matched processing mode of the system operational parameters
Really it establishes rules then, wherein the processing mode is established rules really to be then used in conjunction with the target data and the system operational parameters,
Determine the data processing method to the target data.
In order to more accurately complete above-metioned instruction, as shown in fig.6, this specification additionally provides another kind specifically
Server, wherein the server includes network communications port 601, processor 602 and memory 603, and above structure is logical
It crosses Internal cable to be connected, so that each structure can carry out specific data interaction.
Wherein, the network communications port 601 specifically can be used for obtaining target data and system operation ginseng to be processed
Number;
The processor 602 specifically can be used for determining to run with the system according to preset decision Matching Model
The matched processing mode of parameter is established rules then really, wherein the processing mode is established rules then really in conjunction with the target data
With the system operational parameters, the data processing method to the target data is determined.
The memory 603, specifically can be used for storing target data and system operational parameters, processor 602 generate
Intermediate data, and the corresponding instruction repertorie of storage.
In the present embodiment, the network communications port 601 can be is bound from different communication protocol, thus
The virtual port of different data can be sent or received.Lead to for example, the network communications port can be responsible for progress web data
No. 80 ports of letter are also possible to No. 21 ports for being responsible for carrying out FTP data communication, can also be that responsible progress mail data is logical
No. 25 ports of letter.In addition, the network communications port can also be the communication interface or communication chip of entity.For example, its
It can be mobile radio network communication chip, such as GSM, CDMA;It can also be Wifi chip;It can also be bluetooth core
Piece.
In the present embodiment, the processor 602 can be implemented in any suitable manner.For example, processor can be with
Take such as microprocessor or processor and storage can by (micro-) processor execute computer readable program code (such as
Software or firmware) computer-readable medium, logic gate, switch, specific integrated circuit (Application Specific
Integrated Circuit, ASIC), programmable logic controller (PLC) and the form etc. for being embedded in microcontroller.This specification is simultaneously
It is not construed as limiting.
In the present embodiment, the memory 603 may include many levels, in digital display circuit, as long as can save
Binary data can be memory;In integrated circuits, the circuit with store function of a not no physical form
Also memory, such as RAM, FIFO are;In systems, the storage equipment with physical form is also memory, such as memory bar, TF
Card etc..
This specification embodiment additionally provides a kind of computer storage medium based on above-mentioned method of payment, the computer
Storage medium is stored with computer program instructions, is performed realization in the computer program instructions: obtaining mesh to be processed
Mark data and system operational parameters;According to preset decision Matching Model, determine and the matched place of the system operational parameters
Reason mode is established rules then really;According to the processing mode establish rules really then, the target data, the system operational parameters, really
Target processing mode is made, as the data processing method to the target data.
In the present embodiment, above-mentioned storage medium includes but is not limited to random access memory (Random Access
Memory, RAM), read-only memory (Read-Only Memory, ROM), caching (Cache), hard disk (Hard DiskDrive,
) or storage card (Memory Card) HDD.The memory can be used for storing computer program instructions.Network communication unit
It can be according to standard setting as defined in communication protocol, for carrying out the interface of network connection communication.
In the present embodiment, the function and effect of the program instruction specific implementation of computer storage medium storage, can
To compare explanation with other embodiment, details are not described herein.
As shown in fig.7, this specification embodiment additionally provides a kind of determination of data processing method on software view
Device, the device can specifically include construction module below:
Module 701 is obtained, specifically can be used for obtaining target data and system operational parameters to be processed;
Decision-making management module 702 specifically can be used for determining to transport with the system according to preset decision Matching Model
The matched processing mode of row parameter is established rules then really, and the processing mode is established rules really, is sent to the decision-making module,
Wherein, the processing mode is established rules really then includes at least index parameter and decision rule;
Decision-making module 703, specifically can be used for being established rules really according to the processing mode then, it is the target data, described
System operational parameters determine target processing mode, as the data processing method to the target data.
In one embodiment, described device can also include specifically processing module, specifically can be used for according to described
Target processing mode carries out data processing to the target data, wherein and the decision-making module is connected with the processing module,
It is set in data processing link;The decision-making management module is set in decision-making management link, and the decision-making management link is only
Stand on the data processing link.
In one embodiment, the decision-making module 702 can specifically include;
First determination unit specifically can be used for according to the target data, determining matched more with the target data
A preset data processing method;
Comparing unit specifically can be used for system operational parameters described in comparison and the index parameter, obtain comparison result;
Second determination unit specifically can be used for according to the decision rule, from the multiple preset data processing side
It is determined in formula with the matched preset data processing method of the comparison result as the target processing mode.
In one embodiment, described device also specifically can also include establishing module, specifically can be used for establishing pre-
If decision Matching Model.
In one embodiment, the module of establishing can specifically include:
Acquiring unit specifically can be used for obtaining the historical data of the data processing of system, wherein the data processing
Historical data includes at least: processing mode used in data processing is established rules really then, at the operating parameter of data processing, data
Manage the feedback information of obtained result data, data processing;
Training unit specifically can be used for being trained using the historical data of the data processing, establish described default
Decision Matching Model.
In one embodiment, the system operational parameters include at least one of: memory usage, hard disk are remaining
Capacity, the read or write speed of I/O interface, health index of system environments etc..Certainly, above-mentioned cited system operational parameters are
One kind schematically illustrates.It is transported when it is implemented, may be incorporated into other kinds of parameter as the case may be as above system
Row parameter.In this regard, this specification is not construed as limiting.
It should be noted that unit, device or module etc. that above-described embodiment illustrates, specifically can by computer chip or
Entity is realized, or is realized by the product with certain function.For convenience of description, it describes to divide when apparatus above with function
It is described respectively for various modules.It certainly, can be the function of each module in same or multiple softwares when implementing this specification
And/or realized in hardware, the module for realizing same function can also be realized by the combination of multiple submodule or subelement etc..With
Upper described Installation practice is only schematical, for example, the division of the unit, only a kind of logic function is drawn
Point, there may be another division manner in actual implementation, such as multiple units or components may be combined or can be integrated into separately
One system, or some features can be ignored or not executed.Another point, shown or discussed mutual coupling or straight
Connecing coupling or communication connection can be through some interfaces, and the indirect coupling or communication connection of device or unit can be electrical property,
Mechanical or other forms.
Therefore the determining device of the data processing method of this specification embodiment offer, pass through decision-making management module
It determines to run with system automatically according to the specific running environment of system using trained preset decision Matching Model
The matched processing mode of parameter is established rules then really;It is established rules really according to processing mode by decision-making module again, determining can be compared with
The factors such as system run all right, and the target processing mode of the data processing of suitable target data are taken into account, well with right
Target data carries out specific data processing, to reduce implementation cost, improves efficiency that data processing method determines and accurate
Degree, can by based on it is above-mentioned rule determined by target processing mode, efficiently, steadily progress target data data at
Reason.
Although being based on routine or nothing present description provides the method operating procedure as described in embodiment or flow chart
Creative means may include more or less operating procedure.The step of enumerating in embodiment sequence is only numerous steps
One of rapid execution sequence mode does not represent and unique executes sequence.When device or client production in practice executes,
Can be executed according to embodiment or the execution of method shown in the drawings sequence or parallel (such as parallel processor or multithreading
The environment of processing, even distributed data processing environment).The terms "include", "comprise" or its any other variant are intended to
Cover non-exclusive inclusion, so that the process, method, product or the equipment that include a series of elements not only include those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, product or setting
Standby intrinsic element.In the absence of more restrictions, being not precluded is including process, method, the product of the element
Or there is also other identical or equivalent elements in equipment.The first, the second equal words are used to indicate names, and are not offered as appointing
What specific sequence.
It is also known in the art that other than realizing controller in a manner of pure computer readable program code, it is complete
Entirely can by by method and step carry out programming in logic come so that controller with logic gate, switch, specific integrated circuit, programmable
Logic controller realizes identical function with the form for being embedded in microcontroller etc..Therefore this controller is considered one kind
Hardware component, and the structure that the device for realizing various functions that its inside includes can also be considered as in hardware component.Or
Person even, can will be considered as realizing the device of various functions either the software module of implementation method can be hardware again
Structure in component.
This specification can describe in the general context of computer-executable instructions executed by a computer, such as journey
Sequence module.Generally, program module include routines performing specific tasks or implementing specific abstract data types, programs, objects,
Component, data structure, class etc..This specification can also be practiced in a distributed computing environment, in these distributed computing rings
In border, by executing task by the connected remote processing devices of communication network.In a distributed computing environment, program mould
Block can be located in the local and remote computer storage media including storage equipment.
As seen through the above description of the embodiments, those skilled in the art can be understood that this specification
It can realize by means of software and necessary general hardware platform.Based on this understanding, the technical solution of this specification
Substantially the part that contributes to existing technology can be embodied in the form of software products in other words, the computer software
Product can store in storage medium, such as ROM/RAM, magnetic disk, CD, including some instructions are used so that a computer
Equipment (can be personal computer, mobile terminal, server or the network equipment etc.) execute each embodiment of this specification or
Method described in certain parts of person's embodiment.
Each embodiment in this specification is described in a progressive manner, the same or similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.This specification can be used for
In numerous general or special purpose computing system environments or configuration.Such as: personal computer, server computer, handheld device
Or portable device, laptop device, multicomputer system, microprocessor-based system, set top box, programmable electronics set
Standby, network PC, minicomputer, mainframe computer, distributed computing environment including any of the above system or equipment etc..
Although depicting this specification by embodiment, it will be appreciated by the skilled addressee that there are many become for this specification
Shape and the spirit changed without departing from this specification, it is desirable to which the attached claims include these deformations and change without departing from this
The spirit of specification.