CN109376981A - Determination method, apparatus, server and the data processing method of data processing method - Google Patents

Determination method, apparatus, server and the data processing method of data processing method Download PDF

Info

Publication number
CN109376981A
CN109376981A CN201811014471.2A CN201811014471A CN109376981A CN 109376981 A CN109376981 A CN 109376981A CN 201811014471 A CN201811014471 A CN 201811014471A CN 109376981 A CN109376981 A CN 109376981A
Authority
CN
China
Prior art keywords
data
data processing
decision
target
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811014471.2A
Other languages
Chinese (zh)
Other versions
CN109376981B (en
Inventor
张亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Advanced New Technologies Co Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201811014471.2A priority Critical patent/CN109376981B/en
Publication of CN109376981A publication Critical patent/CN109376981A/en
Application granted granted Critical
Publication of CN109376981B publication Critical patent/CN109376981B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0637Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/3476Data logging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/3495Performance evaluation by tracing or monitoring for systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06393Score-carding, benchmarking or key performance indicator [KPI] analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Educational Administration (AREA)
  • Development Economics (AREA)
  • Computer Hardware Design (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Tourism & Hospitality (AREA)
  • Game Theory and Decision Science (AREA)
  • General Business, Economics & Management (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Present description provides determination method, apparatus, server and the data processing methods of a kind of data processing method.Wherein, the determination method of data processing method includes: to obtain target data and system operational parameters to be processed;According to preset decision Matching Model, it determines to establish rules really then with the matched processing mode of system operational parameters, wherein, processing mode is established rules then really for determining the data processing method to the target data in conjunction with the target data and the system operational parameters.In this specification embodiment, established rules really then by being automatically determined out using trained preset decision Matching Model with the matched processing mode of system operational parameters;It establishes rules really further according to processing mode, determines that the factors such as system run all right can be taken into account, it is suitable for the target processing mode of the data processing of target data again, to carry out data processing to target data, to reduce implementation cost, efficiency and accuracy that data processing method determines are improved.

Description

Determination method, apparatus, server and the data processing method of data processing method
Technical field
This specification belongs to the determination method, apparatus of Internet technical field more particularly to a kind of data processing method, clothes Business device and data processing method.
Background technique
In data handling, it can usually be related to the decision judgement to selected data processing method, be sentenced by decision It is disconnected to can choose out the specific data processing of suitable data processing method progress.
For example, existing simultaneously two kinds of optional data processing methods in the Data processing for generating data B according to data A To complete above-mentioned data processing.At this moment the decision-making module in data processing link can be by itself being needed based on data processing And processing mode set by the factors such as running environment of system is established rules really, carries out decision judgement, from two kinds of data processings Mode chooses a kind of suitable data processing method to carry out specific data processing.
Currently, existing method, need to analyze system environments by technical staff mostly, in conjunction with oneself through running repair Change, processing mode applied by decision-making module in data processing link is set establishes rules really then;And then decision-making module can basis Above-mentioned processing mode is established rules really, determines the data processing method for target data, is carried out to target data specific Data processing.The above method is during realization, due to needing technical staff to combine experience, according to the running environment of system Changing condition, artificially establish rules really to processing mode applied in decision-making module, be adjusted, change, lead to O&M The cost is relatively high, determines that efficiency and accuracy are also difficult to control.Therefore, a kind of determination method of data processing method is needed, To reduce implementation cost, efficiency and accuracy that data processing method determines are improved.
Summary of the invention
This specification is designed to provide determination method, apparatus, server and the data processing of a kind of data processing method Method improves efficiency and accuracy that data processing method determines to reduce implementation cost.
Determination method, apparatus, server and the data processing method of a kind of data processing method that this specification provides be It is achieved:
A kind of determination method of data processing method, comprising: obtain target data and system operational parameters to be processed;Root According to preset decision Matching Model, determine to establish rules really then with the matched processing mode of the system operational parameters, wherein institute Processing mode is stated to establish rules really then for determining to the target data in conjunction with the target data and the system operational parameters Data processing method.
A kind of data processing method, comprising: obtain target data and system operational parameters to be processed;It is determined according to preset Plan Matching Model is determined to establish rules really then with the matched processing mode of the system operational parameters;According to the processing mode Really establish rules then, the target data, the system operational parameters, target processing mode is determined, as to the number of targets According to data processing method;According to the target processing mode, data processing is carried out to the target data.
A kind of determining device of data processing method, comprising: module is obtained, for obtaining target data to be processed and being System operating parameter;Decision-making management module, for determining and the system operational parameters according to preset decision Matching Model The processing mode matched is established rules then really, and the processing mode is established rules really, is sent to the decision-making module, wherein described Processing mode is established rules really then includes at least index parameter and decision rule;Decision-making module, for according to the processing mode It determines rule, the target data, the system operational parameters, target processing mode is determined, as to the target data Data processing method.
A kind of server, including processor and for the memory of storage processor executable instruction, the processor It is realized when executing described instruction and obtains target data and system operational parameters to be processed;According to preset decision Matching Model, It determines to establish rules really then with the matched processing mode of the system operational parameters;According to the processing mode establish rules really then, The target data, the system operational parameters, determine target processing mode, as the data processing to the target data Mode.
A kind of computer readable storage medium, is stored thereon with computer instruction, and described instruction is performed realization and obtains Target data and system operational parameters to be processed;According to preset decision Matching Model, determines to run with the system and join The matched processing mode of number is established rules then really;According to the processing mode establish rules really then, the target data, the system fortune Row parameter determines target processing mode, as the data processing method to the target data.
Determination method, apparatus, server and the data processing method for the data processing method that this specification provides, pass through benefit It determines to run with system automatically according to the specific running environment of system with trained preset decision Matching Model and join The matched processing mode of number is established rules then really;It establishes rules really further according to above-mentioned processing mode, determines preferably to take into account and be Unite the factors such as operation stability, and the target processing mode of the data processing of suitable target data, with to target data into The specific data processing of row improves efficiency and accuracy that data processing method determines, can be based on to reduce implementation cost Target processing mode determined by above-mentioned rule efficiently, steadily carries out the data processing of target data.
Detailed description of the invention
In order to illustrate more clearly of this specification embodiment or technical solution in the prior art, below will to embodiment or Attached drawing needed to be used in the description of the prior art is briefly described, it should be apparent that, the accompanying drawings in the following description is only The some embodiments recorded in this specification, for those of ordinary skill in the art, in not making the creative labor property Under the premise of, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of embodiment schematic diagram that data processing is carried out based on existing method;
Fig. 2 is in a Sample Scenario, using the determination method for the data processing method that this specification embodiment provides A kind of embodiment schematic diagram;
Fig. 3 is in a Sample Scenario, using the determination method for the data processing method that this specification embodiment provides Another embodiment schematic diagram;
Fig. 4 is a kind of flow diagram of the determination method for the data processing method that this specification embodiment provides;
Fig. 5 is a kind of flow diagram for the data processing method that this specification embodiment provides;
Fig. 6 is a kind of embodiment schematic diagram for the server that this specification embodiment provides;
Fig. 7 is a kind of embodiment schematic diagram of the determining device for the data processing method that this specification embodiment provides.
Specific embodiment
In order to make those skilled in the art more fully understand the technical solution in this specification, below in conjunction with this explanation Attached drawing in book embodiment is clearly and completely described the technical solution in this specification embodiment, it is clear that described Embodiment be only this specification a part of the embodiment, instead of all the embodiments.The embodiment of base in this manual, Every other embodiment obtained by those of ordinary skill in the art without making creative efforts, all should belong to The range of this specification protection.
In view of the determination method of existing data processing method is by technical staff mostly according to system running environment (such as occupancy situation of memory etc.), in conjunction with the processing of specific target data, artificial setting determines suitable data processing method Really it establishes rules then, so that the decision-making module (or decision logic) in data processing link can be based on above-mentioned data processing method Really it establishes rules, carries out decision judgement, to determine suitable, stable data processing method, target data is carried out specific Data processing.For example, as shown in fig.1, the risk for the case where operating load when system entirety is larger, and there are system exceptions Under, it needs, in conjunction with experience, to manually adjust according to system situation by technical staff, modify decision-making module in data processing link Applied processing mode is established rules then really;So that decision-making module can establish rules really according to adjustment, modified processing mode Then, it according to target data and system operational parameters, is determined from more appropriate data from three kinds of preset data processing methods Reason mode 2 is used as target processing mode, carries out data processing to target data.
Since the above method is during realization, need to rely on technical staff according to the real-time change feelings of system running environment Condition modification adjusts corresponding processing mode and establishes rules then really, and establishes rules really then modifying and adjusting processing mode again by skill The experience manual amendment of art personnel, cause it is above-mentioned realize when, for artificial O&M, the cost is relatively high, and handle efficiency It is also not sufficiently stable with accuracy.
For above situation, this specification consideration can use trained preset decision Matching Model instead of skill Art personnel in time, efficiently determine to run feelings with current system automatically according to the real-time transform situation of system running environment The matched data processing method of condition is established rules then really, and then can be established rules really according to above-mentioned processing mode, is carried out decision and is sentenced It is disconnected, determine that suitable target processing mode carries out data processing with stabilization, efficiently to target data, to reduce implementation Cost improves efficiency and accuracy that data processing method determines.
This specification embodiment provides a kind of determination method of data processing method, the determination of the data processing method Method can be applied to include multiple servers (or processor) system architecture, or the service including multiple program modules Device.
In the present embodiment, one or more servers in above-mentioned multiple servers are responsible for decision-making management link, His server is responsible for data processing link.
Specifically, being provided with decision-making management module on above-mentioned decision-making management chain road (such as can be responsible for decision-making management The program code of logic), decision-making module and processing module are provided on above-mentioned data processing chain road (such as can be responsible for counting According to the program code of processing main logic).Wherein, above-mentioned decision-making management link and data processing link are mutually indepedent, thus make Decision-making management module is obtained in the case where generation processing mode is established rules then really, above-mentioned processing mode can be established rules really, be sent out The decision-making module into data processing link is sent, establishes rules then, determines pair really so that decision-making module is based on above-mentioned processing mode The data processing method that target data is handled;It is coupled again due to that will not exist with data processing link simultaneously, passes through decision Processing mode used in the logic Modification decision-making module of link management is established rules then really, will not be to the logic on data process chain road It has an impact.
In the present embodiment, above-mentioned decision-making management module specifically can be used for obtaining target data and system to be processed Operating parameter;Further according to preset decision Matching Model, determine with the matched processing mode of the system operational parameters really Set pattern then (such as can include determining that in processing mode institute's decision rule to be used or algorithm, and the index ginseng being related to Number);And above-mentioned processing mode is established rules really, it is sent to decision-making module.
In the present embodiment, on the one hand above-mentioned decision-making module, can pass through network communication (or passing through synchronization module) etc. The processing mode that mode receives the transmission of the decision-making management module in decision-making management link is established rules then really, and according to above-mentioned processing side The determination rules modification of formula updates processing mode used in decision-making module and establishes rules really then, allow decision-making module with certainly Plan management module is synchronous.On the other hand it can be transported by the target data and system of data processing link receiving processing module Row parameter, and established rules really according to processing mode, decision judgement is carried out, determines suitable processing mode as target processing Mode.
In the present embodiment, above-mentioned processing module specifically can be used for receiving the processing of target determined by decision-making module Mode, and specific data processing is carried out to target data according to above-mentioned target processing mode.
In the present embodiment, above-mentioned server concretely one there is data operation, store function and network to hand over The electronic equipment of mutual function;Or run in the electronic equipment, support is provided for data processing, storage and network interaction Software.Do not limit the quantity of the server specifically in the present embodiment.The server can be a server, It can also be several servers, alternatively, the server cluster that several servers are formed.
In a Sample Scenario, can with as shown in fig.2, using this specification embodiment provide processing mode really Determine method to take into account the stability of system running environment, automatically, efficiently determines suitable processing mode to target Data carry out data processing.
In this Sample Scenario, when it is implemented, the decision-making management module in decision-making management link can be in real time or regular Acquire current system operating parameter.
Wherein, above system operating parameter specifically can be understood as the ginseng of the performance for characterizing system running environment situation Number.Specifically, above system operating parameter may include: memory usage, hard disk remaining capacity, I/O interface (input/output Interface) read or write speed, the health index of system environments etc..Certainly, it should be noted that above-mentioned cited system runs ginseng Number is intended merely to that this specification embodiment is better described.When it is implemented, can also be according to specific application scenarios and reality Requirement is applied, other kinds of performance parameter is introduced, such as amount of access that may be incorporated into system database etc. is used as above system Operating parameter.In this regard, this specification is not construed as limiting.
Decision-making management module after obtaining system operational parameters, consider in order to guarantee the operation of system can stablize, it is high Effect can call trained preset decision Matching Model to determine to be suitable for current according to running situation The processing mode of system running environment is established rules then really, i.e., establishes rules really then with the matched processing mode of system operational parameters.This The decision-making module of sample follow-up data process chain road can establish rules really according to above-mentioned processing mode, determine to be suitble to current system The target processing mode to target data for operating condition of uniting.
Wherein, above-mentioned processing mode is established rules really, specifically can be understood as a kind of data for determining to target data The decision-making technique and foundation of processing mode, it can established rules really according to above-mentioned processing mode, carry out decision judgement to determine To the data processing method of target data.
Above-mentioned data processing method specifically can be understood as carrying out in data processing link optionally in target data The embodiment of specific data processing.It usually can be real by the embodiment of plurality of optional to the data processing of target data It is existing, it can data processing is carried out to target data by the data processing method of plurality of optional.Wherein, at different data Requirement of the reason mode when implementing to the occupancy, performance of resource, and obtain processing result and can have differences.
Above-mentioned target processing mode, specifically can be understood as the operating condition in a variety of data processing methods with current system Matching can stablize, efficiently complete the data processing method for carrying out data processing to target data.
For example, target data can be the data W to be calculated of an input, need to carry out calculation processing to the data, Obtain corresponding calculated result E.At this moment may exist two kinds of optional data processing methods in data processing link, i.e., at data Reason mode a and data processing method b.It wherein, can be according to number according to above-mentioned data processing method a or data processing method b Calculated result E is calculated according to W.But it is a kind of relatively simple calculation, which pair that data processing method a is corresponding Resource occupation is relatively fewer, and the requirement to system performance is relatively low, and the accuracy for the calculated result E being calculated is relatively It is low.And it is a kind of more complicated calculation that data processing method b is corresponding, which is relatively large to resource occupation, right The requirement of system performance is relatively high, and the accuracy for the calculated result E being calculated is also relatively high.If current system can Less with resource, data processing is lower to the precise requirements of calculated result E, carries out in order to stabilization, efficiently to data W Processing, the matched target processing mode of institute can be data processing method a.If the available resources of current system are more, data Processing is higher to the precise requirements of calculated result E, and the matched target processing mode of institute then can be data processing method b.
Above-mentioned processing mode is established rules really, specifically can be understood as determining target from multiple optional processing modes The method and foundation of processing mode.It is above-mentioned to establish rules really with the matched processing mode of system operational parameters, specifically it can be understood as It is based on current system operating condition, the processing mode that can preferably take into account system run all right is established rules then really.
Above-mentioned processing mode is established rules really, can specifically include: decision rule and index parameter etc..Wherein, above-mentioned decision Rule specifically can be a kind of judgement algorithm (also referred to as decision making algorithm), judgment rule etc..Specifically, can based on above-mentioned decision rule Judge whether system operational parameters meet preset condition to pass through, to determine using which kind of corresponding data processing method.Such as Judgment rule: selecting No.1 data processing method as target processing mode if the occupancy of CPU is less than threshold value j, if The occupancy of CPU is more than or equal to threshold value j and then selects two number processing modes as target processing mode;Or it is calculated by classification Method judgement meets a certain type condition can be understood as being a kind of decision rule using corresponding data processing method etc..It is above-mentioned Index parameter specifically can be understood as when carrying out condition judgement using above-mentioned decision rule, and involved is used for multilevel iudge Whether system operational parameters etc. meet the index parameter or parameter threshold of preset condition.For example, judgment rule: if CPU Occupancy is less than threshold value j and No.1 data processing method is then selected to may be considered one kind as the threshold value j in target processing mode Parameter index.Certainly, it should be noted that above-mentioned cited decision rule and parameter index are intended merely to that this is better described Specification embodiment.When it is implemented, corresponding decision rule and index can be arranged with processing requirement as the case may be Parameter.In this regard, this specification is not construed as limiting.
Above-mentioned preset decision Matching Model specifically can be understood as one kind in advance by the history number to data processing It is obtained according to being learnt, being trained, suitable processing mode can be determined according to the concrete condition of the running environment of system Really the model established rules then.For example, current system running environment is poor, obtained processing mode is established rules really, can be tended to It determines and requires lower data processing method as target processing mode running environment.In this way it is subsequent can based on determined by Processing mode is established rules really, determines that data processing can be carried out to target data and current system operation conditions is matched Target processing mode efficiently, accurately, steadily to carry out the data processing of target data.
In this Sample Scenario, as shown in fig.3, decision-making management module can be using current system operating parameter as defeated Enter, is input to above-mentioned preset decision Matching Model;Preset decision Matching Model can be based on the system operation ginseng inputted Number, output are matched with the system operational parameters as a result, i.e. to be determined and the matched processing mode of system operational parameters Determine rule (including corresponding decision rule and index parameter).
It, can basis after decision-making management module has obtained establishing rules then really with the matched processing mode of system operational parameters Above-mentioned processing mode is established rules really, generates corresponding configuration data, wherein is included at least corresponding decision in configuration data and is advised Then and index parameter;And above-mentioned configuration data is sent to the decision in data processing link by modes such as network communications Module.
It should be noted that same set of agreement, standard specifically can be used in above-mentioned decision-making module and decision-making management module.Cause This, decision-making module can be parsed by data from above-mentioned after receiving above-mentioned configuration data according to same set of agreement, standard It obtains processing mode determined by decision-making management module in configuration data to establish rules really then, i.e. decision rule and index parameter;Into And can be established rules really according to above-mentioned the processing mode original decision rule then, use decision module local and index parameter It modifies and updates, i.e., it is decision rule used in decision-making module local is synchronous with index parameter modification for decision-making management mould Decision rule and index parameter determined by block.
Further, decision rule and index parameter after decision-making module can be synchronized based on above-mentioned modification, according to be processed Target data and system operational parameters, the processing module data processing method to be used in data process chain road is judged It determines.Specifically, decision rule and index parameter after being synchronized based on above-mentioned modification, according in data processing link wait locate The target data and system operational parameters of reason are determined to stablize, in current system running environment efficiently to target Data carry out the data processing method of data processing as target processing mode, so as to processing module can be according to above-mentioned target at Reason mode is stable, efficiently carries out data processing.
Specifically, decision-making module can be first according to the target data, determination is matched multiple pre- with the target data If data processing method;The system operational parameters and the index parameter again, obtain comparison result;Finally according to institute Decision rule is stated, is determined from the multiple preset data processing method and the matched preset data of the comparison result Processing mode is as the target processing mode.
For example, decision-making module first can go out multiple suitable number of targets according to Feature Selections such as the type of target data and quantity According to data processing method as with the matched preset data processing method of target data.And then it can will be acquired current System operational parameters and index parameter are compared, and obtain specific comparison result.Such as determine: memory usage, which is greater than, to be accounted for It is greater than residual capacity threshold value with rate threshold value, hard disk remaining capacity, (there are delay machines lower than index threshold for the health index of system environments Risk) etc. be used as above-mentioned comparison result.Current system may further be judged according to decision rule and above-mentioned comparison result The preset condition that running environment is met, so can choose data processing method corresponding with preset condition make with than Compared with the matched data processing method of result, obtain be suitble to current system operating condition and meanwhile target data can be counted According to the target processing mode of processing.
Target processing mode can be supplied in data processing link by decision-making module after target processing mode has been determined Processing module, and then processing module efficiently, steadily can carry out target data specific according to above-mentioned target processing mode Data processing.
By above-mentioned Sample Scenario as it can be seen that the determination method for the processing mode that this specification provides has been trained by utilizing Preset decision Matching Model determined and the matched processing of system operational parameters automatically according to the specific running environment of system Mode is established rules then really;Establish rules really further according to processing mode, determine preferably to take into account system run all right etc. because Element, and the target processing mode of the data processing of suitable target data, to carry out specific data processing to target data, from And implementation cost is reduced, and efficiency and accuracy that data processing method determines are improved, it can be by being based on above-mentioned processing mode Really establish rules then determined by target processing mode, efficiently, steadily carry out the data processing of target data.
In another Sample Scenario, it is emphasized that data processing link is mutually indepedent with decision-making management link. Wherein, decision-making management chain road can be set decision-making management module, data processing chain road can be set decision-making module and Handle model.Decision-making management link is responsible for generating processing mode establishes rules then really, and by modes such as network communications by above-mentioned place Reason mode is established rules really, is sent to the decision-making module of data processing chain road.Data processing link is responsible for passing through decision-making module base It establishes rules really in above-mentioned processing mode, determines target processing mode, then by processing module according to above-mentioned target processing mode Complete the data processing to target data.
Based on above structure and connection type, decision-making module can obtain decision-making management chain road decision by network communication It includes configuration data that processing mode is established rules then really that management module is generated, and is modified according to above-mentioned configuration data and more Itself new used processing mode is established rules then really, with synchronous with the holding of decision-making management module.Simultaneously as decision-making module is It is packaged in data processing link and is connected with processing module, it is therefore contemplated that being one is coupled in data processing link In decision logic.It can rapidly be established rules really then according to mode to be processed based on the decision-making module, the target of combination processing Data and system operational parameters efficiently and accurately determine corresponding target processing mode, and then processing module can be according to upper It states target processing mode and data processing is carried out to target data.
It is weaker with data processing link couples because decision-making management link is independently of data processing link setting, It generates processing mode to establish rules then really, and sends above-mentioned processing mode to decision-making module and establish rules really, not will receive at data The influence of link is managed, therefore can more accurately and rapidly determine to establish rules really with the matched processing mode of system operational parameters Then, and by network communication, above-mentioned processing mode is established rules really, is sent to decision-making module, to use decision module local Decision rule and index parameter modify, update, so that the decision-making module being set in data processing link can basis Modification, the decision rule updated and index parameter determine target processing mode, so that the processing in data processing link Module can carry out data processing according to target processing mode.To reduce to other programmed logics in data process chain road It impacts, reduces the difficulty and cost of variation, but also introducing other data more from the external of data processing link It is easy, conveniently, further improves treatment effeciency.
As shown in fig.4, this specification embodiment provides a kind of determination method of data processing method.Specific implementation When, this method may include the following contents.
S41: target data and system operational parameters to be processed are obtained.
In the present embodiment, above-mentioned target data specifically can be understood as the business datum for needing to carry out data processing. Wherein, above-mentioned target data specifically can be text data, be also possible to numeric data, can also be image data etc..It is right In the concrete form and content of above-mentioned target data, this specification is not construed as limiting.
In the present embodiment, above system operating parameter specifically can be understood as characterizing system running environment situation Performance parameter.Specifically, above system operating parameter may include: memory usage, hard disk remaining capacity, I/O interface Read or write speed, health index of system environments etc..Certainly, it should be noted that above-mentioned cited system operational parameters are In order to which this specification embodiment is better described.When it is implemented, according to specific application scenarios and can also implement to require, Other kinds of performance parameter is introduced as system operational parameters.In this regard, this specification is not construed as limiting.
S42: it according to preset decision Matching Model, determines with the matched processing mode of the system operational parameters really Set pattern is then, wherein the processing mode is established rules then really for determining in conjunction with the target data and the system operational parameters To the data processing method of the target data.
In the present embodiment, above-mentioned processing mode (i.e. data processing method) specifically can be understood as data processing link In optionally in the embodiment for carrying out specific data processing to target data.It usually can be with to the data processing of target data It is realized by the embodiment of plurality of optional, it is possible to which the data processing method that can have plurality of optional can be realized to mesh Mark the data processing of data.Wherein, different data processing methods when realizing may occupancy, performance to resource requirement, And it obtains result and can have differences.
In the present embodiment, above-mentioned processing mode is established rules really, specifically can be understood as a kind of for determining to target The decision-making technique and foundation of the data processing method of data, when it is implemented, can be established rules really then according to above-mentioned processing mode The target processing mode of the progress data processing to target data is determined by decision judgement.
In the present embodiment, above-mentioned to establish rules really then with the matched processing mode of the system operational parameters, specifically may be used To be interpreted as being suitable for the running environment of current system, can tend to determine so that system it is stable, health operation, keep away as far as possible Exempt to occur establishing rules really then including the target processing mode of the operation problems such as delay machine, database exception.
Above-mentioned processing mode is established rules really, can specifically include: decision rule and index parameter etc..Wherein, above-mentioned decision Rule specifically can be a kind of judgement algorithm (or decision making algorithm), judgment rule etc..Specifically, can based on above-mentioned decision rule Judge whether system operational parameters meet preset condition to pass through, to determine using which kind of corresponding data processing method.Such as Judgment rule: selecting No.1 data processing method as target processing mode if the occupancy of CPU is less than threshold value j, if The occupancy of CPU is more than or equal to threshold value j and then selects two number processing modes as target processing mode;Or it is calculated by classification Method judgement meets a certain type condition can be understood as being a kind of decision rule using corresponding data processing method etc..It is above-mentioned Index parameter specifically can be understood as when carrying out condition judgement using above-mentioned decision rule, and involved is used for multilevel iudge Whether system operational parameters etc. meet the index parameter or parameter threshold of preset condition.Certainly, it should be noted that above-mentioned institute The decision rule and parameter index enumerated are intended merely to that this specification embodiment is better described.When it is implemented, can root According to concrete condition and processing requirement, corresponding decision rule and index parameter are set.In this regard, this specification is not construed as limiting.
In the present embodiment, above-mentioned preset decision Matching Model specifically can be understood as a kind of passing through logarithm in advance Learnt according to the historical data of processing, train obtained, can be determined according to the concrete condition of the running environment of system The model that suitable processing mode is established rules then really.When it is implemented, can be using system operational parameters as mode input, input Extremely in above-mentioned preset decision Matching Model, to obtain for the determining and matched target processing side of current system operation situation The processing mode of formula is established rules then really.
In the present embodiment, above-mentioned according to preset decision Matching Model, it determines and the system operational parameters The processing mode matched is established rules then really, when it is implemented, may include the following contents: passing through the decision pipe in decision-making management link It manages module and calls the preset decision Matching Model, to determine with the matched processing mode of the system operational parameters really Set pattern is then, wherein the processing mode is established rules really then includes at least index parameter and decision rule.
In the present embodiment, above-mentioned decision-making management link specifically can be used for through the decision pipe in decision-making management link Module (or decision-making management logic) is managed according to the determining matched processing side of operation conditions with current system of system operational parameters Formula is established rules then really;And above-mentioned processing mode is sent by network communication and is established rules really then, by determining in data processing link The determination rules modification of processing mode used in plan module (or decision logic) is updated to above-mentioned and system operational parameters The processing mode matched is established rules then really.Above-mentioned data processing link specifically can be used for through the decision model root tuber in data link It establishes rules really according to processing mode then, judges to determine at target by decision in conjunction with system operational parameters and target data to be processed Reason mode;Data processing is carried out to target data according to target processing mode by the processing module in data processing link.
In the present embodiment, above-mentioned decision-making management link and above-mentioned data processing link are mutually indepedent, mutual Coupling is relatively weak, association influence is also relatively small.Therefore, it is based on above structure and connection relationship, decision-making management module is true The fixed and matched processing mode of system operational parameters is established rules then really, and the decision-making module into data processing link is sent It states processing mode to establish rules really then, the implementation process established rules really then with processing mode used in Change Strategy module is to data Influence and the variation for handling other logic modules in link in addition to decision-making module are relatively small, to reduce modification change The implementation cost that processing mode in decision-making module is established rules then really;Simultaneously by decision-making management link, so that from data processing It is more convenient, efficient that the outside of link introduces other data progress decision interpretations.
In the present embodiment, processing mode described above is established rules really, specifically can be used in conjunction with the target data With the system operational parameters, the data processing method to the target data is determined.
In the present embodiment, the decision-making module in data processing link has acquired above-mentioned and system operational parameters After matched processing mode is established rules then really, further, can be established rules really according to processing mode then, target data, system Operating parameter is determined preferably to carry out data processing to target data and takes into account the stability of system operation, is suitble to Data processing method with the running environment of current system is as target processing mode.Pass through the processing in data processing link again Module carries out data processing to target data according to above-mentioned target processing mode, so that the data processing of target data is more Stabilization, efficiently.
In the present embodiment, it is above-mentioned established rules really according to processing mode then, target data, system operational parameters, determine Target processing mode out, as the data processing method to the target data, when it is implemented, may include the following contents: According to the target data, the determining and matched multiple preset data processing methods of the target data;Compare the system Operating parameter and the index parameter, obtain comparison result;According to the decision rule, from the multiple preset data processing It is determined in mode with the matched preset data processing method of the comparison result as the target processing mode.
In the present embodiment, above-mentioned according to the target data, it is determining matched multiple default with the target data Data processing method, can specifically include: according to features such as the type of target data, quantity, selecting suitable target data (i.e. matched with the target data) data processing method of feature is as preset data processing method.
In the present embodiment, above-mentioned preset data processing method can be it is pre-defined, set for data at The optional data processing method that decision-making module in reason link is selected as the case may be, determined.
In the present embodiment, the above-mentioned system operational parameters and the index parameter, obtain comparison result, tool Body can be is compared the parameters in system operational parameters with corresponding index parameter respectively, obtains corresponding comparison As a result.For example, hard disk remaining capacity (system operational parameters) is less than capacity threshold (corresponding index parameter).
In the present embodiment, above-mentioned according to the decision rule, from the multiple preset data processing method really It makes with the matched preset data processing method of the comparison result as the target processing mode, can specifically include: According to decision rule, the foundation that comparison result is judged as decision determines current target data processing and system operation Which kind of preset condition environment meets, and then preset data processing method corresponding with the preset condition met can be chosen to make For target processing mode.
After determining target processing mode, the processing module in data processing link can be according to target processing mode pair Target data carries out efficient, stable data processing, while can also take into account the stabilization and health of system entirety.
Therefore this specification provide processing mode determination method pass through using it is trained it is preset certainly Plan Matching Model determines the determination with the matched processing mode of system operational parameters automatically according to the specific running environment of system Rule;Establish rules really further according to processing mode, determine preferably to take into account the factors such as system run all right and The target processing mode of the data processing of the target data of conjunction, to carry out specific data processing to target data, to reduce Implementation cost improves efficiency and accuracy that data processing method determines, can pass through the target based on determined by above-mentioned rule Processing mode efficiently, steadily carries out the data processing of target data.
In one embodiment, it according to preset decision Matching Model, determines to match with the system operational parameters Processing mode establish rules really then, when it is implemented, may include content: by decision-making management link (in decision-making management mould Block), the preset decision Matching Model is called, to determine the determination with the matched processing mode of the system operational parameters Rule, wherein the processing mode is established rules really then includes at least index parameter and decision rule;
Correspondingly, being determined and the matched processing side of the system operational parameters according to preset decision Matching Model After formula is established rules then really, the method can also include the following contents: pass through data processing link (in decision-making module), root According to the processing mode establish rules really then, the target data, the system operational parameters, determine target processing mode, make For the data processing method to the target data;By the data processing link (in processing module), according to the mesh Processing mode is marked, data processing is carried out to the target data;Wherein, the decision-making management link is independently of the data processing Link.
It should be noted that the decision-making management link specifically can be understood as independently of the data processing link it is in office Functionally, decision-making management link and the division of labor of data process chain road are different, independently of each other for business;In structure, decision-making management link and Data processing link couples are weaker, influence each other smaller.
In the present embodiment, above system operating parameter specifically can be understood as characterizing system running environment situation Performance parameter.Specifically, above system operating parameter may include: memory usage, hard disk remaining capacity, I/O interface Read or write speed, health index of system environments etc..Wherein, the health index of above system environment, which can refer to, integrally transports system The evaluation parameter of the health status of row environment.For example, there are the risks such as delay machine, exception in system overall operation safety or system It is relatively high.Certainly, it should be noted that above-mentioned cited system operational parameters are that one kind schematically illustrates, and are not answered Constitute the improper restriction to this specification.
In the present embodiment, above-mentioned decision-making management link can specifically include decision-making management, specifically can be used for passing through Decision-making management module (or decision-making management logic) in decision-making management link is according to system operational parameters determination and current system The matched processing mode of operation conditions establish rules really then;And above-mentioned processing mode is established rules really by network communication, it sends In decision-making module (or decision logic) into data processing link, so as to processing mode used in Change Strategy module local Really it establishes rules, repairs.Above-mentioned data processing link can specifically include decision-making module and processing module, specifically for passing through data Decision-making module in link is established rules then really according to above-mentioned processing mode, passes through decision in conjunction with system operational parameters and target data Judge to determine suitable targets processing mode;It can be according to target processing mode to mesh by the processing module in data processing link It marks data and carries out data processing.
And in the conventional method, often there is no decision-making management module, not independently of the decision pipe of data processing link yet Link is managed, is only coupled and the decision-making module in data processing link.Based on the structure and connection relationship in existing method, decision Coupling between module and data processing link is compared with strong, relevance is larger.Therefore, to the processing mode in decision-making module really When set pattern is then modified, the logic module of other parts in data process chain road will certainly be had an impact, for example, it may be possible to need The logic modules such as processing module in data process chain road are modified accordingly, be adjusted.Cause to use decision-making module Processing mode establish rules really, change that the cost is relatively high;In addition, being introduced except data processing link other The difficulty of related data is also relatively large.
And based on structure and connection relationship in present embodiment, the determination of decision-making management module is matched with system operational parameters Processing mode is established rules then really, and is sent above-mentioned processing mode to decision-making module and established rules really then, so that decision-making module is according to institute Processing mode used in the determination Policy Updates modification local of the processing mode received is established rules then really, above process logarithm It is relatively small according to the influence and variation of the logic module of the other parts in processing link in addition to decision-making module, to reduce The implementation cost that processing mode in modification Change Strategy module is established rules then really;Simultaneously by decision-making management link, so that from It is more convenient, efficient that the other data of external introducing of data processing link carry out decisions judgement.
In one embodiment, it is above-mentioned according to the processing mode establish rules really then, the target data, the system Operating parameter determines target processing mode, when it is implemented, may comprise steps of:
S1: according to the target data, the determining and matched multiple preset data processing methods of the target data;
S2: the system operational parameters and the index parameter obtain comparison result;
S3: it according to the decision rule, determines to tie compared with described from the multiple preset data processing method The matched preset data processing method of fruit is as the target processing mode.
In the present embodiment, the target processing mode determined specifically can be understood as one kind can be preferably right Target data carries out data processing, and can combine the stable and safe data processing method of system entirety.
In one embodiment, the preset decision Matching Model specifically can be establishes in the following way: The historical data of the data processing of acquisition system, wherein the historical data of the data processing includes at least: data processing is made Processing mode is established rules really, the operating parameter of data processing, data processing obtain result data, data processing it is anti- Feedforward information;It is trained using the historical data of the data processing, foundation obtains the preset decision Matching Model.
In the present embodiment, the historical data of above-mentioned data processing can specifically include in data handling procedure in history Data relevant to hardware components, for example, processing mode used in data processing establish rules really then, the system of data processing Operating parameter etc., also may include data relevant to data processing business in data handling procedure, such as data in history Handle obtained result data, the feedback information of data processing, the success rate of data processing and failure rate etc..When it is implemented, Historical data of the data of suitable type as above-mentioned data processing can be introduced as the case may be.In this regard, this specification is not It limits.
In the present embodiment, the historical data of the data processing of above system can specifically refer to every in history in system Secondary carry out data processing, the processing mode being based on establish rules then (such as used in decision rule and index parameter), every really The operating parameter (such as CPU occupation rate, hard disk remaining capacity etc.) of system, each data processing obtain when secondary progress data processing Result data, with the feedback information of data processing (such as processing failure, delay machine occur abnormal etc.).Certainly, above-mentioned cited The historical data of data processing be that one kind schematically illustrates.For the particular content of the historical data of above-mentioned data processing, This specification is not construed as limiting.
In the present embodiment, the historical data of the data processing of system is obtained, when it is implemented, may include: to obtain The feedback result of log recording and user in system to each data processing;Above-mentioned log recording is parsed, extraction is counted Establish rules really according to processing mode used in handling, the obtained result data of the operating parameter of data processing, data processing;Root According to user to the feedback result of each data processing, the feedback information etc. of data processing is determined.Certainly, above-mentioned cited acquisition The mode of the historical data of the data processing of system is that one kind schematically illustrates.When it is implemented, according to specific scene, The historical data of the data processing of system can be obtained using other reasonable manners.In this regard, this specification is not construed as limiting.
It in the present embodiment, can will be above-mentioned after the historical data for the data processing for having acquired above system The historical data of the data processing of system carries out learning training as sample data, to models such as neural networks, to set up energy Enough reflect that system operational parameters, data processing method are established rules the moulds of then mapping relations between system run all right really Type to get arrive the preset decision Matching Model.Therefore, it can be transported according to system using above-mentioned preset decision Matching Model Row parameter, which is found, can tend to so that the processing mode of system run all right, safety is established rules then really as above-mentioned and system ginseng The matched processing mode of number is established rules then really.
In one embodiment, the system operational parameters can specifically include at least one of: memory usage, Hard disk remaining capacity, the read or write speed of I/O interface, health index of system environments etc..Certainly, it should be noted that above-mentioned institute The system operational parameters enumerated are that one kind schematically illustrates.When it is implemented, may be incorporated into other classes as the case may be The parameter of type is as above system operating parameter.In this regard, this specification is not construed as limiting.
Therefore this specification provide processing mode determination method pass through using it is trained it is preset certainly Plan Matching Model determines the determination with the matched processing mode of system operational parameters automatically according to the specific running environment of system Rule;Establish rules really further according to processing mode, determine preferably to take into account the factors such as system run all right and The target processing mode of the data processing of the target data of conjunction, to carry out specific data processing to target data, to reduce Implementation cost improves efficiency and accuracy that data processing method determines, can pass through the target based on determined by above-mentioned rule Processing mode efficiently, steadily carries out the data processing of target data;Also by utilizing determining independently of data processing chain road Plan management module is established rules then really to determine and send processing mode, so that decision-making module can change institute in data processing link The processing mode used is established rules then really, to weaken existing structure since there are the couplings of stronger logic to data process chain road Influence caused by the change of middle decision-making module, reduce determine and modification processing mode establish rules really, difficulty and be implemented as This, improves treatment effeciency.
As shown in fig.5, this specification embodiment provides a kind of data processing method.When it is implemented, this method can To include the following contents
S51: target data and system operational parameters to be processed are obtained;
S52: it according to preset decision Matching Model, determines with the matched processing mode of the system operational parameters really Set pattern is then;
S53: according to the processing mode establish rules really then, the target data, the system operational parameters, determine mesh Processing mode is marked, as the data processing method to the target data;
S54: according to the target processing mode, data processing is carried out to the target data.
In the present embodiment, above-mentioned preset decision Matching Model specifically can be understood as a kind of passing through logarithm in advance Learnt according to the historical data of processing, train obtained, can be determined according to the concrete condition of the running environment of system The model that suitable processing mode is established rules then really.When it is implemented, can be using system operational parameters as mode input, input Extremely in above-mentioned preset decision Matching Model, to obtain for the determining and matched target processing side of current system operation situation The processing mode of formula is established rules then really.
In the present embodiment, when it is implemented, can be determined by obtaining and according to current system operating parameter It establishes rules really then with the matched processing mode of system operational parameters;It establishes rules really then further according to above-mentioned processing mode, combining target Data and system operational parameters determine that the factors such as data processing and the system run all right of target data can be taken into account Data processing method is as target processing mode;And then it can be according to above-mentioned target data processing mode, efficiently, steadily to mesh It marks data and carries out specific data processing.
In one embodiment, above-mentioned according to preset decision Matching Model, it determines and the system operational parameters Matched processing mode is established rules then really, when it is implemented, may include: by decision-making management link (in decision-making management mould Block) the preset decision Matching Model is called, to determine the determination with the matched processing mode of the system operational parameters Rule, wherein the processing mode is established rules really then includes at least index parameter and decision rule.Correspondingly, according to the place Reason mode establish rules really then, the target data, the system operational parameters, target processing mode is determined, as to described The data processing method of target data;According to the target processing mode, data processing is carried out to the target data, specifically may be used With include: by data processing link (in decision-making module) according to the processing mode establish rules really then, the target data, The system operational parameters determine target processing mode, as the data processing method to the target data;And pass through institute Data processing link (in processing module) is stated according to the target processing mode, data processing is carried out to the target data.
In one embodiment, the preset decision Matching Model when it is implemented, can build in the following way It is vertical: to obtain the historical data of the data processing of system, wherein the historical data of the data processing includes at least: data processing Used processing mode is established rules really, the operating parameter of data processing, data processing obtain result data, data processing Feedback information;It is trained using the historical data of the data processing, establishes the preset decision Matching Model.
Therefore the data processing method that this specification provides using trained preset decision by being matched Model is determined to establish rules really then with the matched processing mode of system operational parameters automatically according to the specific running environment of system;Again Established rules really according to processing mode, determine preferably to take into account the factors such as system run all right and target The target processing mode of the data processing of data allows system efficient, steady to carry out specific data processing to target data Surely carry out the data processing of target data, there are the risks such as delay machine, exception in the system of reducing, improve system safety and Stability.
This specification embodiment additionally provides a kind of server, including processor and refers to for storage processor to be executable The memory of order, the processor can be according to instruction execution following steps when being embodied: obtaining target data to be processed And system operational parameters;According to preset decision Matching Model, determine and the matched processing mode of the system operational parameters Really it establishes rules then, wherein the processing mode is established rules really to be then used in conjunction with the target data and the system operational parameters, Determine the data processing method to the target data.
In order to more accurately complete above-metioned instruction, as shown in fig.6, this specification additionally provides another kind specifically Server, wherein the server includes network communications port 601, processor 602 and memory 603, and above structure is logical It crosses Internal cable to be connected, so that each structure can carry out specific data interaction.
Wherein, the network communications port 601 specifically can be used for obtaining target data and system operation ginseng to be processed Number;
The processor 602 specifically can be used for determining to run with the system according to preset decision Matching Model The matched processing mode of parameter is established rules then really, wherein the processing mode is established rules then really in conjunction with the target data With the system operational parameters, the data processing method to the target data is determined.
The memory 603, specifically can be used for storing target data and system operational parameters, processor 602 generate Intermediate data, and the corresponding instruction repertorie of storage.
In the present embodiment, the network communications port 601 can be is bound from different communication protocol, thus The virtual port of different data can be sent or received.Lead to for example, the network communications port can be responsible for progress web data No. 80 ports of letter are also possible to No. 21 ports for being responsible for carrying out FTP data communication, can also be that responsible progress mail data is logical No. 25 ports of letter.In addition, the network communications port can also be the communication interface or communication chip of entity.For example, its It can be mobile radio network communication chip, such as GSM, CDMA;It can also be Wifi chip;It can also be bluetooth core Piece.
In the present embodiment, the processor 602 can be implemented in any suitable manner.For example, processor can be with Take such as microprocessor or processor and storage can by (micro-) processor execute computer readable program code (such as Software or firmware) computer-readable medium, logic gate, switch, specific integrated circuit (Application Specific Integrated Circuit, ASIC), programmable logic controller (PLC) and the form etc. for being embedded in microcontroller.This specification is simultaneously It is not construed as limiting.
In the present embodiment, the memory 603 may include many levels, in digital display circuit, as long as can save Binary data can be memory;In integrated circuits, the circuit with store function of a not no physical form Also memory, such as RAM, FIFO are;In systems, the storage equipment with physical form is also memory, such as memory bar, TF Card etc..
This specification embodiment additionally provides a kind of computer storage medium based on above-mentioned method of payment, the computer Storage medium is stored with computer program instructions, is performed realization in the computer program instructions: obtaining mesh to be processed Mark data and system operational parameters;According to preset decision Matching Model, determine and the matched place of the system operational parameters Reason mode is established rules then really;According to the processing mode establish rules really then, the target data, the system operational parameters, really Target processing mode is made, as the data processing method to the target data.
In the present embodiment, above-mentioned storage medium includes but is not limited to random access memory (Random Access Memory, RAM), read-only memory (Read-Only Memory, ROM), caching (Cache), hard disk (Hard DiskDrive, ) or storage card (Memory Card) HDD.The memory can be used for storing computer program instructions.Network communication unit It can be according to standard setting as defined in communication protocol, for carrying out the interface of network connection communication.
In the present embodiment, the function and effect of the program instruction specific implementation of computer storage medium storage, can To compare explanation with other embodiment, details are not described herein.
As shown in fig.7, this specification embodiment additionally provides a kind of determination of data processing method on software view Device, the device can specifically include construction module below:
Module 701 is obtained, specifically can be used for obtaining target data and system operational parameters to be processed;
Decision-making management module 702 specifically can be used for determining to transport with the system according to preset decision Matching Model The matched processing mode of row parameter is established rules then really, and the processing mode is established rules really, is sent to the decision-making module, Wherein, the processing mode is established rules really then includes at least index parameter and decision rule;
Decision-making module 703, specifically can be used for being established rules really according to the processing mode then, it is the target data, described System operational parameters determine target processing mode, as the data processing method to the target data.
In one embodiment, described device can also include specifically processing module, specifically can be used for according to described Target processing mode carries out data processing to the target data, wherein and the decision-making module is connected with the processing module, It is set in data processing link;The decision-making management module is set in decision-making management link, and the decision-making management link is only Stand on the data processing link.
In one embodiment, the decision-making module 702 can specifically include;
First determination unit specifically can be used for according to the target data, determining matched more with the target data A preset data processing method;
Comparing unit specifically can be used for system operational parameters described in comparison and the index parameter, obtain comparison result;
Second determination unit specifically can be used for according to the decision rule, from the multiple preset data processing side It is determined in formula with the matched preset data processing method of the comparison result as the target processing mode.
In one embodiment, described device also specifically can also include establishing module, specifically can be used for establishing pre- If decision Matching Model.
In one embodiment, the module of establishing can specifically include:
Acquiring unit specifically can be used for obtaining the historical data of the data processing of system, wherein the data processing Historical data includes at least: processing mode used in data processing is established rules really then, at the operating parameter of data processing, data Manage the feedback information of obtained result data, data processing;
Training unit specifically can be used for being trained using the historical data of the data processing, establish described default Decision Matching Model.
In one embodiment, the system operational parameters include at least one of: memory usage, hard disk are remaining Capacity, the read or write speed of I/O interface, health index of system environments etc..Certainly, above-mentioned cited system operational parameters are One kind schematically illustrates.It is transported when it is implemented, may be incorporated into other kinds of parameter as the case may be as above system Row parameter.In this regard, this specification is not construed as limiting.
It should be noted that unit, device or module etc. that above-described embodiment illustrates, specifically can by computer chip or Entity is realized, or is realized by the product with certain function.For convenience of description, it describes to divide when apparatus above with function It is described respectively for various modules.It certainly, can be the function of each module in same or multiple softwares when implementing this specification And/or realized in hardware, the module for realizing same function can also be realized by the combination of multiple submodule or subelement etc..With Upper described Installation practice is only schematical, for example, the division of the unit, only a kind of logic function is drawn Point, there may be another division manner in actual implementation, such as multiple units or components may be combined or can be integrated into separately One system, or some features can be ignored or not executed.Another point, shown or discussed mutual coupling or straight Connecing coupling or communication connection can be through some interfaces, and the indirect coupling or communication connection of device or unit can be electrical property, Mechanical or other forms.
Therefore the determining device of the data processing method of this specification embodiment offer, pass through decision-making management module It determines to run with system automatically according to the specific running environment of system using trained preset decision Matching Model The matched processing mode of parameter is established rules then really;It is established rules really according to processing mode by decision-making module again, determining can be compared with The factors such as system run all right, and the target processing mode of the data processing of suitable target data are taken into account, well with right Target data carries out specific data processing, to reduce implementation cost, improves efficiency that data processing method determines and accurate Degree, can by based on it is above-mentioned rule determined by target processing mode, efficiently, steadily progress target data data at Reason.
Although being based on routine or nothing present description provides the method operating procedure as described in embodiment or flow chart Creative means may include more or less operating procedure.The step of enumerating in embodiment sequence is only numerous steps One of rapid execution sequence mode does not represent and unique executes sequence.When device or client production in practice executes, Can be executed according to embodiment or the execution of method shown in the drawings sequence or parallel (such as parallel processor or multithreading The environment of processing, even distributed data processing environment).The terms "include", "comprise" or its any other variant are intended to Cover non-exclusive inclusion, so that the process, method, product or the equipment that include a series of elements not only include those Element, but also including other elements that are not explicitly listed, or further include for this process, method, product or setting Standby intrinsic element.In the absence of more restrictions, being not precluded is including process, method, the product of the element Or there is also other identical or equivalent elements in equipment.The first, the second equal words are used to indicate names, and are not offered as appointing What specific sequence.
It is also known in the art that other than realizing controller in a manner of pure computer readable program code, it is complete Entirely can by by method and step carry out programming in logic come so that controller with logic gate, switch, specific integrated circuit, programmable Logic controller realizes identical function with the form for being embedded in microcontroller etc..Therefore this controller is considered one kind Hardware component, and the structure that the device for realizing various functions that its inside includes can also be considered as in hardware component.Or Person even, can will be considered as realizing the device of various functions either the software module of implementation method can be hardware again Structure in component.
This specification can describe in the general context of computer-executable instructions executed by a computer, such as journey Sequence module.Generally, program module include routines performing specific tasks or implementing specific abstract data types, programs, objects, Component, data structure, class etc..This specification can also be practiced in a distributed computing environment, in these distributed computing rings In border, by executing task by the connected remote processing devices of communication network.In a distributed computing environment, program mould Block can be located in the local and remote computer storage media including storage equipment.
As seen through the above description of the embodiments, those skilled in the art can be understood that this specification It can realize by means of software and necessary general hardware platform.Based on this understanding, the technical solution of this specification Substantially the part that contributes to existing technology can be embodied in the form of software products in other words, the computer software Product can store in storage medium, such as ROM/RAM, magnetic disk, CD, including some instructions are used so that a computer Equipment (can be personal computer, mobile terminal, server or the network equipment etc.) execute each embodiment of this specification or Method described in certain parts of person's embodiment.
Each embodiment in this specification is described in a progressive manner, the same or similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.This specification can be used for In numerous general or special purpose computing system environments or configuration.Such as: personal computer, server computer, handheld device Or portable device, laptop device, multicomputer system, microprocessor-based system, set top box, programmable electronics set Standby, network PC, minicomputer, mainframe computer, distributed computing environment including any of the above system or equipment etc..
Although depicting this specification by embodiment, it will be appreciated by the skilled addressee that there are many become for this specification Shape and the spirit changed without departing from this specification, it is desirable to which the attached claims include these deformations and change without departing from this The spirit of specification.

Claims (16)

1. a kind of determination method of data processing method, comprising:
Obtain target data and system operational parameters to be processed;
According to preset decision Matching Model, determine to establish rules really then with the matched processing mode of the system operational parameters, Wherein, the processing mode is established rules then really for determining to described in conjunction with the target data and the system operational parameters The data processing method of target data.
2. according to the method described in claim 1, being determined and the system operational parameters according to preset decision Matching Model Matched processing mode is established rules then really, comprising:
By decision-making management link, the preset decision Matching Model is called, to determine and the system operational parameters The processing mode matched is established rules then really, wherein the processing mode is established rules really then includes at least index parameter and decision rule;
Correspondingly, being determined and the matched processing mode of the system operational parameters according to preset decision Matching Model After determining rule, the method also includes:
By data processing link, according to the processing mode establish rules really then, the target data, the system operation ginseng Number, determines target processing mode, as the data processing method to the target data;
By the data processing link, according to the target processing mode, data processing is carried out to the target data;
Wherein, the decision-making management link is independently of the data processing link.
3. according to the method described in claim 2, according to the processing mode establish rules really then, the target data, the system System operating parameter, determines target processing mode, comprising:
According to the target data, the determining and matched multiple preset data processing methods of the target data;
Compare the system operational parameters and the index parameter, obtains comparison result;
According to the decision rule, determined from the multiple preset data processing method matched with the comparison result Preset data processing method is as the target processing mode.
4. according to the method described in claim 1, the preset decision Matching Model is established in the following way:
The historical data of the data processing of acquisition system, wherein the historical data of the data processing includes at least: data processing Used processing mode is established rules really, the operating parameter of data processing, data processing obtain result data, data processing Feedback information;
It is trained using the historical data of the data processing, establishes the preset decision Matching Model.
5. according to the method described in claim 1, the system operational parameters include at least one of: memory usage, hard The health index of disk residual capacity, the read or write speed of I/O interface, system environments.
6. a kind of data processing method, comprising:
Obtain target data and system operational parameters to be processed;
According to preset decision Matching Model, determine to establish rules really then with the matched processing mode of the system operational parameters;
According to the processing mode establish rules really then, the target data, the system operational parameters, determine target processing side Formula, as the data processing method to the target data;
According to the target processing mode, data processing is carried out to the target data.
7. according to the method described in claim 6, being determined and the system operational parameters according to preset decision Matching Model Matched processing mode is established rules then really, comprising:
The preset decision Matching Model is called by decision-making management link, to determine to match with the system operational parameters Processing mode establish rules really then, wherein the processing mode establish rules really then include at least index parameter and decision rule;
Correspondingly, according to the processing mode establish rules really then, the target data, the system operational parameters, determine mesh Processing mode is marked, as the data processing method to the target data;According to the target processing mode, to the number of targets According to progress data processing, comprising:
By data processing link according to the processing mode establish rules really then, the target data, the system operational parameters, Target processing mode is determined, as the data processing method to the target data;And pass through the data processing link root According to the target processing mode, data processing is carried out to the target data.
8. according to the method described in claim 6, the preset decision Matching Model is established in the following way:
The historical data of the data processing of acquisition system, wherein the historical data of the data processing includes at least: data processing Used processing mode is established rules really, the operating parameter of data processing, data processing obtain result data, data processing Feedback information;
It is trained using the historical data of the data processing, establishes the preset decision Matching Model.
9. a kind of determining device of data processing method, comprising:
Module is obtained, for obtaining target data and system operational parameters to be processed;
Decision-making management module, for determining and the matched place of the system operational parameters according to preset decision Matching Model Reason mode is established rules then really, and the processing mode is established rules really, is sent to the decision-making module, wherein the processing side Formula is established rules really then includes at least index parameter and decision rule;
Decision-making module, for according to the processing mode establish rules really then, the target data, the system operational parameters, really Target processing mode is made, as the data processing method to the target data.
10. device according to claim 9, described device further includes processing module, for according to the target processing side Formula carries out data processing to the target data, wherein the decision-making module is connected with the processing module, is set to data It handles in link;The decision-making management module is set in decision-making management link, and the decision-making management link is independently of the number According to processing link.
11. device according to claim 9, the decision-making module include;
First determination unit, for according to the target data, the determining and matched multiple preset data of the target data Processing mode;
Comparing unit is used for the system operational parameters and the index parameter, obtains comparison result;
Second determination unit, for according to the decision rule, determined from the multiple preset data processing method with The matched preset data processing method of comparison result is as the target processing mode.
12. device according to claim 9, described device also further includes establishing module, for establishing preset decision With model.
13. device according to claim 12, the module of establishing include:
Acquiring unit, the historical data of the data processing for obtaining system, wherein the historical data of the data processing is at least Include: that processing mode used in data processing is established rules really, the obtained result of the operating parameter of data processing, data processing Data, data processing feedback information;
Training unit establishes the preset decision matching mould for being trained using the historical data of the data processing Type.
14. device according to claim 9, the system operational parameters include at least one of: memory usage, hard The health index of disk residual capacity, the read or write speed of I/O interface, system environments.
15. a kind of server, including processor and for the memory of storage processor executable instruction, the processor is held The step of any one of claims 1 to 5 the method is realized when row described instruction.
16. a kind of computer readable storage medium is stored thereon with computer instruction, described instruction, which is performed, realizes that right is wanted The step of seeking any one of 1 to 5 the method.
CN201811014471.2A 2018-08-31 2018-08-31 Data processing mode determining method and device, server and data processing method Active CN109376981B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811014471.2A CN109376981B (en) 2018-08-31 2018-08-31 Data processing mode determining method and device, server and data processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811014471.2A CN109376981B (en) 2018-08-31 2018-08-31 Data processing mode determining method and device, server and data processing method

Publications (2)

Publication Number Publication Date
CN109376981A true CN109376981A (en) 2019-02-22
CN109376981B CN109376981B (en) 2022-09-02

Family

ID=65404169

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811014471.2A Active CN109376981B (en) 2018-08-31 2018-08-31 Data processing mode determining method and device, server and data processing method

Country Status (1)

Country Link
CN (1) CN109376981B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111240938A (en) * 2020-01-10 2020-06-05 深圳市五联云科技有限公司 Data congestion processing method and device based on face-brushing payment
CN112015838A (en) * 2020-08-28 2020-12-01 苏州智加科技有限公司 Road test data processing method and system and server
CN113077277A (en) * 2020-01-06 2021-07-06 北京京邦达贸易有限公司 Information processing apparatus and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106970837A (en) * 2017-03-29 2017-07-21 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN107122369A (en) * 2016-02-25 2017-09-01 阿里巴巴集团控股有限公司 A kind of business data processing method, device and system
CN108173698A (en) * 2018-01-17 2018-06-15 阿里巴巴集团控股有限公司 Network service management method, apparatus, server and storage medium
CN108287708A (en) * 2017-12-22 2018-07-17 深圳市云智融科技有限公司 A kind of data processing method, device, server and computer readable storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107122369A (en) * 2016-02-25 2017-09-01 阿里巴巴集团控股有限公司 A kind of business data processing method, device and system
CN106970837A (en) * 2017-03-29 2017-07-21 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN108287708A (en) * 2017-12-22 2018-07-17 深圳市云智融科技有限公司 A kind of data processing method, device, server and computer readable storage medium
CN108173698A (en) * 2018-01-17 2018-06-15 阿里巴巴集团控股有限公司 Network service management method, apparatus, server and storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113077277A (en) * 2020-01-06 2021-07-06 北京京邦达贸易有限公司 Information processing apparatus and method
CN111240938A (en) * 2020-01-10 2020-06-05 深圳市五联云科技有限公司 Data congestion processing method and device based on face-brushing payment
CN112015838A (en) * 2020-08-28 2020-12-01 苏州智加科技有限公司 Road test data processing method and system and server
CN112015838B (en) * 2020-08-28 2022-09-09 苏州智加科技有限公司 Road test data processing method and system and server

Also Published As

Publication number Publication date
CN109376981B (en) 2022-09-02

Similar Documents

Publication Publication Date Title
CN107196900A (en) A kind of method and device for verification of knowing together
CN109376981A (en) Determination method, apparatus, server and the data processing method of data processing method
CN110222880A (en) Determination method, model training method and the data processing method of business risk
CN108924198A (en) A kind of data dispatching method based on edge calculations, apparatus and system
CN109447276B (en) Machine learning system, equipment and application method
CN110399533A (en) Funds flow querying method and device
CN108062243A (en) Generation method, task executing method and the device of executive plan
CN107918558A (en) Business Process Control method, apparatus and equipment based on state machine
CN108536846A (en) Air control engine variable library rule adaptation method, device, equipment and storage medium
CN110163739A (en) Pay complaint method, device, server and readable storage medium storing program for executing
CN111768096A (en) Rating method and device based on algorithm model, electronic equipment and storage medium
CN106156170B (en) The analysis of public opinion method and device
CN110458572A (en) The determination method of consumer's risk and the method for building up of target risk identification model
CN111159420B (en) Entity optimization method based on attribute calculation and knowledge template
CN109951430A (en) A kind of data processing method and device
CN107332870A (en) A kind of intelligent cloud service selection system of Users ' Need-oriented and its system of selection
CN106897282A (en) The sorting technique and equipment of a kind of customer group
CN110457704A (en) Determination method, apparatus, storage medium and the electronic device of aiming field
CN107871055A (en) A kind of data analysing method and device
CN107133205A (en) A kind of cloud form component implementation method and device based on data, services
CN109067744A (en) Acl rule processing method, device and communication equipment
CN110162769A (en) Text subject output method and device, storage medium and electronic device
CN110532267A (en) Determination method, apparatus, storage medium and the electronic device of field
CN107577530A (en) Board, the method and system of balanced board memory usage
CN109461081A (en) Credits capitalized method and device, storage medium, electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20200925

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Innovative advanced technology Co.,Ltd.

Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant before: Advanced innovation technology Co.,Ltd.

Effective date of registration: 20200925

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Advanced innovation technology Co.,Ltd.

Address before: Greater Cayman, British Cayman Islands

Applicant before: Alibaba Group Holding Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant