CN110175084A - The monitoring method and device of data variation - Google Patents

The monitoring method and device of data variation Download PDF

Info

Publication number
CN110175084A
CN110175084A CN201910271980.1A CN201910271980A CN110175084A CN 110175084 A CN110175084 A CN 110175084A CN 201910271980 A CN201910271980 A CN 201910271980A CN 110175084 A CN110175084 A CN 110175084A
Authority
CN
China
Prior art keywords
data
business datum
service node
detected rule
field
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910271980.1A
Other languages
Chinese (zh)
Other versions
CN110175084B (en
Inventor
刘晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201910271980.1A priority Critical patent/CN110175084B/en
Publication of CN110175084A publication Critical patent/CN110175084A/en
Application granted granted Critical
Publication of CN110175084B publication Critical patent/CN110175084B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0751Error or fault detection not based on redundancy
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0793Remedial or corrective actions

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Telephonic Communication Services (AREA)

Abstract

This specification embodiment provides the monitoring method and device of a kind of data variation, this method comprises: obtaining the first service node generated business datum in processing business;Whether detection business datum meets predetermined historical data feature detected rule;Wherein, historical data feature detected rule is determined based on history service data caused by the first service node;If testing result instruction business datum does not meet historical data feature detected rule, prompt information is sent to the second service node;Wherein, the data characteristics that prompt information is used to indicate business datum caused by the first service node changes;Second service node is the downstream node of the first service node.

Description

The monitoring method and device of data variation
Technical field
This application involves technical field of data processing more particularly to the monitoring methods and device of a kind of data variation.
Background technique
With the fast development of internet and information technology, more and more business need to be done by operation system Reason, for example, online transaction business, transferred account service, payment transaction etc..In general, being needed in operation system when carrying out business processing Will multiple service nodes collaboration in the operation system carry out the processing of this business.
And with the continuous extension of business scale, some service node may adjust the data contents such as business model It is whole, for example, certain parameters etc. of Added Business mode or a certain business of adjustment, but the downstream traffic section of the service node Point can not know that the alteration of upstream node is handled when carrying out business processing still according to original business model, So as to cause business processing failure.
Therefore, traffic failure situation caused by how being monitored, being reduced thus to the business model etc. of each service node Generation become current urgent need to resolve the technical issues of.
Summary of the invention
The purpose of this specification embodiment is to provide the monitoring method and device of a kind of data variation, by detecting the first industry Whether business node generated business datum in processing business meets predetermined historical data feature detected rule, to supervise Whether the business datum feature for surveying the first service node changes, and may determine that the business model of the first service node accordingly Whether adjusted, and when the business datum feature for monitoring the first service node changes, notifies second in time Service node, wherein the second service node is the downstream node of the first service node.The side provided by this specification embodiment Method realizes the monitoring of the business model to upstream business node, so that downstream traffic node timely learning upstream The situation of change of service node, to make corresponding adjustment in time, thus the generation for the case where reducing business processing failure.
In order to solve the above technical problems, this specification embodiment is achieved in that
This specification embodiment provides a kind of monitoring method of data variation, comprising:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the history Data characteristics detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second business Node sends prompt information;Wherein, the prompt information is used to indicate business datum caused by first service node Data characteristics changes;Second service node is the downstream node of first service node.
This specification embodiment additionally provides a kind of monitoring device of data variation, and described device includes:
First obtains module, for obtaining the first service node generated business datum in processing business;
Detection module, for detecting whether the business datum meets predetermined historical data feature detected rule; Wherein, the historical data feature detected rule is determined based on history service data caused by first service node;
Sending module, if indicating that the business datum does not meet the historical data feature detection rule for testing result Then, then prompt information is sent to the second service node;Wherein, the prompt information is used to indicate first service node and is produced The data characteristics of raw business datum changes;Second service node is the downstream node of first service node.
This specification embodiment additionally provides a kind of monitoring device of data variation, comprising:
Processor;And
It is arranged to the memory of storage computer executable instructions, the executable instruction makes the place when executed Manage device:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the history Data characteristics detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second business Node sends prompt information;Wherein, the prompt information is used to indicate business datum caused by first service node Data characteristics changes;Second service node is the downstream node of first service node.
This specification embodiment additionally provides a kind of storage medium, described to hold for storing computer executable instructions Following below scheme is realized in row instruction when executed:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the history Data characteristics detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second business Node sends prompt information;Wherein, the prompt information is used to indicate business datum caused by first service node Data characteristics changes;Second service node is the downstream node of first service node.
Technical solution in the present embodiment, by detecting the first service node generated business datum in processing business Whether predetermined historical data feature detected rule is met, to monitor whether the business datum feature of the first service node is sent out Changing may determine that whether the business model of the first service node is adjusted accordingly, and monitor the first industry When the business datum feature of business node changes, the second service node is notified in time, wherein the second service node is the first industry The downstream node of business node.The method provided by this specification embodiment realizes the business model to upstream business node Monitoring so that the situation of change of downstream traffic node timely learning upstream business node, to make phase in time The adjustment answered, thus the generation for the case where reducing business processing failure.
Detailed description of the invention
In order to illustrate more clearly of this specification embodiment or technical solution in the prior art, below will to embodiment or Attached drawing needed to be used in the description of the prior art is briefly described, it should be apparent that, the accompanying drawings in the following description is only Some embodiments as described in this application, for those of ordinary skill in the art, in the premise not made the creative labor Under, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is one of the method flow diagram of monitoring method of data variation that this specification embodiment provides;
Fig. 2 is the two of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides;
Fig. 3 is to determine historical data feature detection rule in the monitoring method for the data variation that this specification embodiment provides Method flow diagram then;
Fig. 4 is to determine the process of historical data feature in the monitoring method for the data variation that this specification embodiment provides Schematic diagram;
Fig. 5 is the three of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides;
Fig. 6 is the four of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides;
Fig. 7 is the module composition schematic diagram of the monitoring device for the data variation that this specification embodiment provides;
Fig. 8 is the structural schematic diagram of the monitoring device for the data variation that this specification embodiment provides.
Specific embodiment
In order to make those skilled in the art better understand the technical solutions in the application, below in conjunction with this specification Attached drawing in embodiment is clearly and completely described the technical solution in this specification embodiment, it is clear that described Embodiment is merely a part but not all of the embodiments of the present application.Based on the embodiment in the application, this field Those of ordinary skill's every other embodiment obtained without creative efforts, all should belong to the application The range of protection.
The monitoring method for the data variation that this specification embodiment provides, by detection upstream business node in processing business When generated business datum data characteristics whether change, realize that the business model of detection upstream business node is with this It is no to adjust, in this way, allow downstream traffic node obtain in time upstream business node business model adjustment situation, And then corresponding adjustment is made, thus the generation for the case where reducing business processing failure.
The monitoring method for the data variation that this specification embodiment provides is applied to the monitoring device of data variation, the data The monitoring device of variation is that can be used as within the operation system independently of the equipment except service node each in operation system One device node, or except equipment, this specification embodiment is defined not to this.
The executing subject of the monitoring method for the data variation that this specification embodiment provides is the monitoring of above-mentioned data variation Equipment, specifically, to be installed on the monitoring device of the data variation on the equipment.
Fig. 1 is one of the method flow diagram of monitoring method of data variation that this specification embodiment provides, shown in FIG. 1 Method includes at least following steps:
Step 102, the first service node generated business datum in processing business is obtained.
Wherein, above-mentioned business can be any type of business handled by operation system, for example, transferred account service, supplementing with money Business, payment class business etc..Above-mentioned business datum may include total data relevant to this business, such as may include the industry The type of service of business, the service condition of the business, business side, service order number etc..
For example, above-mentioned business is transferred account service, then the business datum may include: type of service, two parties of transferring accounts The information such as identification information, transfer amounts, order number, time of transferring accounts, mode of transferring accounts.
Specifically, the first service node generated business datum in processing business is obtained in above-mentioned steps 102, Including at least the following two kinds situation:
The first, when the first service node handles the business, generated business datum is obtained from the first service node.
In such a case, it is possible to be whenever the first service node generates a business datum, the then monitoring of data variation Device then obtains this business datum from the first service node.
The second, business datum is obtained from database;Wherein, the first service node is stored in database in processing business When generated business datum.
In that case, the first business datum stores generated business datum to database in processing business In, the monitoring device of data variation then obtains business datum corresponding to the first service node from database.Specifically, The device of data variation can obtain business datum according to the setting period from database.
Wherein, above-mentioned database can be mysql database, Hbase database, OceanBase database etc..
Step 104, detect whether above-mentioned business datum meets predetermined historical data feature detected rule;Wherein, Historical data feature detected rule is determined based on history service data caused by the first service node.
It, can be according to the first service node stored in database before executing the method that this specification embodiment provides The history service data of generation determine historical data feature detected rule corresponding to the first service node.Generally for an industry Be engaged in data for comprising can enumeration type field and can not enumeration type field.It is so-called can enumeration type field then Refer to that data value corresponding to field is finite sequence, i.e., data value, which can be enumerated all, comes.For example, number corresponding to week It include Monday, Tuesday, Wednesday, Thursday, Friday, Saturday and Sunday according to value, which is finite ordered series of numbers, Therefore, week data can enumeration type;If further for example, above-mentioned field be service condition, general business state include successfully with Failure two kinds, data finite sequence, therefore, service condition belong to can enumeration type field.
Correspondingly, can not the field of enumeration type then refer to that data value corresponding to field is infinite sequence, i.e. data Value, which can not be enumerated all, to be come.For example, being directed to this field of order number, each business all corresponds to an order number, as long as business System can not just enumerate all order numbers, therefore, order number, which belongs to, can not enumerate class in the processing for constantly carrying out business The field of type.
In this specification embodiment, above-mentioned historical data feature detected rule be generally basede in history service data can piece Lift data value corresponding to the field of type and can not data value corresponding to the field of enumeration type characterization information institute Combination determination.Even above-mentioned historical data include can enumeration type field and can not enumeration type field;Then go through for every History data characteristics detected rule respectively as it is each can historical data values corresponding to the field of enumeration type and it is each can not piece The historical data characterization information for lifting data corresponding to the field of type is composed.
For ease of understanding, following to be illustrated citing.
For example, in a specific embodiment, above-mentioned historical data feature detected rule can be expressed as shown below:
Type of service: it transfers accounts;Service condition: success;Order information: 12 bit digital of order length.Of course, it is possible to according to going through History business datum predefines a plurality of historical data feature detected rule, herein only with a wherein historical data feature detection It is illustrated for rule, does not constitute the restriction to this specification embodiment.
Specifically, then needing to detect in the business datum after getting business datum caused by the first service node Whether characteristic information corresponding to each field meets above-mentioned historical data feature detected rule.
Step 106, if testing result indicates that above-mentioned business datum does not meet historical data feature detected rule, to second Service node sends prompt information;Wherein, which is used to indicate the number of business datum caused by the first service node It changes according to feature;Second service node is the downstream node of the first service node.
In this specification embodiment, if testing result indicates that above-mentioned business datum meets historical data feature detection rule Then, then it is assumed that compared with history service data, the data characteristics of business datum caused by the first service node does not change, I.e. the developer of the first service node, which is not adjusted the business model of the first service node, (such as increases new business model Deng), at this moment terminate process;If testing result indicates that above-mentioned business datum does not meet historical data feature detected rule, then recognize Data characteristics for business datum caused by the first service node changes, i.e. the business model of the first service node occurs Adjustment, at this moment, the downstream node for the ease of the first service node is in time adjusted correspondingly business model, to protect The normal processing of card business then needs to send prompt information to the second service node (downstream node of the first service node).
In the specific implementation, above-mentioned prompt information can in a manner of mail, in the way of short message, third party's instant messaging The modes such as information are sent to the developer of the second service node.Specifically, needing to carry the first business in the prompt information The data content of changing features occurs for node, so that the staff of the second service node can be in time according to the first service node Current business model makes corresponding adjustment to the second service node, and then guarantees the normal processing of operation system business.
The monitoring method for the data variation that this specification embodiment provides, by produced by the first service processing node of detection Business datum whether be consistent with predetermined historical data feature detected rule, may thereby determine that out the first business section Whether the data characteristics of business datum caused by point changes, and then the data of the business datum by the first service node The variation of feature may determine that whether the business model of the first service node is adjusted, in this way, determining the first industry When the business model of business node adjusts, the downstream node (the second service node) of the first service node can be notified in time, So that the developer of the second service node is in time adjusted correspondingly the second service node, to guarantee operation system industry The normal processing of business.
In the specific implementation, in above-mentioned steps 104, whether detection business datum meets predetermined historical data feature Detected rule specifically includes:
Determine the data characteristics of data value corresponding to each field in the business datum;It respectively will be corresponding to business datum Data characteristics is matched with each historical data feature detected rule, to determine whether the business datum meets historical data spy Levy detected rule.
In the specific implementation, when determining data characteristics corresponding to the business datum, the business datum can be first determined In can enumeration type field and can not enumeration type field.For can enumeration type field, then directly by the field Corresponding data value as data characteristics corresponding to the field, for example, be directed to " service condition " this field, belong to can piece The field of type is lifted, if data value corresponding to " service condition " is " success " in the business datum, then by service condition institute Corresponding data characteristics is determined as " succeeding ".For in the business datum can not enumeration type field, then by the field institute it is right The data feature description information for the data value answered is determined as the data characteristics corresponding to it.For example, being directed to " order number " this word Section, belong to can not enumeration type field, if " order number " in the business datum be " 12787565 ", then can will " grow Degree is 8 bit digitals " as data characteristics corresponding to " order number " this field.Of course, it is possible to which it is right to preset each field institute The data feature description information answered determines rule, for example, the data feature description information determines that rule can be indicated using the word The length information of data value corresponding to section is as its corresponding data feature description information etc..
In determining above-mentioned business datum after data characteristics corresponding to each field, then respectively and in advance by the data characteristics Each historical data feature detected rule first determined is matched, if there are certain historical data feature detected rule and being somebody's turn to do Data characteristics corresponding to business datum matches, then it is assumed that above-mentioned business datum meets historical data feature detected rule, i.e., Compared with history service data, the data characteristics of the business datum does not change.
For ease of understanding, following to be illustrated citing.
For example, in a specific embodiment, data characteristics corresponding to business datum are as follows:
Type of service: it transfers accounts;Service condition: success;Order number: ten digits;
Predetermined historical data feature detected rule includes following three rule:
Regular 1, type of service: it transfers accounts;Service condition: failure;Order number: it is made of ten digits;
Regular 2, type of service: it supplements with money;Service condition: success;Order number: it is made of 12 bit digitals;
Regular 3, type of service: it transfers accounts;Service condition: success;Order number: it is made of 12 bit digitals;
Data characteristics corresponding to above-mentioned business datum 3 is matched with rule 1, rule 2, rule respectively, by With discovery, which mismatches with rule 1, rule 2 and rule 3, it is therefore contemplated that with history service data phase Than the data characteristics of the business datum is changed, i.e., the developer of the first service node carries out the business model Adjustment, at this moment makes corresponding adjustment to the business in time for the ease of the developer of the second service node, then needs to the Two service nodes send prompt information.
Specifically, in this specification embodiment, if detecting the number of business datum caused by the first service node It changes according to feature, other than issuing prompt information to the second service node, it is also necessary to determine the number for being directed to the business datum According to feature detected rule, as historical data feature detected rule, in this way, when next first service node generates same data again When the business datum of feature, the data due to being directed to the data characteristics before have sent prompt letter to the second service node Breath will not then prompt as the second service node issues again in this way, avoid follow-up prompts, cause to increase the exploitation of the second service node The workload of personnel.Therefore, if testing result indicates that above-mentioned business datum does not meet historical data feature detected rule, this explanation The method that book embodiment provides further includes following steps:
Determine data characteristics detected rule corresponding to above-mentioned business datum;Above-mentioned data characteristics detected rule is added to In historical data feature detected rule set;It wherein, include that each historical data is special in the historical data feature detected rule set Levy detected rule.
In this specification embodiment, can the characteristic values of the data according to corresponding to field each in business datum determine business Data characteristics detected rule corresponding to data.In a specific embodiment, if above-mentioned business datum includes that can enumerate class The field of type and can not enumeration type field;
Correspondingly, data characteristics detected rule corresponding to above-mentioned determining business datum, specifically includes:
Determine in above-mentioned business datum can data value corresponding to the field of enumeration type, and, determine above-mentioned business number It can not data feature description information corresponding to the field of enumeration type in;By above-mentioned data value and data characterization information It is combined, obtains data characteristics detected rule corresponding to the business datum.
In this specification embodiment, when determining data characteristics detected rule corresponding to business datum, it is first determined should In business datum can enumeration type field and can not enumeration type field, then, for can not enumeration type field It needs to determine that rule determines data characteristics corresponding to the field according to pre-set data feature description information.For example, number Determine that rule instruction needs to describe its data characteristics from the composition length of the field according to characterization information, then it is field institute is right The length information answered is determined as data feature description information corresponding to the field;Finally, then by can enumeration type field Data value and can not the data feature description information of field of enumeration type combine, as corresponding to the business datum Data characteristics detected rule.
In addition, it should be noted that in this specification embodiment, business caused by the first acquired service node Data can directly be the business datum of key-value form, wherein what key was indicated is each field in business datum, Value expression is data value corresponding to each field, in this case, then can be obtained directly from business datum each Data value corresponding to field.In some cases, acquired business datum may not be the number of key-value form According at this moment, it is necessary first to be formatted to business datum, obtain the business datum of key-value form, determine again later Data value corresponding to each field.
Certainly, in the specific implementation, if the business datum got is not the business datum of key-value form, Numerical value corresponding to each field and each field can also be directly extracted from data.In this specification embodiment, as long as final It is available process not to be implemented to it to field and its corresponding data value, this specification embodiment and limited It is fixed.
For ease of understanding, following detailed processes that citing is illustrated to above-mentioned determining data characteristics detected rule.
For example, an acquired business datum are as follows:
Type of service Service condition Transfer amounts Order number
It transfers accounts Success 100.00 first 1267996413
Field corresponding to the business datum includes: " type of service ", " service condition ", " transfer amounts " and " order Number "." type of service " and " service condition " in these fields belong to can enumeration type field, " transfer amounts " and " order Number " then belong to can not enumeration type field.Therefore, when determining data characteristics detected rule, " service class can directly be used The data value of type " and " service condition " is as data characteristics, for " transfer amounts " and " order number ", then it needs to be determined that its institute is right The data feature description information answered can will then have two to be used as its corresponding for " transfer amounts " behind decimal point Data characteristics data specifying-information, for " order number ", then it is right as its to constitute the number for being 10 by length The data feature description information answered later combines data characteristics corresponding to each field, to obtain the business number According to corresponding data characteristics detected rule.
Therefore, for the business datum, corresponding data characteristics detected rule are as follows:
Type of service: it transfers accounts;Service condition: success;The amount of money: two-decimal behind decimal point;Order number: ten digits.
Fig. 2 is the two of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides, shown in Fig. 2 Method includes at least following steps:
Step 202, the first service node generated business datum in processing business is obtained.
Step 204, detecting above-mentioned business datum is and going through in predetermined historical data feature detected rule set History data characteristics detected rule is consistent;If so, terminating;Otherwise, step 206 is executed.
Step 206, prompt information is sent to the second service node.
Step 208, determine in the business datum can data value corresponding to the field of enumeration type, and, determine the industry It can not data feature description information corresponding to the field of enumeration type in data of being engaged in.
Step 210, above-mentioned data value and data characterization information are combined, are obtained corresponding to the business datum Data characteristics detected rule.
Step 212, historical data spy is added to using the data characteristics detected rule as historical data feature detected rule It levies in detected rule set.
In addition, in this specification embodiment, for the ease of realizing business datum caused by the first service node of detection Whether meet predetermined historical data feature detected rule, then needs the business datum according to caused by the first service node It determines the historical data feature detected rule, therefore, is obtaining the first service node business datum caused by processing business Before, the method that this specification embodiment provides further includes following steps one and step 2;
Step 1: obtaining history service data corresponding to the first service node;
Step 2: determining historical data feature detected rule based on above-mentioned history service data.
In the specific implementation, history service number all caused by the first service node can be obtained from database According to.Specifically, acquired history service data can be and start to process business from the first service node and up to the present accumulate Tired all history service data.
In this specification embodiment, in above-mentioned steps two, historical data feature is determined based on above-mentioned history service data Detected rule specifically comprises the following steps (1), step (2) and step (3);
Step (1) formats above-mentioned history service data, obtains the history service number of key-value form According to;Wherein, key characterizes field, and value characterizes data value corresponding to above-mentioned field;
Step (2), the data value according to corresponding to each field, determine data characteristics corresponding to each field;
Step (3) determines historical data feature detected rule based on data characteristics corresponding to each field.
In a specific embodiment, it can be obtained by the feature factory in the monitoring device of data variation from messaging bus Take history service data all caused by the first service node.It wherein, is data connection object from messaging bus acquisition (Data Transfer Object, DTO), for the ease of determining historical data feature detected rule, in this specification embodiment In, need for acquired DTO to be converted into the business datum of key-value form, wherein key characterization is in business datum Each field, such as " type of service ", " service condition ", " the business amount of money ", " business side " field, and value characterization is then For data value corresponding to each field.
In general, accessed business datum includes multiple fields, when being converted into the data of key-value format, Key value and value value are converted by each field is corresponding.But in practical applications, certain words are often appeared in It the case where section the inside nesting multiple extended fields, in response to this, then needs all to turn each field inside extended field Change corresponding key-value form into, it is following for ease of understanding to be illustrated citing.
For example, in a specific embodiment, accessed history service data are as follows:
In above-mentioned business datum, the case where " extension information " this column then belong to nested field, turn by the column data When changing key-value form into, then need nested each field being converted into corresponding key-value form.
Above-mentioned business datum is converted into key-value format, the history service data after conversion are as shown in the table:
key value
Order number 1231231
Total value 123
State Success
Type It supplements with money
Extend information: requestee's mark 12312312
Extend information: operating system Android
Extend information: extension information: aa xxx
Extend information: extension information: bb [0] 111
Extend information: extension information: bb [1] 222
Extend information: extension information: bb [2] 333
It should be noted that the field of above-mentioned nesting may include two class data, Yi Leiwei in this specification embodiment Single-row data acquisition system (List), one kind is biserial data acquisition system (Map), such as " requestee's mark ": belonging to if " 12312312 " List, " bb ": [" 111 ", " 222 ", " 333 "] then belong to Map, the key- that List class field nested with Map class is converted into Value form is as shown above.
Certainly, only exemplary illustration herein, does not constitute the restriction to this specification embodiment.
Specifically, according to data value corresponding to each field, determining number corresponding to each field in above-mentioned steps (2) According to feature, specifically include:
If above-mentioned field be can enumeration type field, by data value corresponding to the field be determined as the field institute it is right The data characteristics answered;If the field be can not enumeration type field, which is determined according to data value corresponding to each field Data feature description information corresponding to section, data feature description information corresponding to the field is determined as corresponding to the field Data characteristics.
In the specific implementation, it can be used in data variation monitoring device and enumerate generator, determine history service number In can enumeration type field and can not enumeration type field, and by above-mentioned business datum can enumeration type word Section and its corresponding data value data value can not distinguish corresponding to the field of enumeration type.
Need to illustrate when, for can enumeration type field and can not enumeration type field, be situated between aforementioned It continues and how to determine its corresponding characteristic information, specifically refer to the description of front, details are not described herein again.
In above-mentioned steps (3), historical data feature detected rule is determined based on data characteristics corresponding to each field, specifically Include:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combination knot is obtained Fruit;Every data feature combined result is determined as a historical data feature detected rule respectively.
Technical solution herein for ease of understanding, it is following to be illustrated citing.
For example, accessed history service data are three, it is denoted as history service data 1, history service data 2 respectively With history service data 3, data characteristics corresponding to field each in history service data 1 is combined, data characteristics is obtained Data characteristics corresponding to field each in history service data 2 is combined by combined result 1, obtains data characteristics combination knot Data characteristics corresponding to field each in history service data 3 is combined by fruit 2, data characteristics combination 3 is obtained, in basis When data characteristics combined result determines historical data feature detected rule, then data characteristics combined result 1 is determined as one and gone through Data characteristics combined result 2 is determined as a historical data feature detected rule by history data characteristics detected rule, by data spy Sign combined result 3 is determined as a historical data feature detected rule.
Wherein, a history service data can be understood as the first service node and handle business number caused by a business According to.
Certainly, in the specific implementation, there may be historical data feature detected rule determined by a plurality of business datum Identical situation then needs to reject wherein duplicate historical data feature detected rule in this case.
Fig. 3 is to determine historical data feature detection rule in the monitoring method for the data variation that this specification embodiment provides Method flow diagram then, method shown in Fig. 3 include at least following steps:
Step 302, all history service data corresponding to the first service processing node are obtained.
Step 304, above-mentioned history service data are formatted, obtains the history service number of key-value form According to.
Wherein, in this specification embodiment, key characterizes each field in business datum, and it is right that value characterizes each field institute The data value answered.
Step 306, determine in history service data can enumeration type field and can not enumeration type field.
Step 308, for can enumeration type field, data value corresponding to the field is determined as corresponding to the field Data characteristics, for can not enumeration type field, which is determined according to data value corresponding to the field corresponding to Data feature description information, and data feature description corresponding to the field is determined as data characteristics corresponding to the field.
Step 310, data characteristics corresponding to each field in every history service data is combined, obtains data spy Levy combined result.
Step 312, every data feature combined result is determined as a historical data feature detected rule.
Corresponding to method flow diagram shown in Fig. 3, Fig. 4 shows the monitoring of the data variation of this specification embodiment offer In method, the flow diagram of historical data feature detected rule is determined.
For flow diagram shown in Fig. 4, feature factory is obtained from messaging bus caused by the first service node History service data, and by the history service data conversion at the business datum of key-value format, then, by enumerating life Grow up to be a useful person determine in the business datum can enumeration type field and can not enumeration type field, determination can enumeration type word Section characteristic value and can not enumeration type field characteristic value characterization information, by can enumeration type field feature Value and can not the characterization information of field of enumeration type combine, obtain historical data feature detected rule.
The method that this specification embodiment provides, the generated business number when obtaining the first service node in processing business According to when, directly can obtain corresponding business datum from the first service node, corresponding business number can also be obtained from database According to following specific embodiments that will introduce above-mentioned two situations respectively.
Fig. 5 is the three of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides, shown in fig. 5 Method includes at least following steps:
Step 502, the first service node generated business datum in processing business is obtained from the first service node.
Step 504, the data characteristics of data value corresponding to each field in the service node is determined.
Step 506, detecting in predetermined each historical data feature detected rule set whether there is and above-mentioned industry The historical data feature detected rule that the data characteristics of business data matches, and if it exists, then terminate;Otherwise, step 508 is executed.
Step 508, prompt information is sent to second node, wherein the prompt information is used to indicate the first service node institute The data characteristics of the business datum of generation changes.
Step 510, data characteristics detected rule corresponding to the business datum is determined.
Step 512, historical data is added to using above-mentioned data characteristics detected rule as historical data feature detected rule In characterization rules detection set.
Fig. 6 is the four of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides, shown in fig. 6 Method includes at least following steps:
Step 602, the business datum of the first service node is obtained from database;Wherein, is stored in the database One service node generated all business datums in processing business.
It in the specific implementation, can be according to the setting period from being obtained in database in the period produced by the first service node Business datum.
Step 604, the data characteristics of data value corresponding to each field in the service node is determined.
Step 606, detecting in predetermined each historical data feature detected rule set whether there is and above-mentioned industry The historical data feature detected rule that the data characteristics of business data matches, and if it exists, then terminate;Otherwise, step 608 is executed.
Step 608, prompt information is sent to second node, wherein the prompt information is used to indicate the first service node institute The data characteristics of the business datum of generation changes.
Step 610, data characteristics detected rule corresponding to the business datum is determined.
Step 612, historical data is added to using above-mentioned data characteristics detected rule as historical data feature detected rule In characterization rules detection set.
The monitoring method for the data variation that this specification embodiment provides, by the first service node of detection in processing business When generated business datum whether meet predetermined historical data feature detected rule, to monitor the first service node Whether business datum feature changes, and may determine that whether the business model of the first service node is adjusted accordingly, And when the business datum feature for monitoring the first service node changes, the second service node is notified in time, wherein the Two service nodes are the downstream node of the first service node.The method provided by this specification embodiment, realizes to upstream The monitoring of the business model of service node, so that the variation feelings of downstream traffic node timely learning upstream business node Condition, to make corresponding adjustment in time, thus the generation for the case where reducing business processing failure.
Corresponding to the monitoring method for the data variation that this specification embodiment provides, it is based on identical thinking, this specification Embodiment additionally provides a kind of monitoring device of data variation, for executing the above method of this specification embodiment offer, Fig. 7 The module composition schematic diagram of the monitoring device of the data variation provided for this specification embodiment, device shown in Fig. 7 include:
First obtains module 702, for obtaining the first service node generated business datum in processing business;
Detection module 704, for detecting whether business datum meets predetermined historical data feature detected rule;Its In, historical data feature detected rule is determined based on history service data caused by the first service node;
Sending module 706, if not meeting historical data feature detected rule for testing result instruction business datum, to Second service node sends prompt information;Wherein, prompt information is used to indicate business datum caused by the first service node Data characteristics changes;Second service node is the downstream node of the first service node.
Optionally, if testing result indicates that above-mentioned business datum does not meet historical data feature detected rule, this explanation The device that book embodiment provides, further includes:
First determining module, for determining data characteristics detected rule corresponding to business datum;
Adding module, for data characteristics detected rule to be added in historical data feature detected rule set;Wherein, It include each historical data feature detected rule in historical data feature detected rule set.
Optionally, above-mentioned detection module, comprising:
First determination unit, for determining the data characteristics of data value corresponding to each field in business datum;
Matching unit, for respectively by data characteristics corresponding to business datum and each historical data feature detected rule It is matched, to determine whether business datum meets historical data feature detected rule.
Optionally, if above-mentioned business datum include can enumeration type field and can not enumeration type field;
Then above-mentioned determining module, comprising:
Second determination unit, for determine in business datum can data value corresponding to the field of enumeration type, and, really Determining in business datum can not data feature description information corresponding to the field of enumeration type;
Assembled unit obtains corresponding to business datum for data value and data characterization information to be combined Data characteristics detected rule.
Optionally, if above-mentioned history service data include can enumeration type field and can not enumeration type field;
Every above-mentioned historical data feature detected rule respectively as it is each can history number corresponding to the field of enumeration type According to value and each historical data characterization information can not be composed corresponding to the field of enumeration type.
Optionally, above-mentioned first module is obtained, comprising:
First acquisition unit is used in the first service node processing business, caused by the acquisition of the first service node Business datum;
Alternatively, second acquisition unit, for obtaining business datum from database;Wherein, first is stored in database Service node generated business datum in processing business.
Optionally, the device that this specification embodiment provides, further includes:
Second obtains module, for obtaining history service data corresponding to the first service node;
Second determining module, for determining historical data feature detected rule based on history service data.
Optionally, above-mentioned second determining module, comprising:
Converting unit obtains the history service number of key-value form for formatting history service data According to;Wherein, key characterizes field, and value characterizes data value corresponding to field;
Third determination unit determines data characteristics corresponding to each field for the data value according to corresponding to each field;
Determination unit, for determining historical data feature detected rule based on data characteristics corresponding to each field.
Optionally, above-mentioned 4th determination unit, is specifically used for:
If field be can enumeration type field, data value corresponding to field is determined as data corresponding to field Feature;
If field be can not enumeration type field, determined corresponding to field according to data value corresponding to the field Data feature description information corresponding to field is determined as data characteristics corresponding to field by data feature description information.
Optionally, above-mentioned determination unit, is specifically used for:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combination knot is obtained Fruit;
Every data feature combined result is determined as a historical data feature detected rule respectively.
The monitoring device of the data variation of this specification embodiment can also carry out the monitoring device of data variation in Fig. 1-Fig. 6 The method of execution, and the monitoring device of data variation is realized in Fig. 1-embodiment illustrated in fig. 6 function, details are not described herein.
The monitoring device for the data variation that this specification embodiment provides, by the first service node of detection in processing business When generated business datum whether meet predetermined historical data feature detected rule, to monitor the first service node Whether business datum feature changes, and may determine that whether the business model of the first service node is adjusted accordingly, And when the business datum feature for monitoring the first service node changes, the second service node is notified in time, wherein the Two service nodes are the downstream node of the first service node.The method provided by this specification embodiment, realizes to upstream The monitoring of the business model of service node, so that the variation feelings of downstream traffic node timely learning upstream business node Condition, to make corresponding adjustment in time, thus the generation for the case where reducing business processing failure.
Further, based on above-mentioned Fig. 1 to method shown in fig. 6, this specification embodiment additionally provides a kind of data change The monitoring device of change, as shown in Figure 8.
The monitoring device of data variation can generate bigger difference because configuration or performance are different, may include one or More than one processor 801 and memory 802 can store one or more storages in memory 802 using journey Sequence or data.Wherein, memory 802 can be of short duration storage or persistent storage.The application program for being stored in memory 802 can be with Including one or more modules (diagram is not shown), each module may include one in the monitoring device to data variation Family computer executable instruction information.Further, processor 801 can be set to communicate with memory 802, in data The series of computation machine executable instruction information in memory 802 is executed in the monitoring device of variation.The monitoring of data variation is set Standby can also include one or more power supplys 803, one or more wired or wireless network interfaces 804, one or More than one input/output interface 805, one or more keyboards 806 etc..
In a specific embodiment, the monitoring device of data variation include memory and one or one with On program, perhaps more than one program is stored in memory and one or more than one program can wrap for one of them Include one or more modules, and each module may include that series of computation machine in monitoring device to data variation can Information is executed instruction, and is configured to execute this by one or more than one processor or more than one program includes For carrying out following computer executable instructions information:
Obtain the first service node generated business datum in processing business;
Whether detection business datum meets predetermined historical data feature detected rule;Wherein, historical data feature Detected rule is determined based on history service data caused by the first service node;
If testing result instruction business datum does not meet historical data feature detected rule, sent to the second service node Prompt information;Wherein, the data characteristics that prompt information is used to indicate business datum caused by the first service node changes; Second service node is the downstream node of the first service node.
Optionally, computer executable instructions information when executed, is gone through if testing result instruction business datum is not met History data characteristics detected rule, can also be performed following steps:
Determine data characteristics detected rule corresponding to business datum;
Data characteristics detected rule is added in historical data feature detected rule set;Wherein, historical data feature It include each historical data feature detected rule in detected rule set.
Optionally, when executed, it is predetermined whether detection business datum meets computer executable instructions information Historical data feature detected rule, comprising:
Determine the data characteristics of data value corresponding to each field in business datum;
Data characteristics corresponding to business datum is matched with each historical data feature detected rule respectively, with true Determine whether business datum meets historical data feature detected rule.
Optionally, computer executable instructions information when executed, if business datum include can enumeration type field With can not enumeration type field;
Determine data characteristics detected rule corresponding to business datum, comprising:
Determine in business datum can data value corresponding to the field of enumeration type, and, determining can not in business datum Data feature description information corresponding to the field of enumeration type;
Data value and data characterization information are combined, the detection rule of data characteristics corresponding to business datum are obtained Then.
Optionally, computer executable instructions information when executed, if history service data include can enumeration type Field and can not enumeration type field;
Every historical data feature detected rule respectively as it is each can historical data values corresponding to the field of enumeration type And it each historical data characterization information can not be composed corresponding to the field of enumeration type.
Optionally, computer executable instructions information when executed, obtains the first service node in processing business when institute The business datum of generation, comprising:
In the first service node processing business, generated business datum is obtained from the first service node;
Alternatively, obtaining business datum from database;Wherein, the first service node is stored in database in processing business When generated business datum.
Optionally, computer executable instructions information when executed, obtains the first service node in processing business when institute Before the business datum of generation, method further include:
Obtain history service data corresponding to the first service node;
Historical data feature detected rule is determined based on history service data.
Optionally, computer executable instructions information when executed, determines historical data spy based on history service data Levy detected rule, comprising:
History service data are formatted, the history service data of key-value form are obtained;Wherein, key table Field is levied, value characterizes data value corresponding to field;
According to data value corresponding to each field, data characteristics corresponding to each field is determined;
Historical data feature detected rule is determined based on data characteristics corresponding to each field.
Optionally, computer executable instructions information when executed, according to data value corresponding to each field, determines each Data characteristics corresponding to field, comprising:
If field be can enumeration type field, data value corresponding to field is determined as data corresponding to field Feature;
If field be can not enumeration type field, determined corresponding to field according to data value corresponding to the field Data feature description information corresponding to field is determined as data characteristics corresponding to field by data feature description information.
Optionally, computer executable instructions information when executed, is determined based on data characteristics corresponding to each field Historical data feature detected rule, comprising:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combination knot is obtained Fruit;
Every data feature combined result is determined as a historical data feature detected rule respectively.
The monitoring device for the data variation that this specification embodiment provides, by the first service node of detection in processing business When generated business datum whether meet predetermined historical data feature detected rule, to monitor the first service node Whether business datum feature changes, and may determine that whether the business model of the first service node is adjusted accordingly, And when the business datum feature for monitoring the first service node changes, the second service node is notified in time, wherein the Two service nodes are the downstream node of the first service node.The method provided by this specification embodiment, realizes to upstream The monitoring of the business model of service node, so that the variation feelings of downstream traffic node timely learning upstream business node Condition, to make corresponding adjustment in time, thus the generation for the case where reducing business processing failure.
Further, based on above-mentioned Fig. 1 to method shown in fig. 6, this specification embodiment additionally provides a kind of storage Jie Matter, for storing computer executable instructions information, in a kind of specific embodiment, the storage medium can for USB flash disk, CD, Hard disk etc., the computer executable instructions information of storage medium storage are able to achieve following below scheme when being executed by processor:
Obtain the first service node generated business datum in processing business;
Whether detection business datum meets predetermined historical data feature detected rule;Wherein, historical data feature Detected rule is determined based on history service data caused by the first service node;
If testing result instruction business datum does not meet historical data feature detected rule, sent to the second service node Prompt information;Wherein, the data characteristics that prompt information is used to indicate business datum caused by the first service node changes; Second service node is the downstream node of the first service node.
Optionally, the computer executable instructions information of storage medium storage is when being executed by processor, if detection knot Fruit instruction business datum does not meet historical data feature detected rule, and following steps can also be performed:
Determine data characteristics detected rule corresponding to business datum;
Data characteristics detected rule is added in historical data feature detected rule set;Wherein, historical data feature It include each historical data feature detected rule in detected rule set.
Optionally, the computer executable instructions information of storage medium storage detects business when being executed by processor Whether data meet predetermined historical data feature detected rule, comprising:
Determine the data characteristics of data value corresponding to each field in business datum;
Data characteristics corresponding to business datum is matched with each historical data feature detected rule respectively, with true Determine whether business datum meets historical data feature detected rule.
Optionally, the computer executable instructions information of storage medium storage is when being executed by processor, if business number According to include can enumeration type field and can not enumeration type field;
Determine data characteristics detected rule corresponding to business datum, comprising:
Determine in business datum can data value corresponding to the field of enumeration type, and, determining can not in business datum Data feature description information corresponding to the field of enumeration type;
Data value and data characterization information are combined, the detection rule of data characteristics corresponding to business datum are obtained Then.
Optionally, the computer executable instructions information of storage medium storage is when being executed by processor, if history industry Business data include can enumeration type field and can not enumeration type field;
Every historical data feature detected rule respectively as it is each can historical data values corresponding to the field of enumeration type And it each historical data characterization information can not be composed corresponding to the field of enumeration type.
Optionally, the computer executable instructions information of storage medium storage obtains first when being executed by processor Service node generated business datum in processing business, comprising:
In the first service node processing business, generated business datum is obtained from the first service node;
Alternatively, obtaining business datum from database;Wherein, the first service node is stored in database in processing business When generated business datum.
Optionally, the computer executable instructions information of storage medium storage obtains first when being executed by processor Service node is in processing business before generated business datum, method further include:
Obtain history service data corresponding to the first service node;
Historical data feature detected rule is determined based on history service data.
Optionally, the computer executable instructions information of storage medium storage is based on history when being executed by processor Business datum determines historical data feature detected rule, comprising:
History service data are formatted, the history service data of key-value form are obtained;Wherein, key table Field is levied, value characterizes data value corresponding to field;
According to data value corresponding to each field, data characteristics corresponding to each field is determined;
Historical data feature detected rule is determined based on data characteristics corresponding to each field.
Optionally, the computer executable instructions information of storage medium storage is when being executed by processor, according to each word Data value corresponding to section, determines data characteristics corresponding to each field, comprising:
If field be can enumeration type field, data value corresponding to field is determined as data corresponding to field Feature;
If field be can not enumeration type field, determined corresponding to field according to data value corresponding to the field Data feature description information corresponding to field is determined as data characteristics corresponding to field by data feature description information.
Optionally, the computer executable instructions information of storage medium storage is based on each word when being executed by processor Data characteristics corresponding to section determines historical data feature detected rule, comprising:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combination knot is obtained Fruit;
Every data feature combined result is determined as a historical data feature detected rule respectively.
The computer executable instructions information for the storage medium storage that this specification embodiment provides is being executed by processor When, by detecting whether the first service node generated business datum in processing business meets predetermined historical data Feature detected rule may determine that first to monitor whether the business datum feature of the first service node changes accordingly Whether the business model of service node is adjusted, and is become in the business datum feature for monitoring the first service node When change, the second service node is notified in time, wherein the second service node is the downstream node of the first service node.By this theory The method that bright book embodiment provides, realizes the monitoring of the business model to upstream business node, so that downstream industry The situation of change of business node timely learning upstream business node, to make corresponding adjustment in time, to reduce business processing The generation of the case where failure.
In the 1990s, the improvement of a technology can be distinguished clearly be on hardware improvement (for example, Improvement to circuit structures such as diode, transistor, switches) or software on improvement (improvement for method flow).So And with the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit. Designer nearly all obtains corresponding hardware circuit by the way that improved method flow to be programmed into hardware circuit.Cause This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, programmable logic device (Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate Array, FPGA)) it is exactly such a integrated circuit, logic function determines device programming by user.By designer Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, designs and makes without asking chip maker Dedicated IC chip.Moreover, nowadays, substitution manually makes IC chip, this programming is also used instead mostly " is patrolled Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development, And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language (Hardware Description Language, HDL), and HDL is also not only a kind of, but there are many kind, such as ABEL (Advanced Boolean Expression Language)、AHDL(Altera Hardware Description Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL (Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware Description Language) etc., VHDL (Very-High-Speed is most generally used at present Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also answer This understands, it is only necessary to method flow slightly programming in logic and is programmed into integrated circuit with above-mentioned several hardware description languages, The hardware circuit for realizing the logical method process can be readily available.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing The computer for the computer readable program code (such as software or firmware) that device and storage can be executed by (micro-) processor can Read medium, logic gate, switch, specific integrated circuit (Application Specific Integrated Circuit, ASIC), the form of programmable logic controller (PLC) and insertion microcontroller, the example of controller includes but is not limited to following microcontroller Device: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320 are deposited Memory controller is also implemented as a part of the control logic of memory.It is also known in the art that in addition to Pure computer readable program code mode is realized other than controller, can be made completely by the way that method and step is carried out programming in logic Controller is obtained to come in fact in the form of logic gate, switch, specific integrated circuit, programmable logic controller (PLC) and insertion microcontroller etc. Existing identical function.Therefore this controller is considered a kind of hardware component, and to including for realizing various in it The device of function can also be considered as the structure in hardware component.Or even, it can will be regarded for realizing the device of various functions For either the software module of implementation method can be the structure in hardware component again.
System, device, module or the unit that above-described embodiment illustrates can specifically realize by computer chip or entity, Or it is realized by the product with certain function.It is a kind of typically to realize that equipment is computer.Specifically, computer for example may be used Think personal computer, laptop computer, cellular phone, camera phone, smart phone, personal digital assistant, media play It is any in device, navigation equipment, electronic mail equipment, game console, tablet computer, wearable device or these equipment The combination of equipment.
For convenience of description, it is divided into various units when description apparatus above with function to describe respectively.Certainly, implementing this The function of each unit can be realized in the same or multiple software and or hardware when application.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more, The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces The form of product.
The application is reference according to the method for this specification embodiment, the stream of equipment (system) and computer program product Journey figure and/or block diagram describe.It should be understood that can be by computer program instructions information realization flowchart and/or the block diagram The combination of process and/or box in each flow and/or block and flowchart and/or the block diagram.It can provide these calculating Machine program instruction information is to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices Processor is to generate a machine, so that the instruction executed by computer or the processor of other programmable data processing devices Information generates specifies for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram Function device.
These computer program instructions information, which may also be stored in, is able to guide computer or other programmable data processing devices In computer-readable memory operate in a specific manner, so that command information stored in the computer readable memory produces Raw includes the manufacture of command information device, the command information device realize in one or more flows of the flowchart and/or The function of being specified in one or more blocks of the block diagram.
These computer program instructions information also can be loaded onto a computer or other programmable data processing device, so that Series of operation steps are executed on a computer or other programmable device to generate computer implemented processing, thus calculating The command information that is executed on machine or other programmable devices provide for realizing in one or more flows of the flowchart and/or The step of function of being specified in one or more blocks of the block diagram.
In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net Network interface and memory.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/or The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method Or technology come realize information store.Information can be computer-readable instruction information, data structure, the module of program or other numbers According to.The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory techniques, CD-ROM are read-only Memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or Other magnetic storage devices or any other non-transmission medium, can be used for storage can be accessed by a computing device information.According to Herein defines, and computer-readable medium does not include temporary computer readable media (transitory media), such as modulation Data-signal and carrier wave.
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability It include so that the process, method, commodity or the equipment that include a series of elements not only include those elements, but also to wrap Include other elements that are not explicitly listed, or further include for this process, method, commodity or equipment intrinsic want Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including described want There is also other identical elements in the process, method of element, commodity or equipment.
It will be understood by those skilled in the art that embodiments herein can provide as method, system or computer program product. Therefore, complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in the application Form.It is deposited moreover, the application can be used to can be used in the computer that one or more wherein includes computer usable program code The shape for the computer program product implemented on storage media (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) Formula.
The application can computer executable instructions information it is general up and down described in the text, such as Program module.Generally, program module include routines performing specific tasks or implementing specific abstract data types, it is program, right As, component, data structure etc..The application can also be practiced in a distributed computing environment, in these distributed computing environment In, by executing task by the connected remote processing devices of communication network.In a distributed computing environment, program module It can be located in the local and remote computer storage media including storage equipment.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method Part explanation.
The above description is only an example of the present application, is not intended to limit this application.For those skilled in the art For, various changes and changes are possible in this application.All any modifications made within the spirit and principles of the present application are equal Replacement, improvement etc., should be included within the scope of the claims of this application.

Claims (16)

1. a kind of monitoring method of data variation, which comprises
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the historical data Feature detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second service node Send prompt information;Wherein, the prompt information is used to indicate the data of business datum caused by first service node Feature changes;Second service node is the downstream node of first service node.
2. the method as described in claim 1, if testing result indicates that the business datum does not meet the historical data feature Detected rule, the method also includes:
Determine data characteristics detected rule corresponding to the business datum;
The data characteristics detected rule is added in historical data feature detected rule set;Wherein, the historical data It include each historical data feature detected rule in feature detected rule set.
3. the method as described in claim 1, it is special whether the detection business datum meets predetermined historical data Levy detected rule, comprising:
Determine the data characteristics of data value corresponding to each field in the business datum;
Data characteristics corresponding to the business datum is matched with each historical data feature detected rule respectively, with true Whether the fixed business datum meets the historical data feature detected rule.
4. method according to claim 2, if the business datum include can enumeration type field and can not enumeration type Field;
Data characteristics detected rule corresponding to the determination business datum, comprising:
Determine in the business datum can data value corresponding to the field of enumeration type, and, determine in the business datum It can not data feature description information corresponding to the field of enumeration type;
The data value and the data feature description information are combined, the spy of data corresponding to the business datum is obtained Levy detected rule.
5. method according to any of claims 1-4, the first service node of the acquisition is generated in processing business Business datum, comprising:
When first service node handles the business, generated business datum is obtained from first service node;
Alternatively, obtaining the business datum from database;Wherein, first service node is stored in the database to exist Generated business datum when processing business.
6. method according to any of claims 1-4, the first service node of the acquisition is generated in processing business Before business datum, the method also includes:
Obtain history service data corresponding to first service node;
The historical data feature detected rule is determined based on the history service data.
7. method as claimed in claim 6, described determine that the historical data feature detects based on the history service data Rule, comprising:
The history service data are formatted, the history service data of key-value form are obtained;Wherein, key table Field is levied, value characterizes data value corresponding to the field;
According to data value corresponding to each field, data characteristics corresponding to each field is determined;
The historical data feature detected rule is determined based on data characteristics corresponding to each field.
8. the method for claim 7, the data value according to corresponding to each field determines number corresponding to each field According to feature, comprising:
If the field be can enumeration type field, it is right that data value corresponding to the field is determined as field institute The data characteristics answered;
If the field be can not enumeration type field, the field institute is determined according to data value corresponding to the field Corresponding data feature description information, data feature description information corresponding to the field is determined as corresponding to the field Data characteristics.
9. the method for claim 7, described determine that the historical data is special based on data characteristics corresponding to each field Levy detected rule, comprising:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combined result is obtained;
Every data feature combined result is determined as a historical data feature detected rule respectively.
10. a kind of monitoring device of data variation, described device include:
First obtains module, for obtaining the first service node generated business datum in processing business;
Detection module, for detecting whether the business datum meets predetermined historical data feature detected rule;Wherein, The historical data feature detected rule is determined based on history service data caused by first service node;
Sending module, if indicating that the business datum does not meet the historical data feature detected rule for testing result, Prompt information is sent to the second service node;Wherein, the prompt information is used to indicate caused by first service node The data characteristics of business datum changes;Second service node is the downstream node of first service node.
11. device as claimed in claim 10, if testing result indicates that the business datum does not meet the historical data spy Levy detected rule, described device further include:
First determining module, for determining data characteristics detected rule corresponding to the business datum;
Adding module, for the data characteristics detected rule to be added in historical data feature detected rule set;Wherein, It include each historical data feature detected rule in the historical data feature detected rule set.
12. device as claimed in claim 10, the detection module, comprising:
First determination unit, for determining the data characteristics of data value corresponding to each field in the business datum;
Matching unit, for respectively by data characteristics corresponding to the business datum and each historical data feature detected rule It is matched, whether the historical data feature detected rule is met with the determination business datum.
13. device as claimed in claim 11, if the business datum include can enumeration type field and class can not be enumerated The field of type;
The determining module, comprising:
Second determination unit, for determine in the business datum can data value corresponding to the field of enumeration type, and, really It can not data feature description information corresponding to the field of enumeration type in the fixed business datum;
Assembled unit obtains being determined as the industry for the data value and the data feature description information to be combined Data characteristics detected rule corresponding to data of being engaged in.
14. such as the described in any item devices of claim 10-13, described device further include:
Second obtains module, for obtaining history service data corresponding to first service node;
Second determining module, for determining the historical data feature detected rule based on the history service data.
15. a kind of monitoring device of data variation, comprising:
Processor;And
It is arranged to the memory of storage computer executable instructions, the executable instruction makes the processing when executed Device:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the historical data Feature detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second service node Send prompt information;Wherein, the prompt information is used to indicate the data of business datum caused by first service node Feature changes;Second service node is the downstream node of first service node.
16. a kind of storage medium, for storing computer executable instructions, the executable instruction is realized following when executed Process:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the historical data Feature detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second service node Send prompt information;Wherein, the prompt information is used to indicate the data of business datum caused by first service node Feature changes;Second service node is the downstream node of first service node.
CN201910271980.1A 2019-04-04 2019-04-04 Data change monitoring method and device Active CN110175084B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910271980.1A CN110175084B (en) 2019-04-04 2019-04-04 Data change monitoring method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910271980.1A CN110175084B (en) 2019-04-04 2019-04-04 Data change monitoring method and device

Publications (2)

Publication Number Publication Date
CN110175084A true CN110175084A (en) 2019-08-27
CN110175084B CN110175084B (en) 2023-04-25

Family

ID=67689443

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910271980.1A Active CN110175084B (en) 2019-04-04 2019-04-04 Data change monitoring method and device

Country Status (1)

Country Link
CN (1) CN110175084B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112650762A (en) * 2021-03-15 2021-04-13 腾讯科技(深圳)有限公司 Data quality monitoring method and device, electronic equipment and storage medium
CN112783799A (en) * 2021-03-19 2021-05-11 中国工商银行股份有限公司 Software daemon test method and device
CN113468205A (en) * 2021-06-29 2021-10-01 杭州每刻科技有限公司 User-defined expense checking method and system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004349776A (en) * 2003-05-20 2004-12-09 Yamaha Corp Node control method, and node control apparatus and program
US20050262097A1 (en) * 2004-05-07 2005-11-24 Sim-Tang Siew Y System for moving real-time data events across a plurality of devices in a network for simultaneous data protection, replication, and access services
US20090252174A1 (en) * 2006-03-31 2009-10-08 Matsushita Electric Industrial Co., Ltd. message identification method and a relay node used by the method
US20120089572A1 (en) * 2010-10-06 2012-04-12 International Business Machines Corporation Automated and self-adjusting data protection driven by business and data activity events
CN107704929A (en) * 2016-08-08 2018-02-16 华为技术有限公司 A kind of model update method and device
CN108628947A (en) * 2018-04-02 2018-10-09 阿里巴巴集团控股有限公司 A kind of business rule matched processing method, device and processing equipment
CN108780538A (en) * 2016-03-23 2018-11-09 联邦快递服务公司 The system, apparatus and method of broadcast setting for the node in self-adjusting wireless node network
CN109104327A (en) * 2018-06-08 2018-12-28 阿里巴巴集团控股有限公司 A kind of business diary generation method, device and equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004349776A (en) * 2003-05-20 2004-12-09 Yamaha Corp Node control method, and node control apparatus and program
US20050262097A1 (en) * 2004-05-07 2005-11-24 Sim-Tang Siew Y System for moving real-time data events across a plurality of devices in a network for simultaneous data protection, replication, and access services
US20090252174A1 (en) * 2006-03-31 2009-10-08 Matsushita Electric Industrial Co., Ltd. message identification method and a relay node used by the method
US20120089572A1 (en) * 2010-10-06 2012-04-12 International Business Machines Corporation Automated and self-adjusting data protection driven by business and data activity events
CN108780538A (en) * 2016-03-23 2018-11-09 联邦快递服务公司 The system, apparatus and method of broadcast setting for the node in self-adjusting wireless node network
CN107704929A (en) * 2016-08-08 2018-02-16 华为技术有限公司 A kind of model update method and device
CN108628947A (en) * 2018-04-02 2018-10-09 阿里巴巴集团控股有限公司 A kind of business rule matched processing method, device and processing equipment
CN109104327A (en) * 2018-06-08 2018-12-28 阿里巴巴集团控股有限公司 A kind of business diary generation method, device and equipment

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112650762A (en) * 2021-03-15 2021-04-13 腾讯科技(深圳)有限公司 Data quality monitoring method and device, electronic equipment and storage medium
CN112650762B (en) * 2021-03-15 2021-07-02 腾讯科技(深圳)有限公司 Data quality monitoring method and device, electronic equipment and storage medium
CN112783799A (en) * 2021-03-19 2021-05-11 中国工商银行股份有限公司 Software daemon test method and device
CN112783799B (en) * 2021-03-19 2024-05-17 中国工商银行股份有限公司 Software daemon testing method and device
CN113468205A (en) * 2021-06-29 2021-10-01 杭州每刻科技有限公司 User-defined expense checking method and system
CN113468205B (en) * 2021-06-29 2023-09-12 杭州每刻科技有限公司 Custom expense checking method and system

Also Published As

Publication number Publication date
CN110175084B (en) 2023-04-25

Similar Documents

Publication Publication Date Title
CN108492124A (en) Store information recommends method, apparatus and client
CN108664812A (en) Information desensitization method, apparatus and system
CN110175084A (en) The monitoring method and device of data variation
WO2021063045A1 (en) Blockchain-based transaction query method, apparatus and device, and blockchain-based transaction data processing method, apparatus and device
CN110020427B (en) Policy determination method and device
CN107424069A (en) A kind of generation method of air control feature, risk monitoring and control method and apparatus
CN110245047B (en) Time sequence abnormality detection method, device and equipment
CN110503435B (en) Transaction early warning method, device and equipment based on blockchain
CN107094166A (en) A kind of service information sending method and device
CN111461775B (en) Method and device for determining influence of event on traffic
CN108108866A (en) A kind of method and device of risk control
CN107066519A (en) A kind of task detection method and device
WO2022161325A1 (en) Prompting method and electronic device
CN110443457A (en) Data processing method and device
CN110008991A (en) The identification of risk case, risk identification model generation method and device
US20230087106A1 (en) Tokenization request handling at a throttled rate in a payment network
CN110175156A (en) The generation method and device of report
US11687598B2 (en) Determining associations between services and computing assets based on alias term identification
CN109166021A (en) Bookkeeping methods, device and business finance integral system
CN106293890B (en) A kind of method and device for business processing based on complexity
CN110175832A (en) A kind of intermediate account Fund Supervision method, system and equipment
CN109325035A (en) The recognition methods of similar table and device
CN109039695B (en) Service fault processing method, device and equipment
CN110059712A (en) The detection method and device of abnormal data
CN110457430A (en) A kind of Traceability detection method of text, device and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant