CN110175084A - The monitoring method and device of data variation - Google Patents
The monitoring method and device of data variation Download PDFInfo
- Publication number
- CN110175084A CN110175084A CN201910271980.1A CN201910271980A CN110175084A CN 110175084 A CN110175084 A CN 110175084A CN 201910271980 A CN201910271980 A CN 201910271980A CN 110175084 A CN110175084 A CN 110175084A
- Authority
- CN
- China
- Prior art keywords
- data
- business datum
- service node
- detected rule
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0751—Error or fault detection not based on redundancy
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0793—Remedial or corrective actions
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Telephonic Communication Services (AREA)
Abstract
This specification embodiment provides the monitoring method and device of a kind of data variation, this method comprises: obtaining the first service node generated business datum in processing business;Whether detection business datum meets predetermined historical data feature detected rule;Wherein, historical data feature detected rule is determined based on history service data caused by the first service node;If testing result instruction business datum does not meet historical data feature detected rule, prompt information is sent to the second service node;Wherein, the data characteristics that prompt information is used to indicate business datum caused by the first service node changes;Second service node is the downstream node of the first service node.
Description
Technical field
This application involves technical field of data processing more particularly to the monitoring methods and device of a kind of data variation.
Background technique
With the fast development of internet and information technology, more and more business need to be done by operation system
Reason, for example, online transaction business, transferred account service, payment transaction etc..In general, being needed in operation system when carrying out business processing
Will multiple service nodes collaboration in the operation system carry out the processing of this business.
And with the continuous extension of business scale, some service node may adjust the data contents such as business model
It is whole, for example, certain parameters etc. of Added Business mode or a certain business of adjustment, but the downstream traffic section of the service node
Point can not know that the alteration of upstream node is handled when carrying out business processing still according to original business model,
So as to cause business processing failure.
Therefore, traffic failure situation caused by how being monitored, being reduced thus to the business model etc. of each service node
Generation become current urgent need to resolve the technical issues of.
Summary of the invention
The purpose of this specification embodiment is to provide the monitoring method and device of a kind of data variation, by detecting the first industry
Whether business node generated business datum in processing business meets predetermined historical data feature detected rule, to supervise
Whether the business datum feature for surveying the first service node changes, and may determine that the business model of the first service node accordingly
Whether adjusted, and when the business datum feature for monitoring the first service node changes, notifies second in time
Service node, wherein the second service node is the downstream node of the first service node.The side provided by this specification embodiment
Method realizes the monitoring of the business model to upstream business node, so that downstream traffic node timely learning upstream
The situation of change of service node, to make corresponding adjustment in time, thus the generation for the case where reducing business processing failure.
In order to solve the above technical problems, this specification embodiment is achieved in that
This specification embodiment provides a kind of monitoring method of data variation, comprising:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the history
Data characteristics detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second business
Node sends prompt information;Wherein, the prompt information is used to indicate business datum caused by first service node
Data characteristics changes;Second service node is the downstream node of first service node.
This specification embodiment additionally provides a kind of monitoring device of data variation, and described device includes:
First obtains module, for obtaining the first service node generated business datum in processing business;
Detection module, for detecting whether the business datum meets predetermined historical data feature detected rule;
Wherein, the historical data feature detected rule is determined based on history service data caused by first service node;
Sending module, if indicating that the business datum does not meet the historical data feature detection rule for testing result
Then, then prompt information is sent to the second service node;Wherein, the prompt information is used to indicate first service node and is produced
The data characteristics of raw business datum changes;Second service node is the downstream node of first service node.
This specification embodiment additionally provides a kind of monitoring device of data variation, comprising:
Processor;And
It is arranged to the memory of storage computer executable instructions, the executable instruction makes the place when executed
Manage device:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the history
Data characteristics detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second business
Node sends prompt information;Wherein, the prompt information is used to indicate business datum caused by first service node
Data characteristics changes;Second service node is the downstream node of first service node.
This specification embodiment additionally provides a kind of storage medium, described to hold for storing computer executable instructions
Following below scheme is realized in row instruction when executed:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the history
Data characteristics detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second business
Node sends prompt information;Wherein, the prompt information is used to indicate business datum caused by first service node
Data characteristics changes;Second service node is the downstream node of first service node.
Technical solution in the present embodiment, by detecting the first service node generated business datum in processing business
Whether predetermined historical data feature detected rule is met, to monitor whether the business datum feature of the first service node is sent out
Changing may determine that whether the business model of the first service node is adjusted accordingly, and monitor the first industry
When the business datum feature of business node changes, the second service node is notified in time, wherein the second service node is the first industry
The downstream node of business node.The method provided by this specification embodiment realizes the business model to upstream business node
Monitoring so that the situation of change of downstream traffic node timely learning upstream business node, to make phase in time
The adjustment answered, thus the generation for the case where reducing business processing failure.
Detailed description of the invention
In order to illustrate more clearly of this specification embodiment or technical solution in the prior art, below will to embodiment or
Attached drawing needed to be used in the description of the prior art is briefly described, it should be apparent that, the accompanying drawings in the following description is only
Some embodiments as described in this application, for those of ordinary skill in the art, in the premise not made the creative labor
Under, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is one of the method flow diagram of monitoring method of data variation that this specification embodiment provides;
Fig. 2 is the two of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides;
Fig. 3 is to determine historical data feature detection rule in the monitoring method for the data variation that this specification embodiment provides
Method flow diagram then;
Fig. 4 is to determine the process of historical data feature in the monitoring method for the data variation that this specification embodiment provides
Schematic diagram;
Fig. 5 is the three of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides;
Fig. 6 is the four of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides;
Fig. 7 is the module composition schematic diagram of the monitoring device for the data variation that this specification embodiment provides;
Fig. 8 is the structural schematic diagram of the monitoring device for the data variation that this specification embodiment provides.
Specific embodiment
In order to make those skilled in the art better understand the technical solutions in the application, below in conjunction with this specification
Attached drawing in embodiment is clearly and completely described the technical solution in this specification embodiment, it is clear that described
Embodiment is merely a part but not all of the embodiments of the present application.Based on the embodiment in the application, this field
Those of ordinary skill's every other embodiment obtained without creative efforts, all should belong to the application
The range of protection.
The monitoring method for the data variation that this specification embodiment provides, by detection upstream business node in processing business
When generated business datum data characteristics whether change, realize that the business model of detection upstream business node is with this
It is no to adjust, in this way, allow downstream traffic node obtain in time upstream business node business model adjustment situation,
And then corresponding adjustment is made, thus the generation for the case where reducing business processing failure.
The monitoring method for the data variation that this specification embodiment provides is applied to the monitoring device of data variation, the data
The monitoring device of variation is that can be used as within the operation system independently of the equipment except service node each in operation system
One device node, or except equipment, this specification embodiment is defined not to this.
The executing subject of the monitoring method for the data variation that this specification embodiment provides is the monitoring of above-mentioned data variation
Equipment, specifically, to be installed on the monitoring device of the data variation on the equipment.
Fig. 1 is one of the method flow diagram of monitoring method of data variation that this specification embodiment provides, shown in FIG. 1
Method includes at least following steps:
Step 102, the first service node generated business datum in processing business is obtained.
Wherein, above-mentioned business can be any type of business handled by operation system, for example, transferred account service, supplementing with money
Business, payment class business etc..Above-mentioned business datum may include total data relevant to this business, such as may include the industry
The type of service of business, the service condition of the business, business side, service order number etc..
For example, above-mentioned business is transferred account service, then the business datum may include: type of service, two parties of transferring accounts
The information such as identification information, transfer amounts, order number, time of transferring accounts, mode of transferring accounts.
Specifically, the first service node generated business datum in processing business is obtained in above-mentioned steps 102,
Including at least the following two kinds situation:
The first, when the first service node handles the business, generated business datum is obtained from the first service node.
In such a case, it is possible to be whenever the first service node generates a business datum, the then monitoring of data variation
Device then obtains this business datum from the first service node.
The second, business datum is obtained from database;Wherein, the first service node is stored in database in processing business
When generated business datum.
In that case, the first business datum stores generated business datum to database in processing business
In, the monitoring device of data variation then obtains business datum corresponding to the first service node from database.Specifically,
The device of data variation can obtain business datum according to the setting period from database.
Wherein, above-mentioned database can be mysql database, Hbase database, OceanBase database etc..
Step 104, detect whether above-mentioned business datum meets predetermined historical data feature detected rule;Wherein,
Historical data feature detected rule is determined based on history service data caused by the first service node.
It, can be according to the first service node stored in database before executing the method that this specification embodiment provides
The history service data of generation determine historical data feature detected rule corresponding to the first service node.Generally for an industry
Be engaged in data for comprising can enumeration type field and can not enumeration type field.It is so-called can enumeration type field then
Refer to that data value corresponding to field is finite sequence, i.e., data value, which can be enumerated all, comes.For example, number corresponding to week
It include Monday, Tuesday, Wednesday, Thursday, Friday, Saturday and Sunday according to value, which is finite ordered series of numbers,
Therefore, week data can enumeration type;If further for example, above-mentioned field be service condition, general business state include successfully with
Failure two kinds, data finite sequence, therefore, service condition belong to can enumeration type field.
Correspondingly, can not the field of enumeration type then refer to that data value corresponding to field is infinite sequence, i.e. data
Value, which can not be enumerated all, to be come.For example, being directed to this field of order number, each business all corresponds to an order number, as long as business
System can not just enumerate all order numbers, therefore, order number, which belongs to, can not enumerate class in the processing for constantly carrying out business
The field of type.
In this specification embodiment, above-mentioned historical data feature detected rule be generally basede in history service data can piece
Lift data value corresponding to the field of type and can not data value corresponding to the field of enumeration type characterization information institute
Combination determination.Even above-mentioned historical data include can enumeration type field and can not enumeration type field;Then go through for every
History data characteristics detected rule respectively as it is each can historical data values corresponding to the field of enumeration type and it is each can not piece
The historical data characterization information for lifting data corresponding to the field of type is composed.
For ease of understanding, following to be illustrated citing.
For example, in a specific embodiment, above-mentioned historical data feature detected rule can be expressed as shown below:
Type of service: it transfers accounts;Service condition: success;Order information: 12 bit digital of order length.Of course, it is possible to according to going through
History business datum predefines a plurality of historical data feature detected rule, herein only with a wherein historical data feature detection
It is illustrated for rule, does not constitute the restriction to this specification embodiment.
Specifically, then needing to detect in the business datum after getting business datum caused by the first service node
Whether characteristic information corresponding to each field meets above-mentioned historical data feature detected rule.
Step 106, if testing result indicates that above-mentioned business datum does not meet historical data feature detected rule, to second
Service node sends prompt information;Wherein, which is used to indicate the number of business datum caused by the first service node
It changes according to feature;Second service node is the downstream node of the first service node.
In this specification embodiment, if testing result indicates that above-mentioned business datum meets historical data feature detection rule
Then, then it is assumed that compared with history service data, the data characteristics of business datum caused by the first service node does not change,
I.e. the developer of the first service node, which is not adjusted the business model of the first service node, (such as increases new business model
Deng), at this moment terminate process;If testing result indicates that above-mentioned business datum does not meet historical data feature detected rule, then recognize
Data characteristics for business datum caused by the first service node changes, i.e. the business model of the first service node occurs
Adjustment, at this moment, the downstream node for the ease of the first service node is in time adjusted correspondingly business model, to protect
The normal processing of card business then needs to send prompt information to the second service node (downstream node of the first service node).
In the specific implementation, above-mentioned prompt information can in a manner of mail, in the way of short message, third party's instant messaging
The modes such as information are sent to the developer of the second service node.Specifically, needing to carry the first business in the prompt information
The data content of changing features occurs for node, so that the staff of the second service node can be in time according to the first service node
Current business model makes corresponding adjustment to the second service node, and then guarantees the normal processing of operation system business.
The monitoring method for the data variation that this specification embodiment provides, by produced by the first service processing node of detection
Business datum whether be consistent with predetermined historical data feature detected rule, may thereby determine that out the first business section
Whether the data characteristics of business datum caused by point changes, and then the data of the business datum by the first service node
The variation of feature may determine that whether the business model of the first service node is adjusted, in this way, determining the first industry
When the business model of business node adjusts, the downstream node (the second service node) of the first service node can be notified in time,
So that the developer of the second service node is in time adjusted correspondingly the second service node, to guarantee operation system industry
The normal processing of business.
In the specific implementation, in above-mentioned steps 104, whether detection business datum meets predetermined historical data feature
Detected rule specifically includes:
Determine the data characteristics of data value corresponding to each field in the business datum;It respectively will be corresponding to business datum
Data characteristics is matched with each historical data feature detected rule, to determine whether the business datum meets historical data spy
Levy detected rule.
In the specific implementation, when determining data characteristics corresponding to the business datum, the business datum can be first determined
In can enumeration type field and can not enumeration type field.For can enumeration type field, then directly by the field
Corresponding data value as data characteristics corresponding to the field, for example, be directed to " service condition " this field, belong to can piece
The field of type is lifted, if data value corresponding to " service condition " is " success " in the business datum, then by service condition institute
Corresponding data characteristics is determined as " succeeding ".For in the business datum can not enumeration type field, then by the field institute it is right
The data feature description information for the data value answered is determined as the data characteristics corresponding to it.For example, being directed to " order number " this word
Section, belong to can not enumeration type field, if " order number " in the business datum be " 12787565 ", then can will " grow
Degree is 8 bit digitals " as data characteristics corresponding to " order number " this field.Of course, it is possible to which it is right to preset each field institute
The data feature description information answered determines rule, for example, the data feature description information determines that rule can be indicated using the word
The length information of data value corresponding to section is as its corresponding data feature description information etc..
In determining above-mentioned business datum after data characteristics corresponding to each field, then respectively and in advance by the data characteristics
Each historical data feature detected rule first determined is matched, if there are certain historical data feature detected rule and being somebody's turn to do
Data characteristics corresponding to business datum matches, then it is assumed that above-mentioned business datum meets historical data feature detected rule, i.e.,
Compared with history service data, the data characteristics of the business datum does not change.
For ease of understanding, following to be illustrated citing.
For example, in a specific embodiment, data characteristics corresponding to business datum are as follows:
Type of service: it transfers accounts;Service condition: success;Order number: ten digits;
Predetermined historical data feature detected rule includes following three rule:
Regular 1, type of service: it transfers accounts;Service condition: failure;Order number: it is made of ten digits;
Regular 2, type of service: it supplements with money;Service condition: success;Order number: it is made of 12 bit digitals;
Regular 3, type of service: it transfers accounts;Service condition: success;Order number: it is made of 12 bit digitals;
Data characteristics corresponding to above-mentioned business datum 3 is matched with rule 1, rule 2, rule respectively, by
With discovery, which mismatches with rule 1, rule 2 and rule 3, it is therefore contemplated that with history service data phase
Than the data characteristics of the business datum is changed, i.e., the developer of the first service node carries out the business model
Adjustment, at this moment makes corresponding adjustment to the business in time for the ease of the developer of the second service node, then needs to the
Two service nodes send prompt information.
Specifically, in this specification embodiment, if detecting the number of business datum caused by the first service node
It changes according to feature, other than issuing prompt information to the second service node, it is also necessary to determine the number for being directed to the business datum
According to feature detected rule, as historical data feature detected rule, in this way, when next first service node generates same data again
When the business datum of feature, the data due to being directed to the data characteristics before have sent prompt letter to the second service node
Breath will not then prompt as the second service node issues again in this way, avoid follow-up prompts, cause to increase the exploitation of the second service node
The workload of personnel.Therefore, if testing result indicates that above-mentioned business datum does not meet historical data feature detected rule, this explanation
The method that book embodiment provides further includes following steps:
Determine data characteristics detected rule corresponding to above-mentioned business datum;Above-mentioned data characteristics detected rule is added to
In historical data feature detected rule set;It wherein, include that each historical data is special in the historical data feature detected rule set
Levy detected rule.
In this specification embodiment, can the characteristic values of the data according to corresponding to field each in business datum determine business
Data characteristics detected rule corresponding to data.In a specific embodiment, if above-mentioned business datum includes that can enumerate class
The field of type and can not enumeration type field;
Correspondingly, data characteristics detected rule corresponding to above-mentioned determining business datum, specifically includes:
Determine in above-mentioned business datum can data value corresponding to the field of enumeration type, and, determine above-mentioned business number
It can not data feature description information corresponding to the field of enumeration type in;By above-mentioned data value and data characterization information
It is combined, obtains data characteristics detected rule corresponding to the business datum.
In this specification embodiment, when determining data characteristics detected rule corresponding to business datum, it is first determined should
In business datum can enumeration type field and can not enumeration type field, then, for can not enumeration type field
It needs to determine that rule determines data characteristics corresponding to the field according to pre-set data feature description information.For example, number
Determine that rule instruction needs to describe its data characteristics from the composition length of the field according to characterization information, then it is field institute is right
The length information answered is determined as data feature description information corresponding to the field;Finally, then by can enumeration type field
Data value and can not the data feature description information of field of enumeration type combine, as corresponding to the business datum
Data characteristics detected rule.
In addition, it should be noted that in this specification embodiment, business caused by the first acquired service node
Data can directly be the business datum of key-value form, wherein what key was indicated is each field in business datum,
Value expression is data value corresponding to each field, in this case, then can be obtained directly from business datum each
Data value corresponding to field.In some cases, acquired business datum may not be the number of key-value form
According at this moment, it is necessary first to be formatted to business datum, obtain the business datum of key-value form, determine again later
Data value corresponding to each field.
Certainly, in the specific implementation, if the business datum got is not the business datum of key-value form,
Numerical value corresponding to each field and each field can also be directly extracted from data.In this specification embodiment, as long as final
It is available process not to be implemented to it to field and its corresponding data value, this specification embodiment and limited
It is fixed.
For ease of understanding, following detailed processes that citing is illustrated to above-mentioned determining data characteristics detected rule.
For example, an acquired business datum are as follows:
Type of service | Service condition | Transfer amounts | Order number |
It transfers accounts | Success | 100.00 first | 1267996413 |
Field corresponding to the business datum includes: " type of service ", " service condition ", " transfer amounts " and " order
Number "." type of service " and " service condition " in these fields belong to can enumeration type field, " transfer amounts " and " order
Number " then belong to can not enumeration type field.Therefore, when determining data characteristics detected rule, " service class can directly be used
The data value of type " and " service condition " is as data characteristics, for " transfer amounts " and " order number ", then it needs to be determined that its institute is right
The data feature description information answered can will then have two to be used as its corresponding for " transfer amounts " behind decimal point
Data characteristics data specifying-information, for " order number ", then it is right as its to constitute the number for being 10 by length
The data feature description information answered later combines data characteristics corresponding to each field, to obtain the business number
According to corresponding data characteristics detected rule.
Therefore, for the business datum, corresponding data characteristics detected rule are as follows:
Type of service: it transfers accounts;Service condition: success;The amount of money: two-decimal behind decimal point;Order number: ten digits.
Fig. 2 is the two of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides, shown in Fig. 2
Method includes at least following steps:
Step 202, the first service node generated business datum in processing business is obtained.
Step 204, detecting above-mentioned business datum is and going through in predetermined historical data feature detected rule set
History data characteristics detected rule is consistent;If so, terminating;Otherwise, step 206 is executed.
Step 206, prompt information is sent to the second service node.
Step 208, determine in the business datum can data value corresponding to the field of enumeration type, and, determine the industry
It can not data feature description information corresponding to the field of enumeration type in data of being engaged in.
Step 210, above-mentioned data value and data characterization information are combined, are obtained corresponding to the business datum
Data characteristics detected rule.
Step 212, historical data spy is added to using the data characteristics detected rule as historical data feature detected rule
It levies in detected rule set.
In addition, in this specification embodiment, for the ease of realizing business datum caused by the first service node of detection
Whether meet predetermined historical data feature detected rule, then needs the business datum according to caused by the first service node
It determines the historical data feature detected rule, therefore, is obtaining the first service node business datum caused by processing business
Before, the method that this specification embodiment provides further includes following steps one and step 2;
Step 1: obtaining history service data corresponding to the first service node;
Step 2: determining historical data feature detected rule based on above-mentioned history service data.
In the specific implementation, history service number all caused by the first service node can be obtained from database
According to.Specifically, acquired history service data can be and start to process business from the first service node and up to the present accumulate
Tired all history service data.
In this specification embodiment, in above-mentioned steps two, historical data feature is determined based on above-mentioned history service data
Detected rule specifically comprises the following steps (1), step (2) and step (3);
Step (1) formats above-mentioned history service data, obtains the history service number of key-value form
According to;Wherein, key characterizes field, and value characterizes data value corresponding to above-mentioned field;
Step (2), the data value according to corresponding to each field, determine data characteristics corresponding to each field;
Step (3) determines historical data feature detected rule based on data characteristics corresponding to each field.
In a specific embodiment, it can be obtained by the feature factory in the monitoring device of data variation from messaging bus
Take history service data all caused by the first service node.It wherein, is data connection object from messaging bus acquisition
(Data Transfer Object, DTO), for the ease of determining historical data feature detected rule, in this specification embodiment
In, need for acquired DTO to be converted into the business datum of key-value form, wherein key characterization is in business datum
Each field, such as " type of service ", " service condition ", " the business amount of money ", " business side " field, and value characterization is then
For data value corresponding to each field.
In general, accessed business datum includes multiple fields, when being converted into the data of key-value format,
Key value and value value are converted by each field is corresponding.But in practical applications, certain words are often appeared in
It the case where section the inside nesting multiple extended fields, in response to this, then needs all to turn each field inside extended field
Change corresponding key-value form into, it is following for ease of understanding to be illustrated citing.
For example, in a specific embodiment, accessed history service data are as follows:
In above-mentioned business datum, the case where " extension information " this column then belong to nested field, turn by the column data
When changing key-value form into, then need nested each field being converted into corresponding key-value form.
Above-mentioned business datum is converted into key-value format, the history service data after conversion are as shown in the table:
key | value |
Order number | 1231231 |
Total value | 123 |
State | Success |
Type | It supplements with money |
Extend information: requestee's mark | 12312312 |
Extend information: operating system | Android |
Extend information: extension information: aa | xxx |
Extend information: extension information: bb [0] | 111 |
Extend information: extension information: bb [1] | 222 |
Extend information: extension information: bb [2] | 333 |
It should be noted that the field of above-mentioned nesting may include two class data, Yi Leiwei in this specification embodiment
Single-row data acquisition system (List), one kind is biserial data acquisition system (Map), such as " requestee's mark ": belonging to if " 12312312 "
List, " bb ": [" 111 ", " 222 ", " 333 "] then belong to Map, the key- that List class field nested with Map class is converted into
Value form is as shown above.
Certainly, only exemplary illustration herein, does not constitute the restriction to this specification embodiment.
Specifically, according to data value corresponding to each field, determining number corresponding to each field in above-mentioned steps (2)
According to feature, specifically include:
If above-mentioned field be can enumeration type field, by data value corresponding to the field be determined as the field institute it is right
The data characteristics answered;If the field be can not enumeration type field, which is determined according to data value corresponding to each field
Data feature description information corresponding to section, data feature description information corresponding to the field is determined as corresponding to the field
Data characteristics.
In the specific implementation, it can be used in data variation monitoring device and enumerate generator, determine history service number
In can enumeration type field and can not enumeration type field, and by above-mentioned business datum can enumeration type word
Section and its corresponding data value data value can not distinguish corresponding to the field of enumeration type.
Need to illustrate when, for can enumeration type field and can not enumeration type field, be situated between aforementioned
It continues and how to determine its corresponding characteristic information, specifically refer to the description of front, details are not described herein again.
In above-mentioned steps (3), historical data feature detected rule is determined based on data characteristics corresponding to each field, specifically
Include:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combination knot is obtained
Fruit;Every data feature combined result is determined as a historical data feature detected rule respectively.
Technical solution herein for ease of understanding, it is following to be illustrated citing.
For example, accessed history service data are three, it is denoted as history service data 1, history service data 2 respectively
With history service data 3, data characteristics corresponding to field each in history service data 1 is combined, data characteristics is obtained
Data characteristics corresponding to field each in history service data 2 is combined by combined result 1, obtains data characteristics combination knot
Data characteristics corresponding to field each in history service data 3 is combined by fruit 2, data characteristics combination 3 is obtained, in basis
When data characteristics combined result determines historical data feature detected rule, then data characteristics combined result 1 is determined as one and gone through
Data characteristics combined result 2 is determined as a historical data feature detected rule by history data characteristics detected rule, by data spy
Sign combined result 3 is determined as a historical data feature detected rule.
Wherein, a history service data can be understood as the first service node and handle business number caused by a business
According to.
Certainly, in the specific implementation, there may be historical data feature detected rule determined by a plurality of business datum
Identical situation then needs to reject wherein duplicate historical data feature detected rule in this case.
Fig. 3 is to determine historical data feature detection rule in the monitoring method for the data variation that this specification embodiment provides
Method flow diagram then, method shown in Fig. 3 include at least following steps:
Step 302, all history service data corresponding to the first service processing node are obtained.
Step 304, above-mentioned history service data are formatted, obtains the history service number of key-value form
According to.
Wherein, in this specification embodiment, key characterizes each field in business datum, and it is right that value characterizes each field institute
The data value answered.
Step 306, determine in history service data can enumeration type field and can not enumeration type field.
Step 308, for can enumeration type field, data value corresponding to the field is determined as corresponding to the field
Data characteristics, for can not enumeration type field, which is determined according to data value corresponding to the field corresponding to
Data feature description information, and data feature description corresponding to the field is determined as data characteristics corresponding to the field.
Step 310, data characteristics corresponding to each field in every history service data is combined, obtains data spy
Levy combined result.
Step 312, every data feature combined result is determined as a historical data feature detected rule.
Corresponding to method flow diagram shown in Fig. 3, Fig. 4 shows the monitoring of the data variation of this specification embodiment offer
In method, the flow diagram of historical data feature detected rule is determined.
For flow diagram shown in Fig. 4, feature factory is obtained from messaging bus caused by the first service node
History service data, and by the history service data conversion at the business datum of key-value format, then, by enumerating life
Grow up to be a useful person determine in the business datum can enumeration type field and can not enumeration type field, determination can enumeration type word
Section characteristic value and can not enumeration type field characteristic value characterization information, by can enumeration type field feature
Value and can not the characterization information of field of enumeration type combine, obtain historical data feature detected rule.
The method that this specification embodiment provides, the generated business number when obtaining the first service node in processing business
According to when, directly can obtain corresponding business datum from the first service node, corresponding business number can also be obtained from database
According to following specific embodiments that will introduce above-mentioned two situations respectively.
Fig. 5 is the three of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides, shown in fig. 5
Method includes at least following steps:
Step 502, the first service node generated business datum in processing business is obtained from the first service node.
Step 504, the data characteristics of data value corresponding to each field in the service node is determined.
Step 506, detecting in predetermined each historical data feature detected rule set whether there is and above-mentioned industry
The historical data feature detected rule that the data characteristics of business data matches, and if it exists, then terminate;Otherwise, step 508 is executed.
Step 508, prompt information is sent to second node, wherein the prompt information is used to indicate the first service node institute
The data characteristics of the business datum of generation changes.
Step 510, data characteristics detected rule corresponding to the business datum is determined.
Step 512, historical data is added to using above-mentioned data characteristics detected rule as historical data feature detected rule
In characterization rules detection set.
Fig. 6 is the four of the method flow diagram of the monitoring method for the data variation that this specification embodiment provides, shown in fig. 6
Method includes at least following steps:
Step 602, the business datum of the first service node is obtained from database;Wherein, is stored in the database
One service node generated all business datums in processing business.
It in the specific implementation, can be according to the setting period from being obtained in database in the period produced by the first service node
Business datum.
Step 604, the data characteristics of data value corresponding to each field in the service node is determined.
Step 606, detecting in predetermined each historical data feature detected rule set whether there is and above-mentioned industry
The historical data feature detected rule that the data characteristics of business data matches, and if it exists, then terminate;Otherwise, step 608 is executed.
Step 608, prompt information is sent to second node, wherein the prompt information is used to indicate the first service node institute
The data characteristics of the business datum of generation changes.
Step 610, data characteristics detected rule corresponding to the business datum is determined.
Step 612, historical data is added to using above-mentioned data characteristics detected rule as historical data feature detected rule
In characterization rules detection set.
The monitoring method for the data variation that this specification embodiment provides, by the first service node of detection in processing business
When generated business datum whether meet predetermined historical data feature detected rule, to monitor the first service node
Whether business datum feature changes, and may determine that whether the business model of the first service node is adjusted accordingly,
And when the business datum feature for monitoring the first service node changes, the second service node is notified in time, wherein the
Two service nodes are the downstream node of the first service node.The method provided by this specification embodiment, realizes to upstream
The monitoring of the business model of service node, so that the variation feelings of downstream traffic node timely learning upstream business node
Condition, to make corresponding adjustment in time, thus the generation for the case where reducing business processing failure.
Corresponding to the monitoring method for the data variation that this specification embodiment provides, it is based on identical thinking, this specification
Embodiment additionally provides a kind of monitoring device of data variation, for executing the above method of this specification embodiment offer, Fig. 7
The module composition schematic diagram of the monitoring device of the data variation provided for this specification embodiment, device shown in Fig. 7 include:
First obtains module 702, for obtaining the first service node generated business datum in processing business;
Detection module 704, for detecting whether business datum meets predetermined historical data feature detected rule;Its
In, historical data feature detected rule is determined based on history service data caused by the first service node;
Sending module 706, if not meeting historical data feature detected rule for testing result instruction business datum, to
Second service node sends prompt information;Wherein, prompt information is used to indicate business datum caused by the first service node
Data characteristics changes;Second service node is the downstream node of the first service node.
Optionally, if testing result indicates that above-mentioned business datum does not meet historical data feature detected rule, this explanation
The device that book embodiment provides, further includes:
First determining module, for determining data characteristics detected rule corresponding to business datum;
Adding module, for data characteristics detected rule to be added in historical data feature detected rule set;Wherein,
It include each historical data feature detected rule in historical data feature detected rule set.
Optionally, above-mentioned detection module, comprising:
First determination unit, for determining the data characteristics of data value corresponding to each field in business datum;
Matching unit, for respectively by data characteristics corresponding to business datum and each historical data feature detected rule
It is matched, to determine whether business datum meets historical data feature detected rule.
Optionally, if above-mentioned business datum include can enumeration type field and can not enumeration type field;
Then above-mentioned determining module, comprising:
Second determination unit, for determine in business datum can data value corresponding to the field of enumeration type, and, really
Determining in business datum can not data feature description information corresponding to the field of enumeration type;
Assembled unit obtains corresponding to business datum for data value and data characterization information to be combined
Data characteristics detected rule.
Optionally, if above-mentioned history service data include can enumeration type field and can not enumeration type field;
Every above-mentioned historical data feature detected rule respectively as it is each can history number corresponding to the field of enumeration type
According to value and each historical data characterization information can not be composed corresponding to the field of enumeration type.
Optionally, above-mentioned first module is obtained, comprising:
First acquisition unit is used in the first service node processing business, caused by the acquisition of the first service node
Business datum;
Alternatively, second acquisition unit, for obtaining business datum from database;Wherein, first is stored in database
Service node generated business datum in processing business.
Optionally, the device that this specification embodiment provides, further includes:
Second obtains module, for obtaining history service data corresponding to the first service node;
Second determining module, for determining historical data feature detected rule based on history service data.
Optionally, above-mentioned second determining module, comprising:
Converting unit obtains the history service number of key-value form for formatting history service data
According to;Wherein, key characterizes field, and value characterizes data value corresponding to field;
Third determination unit determines data characteristics corresponding to each field for the data value according to corresponding to each field;
Determination unit, for determining historical data feature detected rule based on data characteristics corresponding to each field.
Optionally, above-mentioned 4th determination unit, is specifically used for:
If field be can enumeration type field, data value corresponding to field is determined as data corresponding to field
Feature;
If field be can not enumeration type field, determined corresponding to field according to data value corresponding to the field
Data feature description information corresponding to field is determined as data characteristics corresponding to field by data feature description information.
Optionally, above-mentioned determination unit, is specifically used for:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combination knot is obtained
Fruit;
Every data feature combined result is determined as a historical data feature detected rule respectively.
The monitoring device of the data variation of this specification embodiment can also carry out the monitoring device of data variation in Fig. 1-Fig. 6
The method of execution, and the monitoring device of data variation is realized in Fig. 1-embodiment illustrated in fig. 6 function, details are not described herein.
The monitoring device for the data variation that this specification embodiment provides, by the first service node of detection in processing business
When generated business datum whether meet predetermined historical data feature detected rule, to monitor the first service node
Whether business datum feature changes, and may determine that whether the business model of the first service node is adjusted accordingly,
And when the business datum feature for monitoring the first service node changes, the second service node is notified in time, wherein the
Two service nodes are the downstream node of the first service node.The method provided by this specification embodiment, realizes to upstream
The monitoring of the business model of service node, so that the variation feelings of downstream traffic node timely learning upstream business node
Condition, to make corresponding adjustment in time, thus the generation for the case where reducing business processing failure.
Further, based on above-mentioned Fig. 1 to method shown in fig. 6, this specification embodiment additionally provides a kind of data change
The monitoring device of change, as shown in Figure 8.
The monitoring device of data variation can generate bigger difference because configuration or performance are different, may include one or
More than one processor 801 and memory 802 can store one or more storages in memory 802 using journey
Sequence or data.Wherein, memory 802 can be of short duration storage or persistent storage.The application program for being stored in memory 802 can be with
Including one or more modules (diagram is not shown), each module may include one in the monitoring device to data variation
Family computer executable instruction information.Further, processor 801 can be set to communicate with memory 802, in data
The series of computation machine executable instruction information in memory 802 is executed in the monitoring device of variation.The monitoring of data variation is set
Standby can also include one or more power supplys 803, one or more wired or wireless network interfaces 804, one or
More than one input/output interface 805, one or more keyboards 806 etc..
In a specific embodiment, the monitoring device of data variation include memory and one or one with
On program, perhaps more than one program is stored in memory and one or more than one program can wrap for one of them
Include one or more modules, and each module may include that series of computation machine in monitoring device to data variation can
Information is executed instruction, and is configured to execute this by one or more than one processor or more than one program includes
For carrying out following computer executable instructions information:
Obtain the first service node generated business datum in processing business;
Whether detection business datum meets predetermined historical data feature detected rule;Wherein, historical data feature
Detected rule is determined based on history service data caused by the first service node;
If testing result instruction business datum does not meet historical data feature detected rule, sent to the second service node
Prompt information;Wherein, the data characteristics that prompt information is used to indicate business datum caused by the first service node changes;
Second service node is the downstream node of the first service node.
Optionally, computer executable instructions information when executed, is gone through if testing result instruction business datum is not met
History data characteristics detected rule, can also be performed following steps:
Determine data characteristics detected rule corresponding to business datum;
Data characteristics detected rule is added in historical data feature detected rule set;Wherein, historical data feature
It include each historical data feature detected rule in detected rule set.
Optionally, when executed, it is predetermined whether detection business datum meets computer executable instructions information
Historical data feature detected rule, comprising:
Determine the data characteristics of data value corresponding to each field in business datum;
Data characteristics corresponding to business datum is matched with each historical data feature detected rule respectively, with true
Determine whether business datum meets historical data feature detected rule.
Optionally, computer executable instructions information when executed, if business datum include can enumeration type field
With can not enumeration type field;
Determine data characteristics detected rule corresponding to business datum, comprising:
Determine in business datum can data value corresponding to the field of enumeration type, and, determining can not in business datum
Data feature description information corresponding to the field of enumeration type;
Data value and data characterization information are combined, the detection rule of data characteristics corresponding to business datum are obtained
Then.
Optionally, computer executable instructions information when executed, if history service data include can enumeration type
Field and can not enumeration type field;
Every historical data feature detected rule respectively as it is each can historical data values corresponding to the field of enumeration type
And it each historical data characterization information can not be composed corresponding to the field of enumeration type.
Optionally, computer executable instructions information when executed, obtains the first service node in processing business when institute
The business datum of generation, comprising:
In the first service node processing business, generated business datum is obtained from the first service node;
Alternatively, obtaining business datum from database;Wherein, the first service node is stored in database in processing business
When generated business datum.
Optionally, computer executable instructions information when executed, obtains the first service node in processing business when institute
Before the business datum of generation, method further include:
Obtain history service data corresponding to the first service node;
Historical data feature detected rule is determined based on history service data.
Optionally, computer executable instructions information when executed, determines historical data spy based on history service data
Levy detected rule, comprising:
History service data are formatted, the history service data of key-value form are obtained;Wherein, key table
Field is levied, value characterizes data value corresponding to field;
According to data value corresponding to each field, data characteristics corresponding to each field is determined;
Historical data feature detected rule is determined based on data characteristics corresponding to each field.
Optionally, computer executable instructions information when executed, according to data value corresponding to each field, determines each
Data characteristics corresponding to field, comprising:
If field be can enumeration type field, data value corresponding to field is determined as data corresponding to field
Feature;
If field be can not enumeration type field, determined corresponding to field according to data value corresponding to the field
Data feature description information corresponding to field is determined as data characteristics corresponding to field by data feature description information.
Optionally, computer executable instructions information when executed, is determined based on data characteristics corresponding to each field
Historical data feature detected rule, comprising:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combination knot is obtained
Fruit;
Every data feature combined result is determined as a historical data feature detected rule respectively.
The monitoring device for the data variation that this specification embodiment provides, by the first service node of detection in processing business
When generated business datum whether meet predetermined historical data feature detected rule, to monitor the first service node
Whether business datum feature changes, and may determine that whether the business model of the first service node is adjusted accordingly,
And when the business datum feature for monitoring the first service node changes, the second service node is notified in time, wherein the
Two service nodes are the downstream node of the first service node.The method provided by this specification embodiment, realizes to upstream
The monitoring of the business model of service node, so that the variation feelings of downstream traffic node timely learning upstream business node
Condition, to make corresponding adjustment in time, thus the generation for the case where reducing business processing failure.
Further, based on above-mentioned Fig. 1 to method shown in fig. 6, this specification embodiment additionally provides a kind of storage Jie
Matter, for storing computer executable instructions information, in a kind of specific embodiment, the storage medium can for USB flash disk, CD,
Hard disk etc., the computer executable instructions information of storage medium storage are able to achieve following below scheme when being executed by processor:
Obtain the first service node generated business datum in processing business;
Whether detection business datum meets predetermined historical data feature detected rule;Wherein, historical data feature
Detected rule is determined based on history service data caused by the first service node;
If testing result instruction business datum does not meet historical data feature detected rule, sent to the second service node
Prompt information;Wherein, the data characteristics that prompt information is used to indicate business datum caused by the first service node changes;
Second service node is the downstream node of the first service node.
Optionally, the computer executable instructions information of storage medium storage is when being executed by processor, if detection knot
Fruit instruction business datum does not meet historical data feature detected rule, and following steps can also be performed:
Determine data characteristics detected rule corresponding to business datum;
Data characteristics detected rule is added in historical data feature detected rule set;Wherein, historical data feature
It include each historical data feature detected rule in detected rule set.
Optionally, the computer executable instructions information of storage medium storage detects business when being executed by processor
Whether data meet predetermined historical data feature detected rule, comprising:
Determine the data characteristics of data value corresponding to each field in business datum;
Data characteristics corresponding to business datum is matched with each historical data feature detected rule respectively, with true
Determine whether business datum meets historical data feature detected rule.
Optionally, the computer executable instructions information of storage medium storage is when being executed by processor, if business number
According to include can enumeration type field and can not enumeration type field;
Determine data characteristics detected rule corresponding to business datum, comprising:
Determine in business datum can data value corresponding to the field of enumeration type, and, determining can not in business datum
Data feature description information corresponding to the field of enumeration type;
Data value and data characterization information are combined, the detection rule of data characteristics corresponding to business datum are obtained
Then.
Optionally, the computer executable instructions information of storage medium storage is when being executed by processor, if history industry
Business data include can enumeration type field and can not enumeration type field;
Every historical data feature detected rule respectively as it is each can historical data values corresponding to the field of enumeration type
And it each historical data characterization information can not be composed corresponding to the field of enumeration type.
Optionally, the computer executable instructions information of storage medium storage obtains first when being executed by processor
Service node generated business datum in processing business, comprising:
In the first service node processing business, generated business datum is obtained from the first service node;
Alternatively, obtaining business datum from database;Wherein, the first service node is stored in database in processing business
When generated business datum.
Optionally, the computer executable instructions information of storage medium storage obtains first when being executed by processor
Service node is in processing business before generated business datum, method further include:
Obtain history service data corresponding to the first service node;
Historical data feature detected rule is determined based on history service data.
Optionally, the computer executable instructions information of storage medium storage is based on history when being executed by processor
Business datum determines historical data feature detected rule, comprising:
History service data are formatted, the history service data of key-value form are obtained;Wherein, key table
Field is levied, value characterizes data value corresponding to field;
According to data value corresponding to each field, data characteristics corresponding to each field is determined;
Historical data feature detected rule is determined based on data characteristics corresponding to each field.
Optionally, the computer executable instructions information of storage medium storage is when being executed by processor, according to each word
Data value corresponding to section, determines data characteristics corresponding to each field, comprising:
If field be can enumeration type field, data value corresponding to field is determined as data corresponding to field
Feature;
If field be can not enumeration type field, determined corresponding to field according to data value corresponding to the field
Data feature description information corresponding to field is determined as data characteristics corresponding to field by data feature description information.
Optionally, the computer executable instructions information of storage medium storage is based on each word when being executed by processor
Data characteristics corresponding to section determines historical data feature detected rule, comprising:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combination knot is obtained
Fruit;
Every data feature combined result is determined as a historical data feature detected rule respectively.
The computer executable instructions information for the storage medium storage that this specification embodiment provides is being executed by processor
When, by detecting whether the first service node generated business datum in processing business meets predetermined historical data
Feature detected rule may determine that first to monitor whether the business datum feature of the first service node changes accordingly
Whether the business model of service node is adjusted, and is become in the business datum feature for monitoring the first service node
When change, the second service node is notified in time, wherein the second service node is the downstream node of the first service node.By this theory
The method that bright book embodiment provides, realizes the monitoring of the business model to upstream business node, so that downstream industry
The situation of change of business node timely learning upstream business node, to make corresponding adjustment in time, to reduce business processing
The generation of the case where failure.
In the 1990s, the improvement of a technology can be distinguished clearly be on hardware improvement (for example,
Improvement to circuit structures such as diode, transistor, switches) or software on improvement (improvement for method flow).So
And with the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit.
Designer nearly all obtains corresponding hardware circuit by the way that improved method flow to be programmed into hardware circuit.Cause
This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, programmable logic device
(Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate
Array, FPGA)) it is exactly such a integrated circuit, logic function determines device programming by user.By designer
Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, designs and makes without asking chip maker
Dedicated IC chip.Moreover, nowadays, substitution manually makes IC chip, this programming is also used instead mostly " is patrolled
Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development,
And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language
(Hardware Description Language, HDL), and HDL is also not only a kind of, but there are many kind, such as ABEL
(Advanced Boolean Expression Language)、AHDL(Altera Hardware Description
Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL
(Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby
Hardware Description Language) etc., VHDL (Very-High-Speed is most generally used at present
Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also answer
This understands, it is only necessary to method flow slightly programming in logic and is programmed into integrated circuit with above-mentioned several hardware description languages,
The hardware circuit for realizing the logical method process can be readily available.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing
The computer for the computer readable program code (such as software or firmware) that device and storage can be executed by (micro-) processor can
Read medium, logic gate, switch, specific integrated circuit (Application Specific Integrated Circuit,
ASIC), the form of programmable logic controller (PLC) and insertion microcontroller, the example of controller includes but is not limited to following microcontroller
Device: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320 are deposited
Memory controller is also implemented as a part of the control logic of memory.It is also known in the art that in addition to
Pure computer readable program code mode is realized other than controller, can be made completely by the way that method and step is carried out programming in logic
Controller is obtained to come in fact in the form of logic gate, switch, specific integrated circuit, programmable logic controller (PLC) and insertion microcontroller etc.
Existing identical function.Therefore this controller is considered a kind of hardware component, and to including for realizing various in it
The device of function can also be considered as the structure in hardware component.Or even, it can will be regarded for realizing the device of various functions
For either the software module of implementation method can be the structure in hardware component again.
System, device, module or the unit that above-described embodiment illustrates can specifically realize by computer chip or entity,
Or it is realized by the product with certain function.It is a kind of typically to realize that equipment is computer.Specifically, computer for example may be used
Think personal computer, laptop computer, cellular phone, camera phone, smart phone, personal digital assistant, media play
It is any in device, navigation equipment, electronic mail equipment, game console, tablet computer, wearable device or these equipment
The combination of equipment.
For convenience of description, it is divided into various units when description apparatus above with function to describe respectively.Certainly, implementing this
The function of each unit can be realized in the same or multiple software and or hardware when application.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is reference according to the method for this specification embodiment, the stream of equipment (system) and computer program product
Journey figure and/or block diagram describe.It should be understood that can be by computer program instructions information realization flowchart and/or the block diagram
The combination of process and/or box in each flow and/or block and flowchart and/or the block diagram.It can provide these calculating
Machine program instruction information is to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices
Processor is to generate a machine, so that the instruction executed by computer or the processor of other programmable data processing devices
Information generates specifies for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram
Function device.
These computer program instructions information, which may also be stored in, is able to guide computer or other programmable data processing devices
In computer-readable memory operate in a specific manner, so that command information stored in the computer readable memory produces
Raw includes the manufacture of command information device, the command information device realize in one or more flows of the flowchart and/or
The function of being specified in one or more blocks of the block diagram.
These computer program instructions information also can be loaded onto a computer or other programmable data processing device, so that
Series of operation steps are executed on a computer or other programmable device to generate computer implemented processing, thus calculating
The command information that is executed on machine or other programmable devices provide for realizing in one or more flows of the flowchart and/or
The step of function of being specified in one or more blocks of the block diagram.
In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net
Network interface and memory.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer-readable instruction information, data structure, the module of program or other numbers
According to.The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory
(SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only memory
(ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory techniques, CD-ROM are read-only
Memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or
Other magnetic storage devices or any other non-transmission medium, can be used for storage can be accessed by a computing device information.According to
Herein defines, and computer-readable medium does not include temporary computer readable media (transitory media), such as modulation
Data-signal and carrier wave.
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability
It include so that the process, method, commodity or the equipment that include a series of elements not only include those elements, but also to wrap
Include other elements that are not explicitly listed, or further include for this process, method, commodity or equipment intrinsic want
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including described want
There is also other identical elements in the process, method of element, commodity or equipment.
It will be understood by those skilled in the art that embodiments herein can provide as method, system or computer program product.
Therefore, complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in the application
Form.It is deposited moreover, the application can be used to can be used in the computer that one or more wherein includes computer usable program code
The shape for the computer program product implemented on storage media (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
Formula.
The application can computer executable instructions information it is general up and down described in the text, such as
Program module.Generally, program module include routines performing specific tasks or implementing specific abstract data types, it is program, right
As, component, data structure etc..The application can also be practiced in a distributed computing environment, in these distributed computing environment
In, by executing task by the connected remote processing devices of communication network.In a distributed computing environment, program module
It can be located in the local and remote computer storage media including storage equipment.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality
For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part explanation.
The above description is only an example of the present application, is not intended to limit this application.For those skilled in the art
For, various changes and changes are possible in this application.All any modifications made within the spirit and principles of the present application are equal
Replacement, improvement etc., should be included within the scope of the claims of this application.
Claims (16)
1. a kind of monitoring method of data variation, which comprises
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the historical data
Feature detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second service node
Send prompt information;Wherein, the prompt information is used to indicate the data of business datum caused by first service node
Feature changes;Second service node is the downstream node of first service node.
2. the method as described in claim 1, if testing result indicates that the business datum does not meet the historical data feature
Detected rule, the method also includes:
Determine data characteristics detected rule corresponding to the business datum;
The data characteristics detected rule is added in historical data feature detected rule set;Wherein, the historical data
It include each historical data feature detected rule in feature detected rule set.
3. the method as described in claim 1, it is special whether the detection business datum meets predetermined historical data
Levy detected rule, comprising:
Determine the data characteristics of data value corresponding to each field in the business datum;
Data characteristics corresponding to the business datum is matched with each historical data feature detected rule respectively, with true
Whether the fixed business datum meets the historical data feature detected rule.
4. method according to claim 2, if the business datum include can enumeration type field and can not enumeration type
Field;
Data characteristics detected rule corresponding to the determination business datum, comprising:
Determine in the business datum can data value corresponding to the field of enumeration type, and, determine in the business datum
It can not data feature description information corresponding to the field of enumeration type;
The data value and the data feature description information are combined, the spy of data corresponding to the business datum is obtained
Levy detected rule.
5. method according to any of claims 1-4, the first service node of the acquisition is generated in processing business
Business datum, comprising:
When first service node handles the business, generated business datum is obtained from first service node;
Alternatively, obtaining the business datum from database;Wherein, first service node is stored in the database to exist
Generated business datum when processing business.
6. method according to any of claims 1-4, the first service node of the acquisition is generated in processing business
Before business datum, the method also includes:
Obtain history service data corresponding to first service node;
The historical data feature detected rule is determined based on the history service data.
7. method as claimed in claim 6, described determine that the historical data feature detects based on the history service data
Rule, comprising:
The history service data are formatted, the history service data of key-value form are obtained;Wherein, key table
Field is levied, value characterizes data value corresponding to the field;
According to data value corresponding to each field, data characteristics corresponding to each field is determined;
The historical data feature detected rule is determined based on data characteristics corresponding to each field.
8. the method for claim 7, the data value according to corresponding to each field determines number corresponding to each field
According to feature, comprising:
If the field be can enumeration type field, it is right that data value corresponding to the field is determined as field institute
The data characteristics answered;
If the field be can not enumeration type field, the field institute is determined according to data value corresponding to the field
Corresponding data feature description information, data feature description information corresponding to the field is determined as corresponding to the field
Data characteristics.
9. the method for claim 7, described determine that the historical data is special based on data characteristics corresponding to each field
Levy detected rule, comprising:
Data characteristics corresponding to each field in every history service data is combined, data characteristics combined result is obtained;
Every data feature combined result is determined as a historical data feature detected rule respectively.
10. a kind of monitoring device of data variation, described device include:
First obtains module, for obtaining the first service node generated business datum in processing business;
Detection module, for detecting whether the business datum meets predetermined historical data feature detected rule;Wherein,
The historical data feature detected rule is determined based on history service data caused by first service node;
Sending module, if indicating that the business datum does not meet the historical data feature detected rule for testing result,
Prompt information is sent to the second service node;Wherein, the prompt information is used to indicate caused by first service node
The data characteristics of business datum changes;Second service node is the downstream node of first service node.
11. device as claimed in claim 10, if testing result indicates that the business datum does not meet the historical data spy
Levy detected rule, described device further include:
First determining module, for determining data characteristics detected rule corresponding to the business datum;
Adding module, for the data characteristics detected rule to be added in historical data feature detected rule set;Wherein,
It include each historical data feature detected rule in the historical data feature detected rule set.
12. device as claimed in claim 10, the detection module, comprising:
First determination unit, for determining the data characteristics of data value corresponding to each field in the business datum;
Matching unit, for respectively by data characteristics corresponding to the business datum and each historical data feature detected rule
It is matched, whether the historical data feature detected rule is met with the determination business datum.
13. device as claimed in claim 11, if the business datum include can enumeration type field and class can not be enumerated
The field of type;
The determining module, comprising:
Second determination unit, for determine in the business datum can data value corresponding to the field of enumeration type, and, really
It can not data feature description information corresponding to the field of enumeration type in the fixed business datum;
Assembled unit obtains being determined as the industry for the data value and the data feature description information to be combined
Data characteristics detected rule corresponding to data of being engaged in.
14. such as the described in any item devices of claim 10-13, described device further include:
Second obtains module, for obtaining history service data corresponding to first service node;
Second determining module, for determining the historical data feature detected rule based on the history service data.
15. a kind of monitoring device of data variation, comprising:
Processor;And
It is arranged to the memory of storage computer executable instructions, the executable instruction makes the processing when executed
Device:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the historical data
Feature detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second service node
Send prompt information;Wherein, the prompt information is used to indicate the data of business datum caused by first service node
Feature changes;Second service node is the downstream node of first service node.
16. a kind of storage medium, for storing computer executable instructions, the executable instruction is realized following when executed
Process:
Obtain the first service node generated business datum in processing business;
Detect whether the business datum meets predetermined historical data feature detected rule;Wherein, the historical data
Feature detected rule is determined based on history service data caused by first service node;
If testing result indicates that the business datum does not meet the historical data feature detected rule, to the second service node
Send prompt information;Wherein, the prompt information is used to indicate the data of business datum caused by first service node
Feature changes;Second service node is the downstream node of first service node.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910271980.1A CN110175084B (en) | 2019-04-04 | 2019-04-04 | Data change monitoring method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910271980.1A CN110175084B (en) | 2019-04-04 | 2019-04-04 | Data change monitoring method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110175084A true CN110175084A (en) | 2019-08-27 |
CN110175084B CN110175084B (en) | 2023-04-25 |
Family
ID=67689443
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910271980.1A Active CN110175084B (en) | 2019-04-04 | 2019-04-04 | Data change monitoring method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110175084B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112650762A (en) * | 2021-03-15 | 2021-04-13 | 腾讯科技(深圳)有限公司 | Data quality monitoring method and device, electronic equipment and storage medium |
CN112783799A (en) * | 2021-03-19 | 2021-05-11 | 中国工商银行股份有限公司 | Software daemon test method and device |
CN113468205A (en) * | 2021-06-29 | 2021-10-01 | 杭州每刻科技有限公司 | User-defined expense checking method and system |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004349776A (en) * | 2003-05-20 | 2004-12-09 | Yamaha Corp | Node control method, and node control apparatus and program |
US20050262097A1 (en) * | 2004-05-07 | 2005-11-24 | Sim-Tang Siew Y | System for moving real-time data events across a plurality of devices in a network for simultaneous data protection, replication, and access services |
US20090252174A1 (en) * | 2006-03-31 | 2009-10-08 | Matsushita Electric Industrial Co., Ltd. | message identification method and a relay node used by the method |
US20120089572A1 (en) * | 2010-10-06 | 2012-04-12 | International Business Machines Corporation | Automated and self-adjusting data protection driven by business and data activity events |
CN107704929A (en) * | 2016-08-08 | 2018-02-16 | 华为技术有限公司 | A kind of model update method and device |
CN108628947A (en) * | 2018-04-02 | 2018-10-09 | 阿里巴巴集团控股有限公司 | A kind of business rule matched processing method, device and processing equipment |
CN108780538A (en) * | 2016-03-23 | 2018-11-09 | 联邦快递服务公司 | The system, apparatus and method of broadcast setting for the node in self-adjusting wireless node network |
CN109104327A (en) * | 2018-06-08 | 2018-12-28 | 阿里巴巴集团控股有限公司 | A kind of business diary generation method, device and equipment |
-
2019
- 2019-04-04 CN CN201910271980.1A patent/CN110175084B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004349776A (en) * | 2003-05-20 | 2004-12-09 | Yamaha Corp | Node control method, and node control apparatus and program |
US20050262097A1 (en) * | 2004-05-07 | 2005-11-24 | Sim-Tang Siew Y | System for moving real-time data events across a plurality of devices in a network for simultaneous data protection, replication, and access services |
US20090252174A1 (en) * | 2006-03-31 | 2009-10-08 | Matsushita Electric Industrial Co., Ltd. | message identification method and a relay node used by the method |
US20120089572A1 (en) * | 2010-10-06 | 2012-04-12 | International Business Machines Corporation | Automated and self-adjusting data protection driven by business and data activity events |
CN108780538A (en) * | 2016-03-23 | 2018-11-09 | 联邦快递服务公司 | The system, apparatus and method of broadcast setting for the node in self-adjusting wireless node network |
CN107704929A (en) * | 2016-08-08 | 2018-02-16 | 华为技术有限公司 | A kind of model update method and device |
CN108628947A (en) * | 2018-04-02 | 2018-10-09 | 阿里巴巴集团控股有限公司 | A kind of business rule matched processing method, device and processing equipment |
CN109104327A (en) * | 2018-06-08 | 2018-12-28 | 阿里巴巴集团控股有限公司 | A kind of business diary generation method, device and equipment |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112650762A (en) * | 2021-03-15 | 2021-04-13 | 腾讯科技(深圳)有限公司 | Data quality monitoring method and device, electronic equipment and storage medium |
CN112650762B (en) * | 2021-03-15 | 2021-07-02 | 腾讯科技(深圳)有限公司 | Data quality monitoring method and device, electronic equipment and storage medium |
CN112783799A (en) * | 2021-03-19 | 2021-05-11 | 中国工商银行股份有限公司 | Software daemon test method and device |
CN112783799B (en) * | 2021-03-19 | 2024-05-17 | 中国工商银行股份有限公司 | Software daemon testing method and device |
CN113468205A (en) * | 2021-06-29 | 2021-10-01 | 杭州每刻科技有限公司 | User-defined expense checking method and system |
CN113468205B (en) * | 2021-06-29 | 2023-09-12 | 杭州每刻科技有限公司 | Custom expense checking method and system |
Also Published As
Publication number | Publication date |
---|---|
CN110175084B (en) | 2023-04-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108492124A (en) | Store information recommends method, apparatus and client | |
CN108664812A (en) | Information desensitization method, apparatus and system | |
CN110175084A (en) | The monitoring method and device of data variation | |
WO2021063045A1 (en) | Blockchain-based transaction query method, apparatus and device, and blockchain-based transaction data processing method, apparatus and device | |
CN110020427B (en) | Policy determination method and device | |
CN107424069A (en) | A kind of generation method of air control feature, risk monitoring and control method and apparatus | |
CN110245047B (en) | Time sequence abnormality detection method, device and equipment | |
CN110503435B (en) | Transaction early warning method, device and equipment based on blockchain | |
CN107094166A (en) | A kind of service information sending method and device | |
CN111461775B (en) | Method and device for determining influence of event on traffic | |
CN108108866A (en) | A kind of method and device of risk control | |
CN107066519A (en) | A kind of task detection method and device | |
WO2022161325A1 (en) | Prompting method and electronic device | |
CN110443457A (en) | Data processing method and device | |
CN110008991A (en) | The identification of risk case, risk identification model generation method and device | |
US20230087106A1 (en) | Tokenization request handling at a throttled rate in a payment network | |
CN110175156A (en) | The generation method and device of report | |
US11687598B2 (en) | Determining associations between services and computing assets based on alias term identification | |
CN109166021A (en) | Bookkeeping methods, device and business finance integral system | |
CN106293890B (en) | A kind of method and device for business processing based on complexity | |
CN110175832A (en) | A kind of intermediate account Fund Supervision method, system and equipment | |
CN109325035A (en) | The recognition methods of similar table and device | |
CN109039695B (en) | Service fault processing method, device and equipment | |
CN110059712A (en) | The detection method and device of abnormal data | |
CN110457430A (en) | A kind of Traceability detection method of text, device and equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |