CN106371984A - Data monitoring method, equipment and system - Google Patents
Data monitoring method, equipment and system Download PDFInfo
- Publication number
- CN106371984A CN106371984A CN201610781103.5A CN201610781103A CN106371984A CN 106371984 A CN106371984 A CN 106371984A CN 201610781103 A CN201610781103 A CN 201610781103A CN 106371984 A CN106371984 A CN 106371984A
- Authority
- CN
- China
- Prior art keywords
- data
- monitoring
- monitored
- monitoring rules
- rules
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/323—Visualisation of programs or trace data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention provides a data monitoring method, equipment and system, which belong to the technical field of computers. The data monitoring method comprises the steps of receiving data monitoring requests for different data sources, and analyzing monitoring rule key words and to-be-monitored data identifications from the data monitoring requests; obtaining monitoring rules corresponding to the monitoring rule key words from a rule base; obtaining a plurality of data sets corresponding to the to-be-monitored data identifications from the different data sources; monitoring the plurality of data sets according to the monitoring rules; sending abnormal data to a user terminal when monitoring results indicate that the plurality of data sets are the abnormal data. Thus, data of the different data sources can be uniformly monitored, the data monitoring difficulty is reduced, and the monitoring execution efficiency is improved.
Description
Technical field
The present invention relates to computer realm, particularly to a kind of data monitoring method, equipment and system.
Background technology
Application with e-commerce technology and constantly maturation, during electric business operation, based on computer technology
Operation system need data volume to be processed to be continuously increased, in order to control the operation conditions of each operation system in real time, it is right to need
Data in operation system carries out monitor in real time, thus providing safeguard for normal operation activity.
At present, the mode that regulation engine is usually used realizes operation system is monitored, and regulation engine is built-in should
With the assembly in program, it is capable of separating operational decision making from the application code of an operation system, and makes
Write operational decision making with predefined semantic modules.It is all stand-alone development yet with each operation system, using data base's
May be different, the storage organization of data may be also different, need to be respectively adopted the regulation engine that each operation system is suitable for and just can enter
Row data monitoring, therefore, prior art presence does not enable unification and different pieces of information source data is monitored, and data monitoring is difficult
The problem that degree is larger, monitoring execution efficiency is relatively low.
Content of the invention
In order to realize unification, different pieces of information source data is monitored, reduces data monitoring difficulty, and improve monitoring
Execution efficiency, embodiments provides a kind of data monitoring method, equipment and system.Described technical scheme is as follows:
A kind of first aspect, there is provided data monitoring method, methods described includes:
Receive the data monitoring request for different data sources, and go out monitoring rules from described data monitoring request analysis and close
Key word and Data Identification to be monitored；
The corresponding monitoring rules of described monitoring rules keyword are obtained from rule base；
The corresponding multiple data acquisition systems of described Data Identification to be monitored are obtained from described different data sources；
According to described monitoring rules, the plurality of data acquisition system is monitored；
When monitored results indicate that the plurality of data acquisition system is abnormal data, send described abnormal data to user eventually
End.
In conjunction with a first aspect, in the first possible implementation, described monitoring rules keyword at least includes monitoring
Rule name, monitoring rules description, one of monitoring rules formula, described to obtain described monitoring rules from rule base crucial
The corresponding monitoring rules of word include:
According to the matching degree of described monitoring keyword and described monitoring rules, obtain described from the rule base pre-building
The corresponding monitoring rules of monitoring rules keyword.
In conjunction with the first possible implementation of first aspect, in the possible implementation of second, described from
Obtain the corresponding multiple data acquisition systems of described Data Identification to be monitored in described different data sources to include:
According to described monitoring rules and described Data Identification to be monitored, determine that described Data Identification to be monitored is corresponding multiple
Data source；
The corresponding multiple data acquisition systems of described Data Identification to be monitored are obtained from the plurality of data source.
In conjunction with the possible implementation of the second of first aspect, in the third possible implementation, described from
Obtain the corresponding multiple data acquisition systems of described Data Identification to be monitored in the plurality of data source to include:
Judge whether the plurality of data source is application programming interface tables of data or data file, if it is determined that being, then
Data pick-up is carried out to the plurality of data source；
Data conversion is carried out to the data after extracting；
Generate the corresponding the plurality of data acquisition system of described Data Identification to be monitored.
In conjunction with the third possible implementation of first aspect, in the 4th kind of possible implementation, described
According to described monitoring rules the plurality of data acquisition system is monitored including:
Obtain rule script corresponding with described monitoring rules；
The plurality of data acquisition system is write in described rule script, and executes described rule script.
Second aspect, there is provided a kind of electronic equipment, described equipment includes:
Receiver module, for receiving the data monitoring request for different data sources；
Parsing module, for going out monitoring rules keyword and Data Identification to be monitored from described data monitoring request analysis；
First acquisition module, for obtaining the corresponding monitoring rules of described monitoring rules keyword from rule base；
Second acquisition module, for obtaining the corresponding many numbers of described Data Identification to be monitored from described different data sources
According to set；
Monitoring module, for being monitored to the plurality of data acquisition system according to described monitoring rules；
Sending module, for when monitored results indicate that the plurality of data acquisition system is abnormal data, sending described exception
Data is to user terminal.
In conjunction with second aspect, in the first possible implementation, described monitoring rules keyword includes monitoring rules
Title, monitoring rules description, at least one of monitoring rules formula, described first acquisition module specifically for:
According to the matching degree of described monitoring keyword and described monitoring rules, obtain described from the rule base pre-building
The corresponding monitoring rules of monitoring rules keyword.
In conjunction with the first possible implementation of second aspect, in the possible implementation of second, described
Two acquisition modules include:
Described second acquisition module includes:
Determination sub-module, for according to described monitoring rules and described Data Identification to be monitored, determining described number to be monitored
According to the corresponding multiple data sources of mark；
Acquisition submodule, for obtaining the corresponding multiple data of described Data Identification to be monitored from the plurality of data source
Set.
In conjunction with the possible implementation of the second of second aspect, in the third possible implementation, described obtain
Submodule is taken to include:
Identifying unit, for judging whether the plurality of data source is application programming interface tables of data or data literary composition
Part, if it is determined that being, then carries out data pick-up to the plurality of data source；
Date Conversion Unit, for carrying out data conversion to the data after extracting；
Data acquisition system signal generating unit, for generating the corresponding the plurality of data acquisition system of described Data Identification to be monitored.
In conjunction with second aspect the third possible implementation in, in the 4th kind of possible implementation, described
Monitoring module includes:
Rule script acquisition submodule, for obtaining rule script corresponding with described monitoring rules；
Rule script implementation sub-module, for writing the plurality of data acquisition system in described rule script, and executes institute
State rule script.
The third aspect, there is provided a kind of electronic equipment it is characterised in that described electronic equipment include memorizer and with institute
State memorizer connection processor, wherein, described memorizer is used for storing batch processing code, described processor call described in deposit
The program code that reservoir is stored is used for executing following operation:
Receive the data monitoring request for different data sources, and go out monitoring rules from described data monitoring request analysis and close
Key word and Data Identification to be monitored；
The corresponding monitoring rules of described monitoring rules keyword are obtained from rule base；
The corresponding multiple data acquisition systems of described Data Identification to be monitored are obtained from described different data sources；
According to described monitoring rules, the plurality of data acquisition system is monitored；
When monitored results indicate that the plurality of data acquisition system is abnormal data, send described abnormal data to user eventually
End.
In conjunction with the third aspect, in the first possible implementation, described monitoring rules keyword includes monitoring rules
At least one of title, monitoring rules description, monitoring rules formula, described processor calls the journey that described memorizer is stored
Sequence code is used for executing following operation:
According to the matching degree of described monitoring keyword and described monitoring rules, obtain described from the rule base pre-building
The corresponding monitoring rules of monitoring rules keyword.
In conjunction with the first possible implementation of the third aspect, in the possible implementation of second, described place
Reason device calls the program code that described memorizer is stored to be used for executing following operation:
According to described monitoring rules and described Data Identification to be monitored, determine that described Data Identification to be monitored is corresponding multiple
Data source；
The corresponding multiple data acquisition systems of described Data Identification to be monitored are obtained from the plurality of data source.
In conjunction with the possible implementation of the second of the third aspect, in the third possible implementation, described place
Reason device calls the program code that described memorizer is stored to be used for executing following operation:
Judge whether described different data sources are application programming interface tables of data or data file, if it is determined that being, then
Data pick-up is carried out to described different data sources；
Data conversion is carried out to the data after extracting；
Generate the corresponding the plurality of data acquisition system of described Data Identification to be monitored.
In conjunction with the third possible implementation of the third aspect, in the 4th kind of possible implementation, described place
Reason device calls the program code that described memorizer is stored to be used for executing following operation:
Obtain rule script corresponding with described monitoring rules；
The plurality of data acquisition system is write in described rule script, and executes described rule script.
A kind of fourth aspect, there is provided data monitoring system, described system includes:
Receiving device, for receiving the data monitoring request for different data sources；
Analyzing device, for going out monitoring rules keyword and Data Identification to be monitored from described data monitoring request analysis；
First acquisition equipment, for obtaining the corresponding monitoring rules of described monitoring rules keyword from rule base；
Second acquisition equipment, for obtaining the corresponding many numbers of described Data Identification to be monitored from described different data sources
According to set；
Monitoring device, for being monitored to the plurality of data acquisition system according to described monitoring rules；
Transmission equipment, for when monitored results indicate that the plurality of data acquisition system is abnormal data, sending described exception
Data is to user terminal.
In conjunction with fourth aspect, in the first possible implementation, described monitoring rules keyword includes monitoring rules
Title, monitoring rules description, at least one of monitoring rules formula, described first obtain equipment specifically for:
According to the matching degree of described monitoring keyword and described monitoring rules, obtain described from the rule base pre-building
The corresponding monitoring rules of monitoring rules keyword.
In conjunction with the first possible implementation of fourth aspect, in the possible implementation of second, described
Two acquisition equipment include:
Really stator-device, for according to described monitoring rules and described Data Identification to be monitored, determining described number to be monitored
According to the corresponding multiple data sources of mark；
Obtain sub- equipment, for obtaining the corresponding multiple data of described Data Identification to be monitored from the plurality of data source
Set.
In conjunction with the possible implementation of the second of fourth aspect, in the third possible implementation, described obtain
Sub- equipment is taken to include:
Determination module, for judging whether described different data sources are application programming interface tables of data or data literary composition
Described different data sources if it is determined that being, are then carried out data pick-up by part；
Data conversion module, for carrying out data conversion to the data after extracting；
Data acquisition system generation module, for generating the corresponding the plurality of data acquisition system of described Data Identification to be monitored.
In conjunction with fourth aspect the third possible implementation in, in the 4th kind of possible implementation, described
Monitoring device includes:
Rule script obtains sub- equipment, for obtaining rule script corresponding with described monitoring rules；
Rule script executes sub- equipment, for writing the plurality of data acquisition system in described rule script, and executes institute
State rule script.
Embodiments provide a kind of data monitoring method, equipment and system, comprising: receive and be directed to different data sources
Data monitoring request, data monitoring request at least include monitoring rules keyword and Data Identification to be monitored；From rule base
Obtain the corresponding monitoring rules of monitoring rules keyword；The corresponding many numbers of Data Identification to be monitored are obtained from different data sources
According to set；According to monitoring rules, multiple data acquisition systems are monitored；When monitored results indicate that multiple data acquisition systems are abnormal number
According to when, send abnormal data to user terminal.From there through parsing data monitoring request, be layman provide simply,
Flexibly with easily mode of operation it is achieved that the data monitoring that layman passes through to input natural language form is asked to difference
Operation system carry out the purpose of data monitoring；By obtaining the corresponding monitoring rules of monitoring rules keyword from rule base,
Need not move through manual type and determine monitoring rules from substantial amounts of monitoring rules it is achieved that automatically obtaining monitoring rules, improve
The execution efficiency of monitoring；By obtaining the corresponding multiple data acquisition systems of Data Identification to be monitored from different data sources, multiple
Data acquisition system derives from different data sources, and then improves the compatibility of the data monitoring across operation system；By monitoring rules
Multiple data acquisition systems are monitored it is achieved that regulation engine is not limited to single operation system, can not only be to same business
The historical data of system carries out longitudinal monitoring, and multi-platform, multisystem data laterally can be monitored, and which thereby enhances
Regular recycling rate of waterused data monitoring range, it is achieved that unification is monitored to different pieces of information source data, reduces data prison
Control difficulty, and improve monitoring execution efficiency；By sending abnormal data to user terminal, reach the operation of prompting data monitoring
The purpose of personnel, and make data monitoring operator find the data quality problem that operation system exists in advance, to avoid causing
Bigger loss.
Brief description
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, will make to required in embodiment description below
Accompanying drawing be briefly described it should be apparent that, drawings in the following description are only some embodiments of the present invention, for
For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings
Accompanying drawing.
Fig. 1 is a kind of data monitoring method flow chart provided in an embodiment of the present invention；
Fig. 2 is a kind of data monitoring method flow chart provided in an embodiment of the present invention；
Fig. 3 is a kind of electronic equipment structural representation provided in an embodiment of the present invention；
Fig. 4 is a kind of electronic equipment structural representation provided in an embodiment of the present invention；
Fig. 5 is a kind of data monitoring system structural representation provided in an embodiment of the present invention.
Specific embodiment
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached in the embodiment of the present invention
Figure, is clearly and completely described to the technical scheme in the embodiment of the present invention it is clear that described embodiment is only this
Invent a part of embodiment, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art exist
The every other embodiment being obtained under the premise of not making creative work, broadly falls into the scope of protection of the invention.
Embodiments provide a kind of data monitoring method, the method is applied to the data base in different business systems
Scene under, can realize across operation system, data being monitored according to the request of the data monitoring of user.In addition, the party
Method can also be applied to during ecommerce, under the scene that multiple e-commerce platforms interconnect and carry out data interaction,
Or, in the interconnection of multiple operation systems and carry out data interaction scene under, realize to from multiple e-commerce platforms or
The business datum of multiple operation systems is monitored, and the data of this operation system can be sales data, supplier data, commodity
Data, order data, user data, data on flows etc..
Embodiment one is a kind of data monitoring method provided in an embodiment of the present invention, and with reference to shown in Fig. 1, the method includes:
101st, receive the data monitoring request for different data sources, it is crucial that data monitoring request at least includes monitoring rules
Word and Data Identification to be monitored.
102nd, the corresponding monitoring rules of monitoring rules keyword are obtained from rule base.
Specifically, monitoring rules keyword include monitoring rules title, monitoring rules description, in monitoring rules formula extremely
Few one, according to the matching degree of monitoring keyword and monitoring rules, obtain monitoring rules from the rule base pre-building crucial
The corresponding monitoring rules of word.
103rd, the corresponding multiple data acquisition systems of Data Identification to be monitored are obtained from different data sources.
Specifically, according to described monitoring rules and described Data Identification to be monitored, determine described Data Identification pair to be monitored
The multiple data sources answered；
The corresponding multiple data acquisition systems of described Data Identification to be monitored are obtained from the plurality of data source.
Wherein, the corresponding multiple data acquisition systems of described Data Identification to be monitored, this mistake are obtained from the plurality of data source
Journey may include that
Judge whether multiple data sources are application programming interface tables of data or data file, if it is determined that being, then to many
Individual data source carries out data pick-up；
Data conversion is carried out to the data after extracting；
Generate the corresponding multiple data acquisition systems of Data Identification to be monitored.
104th, according to monitoring rules, multiple data acquisition systems are monitored.
Obtain rule script corresponding with monitoring rules；
Multiple data acquisition systems are write in rule script, and executing rule script.
105th, when monitored results indicate that multiple data acquisition systems are abnormal data, send abnormal data to user terminal.
Optionally, in addition to the foregoing steps, the method that the embodiment of the present invention is provided can also include:
Preserve abnormal data to exception database
Embodiments provide a kind of data monitoring method, by parsing data monitoring request, be layman
Provide that simple, flexibly and easily mode of operation is it is achieved that layman passes through to input the data prison of natural language form
Control request carries out the purpose of data monitoring to different operation systems；Corresponded to by obtaining monitoring rules keyword from rule base
Monitoring rules, need not move through manual type determine monitoring rules from substantial amounts of monitoring rules it is achieved that automatically obtain prison
Regulatory control then, improves the execution efficiency of monitoring；By obtaining the corresponding many numbers of Data Identification to be monitored from different data sources
According to set, multiple data acquisition systems derive from different data sources, and then improve the compatibility of the data monitoring across operation system；Logical
Cross monitoring rules and multiple data acquisition systems are monitored it is achieved that regulation engine is not limited to single operation system, can not only
Longitudinal monitoring is carried out to the historical data of same operation system, and multi-platform, multisystem data laterally can be monitored,
Which thereby enhance regular recycling rate of waterused data monitoring range it is achieved that unification is monitored to different pieces of information source data, fall
Low data monitoring difficulty, and improve monitoring execution efficiency；By sending abnormal data to user terminal, reach prompting number
According to the purpose of policer operation personnel, and data monitoring operator are made to find the data quality problem that operation system exists in advance,
To avoid causing bigger loss.
Embodiment two is a kind of data monitoring method provided in an embodiment of the present invention, and with reference to shown in Fig. 2, the method includes:
201st, receive the data monitoring request for different data sources, and go out monitoring rules from data monitoring request analysis and close
Key word and Data Identification to be monitored.
Wherein, data source (data source) is to provide the device of data or original media required for certain.In data source
In store all set up data base connection information, file can be found in file system as by designated file name
Equally, by providing correct DSN, corresponding data base can be found and connect.The type of data source can include number
According to storehouse, application programming interface tables of data (api interface) data file three types, the such as conventional mysql of data base
Storehouse, oracle storehouse, hive storehouse etc., application programming interface tables of data refers to deposit in the tables of data of certain api interface sensing,
Data file refers to the data preserving in the form of a file.
Data monitoring request can serve to indicate that and the multiple business datums in different data sources are monitored, the plurality of industry
Business data can include flow data, sales data, supplier data, commodity data, user data, order data and logistics number
According to etc..
Specifically, the data monitoring request of receiving user's input；According to predetermined resolution rules data monitoring is asked into
Row parsing, obtains monitoring rules keyword and Data Identification to be monitored.Wherein, this data monitoring request is in client by user
The information of the data monitoring interface input that end provides generates, and this information can be with user data monitoring interface on the client
The natural language that for description, different data sources are carried out with data monitoring of input, according to the input information of this natural language form
Generate data monitoring request.The embodiment of the present invention is not limited to specific resolving.
Wherein, monitoring rules keyword can be in monitoring rules title, monitoring rules description or monitoring rules formula
Any one.Data Identification to be monitored is used for limiting data to be monitored, and this data to be monitored can be the field of value type,
Data Identification to be monitored can pass through additional period term restriction data to be monitored.
Optionally, data monitoring request can also include the monitoring execution time of user input, and this effective monitoring time is used
Execution time in the monitor task controlling based on data monitoring request.Exemplary, the zero crossing time of next day is set to supervise
Control execution time, if the time reaches this time point, data monitoring task is carried out.
By the present invention, receive and the data monitoring of the natural language form of user input is asked and parsed, pass through
Parsing data monitoring request, thus ensure that simplification and the motility of layman's operation.
202nd, the matching degree of analysis monitoring rule keyword and each monitoring rules in the rule base pre-building.
Specifically, monitoring rules keyword include monitoring rules title, monitoring rules description, in monitoring rules formula extremely
Few one, determine each monitoring rules in rule base and rule base according to monitoring rules keyword corresponding rule base type,
Wherein rule base includes the first rule base and Second Rule storehouse, and the first rule base is included for carrying out data to multiple data acquisition systems
Multiple monitoring rules of inquiry, Second Rule storehouse includes the multiple monitoring rule for multiple data acquisition systems are carried out with comparing
Then.
Compared with the characteristic information of monitoring rules each in rule base respectively by monitoring rules keyword, determine monitoring
Regular keyword and the matching degree of each monitoring rules, and matching degree sequence is carried out according to matching degree height.
203rd, according to matching degree, the corresponding monitoring rules of monitoring rules keyword are obtained from rule base.
Specifically, determine that matching degree highest monitoring rules are the corresponding monitoring rules of monitoring rules keyword, and from rule
Then obtain this monitoring rules in storehouse.
By the present invention, analyzed according to matching degree, and then quickly get corresponding monitoring from substantial amounts of monitoring rules
Rule is it is achieved that automatically obtain monitoring rules from rule base, it is to avoid arduously screen monitoring rule during policer operation personal services
Then, thus improve the execution efficiency of data monitoring.
The embodiment of the present invention is not limited to specific acquisition modes.
It should be noted that step 202 to step 203 is that realization acquisition monitoring rules keyword from rule base is corresponding
The process of monitoring rules, in addition to the mode of above-mentioned steps, can also realize this process, the present invention is implemented by other means
Example is not limited to specific mode.
204th, according to monitoring rules and Data Identification to be monitored, the corresponding multiple data sources of Data Identification to be monitored are determined.
Specifically, the embodiment of the present invention is not limited to specific determination mode.
205th, judge whether multiple data sources are application programming interface tables of data or data file, if it is determined that being, then
Data pick-up is carried out to multiple data sources.
Specifically, this process may include that
According to the type information of data source, judge whether this data source is application programming interface tables of data or data literary composition
Part；
If it is determined that being, then entered from data source is for application programming interface tables of data or data file according to decimation rule
Row data pick-up.Wherein, this decimation rule is set in advance, can multiple extracted data, such as data source is data file,
3 secondary data, extracted data from data file 1 for the first time, second extracted data from data file 2 are extracted in setting.This
Bright embodiment is not limited to specific extraction process.
It should be noted that if it is determined that data source is data base, then carrying out to multiple data sources without in execution step 205
The process of data pick-up and step 206, direct execution step 207.Wherein, data base can be mysql storehouse, oracle storehouse,
Hive storehouse etc..
206th, data conversion is carried out to the data after extracting.
Specifically, target dataform is become to the data conversion after extracting.
The embodiment of the present invention is not limited to specific data conversion process.
207th, the corresponding multiple data acquisition systems of Data Identification to be monitored are generated.
Wherein, multiple business datums are included in multiple data acquisition systems, during the plurality of business datum is asked with data monitoring
The monitoring data field comprising is corresponding, exemplary, multiple data acquisition systems can include sales data, supplier data,
Commodity data etc..Multiple data acquisition systems can be the data of the same entity of description, for example, for the merchandise news of certain part clothes,
Data of data, the data of purchasing system offer and form ordering system providing from provider system etc. can be provided, and above-mentioned
Data is the related data information describing this part clothes, and this related data information can be the title of clothes, quantity on order, list
The related data such as valency and total price.
Specifically, corresponding for Data Identification to be monitored multiple business datums are generated multiple data acquisition systems.
The embodiment of the present invention is not limited to specific generating process.
It should be noted that step 205 to step 207 is to realize obtaining Data Identification pair to be monitored from multiple data sources
The process of the multiple data acquisition systems answered, in addition to the mode of above-mentioned steps, can also realize this process by other means, this
Inventive embodiments are not limited to specific mode.
By the present invention, judge whether different data sources are application programming interface tables of data or data file, if sentencing
Surely it is then data pick-up to be carried out to different data sources；And data conversion is carried out to the data after extracting, generate data to be monitored
Identify corresponding multiple data acquisition system it is achieved that obtaining the corresponding multiple data sets of Data Identification to be monitored from different data sources
Close, thus achieve cross-platform, carry out data monitoring across operation system, improve and carried out to across operation system using regulation engine
The compatibility of data monitoring.
208th, obtain rule script corresponding with monitoring rules.
Specifically, rule script is realized by the programming language of service logic, wherein, programming language can include pyke,
Python and sql etc., pyke and python can combine together, can from python Calling pyke it is also possible to
In pyke program, add sentence and the expression formula of python, and use sql returning result.The embodiment of the present invention is to specific
Acquisition modes are not limited.
It should be noted that after the corresponding rule script of this monitoring rules is write and preserved by a user, this prison
Regulatory control is then equally applicable to the call operation of follow-up other users.
209th, multiple data acquisition systems are write in rule script, and executing rule script.
Specifically, multiple data acquisition systems are delivered in rule script as parameter, based on default rule trigger event
Executing rule script, wherein, rule triggering events can be triggered the monitoring execution time comprising in data monitoring request
, the embodiment of the present invention is not limited to specific executive mode.
It should be noted that step 208 to step 209 is to realize according to monitoring rules, multiple data acquisition systems being monitored
Process, in addition to the mode of above-mentioned steps, this process can also be realized by other means, the embodiment of the present invention is to concrete
Mode be not limited.
210th, when monitored results indicate that multiple data acquisition systems are abnormal data, send abnormal data to user terminal.
Specifically, multiple data acquisition systems are judged in the implementing result returning according to rule script whether as abnormal data, if
Monitoring rules instruction carries out data query to multiple data acquisition systems, then whether inquired according to sql is that negative value judges many numbers
Whether it is abnormal data according to set；If monitoring rules instruction carries out comparing to multiple data acquisition systems, according to rule script
Whether the diversity ratio comprising in the implementing result returning judges multiple data acquisition systems with the comparative result of default monitoring threshold value
For abnormal data, wherein it is possible to indicate implementing result state by using status indicator.
For example, user wants whether a field monitoring in multiple data acquisition systems is less than 0, if a < 0, is judged to abnormal number
According to after executing corresponding rule script, output result comprises a sql sentence (select a from tablename
Where a < 0), the data volume of the data total amount of a field and a < 0.
Again for example, user want to monitor certain field in multiple data acquisition systems in a data source whether with b data source
In equal, if unequal, be judged to abnormal data, wherein unequal can represent that predetermined threshold value is 0 it is also possible to represent pre-
If threshold value is 5%, that is, the diversity ratio of a and b is more than 5%, or other predetermined threshold value.Export after executing corresponding rule script
The abnormal data amount that diversity ratio, the data total amount of data to be monitored and the diversity ratio of a and b are more than 5% is comprised in result.
Specifically, the process realizing transmission abnormal data to user terminal may include that
The alarm email sending instruction abnormal data is to user terminal；And/or
The short message alarm sending instruction abnormal data is to user terminal.
Wherein, user terminal can include desk computer, personal computer, above-knee property computer, mobile phone, individual digital
Assistant etc..
Optionally, method can also include:
Stop updating the operation system that there is abnormal data, and send the alarm notification of instruction abnormal data to other business
System.
By the present invention, when there is abnormal data, stop updating the data of the operation system that there is abnormal data, and
Send alarm notification to other operation systems to stop calling abnormal data, on the one hand avoid data and take machine resources, separately
On the one hand ensured the quality of data of other operation systems.
Optionally, in addition to the foregoing steps, the method that the embodiment of the present invention is provided can also include:
Preserve abnormal data to exception database.
By the present invention, abnormal data is preserved to exception database, so that related personnel is subsequently carried out to abnormal data
Analysis.
Because current business system is various and may be using different data sources so that cannot be according to the monitoring demand of user
Realize carrying out unified monitoring across operation system to data；Or so that regulation engine is constrained by certain operation system, and not
Other operation systems can be suitable for, and pass through the method that the embodiment of the present invention is provided, by parsing data monitoring request, be non-special
Industry personnel provide that simple, flexibly and easily mode of operation is it is achieved that layman passes through to input natural language form
Data monitoring request carries out the purpose of data monitoring to different operation systems；Crucial by obtaining monitoring rules from rule base
The corresponding monitoring rules of word, need not move through manual type and determine monitoring rules from substantial amounts of monitoring rules it is achieved that automatically
Obtain monitoring rules, improve the execution efficiency of monitoring；Corresponding by obtaining Data Identification to be monitored from different data sources
Multiple data acquisition systems, multiple data acquisition systems derive from different data sources, and then improve across operation system data monitoring simultaneous
Capacitive；By monitoring rules, multiple data acquisition systems are monitored it is achieved that regulation engine is not limited to single operation system, no
Only longitudinal monitoring can be carried out to the historical data of same operation system, and horizontal stroke can be carried out to multi-platform, multisystem data
To monitoring, which thereby enhance regular recycling rate of waterused data monitoring range it is achieved that unification is carried out to different pieces of information source data
Monitoring, reduces data monitoring difficulty, and improves monitoring execution efficiency；By sending abnormal data to user terminal, reach
Remind the purpose of data monitoring operator, and make data monitoring operator find the data matter that operation system exists in advance
Amount problem, to avoid causing bigger loss.
Embodiment three is a kind of electronic equipment 3 provided in an embodiment of the present invention, and with reference to shown in Fig. 3, this equipment is as to base
Operation system in different data sources carries out data monitoring device, both may be located at client it is also possible to be located at server end, also
Can be neither to be located at client nor the autonomous device being located at server end, this equipment 3 includes:
Receiver module 31, for receiving the data monitoring request for different data sources；
Parsing module 32, for going out monitoring rules keyword and Data Identification to be monitored from data monitoring request analysis；
First acquisition module 33, for obtaining the corresponding monitoring rules of monitoring rules keyword from rule base；
Second acquisition module 34, for obtaining the corresponding multiple data sets of Data Identification to be monitored from different data sources
Close；
Monitoring module 35, for being monitored to multiple data acquisition systems according to monitoring rules；
Sending module 36, for when monitored results indicate that multiple data acquisition systems are abnormal data, sending abnormal data extremely
User terminal.
Optionally, monitoring rules keyword include monitoring rules title, monitoring rules description, in monitoring rules formula extremely
Few one, the first acquisition module concrete 33 is used for:
According to the matching degree of monitoring keyword and monitoring rules, obtain monitoring rules from the rule base pre-building crucial
The corresponding monitoring rules of word.
Optionally, the second acquisition module 34 includes:
Determination sub-module 341, for according to described monitoring rules and described Data Identification to be monitored, determining described to be monitored
The corresponding multiple data sources of Data Identification；
Acquisition submodule 342, corresponding multiple for obtaining described Data Identification to be monitored from the plurality of data source
Data acquisition system.
Optionally, acquisition submodule 342 includes:
Identifying unit 3421, for judging whether multiple data sources are application programming interface tables of data or data literary composition
Multiple data sources if it is determined that being, are then carried out data pick-up by part；
Date Conversion Unit 3422, for carrying out data conversion to the data after extracting；
Data acquisition system signal generating unit 3423, for generating the corresponding multiple data acquisition systems of Data Identification to be monitored.
Optionally, monitoring module 35 includes:
Rule script acquisition submodule 351, for obtaining rule script corresponding with monitoring rules；
Rule script implementation sub-module 352, for multiple data acquisition systems are write in rule script, and executing rule foot
This.
Embodiments provide a kind of electronic equipment, this electronic equipment passes through to parse data monitoring request, be non-special
Industry personnel provide that simple, flexibly and easily mode of operation is it is achieved that layman passes through to input natural language form
Data monitoring request carries out the purpose of data monitoring to different operation systems；Crucial by obtaining monitoring rules from rule base
The corresponding monitoring rules of word, need not move through manual type and determine monitoring rules from substantial amounts of monitoring rules it is achieved that automatically
Obtain monitoring rules, improve the execution efficiency of monitoring；Corresponding by obtaining Data Identification to be monitored from different data sources
Multiple data acquisition systems, multiple data acquisition systems derive from different data sources, and then improve across operation system data monitoring simultaneous
Capacitive；By monitoring rules, multiple data acquisition systems are monitored it is achieved that regulation engine is not limited to single operation system, no
Only longitudinal monitoring can be carried out to the historical data of same operation system, and horizontal stroke can be carried out to multi-platform, multisystem data
To monitoring, which thereby enhance regular recycling rate of waterused data monitoring range it is achieved that unification is carried out to different pieces of information source data
Monitoring, reduces data monitoring difficulty, and improves monitoring execution efficiency；By sending abnormal data to user terminal, reach
Remind the purpose of data monitoring operator, and make data monitoring operator find the data matter that operation system exists in advance
Amount problem, to avoid causing bigger loss.
Example IV is a kind of electronic equipment 4 provided in an embodiment of the present invention, and with reference to shown in Fig. 4, this electronic equipment 4 includes
Memorizer 41 and the processor 42 being connected with memorizer 41, wherein, memorizer 41 is used for storing batch processing code, processor
42 call the program code that memorizer 41 is stored to be used for executing following operation:
Receive the data monitoring request for different data sources, and go out monitoring rules keyword from data monitoring request analysis
With Data Identification to be monitored；
The corresponding monitoring rules of monitoring rules keyword are obtained from rule base；
The corresponding multiple data acquisition systems of Data Identification to be monitored are obtained from different data sources；
According to monitoring rules, multiple data acquisition systems are monitored；
When monitored results indicate that multiple data acquisition systems are abnormal data, send abnormal data to user terminal.
Optionally, monitoring rules keyword include monitoring rules title, monitoring rules description, in monitoring rules formula extremely
Few one, processor 42 calls the program code that memorizer 41 is stored to be used for executing following operation:
According to the matching degree of monitoring keyword and monitoring rules, obtain monitoring rules from the rule base pre-building crucial
The corresponding monitoring rules of word.
Optionally, processor 42 calls the program code that memorizer 41 is stored to be used for executing following operation:
According to described monitoring rules and described Data Identification to be monitored, determine that described Data Identification to be monitored is corresponding multiple
Data source；
The corresponding multiple data acquisition systems of described Data Identification to be monitored are obtained from the plurality of data source.
Optionally, processor 42 calls the program code that memorizer 41 is stored to be used for executing following operation:
Judge whether multiple data sources are application programming interface tables of data or data file, if it is determined that being, then to many
Individual data source carries out data pick-up；
Data conversion is carried out to the data after extracting；
Generate the corresponding multiple data acquisition systems of Data Identification to be monitored.
Optionally, processor 42 calls the program code that memorizer 41 is stored to be used for executing following operation:
Obtain rule script corresponding with monitoring rules；
Multiple data acquisition systems are write in rule script, and executing rule script.
Embodiments provide a kind of electronic equipment, this electronic equipment passes through to parse data monitoring request, be non-special
Industry personnel provide that simple, flexibly and easily mode of operation is it is achieved that layman passes through to input natural language form
Data monitoring request carries out the purpose of data monitoring to different operation systems；Crucial by obtaining monitoring rules from rule base
The corresponding monitoring rules of word, need not move through manual type and determine monitoring rules from substantial amounts of monitoring rules it is achieved that automatically
Obtain monitoring rules, improve the execution efficiency of monitoring；Corresponding by obtaining Data Identification to be monitored from different data sources
Multiple data acquisition systems, multiple data acquisition systems derive from different data sources, and then improve across operation system data monitoring simultaneous
Capacitive；By monitoring rules, multiple data acquisition systems are monitored it is achieved that regulation engine is not limited to single operation system, no
Only longitudinal monitoring can be carried out to the historical data of same operation system, and horizontal stroke can be carried out to multi-platform, multisystem data
To monitoring, which thereby enhance regular recycling rate of waterused data monitoring range it is achieved that unification is carried out to different pieces of information source data
Monitoring, reduces data monitoring difficulty, and improves monitoring execution efficiency；By sending abnormal data to user terminal, reach
Remind the purpose of data monitoring operator, and make data monitoring operator find the data matter that operation system exists in advance
Amount problem, to avoid causing bigger loss.
Embodiment five is a kind of data monitoring system 5 provided in an embodiment of the present invention, and with reference to shown in Fig. 5, this system 5 is wrapped
Include:
Receiving device 51, for receiving the data monitoring request for different data sources；
Analyzing device 52, for going out monitoring rules keyword and Data Identification to be monitored from data monitoring request analysis；
First acquisition equipment 53, for obtaining the corresponding monitoring rules of monitoring rules keyword from rule base；
Second acquisition equipment 54, for obtaining the corresponding multiple data sets of Data Identification to be monitored from different data sources
Close；
Monitoring device 55, for being monitored to multiple data acquisition systems according to monitoring rules；
Transmission equipment 56, for when monitored results indicate that multiple data acquisition systems are abnormal data, sending abnormal data extremely
User terminal.
Optionally, monitoring rules keyword include monitoring rules title, monitoring rules description, in monitoring rules formula extremely
Few one, the first acquisition equipment concrete 53 is used for:
According to the matching degree of monitoring keyword and monitoring rules, obtain monitoring rules from the rule base pre-building crucial
The corresponding monitoring rules of word.
Optionally, the second acquisition equipment 54 includes:
Really stator-device 541, for according to described monitoring rules and described Data Identification to be monitored, determining described to be monitored
The corresponding multiple data sources of Data Identification；
Obtain sub- equipment 542, corresponding multiple for obtaining described Data Identification to be monitored from the plurality of data source
Data acquisition system.
Optionally, obtain sub- equipment 542 to include:
Determination module 5421, for judging whether multiple data sources are application programming interface tables of data or data literary composition
Multiple data sources if it is determined that being, are then carried out data pick-up by part；
Data conversion module 5422, for carrying out data conversion to the data after extracting；
Data acquisition system generation module 5423, for generating the corresponding multiple data acquisition systems of Data Identification to be monitored.
Optionally, monitoring device 55 includes:
Rule script obtains sub- equipment 551, for obtaining rule script corresponding with monitoring rules；
Rule script executes sub- equipment 552, for multiple data acquisition systems are write in rule script, and executing rule foot
This.
Embodiments provide a kind of data monitoring system, this system is passed through to parse data monitoring request, be non-special
Industry personnel provide that simple, flexibly and easily mode of operation is it is achieved that layman passes through to input natural language form
Data monitoring request carries out the purpose of data monitoring to different operation systems；Crucial by obtaining monitoring rules from rule base
The corresponding monitoring rules of word, need not move through manual type and determine monitoring rules from substantial amounts of monitoring rules it is achieved that automatically
Obtain monitoring rules, improve the execution efficiency of monitoring；Corresponding by obtaining Data Identification to be monitored from different data sources
Multiple data acquisition systems, multiple data acquisition systems derive from different data sources, and then improve across operation system data monitoring simultaneous
Capacitive；By monitoring rules, multiple data acquisition systems are monitored it is achieved that regulation engine is not limited to single operation system, no
Only longitudinal monitoring can be carried out to the historical data of same operation system, and horizontal stroke can be carried out to multi-platform, multisystem data
To monitoring, which thereby enhance regular recycling rate of waterused data monitoring range it is achieved that unification is carried out to different pieces of information source data
Monitoring, reduces data monitoring difficulty, and improves monitoring execution efficiency；By sending abnormal data to user terminal, reach
Remind the purpose of data monitoring operator, and make data monitoring operator find the data matter that operation system exists in advance
Amount problem, to avoid causing bigger loss.
Above-mentioned all optional technical schemes, can be using the alternative embodiment arbitrarily combining to form the present invention, and here is no longer
Repeat one by one.
It should be understood that the electronic equipment that above-described embodiment provides is when executing data monitoring method, only with above-mentioned each
The division of functional module is illustrated, and in practical application, can distribute above-mentioned functions by different work(as desired
Module can complete, the internal structure of equipment will be divided into different functional modules, with complete described above all or portion
Divide function.In addition, the data monitoring method that above-described embodiment provides belongs to same design with electronic equipment embodiment, it is specifically real
Existing process refers to embodiment of the method, repeats no more here.
One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can pass through hardware
To complete it is also possible to the hardware being instructed correlation by program is completed, described program can be stored in a kind of computer-readable
In storage medium, storage medium mentioned above can be read only memory, disk or CD etc..
The foregoing is only presently preferred embodiments of the present invention, not in order to limit the present invention, all spirit in the present invention and
Within principle, any modification, equivalent substitution and improvement made etc., should be included within the scope of the present invention.
Claims (11)
1. a kind of data monitoring method is it is characterised in that methods described includes:
Receive the data monitoring request for different data sources, and go out monitoring rules keyword from described data monitoring request analysis
With Data Identification to be monitored；
The corresponding monitoring rules of described monitoring rules keyword are obtained from rule base；
The corresponding multiple data acquisition systems of described Data Identification to be monitored are obtained from described different data sources；
According to described monitoring rules, the plurality of data acquisition system is monitored；
When monitored results indicate that the plurality of data acquisition system is abnormal data, send described abnormal data to user terminal.
2. method according to claim 1 it is characterised in that described monitoring rules keyword include monitoring rules title,
Monitoring rules description, at least one of monitoring rules formula, described obtain described monitoring rules keyword pair from rule base
The monitoring rules answered include:
Analyze the matching degree of described monitoring rules keyword and each monitoring rules in the rule base pre-building；
According to described matching degree, obtain the corresponding monitoring rules of described monitoring rules keyword from described rule base.
3. method according to claim 2 it is characterised in that described obtain from described different data sources described to be monitored
The corresponding multiple data acquisition systems of Data Identification include:
According to described monitoring rules and described Data Identification to be monitored, determine the corresponding multiple data of described Data Identification to be monitored
Source；
The corresponding multiple data acquisition systems of described Data Identification to be monitored are obtained from the plurality of data source.
4. method according to claim 3 it is characterised in that described obtain from the plurality of data source described to be monitored
The corresponding multiple data acquisition systems of Data Identification include:
Judge whether the plurality of data source is application programming interface tables of data or data file, if it is determined that being, then to institute
State multiple data sources and carry out data pick-up；
Data conversion is carried out to the data after extracting；
Generate the corresponding the plurality of data acquisition system of described Data Identification to be monitored.
5. method according to claim 4 it is characterised in that described according to described monitoring rules to the plurality of data set
Conjunction be monitored including:
Obtain rule script corresponding with described monitoring rules；
The plurality of data acquisition system is write in described rule script, and executes described rule script.
6. a kind of electronic equipment is it is characterised in that described equipment includes:
Receiver module, for receiving the data monitoring request for different data sources；
Parsing module, for and go out monitoring rules keyword and Data Identification to be monitored from described data monitoring request analysis；
First acquisition module, for obtaining the corresponding monitoring rules of described monitoring rules keyword from rule base；
Second acquisition module, for obtaining the corresponding multiple data sets of described Data Identification to be monitored from described different data sources
Close；
Monitoring module, for being monitored to the plurality of data acquisition system according to described monitoring rules；
Sending module, for when monitored results indicate that the plurality of data acquisition system is abnormal data, sending described abnormal data
To user terminal.
7. equipment according to claim 6 it is characterised in that described monitoring rules keyword include monitoring rules title,
Monitoring rules description, at least one of monitoring rules formula, described first acquisition module specifically for:
According to described monitoring keyword and the matching degree of described monitoring rules, obtain described monitoring from the rule base pre-building
The corresponding monitoring rules of regular keyword.
8. equipment according to claim 7 is it is characterised in that described second acquisition module includes:
Determination sub-module, for according to described monitoring rules and described Data Identification to be monitored, determining described data mark to be monitored
Know corresponding multiple data source；
Acquisition submodule, for obtaining the corresponding multiple data sets of described Data Identification to be monitored from the plurality of data source
Close.
9. equipment according to claim 8 is it is characterised in that described acquisition submodule includes:
Identifying unit, for judging whether the plurality of data source is application programming interface tables of data or data file, if
Judgement is then to carry out data pick-up to the plurality of data source；
Date Conversion Unit, for carrying out data conversion to the data after extracting；
Data acquisition system signal generating unit, for generating the corresponding the plurality of data acquisition system of described Data Identification to be monitored.
10. equipment according to claim 9 is it is characterised in that described monitoring module includes:
Rule script acquisition submodule, for obtaining rule script corresponding with described monitoring rules；
Rule script implementation sub-module, for writing the plurality of data acquisition system in described rule script, and executes described rule
Then script.
A kind of 11. data monitoring systems are it is characterised in that described system includes:
Receiving device, for receiving the data monitoring request for different data sources；
Analyzing device, for going out monitoring rules keyword and Data Identification to be monitored from described data monitoring request analysis；
First acquisition equipment, for obtaining the corresponding monitoring rules of described monitoring rules keyword from rule base；
Second acquisition equipment, for obtaining the corresponding multiple data sets of described Data Identification to be monitored from described different data sources
Close；
Monitoring device, for being monitored to the plurality of data acquisition system according to described monitoring rules；
Transmission equipment, for when monitored results indicate that the plurality of data acquisition system is abnormal data, sending described abnormal data
To user terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610781103.5A CN106371984B (en) | 2016-08-31 | 2016-08-31 | A kind of data monitoring method, equipment and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610781103.5A CN106371984B (en) | 2016-08-31 | 2016-08-31 | A kind of data monitoring method, equipment and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106371984A true CN106371984A (en) | 2017-02-01 |
| CN106371984B CN106371984B (en) | 2019-03-26 |
Family
ID=57900528
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610781103.5A Active CN106371984B (en) | 2016-08-31 | 2016-08-31 | A kind of data monitoring method, equipment and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106371984B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107896170A (en) * | 2017-11-08 | 2018-04-10 | 平安科技（深圳）有限公司 | Insure the monitoring method and device of application system |
| CN108133050A (en) * | 2018-01-17 | 2018-06-08 | 北京网信云服信息科技有限公司 | A kind of extracting method of data, system and device |
| CN108229183A (en) * | 2017-12-06 | 2018-06-29 | 链家网（北京）科技有限公司 | A kind of business datum monitoring method and its monitoring device |
| CN109032884A (en) * | 2018-06-11 | 2018-12-18 | 平安科技（深圳）有限公司 | A kind of processing method of monitoring data, server and computer readable storage medium |
| CN109165213A (en) * | 2018-09-29 | 2019-01-08 | 浙江大学 | Data preprocessing method based on customized Groovy script configuration file |
| CN109408499A (en) * | 2018-10-22 | 2019-03-01 | 福建星瑞格软件有限公司 | A kind of auditing method and system of matching database access user |
| CN110297739A (en) * | 2019-06-04 | 2019-10-01 | 平安科技（深圳）有限公司 | The data monitoring method and relevant device of platform are administered based on data |
| CN110297742A (en) * | 2019-07-04 | 2019-10-01 | 北京百佑科技有限公司 | Data monitoring system, method and server |
| CN110555150A (en) * | 2019-09-09 | 2019-12-10 | 江苏满运软件科技有限公司 | Data monitoring method, device, equipment and storage medium |
| CN110855556A (en) * | 2019-11-14 | 2020-02-28 | 哈工大机器人湖州国际创新研究院 | Monitoring processing method and device, electronic equipment and computer storage medium |
| CN111143163A (en) * | 2019-12-13 | 2020-05-12 | 上海硬通网络科技有限公司 | Data monitoring method and device, computer equipment and storage medium |
| CN111369354A (en) * | 2018-12-25 | 2020-07-03 | 航天信息股份有限公司 | Data monitoring method and device for block chain application and storage medium |
| CN114500320A (en) * | 2022-02-15 | 2022-05-13 | 平安证券股份有限公司 | Data monitoring method and device, electronic equipment and computer readable storage medium |
| WO2023245893A1 (en) * | 2022-06-24 | 2023-12-28 | 深圳前海微众银行股份有限公司 | Monitoring method and device, and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104636483A (en) * | 2015-02-16 | 2015-05-20 | 广东省公安厅 | Data monitoring method |
| CN104636484A (en) * | 2015-02-16 | 2015-05-20 | 广东省公安厅 | Monitoring task generating method and device based on data monitoring |
| US20150150023A1 (en) * | 2013-11-22 | 2015-05-28 | Decooda International, Inc. | Emotion processing systems and methods |
| CN105447046A (en) * | 2014-09-02 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Distributed system data consistency processing method, device and system |
| CN105808655A (en) * | 2016-02-26 | 2016-07-27 | 广州品唯软件有限公司 | Processing method, device and system for mass data anomaly checking |
-
2016
- 2016-08-31 CN CN201610781103.5A patent/CN106371984B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150150023A1 (en) * | 2013-11-22 | 2015-05-28 | Decooda International, Inc. | Emotion processing systems and methods |
| CN105447046A (en) * | 2014-09-02 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Distributed system data consistency processing method, device and system |
| CN104636483A (en) * | 2015-02-16 | 2015-05-20 | 广东省公安厅 | Data monitoring method |
| CN104636484A (en) * | 2015-02-16 | 2015-05-20 | 广东省公安厅 | Monitoring task generating method and device based on data monitoring |
| CN105808655A (en) * | 2016-02-26 | 2016-07-27 | 广州品唯软件有限公司 | Processing method, device and system for mass data anomaly checking |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107896170B (en) * | 2017-11-08 | 2019-12-03 | 平安科技（深圳）有限公司 | Insure the monitoring method and device of application system |
| CN107896170A (en) * | 2017-11-08 | 2018-04-10 | 平安科技（深圳）有限公司 | Insure the monitoring method and device of application system |
| CN108229183A (en) * | 2017-12-06 | 2018-06-29 | 链家网（北京）科技有限公司 | A kind of business datum monitoring method and its monitoring device |
| CN108133050A (en) * | 2018-01-17 | 2018-06-08 | 北京网信云服信息科技有限公司 | A kind of extracting method of data, system and device |
| CN109032884A (en) * | 2018-06-11 | 2018-12-18 | 平安科技（深圳）有限公司 | A kind of processing method of monitoring data, server and computer readable storage medium |
| CN109032884B (en) * | 2018-06-11 | 2021-05-28 | 平安科技（深圳）有限公司 | Monitoring data processing method, server and computer readable storage medium |
| CN109165213A (en) * | 2018-09-29 | 2019-01-08 | 浙江大学 | Data preprocessing method based on customized Groovy script configuration file |
| CN109408499B (en) * | 2018-10-22 | 2022-10-11 | 福建星瑞格软件有限公司 | Auditing method and system for matching database access users |
| CN109408499A (en) * | 2018-10-22 | 2019-03-01 | 福建星瑞格软件有限公司 | A kind of auditing method and system of matching database access user |
| CN111369354A (en) * | 2018-12-25 | 2020-07-03 | 航天信息股份有限公司 | Data monitoring method and device for block chain application and storage medium |
| CN110297739A (en) * | 2019-06-04 | 2019-10-01 | 平安科技（深圳）有限公司 | The data monitoring method and relevant device of platform are administered based on data |
| CN110297742A (en) * | 2019-07-04 | 2019-10-01 | 北京百佑科技有限公司 | Data monitoring system, method and server |
| CN110297742B (en) * | 2019-07-04 | 2023-12-19 | 北京百佑科技有限公司 | Data monitoring system, method and server |
| CN110555150A (en) * | 2019-09-09 | 2019-12-10 | 江苏满运软件科技有限公司 | Data monitoring method, device, equipment and storage medium |
| CN110555150B (en) * | 2019-09-09 | 2022-10-14 | 江苏满运软件科技有限公司 | Data monitoring method, device, equipment and storage medium |
| CN110855556A (en) * | 2019-11-14 | 2020-02-28 | 哈工大机器人湖州国际创新研究院 | Monitoring processing method and device, electronic equipment and computer storage medium |
| CN111143163A (en) * | 2019-12-13 | 2020-05-12 | 上海硬通网络科技有限公司 | Data monitoring method and device, computer equipment and storage medium |
| CN111143163B (en) * | 2019-12-13 | 2024-04-16 | 上海硬通网络科技有限公司 | Data monitoring method, device, computer equipment and storage medium |
| CN114500320A (en) * | 2022-02-15 | 2022-05-13 | 平安证券股份有限公司 | Data monitoring method and device, electronic equipment and computer readable storage medium |
| WO2023245893A1 (en) * | 2022-06-24 | 2023-12-28 | 深圳前海微众银行股份有限公司 | Monitoring method and device, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106371984B (en) | 2019-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106371984A (en) | Data monitoring method, equipment and system | |
| CN106371973B (en) | A kind of data processing method, equipment and system | |
| AU2013263085B2 (en) | System and methods for social data sharing capabilities for enterprise information systems | |
| CN105704005B (en) | Malicious user reporting method and device, and reported information processing method and device | |
| CN102043702A (en) | Event monitoring method as well as rule engine device and system | |
| CN100384161C (en) | Method and system for processing service behaviour abnormal | |
| CN112580914A (en) | Method and device for realizing enterprise-level data middling platform system for collecting multi-source data | |
| CN113157947A (en) | Knowledge graph construction method, tool, device and server | |
| WO2016153464A1 (en) | Analysis of information in a combination of a structured database and an unstructured database | |
| CN108959294B (en) | Method and device for accessing search engine | |
| CN113434742A (en) | Account screening method and device, storage medium and electronic device | |
| US7991661B1 (en) | Method and system for providing market analysis for wireless voice markets | |
| CN109828883B (en) | Task data processing method and device, storage medium and electronic device | |
| CN116208579A (en) | Information pushing method, device, equipment and storage medium | |
| CN114298565A (en) | Big data software recommendation method based on downloaded file | |
| JP5401577B2 (en) | Computing that analyzes the credit of telephone users based on the current usage of telephone numbers and past survey history using the analysis method specified by the survey client | |
| CN112016340A (en) | Invoice head-up information automatic identification system and method | |
| CN110096666A (en) | The method and device of data processing | |
| CN109635074A (en) | A kind of entity relationship analysis method and terminal device based on public feelings information | |
| US11811857B1 (en) | SaaS application contract terms benchmarking in a SaaS management platform | |
| CN114866603B (en) | Information pushing method and device, electronic equipment and storage medium | |
| CN112016081B (en) | Method, device, medium and electronic equipment for realizing identifier mapping | |
| CN110196794B (en) | Operation log processing method and system based on express cabinet | |
| CN116132583A (en) | Information processing method and device | |
| CN115687284A (en) | Information processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220111 Address after: 510000 Room 601, 128 Dingxin Road, Haizhu District, Guangzhou City, Guangdong Province (office only) Patentee after: Vipshop (Guangzhou) Software Co.,Ltd. Address before: 510145 No. 314, Fangcun Avenue, Liwan District, Guangzhou City, Guangdong Province Patentee before: GUANGZHOU PINWEI SOFTWARE Co.,Ltd. |