CN110069378A - Data monitoring method, device, terminal and computer readable storage medium - Google Patents
Data monitoring method, device, terminal and computer readable storage medium Download PDFInfo
- Publication number
- CN110069378A CN110069378A CN201910200498.9A CN201910200498A CN110069378A CN 110069378 A CN110069378 A CN 110069378A CN 201910200498 A CN201910200498 A CN 201910200498A CN 110069378 A CN110069378 A CN 110069378A
- Authority
- CN
- China
- Prior art keywords
- deletions
- additions
- traffic table
- database
- change
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
Abstract
The invention discloses a kind of data monitoring method, data monitoring device, terminal and computer readable storage mediums, this method comprises: obtaining the system table of database at interval of preset time, the database includes and the corresponding traffic table of the database function and traffic table corresponding with the traffic table identify, and the system table includes that the additions and deletions for each traffic table for recording and updating in real time when user's operation is interacted with the database change and look into number；It extracts each traffic table mark and additions and deletions corresponding with traffic table mark changes and look into number；Changed according to the additions and deletions extracted look into number processing be shown for chart.The present invention relates to software supervision fields, change the technical issues of looking into number and generating diagrammatic representation, the prior art is avoided to carry out data monitoring by analysis more detailed logging, influence database performance by obtaining additions and deletions.
Description
Technical field
The present invention relates to data monitoring statistical technique field more particularly to a kind of data monitoring method, device, terminal and meters
Calculation machine readable storage medium storing program for executing.
Background technique
In the prior art, using monitoring system front monitoring front-end user behavior and front end page failure exception.Current monitoring
The working method of system be open more detailed logging to obtain each SQL query statement by the data in called data library, and
Using each SQL query statement as the data source of abnormal monitoring, but the corresponding function in called data library will affect database
Write-in and reading performance, and using all complete SQL statements as needing to carry out each keyword after data source
Dismantling and analysis, engineer is for statistical analysis to log, high labor cost.
Therefore, how to solve the problems, such as that monitoring system influences database write-in and reading performance, become urgently to be resolved at present
The technical issues of.
Summary of the invention
The main purpose of the present invention is to provide a kind of data monitoring method, device, terminal and computer-readable storage mediums
Matter, it is intended to solve the technical issues of existing monitoring system influences database write-in, reading performance.
To achieve the above object, the present invention proposes that a kind of data monitoring method, the data monitoring method include:
The system table of database is obtained at interval of preset time, the database includes corresponding with the database function
Traffic table and traffic table corresponding with traffic table mark, the system table includes that user's operation and the database occur
The additions and deletions for each traffic table for recording and updating in real time when interaction, which change, looks into number；
It extracts each traffic table mark and additions and deletions corresponding with traffic table mark changes and look into number；
Changed according to the additions and deletions extracted look into number processing be shown for chart.
Further, the data monitoring method is used for distributed system, and the distributed system includes multiple servers；
The step of system table that database is obtained at interval of preset time, comprising:
The system table of the corresponding database of each server in the distributed system is obtained at interval of preset time；
The historical data of the same database is compared with the system table, is obtained each described in the system table
The modification information of traffic table, the modification information include that the additions and deletions change and look into number；
Nodal information is increased to the modification information, the nodal information includes acquisition time and the corresponding clothes of the database
Business device mark.
Further, the step of system table that database is obtained at interval of preset time, further includes:
The change data after nodal information will be increased and carry out data conversion, handled as standardized data, and store.
Further, the additions and deletions that the basis is extracted, which change, looks into the step of number processing is shown for chart, packet
It includes:
The additions and deletions extracted are changed and looks into number and is analyzed to obtain base table by the visual analyzing software；
The keyword for obtaining user's input, the chart generated according to data corresponding with the keyword in the base table
It is shown.
Further, the additions and deletions that the basis is extracted change look into number processing the step of being shown for chart it
Afterwards, further includes:
According to preset threshold table, inquires the traffic table and identify corresponding first preset threshold；
Judge that the additions and deletions of the traffic table in the preset time change and looks into whether number is greater than first preset threshold；
If the additions and deletions of the traffic table, which change, looks into number greater than first preset threshold, generating includes the traffic table mark
The warning message of knowledge.
Further, the additions and deletions for judging the traffic table in the preset time, which change, looks into whether number is greater than first in advance
If after the step of threshold value, further includes:
If the additions and deletions of the traffic table, which change, looks into number less than or equal to first preset threshold, according to the default threshold
It is worth table, inquires the traffic table and identify corresponding second preset threshold；
Judge that the additions and deletions of the traffic table in the preset time change to look into the change rate of number whether to be greater than described second pre-
If threshold value；
If the additions and deletions of the traffic table change the change rate for looking into number greater than second preset threshold, generate comprising described
The warning message of traffic table mark.
Further, the step of generation includes the warning message of the traffic table mark, comprising:
The corresponding nodal information is identified according to the traffic table of the traffic table, determines that the traffic table is corresponding described
Server；
According to contacts list is prestored, the server corresponding engineering teacher contact details are searched；
By engineer's contact details, the warning message is sent to engineer.
In addition, the present invention also provides a kind of data monitoring device, the data monitoring device includes:
Obtain module, the system table for obtaining module and being used to obtain database at interval of preset time, the system table
In include and the corresponding traffic table of the database function, traffic table corresponding with the traffic table mark and user grasp
The additions and deletions for making each traffic table for recording and updating in real time when interacting with the database, which change, looks into number；
Extraction module, the additions and deletions that the extraction module is used to extract each traffic table, which change, looks into number；
Generation module, the generation module look into number by visual analyzing software for changing the additions and deletions extracted
Carry out deployment displaying.
In addition, the present invention also provides a kind of terminal, the terminal includes processor, memory and is stored in described deposit
The data monitoring program that can be executed by the processor on reservoir, wherein the data monitoring program is held by the processor
When row, the step of realizing data monitoring method as the aforementioned.
The present invention also provides a kind of computer readable storage medium, data are stored on the computer readable storage medium
Monitoring programme, wherein when the data monitoring program is executed by processor, realize as described in any one of claims 1 to 7
The step of data monitoring method.
In technical solution of the present invention, change by obtaining additions and deletions and look into number, thus judge the modification of each traffic table, access,
The number of write-in is increased sharply to avoid network flow, is visited to be monitored to the realization of database, the corresponding function of traffic table
Ask that busy caused user experience is bad；Changed by inquiry additions and deletions and look into number progress data monitoring, so as to avoid the prior art
In by opening more detailed logging monitoring, the technical issues of influencing server performance, it is thus also avoided that daily record data statistical analysis causes
Monitoring software secondary development complexity technical problem.
Detailed description of the invention
Fig. 1 is the hardware structural diagram of terminal involved in the embodiment of the present invention；
Fig. 2 is the flow diagram of data monitoring method first embodiment of the present invention；
Fig. 3 is the flow diagram of data monitoring method second embodiment of the present invention；
Fig. 4 is the flow diagram of data monitoring method 3rd embodiment of the present invention；
Fig. 5 is the flow diagram of data monitoring method fourth embodiment of the present invention；
Fig. 6 is the flow diagram of the 5th embodiment of data monitoring method of the present invention；
Fig. 7 is the flow diagram of data monitoring method sixth embodiment of the present invention；
Fig. 8 is the part flow diagram of the 7th embodiment of data monitoring method of the present invention；
Fig. 9 is the module diagram of data monitoring device of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The present embodiments relate to data monitoring method be applied to terminal, the terminal have show and processing function
Equipment can be server；It can also be portable computer, such as ipad, laptop etc..The present embodiments relate to
Data monitoring method is also used to monitoring distributed system.
Referring to Fig.1, Fig. 1 is terminal structure schematic diagram involved in the embodiment of the present invention.In the embodiment of the present invention, eventually
End may include processor 1001 (such as CPU), communication bus 1002, user interface 1003, network interface 1004, memory
1005.Wherein, communication bus 1002 is for realizing the connection communication between these components；User interface 1003 may include display
Shield (Display), input unit such as keyboard (Keyboard)；Network interface 1004 optionally may include that the wired of standard connects
Mouth, wireless interface (such as WI-FI interface)；Memory 1005 can be high speed RAM memory, be also possible to stable memory
(non-volatile memory), such as magnetic disk storage, memory 1005 optionally can also be independently of aforementioned processor
1001 storage device.
It will be understood by those skilled in the art that hardware configuration shown in Fig. 1 does not constitute the restriction to equipment, can wrap
It includes than illustrating more or fewer components, perhaps combines certain components or different component layouts.
With continued reference to Fig. 1, the memory 1005 in Fig. 1 as a kind of computer readable storage medium may include operation system
System, network communication module and data monitoring program.
In Fig. 1, network communication module is mainly used for connecting each server in distributed system, carries out with server
Data communication；And processor 1001 can call the data monitoring program stored in memory 1005, and execute data monitoring side
The step of method.
Based on the hardware configuration of above-mentioned terminal, each embodiment of data monitoring method of the present invention is proposed.
The present invention provides a kind of data monitoring method.
Referring to Fig. 2, in the first embodiment of the invention, data monitoring method the following steps are included:
Step S100, the system table of database is obtained at interval of preset time, and the database includes and the database
The corresponding traffic table of function, traffic table corresponding with traffic table mark, the system table include user's operation with it is described
The additions and deletions that each traffic table for recording and updating in real time when interaction occurs for database, which change, looks into number；
Specifically, it is provided with database in server, to realize the function to be realized of server, can be looked by structuring
It askes language (Structured Query Language, SQL) and writes query function to obtain initial data from each database.
System table is the table that the information such as data dictionary and internal structure, data statistics are used to store in database, and system table can be by front end
User is recorded and is updated in real time to the number of the interactive operation of database when submitting data, and interactive operation includes increasing, deleting
It removes, change and inquires, change in initial data including additions and deletions and look into number, i.e., the interactive operation of increase, deletion, change and inquiry is secondary
Number.It include multiple business boards in database, each traffic table table corresponds to a function of front end or entire operation system, system table
Middle record has the corresponding additions and deletions of each traffic table to change to look into number.In system table additions and deletions change look into number record be when based on interaction behaviour
When the data of work are stored to database, or when executing trigger, each traffic table is increased by the record function built in database
It revises the accumulator looked into add up, wherein trigger refers to a kind of storing process of specific type, its execution is by event
Trigger, for example it will be activated to execute when operating to a table, operation specifically can be insert, delete or
The sentences such as update.
Those skilled in the art self-setting preset time, the preset time can be minute or second according to actual needs
Rank.
Step S200, each traffic table mark of extraction and additions and deletions corresponding with traffic table mark, which change, looks into number；
Step S300, changed according to the additions and deletions extracted look into number processing be shown for chart.
Visual analyzing software, which is shown, changes the corresponding additions and deletions of each traffic table specifically by visual analyzing software
It looks into number to be handled, be shown with meeting user's habit or directly handling according to user instructions for chart, interface, with advantageous
It is further analyzed, is handled it based on chart in user.Specifically usable Elasticsearch, Logstash and
Kibana2 (hereinafter referred to as ELK) carries out data displaying as visual analyzing software, and ELK is third party's open source software, can support
The interface UI statistical analysis summarizes and shows function.
For example, finding that the data writing of some traffic table is abnormal or counts according to the chart that visual analyzing software is shown
It is abnormal (can be growth or reduction) according to amount of access, it can the traffic table is issued and is alerted, and where positioning the traffic table
Server, so that staff handles the server, the corresponding business function of server；It is soft according to visual analyzing
The chart that part is shown finds that the total amount of data of traffic table in database is much smaller than data access amount, it is believed that the database lacks
Weary suitable index, needs to optimize；According to the chart that visual analyzing software is shown, it has also been found that there is no data to ask
The traffic table asked can be deleted and be filed to the traffic table, and database storage resources are saved；It has also been found that data write-in
Biggish traffic table is measured, to be filed in time to its data, and excellent to corresponding database, application program progress performance
Change.
In the present invention, change by obtaining additions and deletions and look into number, to judge the modification of each traffic table, access, write-in
Number, to be monitored to the realization of database, the corresponding function of traffic table, increase sharply to avoid network flow, access it is busy
Caused user experience is bad；Changed by inquiry additions and deletions and look into number progress data monitoring, so as to avoid passing through in the prior art
The technical issues of opening more detailed logging monitoring, influencing server performance, it is thus also avoided that monitoring caused by daily record data statistical analysis
The technical problem of software secondary development complexity.
Further, referring to figure 3., Fig. 3 is the flow diagram of data monitoring method second embodiment of the present invention, is based on
First embodiment, the data monitoring method are used for distributed system, and the distributed system includes multiple servers；Step
S100 includes:
Step S110 obtains the corresponding database of each server in the distributed system at interval of preset time
System table；
Specifically, the query function for being used to obtain initial data can be deployed in each server of distributed system,
To obtain the system table of each database respectively.
The historical data of the same database is compared with the system table, obtains the system by step S120
The modification information of table, the modification information include that the additions and deletions change and look into number；
Step S130 increases nodal information to the modification information, and the nodal information includes acquisition time and the number
It is identified according to library corresponding server.
For distributed system, corresponding data acquisition cutting and transmission group can be disposed in each server of system
Part, such as: Filebeat, the change which can acquire every table at interval of preset time from each distributed data base are believed
Breath, is then cut, is cached, and increases database node information for the data after caching, and the nodal information may include adopting
Collect time, server identification marking, IP address etc..Data resolution component, such as logstash can also be disposed, dynamically in the future
It unites from the modification information data of different server, for the execution of step S200.
It is obtained each time since the present invention needs to be spaced preset time acquisition system table to dynamically carry out data monitoring
The system table taken can be the same or different, and historical data is to obtain acquired in the preceding primary acquisition operation of time acquisition operation
System table, obtain when subsystem table after, will deserve subsystem table storage and refresh data so that work as subsystem table can become
The historical data in operation is obtained next time.
It is carried out pair by obtaining the system table of each database in distributed system respectively, and by system table and historical data
Than to obtain modification information, by increasing nodal information, suitable discovery data exception can be dateed back in distributed system
Database, the server being abnormal.
Further, referring to figure 4., Fig. 4 is the flow diagram of data monitoring method 3rd embodiment of the present invention, is based on
Second embodiment, step S100 further include:
Step S140 will increase the change data after nodal information and carry out data conversion, handles as standardized data,
And it stores.
Standardized data is the data of unified format.Change data after increasing nodal information are usually different-format, no
With the data of the nonstandardized technique of mode, nonstandardized technique data are subjected to data conversion, are handled to meet user's expected data form,
Be conducive to subsequent retrieval, analysis.Logstash specifically can be used to be standardized and store.Logstash is one and opens
Source data collection engine has real-time function pipeline, the data being collected into can be parsed, be defined matching to data
It converts, is then written in preset data storage computing cluster (elasticsearch) with type, it is convenient subsequently through visualization
Analysis software is shown.
Further, referring to figure 5., Fig. 5 is the flow diagram of data monitoring method fourth embodiment of the present invention, is based on
Second embodiment, step S300 include:
The additions and deletions extracted are changed and look into number and analyzed to obtain by the visual analyzing software by step S310
Base table；
Step S320 obtains the keyword of user's input, according to data corresponding with the keyword in the base table
The chart of generation is shown.
Preferably, can carry out customized be developed so that has a total base by each traffic table of the ELK to each database
Table is counted, then obtains the keyword of user's input, has generated the interface that user needs to check displaying.It can be by database name
At least one in title, business table name and server name is used as keyword, is needed with inquiring from total base table
The data of displaying form chart, the interface of displaying；Certainly the keyword of selection can also be used as and screens out use, with from total base
The corresponding data of keyword are screened out in table, and the chart shown, interface are formed by remaining data；Can also using time dimension as
Keyword extracts the data of corresponding acquisition time or time dimension from base table, forms chart, the interface of displaying.
User can also make operation, to control in the form of the diagrammatic representation generated, chart coordinate, legend etc..Concrete configuration
The process of chart can be can enter the Visualize statistical graph page in ELK, receive user's operation and issue displaying type
Selection instruction processes data into and refers to type selection is shown to select in the form of the diagrammatic representations such as pie chart, histogram, line chart
Enable the chart being consistent；After selecting " From a new search " to enter visual configuration interface, legend, data coordinates are defined
Or field type, such as x-axis, y-axis respectively indicate anything.
It looks into number by changing the corresponding additions and deletions of traffic table each in distributed system and arranges as base table, to facilitate reception
The instruction of user, to form the chart that the data of displaying required for user form.
Further, Fig. 6 is please referred to, Fig. 6 is the flow diagram of the 5th embodiment of data monitoring method of the present invention, is based on
Fourth embodiment, step S300 include: later
Step S400 inquires the traffic table and identifies corresponding first preset threshold according to preset threshold table；
Step S500 judges that the additions and deletions of the traffic table in the preset time change and looks into whether number is greater than described first in advance
If threshold value；
Step S600, if the additions and deletions of the traffic table, which change, looks into number greater than first preset threshold, generating includes institute
State the warning message of traffic table mark.
If the additions and deletions of the traffic table, which change, looks into number less than or equal to first preset threshold, can be not processed.
Those skilled in the art are first pre- according to actual needs in self-setting preset threshold table and preset threshold table
If threshold value.Number is looked into greater than first preset threshold when additions and deletions change, then proves the data access amount exception to the traffic table, it can
It can lead to user terminal access Caton, warning message be generated, so that staff deals with.Those skilled in the art are appreciated that
, increase data times, deletion data times, change data times and inquiry data times can also be respectively set default
Threshold value, then data times will be increased, delete data times, change data times and inquire data times and preset respectively with corresponding
Threshold value is compared, and to alert for abnormal conditions, staff is reminded to handle.
Further, the flow diagram that 7, Fig. 7 is data monitoring method sixth embodiment of the present invention is please referred to, is based on the
Five embodiments, after step S600 further include:
Step S700, if the additions and deletions of the traffic table, which change, looks into number less than or equal to first preset threshold, basis
The preset threshold table inquires the traffic table and identifies corresponding second preset threshold；
Step S800 judges that the additions and deletions of the traffic table in the preset time change and looks into the change rate of number and whether be greater than institute
State the second preset threshold；
Step S900 gives birth to if the additions and deletions of the traffic table change the change rate for looking into number greater than second preset threshold
At the warning message identified comprising the traffic table.
If the additions and deletions of the traffic table change the change rate for looking into number less than or equal to second preset threshold, does not do and locate
Reason.
Those skilled in the art's the second preset threshold of self-setting according to actual needs.Additions and deletions change the change rate body for looking into number
Show additions and deletions and changes the variation tendency for looking into number on time dimension.To find that database access in different time periods is busy, network
The case where flow increases sharply reminds staff to handle.
Further, the flow diagram that 8, Fig. 8 is the 7th embodiment of data monitoring method of the present invention is please referred to, is based on the
Six embodiments, step S600 or step S900 include:
Step S610 identifies the corresponding nodal information according to the traffic table of the traffic table, determines the traffic table
The corresponding server；
Step S620 searches the server corresponding engineering teacher contact details according to contacts list is prestored；
Prestoring contacts list is that those skilled in the art are pre-set, wherein including each server pair in distributed system
The engineer's contact method answered.
The warning message is sent to engineer by engineer's contact details by step S630.
Preferably, the traffic table for data exception occur can also be identified, the additions and deletions of traffic table change the figure for looking into number, generation
Table is sent to the engineer together.It can will specifically be warned by communication modes such as short message, mail, instant communication software, workbenches
It accuses information and is sent to engineer.
In addition, the present invention also provides a kind of data monitoring device, the data monitoring device includes:
Obtain module 10, the system table for obtaining module 10 and being used to obtain database at interval of preset time, the number
It include that and the corresponding traffic table of the database function and traffic table corresponding with the traffic table is identified according to library, the system
Table includes that the additions and deletions for each traffic table for recording and updating in real time when user's operation is interacted with the database change and look into time
Number；
Extraction module 20, the additions and deletions that the extraction module 20 is used to extract each traffic table, which change, looks into number；
Generation module 30, the generation module 30 look into number and pass through visual analyzing for changing the additions and deletions extracted
Software carries out deployment displaying.
Further, the data monitoring device is used for distributed system, and the distributed system includes multiple servers；
The acquisition module 10 is also used to obtain the corresponding data of each server in the distributed system at interval of preset time
The system table in library；
The historical data of the same database is compared with the system table, is obtained each described in the system table
The modification information of traffic table, the modification information include that the additions and deletions change and look into number；
Nodal information is increased to the modification information, the nodal information includes acquisition time and the corresponding clothes of the database
Business device mark.
Further, the acquisition module 10 is also used to increase the change data progress data turn after nodal information
It changes, handles as standardized data, and store.
Further, the data monitoring device further include:
Statistical module 40, the statistical module 40 look into number and pass through the visualization for changing the additions and deletions extracted
Analysis software is analyzed to obtain base table；
The generation module 30 be also used to obtain user input keyword, according in the base table with the keyword phase
The chart that corresponding data generate is shown.
Further, the data monitoring device further include:
Enquiry module 50, the enquiry module 50 are used to that it is corresponding to inquire the traffic table mark according to preset threshold table
First preset threshold；
Judgment module 60, the judgment module 60 are looked into time for judging that the additions and deletions of the traffic table in the preset time change
Whether number is greater than first preset threshold；
Alert module 70, if the alert module 70 changes for the additions and deletions of the traffic table looks into number in advance greater than described first
If threshold value, then the warning message comprising traffic table mark is generated.
Further, if the additions and deletions that the enquiry module 50 is also used to the traffic table, which change, looks into number less than or equal to described
First preset threshold inquires the traffic table and identifies corresponding second preset threshold then according to the preset threshold table；
The judgment module 60 is also used to judge that the additions and deletions of the traffic table in the preset time change the variation for looking into number
Whether rate is greater than second preset threshold；
If the additions and deletions that the alert module 70 is also used to the traffic table change the change rate for looking into number in advance greater than described second
If threshold value, then the warning message comprising traffic table mark is generated.
Further, the alert module 70 includes:
Searching module, searching module are used to identify the corresponding nodal information according to the traffic table of the traffic table, really
Determine the corresponding server of the traffic table；
Searching module is also used to search the server corresponding engineering teacher contact details according to contacts list is prestored；
Sending module, sending module are used to that the warning message to be sent to engineering by engineer's contact details
Teacher.
In addition, storing bounded on computer readable storage medium the present invention also provides a kind of computer readable storage medium
The more new procedures in face, wherein when the more new procedures at interface are executed by processor, realize the step of the update method such as above-mentioned interface
Suddenly.
The more new procedures of its median surface be performed realized method can refer to interface of the present invention update method it is each
A embodiment, details are not described herein again.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the system that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or system.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that terminal device (it can be mobile phone,
Computer, server, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of data monitoring method, which is characterized in that the data monitoring method includes:
The system table of database is obtained at interval of preset time, the database includes industry corresponding with the database function
Business table and traffic table corresponding with traffic table mark, the system table includes that user's operation is interacted with the database
When the additions and deletions of each traffic table that record and update in real time change and look into number；
It extracts each traffic table mark and additions and deletions corresponding with traffic table mark changes and look into number；
Changed according to the additions and deletions extracted look into number processing be shown for chart.
2. data monitoring method as described in claim 1, which is characterized in that the data monitoring method is for distributed system
System, the distributed system includes multiple servers；The step of system table that database is obtained at interval of preset time, packet
It includes:
The system table of the corresponding database of each server in the distributed system is obtained at interval of preset time；
The historical data of the same database is compared with the system table, obtains each business in the system table
The modification information of table, the modification information include that the additions and deletions change and look into number；
Nodal information is increased to the modification information, the nodal information includes acquisition time and the database corresponding server
Mark.
3. data monitoring method as claimed in claim 2, which is characterized in that described to obtain database at interval of preset time
The step of system table, further includes:
The change data after the nodal information will be increased and carry out data conversion, handled as standardized data, and store.
4. data monitoring method as claimed in claim 2, which is characterized in that the additions and deletions that the basis is extracted, which change, looks into time
The step of number processing is shown for chart, comprising:
The additions and deletions extracted are changed and looks into number and is analyzed to obtain base table by the visual analyzing software；
The keyword for obtaining user's input is carried out according to the chart that data corresponding with the keyword in the base table generate
It shows.
5. data monitoring method as claimed in claim 4, which is characterized in that the additions and deletions that the basis is extracted, which change, looks into time
After the step of number processing is shown for chart, further includes:
According to preset threshold table, inquires the traffic table and identify corresponding first preset threshold；
Judge that the additions and deletions of the traffic table in the preset time change and looks into whether number is greater than first preset threshold；
If the additions and deletions of the traffic table, which change, looks into number greater than first preset threshold, generate comprising traffic table mark
Warning message.
6. data monitoring method as claimed in claim 5, which is characterized in that the business in the judgement preset time
The additions and deletions of table, which change, looked into after the step of whether number is greater than the first preset threshold, further includes:
If the additions and deletions of the traffic table, which change, looks into number less than or equal to first preset threshold, according to the preset threshold
Table inquires the traffic table and identifies corresponding second preset threshold；
Judge that the additions and deletions of the traffic table in the preset time change to look into the change rate of number and whether be greater than the described second default threshold
Value；
If the additions and deletions of the traffic table change the change rate for looking into number greater than second preset threshold, generating includes the business
The warning message of table mark.
7. such as data monitoring method described in claim 5 or 6, which is characterized in that described generate identifies comprising the traffic table
Warning message the step of, comprising:
The corresponding nodal information is identified according to the traffic table of the traffic table, determines the corresponding service of the traffic table
Device；
According to contacts list is prestored, the server corresponding engineering teacher contact details are searched；
By engineer's contact details, the warning message is sent to engineer.
8. a kind of data monitoring device, which is characterized in that the data monitoring device includes:
Module is obtained, the module that obtains is wrapped in the system table for obtaining the system table of database at interval of preset time
Include and the corresponding traffic table of the database function, traffic table corresponding with the traffic table mark and user's operation with
The additions and deletions that each traffic table for recording and updating in real time when interaction occurs for the database, which change, looks into number；
Extraction module, the additions and deletions that the extraction module is used to extract each traffic table, which change, looks into number；
Generation module, the generation module are looked into number and are carried out by visual analyzing software for changing the additions and deletions extracted
Deployment is shown.
9. a kind of terminal, which is characterized in that including processor, memory and be stored on the memory can be described
The data monitoring program that processor executes, wherein when the data monitoring program is executed by the processor, realize as right is wanted
The step of data monitoring method described in asking any one of 1 to 7.
10. a kind of computer readable storage medium, which is characterized in that be stored with data prison on the computer readable storage medium
Control program, wherein when the data monitoring program is executed by processor, realize the number as described in any one of claims 1 to 7
The step of according to monitoring method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910200498.9A CN110069378A (en) | 2019-03-16 | 2019-03-16 | Data monitoring method, device, terminal and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910200498.9A CN110069378A (en) | 2019-03-16 | 2019-03-16 | Data monitoring method, device, terminal and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110069378A true CN110069378A (en) | 2019-07-30 |
Family
ID=67366353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910200498.9A Pending CN110069378A (en) | 2019-03-16 | 2019-03-16 | Data monitoring method, device, terminal and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110069378A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110795291A (en) * | 2019-10-23 | 2020-02-14 | 中国银联股份有限公司 | Database processing method and device |
| CN112800107A (en) * | 2021-01-18 | 2021-05-14 | 湖北宸威玺链信息技术有限公司 | Novel data source security identification method, system, device and medium |
| CN114970479A (en) * | 2022-07-29 | 2022-08-30 | 飞狐信息技术（天津）有限公司 | Chart generation method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120198279A1 (en) * | 2011-02-02 | 2012-08-02 | Salesforce.Com, Inc. | Automated Testing on Mobile Devices |
| CN107861958A (en) * | 2016-09-22 | 2018-03-30 | 腾讯科技（深圳）有限公司 | A kind of metadata synchronization method and device |
| CN107870843A (en) * | 2016-12-30 | 2018-04-03 | 平安科技（深圳）有限公司 | The method and device of nas server performance monitoring |
| JP2018160186A (en) * | 2017-03-23 | 2018-10-11 | 富士通株式会社 | Monitoring program, monitoring method, and monitoring device |
| CN109086182A (en) * | 2018-06-27 | 2018-12-25 | 平安科技（深圳）有限公司 | The method and terminal device of database auto-alarming |
| CN109344142A (en) * | 2018-08-22 | 2019-02-15 | 中国平安人寿保险股份有限公司 | Data processing method, device, electronic equipment and storage medium |
-
2019
- 2019-03-16 CN CN201910200498.9A patent/CN110069378A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120198279A1 (en) * | 2011-02-02 | 2012-08-02 | Salesforce.Com, Inc. | Automated Testing on Mobile Devices |
| CN107861958A (en) * | 2016-09-22 | 2018-03-30 | 腾讯科技（深圳）有限公司 | A kind of metadata synchronization method and device |
| CN107870843A (en) * | 2016-12-30 | 2018-04-03 | 平安科技（深圳）有限公司 | The method and device of nas server performance monitoring |
| JP2018160186A (en) * | 2017-03-23 | 2018-10-11 | 富士通株式会社 | Monitoring program, monitoring method, and monitoring device |
| CN109086182A (en) * | 2018-06-27 | 2018-12-25 | 平安科技（深圳）有限公司 | The method and terminal device of database auto-alarming |
| CN109344142A (en) * | 2018-08-22 | 2019-02-15 | 中国平安人寿保险股份有限公司 | Data processing method, device, electronic equipment and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110795291A (en) * | 2019-10-23 | 2020-02-14 | 中国银联股份有限公司 | Database processing method and device |
| CN112800107A (en) * | 2021-01-18 | 2021-05-14 | 湖北宸威玺链信息技术有限公司 | Novel data source security identification method, system, device and medium |
| CN114970479A (en) * | 2022-07-29 | 2022-08-30 | 飞狐信息技术（天津）有限公司 | Chart generation method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11741089B1 (en) | Interactive location queries for raw machine data | |
| US11669382B2 (en) | Anomaly detection for data stream processing | |
| US11061918B2 (en) | Locating and categorizing data using inverted indexes | |
| US10922625B2 (en) | Distributed data processing for machine learning | |
| US11409645B1 (en) | Intermittent failure metrics in technological processes | |
| US10200262B1 (en) | Continuous anomaly detection service | |
| US11880399B2 (en) | Data categorization using inverted indexes | |
| US20200372007A1 (en) | Trace and span sampling and analysis for instrumented software | |
| CN110069378A (en) | Data monitoring method, device, terminal and computer readable storage medium | |
| US10592327B2 (en) | Apparatus, system, and method for analyzing logs | |
| US11556592B1 (en) | Storage estimate generation | |
| US11106713B2 (en) | Sampling data using inverted indexes in response to grouping selection | |
| CN114791846B (en) | Method for realizing observability aiming at cloud-originated chaos engineering experiment | |
| US20220318319A1 (en) | Focus Events | |
| CN111339171A (en) | Data query method, device and equipment | |
| CN108306749A (en) | A kind of monitoring system alarming method, monitoring system and monitoring device | |
| CN112559538A (en) | Incidence relation generation method and device, computer equipment and storage medium | |
| US8732323B2 (en) | Recording medium storing transaction model generation support program, transaction model generation support computer, and transaction model generation support method | |
| CN116016117A (en) | Network equipment operation and maintenance data acquisition method and system, electronic equipment and storage medium | |
| CN111368039B (en) | Data management system | |
| CN114816914A (en) | Data processing method, equipment and medium based on Kubernetes | |
| CN112286767A (en) | Redis cache analysis method | |
| CN115858893B (en) | Data visual analysis method and device, electronic equipment and storage medium | |
| US11836869B1 (en) | Generating three-dimensional data visualizations in an extended reality environment | |
| US11971778B1 (en) | Anomaly detection from incoming data from a data stream |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190730 |