CN105468492A - SE(search engine)-based data monitoring method and system - Google Patents
SE(search engine)-based data monitoring method and system Download PDFInfo
- Publication number
- CN105468492A CN105468492A CN201510790121.5A CN201510790121A CN105468492A CN 105468492 A CN105468492 A CN 105468492A CN 201510790121 A CN201510790121 A CN 201510790121A CN 105468492 A CN105468492 A CN 105468492A
- Authority
- CN
- China
- Prior art keywords
- index
- monitoring
- search engine
- data
- monitor data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
Landscapes
- Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides an SE (search engine)-based data monitoring method and system. The method comprises: monitoring data on an application server is received by a monitoring server, and the monitoring data is written into an SE, so that the SE stores and indexes the monitoring data; according to preset monitoring indexes, statistical data of the monitoring data is acquired from the SE, so that alarm information is given out for indexes exceeding monitoring threshold values. The method and the system provided by the invention are utilized to perform efficient and high-speed retrieval of data like non-structural log data through the SE, so as to monitor and give an alarm in time for an abnormal condition of the application server.
Description
Technical field
The present invention relates to data monitoring field, specifically, relate to a kind of data monitoring method based on search engine and system.
Background technology
Along with the fast development of ecommerce correlation technique and business, the monitor mode of hardware and software platform can not meet the monitoring requirement of growing various different pieces of informations.At present, application server is in order to meet continuous diversified extensive application demand, and the form greatly mainly with server cluster is disposed, and the quantity of application constantly increases, and the data interaction between various different application is more complicated.Therefore, how effective monitoring is carried out to the every data in the application server system of cluster form, become the technical matters that solution is needed in data monitoring field badly.
Summary of the invention
For solving the problems of the technologies described above, the invention provides a kind of data monitoring method based on search engine and system.
According to the first aspect of embodiment of the present invention, provide a kind of data monitoring method based on search engine, the method can comprise by the monitor data on monitoring server termination receipts application server, and by described monitor data write search engine so that described search engine stores and index described monitor data; According to the monitor control index preset from the statistics of described search engine acquisition to described monitor data, to send warning message to the index exceeding monitoring threshold value.
In certain embodiments of the present invention, the monitor data on described application server is by the monitoring agent end collection being arranged at described application server, is encapsulated as JSON form, is sent to described monitoring server end by message-oriented middleware.
In certain embodiments of the present invention, described monitor data comprises numerical value corresponding to index name, index collection time and index.
In certain embodiments of the present invention, described monitor control index comprises following one or more: CPU, internal memory, page access amount, page response time, page response size, exception response code, visited site rank, access URL rank, come origin url rank, process, port, JVM service line number of passes, the use of JVM heap memory, JVM load classes number, database connection pool and ERROR level logs.
In certain embodiments of the present invention, the monitor control index preset of described basis obtains from described search engine and comprises the statistics of described monitor data: obtain statistics to described monitor data from described search engine by full-text search according to the monitor control index preset.
In certain embodiments of the present invention, described warning message comprises: the numerical value of index name and described index exceedes the time of described monitoring threshold value.
According to the second aspect of embodiment of the present invention, provide a kind of data monitoring system based on search engine, this system can comprise: monitoring server end, for receiving the monitor data on application server, and by described monitor data write search engine; Search engine, for storing and index described monitor data; Described monitoring server end, also for obtaining statistics to described monitor data, to send warning message to the index exceeding monitoring threshold value according to the monitor control index preset from described search engine.
In certain embodiments of the present invention, described system also comprises: monitoring agent end, is arranged on application server, for gathering the monitor data on described application server, described monitor data is encapsulated as JSON form, and is sent to described monitoring server end by message-oriented middleware.
In certain embodiments of the present invention, described monitor data comprises numerical value corresponding to index name, time of index collection and index.
In certain embodiments of the present invention, described monitor control index comprises following one or more: CPU, internal memory, page access amount, page response time, page response size, exception response code, visited site rank, access URL rank, come origin url rank, process, port, JVM service line number of passes, the use of JVM heap memory, JVM load classes number, database connection pool and ERROR level logs.
In certain embodiments of the present invention, described monitoring server end to obtain from described search engine according to the monitor control index preset and comprises the statistics of described monitor data: obtain statistics to described monitor data from described search engine by full-text search according to the monitor control index preset.
In certain embodiments of the present invention, described warning message comprises: the numerical value of index name and described index exceedes the time of described monitoring threshold value.
Implement the data monitoring method based on search engine provided by the invention and system, can be carried out effectively all kinds of monitor datas such as non-structured application daily records by search engine, retrieval at a high speed, all kinds of abnormal conditions of timely application server carry out monitoring and reporting to the police.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the data monitoring method based on search engine according to one embodiment of the present invention;
Fig. 2 is the structural representation of the data monitoring system based on search engine according to one embodiment of the present invention;
Fig. 3 is the structural representation of the data monitoring system based on search engine according to one embodiment of the present invention.
Embodiment
Be described in detail to various aspects of the present invention below in conjunction with the drawings and specific embodiments.Wherein, well-known module, unit and connection each other, link, communication or operation do not illustrate or do not elaborate.Further, described feature, framework or function can combine by any way in one or more embodiments.It will be appreciated by those skilled in the art that following various embodiments are only for illustrating, but not for limiting the scope of the invention.Can also easy understand, the module in each embodiment described herein and shown in the drawings or unit or processing mode can be undertaken combining and designing by various different configuration.
See the schematic flow sheet that Fig. 1, Fig. 1 are the data monitoring methods based on search engine according to one embodiment of the present invention, the method can comprise:
S101, receives the monitor data on application server by monitoring server termination, and by described monitor data write search engine so that described search engine stores and index described monitor data;
S102, according to the monitor control index preset from the statistics of described search engine acquisition to described monitor data, to send warning message to the index exceeding monitoring threshold value.
In embodiments of the present invention, data monitoring method based on search engine can comprise: step S101, the monitor data on application server is received by monitoring server termination, and by described monitor data write search engine so that described search engine stores and index described monitor data.Wherein, monitor data on application server can be by the monitoring agent Agent end collection be arranged on application server, be encapsulated as JSON form, be sent to described monitoring server Server by message-oriented middleware (such as, distributed message middleware) and hold.
It should be noted that, application server of the present invention can comprise WEB application server, generally outwards provide application service with the form of cluster, such as, receive the transaction request such as inquired about, place an order and pay and so on of client, these requests are processed, and record and apply daily record accordingly, the information such as such as Transaction Success, Fail Transaction, transaction exception, and these log informations can be divided into info rank, warning rank and error rank successively.Every platform application server in application server cluster all arranges a monitoring agent Agent end, is gathered all kinds of monitor datas on this application server by the monitoring Agent end on each application server.The monitor data that monitoring Agent end gathers on the application server can comprise various different data, divide from data type, can comprise: usage data of WEB access log, application daily record log informations such as () illustrational Transaction Success such as, Fail Transaction, transaction are abnormal, operating system etc.; Divide from the structure of data, article one, monitor data can comprise: needs monitoring index name, the index collection time (such as, the acquisition time of the corresponding index of this index name) and numerical value corresponding to the index numerical value of index name correspondence index (such as, on the time point of this acquisition time).
Be arranged at the monitoring Agent end of application server after acquisition monitoring data, these monitor datas are construed to JSON form, monitoring server end is sent to the form of message queue by distributed message middleware, then, monitoring server end reads the message in message queue, and by message with the form of JSON write search engine (such as, distributed search engine etc. based on lucene builds), search engine can carry out index and storage to message in real time, and also can carry out participle and index to the monitoring relevant field in message by JSON form, from search engine, monitor data corresponding to monitor control index is retrieved so that follow-up.
In step S102, monitoring server end obtains statistics to monitor data according to the monitor control index preset from search engine, such as, by the monitor data that monitor control index in full-text search search engine is corresponding, obtain the statistics to these monitor datas, these statisticss are preserved so that follow-up monitoring display, then monitoring threshold value corresponding to index for the numerical value adding up the every monitor control index obtained is compared, if exceed (such as, be more than or equal to) monitoring threshold value, then warning message is sent to the index exceeding monitoring threshold value.Wherein, monitor control index can comprise following one or more: CPU, internal memory, page access amount, page response time, page response size, exception response code answer codes such as (such as) 40X, 50X, visited site rank, access URL rank, come origin url rank, process, port, JVM service line number of passes, the use of JVM heap memory, JVM load classes number, database connection pool, ERROR level logs.For different monitor control indexs, can arrange and monitor threshold value accordingly, but for some monitor control indexs wherein, also monitoring threshold value can not be set, such as visited site rank, access URL rank, carry out origin url rank etc. and do not need to arrange monitoring threshold value.And, different frequencies can be adopted to the monitoring data collection of monitor control index, such as, to the acquisition time interval of CPU, internal memory, page access amount etc. can be set to less (such as, 1 minute, 1.5 minutes etc.), can be set to comparatively large (such as, 1 hour, 1.5 hours etc.) visited site rank, access URL rank and the acquisition time interval of carrying out origin url rank etc.
CPU in monitor control index and internal memory are the monitor control indexs of application server system, for showing CPU and the service condition in internal memory a period of time.The sample frequency of CPU and internal memory can be set to such as 1 minute/time.To CPU and internal memory two monitor control indexs, monitoring threshold value can be set, such as, the monitoring threshold value of CPU can be set to 90%, 91%, 93%, 95%, 97% etc., if monitoring threshold value that the utilization rate of CPU exceedes (such as, being more than or equal to), then send warning message to CPU index, warning message can comprise index name and this index exceedes the time monitoring threshold value, can also comprise concrete alarm detail.Such as, warning message can comprise CPU, CPU and exceed monitoring time of threshold value and alarm detail (numerical value when such as, CPU reports to the police be how many etc.).
Page access amount in monitor control index, page response time, page response size, exception response code, visited site rank, access URL (UniformResourceLocator, URL(uniform resource locator)) rank, carry out the monitor control index that origin url rank belongs to application server flow.Wherein, page response size is user's request access Webpage, load the number of the byte number shared by this Webpage.Exception response code can comprise the answer code of the webpage exceptions such as 40X, 50X, such as, 404 answer codes of usually display, be user input break links time the page that returns.The sampling interval of page access amount, page response time and page response size can be set to less, such as, and 1 minute.Page access amount and page response time can arrange corresponding threshold value, such as, the monitoring threshold value of page access amount can be set to 85%, 87%, 89%, 90%, 92% of page access total volume etc., the monitoring threshold value of page response time can be set to 6 seconds, 8 seconds, 9 seconds, 10 seconds, 12 seconds.
The indexs such as the process in monitor control index, port, JVM service line number of passes, JVM use internal memory, JVM load classes number (such as, JVM has loaded class number sum), database connection pool and ERROR level logs belong to the application monitor control index of application server.Wherein, can be set to slightly longer than the acquisition time interval (such as, 1 minute etc.) of JVM service line number of passes and JVM load classes number to process and port index, such as, 5 minutes, 6 minutes etc.JVM heap memory uses the JVM heap memory, the distribution of JVM heap memory, maximal value and garbage reclamation (GarbageCycle, GC) time etc. that comprise and having used.To JVM service line number of passes, the use of JVM internal memory and database connection pool etc., monitoring threshold value can be set.Such as, can arrange the quantity of service thread in JVM and be defined as 20,22,25 etc., the monitoring threshold value that JVM heap memory uses can be set to 90% of capacity etc.The monitoring threshold value of DataBase combining number can be set to 90% of capacity.Those skilled in the art need monitoring threshold value to be set to other numerical value in the upper and lower certain limit of monitoring threshold value above-mentioned according to application.In a kind of concrete embodiment, the sample frequency that monitor control index is corresponding, alarm threshold etc. can be as shown in table 1.
Table 1
In step s 102, by monitoring server end regularly (such as, by every 10 minutes, timed task is waited every 1 hour) from search engine, retrieve monitor data corresponding to monitor control index (such as, comprise index name, index collection time and numerical value corresponding to index) after, respectively the numerical value of every monitor control index is compared with corresponding monitoring threshold value, if exceed monitoring threshold value, then warning message is sent to the index that this exceedes monitoring threshold value, such as, can be reported to the police by the alarm sound corresponding with this monitor control index, can also by eye-catching color (such as, red) point out this index to report to the police, also can be connected with the mobile terminal of monitor staff, this index is pointed out to report to the police by the form of note, and, two in above-mentioned prompt tone, color and note kind can be combined, such as, simultaneously auditory tone cues and color mark, or color mark or short message prompt etc. simultaneously, and, three kinds of above-mentioned modes can also be used to report to the police simultaneously.And, for retrieving the statistics obtained, monitoring server end can by the mode of chart (such as, the index collection time is represented by horizontal ordinate, ordinate represents the corresponding numerical value of index) regularly (such as, every 3 hours, every day and weekly etc.) show to user.
Although the above describes step S101 and step S102 in a certain order, but these two steps are in concrete data monitoring process, be not necessarily perform according to above-mentioned sequencing, and can executed in parallel (such as, while the monitor data in current message queue is received and stored, the data stored are retrieved and warning etc.), also first to the retrieval in monitor data execution step S102 for the previous period and alarming step, follow-up monitor data can be read and write.
Data monitoring method based on search engine provided by the invention, can be carried out effectively all kinds of monitor datas such as non-structured application daily records by search engine, retrieval at a high speed, all kinds of abnormal conditions of timely application server carry out monitoring, report to the police and showing, and reduce the amendment to application and invasion when monitoring simultaneously.
Describe the data monitoring method based on search engine of the present invention in conjunction with embodiment above, describe the data monitoring system based on search engine corresponding with above-mentioned method for supervising below in conjunction with embodiment.
See the structural representation that Fig. 2, Fig. 2 are the data monitoring systems based on search engine according to one embodiment of the present invention, this system 200 can comprise:
Monitoring server end 201, for receiving the monitor data on application server, and by described monitor data write search engine;
Search engine 202, for storing and index described monitor data;
Described monitoring server end 201, also for obtaining statistics to described monitor data, to send warning message to the index exceeding monitoring threshold value according to the monitor control index preset from described search engine.
Data monitoring system 200 of the present invention can comprise monitoring server end 201 and search engine 202, can also comprise the monitoring agent end 203 be arranged in application server cluster on each application server, such as, as shown in Figure 3.
Monitoring server end 201 receives the monitor data on application server, and by described monitor data write search engine 202 so that described search engine 202 stores and index described monitor data.Wherein, monitor data on application server can be gathered by the monitoring agent Agent end 203 be arranged on application server, be encapsulated as JSON form, be sent to described monitoring server Server by message-oriented middleware (such as, distributed message middleware) and hold 201.
Application server of the present invention can comprise WEB application server, generally outwards provide application service with the form of cluster, such as, receive the transaction request such as inquired about, place an order and pay and so on of client, these requests are processed, and record applies daily record accordingly, the information such as such as Transaction Success, Fail Transaction, transaction exception, and these log informations can be divided into info rank, warning rank and error rank successively.Every platform application server in application server cluster all arranges a monitoring agent Agent end 203, and the monitoring Agent end 203 on each application server gathers all kinds of monitor datas on this application server.The monitor data that monitoring Agent end 203 gathers on the application server can comprise various different data, divide from data type, can comprise: usage data of WEB access log, application daily record log informations such as () illustrational Transaction Success such as, Fail Transaction, transaction are abnormal, operating system etc.; Divide from the structure of data, article one, monitor data can comprise: needs monitoring index name, the index collection time (such as, the acquisition time of the corresponding index of this index name) and numerical value corresponding to the index numerical value of index name correspondence index (such as, on the time point of this acquisition time).
Be arranged at the monitoring Agent end 203 of application server after acquisition monitoring data, these monitor datas are construed to JSON form, monitoring server end 201 is sent to the form of message queue by distributed message middleware, then, monitoring server end 201 reads the message in message queue, and by message with the form of JSON write search engine (such as, distributed search engine etc. based on lucene builds) 202, search engine 202 can carry out index and storage to message in real time, and also can carry out participle and index to the monitoring relevant field in message by JSON form, from search engine, monitor data corresponding to monitor control index is retrieved so that follow-up.
Monitoring server end 201 obtains 202 according to the monitor control index preset from search engine and gets statistics to monitor data, such as, by the monitor data that monitor control index in full-text search search engine is corresponding, obtain the statistics to these monitor datas, these statisticss are preserved so that follow-up monitoring display, the monitoring threshold value of then adding up the numerical value of the every monitor control index obtained corresponding to index compares, if exceed (such as, be more than or equal to) monitoring threshold value, then warning message is sent to the index exceeding monitoring threshold value.Wherein, monitor control index can comprise following one or more: CPU, internal memory, page access amount, page response time, page response size, exception response code answer codes such as (such as) 40X, 50X, visited site rank, access URL rank, come origin url rank, process, port, JVM service line number of passes, the use of JVM heap memory, JVM load classes number, database connection pool, ERROR level logs.For different monitor control indexs, can arrange and monitor threshold value accordingly, but for some monitor control indexs wherein, also monitoring threshold value can not be set, such as visited site rank, access URL rank, carry out origin url rank etc. and do not need to arrange monitoring threshold value.And, different frequencies can be adopted to the monitoring data collection of monitor control index, such as, to the acquisition time interval of CPU, internal memory, page access amount etc. can be set to less (such as, 1 minute, 1.5 minutes etc.), can be set to comparatively large (such as, 1 hour, 1.5 hours etc.) visited site rank, access URL rank and the acquisition time interval of carrying out origin url rank etc.
CPU in monitor control index and internal memory are the monitor control indexs of application server system, for showing CPU and the service condition in internal memory a period of time.The sample frequency of CPU and internal memory can be set to such as 1 minute/time.To CPU and internal memory two monitor control indexs, monitoring threshold value can be set, such as, the monitoring threshold value of CPU can be set to 90%, 91%, 93%, 95%, 97% etc., if monitoring threshold value that the utilization rate of CPU exceedes (such as, being more than or equal to), then send warning message to CPU index, warning message can comprise index name and this index exceedes the time monitoring threshold value, can also comprise concrete alarm detail.Such as, warning message can comprise CPU, CPU and exceed monitoring time of threshold value and alarm detail (numerical value when such as, CPU reports to the police be how many etc.).
Page access amount in monitor control index, page response time, page response size, exception response code, visited site rank, access URL rank, carry out the monitor control index that origin url rank belongs to application server flow.Wherein, page response size is user's request access Webpage, load the number of the byte number shared by this Webpage.Exception response code can comprise the answer code of the webpage exceptions such as 40X, 50X, such as, 404 answer codes of usually display, be user input break links time the page that returns.The sampling interval of page access amount, page response time and page response size can be set to less, such as, and 1 minute.Page access amount and page response time can arrange the threshold value of response, such as, the monitoring threshold value of page access amount can be set to 85%, 87%, 89%, 90%, 92% of page access total volume etc., the monitoring threshold value of page response time can be set to 6 seconds, 8 seconds, 9 seconds, 10 seconds, 12 seconds.
The indexs such as the process in monitor control index, port, JVM service line number of passes, JVM use internal memory, JVM load classes number (such as, JVM has loaded class number sum), database connection pool and ERROR level logs belong to the application monitor control index of application server.Wherein, can be set to slightly longer than the acquisition time interval (such as, 1 minute etc.) of JVM service line number of passes and JVM load classes number to process and port index, such as, 5 minutes, 6 minutes etc.JVM heap memory uses the JVM heap memory, the distribution of JVM heap memory, maximal value and garbage reclamation GC time etc. that comprise and having used.To JVM service line number of passes, the use of JVM internal memory and database connection pool etc., monitoring threshold value can be set.Such as, can arrange the quantity of service thread in JVM and be defined as 20,22,25 etc., the monitoring threshold value that JVM heap memory uses can be set to 90% of capacity etc.The monitoring threshold value of DataBase combining number can be set to 90% of capacity.Those skilled in the art need monitoring threshold value to be set to other numerical value in the upper and lower certain limit of monitoring threshold value above-mentioned according to application.In a kind of concrete embodiment, the sample frequency that monitor control index is corresponding, alarm threshold etc. can be as shown in table 1.
Monitoring server end 201 regularly (such as, by every 10 minutes, timed task is waited every 1 hour) from search engine 202, retrieve monitor data corresponding to monitor control index (such as, comprise index name, index collection time and numerical value corresponding to index) after, respectively the numerical value of every monitor control index is compared with corresponding monitoring threshold value, if exceed monitoring threshold value, then warning message is sent to the index that this exceedes monitoring threshold value, such as, can be reported to the police by the alarm sound corresponding with this monitor control index, can also be reported to the police by this index of eye-catching color tips, also can be connected with the mobile terminal of monitor staff, this index is pointed out to report to the police by the form of note.And, two in above-mentioned prompt tone, color and note kind can be combined, such as, simultaneously auditory tone cues and color mark, or color mark or short message prompt etc. simultaneously; And, three kinds of above-mentioned modes can also be used to report to the police simultaneously.And, for retrieving the statistics obtained, monitoring server end can also by the mode of chart (such as, the index collection time is represented by horizontal ordinate, ordinate represents the corresponding numerical value of index) regularly (such as, every 3 hours, every day and weekly etc.) show to user.
Through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can realize by the mode of software combined with hardware platform.Based on such understanding, what technical scheme of the present invention contributed to background technology can embody with the form of software product in whole or in part, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprising some instructions in order to make a computer equipment (can be personal computer, server, smart mobile phone or the network equipment etc.) perform the method described in some part of each embodiment of the present invention or embodiment.
The term used in instructions of the present invention and wording, just to illustrating, are not meaned and are formed restriction.It will be appreciated by those skilled in the art that under the prerequisite of the ultimate principle not departing from disclosed embodiment, can various change be carried out to each details in above-mentioned embodiment.Therefore, scope of the present invention is only determined by claim, and in the claims, except as otherwise noted, all terms should be understood by the most wide in range rational meaning.
Claims (12)
1. based on a data monitoring method for search engine, it is characterized in that, described method comprises:
The monitor data on application server is received by monitoring server termination, and by described monitor data write search engine so that described search engine stores and index described monitor data;
According to the monitor control index preset from the statistics of described search engine acquisition to described monitor data, to send warning message to the index exceeding monitoring threshold value.
2. method according to claim 1, is characterized in that, the monitor data on described application server is by the monitoring agent end collection being arranged at described application server, is encapsulated as JSON form, is sent to described monitoring server end by message-oriented middleware.
3. method according to claim 2, is characterized in that, described monitor data comprises numerical value corresponding to index name, index collection time and index.
4. method according to claim 3, it is characterized in that, described monitor control index comprises following one or more: CPU, internal memory, page access amount, page response time, page response size, exception response code, visited site rank, access URL rank, come origin url rank, process, port, JVM service line number of passes, the use of JVM heap memory, JVM load classes number, database connection pool and ERROR level logs.
5. method according to claim 1, is characterized in that, the monitor control index that described basis is preset obtains from described search engine and comprises the statistics of described monitor data:
Statistics to described monitor data is obtained from described search engine by full-text search according to the monitor control index preset.
6. method according to claim 5, is characterized in that, described warning message comprises: the numerical value of index name and described index exceedes the time of described monitoring threshold value.
7. based on a data monitoring system for search engine, it is characterized in that, described system comprises:
Monitoring server end, for receiving the monitor data on application server, and by described monitor data write search engine;
Search engine, for storing and index described monitor data;
Described monitoring server end, also for obtaining statistics to described monitor data, to send warning message to the index exceeding monitoring threshold value according to the monitor control index preset from described search engine.
8. system according to claim 7, is characterized in that, described system also comprises:
Monitoring agent end, is arranged on application server, for gathering the monitor data on described application server, described monitor data is encapsulated as JSON form, and is sent to described monitoring server end by message-oriented middleware.
9. system according to claim 7, is characterized in that, described monitor data comprises numerical value corresponding to index name, time of index collection and index.
10. system according to claim 9, it is characterized in that, described monitor control index comprises following one or more: CPU, internal memory, page access amount, page response time, page response size, exception response code, visited site rank, access URL rank, come origin url rank, process, port, JVM service line number of passes, the use of JVM heap memory, JVM load classes number, database connection pool and ERROR level logs.
11. systems according to claim 7, is characterized in that, described monitoring server end comprises the statistics of described monitor data from described search engine acquisition according to the monitor control index preset:
Statistics to described monitor data is obtained from described search engine by full-text search according to the monitor control index preset.
12. systems according to claim 11, is characterized in that, described warning message comprises: the numerical value of index name and described index exceedes the time of described monitoring threshold value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510790121.5A CN105468492A (en) | 2015-11-17 | 2015-11-17 | SE(search engine)-based data monitoring method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510790121.5A CN105468492A (en) | 2015-11-17 | 2015-11-17 | SE(search engine)-based data monitoring method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105468492A true CN105468492A (en) | 2016-04-06 |
Family
ID=55606224
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510790121.5A Pending CN105468492A (en) | 2015-11-17 | 2015-11-17 | SE(search engine)-based data monitoring method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105468492A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407073A (en) * | 2016-09-13 | 2017-02-15 | 广州善融信息科技有限公司 | Monitoring implementation method based on spring task scheduling |
| CN106452931A (en) * | 2016-12-27 | 2017-02-22 | 中国建设银行股份有限公司 | Monitoring index, domain value discovery method, domain value adjusting method and automatic monitoring system |
| CN106649040A (en) * | 2016-12-26 | 2017-05-10 | 上海新炬网络信息技术有限公司 | Automatic monitoring method and device for performance of Weblogic middleware |
| CN107315672A (en) * | 2017-06-22 | 2017-11-03 | 北京小度信息科技有限公司 | Method and apparatus for monitoring server |
| CN107317708A (en) * | 2017-06-29 | 2017-11-03 | 人民法院信息技术服务中心 | The monitoring method and device of a kind of Court business application system |
| CN108540304A (en) * | 2018-02-12 | 2018-09-14 | 中国神华能源股份有限公司 | Remote collection monitoring system and method based on industrial big data |
| CN108809673A (en) * | 2017-04-28 | 2018-11-13 | 北京微影时代科技有限公司 | A kind of method and device of fault alarm |
| CN108920659A (en) * | 2018-07-03 | 2018-11-30 | 广州唯品会信息科技有限公司 | Data processing system and its data processing method, computer readable storage medium |
| CN108959033A (en) * | 2018-07-05 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of cpu monitor pre-warning management system and method |
| CN109040218A (en) * | 2018-07-25 | 2018-12-18 | 山东中创软件商用中间件股份有限公司 | A kind of application system liveness determines method, apparatus, equipment and storage medium |
| CN109189643A (en) * | 2018-09-11 | 2019-01-11 | 五八有限公司 | Monitoring method, device, equipment and the storage medium of request interface response data |
| CN109903175A (en) * | 2019-03-26 | 2019-06-18 | 众安在线财产保险股份有限公司 | A kind of Insurance core system monitor supervision platform |
| CN111159524A (en) * | 2019-12-30 | 2020-05-15 | 北京同邦卓益科技有限公司 | Monitoring method and system, and storage medium |
| CN111614501A (en) * | 2020-05-25 | 2020-09-01 | 厦门二五八网络科技集团股份有限公司 | Monitoring method and system |
| CN112711514A (en) * | 2020-12-30 | 2021-04-27 | 北京珞安科技有限责任公司 | Monitoring system, method and device of terminal equipment |
| CN112989327A (en) * | 2019-12-18 | 2021-06-18 | 拓尔思天行网安信息技术有限责任公司 | Detection method, device, equipment and storage medium for stealing website data |
| CN113609129A (en) * | 2021-07-29 | 2021-11-05 | 沈阳蓝天智慧燃气供热有限公司 | Heat energy monitoring comprehensive retrieval method based on big data |
| CN114025044A (en) * | 2021-10-15 | 2022-02-08 | 中国人民财产保险股份有限公司 | Control method and device of call center and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080140817A1 (en) * | 2006-12-06 | 2008-06-12 | Agarwal Manoj K | System and method for performance problem localization |
| CN102340415A (en) * | 2011-06-23 | 2012-02-01 | 北京新媒传信科技有限公司 | Server cluster system and monitoring method thereof |
| CN104407964A (en) * | 2014-12-08 | 2015-03-11 | 国家电网公司 | Centralized monitoring system and method based on data center |
| CN104954184A (en) * | 2015-06-15 | 2015-09-30 | 四川长虹电器股份有限公司 | Monitoring and alarming method and system for cloud background server cluster |
-
2015
- 2015-11-17 CN CN201510790121.5A patent/CN105468492A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080140817A1 (en) * | 2006-12-06 | 2008-06-12 | Agarwal Manoj K | System and method for performance problem localization |
| CN102340415A (en) * | 2011-06-23 | 2012-02-01 | 北京新媒传信科技有限公司 | Server cluster system and monitoring method thereof |
| CN104407964A (en) * | 2014-12-08 | 2015-03-11 | 国家电网公司 | Centralized monitoring system and method based on data center |
| CN104954184A (en) * | 2015-06-15 | 2015-09-30 | 四川长虹电器股份有限公司 | Monitoring and alarming method and system for cloud background server cluster |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407073A (en) * | 2016-09-13 | 2017-02-15 | 广州善融信息科技有限公司 | Monitoring implementation method based on spring task scheduling |
| CN106649040A (en) * | 2016-12-26 | 2017-05-10 | 上海新炬网络信息技术有限公司 | Automatic monitoring method and device for performance of Weblogic middleware |
| CN106452931B (en) * | 2016-12-27 | 2019-09-17 | 中国建设银行股份有限公司 | Monitor control index and thresholding discovery method, thresholding method of adjustment and automatic monitored control system |
| CN106452931A (en) * | 2016-12-27 | 2017-02-22 | 中国建设银行股份有限公司 | Monitoring index, domain value discovery method, domain value adjusting method and automatic monitoring system |
| CN108809673A (en) * | 2017-04-28 | 2018-11-13 | 北京微影时代科技有限公司 | A kind of method and device of fault alarm |
| CN107315672A (en) * | 2017-06-22 | 2017-11-03 | 北京小度信息科技有限公司 | Method and apparatus for monitoring server |
| CN107315672B (en) * | 2017-06-22 | 2020-08-21 | 北京星选科技有限公司 | Method and device for monitoring server |
| CN107317708A (en) * | 2017-06-29 | 2017-11-03 | 人民法院信息技术服务中心 | The monitoring method and device of a kind of Court business application system |
| CN107317708B (en) * | 2017-06-29 | 2019-12-31 | 人民法院信息技术服务中心 | Monitoring method and device for court business application system |
| CN108540304A (en) * | 2018-02-12 | 2018-09-14 | 中国神华能源股份有限公司 | Remote collection monitoring system and method based on industrial big data |
| CN108540304B (en) * | 2018-02-12 | 2021-01-08 | 中国神华能源股份有限公司 | Remote acquisition monitoring system and method based on industrial big data |
| CN108920659B (en) * | 2018-07-03 | 2022-06-07 | 广州唯品会信息科技有限公司 | Data processing system, data processing method thereof, and computer-readable storage medium |
| CN108920659A (en) * | 2018-07-03 | 2018-11-30 | 广州唯品会信息科技有限公司 | Data processing system and its data processing method, computer readable storage medium |
| CN108959033A (en) * | 2018-07-05 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of cpu monitor pre-warning management system and method |
| CN109040218A (en) * | 2018-07-25 | 2018-12-18 | 山东中创软件商用中间件股份有限公司 | A kind of application system liveness determines method, apparatus, equipment and storage medium |
| CN109189643A (en) * | 2018-09-11 | 2019-01-11 | 五八有限公司 | Monitoring method, device, equipment and the storage medium of request interface response data |
| CN109903175A (en) * | 2019-03-26 | 2019-06-18 | 众安在线财产保险股份有限公司 | A kind of Insurance core system monitor supervision platform |
| CN112989327A (en) * | 2019-12-18 | 2021-06-18 | 拓尔思天行网安信息技术有限责任公司 | Detection method, device, equipment and storage medium for stealing website data |
| CN111159524A (en) * | 2019-12-30 | 2020-05-15 | 北京同邦卓益科技有限公司 | Monitoring method and system, and storage medium |
| CN111614501A (en) * | 2020-05-25 | 2020-09-01 | 厦门二五八网络科技集团股份有限公司 | Monitoring method and system |
| CN112711514A (en) * | 2020-12-30 | 2021-04-27 | 北京珞安科技有限责任公司 | Monitoring system, method and device of terminal equipment |
| CN113609129A (en) * | 2021-07-29 | 2021-11-05 | 沈阳蓝天智慧燃气供热有限公司 | Heat energy monitoring comprehensive retrieval method based on big data |
| CN114025044A (en) * | 2021-10-15 | 2022-02-08 | 中国人民财产保险股份有限公司 | Control method and device of call center and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105468492A (en) | SE(search engine)-based data monitoring method and system | |
| KR101792582B1 (en) | Efficient query processing using histograms in a columnar database | |
| CN109284251A (en) | Blog management method, device, computer equipment and storage medium | |
| CN103838867A (en) | Log processing method and device | |
| CN106778253A (en) | Threat context aware information security Initiative Defense model based on big data | |
| CN111339175B (en) | Data processing method, device, electronic equipment and readable storage medium | |
| CN106487574A (en) | Automatic operating safeguards monitoring system | |
| CN101707632A (en) | Method for dynamically monitoring performance of server cluster and alarming real-timely | |
| CN110019072B (en) | AB experiment method and system based on real-time data | |
| CN112506743A (en) | Log monitoring method and device and server | |
| CN109299164A (en) | A kind of data query method, computer readable storage medium and terminal device | |
| CN107273369B (en) | Table data modification method and device | |
| CN102902775A (en) | Internet real-time computing method and internet real-time computing system | |
| CN110321364B (en) | Transaction data query method, device and terminal of credit card management system | |
| CN106295382A (en) | A kind of Information Risk preventing control method and device | |
| CN113157947A (en) | Knowledge graph construction method, tool, device and server | |
| CN111552885A (en) | System and method for realizing automatic real-time message pushing operation | |
| CN112506954A (en) | Database auditing method and device | |
| CN114157679A (en) | Cloud-native-based distributed application monitoring method, device, equipment and medium | |
| CN113032252A (en) | Method and device for collecting buried point data, client device and storage medium | |
| CN110677271A (en) | Big data alarm method, device, equipment and storage medium based on ELK | |
| CN116701525A (en) | Early warning method and system based on real-time data analysis and electronic equipment | |
| CN109768878A (en) | A kind of network work order calculation method and device based on big data | |
| CN109614380A (en) | Log processing method, system, computer equipment and readable medium | |
| CN110851758B (en) | Webpage visitor quantity counting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160406 |