CN108415808A - Access real-time visual monitoring method, system, equipment and the medium of Dispatching Unit - Google Patents
Access real-time visual monitoring method, system, equipment and the medium of Dispatching Unit Download PDFInfo
- Publication number
- CN108415808A CN108415808A CN201810181722.XA CN201810181722A CN108415808A CN 108415808 A CN108415808 A CN 108415808A CN 201810181722 A CN201810181722 A CN 201810181722A CN 108415808 A CN108415808 A CN 108415808A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- granularity
- unit
- granular
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
Abstract
The present invention relates to a kind of real-time visual monitoring method, system, equipment and the media of access Dispatching Unit.Granularity division is carried out to access data, obtains the first granularity data, and generate the granular information and the first granularity data information of first granularity data；The first granularity data is received by middleware unit, generates data to be distributed；Granularity division is carried out to data to be distributed, obtains the second granularity data, and generate the granular information and the second granularity data information of second granularity data；Monitored results are generated according to first granular information of monitoring unit and the first granularity data information, the second granular information and the second granularity data information.The service condition that real-time, system, independent can be monitored access data, distribute data, is monitored the different business systems of access, can find already existing or potential problem in real time.
Description
Technical field
The invention belongs to data monitoring field more particularly to it is a kind of access Dispatching Unit real-time visual monitoring method,
System, equipment and medium.
Background technology
In recent years, with the deep development and popularization and application of mobile Internet and information technology, the scale of logistic industry is not
Disconnected increase is expanded comprehensively with business, and all the time all in the data for generating magnanimity, but there is presently no complete set covering is public
The data monitoring system of the every business of department, can neither observe the business and data of company, also without a set of shielding bottom on a macro scale
The microscopic observation model of details, access Dispatching Unit can by kafka access each department, various businesses data, because
This, effective big data processing monitoring tools have become the active demand of current company and department, cover multifaceted monitoring
The research and development of tool are imperative.
Invention content
In order to solve the above-mentioned technical problem, the purpose of the present invention is to provide a kind of real-time visuals of access Dispatching Unit
Monitoring method, system, equipment and medium.
According to an aspect of the invention, there is provided a kind of real-time visual monitoring method of access Dispatching Unit, including
Following steps：
Granularity division is carried out to access data, obtains the first granularity data, and generate the granularity of first granularity data
First granularity data is sent to middleware unit by information and the first granularity data information, by first granular information
And first granularity data information be uploaded to monitoring unit；
The first granularity data is received by middleware unit, generates data to be distributed；
Granularity division is carried out to data to be distributed, obtains the second granularity data, and generate the grain of second granularity data
Information and the second granularity data information are spent, second granularity data is distributed to corresponding database, by second granularity
Information and the second granularity data information are uploaded to monitoring unit；
According to first granular information of monitoring unit and the first granularity data information, the second granular information and second
Degrees of data information generates monitored results.
Further, believed according to first granular information of monitoring unit and the first granularity data information, the second granularity
Breath and the second granularity data information generate monitored results, including：
The data of middleware unit are obtained according to the first granularity data information of monitoring unit and the second granularity data information
Backlog information；
Data flow letter is obtained according to the first granular information of monitoring unit, the second granular information combination data origin information
Breath.
Further, the real-time visual monitoring method of the described access Dispatching Unit further includes：By middleware unit
Data overstock value and are compared with the overstocked threshold value of data, and police is generated if the data of middleware unit overstock value more than the overstocked threshold value of data
Show result.
Further, data origin information is obtained by accessing the field data that data are submitted.
Further, the real-time visual monitoring method of the described access Dispatching Unit further includes：Pass through middleware unit
The first granularity data is received, is stored, generates theme granular information, and theme granularity metamessage is uploaded to monitoring unit.
Further, data flow information further includes theme granularity metamessage.
Further, monitoring unit includes increase income monitoring module, visual control module.
Wherein, middleware unit kafka, monitoring module of increasing income are openTSDB.
Further, first granular information and the first granularity data information, second granular information and second
Degrees of data information is uploaded to monitoring module of increasing income.
Further, theme granularity metamessage is uploaded to visual control module.
Further, middleware list is obtained according to the first granularity data information of monitoring unit and the second granularity data information
The data backlog information of member, including：
Middleware unit is obtained according to the first granularity data information of monitoring module of increasing income and the second granularity data information
Data backlog information.
Further, monitored results pass through visual control modules exhibit.
Further, data backlog information calls middleware unit to be visualized by visual control module.
Further, data origin information and/or data flow information by visual control module according to http agreements
By calling monitoring module of increasing income to be visualized.
Further,
The granular information of first granularity data is task granularity, system granular, service line granularity, access style granularity
At least one information,
The granular information of second granularity data includes task granularity, system granular, service line granularity, distribution type grain
At least one information of degree.
According to another aspect of the present invention, a kind of real-time visual monitoring system of access Dispatching Unit, packet are provided
It includes：
Access unit is configured to carry out granularity division to access data, obtains the first granularity data, and generate described the
First granularity data is sent to middleware unit by the granular information of one granularity data and the first granularity data information, will
First granular information and the first granularity data information are uploaded to monitoring unit；
Middleware unit is configured to middleware unit and receives the first granularity data, generates data to be distributed；
Dispatching Unit is configured to carry out granularity division to data to be distributed, obtains the second granularity data, and described in generation
Second granularity data is distributed to corresponding data by the granular information of the second granularity data and the second granularity data information
Second granular information and the second granularity data information are uploaded to monitoring unit by library；
Monitoring unit is configured to according to first granular information and the first granularity data information, the second granular information
And second granularity data information generate monitored results.
Further, monitoring unit is also configured to：
The data of middleware unit are obtained according to the first granularity data information of monitoring unit and the second granularity data information
Backlog information；
Data flow letter is obtained according to the first granular information of monitoring unit, the second granular information combination data origin information
Breath.
Further, which further includes alarm unit, is configured to the data of middleware unit overstocking value and data
It overstocks threshold value to compare, warning result is generated if the data of middleware unit overstock value more than the overstocked threshold value of data.
Further, data origin information is obtained by accessing the field data that data are submitted.
Further, middleware unit is also configured to receive the first granularity data, is stored, and theme granularity letter is generated
Breath, and theme granularity metamessage is uploaded to monitoring unit.
Data flow information further includes theme granularity metamessage.
Further, monitoring unit includes increase income monitoring module, visual control module.
Further, monitoring module of increasing income is configured to：
Receive first granular information and the first granularity data information, second granular information and the second granularity data
Information；
The data that middleware unit is obtained according to the first granularity data information and the second granularity data information overstock letter
Breath.
Further,
Visual control module is configured to：
Receive theme granularity metamessage；
Show monitored results.
Further, visual control module is also configured to：
Middleware unit is called to visualize data backlog information；
According to http agreements, by calling, monitoring module of increasing income visualizes data origin information and/or data flow is believed
Breath.
Wherein,
The granular information of first granularity data is task granularity, system granular, service line granularity, access style granularity
At least one information,
The granular information of second granularity data includes task granularity, system granular, service line granularity, distribution type grain
At least one information of degree.
Dispatching Unit is by control module from the first granularity data accessed through middleware unit.
According to another aspect of the present invention, a kind of equipment is provided, the equipment includes：
One or more processors；
Memory, for storing one or more programs,
When one or more of programs are executed by one or more of processors so that one or more of places
It manages device and executes any one of them method as above.
According to another aspect of the present invention, a kind of computer-readable storage medium being stored with computer program is provided
Matter, the program realize any one of them method as above when being executed by processor.
Compared with prior art, the invention has the advantages that：
1, the real-time visual monitoring method of the exemplary access Dispatching Unit of the present invention carries out granularity to access data and draws
Point, the first granularity data is obtained, and generate the granular information and the first granularity data information of first granularity data, it will be described
First granularity data is sent to middleware unit, and it is single that first granular information and the first granularity data information are uploaded to monitoring
Member；The first granularity data is received by middleware unit, generates data to be distributed；Granularity division is carried out to data to be distributed, is obtained
To the second granularity data, and the granular information and the second granularity data information of second granularity data are generated, by described second
Granularity data is distributed to corresponding database, and it is single that second granular information and the second granularity data information are uploaded to monitoring
Member；According to first granular information and the first granularity data information, the second granular information and the second granularity number of monitoring unit
It is believed that breath generates monitored results.The service condition that real-time, system, independent can be monitored access data, distribute data, it is right
The different business systems of access are monitored, and can find already existing or potential problem in real time.It is more than threshold when overstocking
Value, system developer and related service personnel just go investigation problem, make and most timely reacting.Data flow information can provide
Data circulating positions, help are rapidly found out where problem.
2, the real-time visual monitoring system of the exemplary access Dispatching Unit of the present invention, the present invention are single by building monitoring
Member is monitored the different grain size of access, each division of Dispatching Unit, being capable of real-time, system, independent monitoring access
Data, distribute data service condition, the different business systems of access are monitored, can find in real time it is already existing or
The potential problem of person.Different grain size to accessing each division of Dispatching Unit is monitored respectively, to being linked into the system not
Be monitored with operation system, simple in structure, operation is convenient, headed by set can completely cover the data monitoring system of company's items business
System, for impetus of this field development with matter.
3, the exemplary equipment of the present invention, any one of them method as above is executed by one or more processors, is docked
The different grain size for entering each division of Dispatching Unit is monitored respectively, and the different business systems to being linked into the system are supervised
Control.
4, the computer readable storage medium of the exemplary computer program of the present invention, the program are realized when being executed by processor
Any one of them method as above can find already existing or potential system in real time to the data monitoring of every business
System problem.
Description of the drawings
Fig. 1 is the flow chart for the real-time visual monitoring method that embodiment one accesses Dispatching Unit；
Fig. 2 is one specific monitoring step schematic diagram of embodiment.
Specific implementation mode
In order to be better understood by technical scheme of the present invention, with reference to specific embodiment, Figure of description to the present invention
It is described further.
Embodiment one：
A kind of real-time visual monitoring method of access Dispatching Unit is present embodiments provided, as shown in Figure 1, including following
Step：
S1, granularity division is carried out to access data, obtains the first granularity data, and generate the grain of first granularity data
Information and the first granularity data information are spent, first granularity data is sent to middleware unit, first granularity is believed
Breath and the first granularity data information be uploaded to monitoring unit, wherein the granular information of first granularity data be task granularity,
System granular, service line granularity, at least one information of access style granularity, the first granularity data information are the first granularity data
Size of data, data number information；
S2, the first granularity data is received by middleware unit, generates data to be distributed；
S3, granularity division is carried out to data to be distributed, obtains the second granularity data, and generate second granularity data
Second granularity data is distributed to corresponding database by granular information and the second granularity data information, by described second
Degree information and the second granularity data information are uploaded to monitoring unit, wherein the granular information of second granularity data includes appointing
Business granularity, system granular, service line granularity, at least one information of distribution type granularity, the second granularity data information are second
The size of data of granularity data, data number information；
S4, according to first granular information of monitoring unit and the first granularity data information, the second granular information and
Two granularity data information generate monitored results.
According to first granular information of monitoring unit and the first granularity data information, the second granular information and second
Degrees of data information generates monitored results, including：
S41, middleware unit is obtained according to the first granularity data information and the second granularity data information of monitoring unit
Data backlog information；
S42, data flow is obtained according to the first granular information of monitoring unit, the second granular information combination data origin information
To information.
Wherein,
The first granularity data is received by middleware unit, is stored, generates theme granular information, and by theme granularity
Metamessage is uploaded to monitoring unit.
Therefore data flow information further includes theme granularity metamessage.
And data origin information is obtained by accessing the field data that data are submitted.Appoint with specific reference to what access data were submitted
Business field data, obtains data origin information.
The real-time visual monitoring method of the described access Dispatching Unit further includes：The data of middleware unit are overstock
Value overstocks threshold value with data and compares, and warning result is generated if the data of middleware unit overstock value more than the overstocked threshold value of data.
Further, monitoring unit includes increase income monitoring module, visual control module.
Wherein, first granular information and the first granularity data information, second granular information and the second granularity number
It is believed that breath is uploaded to monitoring module of increasing income.
Theme granularity metamessage is uploaded to visual control module.
The data of middleware unit are obtained according to the first granularity data information of monitoring unit and the second granularity data information
Backlog information, including：
Middleware unit is obtained according to the first granularity data information of monitoring module of increasing income and the second granularity data information
Data backlog information.
Monitored results pass through visual control modules exhibit.Specially：
Data backlog information calls middleware unit to be visualized by visual control module.
Data origin information and/or data flow information are opened according to http agreements by calling by visual control module
Source monitoring module is visualized.
The data accessed above by middleware unit include no platform data or the platform collected by data collector
Data, middleware unit can be kafka, and monitoring module of increasing income can be openTSDB.
Therefore data origin information and/or data flow information pass through calling by visual control module according to http agreements
OpenTSDB API are visualized.
It is as follows that specific monitoring step is specifically illustrated by taking Fig. 2 as an example：
(1) for platform data, no platform data in figure, by taking platform data as an example, after task access unit, access unit
According to the field data of submission task aggregation to system granular, service line granularity (such as fast fortune business, heavy cargo business, cold fortune industry
Business, commercial occupation, warehousing, financial business, electric business industrial park), access style granularity (such as bee data, binlog data,
Udp data, sdk data), access unit is stored in data access to kafka by topic, visualizes visual control module
It is monitored respectively according to different granularities；
(2) in Dispatching Unit, control module goes to take the data accessed in kafka, according to distributed tasks granularity, is
System granularity, service line granularity, distribution type granularity (ES, HDFS, HIVE, Hbase) are monitored respectively；
(3) when the monitoring of every granularity needs to check specific data, remembered in openTSDB searching datas according to http agreements
Record.
It the time that every granularity can be inquired with effectively save developer, can also simultaneously for the personnel of not development Experience
The state that data are checked by shirtsleeve operation shields low-level details, realizes key deployment, checks.
A kind of real-time visual monitoring system of access Dispatching Unit is present embodiments provided, including：
(1) access unit is configured to：
Granularity division is carried out to access data, obtains the first granularity data, and generate the granularity of first granularity data
First granularity data is sent to middleware unit by information and the first granularity data information, by first granular information
And first granularity data information be uploaded to monitoring unit, wherein the granular information of first granularity data be task granularity, be
System granularity, service line granularity, at least one information of access style granularity, the first granularity data information are the first granularity data
Data number information, data size information.
(2) middleware unit is configured to：
The first granularity data is received by middleware unit, generates data to be distributed,
It is also configured to：
The first granularity data is received, is stored, generates theme granular information, and theme granularity metamessage is uploaded to prison
Control unit.
(3) Dispatching Unit is configured to carry out granularity division to data to be distributed, obtains the second granularity data, and generate
Second granularity data is distributed to corresponding number by the granular information of second granularity data and the second granularity data information
According to library, second granular information and the second granularity data information are uploaded to monitoring unit, wherein second granularity data
Granular information include task granularity, system granular, service line granularity, at least one information of distribution type granularity, second
Degrees of data information is the data number information of the second granularity data, data size information.
(4) monitoring unit is configured to：
According to first granular information and the first granularity data information, the second granular information and the second granularity data information
Generate monitored results,
It is also configured to：
The data of middleware unit are obtained according to the first granularity data information of monitoring unit and the second granularity data information
Backlog information；
Data flow letter is obtained according to the first granular information of monitoring unit, the second granular information combination data origin information
Breath, data flow information further includes theme granularity metamessage.
Data origin information is obtained by accessing the field data that data are submitted.
(5) alarm unit is configured to compare the overstocked value of the data of middleware unit and the overstocked threshold value of data, if intermediate
It is more than that the overstocked threshold value of data then generates warning result that the data of part unit, which overstock value,.
Monitoring unit includes increase income monitoring module, visual control module.
Wherein, monitoring module of increasing income is configured to：
Receive first granular information and the first granularity data information, second granular information and the second granularity data
Information；
The data that middleware unit is obtained according to the first granularity data information and the second granularity data information overstock letter
Breath.
Visual control module is configured to：
Receive theme granularity metamessage；
Show monitored results.
Visual control module is also configured to：
Middleware unit is called to visualize data backlog information；
According to http agreements, by calling, monitoring module of increasing income visualizes data origin information and/or data flow is believed
Breath.
The data accessed by middleware unit include no platform data or the platform data collected by data collector,
Middleware unit can be kafka, and monitoring module of increasing income can be openTSDB, and the data accessed by middleware unit are pressed
Topic is stored, and generates topic granular informations, and topic granularity metamessages are transmitted to visual control module.
The data backlog information of middleware unit calls kafka to be visualized by visual control module.
Data origin information and/or data flow information pass through calling by visual control module according to http agreements
OpenTSDB API are visualized.
The real-time visual monitoring system of the access Dispatching Unit is by reporting to the data of the access unit of openTSDB
Quantity information, data size information and granular information and report to the data number information of Dispatching Unit of openTSDB, data
Size information and granular information, and data origin information overstocked to the data of data backlog information, kafka in Dispatching Unit,
Data flow information is monitored.
Above system is a set of data monitoring system that can completely cover company's items business, can observe public affairs on a macro scale
The business and data of department, and the microscopic observation model of low-level details can be shielded.
This system constructs visual control module on entirely access Dispatching Unit upper layer, can be systematically independent in real time
Ground monitors the service condition of AM access module and distribution module, can find that each module is already existing or potential system in real time
Problem.
The system uses kafka Information frames, the business datum of each department is accessed, including bee, binlog, udp, sdk etc.
Data type can be distributed in es, hdfs, hive, hbase by all kinds of means, and access data and distribution data are passed through prison
Control program is uploaded to openTSDB, and the innovation can either visualize system and data mode in Linux system, also can
Data record in openTSDB is visualized out.Low-level details, key observation can be shielded；Can from service line,
A variety of particle sizing systems such as system, topic themes, task, data type ground monitoring data；It is configured with data and overstocks abnormality alarming；
Realization system visualizes completely, easy to use.
A kind of equipment is present embodiments provided, the equipment includes：
One or more processors；
Memory, for storing one or more programs,
When one or more of programs are executed by one or more of processors so that one or more of places
It manages device and executes any one of them method as above.
A kind of computer readable storage medium being stored with computer program is present embodiments provided, the program is by processor
Any one of them method as above is realized when execution.
Embodiment two
The present embodiment feature identical with embodiment one repeats no more, and the present embodiment feature different from embodiment one exists
In：
The data accessed by middleware unit are the platform data collected by data collector.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.People in the art
Member should be appreciated that invention scope involved in the application, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic
Scheme, while should also cover in the case where not departing from the inventive concept, it is carried out by above-mentioned technical characteristic or its equivalent feature
Other technical solutions of arbitrary combination and formation.Such as features described above has similar work(with (but not limited to) disclosed herein
Energy.
Claims (27)
1. a kind of real-time visual monitoring method of access Dispatching Unit, characterized in that include the following steps：
Granularity division is carried out to access data, obtains the first granularity data, and generate the granular information of first granularity data
And the first granularity data information, first granularity data is sent to middleware unit, by first granular information and
One granularity data information is uploaded to monitoring unit；
The first granularity data is received by middleware unit, generates data to be distributed；
Granularity division is carried out to data to be distributed, obtains the second granularity data, and generates the granularity letter of second granularity data
Breath and the second granularity data information, are distributed to corresponding database, by second granular information by second granularity data
And second granularity data information be uploaded to monitoring unit；
According to first granular information and the first granularity data information, the second granular information and the second granularity number of monitoring unit
It is believed that breath generates monitored results.
2. the real-time visual monitoring method of access Dispatching Unit according to claim 1, characterized in that single according to monitoring
First granular information and the first granularity data information, the second granular information and the second granularity data information of member generate monitoring
As a result, including：
The data that middleware unit is obtained according to the first granularity data information of monitoring unit and the second granularity data information are overstock
Information；
Data flow information is obtained according to the first granular information of monitoring unit, the second granular information combination data origin information.
3. the real-time visual monitoring method of access Dispatching Unit according to claim 2, characterized in that further include：It will
The data of middleware unit overstock value and are compared with the overstocked threshold value of data, if the data of middleware unit overstock value and overstock more than data
Threshold value then generates warning result.
4. the real-time visual monitoring method of access Dispatching Unit according to claim 2, characterized in that data source is believed
Breath is obtained by accessing the field data that data are submitted.
5. the real-time visual monitoring method of access Dispatching Unit according to claim 2, characterized in that further include：It is logical
It crosses middleware unit and receives the first granularity data, stored, generate theme granular information, and theme granularity metamessage is uploaded
To monitoring unit.
6. the real-time visual monitoring method of access Dispatching Unit according to claim 5, characterized in that data flow is believed
Breath further includes theme granularity metamessage.
7. the real-time visual monitoring method of access Dispatching Unit according to claim 6, characterized in that monitoring unit packet
Include monitoring module of increasing income, visual control module.
8. the real-time visual monitoring method of access Dispatching Unit according to claim 7, characterized in that described first
Degree information and the first granularity data information, second granular information and the second granularity data information are uploaded to monitoring mould of increasing income
Block.
9. the real-time visual monitoring method of access Dispatching Unit according to claim 8, characterized in that theme granularity member
Information is uploaded to visual control module.
10. the real-time visual monitoring method of access Dispatching Unit according to claim 9, characterized in that according to monitoring
The the first granularity data information and the second granularity data information of unit obtain the data backlog information of middleware unit, including：
The data of middleware unit are obtained according to the first granularity data information of monitoring module of increasing income and the second granularity data information
Backlog information.
11. the real-time visual monitoring method of access Dispatching Unit according to claim 10, characterized in that monitored results
Pass through visual control modules exhibit.
12. the real-time visual monitoring method of access Dispatching Unit according to claim 11, characterized in that data are overstock
Information calls middleware unit to be visualized by visual control module.
13. the real-time visual monitoring method of access Dispatching Unit according to claim 11, characterized in that data source
Information and/or data flow information can by calling monitoring module of increasing income to carry out according to http agreements by visual control module
It is shown depending on changing.
14. according to the real-time visual monitoring method of any access Dispatching Unit of claim 1-13, characterized in that
The granular information of first granularity data be task granularity, system granular, service line granularity, access style granularity extremely
A kind of few information,
The granular information of second granularity data includes task granularity, system granular, service line granularity, distribution type granularity
At least one information.
15. a kind of real-time visual monitoring system of access Dispatching Unit, characterized in that including：
Access unit is configured to carry out granularity division to access data, obtains the first granularity data, and generate described first
First granularity data is sent to middleware unit by the granular information of degrees of data and the first granularity data information, will be described
First granular information and the first granularity data information are uploaded to monitoring unit；
Middleware unit is configured to middleware unit and receives the first granularity data, generates data to be distributed；
Dispatching Unit is configured to carry out granularity division to data to be distributed, obtains the second granularity data, and generate described second
Second granularity data is distributed to corresponding database by the granular information of granularity data and the second granularity data information, will
Second granular information and the second granularity data information are uploaded to monitoring unit；
Monitoring unit is configured to according to first granular information and the first granularity data information, the second granular information and
Two granularity data information generate monitored results.
16. the real-time visual monitoring system of access Dispatching Unit according to claim 15, characterized in that monitoring unit
It is also configured to：
The data that middleware unit is obtained according to the first granularity data information of monitoring unit and the second granularity data information are overstock
Information；
Data flow information is obtained according to the first granular information of monitoring unit, the second granular information combination data origin information.
17. the real-time visual monitoring system of access Dispatching Unit according to claim 16, characterized in that further include police
Show unit, is configured to compare the overstocked value of the data of middleware unit and the overstocked threshold value of data, if the data of middleware unit
It is more than that the overstocked threshold value of data then generates warning result to overstock value.
18. the real-time visual monitoring system of access Dispatching Unit according to claim 16, characterized in that data source
Information is obtained by accessing the field data that data are submitted.
19. the real-time visual monitoring system of access Dispatching Unit according to claim 16, characterized in that middleware list
Member is also configured to receive the first granularity data, is stored, and generates theme granular information, and theme granularity metamessage is uploaded
To monitoring unit.
20. the real-time visual monitoring system of access Dispatching Unit according to claim 19, characterized in that data flow
Information further includes theme granularity metamessage.
21. the real-time visual monitoring system of access Dispatching Unit according to claim 20, characterized in that monitoring unit
Including monitoring module of increasing income, visual control module.
22. the real-time visual monitoring system of access Dispatching Unit according to claim 21, characterized in that monitoring of increasing income
Module is configured to：
Receive first granular information and the first granularity data information, second granular information and the second granularity data letter
Breath；
The data backlog information of middleware unit is obtained according to the first granularity data information and the second granularity data information.
23. the real-time visual monitoring system of access Dispatching Unit according to claim 22, characterized in that
Visual control module is configured to：
Receive theme granularity metamessage；
Show monitored results.
24. the real-time visual monitoring system of access Dispatching Unit according to claim 23, characterized in that visualization prison
Control module is configured to：
Middleware unit is called to visualize data backlog information；
According to http agreements by calling monitoring module of increasing income to visualize data origin information and/or data flow information.
25. according to the real-time visual monitoring system of any access Dispatching Unit of claim 15-24, characterized in that
The granular information of first granularity data be task granularity, system granular, service line granularity, access style granularity extremely
A kind of few information,
The granular information of second granularity data includes task granularity, system granular, service line granularity, distribution type granularity
At least one information.
26. a kind of equipment, characterized in that the equipment includes：
One or more processors；
Memory, for storing one or more programs,
When one or more of programs are executed by one or more of processors so that one or more of processors
Execute the method as described in any one of claim 1-14.
27. a kind of computer readable storage medium being stored with computer program, characterized in that when the program is executed by processor
Realize the method as described in any one of claim 1-14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810181722.XA CN108415808B (en) | 2018-03-06 | 2018-03-06 | Real-time visual monitoring method, system, equipment and medium for access distribution unit |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810181722.XA CN108415808B (en) | 2018-03-06 | 2018-03-06 | Real-time visual monitoring method, system, equipment and medium for access distribution unit |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108415808A true CN108415808A (en) | 2018-08-17 |
| CN108415808B CN108415808B (en) | 2022-03-15 |
Family
ID=63129781
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810181722.XA Active CN108415808B (en) | 2018-03-06 | 2018-03-06 | Real-time visual monitoring method, system, equipment and medium for access distribution unit |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108415808B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111126933A (en) * | 2019-11-11 | 2020-05-08 | 中盈优创资讯科技有限公司 | Kafka production and consumption progress monitoring method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7949673B2 (en) * | 2005-12-15 | 2011-05-24 | Computer Associates Think, Inc. | Correlating cross process and cross thread execution flows in an application manager |
| CN105243002A (en) * | 2015-08-28 | 2016-01-13 | 浪潮软件股份有限公司 | Message middleware monitoring method and system |
| CN106453554A (en) * | 2016-10-11 | 2017-02-22 | 上海携程商务有限公司 | Monitoring system and monitoring method for application dependency in distributed information system |
-
2018
- 2018-03-06 CN CN201810181722.XA patent/CN108415808B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7949673B2 (en) * | 2005-12-15 | 2011-05-24 | Computer Associates Think, Inc. | Correlating cross process and cross thread execution flows in an application manager |
| CN105243002A (en) * | 2015-08-28 | 2016-01-13 | 浪潮软件股份有限公司 | Message middleware monitoring method and system |
| CN106453554A (en) * | 2016-10-11 | 2017-02-22 | 上海携程商务有限公司 | Monitoring system and monitoring method for application dependency in distributed information system |
Non-Patent Citations (1)
| Title |
|---|
| 半兽人: "KafkaOffsetMonitor：监控消费者和延迟的队列", 《HTTPS://WWW.ORCHOME.COM/54》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111126933A (en) * | 2019-11-11 | 2020-05-08 | 中盈优创资讯科技有限公司 | Kafka production and consumption progress monitoring method and device |
| CN111126933B (en) * | 2019-11-11 | 2023-09-29 | 中盈优创资讯科技有限公司 | Kafka production and consumption progress monitoring method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108415808B (en) | 2022-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020259421A1 (en) | Method and apparatus for monitoring service system | |
| Al-Abassi et al. | Industrial big data analytics: challenges and opportunities | |
| US20210406981A1 (en) | Method and apparatus of determining display page, electronic device, and medium | |
| Chandy et al. | 10201 executive summary and manifesto–event processing | |
| Imran et al. | Engineering crowdsourced stream processing systems | |
| US20170178490A1 (en) | Informing first responders based on incident detection, and automatic reporting of individual location and equipment state | |
| US20190303112A1 (en) | Replacement algorithm selection platform | |
| Munir et al. | Big data: big challenges to privacy and data protection | |
| CN112181704A (en) | Big data task processing method and device, electronic equipment and storage medium | |
| CN111078980A (en) | Management method, device, equipment and storage medium based on credit investigation big data | |
| Pramanik et al. | A framework for criminal network analysis using big data | |
| CN115237857A (en) | Log processing method and device, computer equipment and storage medium | |
| Bihl et al. | Analytics for Autonomous C4ISR within e-Government: a Research Agenda. | |
| Alshurideh et al. | Automated Sales Management System Empowered with Artificial Intelligence | |
| Surnin et al. | Industrial application of big data services in digital economy | |
| CN108415808A (en) | Access real-time visual monitoring method, system, equipment and the medium of Dispatching Unit | |
| Sindiramutty et al. | Modern Smart Cities and Open Research Challenges and Issues of Explainable Artificial Intelligence | |
| Fathoni et al. | A container-based of edge device monitoring on Kubernetes | |
| CN102541563A (en) | Method and system for generating monitoring interfaces | |
| US10289633B1 (en) | Integrating compliance and analytic environments through data lake cross currents | |
| CN111240866A (en) | Service data processing method and device | |
| Agostinelli | Actionable framework for city digital twin-enabled predictive maintenance and security management systems | |
| Gaykar et al. | Faulty Node Detection in HDFS Using Machine Learning Techniques. | |
| WO2023021526A1 (en) | Cognitive interoperable inquisitive source agnostic infrastructure omni-specifics intelligence process and system for collaborative infra super diligence | |
| CN110677271B (en) | Big data alarm method, device, equipment and storage medium based on ELK |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |