CN117370053A - Information system service operation-oriented panoramic monitoring method and system - Google Patents

Information system service operation-oriented panoramic monitoring method and system Download PDF

Info

Publication number
CN117370053A
CN117370053A CN202311191727.8A CN202311191727A CN117370053A CN 117370053 A CN117370053 A CN 117370053A CN 202311191727 A CN202311191727 A CN 202311191727A CN 117370053 A CN117370053 A CN 117370053A
Authority
CN
China
Prior art keywords
data
fault
module
unit
index
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311191727.8A
Other languages
Chinese (zh)
Inventor
柏永飞
唐海荣
刘庭辉
杨式威
阮冬玲
严晴
张南京
王泉啸
周晨曦
杨兴翔
施成龙
朱江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nari Information and Communication Technology Co
Original Assignee
Nari Information and Communication Technology Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nari Information and Communication Technology Co filed Critical Nari Information and Communication Technology Co
Priority to CN202311191727.8A priority Critical patent/CN117370053A/en
Publication of CN117370053A publication Critical patent/CN117370053A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/079Root cause analysis, i.e. error or fault diagnosis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0709Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0766Error or fault reporting or storing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/243Classification techniques relating to the number of classes
    • G06F18/2433Single-class perspective, e.g. one-against-all classification; Novelty detection; Outlier detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Hardware Design (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses an information system service operation panoramic monitoring method and system, comprising the steps of constructing an information system panoramic monitoring index system based on service requirements, wherein the service requirements comprise abnormal prior user perception, automatic alarm association and accurate fault positioning; acquiring target monitoring data and preprocessing the target monitoring data; and combining the preprocessed data with an information system panoramic monitoring index system to perform alarm analysis and fault positioning, and finishing panoramic monitoring of information system service operation. The method realizes the automatic association of abnormality prior to user perception and alarm and the accurate positioning of faults.

Description

Information system service operation-oriented panoramic monitoring method and system
Technical Field
The invention relates to the technical field of operation and maintenance management of enterprise information systems, in particular to a panoramic monitoring method and a panoramic monitoring system for information system business operation.
Background
The information system monitoring is a process of collecting information system operation data through a technical means and analyzing and managing the information system operation data. The system aims to know the running condition of the system in real time, discover risks and problems possibly faced by the system in time and ensure the stable and efficient running of the system. Information system monitoring includes user experience monitoring, business application monitoring, service monitoring, platform component monitoring, infrastructure monitoring, and the like. The existing information system operation and maintenance monitoring has the following defects:
(1) The monitoring range is limited: the technical level index monitoring, such as server index, network index, etc., is mainly focused. The monitoring of service data, service call links and user experience is insufficient, and the monitoring is mainly 'point', so that the operation effect of the system cannot be comprehensively estimated.
(2) The monitoring system is isolated: the association relation exists among different monitoring systems, and the effective sharing of data and information cannot be realized, so that the global system view is difficult to obtain in the problem diagnosis and decision process, and the phenomenon of 'information island' occurs.
(3) Lack of standardization: at present, the monitoring system generally adopts respective monitoring schemes and index systems, and lacks unified monitoring data standards and interface specifications. This makes the data between different monitoring systems difficult to interoperate and compare, preventing monitoring integration.
Disclosure of Invention
This section is intended to outline some aspects of embodiments of the invention and to briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section as well as in the description summary and in the title of the application, to avoid obscuring the purpose of this section, the description summary and the title of the invention, which should not be used to limit the scope of the invention.
The present invention has been made in view of the above-described problems occurring in the prior art.
Therefore, the invention provides a panoramic monitoring method and a panoramic monitoring system for information system service operation, which can solve the problems in the background technology.
In order to solve the technical problems, the invention provides a panoramic monitoring method for information system service operation, which comprises the following steps:
constructing an information system panoramic monitoring index system based on service requirements, wherein the service requirements comprise abnormal prior to user perception, automatic alarm association and accurate fault positioning;
acquiring target monitoring data and preprocessing the target monitoring data;
and combining the preprocessed data with the information system panoramic monitoring index system to perform alarm analysis and fault positioning, and finishing panoramic monitoring of information system business operation.
An information system service operation-oriented panoramic monitoring system is characterized in that: comprises a monitoring data acquisition unit, a server unit, a communication unit, a logic analysis unit, an alarm unit and a terminal display and query unit,
the monitoring data acquisition unit is used for collecting service performance data, operation and maintenance service data, resources and relation data, dividing the data into current period data and historical period data according to a fixed period, and transmitting the data to the server unit for structural storage;
The server unit is used for acquiring the data information transmitted by the monitoring data acquisition unit, carrying out structural storage, and calling different structured data according to the instruction information transmitted by other units to transmit the data to the corresponding unit through the communication unit;
a communication unit for maintaining connection of the respective units in the system;
the logic analysis unit is used for presetting performance indexes, service application indexes and alarm indexes, sending data analysis instructions to the server unit through the communication unit, and analyzing and judging monitoring data according to the data transmitted by the server unit and combining the preset performance indexes, the service application indexes and the alarm indexes;
the alarm unit is used for alarming according to the analysis and judgment results of the logic analysis unit;
the terminal display and query unit is used for displaying the analysis and judgment result of the logic analysis unit and carrying out alarming by combining the alarming unit, providing resource query service for a user, and calling and displaying corresponding data in the server unit through the communication unit.
As a preferable scheme of the information system service oriented operation panoramic monitoring system, the invention comprises the following steps: the monitoring data acquisition unit comprises a data collection module and a data processing module,
The data collection module comprises a first data collection part, a second data collection part and a third data collection part, and the first data collection part, the second data collection part and the third data collection part are simultaneously connected with the data processing module in a unidirectional way and directly transmit collected data to the data processing module;
the first data collecting part collects system external data through an APM tool, the second data collecting part collects system external data through an NPM tool, the third data collecting part collects system external data through other link monitoring tools, the data processing module aggregates data into three types of data, namely topology data, link data and index data after receiving the data transmitted by the data collecting module, and the three types of data are structured and then sent to the server unit through the communication unit, and the server unit stores the received structured data;
the structuring includes dividing the data into base monitoring data, traffic link data, system traffic data, and log data.
As a preferable scheme of the information system service oriented operation panoramic monitoring system, the invention comprises the following steps: the logic analysis unit comprises an index preset module, an index comparison module, a fault analysis and judgment module, a fault positioning module and a fault early warning module,
The index presetting module is used for presetting performance indexes, service application indexes and alarm indexes, the index comparison module is directly connected with the server unit through a communication unit, and transmits comparison instructions to the communication unit, wherein the comparison instructions comprise a first comparison instruction, a second comparison instruction and a third comparison instruction;
when the server unit acquires a first comparison instruction, the server unit transmits basic monitoring data to the index comparison module, the index comparison module compares the data by combining the indexes preset in the index preset module, and after a first comparison result is generated, the first comparison result is transmitted to the fault analysis and judgment module;
when the server unit acquires a second comparison instruction, the server unit transmits service link data and system service data to the index comparison module, the index comparison module compares the data by combining indexes preset in the index preset module to generate a second comparison result, and the first comparison result is transmitted to the fault analysis and judgment module;
when the server unit acquires a third comparison instruction, the server unit transmits log data to the index comparison module, the index comparison module compares the data by combining the indexes preset in the index preset module to generate a third comparison result, and the third judgment result is transmitted to the fault analysis and judgment module.
As a preferable scheme of the information system service oriented operation panoramic monitoring system, the invention comprises the following steps: the logic analysis unit may further comprise a logic analysis unit,
the fault analysis and judgment module receives the index comparison result transmitted by the index comparison module and analyzes and judges the index comparison result;
when the first judgment result is received, if the basic monitoring data in the first judgment result deviates from the preset basic monitoring data by ten percent, or the basic monitoring data in the first judgment result is absent, a fault is determined;
when the second judging result is received, if the service link data and the system service data in the second judging result are missing, the fault is determined to occur;
when the third judging result is received, if the log data in the third judging result is missing or is increased compared with the previous period, the fault is determined.
As a preferable scheme of the information system service oriented operation panoramic monitoring system, the invention comprises the following steps: the logic analysis unit may further comprise a logic analysis unit,
the fault positioning module is used for obtaining a specific positioning model through combining with a neural network training, receiving fault data from log data in the server unit, taking the fault data as input, taking the fault type and the fault position as output, and training the fault positioning neural network model;
After the training of the fault location neural network model is completed, the fault location module stores the model into the server unit, if the fault analysis and judgment module judges that the result is a fault, the fault analysis and judgment module sends a fault to-be-located instruction to the fault location module, and after the fault location module obtains the fault to-be-located instruction, the fault location module sends a command for calling the fault location neural network model to the server unit through the communication unit;
when the fault location neural network model is successfully called, the real-time data in the server unit is directly used as a model input to be accessed into the fault location neural network model, the fault type and the fault position information are obtained, and the fault type and the fault position information are transmitted to the fault early warning module;
and the fault early warning module confirms the alarm grade of the fault type and the fault position information and then transmits the alarm grade to the alarm unit.
As a preferable scheme of the information system service oriented operation panoramic monitoring system, the invention comprises the following steps: the alarm unit comprises alarm triggering strategy configuration and alarm notification strategy configuration, wherein the alarm triggering strategy configuration is used for providing multi-channel alarm for information system monitoring, the alarm triggering strategy is used for independently configuring, alarm triggering conditions comprise single-index triggering and multi-index combined triggering, the single-index triggering rules comprise missing alarms, threshold alarms, character comparison, trend alarms, state inversion, floating threshold alarms and abrupt change alarm rules, the multi-index triggering is used for carrying out multi-index combined alarm based on AND or rules, the alarm notification strategy configuration comprises an alarm resource range and a notification strategy, and the alarm resource range is set through resource types, resource units, machine rooms, groups and resource instance modes; the notification strategy comprises a receiving object, a notification mode, notification time, a repetition rule and an upgrading rule, and also comprises functions of de-duplication, grouping, suppression, silence and routing of the alarms, and alarms are carried out according to analysis and judgment results of the logic analysis unit.
As a preferable scheme of the information system service oriented operation panoramic monitoring system, the invention comprises the following steps: the terminal display and query unit comprises data collected by a display system, displays alarm information by combining the alarm unit, and queries resources according to user requirements.
A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method as described above when executing the computer program.
A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method as described above.
The invention has the beneficial effects that: the invention provides an information system service operation panoramic monitoring method and system, which construct an information system panoramic monitoring index system based on service requirements, wherein the service requirements comprise abnormal prior user perception, automatic alarm association and accurate fault positioning; acquiring target monitoring data and preprocessing the target monitoring data; and combining the preprocessed data with the information system panoramic monitoring index system to perform alarm analysis and fault positioning, and finishing panoramic monitoring of information system business operation. The method realizes the automatic association of abnormality prior to user perception and alarm and the accurate positioning of faults.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. Wherein:
FIG. 1 is a flow chart of a method and system for panoramic monitoring of information system-oriented business operations according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a system structure of a panoramic monitoring method and a system for information system service operation according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an APM/NPM external probe nanotube for an information system service operation panorama monitoring method and system according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of an architecture of a panoramic monitoring technique of an information system for an information system service operation panoramic monitoring method and system according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an information system panoramic monitoring flow for an information system service operation panoramic monitoring method and system according to an embodiment of the present invention;
Fig. 6 is an internal structure diagram of a computer device for an information system service operation panorama monitoring method and system according to an embodiment of the present invention.
Detailed Description
So that the manner in which the above recited objects, features and advantages of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways other than those described herein, and persons skilled in the art will readily appreciate that the present invention is not limited to the specific embodiments disclosed below.
Further, reference herein to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic can be included in at least one implementation of the invention. The appearances of the phrase "in one embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments.
While the embodiments of the present invention have been illustrated and described in detail in the drawings, the cross-sectional view of the device structure is not to scale in the general sense for ease of illustration, and the drawings are merely exemplary and should not be construed as limiting the scope of the invention. In addition, the three-dimensional dimensions of length, width and depth should be included in actual fabrication.
Also in the description of the present invention, it should be noted that the orientation or positional relationship indicated by the terms "upper, lower, inner and outer", etc. are based on the orientation or positional relationship shown in the drawings, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the apparatus or elements referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention. Furthermore, the terms "first, second, or third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
The terms "mounted, connected, and coupled" should be construed broadly in this disclosure unless otherwise specifically indicated and defined, such as: can be fixed connection, detachable connection or integral connection; it may also be a mechanical connection, an electrical connection, or a direct connection, or may be indirectly connected through an intermediate medium, or may be a communication between two elements. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.
Example 1
Referring to fig. 1-6, a first embodiment of the present invention provides an information system service oriented operation panorama monitoring system, comprising:
in a preferred embodiment, an information system service oriented operation panorama monitoring system comprises a monitoring data acquisition unit 100, a server unit 200, a communication unit 300, a logic analysis unit 400, an alarm unit 500 and a terminal presentation and query unit 600,
the monitoring data acquisition unit 100 is configured to collect service performance data, operation and maintenance service data, and resource and relationship data, divide the data into current period and historical period data according to a fixed period, and transmit the data to the server unit 200 for structural storage;
the server unit 200 is configured to obtain the data information transmitted by the monitoring data acquisition unit 100, perform structural storage, and invoke different structured data according to the instruction information transmitted by other units, and transmit the data to the corresponding unit through the communication unit 300;
a communication unit 300 for maintaining connection of the respective units in the system;
the logic analysis unit 400 is configured to preset a performance index, a service application index and an alarm index, send a data analysis instruction to the server unit 200 through the communication unit 300, and analyze and judge the monitored data according to the data transmitted by the server unit 200 in combination with the preset performance index, the service application index and the alarm index;
An alarm unit 500 for alarming according to the analysis and judgment result of the logic analysis unit 400;
the terminal display and query unit 600 is configured to display the analysis and judgment result of the logic analysis unit 400 and perform the alarm in combination with the alarm unit 500, and provide the resource query service for the user, and retrieve and display the corresponding data in the server unit 200 through the communication unit 300.
The monitoring data acquisition unit 100 comprises a data collection module 101 and a data processing module 102,
the data collection module 101 includes a first data collection unit 101a, a second data collection unit 101b, and a third data collection unit 101c, where the first data collection unit 101a, the second data collection unit 101b, and the third data collection unit 101c are connected with the data processing module 102 in one way at the same time, and directly transmit collected data to the data processing module 102;
the first data collection part 101a collects system external data through an APM tool, the second data collection part 101b collects system external data through an NPM tool, the third data collection part 101c collects system external data through other link monitoring tools, the data processing module 102 aggregates the data into three types of topology data, link data and index data after receiving the data transmitted by the data collection module 101, and sends the three types of data to the server unit 200 through the communication unit 300, and the server unit 200 dumps the received data;
Structuring includes separating the data into base monitoring data, traffic link data, system traffic data, and log data.
The basic monitoring data may include indexes such as port rate, CPU usage, memory usage, session number, newly-built connection number, packet loss ratio, time delay, etc., the service link data may include information such as call request success rate, call average response, call per minute number, topology data, trace call list, span monitoring details, etc., and the system service data may include data such as registered user number, online user number, active user number, newly-added user number, access number, traffic volume, service operation stage distribution, service access number, service object number, etc., and log data.
The logic analysis unit 400 includes an index presetting module 401, an index comparing module 402, a fault analyzing and judging module 403, a fault locating module 404 and a fault pre-warning module 405,
the index presetting module 401 is used for presetting performance indexes, service application indexes and alarm indexes, the index comparison module 402 is directly connected with the server unit 200 through the communication unit 300, and the index comparison module 402 sends comparison instructions to the communication unit 300, wherein the comparison instructions comprise a first comparison instruction, a second comparison instruction and a third comparison instruction;
When the server unit 200 acquires the first comparison instruction, the server unit 200 transmits the basic monitoring data to the index comparison module 402, the index comparison module 402 judges the data by combining the index preset in the index preset module 401, and transmits the judging result to the fault analysis and judging module 403;
when the server unit 200 acquires the second comparison instruction, the server unit 200 transmits the service link data and the system service data to the index comparison module 402, the index comparison module 402 judges the data by combining the index preset in the index preset module 401, and transmits the judging result to the fault analysis and judging module 403;
when the server unit 200 obtains the third comparison instruction, the server unit 200 transmits the log data to the index comparison module 402, the index comparison module 402 determines the data by combining the index preset in the index preset module 401, and transmits the determination result to the fault analysis and determination module 403.
The logic analysis unit 400 further comprises a logic analysis unit,
the fault analysis and judgment module 403 receives the index comparison result transmitted from the index comparison module 402, and analyzes and judges the index comparison result;
When the first judgment result is received, if the basic monitoring data in the first judgment result deviates from the preset basic monitoring data by ten percent, or the basic monitoring data in the first judgment result is absent, a fault is determined;
when the second judging result is received, if the service link data and the system service data in the second judging result are missing, the fault is determined to occur;
when the third judging result is received, if the log data in the third judging result is missing or is increased compared with the previous period, the fault is determined.
The logic analysis unit 400 further comprises a logic analysis unit,
the fault location module 404 obtains a specific location model by combining with the neural network training, the fault location module 404 receives fault data from the log data in the server unit 200, takes the fault data as input, takes the fault type and the fault position as output, and trains the fault location neural network model;
after the training of the fault location neural network model is completed, the fault location module 404 stores the model in the server unit 200, if the fault analysis and judgment module 403 judges that the result is a fault, the fault analysis and judgment module 403 sends a fault to-be-located instruction to the fault location module 404, and after the fault location module 404 obtains the fault to-be-located instruction, the fault location module 404 sends a command for calling the fault location neural network model to the server unit 200 through the communication unit 300;
After the fault location neural network model is successfully called, the real-time data in the server unit 200 is directly used as a model input to be accessed into the fault location neural network model, the fault type and the fault location information are obtained, and the fault type and the fault location information are transmitted to the fault early warning module 405;
the fault early warning module 405 confirms the alarm level of the fault type and the fault location information, and then transmits the alarm level to the alarm unit 500.
The alarm unit 500 includes providing an alarm trigger policy configuration and an alarm notification policy configuration, and providing a multi-channel alarm for information system monitoring, wherein the alarm trigger policy is configured independently, the alarm trigger condition includes single-index trigger and multi-index combined trigger, the single-index trigger rule includes missing alarm, threshold alarm, character comparison, trend alarm, state inversion, floating threshold alarm and abrupt change alarm rule, the multi-index trigger carries out multi-index combined alarm based on AND or rule, the alarm notification policy configuration includes an alarm resource range and a notification policy, and the alarm resource range includes setting by resource type, resource unit, machine room, group and resource instance mode; the notification policy includes receiving an object, a notification manner, a notification time, a repetition rule, an upgrade rule, and further includes functions of de-duplication, grouping, suppression, silence, and routing of alarms, and alarms are performed according to the analysis and judgment result of the logic analysis unit 400.
The terminal display and query unit 600 includes data collected by the display system, displays the alarm information in combination with the alarm unit 500, and queries resources according to user requirements.
The above unit modules may be embedded in hardware or independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above units.
In summary, the invention provides an information system service-oriented panoramic monitoring system, which constructs an information system panoramic monitoring index system based on service requirements, wherein the service requirements comprise abnormal prior user perception, alarm automatic association and fault accurate positioning; acquiring target monitoring data and preprocessing the target monitoring data; and combining the preprocessed data with an information system panoramic monitoring index system to perform alarm analysis and fault positioning, and finishing panoramic monitoring of information system service operation. The method realizes the automatic association of abnormality prior to user perception and alarm and the accurate positioning of faults.
Example 2
Referring to fig. 1-6, for one embodiment of the present invention, there is provided an information system service oriented operation panorama monitoring method, including:
Constructing an information system panoramic monitoring index system based on service requirements, wherein the service requirements comprise abnormal prior to user perception, alarm automatic association and fault accurate positioning;
acquiring target monitoring data and preprocessing the target monitoring data;
and combining the preprocessed data with an information system panoramic monitoring index system to perform alarm analysis and fault positioning, and finishing panoramic monitoring of information system service operation.
In the embodiment of the application, APM/NPM link tool data integration specification is proposed: the external system gathers APM and NPM data into three types of data, namely topology data (topo), link data (trace) and index data (metric), through APM, NPM tools or other link monitoring tools, and sends the three types of data to a message queue through an adaptation program, and a dump service dumps the received data.
Wherein, topology data Topo: the topology data is call topology data between business system application services, databases, middleware or external system application services in a period of time, and comprises transaction topology data, service topology data and network topology data.
It should be noted that the link data Trace: the link data Trace is a specific call request of a user, an APM link and an NPM link, and includes detailed data such as a start point and an end point of the link, related call stack information and the like.
Note that, the index data Metric: the index data metadata is related data of aggregation, calculation and statistics of data such as services, service instances, call chain Trace and the like.
It should be noted that the APM/NPM external probe was subjected to uniform nanotube: in order to realize the unified nano tube for the APM and NPM probes of various manufacturers, a probe unified nano tube supporting service function is provided, and each probe manufacturer needs to develop and realize the relevant adapting function according to the requirements of the unified nano tube.
In the embodiment of the application, a southbound interface service specification is proposed: external data receiving and gathering such as information system service data, system integration interfaces or monitoring indexes are realized through a southbound interface, and data transmission capacity is realized through an API interface and a message queue mode. The data instant processing scene uses an API interface, and complies with RESTful specifications based on an HTTP protocol; the data batch receiving and subscribing scenario uses message services, supporting Kafka, rabbitMQ and other common message queue middleware.
In the embodiment of the application, an information system panoramic monitoring index system is established: including physical device (host device, network device, security device, storage device, machine room device, dedicated device, etc.) indicators, basic platform (cloud platform, data center, VMware, openStack, kubernetes, cloud resources, cloud database, cloud middleware, etc.) indicators, information system (business, service link, service topology, etc.) indicators, log data. And (5) standardizing the acquisition and access of objects, acquisition indexes, acquisition modes and acquisition frequencies.
It should be noted that, according to the monitoring index system, a corresponding index library and an acquisition mode are established, and the acquisition modes are divided into three modes of Agent acquisition, protocol acquisition and third party data access.
It should be noted that Agent collection includes plug-in collection, script collection, probe, etc., supports pluggable plug-in collection, supports third party collection plug-in access, and realizes the expansion of collection range and collection mode.
It should be noted that the protocol acquisition includes data acquisition of general protocols such as SNMP, SSH, WMI, RESTFUL, JMX, SMI-S, IPMI, HTTP, HTTPS, JDBC.
Furthermore, the third party data access can support the access of the third party collected data through the south interface and the APM and NPM interface specifications.
In the embodiment of the application, the business link model and the resource model are also subjected to unified maintenance management based on the CMDB: the business link model comprises a business scene, business activities and service endpoints, and the information system business scene management is realized through the business link model and the correlation relationship. And simultaneously combining resource models of an information system, a platform component, an infrastructure and the like and association relations to finally form a full scene data model for supporting panoramic monitoring of the information system, wherein the full scene data model comprises nodes, links and systems of various layers from an infrastructure layer, a platform layer, a service layer to an application layer and the like.
In the embodiment of the application, alarm centralized management is also provided: providing alarm triggering strategy configuration and alarm notification strategy configuration, and providing multi-channel alarm for information system monitoring. The alarm triggering strategy can be independently configured based on each resource model, and the alarm triggering conditions comprise single-index triggering and multi-index combined triggering. The single index triggering rules comprise rules such as missing alarms, threshold alarms, character comparison, trend alarms, state inversion, floating threshold alarms, abrupt change alarms and the like. The multi-index trigger may be multi-index joint alarm based on AND or rules. The alarm notification rule comprises an alarm resource range and a notification policy, wherein the alarm resource range can be set according to the modes of a resource type, a resource unit, a machine room, a group, a resource instance and the like, and the notification policy comprises a receiving object, a notification mode, a notification time, a repetition rule, an upgrading rule and the like. And simultaneously, the functions of de-duplication, grouping, suppression, silence, routing and the like of the alarms are supported. And the association rule engine is used for analyzing the alarm reasons, so that the fault is rapidly and accurately positioned, the interference of invalid alarms is reduced, and the alarm storm is effectively resisted.
In the embodiment of the application, a business scene arrangement is also provided: in order to solve the business requirements of various business scenes of the information system, irregular adjustment of the business scenes and the like, a business scene arrangement function is provided. The service scene arrangement refers to that operation and maintenance personnel carry out service scene creation, flow arrangement and self-defined index association based on service scene related materials combed by service departments, and service link preservation is supported. The method comprises scene classification maintenance, service scene maintenance, service circulation link maintenance and the like. The system full-link monitoring service based on the service language and guided by the service scene is realized.
In this embodiment of the present application, index billboard arrangement is also provided: in order to solve the problem that the service indexes and the display layout of the service scene need to be dynamically adjusted in different periods and under different scenes, an index signboard arrangement function is provided. The index sign arrangement is the work of arranging the service indexes and the display forms to be displayed by the service monitoring sign based on the service operation monitoring condition of the service personnel of the service department. The index billboard arrangement comprises service scene selection, service index maintenance, index billboard arrangement and layout arrangement.
In one embodiment, a computer device is provided, which may be a terminal, and the internal structure of which may be as shown in fig. 6. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless mode can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program, when executed by the processor, implements a method for panoramic monitoring of information system-oriented business operations. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of:
constructing an information system panoramic monitoring index system based on service requirements, wherein the service requirements comprise abnormal prior to user perception, alarm automatic association and fault accurate positioning;
acquiring target monitoring data and preprocessing the target monitoring data;
and combining the preprocessed data with an information system panoramic monitoring index system to perform alarm analysis and fault positioning, and finishing panoramic monitoring of information system service operation.
In summary, the invention provides an information system service operation panoramic monitoring method, which constructs an information system panoramic monitoring index system based on service requirements, wherein the service requirements comprise abnormal prior user perception, alarm automatic association and fault accurate positioning; acquiring target monitoring data and preprocessing the target monitoring data; and combining the preprocessed data with an information system panoramic monitoring index system to perform alarm analysis and fault positioning, and finishing panoramic monitoring of information system service operation. The method realizes the automatic association of abnormality prior to user perception and alarm and the accurate positioning of faults.
Example 3
Referring to fig. 1-6, for one embodiment of the present invention, there is provided a panorama monitoring method and system for service operation of an information system, including:
as shown in fig. 5, the implementation steps of developing panoramic monitoring on an information system are as follows:
information about infrastructure, platform components, business scenarios, business activities, service endpoints, physical topology graphs, micro-service inventory, system integration relationships, etc. involved in an information system is first filtered (some of which may be obtained automatically by auto discovery, such as network layer topology discovery, auto discovery of databases and middleware on hosts, auto discovery of micro-services and service endpoints). The infrastructure comprises host server, network device, security device, storage device and other resources; the platform component comprises a database, middleware and other resources; the service scene, the service activities and the service endpoint combing work mainly comprise the steps of combing the names and descriptions of the service scenes, determining the service indexes to be focused for monitoring and the service activities forming the service scenes under different service scenes, the root service endpoints of each service activity, supporting the service call links and the like of the service operation, and finally forming the contents of a service scene list, a service monitoring index list, a service flow chart, a service call chain and the like; the Internet of things topological graph refers to the topological relation of each resource deployed by the information system; the micro service list is an incidence relation between an information system deployment service list and a service scene and a service activity; the system integration relationship is used for describing the integration relationship between different service scenes and external systems, and comprises key information such as service scenes, service activities, integration modes, integration directions, integration contents and the like associated with the external systems.
And according to the related resources and the association relation related to the carded information system, performing related model maintenance in the system, wherein the related model maintenance is referred to as a resource allocation component in fig. 4. The main resource model comprises an information system, a physical machine, a storage device, a network device, a security device, a virtual machine, a cloud component, a database, middleware, a service scene, service activities, service endpoints and other models and related sub-models, and maintains the related topological relation of resources, and automatically maintains the dynamic relation of service call links and the like through acquisition.
The access of the information system monitoring data is realized by means of an acquisition control component, see fig. 4. The functions of acquisition task configuration, acquisition task scheduling execution, acquisition result return and the like are provided, and the Agent-free direct acquisition can be performed through the unified Agent of the system, and the data of a third-party tool can be accessed through a southbound interface. The collected monitoring data includes basic monitoring data (indexes such as port rate, CPU usage, memory usage, session number, newly-built connection number, packet loss ratio, time delay, etc.), service link data (information such as call request success rate, call average response, call times per minute, topology data, trace call list, span monitoring details, etc.), system service data (data such as registered user number, online user number, active user number, newly-added user number, access times, service volume, service operation stage distribution, service access times, service object number, etc.), and log data.
See fig. 2 for access to APM, NPM, etc. applications and network link data. There are two data access modes: for general APM and NPM tools, actively and periodically acquiring service link data through a system side adaptation service; for a specific link tool, the service link data is pushed periodically by the link tool manufacturer according to the specification development adaptation service. And uniformly transmitting the accessed data to a message service queue, and then transferring the data stream to a monitoring alarm service and a resource configuration service through a dump service to perform alarm monitoring and data model updating of the data.
In order to realize unified nanotubes for APM and NPM probes of various manufacturers in a system, a support service function of the unified nanotubes is provided on the system side, and each probe manufacturer needs to develop and realize relevant adapting functions according to the requirements of the unified nanotubes, see fig. 3. The following interface services are provided for the probe nanotube adapting services of each manufacturer at the system side: registering a probe nanotube adapting service (for the probe nanotube adapting service to actively register nanotube adapting service information to a system and provide pushing addresses for issuing probe operation strategies to various manufacturers), registering a deployed probe service (for the probe nanotube adapting service to actively register deployed probe instance information to the system), acquiring a probe operation strategy service (for the probe nanotube adapting service to acquire an operation strategy of a probe from the system), and receiving a probe operation state data service (the adapting service corresponding to the probe submits self-monitoring data to the system through the interface); the following interface services should be provided at the vendor side: and receiving the issued probe operation strategy service.
For the collected and accessed monitoring data, the monitoring management component and the data analysis component are used for processing the data and generating alarm information, and meanwhile, the data analysis capability is combined for carrying out alarm association analysis and fault positioning, see fig. 4. And processing the accessed monitoring data based on the link flow calculation, judging whether an alarm is generated according to alarm rules, performing processing such as de-duplication and noise reduction on the alarm information, and then performing alarm information notification transmission according to the alarm notification rules.
And finally, carrying out visual display on panoramic monitoring information of the information system through comprehensive service monitoring, panoramic monitoring running and other views. Meanwhile, according to the carded actual service scene information, the related service scene monitoring view and the related index bulletin board are dynamically configured through the scene arrangement function and the index bulletin board arrangement function provided by the system, so that service monitoring requirements of different systems are met.
It should be noted that the above embodiments are only for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solution of the present invention may be modified or substituted without departing from the spirit and scope of the technical solution of the present invention, which is intended to be covered in the scope of the claims of the present invention.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. The solutions in the embodiments of the present application may be implemented in various computer languages, for example, object-oriented programming language Java, and an transliterated scripting language JavaScript, etc.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present application without departing from the spirit or scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to cover such modifications and variations.

Claims (10)

1. An information system service operation-oriented panoramic monitoring method is characterized by comprising the following steps of: comprising the steps of (a) a step of,
constructing an information system panoramic monitoring index system based on service requirements, wherein the service requirements comprise abnormal prior to user perception, automatic alarm association and accurate fault positioning;
acquiring target monitoring data and preprocessing the target monitoring data;
and combining the preprocessed data with the information system panoramic monitoring index system to perform alarm analysis and fault positioning, and finishing panoramic monitoring of information system business operation.
2. An information system service operation-oriented panoramic monitoring system is characterized in that: comprises a monitoring data acquisition unit (100), a server unit (200), a communication unit (300), a logic analysis unit (400), an alarm unit (500) and a terminal display and query unit (600),
the monitoring data acquisition unit (100) is used for collecting service performance data, operation and maintenance service data, resources and relation data, dividing the data into current period data and historical period data according to a fixed period, and transmitting the data to the server unit (200) for structural storage;
The server unit (200) is used for acquiring the data information transmitted by the monitoring data acquisition unit (100), carrying out structural storage, and calling different structured data according to the instruction information transmitted by other units to transmit the data to the corresponding unit through the communication unit (300);
a communication unit (300) for maintaining a connection of the units in the system;
the logic analysis unit (400) is used for presetting performance indexes, service application indexes and alarm indexes, sending data analysis instructions to the server unit (200) through the communication unit (300), and analyzing and judging monitoring data according to the data transmitted by the server unit (200) and combining the preset performance indexes, the service application indexes and the alarm indexes;
an alarm unit (500) for alarming according to the analysis and judgment result of the logic analysis unit (400);
and the terminal display and query unit (600) is used for displaying the analysis and judgment result of the logic analysis unit (400) and carrying out alarming in combination with the alarming unit (500), providing resource query service for a user, and calling and displaying corresponding data in the server unit (200) through the communication unit (300).
3. The information system service oriented operation panorama monitoring system according to claim 2, wherein: the monitoring data acquisition unit (100) comprises a data collection module (101) and a data processing module (102),
the data collection module (101) comprises a first data collection part (101 a), a second data collection part (101 b) and a third data collection part (101 c), wherein the first data collection part (101 a), the second data collection part (101 b) and the third data collection part (101 c) are simultaneously connected with the data processing module (102) in a one-way manner, and collected data are directly transmitted to the data processing module (102);
the first data collecting part (101 a) collects system external data through an APM tool, the second data collecting part (101 b) collects system external data through an NPM tool, the third data collecting part (101 c) collects system external data through other link monitoring tools, the data processing module (102) aggregates data into three types of data, namely topology data, link data and index data after receiving the data transmitted by the data collecting module (101), and the three types of data are structured and then transmitted to the server unit (200) through the communication unit (300), and the server unit (200) stores the received structured data;
The structuring includes dividing the data into base monitoring data, traffic link data, system traffic data, and log data.
4. The information system service oriented operational panorama monitoring system according to claim 3, wherein: the logic analysis unit (400) comprises an index presetting module (401), an index comparing module (402), a fault analysis and judgment module (403), a fault positioning module (404) and a fault early warning module (405),
the index presetting module (401) is used for presetting performance indexes, service application indexes and alarm indexes, the index comparison module (402) is directly connected with the server unit (200) through the communication unit (300), the index comparison module (402) sends comparison instructions to the communication unit (300), and the comparison instructions comprise a first comparison instruction, a second comparison instruction and a third comparison instruction;
when the server unit (200) acquires a first comparison instruction, the server unit (200) transmits basic monitoring data to the index comparison module (402), the index comparison module (402) compares the data by combining indexes preset in the index preset module (401), and after a first comparison result is generated, the first comparison result is transmitted to the fault analysis and judgment module (403);
When the server unit (200) acquires a second comparison instruction, the server unit (200) transmits service link data and system service data to the index comparison module (402), the index comparison module (402) compares the data by combining indexes preset in the index preset module (401) to generate a second comparison result, and the first comparison result is transmitted to the fault analysis and judgment module (403);
when the server unit (200) acquires a third comparison instruction, the server unit (200) transmits log data to the index comparison module (402), the index comparison module (402) compares the data by combining indexes preset in the index preset module (401) to generate a third comparison result, and the third judgment result is transmitted to the fault analysis and judgment module (403).
5. The information system service oriented operation panorama monitoring system according to claim 4, wherein: the logic analysis unit (400) further comprises,
the fault analysis and judgment module (403) receives the index comparison result transmitted by the index comparison module (402) and analyzes and judges the index comparison result;
When the first judgment result is received, if the basic monitoring data in the first judgment result deviates from the preset basic monitoring data by ten percent, or the basic monitoring data in the first judgment result is absent, a fault is determined;
when the second judging result is received, if the service link data and the system service data in the second judging result are missing, the fault is determined to occur;
when the third judging result is received, if the log data in the third judging result is missing or is increased compared with the previous period, the fault is determined.
6. The information system service oriented operation panorama monitoring system according to claim 5, wherein: the logic analysis unit (400) further comprises,
the fault positioning module (404) is used for obtaining a specific positioning model through combining with a neural network training, the fault positioning module (404) is used for receiving fault data in log data from the server unit (200), taking the fault data as input, taking the fault type and the fault position as output, and training the fault positioning neural network model;
after the training of the fault location neural network model is completed, the fault location module (404) stores the model into the server unit (200), if the fault analysis and judgment module (403) judges that the result is a fault, the fault analysis and judgment module (403) sends a fault location waiting instruction to the fault location module (404), and after the fault location module (404) acquires the fault location waiting instruction, the communication unit (300) sends a fault location neural network model calling instruction to the server unit (200);
When the fault location neural network model is successfully called, the real-time data in the server unit (200) is directly used as a model input to be accessed into the fault location neural network model, the fault type and the fault position information are obtained, and the fault type and the fault position information are transmitted to the fault early warning module (405);
the fault early warning module (405) confirms the fault type and the fault position information and then transmits the alarm grade to the alarm unit (500).
7. The information system service oriented operation panorama monitoring system according to claim 6, wherein: the alarm unit (500) comprises alarm triggering strategy configuration and alarm notification strategy configuration, wherein the alarm triggering strategy configuration is used for providing multi-channel alarms for information system monitoring, the alarm triggering strategy is independently configured, alarm triggering conditions comprise single-index triggering and multi-index combined triggering, the single-index triggering rules comprise missing alarms, threshold alarms, character comparison, trend alarms, state inversion, floating threshold alarms and abrupt change alarm rules, the multi-index triggering is used for carrying out multi-index combined alarms based on AND or rules, the alarm notification strategy configuration comprises an alarm resource range and a notification strategy, and the alarm resource range comprises a resource type, a resource unit, a machine room, a group and a resource instance mode; the notification strategy comprises a receiving object, a notification mode, notification time, a repetition rule and an upgrading rule, and further comprises functions of de-duplication, grouping, suppression, silence and routing of alarms, and alarms are carried out according to analysis and judgment results of the logic analysis unit (400).
8. The information system service oriented operation panorama monitoring system according to claim 7, wherein: the terminal display and query unit (600) comprises data collected by a display system, displays alarm information by combining the alarm unit (500), and queries resources according to user requirements.
9. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of claim 1 when executing the computer program.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of claim 1.
CN202311191727.8A 2023-09-14 2023-09-14 Information system service operation-oriented panoramic monitoring method and system Pending CN117370053A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311191727.8A CN117370053A (en) 2023-09-14 2023-09-14 Information system service operation-oriented panoramic monitoring method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311191727.8A CN117370053A (en) 2023-09-14 2023-09-14 Information system service operation-oriented panoramic monitoring method and system

Publications (1)

Publication Number Publication Date
CN117370053A true CN117370053A (en) 2024-01-09

Family

ID=89401222

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311191727.8A Pending CN117370053A (en) 2023-09-14 2023-09-14 Information system service operation-oriented panoramic monitoring method and system

Country Status (1)

Country Link
CN (1) CN117370053A (en)

Similar Documents

Publication Publication Date Title
US9369521B2 (en) Naming of distributed business transactions
CN105357038B (en) Monitor the method and system of cluster virtual machine
CN109586999A (en) A kind of container cloud platform condition monitoring early warning system, method and electronic equipment
US9384114B2 (en) Group server performance correction via actions to server subset
US10116534B2 (en) Systems and methods for WebSphere MQ performance metrics analysis
US8656009B2 (en) Indicating an impact of a change in state of a node
Baresi et al. Event-based multi-level service monitoring
US8788958B2 (en) Modeling, monitoring, and analysis of computer services
CN107704387B (en) Method, device, electronic equipment and computer readable medium for system early warning
US10536505B2 (en) Intelligent data transmission by network device agent
CN109660426A (en) Monitoring method and system, computer-readable medium and electronic equipment
US20120066372A1 (en) Selective registration for remote event notifications in processing node clusters
US9577900B1 (en) Application centric network experience monitoring
CN112994972A (en) Distributed probe monitoring platform
CN103823743B (en) The monitoring method of software system and equipment
CN109615218A (en) Nuclear power information system performance monitoring system and method
CN117176802B (en) Full-link monitoring method and device for service request, electronic equipment and medium
CN116708217A (en) Data center equipment monitoring method, system, electronic equipment and storage medium
CN115080363B (en) System capacity evaluation method and device based on service log
CN103078764A (en) Operational monitoring system and method based on virtual computing task
CN117370053A (en) Information system service operation-oriented panoramic monitoring method and system
CN106933718B (en) Method for monitoring performance and device
CN114816914A (en) Data processing method, equipment and medium based on Kubernetes
CN108205479A (en) The method, apparatus and storage medium of a kind of faulted-phase judgment
CN103944777B (en) Distributed monitoring system information processing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination