CN107483297B - Active monitoring system and method for quality of service carried on embedded equipment - Google Patents
Active monitoring system and method for quality of service carried on embedded equipment Download PDFInfo
- Publication number
- CN107483297B CN107483297B CN201710943496.XA CN201710943496A CN107483297B CN 107483297 B CN107483297 B CN 107483297B CN 201710943496 A CN201710943496 A CN 201710943496A CN 107483297 B CN107483297 B CN 107483297B
- Authority
- CN
- China
- Prior art keywords
- probe
- monitoring
- access
- subsystem
- management module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
- H04L41/5009—Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0811—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking connectivity
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The invention provides an active monitoring system for the quality of service carried on an embedded device, comprising: the system comprises a probe subsystem, a probe access subsystem, a data convergence subsystem and a management and analysis platform; the invention also provides an active monitoring system for the quality of service carried on the embedded equipment, which comprises: an implantation probe subsystem; finishing probe registration; monitoring and managing; collecting and storing data; statistical analysis was performed. The invention not only supports the traditional network node reachability monitoring, but also supports the network content quality monitoring. The former provides network reachability performance monitoring, both for newly built networks and for mature networks, which can provide fine network base quality analysis; the latter can provide the content access quality monitoring obtained from the analog user angle, and has great effect on the quality perception condition of the network operator when analyzing the user using the network, the service access condition of the content provider, the transmission capability of the network, and the like.
Description
Technical Field
The present invention relates to the field of monitoring technologies, and in particular, to an active monitoring system and method for quality of service carried on an embedded device.
Background
The active monitoring system on the current embedded device has the following disadvantages: 1) The monitoring target is single; only monitoring of reachability between network nodes is supported. For already established networks, the probability of quality problems occurring in the reachability between network nodes is very low, so that simple reachability monitoring is generally unable to find quality problems. In contrast, the network content quality monitoring needs are more stringent, namely, monitoring the transmission performance of data content accessed through the network. 2) The monitoring means are few and the effect is limited; only the inter-node reachability monitoring through PING, TRACEROUTE and other tools is supported, and no efficient method for monitoring the network content quality exists. While there are numerous open source or commercial network content quality monitoring tools that support protocols such as HTTP, FTP, TCP, these tools are overly heavy for embedded devices with limited resources and the devices cannot provide the memory, CPU, etc. computing resources required for their operation. The simple reachability monitoring result cannot find the quality problem of the network content, so that the network service provider cannot be provided with the experience condition of the user of the network service provider on the network, and further cannot provide network quality optimization suggestions and suggestions. 3) The monitoring system communication protocol has high cost and the deployment method is limited; at present, many monitoring systems on embedded equipment are realized by adopting a communication protocol combination mode of XML+SOAP+HTTP based on the traditional TR069 protocol family. In the transmission process, the protocol overhead of the data is huge. To transfer one byte of valid data, the amount of data specified by the additional protocol that needs to be transferred may be several times the amount of valid word data. Meanwhile, since the TR069 protocol is generally used only in the network of the network provider, all the network nodes cannot be flexibly deployed to other service networks to support more monitoring means and more network nodes during system deployment.
Disclosure of Invention
The object of the present invention is to solve at least one of the technical drawbacks.
Therefore, the present invention aims to provide an active monitoring system and method for the quality of service carried on an embedded device, which can monitor the reachability of network nodes and the quality of content simultaneously.
To achieve the above object, the present invention provides an active monitoring system for quality of service carried on an embedded device, comprising: the system comprises a probe subsystem, a probe access subsystem, a data convergence subsystem and a management and analysis platform;
the probe subsystem comprises a probe management module, a monitoring management module and a probe TR069 communication module;
the probe management module is used for being responsible for the installation and upgrading of the probe and collecting the running state of the probe and the use condition of system resources;
the monitoring management module is used for receiving, creating, executing the monitoring task and reporting the monitoring result;
the probe TR069 communication module is used for realizing direct communication with the probe access subsystem, completing the receiving of probe configuration information and monitoring task information and the reporting of probe state information and monitoring result information;
the probe access subsystem comprises an access synchronization management module, a load balancing module, an access TR069 communication module and an access management module;
the access synchronization management module is used for realizing registration and authentication of the probe access subsystem to the management and analysis platform, obtaining the latest monitoring task information required to be issued to the probe from the management and analysis platform and synchronizing the monitoring task information to the management and analysis platform;
the load balancing module is used for butting the probe subsystems and distributing the load of the high-concurrency probe connection request to the plurality of server communication modules;
the access TR069 communication module is used for simplifying the TR069 protocol, analyzing the message, checking the validity of the message format and the validity of the data, and submitting the service data loaded by the message to the access management module; the access TR069 communication module and the access management module are in one-to-one binding relation;
the access management module is used for receiving and processing registration, state and monitoring result request messages initiated by the probe, completing the registration and authentication process of the probe according to different message types, submitting state data to the data aggregation subsystem or submitting monitoring results to the data aggregation subsystem;
the data convergence subsystem comprises a data conversion module and a data storage module;
the data conversion module is in charge of receiving and extracting the monitoring result and the probe state data reported by the probe access subsystem, converting the data according to a certain format and sending the converted data to the data storage module in a message form;
the data storage module is used for caching the piece-by-piece messages and storing the content in the cache to a persistent system when the cache size exceeds a certain threshold value or a certain time period arrives;
the management and analysis platform comprises a platform synchronous management module, a monitoring target management module, a monitoring probe management module, a monitoring task management module and a statistical analysis module;
the monitoring probe management module is used for managing monitoring probe information;
the monitoring target management module is used for creating and maintaining a monitoring target node;
the monitoring task management module is used for creating and maintaining a monitoring task;
the platform synchronous management module transmits the configuration information to the access subsystem, and the access synchronous management module of the access subsystem stores the configuration information to the local database;
the statistical analysis module is used for obtaining the model mapping mathematical relation between each statistical index and the service quality from the configuration database, and analyzing the service quality situation obtained by quantitative calculation of the monitoring result through the mathematical relation.
Further, the monitoring management module of the probe subsystem comprises a scheduler and a monitoring task manager;
the monitoring task manager is used for creating and deleting a monitoring task and submitting a monitoring result to the probe TR069 communication module;
the scheduler is used for creating a task execution plan according to different scheduling strategies and controlling the one-time operation or the periodic operation of the task according to the plan.
Further, when the monitoring management module of the probe subsystem creates and executes the monitoring task, the monitoring session is utilized to save and track information related to one monitoring target in the current monitoring task; after the monitoring session is established, starting to run a monitoring script; the monitoring script controls its lifecycle by session: loading configuration data, starting execution, monitoring the execution state, stopping execution and reporting the result.
Further, after the access TR069 communication module remotely calls the InformiResponse function, checking whether an upgrade task, a parameter configuration task or a monitoring task related to the probe needs to be issued to the probe; if not, sending an empty request to the probe to tell the probe access subsystem that no transaction needs the probe to complete and requesting the probe to disconnect to release the server resource; if so, the corresponding message content is sent to the probe.
The invention also provides an active monitoring method for the quality of service carried on the embedded equipment, which is characterized in that: the method comprises the following steps:
step S1, implanting a probe subsystem;
solidifying the address of the probe access subsystem in the probe of the probe subsystem, then arranging the probe in the embedded equipment, and automatically operating the probe subsystem when the equipment is started to integrate the probe subsystem into the original embedded equipment system;
step S2, completing probe registration;
the probe management module in the probe subsystem is connected with the probe access subsystem through the solidified address;
the method comprises the steps that a function is remotely called by an access TR069 communication module, after a call request accords with a rule, identification and safety information transmitted by a probe subsystem are obtained by an access management module, the validity safety of the probe is checked, after the check is qualified, the communication between the probe subsystem and the probe access subsystem is established, registration information of the probe is submitted to a synchronous management module, after the registration information is checked to be qualified, the registration information of the probe is uploaded to a platform synchronous management module of a management and analysis platform through a synchronous communication channel by the access synchronous management module, and after the platform synchronous management module receives the uploaded registration information, data are stored in a database to allow the management and analysis platform to monitor and manage the probe information;
step S3, monitoring and managing are carried out;
the monitoring target management module creates and maintains a monitoring target node, the monitoring task management module creates and maintains a monitoring task, after the configuration monitoring task is created and set, configuration information is issued to the probe access subsystem through the platform synchronous management module, and the configuration information is stored in the local database by the access synchronous management module of the probe access subsystem; meanwhile, the access TR069 communication module checks whether a probe related upgrading task, a parameter configuration task or a monitoring task exists or not, the task is issued to the probe management module, the monitoring management module creates a monitoring task execution task according to monitoring task information, when the scheduling condition is met, the tasks are executed, and the probe TR069 communication module uploads a monitoring result to the probe access subsystem;
s4, collecting and storing data;
after receiving the monitoring result, the access management module of the probe access subsystem directly submits the monitoring result to the data aggregation subsystem; the data conversion module of the data convergence subsystem processes the monitoring result, integrates three relevant configuration data of the monitoring task and the monitoring result into a detailed list record in a unified format, and submits the detailed list record to the data storage module after integration is completed; the data storage module writes the received detailed list record information into a file with a fixed size or a fixed time span, and the file is imported into a database system for storage in a batch importing mode;
s5, carrying out statistical analysis;
the statistical analysis module of the management and analysis platform obtains the service quality index information reported in various monitoring results from the configuration database, the statistical analysis module obtains data from the database at intervals, the pipeline processing process is executed, and index statistical values of various monitoring results of various monitoring tasks in the statistical period are calculated; and obtaining a model mapping mathematical relationship between each statistical index and the service quality from the configuration database, and analyzing the service quality situation obtained by quantitative calculation of the monitoring result through the mathematical relationship.
Further, in step S2, the access management module of the probe access subsystem acquires the incoming identifier and security information, and verifies whether the probe is legal or not, and the security information verifies whether the probe is legal or not; after the verification is completed, the verification result is transferred to the access TR069 communication module, and if the verification fails, corresponding error codes and error descriptions are provided for the access TR069 communication module; if the verification is successful, the following work is completed:
1) Transmitting a correct response code to the access TR069 communication module;
2) Creating a TR069 session and saving the identity of the probe in the session to track data flow throughout the communication process;
3) And acquiring the registration information of the incoming probe and submitting the registration information to a synchronous management module.
Further, in step S2, when the registration verification passes, the probe access subsystem needs to complete two tasks, namely up and down:
1) The access TR069 communication module processes the InformaResponse call request submitted by the access management module, and remotely calls the InformaResponse function of the probe according to the test result, if the test fails, an error code and an error description are transmitted, and the connection between the probe and the InformaResponse is forcibly disconnected; otherwise, the correct response code is transmitted as a parameter to respond to the probe;
2) The access synchronization management module uploads the probe registration information to the platform synchronization management module of the management and analysis platform through the synchronization communication channel.
Further, in step S3, when the monitoring task management module creates a task, three types of information need to be specified: 1. monitoring the parameter description of the task itself; 2. monitoring target node information; 3. and monitoring the execution method of the task.
Further, the probe TR069 communication module of the probe subsystem is in a waiting cycle, and when receiving the message issued by the probe access subsystem, the communication module judges the message type and carries out corresponding processing; if the message is the upgrade request and parameter configuration message, the probe TR069 communication module transmits the message to the probe management module for processing, and if the message is the monitoring task message, the probe TR069 communication module transmits the message to the monitoring management module for processing.
Further, the probe TR069 communication module of the probe subsystem sequentially processes each monitoring result and reports the result to the probe access subsystem according to the JSON-RPC specification.
The invention has the following beneficial effects:
1. the invention not only supports the traditional network node reachability monitoring, but also supports the network content quality monitoring. The former provides network reachability performance monitoring, both for newly built networks and for mature networks, which can provide fine network base quality analysis; the latter can provide the content access quality monitoring obtained from the analog user angle, and has great effect on the quality perception condition of the network operator when analyzing the user using the network, the service access condition of the content provider, the transmission capability of the network, and the like.
2. The invention can provide various monitoring means for the target network node, and specifically comprises PING reachability monitoring, TRACEROUTE reachability monitoring, webpage browsing service quality monitoring, file downloading service quality monitoring, network speed testing service quality monitoring, game server access service quality monitoring and online video playing service quality monitoring. In addition, the system provides a testing method with excellent expansibility, and the support for a new testing means can be increased by adding and realizing a testing script library.
3. The system simplifies the communication protocol based on JSON-RPC and TR069 protocol specifications, and reduces the protocol overhead of effective data transmission by about 2/3; meanwhile, the special learning capability of the probe in the system supports the deployment of the monitoring platform into the network management network or service network of the network provider, so that more content provider services can be supported to be monitored.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the invention will become apparent and may be better understood from the following description of embodiments taken in conjunction with the accompanying drawings in which:
FIG. 1 is a block diagram of the structure of the present invention;
fig. 2 is a main flow chart of the present invention.
Detailed Description
Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are illustrative and intended to explain the present invention and should not be construed as limiting the invention.
The invention provides an active monitoring system for the quality of service carried on an embedded device, which is shown in the accompanying figure 1 and comprises: a probe subsystem 1, a probe access subsystem 2, a data convergence subsystem 3 and a management and analysis platform 4.
The probe subsystem 1 comprises a probe management module 11, a monitoring management module 13 and a probe TR069 communication module 12.
The probe management module 11 is used for being responsible for the installation and upgrading of the probes and collecting the running state of the probes and the use condition of system resources.
The monitoring management module 13 is configured to receive, create, execute a monitoring task, and report a monitoring result.
The monitoring management module 13 of the probe subsystem 1 comprises a scheduler and a monitoring task manager; the monitoring task manager is used for creating and deleting the monitoring task and submitting the monitoring result to the probe TR069 communication module.
The scheduler is used for creating a task execution plan according to different scheduling strategies and controlling the one-time operation or the periodic operation of the task according to the plan.
The monitoring task manager is used for storing basic information of tasks and storing monitoring session information.
The monitoring task is responsible for storing basic information of the task and storing monitoring session information; one monitoring task corresponds to a plurality of monitoring sessions, and one monitoring session corresponds to one monitoring target.
The monitoring session is established when the monitoring task is executed, and is responsible for storing and tracking information related to one monitoring target in the current monitoring task; the monitoring session is the smallest scheduling unit that the scheduler controls the execution of the monitoring task.
The execution of each monitoring session is actually completed by a monitoring script; after the monitoring session is established, starting to run a monitoring script; the monitoring script controls its lifecycle by session: loading configuration data, starting execution, monitoring the execution state, stopping execution and reporting the result. Each monitoring script corresponds to a monitoring means, and the system defaults to internally support PING and TRACEROUTE tests and simultaneously supports lightweight network tools such as a web browser, an online video player, an FTP client and the like used by a simulation user so as to support the quality of tested contents; through the five life cycle control mechanisms, the monitoring management module provides an easily-expanded monitoring script framework, and for newly-increased content quality monitoring requirements, only a monitoring script meeting a corresponding standard interface is required to be provided
The probe TR069 communication module 12 is configured to directly communicate with the probe access subsystem, complete receiving of probe configuration information and monitoring task information, and report probe status information and monitoring result information.
The probe access subsystem 3 comprises an access synchronization management module 21, a load balancing module 22, an access TR069 communication module 23 and an access management module 24.
The access synchronization management module 21 is used for realizing registration and authentication of the probe access subsystem to the management and analysis platform, obtaining the latest monitoring task information required to be issued to the probe from the management and analysis platform, and synchronizing the monitoring task information to the management and analysis platform.
The load balancing module 22 is configured to dock the probe subsystem and distribute the load of the high-concurrency probe connection request to the plurality of server communication modules.
The access TR069 communication module 23 is used for simplifying the TR069 protocol, analyzing the message, checking the validity of the message format and the validity of the data, and submitting the service data loaded by the message to the access management module; the access TR069 communication module and the access management module are in one-to-one binding relation.
After the access TR069 communication module remotely calls the InformResponse function, checking whether a probe-related upgrade task, a parameter configuration task or a monitoring task needs to be issued to the probe; if not, sending an empty request to the probe to tell the probe access subsystem that no transaction needs the probe to complete and requesting the probe to disconnect to release the server resource; if so, the corresponding message content is sent to the probe.
The access management module 24 is configured to receive and process registration, status and monitoring result request messages initiated by the probe, complete registration and authentication processes for the probe according to different message types, and submit status data to the data aggregation subsystem or submit monitoring results to the data aggregation subsystem.
The data convergence subsystem 3 comprises a data conversion module 31 and a data storage module 32.
The data conversion module 31 is responsible for receiving and extracting the monitoring result and the probe state data reported by the probe access subsystem, converting the data according to a certain format, and sending the converted data to the data storage module in a message form;
the data storage module 32 is configured to cache the piece-by-piece messages, and store the content in the cache to the persistent system when the cache size exceeds a certain threshold or a certain time period arrives;
the management and analysis platform 4 comprises a platform synchronization management module 41, a monitoring target management module 42, a monitoring probe management module 43, a monitoring task management module 44 and a statistical analysis module 45;
the monitoring probe management module 43 is used for managing monitoring probe information;
the monitoring target management module 42 is used for creating and maintaining a monitoring target node;
the monitoring task management module 44 is used for creating and maintaining monitoring tasks;
the platform synchronization management module 41 issues configuration information to the access subsystem, which is stored in the local database by the access synchronization management module of the access subsystem.
The statistical analysis module 45 is configured to obtain a model mapping mathematical relationship between each statistical index and the quality of service from the configuration database, and analyze the quality of service situation obtained by the quantitative calculation of the monitoring result through the mathematical relationship.
The invention can provide various monitoring means for the target network node, and specifically comprises PING reachability monitoring, TRACEROUTE reachability monitoring, webpage browsing service quality monitoring, file downloading service quality monitoring, network speed testing service quality monitoring, game server access service quality monitoring and online video playing service quality monitoring. In addition, the system provides a testing method with excellent expansibility, and the support for a new testing means can be increased by adding and realizing a testing script library.
The invention also provides an active monitoring method for the quality of service carried on the embedded equipment, as shown in fig. 2, comprising the following steps:
step S1, implanting a probe subsystem;
solidifying the address of the probe access subsystem in the probe of the probe subsystem, then arranging the probe in the embedded equipment, and automatically operating the probe subsystem when the equipment is started to integrate the probe subsystem into the original embedded equipment system;
step S2, completing probe registration;
the probe management module in the probe subsystem is connected with the probe access subsystem through the solidified address;
the method comprises the steps of remotely calling a function by an access TR069 communication module, obtaining identification and safety information transmitted by a probe subsystem by an access management module after a call request meets a rule, checking the validity safety of the probe, establishing communication between the probe subsystem and the probe access subsystem after the check is qualified, submitting registration information of the probe to a synchronous management module, uploading the registration information of the probe to a platform synchronous management module of a management and analysis platform by the access synchronous management module through a synchronous communication channel after the check of the registration information is qualified, and storing data into a database after the platform synchronous management module receives the uploaded registration information so as to allow the management and analysis platform to monitor and manage the probe information.
The detailed steps for completing the probe registration are as follows:
1) After the installation and deployment of the embedded equipment are completed and the embedded equipment is started, the probe subsystem automatically operates along with the system.
2) The probe management module in the probe subsystem begins to operate, attempting to connect the probe access subsystem through the cured address. If the connection fails, retrying the step until successful; if the connection is successful, the next step is entered.
3) The probe management module activates the probe TR069 communication module, the probe TR069 communication module remotely calls an Inform function in the probe access subsystem, and provides information such as identification, safety, installation date and the like of the probe and information such as inherent manufacturer, model, serial number and the like of embedded equipment as function parameters according to JSON-RPC specifications when remotely calling the function.
4) After the load balancing module of the probe access subsystem receives the call request, the load balancing module issues the request to a certain access TR069 communication module through a preset load distribution strategy and is responsible for forwarding the subsequent request and response message between the probe and the probe access subsystem.
5) After receiving the call request, the access TR069 communication module of the probe access subsystem checks whether the message format accords with the specification, if not, remotely calls the InformimResponse function of the probe, transmits error codes and error description, and forcibly disconnects the connection with the probe; otherwise, the call request will be processed by the access management module.
6) The access management module of the probe access subsystem acquires the incoming identification and the security information, verifies whether the probe is legal or not, and verifies whether the security information passes or not. After the verification is completed, the verification result is transferred to the access TR069 communication module, and if the verification fails, corresponding error codes and error descriptions are provided for the access TR069 communication module; if the verification is successful, the following work is completed: 1. transmitting a correct response code to the access TR069 communication module; 2. creating a TR069 session and saving the identity of the probe in the session to track data flow throughout the communication process; 3. and acquiring the registration information of the incoming probe and submitting the registration information to an access synchronization management module.
7) When the registration verification passes, the probe access subsystem needs to complete two works up and down: 1. the access TR069 communication module processes the InformaResponse call request submitted by the access management module, and remotely calls the InformaResponse function of the probe according to the test result, if the test fails, an error code and an error description are transmitted, and the connection between the probe and the InformaResponse is forcibly disconnected; otherwise, the correct response code is transmitted as a parameter to respond to the probe; 2. the access synchronization management module uploads the probe registration information to the platform synchronization management module of the management and analysis platform through the synchronization communication channel.
8) The probe access TR069 communication module is accessed to an InformaResponse remote call request of the probe access subsystem to check whether an error occurs; if the probe access subsystem is wrong, disconnecting and retrying to connect the probe access subsystem after a certain time and repeating the registration process; if no, entering a waiting loop to wait for the subsequent task configuration requirement of the probe access subsystem.
9) And after receiving the uploaded registration information, the platform synchronization management module of the management and analysis platform stores the data into a database so as to allow the platform to perform the operations of adding, deleting and checking the probe information.
Step S3, monitoring and managing are carried out;
the monitoring target management module creates and maintains a monitoring target node, the monitoring task management module creates and maintains a monitoring task, after the configuration monitoring task is created and set, configuration information is issued to the probe access subsystem through the platform synchronous management module, and the configuration information is stored in the local database by the access synchronous management module of the probe access subsystem; meanwhile, the access TR069 communication module checks whether the probe related upgrading task, parameter configuration task or monitoring task exists or not, the task is issued to the probe management module, the monitoring management module creates a monitoring task execution task according to the monitoring task information, the tasks are executed when the scheduling condition is met, and the probe TR069 communication module uploads the monitoring result to the probe access subsystem.
The specific steps for monitoring and managing are as follows:
1) After the probe is registered through the probe access subsystem, adding, deleting and modifying the probe information is realized through the monitoring probe management module on the management and analysis platform;
2) Creating and maintaining a monitoring target node through a monitoring target management module of a management and analysis platform;
3) And creating and maintaining the monitoring task through a monitoring task management module of the management and analysis platform. When creating a task, three types of information need to be specified: 1. monitoring task self parameter descriptions (including task scheduling information, monitoring index information and quality test parameter information); 2. monitored target node information (including target domain name or IP address and port); 3. monitoring the execution method of the task (which probe is responsible for executing the task);
4) After the configuration monitoring task is established and set, the configuration information is issued to the probe access subsystem through a platform synchronous management module of a management and analysis platform, and the configuration information is stored into a local database by a synchronous management module of the probe access subsystem;
5) After the probe access subsystem access TR069 communication module remotely calls the InformimResponse function, whether a probe related upgrade task, a parameter configuration task or a monitoring task needs to be issued to the probe is checked. If not, sending an empty request to the probe to tell the probe access subsystem that no transaction needs the probe to complete and requesting the probe to disconnect to release the server resource; if so, sending the corresponding message content to the probe;
6) The access TR069 communication module of the probe subsystem is in a waiting cycle, and when receiving the message issued by the probe access subsystem, the access TR069 communication module judges the message type and carries out corresponding processing. If the information is the upgrade request and parameter configuration information, the access TR069 communication module transmits the information to the probe management module for processing, and if the information is the monitoring task information, the access TR069 communication module transmits the information to the monitoring management module for processing;
7) The monitoring management module of the probe subsystem creates monitoring task execution tasks according to the monitoring task information, and executes the tasks when the scheduling conditions are met;
8) After the task execution is completed, the probe subsystem monitoring management module submits a monitoring task execution result to the TR069 access communication module; meanwhile, the monitoring task is cleared or scheduling information is changed to support periodic execution;
9) And the access TR069 communication module of the probe subsystem sequentially processes each monitoring result and reports the result to the probe access subsystem according to the JSON-RPC specification.
S4, collecting and storing data;
after receiving the monitoring result, the access management module of the probe access subsystem directly submits the monitoring result to the data aggregation subsystem; the data conversion module of the data convergence subsystem processes the monitoring result, integrates three relevant configuration data of the monitoring task and the monitoring result into a detailed list record in a unified format, and submits the detailed list record to the data storage module after integration is completed; the data storage module writes the received detailed list record information into a file with a fixed size or a fixed time span, and the file is imported into a database system for storage in a batch importing mode;
s5, carrying out statistical analysis;
the statistical analysis module of the management and analysis platform obtains the service quality index information reported in various monitoring results from the configuration database, the statistical analysis module obtains data from the database at intervals (called a statistical period, such as 5 minutes), the pipeline processing process is executed, and index statistical values of various monitoring results of various monitoring tasks in the statistical period are calculated; and obtaining a model mapping mathematical relationship between each statistical index and the service quality from the configuration database, and analyzing the service quality situation obtained by quantitative calculation of the monitoring result through the mathematical relationship.
The invention can provide various monitoring means for the target network node, and specifically comprises PING reachability monitoring, TRACEROUTE reachability monitoring, webpage browsing service quality monitoring, file downloading service quality monitoring, network speed testing service quality monitoring, game server access service quality monitoring and online video playing service quality monitoring. In addition, the system provides a testing method with excellent expansibility, and the support for a new testing means can be increased by adding and realizing a testing script library.
Although embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the invention, and that variations, modifications, alternatives, and variations may be made in the above embodiments by those skilled in the art without departing from the spirit and principles of the invention. The scope of the invention is defined by the appended claims and their equivalents.
Claims (10)
1. An active monitoring system for quality of service carried on an embedded device, comprising: the system comprises a probe subsystem, a probe access subsystem, a data convergence subsystem and a management and analysis platform;
the probe subsystem comprises a probe management module, a monitoring management module and a probe TR069 communication module;
the probe management module is used for being responsible for the installation and upgrading of the probe and collecting the running state of the probe and the use condition of system resources;
the monitoring management module is used for receiving, creating, executing the monitoring task and reporting the monitoring result;
the probe TR069 communication module is used for realizing direct communication with the probe access subsystem, completing the receiving of probe configuration information and monitoring task information and the reporting of probe state information and monitoring result information;
the probe access subsystem comprises an access synchronization management module, a load balancing module, an access TR069 communication module and an access management module;
the access synchronization management module is used for realizing registration and authentication of the probe access subsystem to the management and analysis platform, acquiring the latest monitoring task information required to be issued to the probe from the management and analysis platform and synchronizing with the management and analysis platform;
the load balancing module is used for butting the probe subsystems and distributing the load of the high-concurrency probe connection request to the plurality of server communication modules;
the access TR069 communication module is used for simplifying the TR069 protocol, analyzing the message, checking the validity of the message format and the validity of the data, and submitting the service data loaded by the message to the access management module; the access TR069 communication module and the access management module are in one-to-one binding relation;
the access management module is used for receiving and processing registration, state and monitoring result request messages initiated by the probe, completing the registration and authentication process of the probe according to different message types, submitting state data to the data aggregation subsystem or submitting monitoring results to the data aggregation subsystem;
the data convergence subsystem comprises a data conversion module and a data storage module;
the data conversion module is in charge of receiving and extracting the monitoring result and the probe state data reported by the probe access subsystem, converting the data according to a certain format and sending the converted data to the data storage module in a message form;
the data storage module is used for caching the piece-by-piece messages and storing the content in the cache to a persistent system when the cache size exceeds a certain threshold value or a certain time period arrives;
the management and analysis platform comprises a platform synchronous management module, a monitoring target management module, a monitoring probe management module, a monitoring task management module and a statistical analysis module;
the monitoring probe management module is used for managing monitoring probe information;
the monitoring target management module is used for creating and maintaining a monitoring target node;
the monitoring task management module is used for creating and maintaining a monitoring task;
the platform synchronous management module transmits the configuration information to the probe access subsystem, and the access synchronous management module of the probe access subsystem stores the configuration information to a local database;
the statistical analysis module is used for obtaining the model mapping mathematical relation between each statistical index and the service quality from the configuration database, and analyzing the service quality situation obtained by quantitative calculation of the monitoring result through the mathematical relation.
2. The active monitoring system for quality of service carried on an embedded device of claim 1, wherein: the monitoring management module of the probe subsystem comprises a dispatcher and a monitoring task manager;
the monitoring task manager is used for creating and deleting a monitoring task and submitting a monitoring result to the probe TR069 communication module;
the scheduler is used for creating a task execution plan according to different scheduling strategies and controlling the one-time operation or the periodic operation of the task according to the plan.
3. The active monitoring system for quality of service carried on an embedded device of claim 1, wherein: when the monitoring management module of the probe subsystem creates and executes a monitoring task, the monitoring session is utilized to save and track information related to one monitoring target in the current monitoring task; after the monitoring session is established, starting to run a monitoring script; the monitoring script controls its lifecycle by session: loading configuration data, starting execution, monitoring the execution state, stopping execution and reporting the result.
4. The active monitoring system for quality of service carried on an embedded device of claim 1, wherein: after the access TR069 communication module remotely calls an InformResponse function, checking whether a probe-related upgrading task, a parameter configuration task or a monitoring task needs to be issued to the probe; if not, sending an empty request to the probe to tell the probe access subsystem that no transaction needs the probe to complete and requesting the probe to disconnect to release the server resource; if so, the corresponding message content is sent to the probe.
5. An active monitoring method for the quality of service carried on an embedded device is characterized in that: the method comprises the following steps:
step S1, implanting a probe subsystem;
solidifying the address of the probe access subsystem in the probe of the probe subsystem, then arranging the probe in the embedded equipment, and automatically operating the probe subsystem when the equipment is started to integrate the probe subsystem into the original embedded equipment system;
step S2, completing probe registration;
the probe management module in the probe subsystem is connected with the probe access subsystem through the solidified address;
the method comprises the steps that a function is remotely called by an access TR069 communication module, after a call request accords with a rule, identification and safety information transmitted by a probe subsystem are obtained by an access management module, the validity safety of the probe is checked, after the check is qualified, the communication between the probe subsystem and the probe access subsystem is established, registration information of the probe is submitted to an access synchronous management module, after the check of the registration information is qualified, the registration information of the probe is uploaded to a platform synchronous management module of a management and analysis platform through a synchronous communication channel by the access synchronous management module, and after the platform synchronous management module receives the uploaded registration information, data are stored in a database to allow the management and analysis platform to monitor and manage the probe information;
step S3, monitoring and managing are carried out;
the monitoring target management module creates and maintains a monitoring target node, the monitoring task management module creates and maintains a monitoring task, after the configuration monitoring task is created and set, configuration information is issued to the probe access subsystem through the platform synchronous management module, and the configuration information is stored in the local database by the access synchronous management module of the probe access subsystem; meanwhile, the access TR069 communication module checks whether a probe related upgrading task, a parameter configuration task or a monitoring task exists or not, the task is issued to the probe management module, the monitoring management module creates a monitoring task execution task according to monitoring task information, and when the scheduling condition is met, the tasks are executed, and the probe TR069 communication module uploads a monitoring result to the probe access subsystem;
s4, collecting and storing data;
after receiving the monitoring result, the access management module of the probe access subsystem directly submits the monitoring result to the data aggregation subsystem; the data conversion module of the data convergence subsystem processes the monitoring result, integrates three relevant configuration data of the monitoring task and the monitoring result into a detailed list record in a unified format, and submits the detailed list record to the data storage module after integration is completed; the data storage module writes the received detailed list record information into a file with a fixed size or a fixed time span, and the file is imported into a database system for storage in a batch importing mode;
s5, carrying out statistical analysis;
the statistical analysis module of the management and analysis platform obtains the service quality index information reported in various monitoring results from the configuration database, the statistical analysis module obtains data from the database at intervals, the pipeline processing process is executed, and index statistical values of various monitoring results of various monitoring tasks in a statistical period are calculated; and obtaining a model mapping mathematical relationship between each statistical index and the service quality from the configuration database, and analyzing the service quality situation obtained by quantitative calculation of the monitoring result through the mathematical relationship.
6. The method for active monitoring of quality of service carried on an embedded device of claim 5, wherein: in step S2, an access management module of the probe access subsystem acquires the input identification and security information, verifies whether the probe is legal or not, and verifies whether the security information passes or not; after the verification is completed, the verification result is transferred to the access TR069 communication module, and if the verification fails, corresponding error codes and error descriptions are provided for the access TR069 communication module; if the verification is successful, the following work is completed:
1) Transmitting a correct response code to the access TR069 communication module;
2) Creating a TR069 session and saving the identity of the probe in the session to track data flow throughout the communication process;
3) And acquiring the registration information of the incoming probe and submitting the registration information to an access synchronization management module.
7. The method for active monitoring of quality of service carried on an embedded device of claim 5, wherein: in step S2, when the registration check passes, the probe access subsystem needs to complete two tasks up and down:
1) The access TR069 communication module processes the InformaResponse call request submitted by the access management module, and remotely calls the InformaResponse function of the probe according to the test result, if the test fails, an error code and an error description are transmitted, and the connection between the probe and the InformaResponse is forcibly disconnected; otherwise, the correct response code is transmitted as a parameter to respond to the probe;
2) The access synchronization management module uploads the probe registration information to the platform synchronization management module of the management and analysis platform through the synchronization communication channel.
8. The method for active monitoring of quality of service carried on an embedded device of claim 5, wherein: in step S3, when the monitoring task management module creates a task, three types of information need to be specified: 1. monitoring the parameter description of the task itself; 2. monitoring target node information; 3. and monitoring the execution method of the task.
9. The method for active monitoring of quality of service carried on an embedded device of claim 5, wherein: the probe TR069 communication module of the probe subsystem is in a waiting cycle, and when receiving the message issued by the probe access subsystem, the probe TR069 communication module judges the message type and carries out corresponding processing; if the message is the upgrade request and parameter configuration message, the probe TR069 communication module transmits the message to the probe management module for processing, and if the message is the monitoring task message, the probe TR069 communication module transmits the message to the monitoring management module for processing.
10. The method for active monitoring of quality of service carried on an embedded device of claim 5, wherein: and a probe TR069 communication module of the probe subsystem sequentially processes each monitoring result and reports the result to the probe access subsystem according to the JSON-RPC specification.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710943496.XA CN107483297B (en) | 2017-10-11 | 2017-10-11 | Active monitoring system and method for quality of service carried on embedded equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710943496.XA CN107483297B (en) | 2017-10-11 | 2017-10-11 | Active monitoring system and method for quality of service carried on embedded equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107483297A CN107483297A (en) | 2017-12-15 |
| CN107483297B true CN107483297B (en) | 2023-06-02 |
Family
ID=60605368
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710943496.XA Active CN107483297B (en) | 2017-10-11 | 2017-10-11 | Active monitoring system and method for quality of service carried on embedded equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107483297B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109067584A (en) * | 2018-08-13 | 2018-12-21 | 海南宝通实业公司 | A kind of mobile network property detection method and system based on terminal unit |
| CN110035132B (en) * | 2019-04-30 | 2022-08-12 | 深圳市网心科技有限公司 | Data synchronization method, computer device and storage medium |
| CN112333020B (en) * | 2020-11-03 | 2023-07-21 | 广东电网有限责任公司 | Network security monitoring and data message analysis system based on quintuple |
| CN113382056A (en) * | 2021-06-07 | 2021-09-10 | 北京博睿宏远数据科技股份有限公司 | Data reporting method, device, equipment, storage medium and system |
| CN116208432B (en) * | 2023-05-05 | 2023-06-30 | 北京安普诺信息技术有限公司 | Web application security probe management method, system, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143022A (en) * | 2011-03-16 | 2011-08-03 | 北京邮电大学 | Cloud measurement device and method for IP network |
| CN104009890A (en) * | 2014-06-10 | 2014-08-27 | 江苏省邮电规划设计院有限责任公司 | Test system and method for network quality in Internet |
| CN106850298A (en) * | 2017-02-08 | 2017-06-13 | 中国联合网络通信集团有限公司 | IPTV service quality monitoring method, terminal and system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9426046B2 (en) * | 2011-12-27 | 2016-08-23 | Tektronix Texas, Llc | Web page download time analysis |
| CN102801587B (en) * | 2012-08-29 | 2014-09-17 | 北京邮电大学 | Large-scale network-oriented virtualized monitoring system and dynamic monitoring method thereof |
-
2017
- 2017-10-11 CN CN201710943496.XA patent/CN107483297B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143022A (en) * | 2011-03-16 | 2011-08-03 | 北京邮电大学 | Cloud measurement device and method for IP network |
| CN104009890A (en) * | 2014-06-10 | 2014-08-27 | 江苏省邮电规划设计院有限责任公司 | Test system and method for network quality in Internet |
| CN106850298A (en) * | 2017-02-08 | 2017-06-13 | 中国联合网络通信集团有限公司 | IPTV service quality monitoring method, terminal and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107483297A (en) | 2017-12-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107483297B (en) | Active monitoring system and method for quality of service carried on embedded equipment | |
| CN107357571B (en) | Maintenance method and system for equipment component program | |
| CN111324363A (en) | Equipment upgrading method, upgrading terminal, equipment and storage medium | |
| CN110120970B (en) | Data processing method and device based on Internet of vehicles and gateway system | |
| CN110138876B (en) | Task deployment method, device, equipment and platform | |
| EP4066441B1 (en) | Management of iot devices in wireless communication networks | |
| CN106993043B (en) | Data communication system and method based on agency | |
| CN107634871B (en) | Connectivity test method, device and system | |
| CN106339273A (en) | Application program restoration method, terminal and server | |
| CN108833565A (en) | A kind of method, apparatus of monitoring server, server and storage medium | |
| CN112584398B (en) | Data processing method, device and storage medium | |
| CN103677983A (en) | Scheduling method and device of application | |
| CN111224828A (en) | Network management method of intelligent CPE (customer premise equipment) | |
| CN103186536A (en) | Method and system for scheduling data shearing devices | |
| CN110636127B (en) | Communication processing method and system between information data | |
| CN111294252B (en) | Cluster test system | |
| CN113824801B (en) | Intelligent integration terminal unified access management component system | |
| CN114422386B (en) | Monitoring method and device for micro-service gateway | |
| WO2015117458A1 (en) | Fault information collection method, device and system | |
| CN113535402A (en) | Load balancing processing method and device based on 5G MEC and electronic equipment | |
| CN113721938A (en) | Edge-edge cooperative task processing method, device and system suitable for power Internet of things | |
| CN108259527B (en) | Proxy-based service processing method and device and network element equipment | |
| CN111082964A (en) | Distribution method and device of configuration information | |
| CN115865651B (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN108259211B (en) | Equipment management method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |