CN113923272A - Data analysis method and device and server equipment - Google Patents
Data analysis method and device and server equipment Download PDFInfo
- Publication number
- CN113923272A CN113923272A CN202111087997.5A CN202111087997A CN113923272A CN 113923272 A CN113923272 A CN 113923272A CN 202111087997 A CN202111087997 A CN 202111087997A CN 113923272 A CN113923272 A CN 113923272A
- Authority
- CN
- China
- Prior art keywords
- service
- protocol
- data
- analysis
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/38—Services specially adapted for particular environments, situations or purposes for collecting sensor information
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention provides a data analysis method, a data analysis device and server equipment, wherein the method comprises the following steps: intercepting target data sent by target equipment; determining a protocol to which the target data belongs; determining whether a resolution service of a protocol to which the target data belongs has been started; and if not, starting the analysis service of the protocol to which the target data belongs, and transmitting the target data to the analysis service of the protocol to which the target data belongs for analysis. By the scheme, the problems that the idle running time is too long and the performance of the server is seriously influenced due to the fact that the existing analysis service runs all the time are solved, the effect of reducing the running time of the analysis service while ensuring the stable running of the analysis service is achieved, and the performance of the server is effectively improved.
Description
Technical Field
The invention relates to the technical field of equipment control, in particular to a data analysis method and device and server equipment.
Background
At present, a plurality of building control devices are connected into a building control system, and for the building control pens, different protocols are generally adopted to be connected into a platform system according to different types of boards and devices. For example: the fire fighting equipment uses a Nb-iot butt joint upper computer protocol, the multi-link machine uses a DTU butt joint upper computer protocol, the other equipment uses a standard network controller GMLinkNet butt joint upper computer protocol (the GMLinkNet butt joint upper computer protocol is a protocol for performing data analysis on GLink building automatic control network controller series products by an upper computer analysis program), and the like. For a platform, a plurality of analysis services are arranged to analyze data uploaded by equipment with various protocols, each protocol is provided, one analysis service of the platform analyzes corresponding equipment data, the analysis services of the protocols convert data with different structures uploaded by different protocols into standard data available for the platform through a series of operations, and the platform can display, store and analyze the data on pages and the like.
Because the analysis service has a large amount of operation of structure conversion, for the server, the server needs to run analysis services for multiple protocols to analyze when the data is uploaded by the equipment corresponding to the protocols. However, when a device of a certain protocol uploads data for a long time, the resolution service of the protocol is in a state of idle running in between, which seriously affects the performance of the server.
Secondly, after the system is delivered to the client, the system runs all the resolution services of the protocols, waits for the equipment accessing various protocols to upload data, and if the client does not have an access plan of a certain protocol equipment, the resolution services of the protocols also belong to a no-load running state in the server, which affects the performance of the server. In addition, if the resolution service of a certain protocol is not directly started, when a client has an access plan of the protocol device, data cannot be resolved, and data is lost.
For the problem of the protocol resolution server, no effective solution is provided at present.
Disclosure of Invention
The embodiment of the invention provides a data analysis method, a data analysis device and server equipment, and aims to solve the problem that the performance of a server is seriously influenced by the long idle running state of the existing analysis service.
In one aspect, a data parsing method is provided, including:
intercepting target data sent by target equipment;
determining a protocol to which the target data belongs;
determining whether a resolution service of a protocol to which the target data belongs has been started;
and if not, starting the analysis service of the protocol to which the target data belongs, and transmitting the target data to the analysis service of the protocol to which the target data belongs for analysis.
In one embodiment, the above method further comprises:
discovering the analysis service through a jump signal generated when the analysis service is manually started;
under the condition of discovering the analysis service, registering the discovered analysis service in a preset registry;
and performing start-stop control on each analysis service in the registry.
In one embodiment, the performing start-stop control on each analysis service in the registry includes:
counting the uploading frequency of the protocol data corresponding to each analysis service;
calculating the calibration duration corresponding to each analysis service according to the uploading frequency of the protocol data corresponding to each analysis service;
monitoring the duration of the data which are not received by each analysis service, and whether the corresponding calibration duration is reached;
and stopping the service for the resolution service reaching the corresponding calibration time length.
In one embodiment, the service suspension of the resolution service reaching the corresponding calibrated duration includes:
taking the analysis service when the duration of the unreceived data reaches the corresponding calibration duration as a first target analysis service;
logging the first target resolution service from the registry;
and under the condition that the first target analysis service in the registry is monitored to be cancelled, service termination is carried out on the first target analysis service.
In one embodiment, starting a resolution service of a protocol to which the target data belongs and transmitting the target data to the resolution service of the protocol to which the target data belongs for resolution includes:
temporarily storing the target data in a preset queue;
taking the analysis service of the protocol to which the target data belongs as a second target analysis service;
adding the second target resolution service to the registry;
starting a second target analysis service under the condition that the second target analysis service is added in the registry;
and sending the target data in the preset queue to the second target analysis service for analysis.
In one embodiment, the intercepting target data sent by a target device includes at least one of:
intercepting data sent by a protocol of a temperature-sensitive detector in fire-fighting sensor equipment in a butt joint with an upper computer;
intercepting data sent by a network controller in a butt joint with an upper computer protocol;
or intercepting data sent by the multi-online docking wireless control protocol.
In one embodiment, determining a protocol to which the target data belongs includes:
judging the data type of the target data;
determining an analysis channel corresponding to the data type;
determining a data structure of the target data according to the analysis channel;
matching the enumeration type of the target data according to a data structure;
and taking the protocol corresponding to the matched enumeration type as the protocol to which the target data belongs.
In another aspect, a data analysis apparatus is provided, including:
the intercepting module is used for intercepting target data sent by target equipment;
the first determining module is used for determining a protocol to which the target data belongs;
the second determining module is used for determining whether the analysis service of the protocol to which the target data belongs is started;
and the analysis module is used for starting the analysis service of the protocol to which the target data belongs and transmitting the target data to the analysis service of the protocol to which the target data belongs for analysis under the condition that the target data is determined not to be started.
In still another aspect, there is provided a server apparatus including: the data analysis device described above.
In yet another aspect, a network device is provided, including: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the above method when executing the computer program.
In a further aspect, a non-transitory computer-readable storage medium is provided, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the above-mentioned method.
In the above embodiment, the parsing service is controlled to be in a start or stop state, when data is processed, whether the parsing service of a protocol to which the target data belongs is started is determined by intercepting the target data sent by the target device, and if not, the parsing service is started first, and then the target data is transmitted to the parsing service for parsing. By the scheme, the problems that the idle running time is too long and the performance of the server is seriously influenced due to the fact that the existing analysis service runs all the time are solved, the effect of reducing the running time of the analysis service while ensuring the stable running of the analysis service is achieved, and the performance of the server is effectively improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a method flow diagram of a data parsing method according to an embodiment of the invention;
FIG. 2 is a schematic diagram of a data processing system according to an embodiment of the present invention;
fig. 3 is a block diagram of a start/stop control apparatus of a protocol parsing service according to an embodiment of the present invention;
fig. 4 is a block diagram of a data analysis apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the following embodiments and accompanying drawings. The exemplary embodiments and descriptions of the present invention are provided to explain the present invention, but not to limit the present invention.
In order to solve the problem that the performance of the server is seriously affected due to the long idle running time of the existing parsing service, in this example, a data parsing method is provided, as shown in fig. 1, which may include the following steps:
step 101: intercepting target data sent by target equipment;
the intercepting of the target data sent by the target device may be:
1) intercepting data sent by a temperature-sensitive detector in the fire-fighting sensor equipment through an Nb-iot wireless communication module in a butt joint mode with an upper computer protocol;
2) intercepting data sent by a network controller in a butt joint with an upper computer protocol;
or, 3) intercepting data sent by the multi-connection machine through a DTU (data transfer unit) docking wireless control protocol.
That is, the target device and the target data are diversified, because the data analysis method can be applied to a building control system, and for the building control system, there are a plurality of controlled devices, interactive devices, service devices, and the like. Different devices may upload data via their own data transfer protocols.
Step 102: determining a protocol to which the target data belongs;
in order to achieve efficient protocol determination, modulo operation detection may be performed on uploaded data from three dimensions, which may be referred to as three-modulo detection, where the three dimensions may be: data structure, data type, enumeration type. For the target data, preprocessing may be performed to convert the target data into a fixed data format, and based on the fixed data format, the information of the three dimensions is determined.
Specifically, when data is uploaded, the data type of the data is judged firstly, a corresponding analysis channel is selected according to the data type, then the data structure of the data is judged, the range of the protocol is further narrowed according to the data structure, finally, the enumeration type is judged, and the protocol is directly confirmed according to the enumeration type. When implemented, determining the protocol to which the target data belongs may include: judging the data type of the target data; determining an analysis channel corresponding to the data type; determining a data structure of the target data according to the analysis channel; matching the enumeration type of the target data according to a data structure; and taking the protocol corresponding to the matched enumeration type as the protocol to which the target data belongs. Namely, the protocol to which the data belongs is efficiently and accurately determined through three dimensions of a data structure, a data type and an enumeration type.
Step 103: determining whether a resolution service of a protocol to which the target data belongs has been started;
step 104: and if not, starting the analysis service of the protocol to which the target data belongs, and transmitting the target data to the analysis service of the protocol to which the target data belongs for analysis.
In the above example, the parsing service is controlled to be in a starting or stopping state, when data is processed, whether the parsing service of a protocol to which the target data belongs is started is determined by intercepting the target data sent by the target device, and if not, the parsing service is started first, and then the target data is transmitted to the parsing service for parsing. By the scheme, the problems that the idle running time is too long and the performance of the server is seriously influenced due to the fact that the existing analysis service runs all the time are solved, the effect of reducing the running time of the analysis service while ensuring the stable running of the analysis service is achieved, and the performance of the server is effectively improved.
Considering that in the whole system, the required analysis services are various, in order to realize centralized management and control of various analysis services and improve management efficiency, a registry can be set, and the start and stop states of the analysis services are recorded and adjusted through the registry, so that accurate management and control of the analysis services are realized. That is, the parsing service can be discovered through a jump signal generated when the parsing service is manually started; under the condition of discovering the analysis service, registering the discovered analysis service in a preset registry; and performing start-stop control on each analysis service in the registry. For example: when the resolution service is manually started, the protocol service sends a jump signal, the registry detects that the service jumps, the service is captured, and the service is registered in the registry by the registry.
Furthermore, in order to reduce the time length of the idle running of the resolution service, a calibration time length may be set for the resolution service, and if the data is not received after exceeding the calibration time length, it may be determined that the resolution service can be subjected to service suspension operation, so as to improve the performance of the server. Specifically, when the start-stop control is performed on each analysis service in the registry, the calibration duration corresponding to each analysis service can be calculated according to the uploading frequency of the protocol data corresponding to each analysis service by counting the uploading frequency of the protocol data corresponding to each analysis service; monitoring the duration of the data which are not received by each analysis service, and whether the corresponding calibration duration is reached; and stopping the service for the resolution service reaching the corresponding calibration time length.
Specifically, after the analysis service is counted for a certain time (wherein the time can be set, for example, one week, etc.), a calculation is performed, and the frequency x of uploading each protocol data is calculated and stored; after the frequency x is obtained, the frequency x can be uploaded through F (x) according to each protocol data to be calculated, and the calibration t of the protocol for a long time is obtained. When a certain analysis service is started but no data is uploaded to the analysis service for a long time, detecting whether the protocol analysis service does not receive the data after t time through a function F (x), if the protocol analysis service does not receive the data after t time is judged, removing the analysis service of the protocol from the registry, and then stopping the corresponding analysis service when a certain registration information of the registry is monitored to be cancelled.
For example: the fire sensor reports data once in 8 hours, the frequency is 8 hours/time, and if t is 3x, t is 24, that is, if the fire sensor does not upload data in 24 hours (may be failed or removed), it may be determined that the data is not uploaded for a long time.
In one embodiment, the service suspension of the resolution service reaching the corresponding calibrated duration may include: taking the analysis service when the duration of the unreceived data reaches the corresponding calibration duration as a first target analysis service; logging the first target resolution service from the registry; and under the condition that the first target analysis service in the registry is monitored to be cancelled, service termination is carried out on the first target analysis service.
In order to realize efficient and ordered uploading of data, a queue can be set, when the data is received, the data can be stored in the queue, and the analysis is triggered to be performed under the condition that the analysis service corresponding to the data is in a running state. That is, starting the parsing service of the protocol to which the target data belongs, and transmitting the target data to the parsing service of the protocol to which the target data belongs for parsing may include: temporarily storing the target data in a preset queue; taking the analysis service of the protocol to which the target data belongs as a second target analysis service; adding the second target resolution service to the registry; starting a second target analysis service under the condition that the second target analysis service is added in the registry; and sending the target data in the preset queue to the second target analysis service for analysis.
The above method is described below with reference to a specific example, however, it should be noted that the specific example is only for better describing the present application and is not to be construed as limiting the present application.
Aiming at the problems that the existing analysis service is in an idle running state when no data can be analyzed, and the analysis service is not started to cause analysis failure and data loss when the equipment uploads data, the method provides a start-stop control device for the protocol analysis service in the embodiment. In addition, the protocol analysis service is stopped for the protocol data with lower uploading frequency.
As shown in fig. 2, the schematic diagram of the data processing system provided in this embodiment may use a RabbitMQ server as a message queue, and the communication between each communication device (Nb-iot wireless communication device, network controller communication device, Modbus communication device) and each parsing server (Nb-iot parsing server, network controller parsing server, Modbus parsing server) is performed by using the message queue. The communication equipment transmits the data to the analysis service control device through the RabbitMQ server, and the data is transmitted to the analysis server by the analysis service control device, analyzed and transmitted to the data center station and then transmitted to the service foreground.
The data center station is used for preprocessing the data acquired and analyzed by each analysis server, and mainly aims to integrate the data analyzed by various protocols in a standardized data format. The business foreground is the service related to page display and business processing, such as the display of monitoring pages of the equipment by various subsystems and the logic of business processing related to page display.
Specifically, based on message interception, three-mode detection is performed on a protocol to which data belongs, and a 'mode-like' operation is performed on the data uploaded by the equipment from three dimensions to detect the protocol to which the data belongs. The service is used for carrying out forward registration on the registry through a service jump investigation technology, and the registration information of a registry protocol is detected when the data is uploaded to the data distribution module, so that the data distribution is realized. Furthermore, a protocol reverse injection technology is introduced, and a general forward injection process is that when a protocol analysis service is started, the service sends a heartbeat, and when a registration center detects heartbeat information, the information of the service is injected into the registration center; and the reverse injection is to directly inject the service information into the registry through human or program, and the process is called reverse injection, and when the change of the registry information is detected, the start and stop of the protocol analysis service are controlled.
As shown in fig. 3, the start-stop control device for the protocol parsing service may include: the system comprises a message interception module, a data distribution module, a registration center module, a reverse registration module of the registration center and a start-stop control module. Wherein:
the message interception module is used for intercepting all data sent from the RabbitMQ server so as to avoid direct communication between the analytic service and the RabbitMQ server;
the data distribution module is used for judging the protocol to which the data belongs;
the registration center is used for discovering and analyzing services;
a reverse registration module, configured to manage a registry of a registry, where the registry includes related information of each protocol parsing server, for example: IP, port, service name, protocol of which, etc.;
and the start-stop control module is used for controlling the start and stop of the service according to the registry.
Based on the above start-stop control device for the protocol analysis service, when the analysis service is manually started, the service will send a jump signal, the registry detects that there is a jump in the service, and captures the jump, so that the service is registered in the registry by the registry, which may be called jump investigation.
When data is uploaded from the RabbitMQ server, after the data flow passes through the data distribution module, the data distribution module performs modular operation detection, which may be called as three-modular detection, on three dimensions of the uploaded data, where the three dimensions are: the data structure, the data type and the enumeration type are used for judging the protocol of the three dimensions in a calculation mode similar to modular operation, and then the protocol is distributed to each analysis service for analysis.
The three-mode detection may be: each protocol specifies the data format when it is sent to the RabbitMQ server, defining three dimensions: data type, data structure, enumeration type. When data is uploaded, the data type is judged firstly, a corresponding analysis channel is selected according to the data type, then the data structure is judged, the range of the protocol is further narrowed according to the data structure, finally the enumeration type is judged, and the protocol is directly confirmed according to the enumeration type.
For example:
1) the temperature-sensing detector in the fire sensor equipment is connected with data sent by an upper computer protocol through an Nb-iot wireless communication module, the data type is a byte array, the length is 6, and the data structure is as follows:
2) the network controller is connected with data sent by an upper computer protocol, the data type of the data is a JSON character string, and the data structure is as follows:
the enumerated types are:
11 x: status code
51 x: type of request
7 a: type of point location
7 b: point location ID
8 c: current value of point location
3) The multi-split air conditioner is connected with data sent by a wireless control protocol through a DTU, the data type of the multi-split air conditioner is a JSON character string, and the data structure is as follows:
the enumerated types are:
29xy 0: temperature of the unit
7xy 6: on-off machine
8xy 8: mode of operation
8xy 9: wind speed
8xy 2: ambient temperature
7xy 8: communication fault of indoor unit
7xy 7: locking in
The message distribution module records the data uploaded to each protocol analysis service, and the recording comprises the following steps: uploading time and an affiliated protocol; after counting for a certain time (wherein the time can be set, for example, one week, etc.), calculating once, calculating the uploading frequency x of each protocol data, and storing; and F (x) operation can be carried out after the frequency x is reached, and the operation is carried out according to the uploading frequency x of each protocol data to calculate, so that the long-time calibration t of the protocol is obtained.
When a certain analysis service is started, but no data is uploaded to the analysis service for a long time, the reverse registration module detects whether the protocol analysis service does not receive the data after t time through a function F (x), and if the protocol analysis service does not receive the data after t time, the reverse injection module eliminates the analysis service of the protocol from the registration center. And then the start-stop control module monitors that a certain piece of registration information of the registry is cancelled, and stops the corresponding analysis service.
For example: the fire sensor reports data once in 8 hours, the frequency is 8 hours/time, and if t is 3x, t is 24, that is, if the fire sensor does not upload data in 24 hours (may be failed or removed), it may be determined that the data is not uploaded for a long time.
Under the condition that the analysis service is not started, when data are uploaded from the RabbitMQ server, data flow passes through the data distribution module, the data distribution module judges the protocol of the uploaded data, and then the data are temporarily stored in a queue. And then, informing a reverse registration module, adding the analysis service of the protocol into a registration center, and then monitoring that a certain piece of registration information of the registry is registered by a start-stop control module to start the corresponding analysis service. And after the analysis service is started, the data in the queue is distributed to each analysis service for analysis.
Based on the same inventive concept, the embodiment of the present invention further provides a data analysis apparatus, as described in the following embodiments. Because the principle of the data analysis device for solving the problems is similar to that of the data analysis method, the implementation of the data analysis device can refer to the implementation of the data analysis method, and repeated parts are not described again. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated. Fig. 4 is a block diagram of a data analysis apparatus according to an embodiment of the present invention, and as shown in fig. 4, the data analysis apparatus may include: an interception module 401, a first determination module 402, a second determination module 403 and a parsing module 404, the structure of which is explained below.
The intercepting module 401 is configured to intercept target data sent by a target device;
a first determining module 402, configured to determine a protocol to which the target data belongs;
a second determining module 403, configured to determine whether a resolution service of a protocol to which the target data belongs is started;
the parsing module 404 is configured to, if it is determined that the target data is not started, start a parsing service of a protocol to which the target data belongs, and transmit the target data to the parsing service of the protocol to which the target data belongs for parsing.
In one embodiment, the data parsing apparatus may be further configured to discover the parsing service through a jump signal generated when the parsing service is manually started; under the condition of discovering the analysis service, registering the discovered analysis service in a preset registry; and performing start-stop control on each analysis service in the registry.
In an embodiment, the performing start-stop control on each analysis service in the registry may include: counting the uploading frequency of the protocol data corresponding to each analysis service; calculating the calibration duration corresponding to each analysis service according to the uploading frequency of the protocol data corresponding to each analysis service; monitoring the duration of the data which are not received by each analysis service, and whether the corresponding calibration duration is reached; and stopping the service for the resolution service reaching the corresponding calibration time length.
In one embodiment, the service suspension of the resolution service reaching the corresponding calibrated duration may include: taking the analysis service when the duration of the unreceived data reaches the corresponding calibration duration as a first target analysis service; logging the first target resolution service from the registry; and under the condition that the first target analysis service in the registry is monitored to be cancelled, service termination is carried out on the first target analysis service.
In one embodiment, starting a resolution service of a protocol to which the target data belongs and transmitting the target data to the resolution service of the protocol to which the target data belongs for resolution may include: temporarily storing the target data in a preset queue; taking the analysis service of the protocol to which the target data belongs as a second target analysis service; adding the second target resolution service to the registry; starting a second target analysis service under the condition that the second target analysis service is added in the registry; and sending the target data in the preset queue to the second target analysis service for analysis.
In one embodiment, the intercepting target data sent by the target device may include, but is not limited to, at least one of the following: intercepting data sent by a temperature-sensitive detector in the fire-fighting sensor equipment through an Nb-iot wireless communication module in a butt joint mode with an upper computer protocol; intercepting data sent by a network controller in a butt joint with an upper computer protocol; or intercepting data sent by the multi-connection machine through a DTU (data transfer unit) docking wireless control protocol.
In an embodiment, the first determining module 402 may be specifically configured to determine a data type of the target data; determining an analysis channel corresponding to the data type; determining a data structure of the target data according to the analysis channel; matching the enumeration type of the target data according to a data structure; and taking the protocol corresponding to the matched enumeration type as the protocol to which the target data belongs.
In another embodiment, a software is provided, which is used to execute the technical solutions described in the above embodiments and preferred embodiments.
In another embodiment, a storage medium is provided, in which the software is stored, and the storage medium includes but is not limited to: optical disks, floppy disks, hard disks, erasable memory, etc.
From the above description, it can be seen that the embodiments of the present invention achieve the following technical effects: controlling the analysis service to be in a starting or stopping state, when processing data, determining whether the analysis service of a protocol to which the target data belongs is started or not by intercepting the target data sent by the target equipment, if not, starting the analysis service first, and then transmitting the target data to the analysis service for analysis. By the scheme, the problems that the idle running time is too long and the performance of the server is seriously influenced due to the fact that the existing analysis service runs all the time are solved, the effect of reducing the running time of the analysis service while ensuring the stable running of the analysis service is achieved, and the performance of the server is effectively improved.
Although various specific embodiments are mentioned in the disclosure of the present application, the present application is not limited to the cases described in the industry standards or the examples, and the like, and some industry standards or the embodiments slightly modified based on the implementation described in the custom manner or the examples can also achieve the same, equivalent or similar, or the expected implementation effects after the modifications. Embodiments employing such modified or transformed data acquisition, processing, output, determination, etc., may still fall within the scope of alternative embodiments of the present application.
Although the present application provides method steps as described in an embodiment or flowchart, more or fewer steps may be included based on conventional or non-inventive means. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an apparatus or client product in practice executes, it may execute sequentially or in parallel (e.g., in a parallel processor or multithreaded processing environment, or even in a distributed data processing environment) according to the embodiments or methods shown in the figures. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the presence of additional identical or equivalent elements in a process, method, article, or apparatus that comprises the recited elements is not excluded.
The devices or modules and the like explained in the above embodiments may be specifically implemented by a computer chip or an entity, or implemented by a product with certain functions. For convenience of description, the above devices are described as being divided into various modules by functions, and are described separately. Of course, in implementing the present application, the functions of each module may be implemented in one or more pieces of software and/or hardware, or a module that implements the same function may be implemented by a combination of a plurality of sub-modules, and the like. The above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and other divisions may be realized in practice, for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted, or not executed.
Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may therefore be considered as a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.
The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, classes, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, or the like, and includes several instructions for enabling a computer device (which may be a personal computer, a mobile terminal, a server, or a network device) to execute the method according to the embodiments or some parts of the embodiments of the present application.
The embodiments in the present specification are described in a progressive manner, and the same or similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. The application is operational with numerous general purpose or special purpose computing system environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
While the present application has been described by way of examples, those of ordinary skill in the art will appreciate that there are numerous variations and permutations of the present application that do not depart from the spirit of the present application and that the appended embodiments are intended to include such variations and permutations without departing from the present application.
Claims (11)
1. A data parsing method, comprising:
intercepting target data sent by target equipment;
determining a protocol to which the target data belongs;
determining whether a resolution service of a protocol to which the target data belongs has been started;
and if not, starting the analysis service of the protocol to which the target data belongs, and transmitting the target data to the analysis service of the protocol to which the target data belongs for analysis.
2. The method of claim 1, further comprising:
discovering the analysis service through a jump signal generated when the analysis service is manually started;
under the condition of discovering the analysis service, registering the discovered analysis service in a preset registry;
and performing start-stop control on each analysis service in the registry.
3. The method of claim 2, wherein performing start-stop control on each analytic service in the registry comprises:
counting the uploading frequency of the protocol data corresponding to each analysis service;
calculating the calibration duration corresponding to each analysis service according to the uploading frequency of the protocol data corresponding to each analysis service;
monitoring the duration of the data which are not received by each analysis service, and whether the corresponding calibration duration is reached;
and stopping the service for the resolution service reaching the corresponding calibration time length.
4. The method of claim 3, wherein the out-of-service for the resolution service that reaches the corresponding calibrated duration comprises:
taking the analysis service when the duration of the unreceived data reaches the corresponding calibration duration as a first target analysis service;
logging the first target resolution service from the registry;
and under the condition that the first target analysis service in the registry is monitored to be cancelled, service termination is carried out on the first target analysis service.
5. The method of claim 2, wherein starting a resolution service of a protocol to which the target data belongs and transmitting the target data to the resolution service of the protocol to which the target data belongs for resolution comprises:
temporarily storing the target data in a preset queue;
taking the analysis service of the protocol to which the target data belongs as a second target analysis service;
adding the second target resolution service to the registry;
starting a second target analysis service under the condition that the second target analysis service is added in the registry;
and sending the target data in the preset queue to the second target analysis service for analysis.
6. The method of claim 1, wherein determining the protocol to which the target data belongs comprises:
judging the data type of the target data;
determining an analysis channel corresponding to the data type;
determining a data structure of the target data according to the analysis channel;
matching the enumeration type of the target data according to a data structure;
and taking the protocol corresponding to the matched enumeration type as the protocol to which the target data belongs.
7. The method of claim 1, wherein intercepting target data sent by a target device comprises at least one of:
intercepting data sent by a protocol of a temperature-sensitive detector in fire-fighting sensor equipment in a butt joint with an upper computer;
intercepting data sent by a network controller in a butt joint with an upper computer protocol;
or intercepting data sent by the multi-online docking wireless control protocol.
8. A data analysis device, comprising:
the intercepting module is used for intercepting target data sent by target equipment;
the first determining module is used for determining a protocol to which the target data belongs;
the second determining module is used for determining whether the analysis service of the protocol to which the target data belongs is started;
and the analysis module is used for starting the analysis service of the protocol to which the target data belongs and transmitting the target data to the analysis service of the protocol to which the target data belongs for analysis under the condition that the target data is determined not to be started.
9. A server device, comprising: the data parsing apparatus of claim 8.
10. A network device, comprising: memory, processor and computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 7 when executing the computer program.
11. A non-transitory computer readable storage medium, having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111087997.5A CN113923272A (en) | 2021-09-16 | 2021-09-16 | Data analysis method and device and server equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111087997.5A CN113923272A (en) | 2021-09-16 | 2021-09-16 | Data analysis method and device and server equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113923272A true CN113923272A (en) | 2022-01-11 |
Family
ID=79235290
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111087997.5A Pending CN113923272A (en) | 2021-09-16 | 2021-09-16 | Data analysis method and device and server equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113923272A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115550472A (en) * | 2022-11-22 | 2022-12-30 | 浙江大华技术股份有限公司 | Heterogeneous data processing method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102158498A (en) * | 2011-05-26 | 2011-08-17 | 东南大学 | Implementation method for network node structure supporting service customization and expansion |
| CN102571732A (en) * | 2010-12-30 | 2012-07-11 | 中国移动通信集团公司 | Method, device and system for processing sensor protocol information |
| CN107636602A (en) * | 2017-07-14 | 2018-01-26 | 深圳市元征科技股份有限公司 | A kind of data processing method and data processing equipment |
| JP2018042018A (en) * | 2016-09-05 | 2018-03-15 | 日本電信電話株式会社 | Communication device, communication method, and communication program |
| CN110380913A (en) * | 2019-08-19 | 2019-10-25 | 贵州航天智慧农业有限公司 | A kind of multi-protocols device management method and system based on single port |
| CN112153048A (en) * | 2020-09-24 | 2020-12-29 | 珠海格力电器股份有限公司 | Information analysis method, information analysis device, information analysis system, storage medium, and electronic device |
| CN113179269A (en) * | 2021-04-27 | 2021-07-27 | 深圳市麦斯杰网络有限公司 | Internet of things-based protocol data analysis method, system, medium, and program product |
-
2021
- 2021-09-16 CN CN202111087997.5A patent/CN113923272A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102571732A (en) * | 2010-12-30 | 2012-07-11 | 中国移动通信集团公司 | Method, device and system for processing sensor protocol information |
| CN102158498A (en) * | 2011-05-26 | 2011-08-17 | 东南大学 | Implementation method for network node structure supporting service customization and expansion |
| JP2018042018A (en) * | 2016-09-05 | 2018-03-15 | 日本電信電話株式会社 | Communication device, communication method, and communication program |
| CN107636602A (en) * | 2017-07-14 | 2018-01-26 | 深圳市元征科技股份有限公司 | A kind of data processing method and data processing equipment |
| CN110380913A (en) * | 2019-08-19 | 2019-10-25 | 贵州航天智慧农业有限公司 | A kind of multi-protocols device management method and system based on single port |
| CN112153048A (en) * | 2020-09-24 | 2020-12-29 | 珠海格力电器股份有限公司 | Information analysis method, information analysis device, information analysis system, storage medium, and electronic device |
| CN113179269A (en) * | 2021-04-27 | 2021-07-27 | 深圳市麦斯杰网络有限公司 | Internet of things-based protocol data analysis method, system, medium, and program product |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115550472A (en) * | 2022-11-22 | 2022-12-30 | 浙江大华技术股份有限公司 | Heterogeneous data processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2755416B1 (en) | Method and apparatus for remotely locating wireless network fault | |
| CN102006588B (en) | Method and system for monitoring network behavior of smart mobile phone | |
| CN108900374B (en) | Data processing method and device applied to DPI equipment | |
| CN109656574B (en) | Transaction time delay measurement method and device, computer equipment and storage medium | |
| US9467360B2 (en) | System, device and method for managing network traffic by using monitoring and filtering policies | |
| US9276819B2 (en) | Network traffic monitoring | |
| CN103544091A (en) | Method and device for monitoring Windows process | |
| CN104598369A (en) | Method and device for monitoring software in mobile device | |
| CN110099398B (en) | Network failure information collection method, network system, storage medium and network device | |
| CN108737212B (en) | Device, system and method for detecting transmission protocol conformance | |
| CN112017323A (en) | Patrol alarm method and device, readable storage medium and terminal equipment | |
| CN112333044A (en) | Shunting equipment performance test method, device and system, electronic equipment and medium | |
| CN113923272A (en) | Data analysis method and device and server equipment | |
| CN115484047A (en) | Method, device, equipment and storage medium for identifying flooding attack in cloud platform | |
| CN113207146B (en) | Wireless communication network quality monitoring system and method | |
| TWI448975B (en) | Dispersing-type algorithm system applicable to image monitoring platform | |
| CN117041305B (en) | Offline data management method, device and medium for gas flowmeter based on Internet of things | |
| CN111278022A (en) | Internet of things WiFi module performance test method and system | |
| CN110069382A (en) | Software supervision method, server, terminal device, computer equipment and medium | |
| CN116260747A (en) | Monitoring method and device of terminal test equipment and electronic equipment | |
| CN103905223A (en) | Data packet acquisition method, system and device | |
| CN110808845A (en) | MAC address information acquisition system and method based on WiFi equipment | |
| CN116886445B (en) | Processing method and device of filtering result, storage medium and electronic equipment | |
| CN113703404B (en) | Fault simulation monitoring and diagnosis method and device, electronic device and storage medium | |
| CN114070756B (en) | Method for counting network traffic and related device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220111 |
|
| RJ01 | Rejection of invention patent application after publication |