CN114827306A - Multi-source heterogeneous industrial protocol message analysis method, system, equipment and medium - Google Patents
Multi-source heterogeneous industrial protocol message analysis method, system, equipment and medium Download PDFInfo
- Publication number
- CN114827306A CN114827306A CN202210252524.4A CN202210252524A CN114827306A CN 114827306 A CN114827306 A CN 114827306A CN 202210252524 A CN202210252524 A CN 202210252524A CN 114827306 A CN114827306 A CN 114827306A
- Authority
- CN
- China
- Prior art keywords
- message
- protocol
- module
- data
- industrial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 99
- 238000013515 script Methods 0.000 claims abstract description 86
- 238000000034 method Methods 0.000 claims abstract description 49
- 238000007781 pre-processing Methods 0.000 claims abstract description 39
- 230000000007 visual effect Effects 0.000 claims abstract description 9
- 230000008569 process Effects 0.000 claims description 25
- 238000007405 data analysis Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 4
- 238000007726 management method Methods 0.000 description 28
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000008092 positive effect Effects 0.000 description 2
- 238000012827 research and development Methods 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/08—Protocols for interworking; Protocol conversion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/31—Indexing; Data structures therefor; Storage structures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention belongs to the technical field of industrial internet, and discloses a method, a system, equipment and a medium for analyzing multi-source heterogeneous industrial protocol messages, wherein input terminal information is managed through a provided visual interface; after receiving the input of the industrial protocol message, removing the invalid message by the preprocessing module, inquiring the corresponding industrial protocol name and equipment ID of the equipment according to the address and the label uploaded by the input terminal, submitting the information to the protocol matching module, and outputting the information to the message analyzing module; the protocol matching module acquires an analysis script from a protocol analysis script database according to the industrial protocol name and the equipment ID submitted by the preprocessing module, and queries a corresponding ID industrial equipment data structure in a relational database; the message analysis module runs the protocol matching module output script in the script engine to analyze the input message, formats the analyzed message data according to the data structure output by the protocol matching module and stores the message data into the non-relational database. The invention improves the access efficiency of large-scale industrial equipment.
Description
Technical Field
The invention belongs to the technical field of industrial internet, and particularly relates to a multi-source heterogeneous industrial protocol message analysis method, system, equipment and medium.
Background
In the process of advancing industrial internet in the industrial field, the multi-source equipment and heterogeneous protocol access problem is a negative factor for further advancing industrial internet industrialization and marketization. Since PLC brands in the industry include Siemens (Siemens), Schneider (Schneider), ohron (Omron), Mitsubishi (Mitsubishi), honowell (Honeywell), Panasonic (Panasonic), rocwell (Rockwell), Emerson (Emerson), and the like, communication interfaces of each brand are various, and communication protocols vary from several to over a dozen. Common physical communication interfaces in the industrial communication field comprise RJ11, Mini Din, DB9, DB25, DB37 and the like, physical layer interfaces have RS232, RS422, RS485, RJ45 and the like, and the multi-source heterogeneous industrial protocol message analysis problem is an important difficulty in industrial internet data acquisition and data storage.
The common analytic mode in the industry is an access mode based on a third-party industrial internet gateway, namely, data acquisition and data analysis of physical layer and data link layer industrial equipment are realized locally by using gateway hardware, and then the data are converted into internet of things protocol data to be uploaded to an industrial internet platform. Due to the characteristics of different message stacks, unclear effective data bits, different verification modes, complex industrial field environment and multi-source isomerism of the industrial protocol, the solutions need a large amount of manual setting and operation during specific implementation and cannot solve the problems of access and analysis of the industrial internet large-scale industrial protocol.
Through the above analysis, the problems and defects of the prior art are as follows: the industrial communication interfaces and communication standards are various, the workload of analyzing the multi-source heterogeneous industrial protocol is large, the existing message analyzing solution is not suitable for the access requirement of the industrial internet, and the cloud difficulty of industrial equipment is greatly increased.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a method, a system, equipment and a medium for analyzing a multi-source heterogeneous industrial protocol message.
The invention is realized in this way, a multisource heterogeneous industrial protocol message parsing method, the multisource heterogeneous industrial protocol message parsing method firstly manages input terminal information through a visual interface provided by a terminal management module, and adds industrial equipment address, ID, protocol and data parsing script information; after receiving the input of the industrial protocol message, removing the invalid message by the preprocessing module, inquiring the corresponding industrial protocol name and equipment ID of the equipment according to the address and the label uploaded by the input terminal, submitting the information to the protocol matching module, and outputting the information to the message analyzing module; the protocol matching module acquires an analysis script from a protocol analysis script database according to the industrial protocol name and the equipment ID submitted by the preprocessing module, inquires a corresponding ID industrial equipment data structure in a relational database, and submits the data to the message analysis module; the message analysis module runs the script output by the protocol matching module in the script engine to analyze the input message, formats the analyzed message data according to the data structure output by the protocol matching module and stores the message data into the non-relational database.
Further, the multi-source heterogeneous industrial protocol message analysis method specifically comprises the following steps:
firstly, editing relevant information of a data acquisition terminal and industrial equipment in a terminal management module;
step two, after the protocol message uploaded by the physical layer industrial data acquisition terminal reaches the middleware, the invalid message is removed through the preprocessing module, the inquiry message is submitted to the protocol matching module corresponding to the industrial protocol name, and the message is output to the message analysis module;
step three, the protocol matching module acquires an analysis script and an equipment data structure according to the data submitted by the preprocessing module, and submits the data to the message analysis module;
and fourthly, the message analysis module operates the script output by the protocol matching module in the script engine to analyze the input message, formats the analyzed message data according to the data structure output by the protocol matching module and stores the message data into a non-relational database.
Further, the specific process of editing the relevant information of the data acquisition terminal and the industrial equipment through the terminal management module in the first step is as follows: and newly adding and editing data acquisition terminal information and the address, ID, protocol and data analysis script information of the affiliated industrial equipment in a visual interface of the terminal management module.
Further, in the second step, the invalid message is removed through the preprocessing module, the query message is submitted to the protocol matching module corresponding to the industrial protocol name, and the specific process of outputting the message to the message analyzing module is as follows: firstly, judging the length of a message stack, and considering a protocol with the message stack depth less than 10 as an invalid protocol to be removed according to the commonality of an industrial field bus protocol; then, the corresponding industrial protocol name and equipment ID of the equipment are inquired according to the address and the label uploaded by the input terminal and submitted to the protocol matching module, and the message is output to the message analyzing module.
Further, in the third step, the protocol matching module obtains the analysis script and the device data structure according to the data submitted by the preprocessing module, and the specific process of submitting the data to the message analysis module is as follows: the protocol matching module obtains the protocol analysis script from the protocol analysis script database according to the industrial protocol name and the equipment ID submitted by the preprocessing module, queries the corresponding ID industrial equipment data structure from the relational database, and submits the data to the message analysis module.
Further, the specific process of the message parsing module in the fourth step of running the script output by the protocol matching module in the script engine to parse the input message, formatting the parsed message data according to the data structure output by the protocol matching module and storing the parsed message data in the non-relational database is as follows: and running the script output by the protocol matching module in the script engine to analyze the input message, formatting the analyzed message data according to the data structure output by the protocol matching module and storing the message data into a non-relational database.
Another object of the present invention is to provide a computer device, which includes a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to execute the steps of the multi-source heterogeneous industrial protocol message parsing method.
Another object of the present invention is to provide a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the processor executes the steps of the multi-source heterogeneous industrial protocol message parsing method.
Another object of the present invention is to provide an information data processing terminal, where the information data processing terminal is configured to implement the steps of the multi-source heterogeneous industrial protocol message parsing method.
Another object of the present invention is to provide a multi-source heterogeneous industrial protocol packet parsing system for implementing the multi-source heterogeneous industrial protocol packet parsing method, the multi-source heterogeneous industrial protocol packet parsing system including:
the terminal management module is used for managing and editing the data acquisition terminal information and the address, the ID, the protocol and the data analysis script information of the industrial equipment;
the preprocessing module is used for receiving the protocol message uploaded by the industrial data acquisition terminal, removing invalid messages, inquiring the name of the industrial protocol corresponding to the message, submitting the name to the protocol matching module, and outputting the message to the message analyzing module;
the protocol matching module receives the data submitted by the preprocessing module, acquires the analysis script and the equipment data structure, and submits the data to the message analysis module;
and the message analysis module is used for operating the script output by the protocol matching module in the script engine to analyze the input message, formatting the analyzed message data according to the data structure output by the protocol matching module and storing the message data into a non-relational database.
In combination with the technical solutions and the technical problems to be solved, please analyze the advantages and positive effects of the technical solutions to be protected in the present invention from the following aspects:
first, aiming at the technical problems existing in the prior art and the difficulty in solving the problems, the technical problems to be solved by the technical scheme of the present invention are closely combined with results, data and the like in the research and development process, and some creative technical effects are brought after the problems are solved. The specific description is as follows: the invention realizes the functions of self-defining of equipment types, self-defining of message analysis, self-defining of message data structures and the like. And eliminating invalid data, and inquiring analysis scripts and data structures required by message analysis of the industrial equipment to provide data support for subsequent steps. And acquiring an analysis script and an equipment data structure, and providing support for message analysis. And analyzing and storing the input message to complete the analysis process of the multi-source heterogeneous industrial protocol message.
The invention aims to solve the problems in the industrial protocol analysis process in the field of industrial internet, simplifies the flows of message analysis and data formatting of the industrial internet and improves the efficiency of large-scale industrial equipment access.
Secondly, considering the technical scheme as a whole or from the perspective of products, the technical effect and advantages of the technical scheme to be protected by the invention are specifically described as follows:
the invention aims at the application scenes of message analysis and data formatting of the existing industrial internet, realizes the user-defined analysis and data formatting of the industrial protocol message, and aims to simplify the flows of message analysis and data formatting of the industrial internet and perfect the network access cloud system of the industrial internet.
Third, as an inventive supplementary proof of the claims of the present invention, there are also presented several important aspects:
(1) the expected income and commercial value after the technical scheme of the invention is converted are as follows: the invention solves the problem of industrial protocol message analysis commonly existing in the field of domestic industrial Internet commerce, and provides technical support for large-scale commercial industrial Internet equipment access.
(2) The technical scheme of the invention fills the technical blank in the industry at home and abroad: the invention provides a solution for analyzing domestic and foreign industrial protocol messages by using industrial data acquisition terminals, and fills the blank of the technology of analyzing industrial internet self-defined protocol messages and formatting data.
(3) The technical scheme of the invention solves the technical problems which are always desired to be solved but are not successfully achieved: the invention solves the problems of large-scale message analysis and data formatting of industrial multisource heterogeneous protocols, clears the barrier of industrial internet strategic propulsion and accelerates the industrial intelligent transformation and upgrading process of China.
(4) The technical scheme of the invention overcomes the technical prejudice whether: the invention combines the algorithm theory of the scientific research field with the actual production technical requirements of the industrial field, and overcomes the technical bias.
Drawings
Fig. 1 is a flowchart of a multi-source heterogeneous industrial protocol message parsing method according to an embodiment of the present invention;
fig. 2 is a flowchart of an implementation of a multi-source heterogeneous industrial protocol message parsing method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a multi-source heterogeneous industrial protocol message parsing system according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a terminal management process provided in an embodiment of the present invention;
FIG. 5 is a schematic diagram of a pre-processing process provided by an embodiment of the present invention;
FIG. 6 is a diagram illustrating a protocol matching process provided by an embodiment of the invention;
fig. 7 is a schematic diagram of a message parsing process according to an embodiment of the present invention;
fig. 8 is a terminal management visualization interface display diagram of a terminal management module according to an embodiment of the present invention;
fig. 9 is a display diagram of a device management visualization interface of a terminal management module according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
First, an embodiment is explained. This section is an explanatory embodiment expanding on the claims so as to fully understand how the present invention is embodied by those skilled in the art.
As shown in fig. 1, the method for parsing a multi-source heterogeneous industrial protocol packet provided in the embodiment of the present invention includes the following steps:
s101: managing and inputting terminal information through a visual interface provided by a terminal management module, and adding information such as an industrial equipment address, an ID, a protocol, a data analysis script and the like;
s102: after receiving the input of the industrial protocol message, removing the invalid message by the preprocessing module, inquiring the corresponding industrial protocol name and equipment ID of the equipment according to the address and the label uploaded by the input terminal, submitting the information to the protocol matching module, and outputting the information to the message analyzing module;
s103: the protocol matching module acquires an analysis script from a protocol analysis script database according to the industrial protocol name and the equipment ID submitted by the preprocessing module, inquires a corresponding ID industrial equipment data structure from a relational database, and submits the data to the message analysis module;
s104: the message analysis module runs the script output by the protocol matching module in the script engine to analyze the input message, formats the analyzed message data according to the data structure output by the protocol matching module and stores the message data into the non-relational database.
As shown in fig. 3, the multi-source heterogeneous industrial protocol message parsing system provided in the embodiment of the present invention includes:
and the terminal management module is used for managing and editing the data acquisition terminal information and the information such as the address, the ID, the protocol and the data analysis script of the affiliated industrial equipment.
The preprocessing module is used for receiving the protocol message uploaded by the industrial data acquisition terminal, removing invalid messages, inquiring the industrial protocol name corresponding to the message, submitting the industrial protocol name to the protocol matching module, and outputting the message to the message analyzing module.
And the protocol matching module receives the data submitted by the preprocessing module, acquires the analysis script and the equipment data structure, and submits the data to the message analysis module.
And the message analysis module is used for operating the script output by the protocol matching module in the script engine to analyze the input message, formatting the analyzed message data according to the data structure output by the protocol matching module and storing the message data into a non-relational database.
The terminal management module provided by the embodiment of the invention provides a mechanism for managing and editing data acquisition terminal information, as shown in table 1 and fig. 4. And the main function data of the terminal management module is used for acquiring terminal information management.
TABLE 1 data acquisition terminal information management
And the terminal management module manages the data acquisition terminal information and the information such as the address, the ID, the protocol and the data analysis script of the affiliated industrial equipment, generates relational model data and stores the relational model data into the relational database.
The preprocessing module provided by the embodiment of the invention provides an invalid message elimination and message protocol query mechanism, as shown in table 2 and fig. 5. The main function of the preprocessing module is to process the original message data set and generate a data set with labels such as protocol names and device IDs.
Table 2 invalid packet rejection and packet protocol lookup
| Module name | Input device | Output of | Remarks to note |
| Pre-processing module | Raw message data set | Tag data set |
The method comprises the steps that a preprocessing module receives a protocol message uploaded by an industrial data acquisition terminal, removes invalid messages with the message stack depth smaller than 10, inquires information such as a terminal ID, a device ID and an industrial protocol name of the uploaded message in a relational database according to an input terminal IP and a device address, generates a message number corresponding to the message in a message data set, packages the information into a label data set and submits the label data set to a protocol matching module, and outputs the processed message data set to a message analysis module.
The protocol matching module provided by the embodiment of the invention provides a device parsing script query and a device data structure query mechanism, as shown in table 3 and fig. 6. The main function of the protocol matching module is to inquire the corresponding analysis script and data structure of the device according to the input protocol label name and the device ID.
TABLE 3 device parsing script query and device data structure query
The protocol matching module acquires a protocol analysis script from a protocol analysis script database according to tags such as an industrial protocol name and equipment ID submitted by the preprocessing module, packages the protocol analysis script into a data set of the equipment analysis script taking a terminal as a unit, inquires data structures such as data types and data lengths of various sensors of equipment corresponding to the equipment ID from a relational database, and submits the data to the message analysis module.
The message parsing module provided in the embodiment of the present invention provides a message parsing mechanism and a data formatting mechanism, as shown in table 4 and fig. 7. The main function of the message analysis module is to run equipment analysis script analysis and format the message.
Table 4 message parsing and data formatting
The message analysis module runs the script output by the protocol matching module in the script engine to analyze the input message, formats the analyzed message data according to the data structure output by the protocol matching module and stores the message data into the non-relational database.
As shown in fig. 3, the method for parsing a multi-source heterogeneous industrial protocol packet according to the embodiment of the present invention includes the following steps:
step one, relevant information of the data acquisition terminal and the industrial equipment is edited at a terminal management module. The steps realize the functions of self-defining the equipment type, self-defining the message analysis, self-defining the message data structure and the like.
And step two, after the protocol message uploaded by the physical layer industrial data acquisition terminal reaches the middleware, removing the invalid message through the preprocessing module, inquiring the industrial protocol name corresponding to the message, submitting the message to the protocol matching module, and outputting the message to the message analysis module. The method comprises the following steps of eliminating invalid data, inquiring analysis scripts and data structures required by message analysis of the industrial equipment, and providing data support for subsequent steps.
And step three, the protocol matching module acquires the analysis script and the equipment data structure according to the data submitted by the preprocessing module, and submits the data to the message analysis module. In the step, an analysis script and an equipment data structure are obtained, and support is provided for message analysis.
And fourthly, the message analysis module operates the script output by the protocol matching module in the script engine to analyze the input message, formats the analyzed message data according to the data structure output by the protocol matching module and stores the message data into a non-relational database. The step analyzes and stores the input message, and completes the analysis process of the multi-source heterogeneous industrial protocol message.
Further, in the first step, the specific process of editing the relevant information of the data acquisition terminal and the industrial equipment through the terminal management module is as follows:
and newly adding and editing information of the data acquisition terminal and information of addresses, IDs, protocols, data analysis scripts and the like of the affiliated industrial equipment in a visual interface of the terminal management module.
Further, in the second step, the invalid message is removed through the preprocessing module, the query message is submitted to the protocol matching module corresponding to the industrial protocol name, and the specific process of outputting the message to the message analyzing module is as follows:
firstly, judging the length of a message stack, and considering a protocol with the message stack depth less than 10 as an invalid protocol to be removed according to the commonality of an industrial field bus protocol; then, the corresponding industrial protocol name and equipment ID of the equipment are inquired according to the address and the label uploaded by the input terminal and submitted to the protocol matching module, and the message is output to the message analyzing module.
Further, in the third step, the protocol matching module obtains the analysis script and the device data structure according to the data submitted by the preprocessing module, and the specific process of submitting the data to the message analysis module is as follows:
the protocol matching module obtains the protocol analysis script from the protocol analysis script database according to the industrial protocol name and the equipment ID submitted by the preprocessing module, queries the corresponding ID industrial equipment data structure from the relational database, and submits the data to the message analysis module.
Further, in the fourth step, the specific process of the message parsing module running the script output by the protocol matching module in the script engine to parse the input message, formatting the parsed message data according to the data structure output by the protocol matching module and storing the parsed message data in the non-relational database is as follows:
and running the script output by the protocol matching module in the script engine to analyze the input message, formatting the analyzed message data according to the data structure output by the protocol matching module and storing the message data into a non-relational database.
And II, application embodiment. In order to prove the creativity and the technical value of the technical scheme of the invention, the part is the application example of the technical scheme of the claims on specific products or related technologies.
The computer device provided by the embodiment of the invention comprises a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the following steps: step one, relevant information of the data acquisition terminal and the industrial equipment is edited at a terminal management module. And step two, after the protocol message uploaded by the physical layer industrial data acquisition terminal reaches the middleware, removing the invalid message through the preprocessing module, inquiring the industrial protocol name corresponding to the message, submitting the message to the protocol matching module, and outputting the message to the message analysis module. And step three, the protocol matching module acquires the analysis script and the equipment data structure according to the data submitted by the preprocessing module, and submits the data to the message analysis module. And fourthly, the message analysis module operates the script output by the protocol matching module in the script engine to analyze the input message, formats the analyzed message data according to the data structure output by the protocol matching module and stores the message data into a non-relational database.
And thirdly, evidence of relevant effects of the embodiment. The embodiment of the invention achieves some positive effects in the process of research and development or use, and has great advantages compared with the prior art, and the following contents are described by combining data, diagrams and the like in the test process.
The terminal management module realizes information management of the data acquisition terminal through a visual interface, and fig. 8 shows an actual operation interface of terminal management of the industrial internet platform, so that the user-defined management of information of a gateway number, a terminal ID, affiliated industrial equipment and the like of the data acquisition terminal on the industrial internet platform is realized; as shown in fig. 9, an actual operation interface of the device management of the industrial internet platform is provided, which realizes the user-defined management of information such as the device ID, the data structure, the parsing script, the device response instruction, and the like of the device to which the terminal belongs.
The preprocessing module inputs an original message data set and outputs a message data set and a label data set with invalid messages removed, and the data structure is as follows:
pre-processing module data structure
The protocol matching module queries the analysis script and the equipment data structure of the corresponding equipment according to the label data set, and the data structure is as follows:
protocol matching module data structure
The message analysis module uses a script engine to read and run the script added to the terminal management module, has the characteristics of modularization and platform independence, and enables a user to customize a message analysis flow including message format extraction, message data analysis, message data type conversion and data calculation through a visual interface on a platform application layer through a front-end language relative to the existing message analysis solution.
It should be noted that the embodiments of the present invention can be realized by hardware, software, or a combination of software and hardware. The hardware portion may be implemented using dedicated logic; the software portions may be stored in a memory and executed by a suitable instruction execution system, such as a microprocessor or specially designed hardware. Those skilled in the art will appreciate that the apparatus and methods described above may be implemented using computer executable instructions and/or embodied in processor control code, such code being provided on a carrier medium such as a disk, CD-or DVD-ROM, programmable memory such as read only memory (firmware), or a data carrier such as an optical or electronic signal carrier, for example. The apparatus and its modules of the present invention may be implemented by hardware circuits such as very large scale integrated circuits or gate arrays, semiconductors such as logic chips, transistors, or programmable hardware devices such as field programmable gate arrays, programmable logic devices, etc., or by software executed by various types of processors, or by a combination of hardware circuits and software, e.g., firmware.
The above description is only for the purpose of illustrating the present invention and the appended claims are not to be construed as limiting the scope of the invention, which is intended to cover all modifications, equivalents and improvements that are within the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A multi-source heterogeneous industrial protocol message analysis method is characterized in that firstly, input terminal information is managed through a visual interface provided by a terminal management module, and industrial equipment address, ID, protocol and data analysis script information are added; after receiving the input of the industrial protocol message, removing the invalid message by the preprocessing module, inquiring the corresponding industrial protocol name and equipment ID of the equipment according to the address and the label uploaded by the input terminal, submitting the information to the protocol matching module, and outputting the information to the message analyzing module; the protocol matching module acquires an analysis script in a protocol analysis script database according to the industrial protocol name and the equipment ID submitted by the preprocessing module, inquires a corresponding ID industrial equipment data structure in a relational database, and submits the data to the message analysis module; the message analysis module runs the script output by the protocol matching module in the script engine to analyze the input message, formats the analyzed message data according to the data structure output by the protocol matching module and stores the message data into the non-relational database.
2. The method for parsing a multi-source heterogeneous industrial protocol packet according to claim 1, wherein the method specifically comprises the following steps:
firstly, editing relevant information of a data acquisition terminal and industrial equipment in a terminal management module;
step two, after the protocol message uploaded by the physical layer industrial data acquisition terminal reaches the middleware, the invalid message is removed through the preprocessing module, the inquiry message is submitted to the protocol matching module corresponding to the industrial protocol name, and the message is output to the message analysis module;
step three, the protocol matching module acquires an analysis script and an equipment data structure according to the data submitted by the preprocessing module, and submits the data to the message analysis module;
and fourthly, the message analysis module operates the script output by the protocol matching module in the script engine to analyze the input message, formats the analyzed message data according to the data structure output by the protocol matching module and stores the message data into a non-relational database.
3. The method for parsing the multi-source heterogeneous industrial protocol message according to claim 2, wherein the specific process of editing the relevant information of the data acquisition terminal and the industrial equipment through the terminal management module in the first step is as follows: and newly adding and editing data acquisition terminal information and the address, ID, protocol and data analysis script information of the affiliated industrial equipment in a visual interface of the terminal management module.
4. The multi-source heterogeneous industrial protocol message parsing method according to claim 2, wherein in the second step, invalid messages are removed through the preprocessing module, the name of the industrial protocol corresponding to the query message is submitted to the protocol matching module, and the specific process of outputting the message to the message parsing module is as follows: firstly, judging the length of a message stack, and considering a protocol with the message stack depth less than 10 as an invalid protocol to be removed according to the commonality of an industrial field bus protocol; then, the corresponding industrial protocol name and equipment ID of the equipment are inquired according to the address and the label uploaded by the input terminal and submitted to the protocol matching module, and the message is output to the message analyzing module.
5. The method for parsing the multi-source heterogeneous industrial protocol message according to claim 2, wherein in the third step, the protocol matching module obtains the parsing script and the device data structure according to the data submitted by the preprocessing module, and the specific process of submitting the data to the message parsing module is as follows: the protocol matching module obtains the protocol analysis script from the protocol analysis script database according to the industrial protocol name and the equipment ID submitted by the preprocessing module, queries the corresponding ID industrial equipment data structure from the relational database, and submits the data to the message analysis module.
6. The method for parsing a multi-source heterogeneous industrial protocol message according to claim 2, wherein the specific process of the message parsing module in the fourth step of running the script output by the protocol matching module in the script engine to parse the input message, formatting the parsed message data according to the data structure output by the protocol matching module and storing the parsed message data in the non-relational database is as follows: and running the script output by the protocol matching module in the script engine to analyze the input message, formatting the analyzed message data according to the data structure output by the protocol matching module and storing the message data into a non-relational database.
7. A computer device comprising a memory and a processor, wherein the memory stores a computer program, and wherein the computer program when executed by the processor causes the processor to perform the steps of the multi-source heterogeneous industrial protocol message parsing method of any one of claims 1-6.
8. A computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the steps of the multi-source heterogeneous industrial protocol message parsing method according to any one of claims 1 to 6.
9. An information data processing terminal, characterized in that the information data processing terminal is used for implementing the steps of the multi-source heterogeneous industrial protocol message parsing method of any one of claims 1 to 6.
10. A multi-source heterogeneous industrial protocol message analysis system for implementing the multi-source heterogeneous industrial protocol message analysis method according to any one of claims 1 to 6, wherein the multi-source heterogeneous industrial protocol message analysis system comprises:
the terminal management module is used for managing and editing the data acquisition terminal information and the address, the ID, the protocol and the data analysis script information of the industrial equipment;
the preprocessing module is used for receiving the protocol message uploaded by the industrial data acquisition terminal, removing invalid messages, submitting the inquiry message to the protocol matching module corresponding to the industrial protocol name, and outputting the message to the message analysis module;
the protocol matching module is used for receiving the data submitted by the preprocessing module, acquiring an analysis script and an equipment data structure and submitting the data to the message analysis module;
and the message analysis module is used for operating the script output by the protocol matching module in the script engine to analyze the input message, formatting the analyzed message data according to the data structure output by the protocol matching module and storing the message data into a non-relational database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210252524.4A CN114827306B (en) | 2022-03-15 | 2022-03-15 | Multi-source heterogeneous industrial protocol message analysis method, system, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210252524.4A CN114827306B (en) | 2022-03-15 | 2022-03-15 | Multi-source heterogeneous industrial protocol message analysis method, system, equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114827306A true CN114827306A (en) | 2022-07-29 |
| CN114827306B CN114827306B (en) | 2024-01-19 |
Family
ID=82528297
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210252524.4A Active CN114827306B (en) | 2022-03-15 | 2022-03-15 | Multi-source heterogeneous industrial protocol message analysis method, system, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114827306B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115361456A (en) * | 2022-08-04 | 2022-11-18 | 广东中设智控科技股份有限公司 | Data message processing method, device and system |
| CN117290428A (en) * | 2023-11-22 | 2023-12-26 | 深圳中正信息科技有限公司 | Data management method and device for internet of things device and readable storage medium |
| CN118055127A (en) * | 2024-04-16 | 2024-05-17 | 哈尔滨工业大学（威海） | Heterogeneous robot and textile equipment information fusion interface calling device and method |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1592270A (en) * | 2003-08-26 | 2005-03-09 | 华为技术有限公司 | Method and device for realizing multi-protocol conversion between intelligent network and external platforn |
| US20060280178A1 (en) * | 2005-06-14 | 2006-12-14 | Microsoft Corporation | Script-based parser |
| CN101252471A (en) * | 2008-03-20 | 2008-08-27 | 中兴通讯股份有限公司 | Distributed automatization test system and method |
| CN106682097A (en) * | 2016-12-01 | 2017-05-17 | 北京奇虎科技有限公司 | Method and device for processing log data |
| CN107046526A (en) * | 2016-12-28 | 2017-08-15 | 北京邮电大学 | Distributed heterogeneous network hole method for digging based on Fuzzing algorithms |
| US20170364539A1 (en) * | 2016-06-19 | 2017-12-21 | Data.World, Inc. | Platform management of integrated access of public and privately-accessible datasets utilizing federated query generation and query schema rewriting optimization |
| CN110222318A (en) * | 2019-06-05 | 2019-09-10 | 卡斯柯信号(成都)有限公司 | Data generating tool development approach based on XML |
| CN110601876A (en) * | 2019-08-20 | 2019-12-20 | 西安向南网络信息科技有限公司 | Intelligent Internet of things platform |
| CN110618983A (en) * | 2019-08-15 | 2019-12-27 | 复旦大学 | JSON document structure-based industrial big data multidimensional analysis and visualization method |
| CN112671553A (en) * | 2020-11-26 | 2021-04-16 | 中国电子科技网络信息安全有限公司 | Industrial control network topological graph generation method based on active and passive detection |
-
2022
- 2022-03-15 CN CN202210252524.4A patent/CN114827306B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1592270A (en) * | 2003-08-26 | 2005-03-09 | 华为技术有限公司 | Method and device for realizing multi-protocol conversion between intelligent network and external platforn |
| US20060280178A1 (en) * | 2005-06-14 | 2006-12-14 | Microsoft Corporation | Script-based parser |
| CN101252471A (en) * | 2008-03-20 | 2008-08-27 | 中兴通讯股份有限公司 | Distributed automatization test system and method |
| US20170364539A1 (en) * | 2016-06-19 | 2017-12-21 | Data.World, Inc. | Platform management of integrated access of public and privately-accessible datasets utilizing federated query generation and query schema rewriting optimization |
| CN106682097A (en) * | 2016-12-01 | 2017-05-17 | 北京奇虎科技有限公司 | Method and device for processing log data |
| CN107046526A (en) * | 2016-12-28 | 2017-08-15 | 北京邮电大学 | Distributed heterogeneous network hole method for digging based on Fuzzing algorithms |
| CN110222318A (en) * | 2019-06-05 | 2019-09-10 | 卡斯柯信号(成都)有限公司 | Data generating tool development approach based on XML |
| CN110618983A (en) * | 2019-08-15 | 2019-12-27 | 复旦大学 | JSON document structure-based industrial big data multidimensional analysis and visualization method |
| CN110601876A (en) * | 2019-08-20 | 2019-12-20 | 西安向南网络信息科技有限公司 | Intelligent Internet of things platform |
| CN112671553A (en) * | 2020-11-26 | 2021-04-16 | 中国电子科技网络信息安全有限公司 | Industrial control network topological graph generation method based on active and passive detection |
Non-Patent Citations (3)
| Title |
|---|
| BRUNO Y. L. KIMURA: "Alternative Scheduling Decisions for Multipath TCP", 《 IEEE COMMUNICATIONS LETTERS》 * |
| 刘宇辉: "集成"还是"融合"——论IBMS与物联网智慧云平台的选择", 《智能建筑与智慧城市》, pages 3 - 4 * |
| 祝幸辉: "云物联平台的数据汇聚与存储方法研究", 《中国优秀硕士学位论文全文数据库信息科技辑》, pages 26 - 27 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115361456A (en) * | 2022-08-04 | 2022-11-18 | 广东中设智控科技股份有限公司 | Data message processing method, device and system |
| CN117290428A (en) * | 2023-11-22 | 2023-12-26 | 深圳中正信息科技有限公司 | Data management method and device for internet of things device and readable storage medium |
| CN117290428B (en) * | 2023-11-22 | 2024-04-05 | 深圳中正信息科技有限公司 | Data management method and device for internet of things device and readable storage medium |
| CN118055127A (en) * | 2024-04-16 | 2024-05-17 | 哈尔滨工业大学（威海） | Heterogeneous robot and textile equipment information fusion interface calling device and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114827306B (en) | 2024-01-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114827306A (en) | Multi-source heterogeneous industrial protocol message analysis method, system, equipment and medium | |
| CN111708860A (en) | Information extraction method, device, equipment and storage medium | |
| CN110933146B (en) | Data conversion method and device and server | |
| CN110263009B (en) | Method, device and equipment for generating log classification rule and readable storage medium | |
| CN106789898B (en) | Remote data transmission terminal, system and coding and decoding method thereof | |
| CN110765195A (en) | Data analysis method and device, storage medium and electronic equipment | |
| CN108153803B (en) | Data acquisition method and device and electronic equipment | |
| WO2024104217A1 (en) | Dbc dynamic adaptive updating method and apparatus, electronic device, and storage medium | |
| CN111597174A (en) | Distributed data statistical processing system, method, storage medium and terminal | |
| CN112860727A (en) | Data query method, device, equipment and medium based on big data query engine | |
| CN114036183A (en) | Data ETL processing method, device, equipment and medium | |
| CN108733688B (en) | Data analysis method and device | |
| CN115062051A (en) | Universal assembly cross-database language query method and system | |
| CN116051069A (en) | Operation and maintenance fault monitoring system modeling method based on knowledge graph and OPC UA protocol | |
| CN115658788A (en) | Real-time data query method and system for Internet of things | |
| AU2017269259A1 (en) | Data driven invocation of real time wind market forecasting analytics | |
| CN107896246A (en) | Message dissemination system based on XBRL | |
| CN113973111A (en) | Data forwarding method and device, gateway equipment and computer readable storage medium | |
| CN111625568A (en) | Big data statistics collection algorithm | |
| CN111178025A (en) | Editing method and device of nuclear power plant operation guide rules, computer equipment and storage medium | |
| CN113836211B (en) | Data extraction method for accessing data of internet of things equipment to JAVA platform | |
| CN112241416A (en) | System and method for constructing complex sql statement by using python syntax semantics | |
| CN117453836A (en) | Industrial real-time data warehouse system based on Flink | |
| CN116303420A (en) | Method for tracing and analyzing parent-child batch in semiconductor industry based on tree diagram | |
| CN117675965A (en) | Message processing and analyzing method for internet of things data center |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |