CN109617654B - Data transmission method and data aggregation analysis device for industrial internet big data service system - Google Patents

Data transmission method and data aggregation analysis device for industrial internet big data service system Download PDF

Info

Publication number
CN109617654B
CN109617654B CN201811539335.5A CN201811539335A CN109617654B CN 109617654 B CN109617654 B CN 109617654B CN 201811539335 A CN201811539335 A CN 201811539335A CN 109617654 B CN109617654 B CN 109617654B
Authority
CN
China
Prior art keywords
data
bits
field
header
acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811539335.5A
Other languages
Chinese (zh)
Other versions
CN109617654A (en
Inventor
何泰霖
史玉洁
袁志远
吴恺
喻勋勋
陈亮
欧阳少海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Flying Enterprise Internet Technology Co Ltd
Original Assignee
Guangdong Flying Enterprise Internet Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Flying Enterprise Internet Technology Co Ltd filed Critical Guangdong Flying Enterprise Internet Technology Co Ltd
Priority to CN201811539335.5A priority Critical patent/CN109617654B/en
Publication of CN109617654A publication Critical patent/CN109617654A/en
Application granted granted Critical
Publication of CN109617654B publication Critical patent/CN109617654B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22Parsing or analysis of headers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/0001Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0006Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission format
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/004Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0056Systems characterized by the type of code used
    • H04L1/0061Error detection codes

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention discloses an industrial internet big data service platform system and a service method thereof, creatively introduces a specific data header in the data transmission process to set and manage an industrial control internet big data service system and a platform, the mark field, the FE device field, the bottom layer response field and the FE type code field can accurately judge and distinguish the processing object parameter type, the acquisition command and control message type and the acquisition combination of different types of the acquired data, and performs fine control and error checking on the slave FE data header through the pre-exclusion field and the post-exclusion field and the FE data header check field, therefore, the task of collecting big data, multiple users and multiple objects can be conveniently and effectively carried out, the problem of consistency of data transmission and processing formats is solved, transmission data is effectively managed, and the management efficiency of a big data system is improved.

Description

Data transmission method and data aggregation analysis device for industrial internet big data service system
Technical Field
The present application relates generally to big data transmission technology, and more particularly, to a data transmission method and a data aggregation analysis apparatus for an industrial internet big data service system.
Background
In terms of enterprises, industrial business chains are long, and a plurality of parts of cooperation are needed in the links from raw material supply, purchasing and warehousing, production inspection and sale, and management efficiency is low and errors are easy to make through a traditional mode, so that a plurality of industrial enterprises have the requirements of building an internet system and optimizing chains to realize informatization cooperation.
The industrial revolution of the enterprise is not rising. Starting from solving the problems and requirements of industrial enterprises, the communication cost between the enterprises and each node such as a supply end, a management end, a production end, a sales end and the like and inside each node is shortened through connection, the error rate is reduced, the communication efficiency is improved, and the like. By creating an enterprise network, the ecological system in the enterprise can be integrally planned and managed, the cooperative operation of different plates in upper, middle and lower reaches, management, research and development, purchasing, production, quality inspection, decision and the like in an enterprise system is effectively promoted, the connection of the ecological system in the enterprise is tighter, and an industrial chain is more optimized.
The big data technology is reasonably applied in the industrial field, so that the enterprise informatization development can be effectively promoted, the enterprise production operation efficiency is improved, the flow of production information in the manufacturing process is accelerated, the enterprise upgrading and transformation are assisted, and a brand-new intelligent manufacturing mode is formed.
Due to the appearance of new infrastructures such as ultra-low-cost sensors, connection and data storage, the development, application and upgrade of new technologies such as the internet of things, big data, artificial intelligence, cloud computing, 5G and chip technology, the service and business model of industrial departments are gradually evolved, and the internet of industrial things is the whole technology and must be crystallized under the background of the industrial progress.
The industrial internet is a product of deep fusion of a new generation of information communication technology and modern industrial technology, is an important carrier for digitalization, networking and intellectualization of manufacturing industry, and is a high point of a new round of industry competition all over the world. The industrial internet realizes comprehensive perception, dynamic transmission and real-time analysis of industrial data by constructing a basic network connecting machines, materials, people and information systems, forms scientific decision and intelligent control, improves the manufacturing resource allocation efficiency, and becomes a new race track for lead enterprises, a new direction of global industrial layout and a new focus for manufacturing competition in the big country. As three major factors of the industrial Internet, the industrial Internet platform is a hub of industrial full-factor link, is the core of industrial resource allocation, and has important significance for exciting the solid economy of China and promoting the manufacturing industry to advance to the middle-high end. The industrial internet platform is an industrial cloud platform which faces the digital, networking and intelligent requirements of the manufacturing industry, constructs a service system based on mass data acquisition, aggregation and analysis, and supports ubiquitous connection, flexible supply and efficient configuration of manufacturing resources. The essence of the method is that a development environment facing industrial large data storage, integration, access, analysis and management is established by constructing an accurate, real-time and efficient data acquisition interconnection system, modeling, standardization, software and multiplexing of industrial technology, experience and knowledge are realized, resource allocation efficiency such as research and development design, production and manufacture, operation and management is continuously optimized, and a manufacturing industry new ecology with resource enrichment, multi-party participation, cooperative win-win and cooperative evolution is formed.
The industrial internet platform has become an important gripper for enterprise intelligent transformation. The intelligent production and management of enterprises can be realized. Through comprehensive acquisition and deep analysis of various data of a 'man-machine material method ring' on a production site, deep reasons causing production bottlenecks and product defects can be found, and the production efficiency and the product quality are continuously improved. Based on the comprehensive analysis of the field data, enterprise planning resources, operation management and other data, more accurate supply chain management and financial management can be realized, and the enterprise operation cost is reduced. But also help enterprises to realize the innovation of production modes and business modes. The enterprise can realize getting through the data of product after-sale use link through the platform, provides novel business modes such as healthy management of equipment, product value-added service, realizes from selling the product to selling the change of service, realizes the value promotion. The platform-based system can also interact with the user more fully, know the personalized requirements of the user, effectively organize production resources and realize higher profit level by means of personalized products. In addition, different enterprises can develop information interaction based on the platform, so that resource and capability aggregation across enterprises, regions and industries is realized, and a more efficient collaborative design, collaborative manufacturing and collaborative service system is created.
However, in the bottom acquisition of the industrial internet, uniform or similar acquisition devices are often adopted for different types of data acquisition in a general manner, the acquired data are not screened and distinguished in advance, and in the data transmission process, the processing object parameter type, the acquisition command and control message type and the acquisition combination of different types of the acquired data cannot be accurately judged and distinguished, so that the large-data multi-user multi-object acquisition task cannot be accurately and effectively carried out, the problems of data transmission and processing format consistency are caused, the transmitted data cannot be effectively managed, and the management efficiency of a large-data system is reduced.
Disclosure of Invention
The application relates to a data transmission method of an industrial internet big data service system, which comprises the steps of finishing data acquisition object grouping, collector grouping, matching acquisition, aggregation and analysis by adopting a data aggregation analysis device of the system; the data processing mapping index device of the system is adopted to finish the rapid processing, swallowing and spitting of the data and the files; extracting and applying a big data processing result set by adopting a result set device of the system, and providing a charging rule for use and deployment; wherein:
the data aggregation analysis device comprises a central control part, a data aggregation part, a data analysis part and at least one collector, wherein the central control part is used for setting 6-bit acquisition ID for the acquired equipment and organizing the collectors according to the type of an adaptive acquisition object manufacturer, the type of the adaptive acquisition object equipment and the type of an adaptive acquisition object system interface;
the central control part organizes a plurality of collected devices with the same collection ID into a group, allocates data collectors matched with the grouping of the collected devices to form a collection group set so as to refine collected data and prevent data identification errors and collection errors between the collectors and the collected devices caused by different types of the collected devices and interface types;
and the data analysis part is used for decapsulating, decrypting and inversely transposing the aggregated data format data sent by the data aggregation part, and analyzing the data to obtain analysis object data.
The aggregating unit aggregates the collected data of each collection group set, packages the data by adopting a data header with a specific format to form a uniform aggregated data format, and sends the aggregated data format to the data analysis component, and specifically comprises:
encapsulating the data header as an FE data header, the FE data header comprising at least the following fields:
a front isolated field: using the field to isolate the upper header;
a mark field: using this field to hint the start position of the FE data header;
FE device field: using the field to distinguish FE collected devices and types thereof;
bottom layer response field: using the field to determine the specific identification of the underlying acquisition group set;
FE type codeword section: using the field to determine a specific type of data message;
post-isolation field: using the field to isolate packet payload; and an FE data header check field.
In another aspect, the present application provides a data aggregation analysis device for an industrial internet big data service system, where the system includes a data aggregation analysis device to complete data collection object grouping, collector grouping, matching collection, aggregation and analysis; the data processing mapping index device is used for finishing the rapid processing and handling of data and files; the result set device is used for extracting and applying the big data processing result set and providing a charging rule for use and deployment; wherein:
the data aggregation analysis device comprises a central control part, a data aggregation part, a data analysis part and at least one collector, wherein the central control part is used for setting 6-bit acquisition ID for the acquired equipment and organizing the collectors according to the type of an adaptive acquisition object manufacturer, the type of the adaptive acquisition object equipment and the type of an adaptive acquisition object system interface;
the central control part organizes a plurality of collected devices with the same collection ID into a group, allocates data collectors matched with the grouping of the collected devices to form a collection group set so as to refine collected data and prevent data identification errors and collection errors between the collectors and the collected devices caused by different types of the collected devices and interface types,
the data aggregation part aggregates the collected data of each collection group set, encapsulates the data by adopting a data datagram in a specific format to form a uniform aggregated data format and sends the uniform aggregated data format to the data analysis part;
and the data analysis part is used for decapsulating, decrypting and inversely transposing the aggregated data format data sent by the data aggregation part, and analyzing the data to obtain analysis object data.
The data aggregation part aggregates the collected data of each collection group set, encapsulates the data by adopting a data header with a specific format to form a uniform aggregated data format, and sends the aggregated data format to the data analysis part, wherein the data aggregation part specifically comprises the following steps:
the data header is an FE data header, and the FE data header at least comprises the following fields:
a front isolated field: using the field to isolate the upper header;
a mark field: using this field to hint the start position of the FE data header;
FE device field: using the field to distinguish FE collected devices and types thereof;
bottom layer response field: using the field to determine the specific identification of the underlying acquisition group set;
FE type codeword section: using the field to determine a specific type of data message;
post-isolation field: using the field to isolate packet payload;
FE data header check field.
The invention provides a data transmission method and a data aggregation analysis device of an industrial Internet big data service system, which creatively introduces an FE data header in the data transmission process for setting and managing an FE industrial control Internet big data service system and a platform, wherein a front isolation field, a mark field, an FE equipment field, a bottom layer response field, an FE type code field, a rear isolation field and an FE data header check field are used for forming the FE data header, the mark field, the FE equipment field, the bottom layer response field and the FE type code field are used for accurately judging and distinguishing the processing object parameter type of the acquired data, the type of the acquisition command and control message and the acquisition combination of different types, and the front isolation field, the rear isolation field and the FE data header check field are used for accurately controlling and checking errors of the slave FE data header, therefore, the task of collecting big data, multiple users and multiple objects can be conveniently and effectively carried out, the problems of data transmission and processing format consistency are solved, the transmission data are effectively managed, and the management efficiency of a big data system is improved.
Drawings
Fig. 1 shows a schematic diagram of a data transmission direction including an FE data header in a data transmission method of an industrial internet big data service system.
Fig. 2 shows the most basic transmission data packet format in the data transmission method of the industrial internet big data service system.
Fig. 3 shows a basic composition format of an FE data header in a data transmission method of an industrial internet big data service system.
Fig. 4 shows a basic composition format of an FE type code field in a data transmission method of an industrial internet big data service system.
Description of the specific embodiments
In order to make the aforementioned objects, features and advantages of the present invention more comprehensible, the present invention is described in further detail with reference to the accompanying drawings and detailed description below:
now, the present patent application will be described in detail with respect to preferred embodiments of a data transmission method and a data aggregation parsing apparatus for an industrial internet big data service system, and a plurality of examples are also provided in the following description. Although the system and method disclosed in this patent application have been described in detail, for the sake of clarity it is apparent that some of the functional components that are not particularly important to an understanding of the system and method may not be shown.
Further, it is to be understood that the systems and methods disclosed in this patent application are not limited to the precise embodiments described below, and that various changes and modifications may be effected therein by one skilled in the art without departing from the spirit or scope thereof. For example, elements and/or features of different exemplary embodiments may be combined with each other and/or substituted for each other within the scope of this disclosure.
Fig. 1 is a schematic diagram illustrating a data transmission direction including an FE data header in a data transmission method of an industrial internet big data service system according to the present patent application. Fig. 2 shows the most basic transmission data packet format in the data transmission method of the industrial internet big data service system. Fig. 3 shows a basic composition format of an FE data header in a data transmission method of an industrial internet big data service system. Referring to fig. 1, 2 and 3, the data transmission method of the industrial internet big data service system includes that a data aggregation analysis device of the system is adopted to complete data acquisition object grouping, collector grouping, matching acquisition, aggregation and analysis; the data processing mapping index device of the system is adopted to finish the rapid processing and handling of data and files; extracting and applying a big data processing result set by adopting a result set device of the system, and providing a charging rule for use and deployment; wherein: the data aggregation analysis device comprises a central control part, a data aggregation part, a data analysis part and at least one collector, wherein the central control part is used for setting 6-bit acquisition ID for the acquired equipment and organizing the collectors according to the type of an adaptive acquisition object manufacturer, the type of the adaptive acquisition object equipment and the type of an adaptive acquisition object system interface; the central control part organizes a plurality of collected devices with the same collection ID into a group, allocates data collectors matched with the grouping of the collected devices to form a collection group set so as to refine the collected data and prevent data identification errors and collection errors between the collectors and the collected devices caused by different types of the collected devices and interface types,
the central control part sets 1 st-2 nd bits of the acquisition ID according to a manufacturer of the acquired equipment; setting 3-5 bits of an acquisition ID according to the type of the equipment to be acquired; and setting the 6 th bit of the acquisition ID according to the type of the system interface of the acquired equipment. The central control unit then assigns acquisition IDs to the respective acquired devices in the platform system.
A collected device ID assignment table is maintained in which the principle and specific manner of each ID assignment is determined, for example, for the requesting vendor "hong kong bao lion", this patent sets the 1 st-2 th vendor identification code of its collection ID to 01, "hai group" to 02, and so on. The central control part inquires each acquisition ID corresponding to the equipment characteristics from the acquired equipment ID distribution table, and after each acquisition ID is obtained, the acquisition IDs are combined into 6 acquisition IDs according to a certain combination mode.
For example, when the collected equipment is industrial production equipment, the 3 rd bit of the collection ID is set to be 1, when the collected equipment is household equipment, the 3 rd bit of the collection ID is set to be 2, and when the collected equipment is industrial control equipment, the 3 rd bit of the collection ID is set to be 3; setting the 4 th bit of the acquisition ID to be 1 when the acquired equipment is manual equipment, setting the 4 th bit of the acquisition ID to be 2 when the acquired equipment is automatic equipment, and setting the 4 th bit of the acquisition ID to be 3 when the acquired equipment is intelligent AI equipment; when the collected device is a virtualization device, the 5 th bit of the collection ID is set to 1, and when the collected device is a physical device, the 5 th bit of the collection ID is set to 2.
And 6-bit ID is allocated to the acquired equipment according to the ID allocation table of the acquired equipment.
The data aggregation part aggregates the acquired data of each acquisition group set, packages the data by adopting a data header with a specific format to form a uniform aggregated data format and sends the uniform aggregated data format to the data analysis part; and the data analysis part is used for decapsulating, decrypting and reversely transposing the aggregated data format data sent by the data aggregation part, and performing data analysis to obtain analysis object data.
Referring to fig. 1, in the data transmission method and the data aggregation and analysis device for the industrial internet big data service system according to the present application, the aggregation is performed on the collected data of each collection group set, a data header with a specific format is used to package the data, so as to form a uniform aggregated data format, and the aggregated data format is sent to a data analysis component, and the specific is as follows: encapsulating the data header as an FE data header, the FE data header comprising at least the following fields: a front isolated field: using the field to isolate the upper header;
a mark field: using this field to hint the start position of the FE data header;
FE device field: using the field to distinguish FE collected devices and types thereof;
bottom layer response field: using the field to determine the specific identification of the underlying acquisition group set;
FE type codeword section: using the field to determine a specific type of data message;
post-isolation field: using the field to isolate packet payload;
FE data header check field.
In one embodiment, the pre-exclusion field is preferably generated according to an algorithm and permutation order based on other types of data headers preceding the FE data header. The method comprises the following steps: truncating other types of data headers before the FE data header, reserving the middle 8+ 1-9 bits when the other types of data headers before the FE data header are odd bits and the bit number is more than 8 bits, inverting the truncated odd bits in the 9 bits, and forming an isolated field with the original even bits in the original 9 bits according to the original sequence; when the other types of data headers before the FE data header are even bits and the bit number is not less than 8 bits, reserving the middle 8 bits, inverting the odd bits in the intercepted 8 bits, and forming an isolation field with the even bits in the original 8 bits according to the original sequence; when the number of bits of the other types of data headers before the FE data header is less than 8 bits, all the data bits are reserved, the odd bits are inverted and combined with the even bits in the original data according to the original sequence, and then the combined bits are copied and are cut off into 8 bits from the first bit to form an isolation field.
In another embodiment, preferably, the post-isolation field is generated according to a certain algorithm and an arrangement order based on the FE packet load. The method comprises the following steps: truncating the FE data packet load, keeping the middle 8+ 1-9 bits when the FE data packet load is odd bits and the bit number is more than 8 bits, inverting the odd bits in the truncated 9 bits, and forming an isolation field with the even bits in the original 9 bits according to the original sequence; when the load of the FE data packet is even number and the number of bits is not less than 8 bits, retaining the middle 8 bits, negating the odd number bits in the intercepted 8 bits, and forming an isolation field with the even number bits in the original 8 bits according to the original sequence; when the load bit number of the FE data packet is less than 8 bits, all data bits are reserved, odd bits are inverted and combined with even bits in the original data according to the original sequence, and then the combination bits are copied and cut off into 8 bits from the first bit to form an isolation field.
In another embodiment, for example, the flag field is specifically: the equipment process batch identifier is converted to binary data and continues 11111110, resulting in the tag field of the FE data header.
Note that in this example, the 11111110 used as the continuation in the tag field is actually a binary representation of the hexadecimal character "FE" for which it was used as a tagging purpose during development of the industrial internet system.
In another embodiment, preferably, the FE device field has 6 bits in total, specifically: setting 1 st-2 nd bits of an equipment field according to a manufacturer of the collected equipment; setting 3-5 bits of an equipment field according to the type of the equipment to be collected; and setting the 6 th bit of the equipment field according to the type of the system interface of the acquired equipment.
The data acquisition is specially set, the acquisition objects are divided into three different fields, 6-bit acquisition IDs are set, the acquisition objects are grouped according to the acquisition ID difference of the acquisition objects, meanwhile, the corresponding collectors are grouped according to the types, and then the collectors grouped correspondingly are matched with the acquisition object equipment grouped by the corresponding IDs one by one, so that the problem of collector adaptation caused by different attributes of the acquisition objects is solved conveniently, exactly and pertinently.
In another embodiment, preferably, the FE bottom layer response field is specifically set as follows: and using binary codes of the device identifications of the same type of acquisition devices in the acquisition group as FE (field of function) bottom-layer response fields to judge a specific bottom-layer acquisition group set.
The device identifications of the same type of acquisition devices in the acquisition group should be designed to be the same value. For example, for an acquisition group set with an acquisition ID of 022312 of an acquired object, the acquisition group set can be converted into a binary system and then polarization-coded, so that the acquisition group set can obtain transmission efficiency close to channel capacity, and after a polarization-coded result and an acquisition ID of 022312 of the acquired object are subjected to binary system and calculation, an equipment identifier of the type of acquisition equipment is obtained;
or, when the system is initialized, a corresponding collector device identifier for collecting a certain type of collected device is set, so as to obtain the device identifier of the type of collected device.
Fig. 4 shows a basic composition format of an FE type code field in a data transmission method of an industrial internet big data service system. In another embodiment, for example, the FE type code field is an optional field, specifically:
WRO: the message retransmission method is used for indicating that the message transmission has errors and needs to be carried out;
UPD: to request or respond to messages related to collector update data;
DEF: the message is used for informing that the message is a message for acquiring related data of the appointed acquisition data;
DEL: a message for deleting the collection group set or a specific collector in the collection group set;
PAT: a message to inform of transmission path errors somewhere from the harvester group up to the parsing component;
and (6) TEST: to test the messages of the collection set.
On the other hand, the application provides a data aggregation analysis device of an industrial internet big data service system, wherein the system where the device is located comprises the data aggregation analysis device, and the data aggregation analysis device is used for completing data acquisition object grouping, collector grouping, matching acquisition, aggregation and analysis; the data processing mapping index device is used for finishing the rapid processing and handling of data and files; the result set device is used for extracting and applying the big data processing result set and providing a charging rule for use and deployment; wherein: the data aggregation analysis device comprises a central control part, a data aggregation part, a data analysis part and at least one collector, wherein the central control part is used for setting 6-bit acquisition ID for the acquired equipment and organizing the collectors according to the type of an adaptive acquisition object manufacturer, the type of the adaptive acquisition object equipment and the type of an adaptive acquisition object system interface; the central control part organizes a plurality of collected devices with the same collection ID into a group, allocates data collectors matched with the grouped devices to form a collection group set so as to refine collected data and prevent data identification errors and collection errors of the collectors and the collected devices caused by different collection device types and interface types; and the data analysis component is used for de-encapsulating, decrypting and reversely inverting the aggregated data format data sent by the data aggregation component, and analyzing the data to obtain the analysis object data.
The data aggregation part aggregates the collected data of each collection group set, encapsulates the data by adopting a data header with a specific format to form a uniform aggregated data format, and sends the aggregated data format to the data analysis part, wherein the data aggregation part specifically comprises the following steps:
the data header is an FE data header, and the FE data header at least comprises the following fields:
a front isolated field: using the field to isolate the upper header;
a mark field: using this field to hint the start position of the FE data header;
FE device field: using the field to distinguish FE collected devices and types thereof;
bottom layer response field: using the field to determine the specific identification of the underlying acquisition group set;
FE type codeword section: using the field to determine a specific type of data message;
post-isolation field: using the field to isolate packet payload;
FE data header check field.
Wherein the pre-exclusion field specifically is: the pre-exclusion field is generated according to an algorithm and an order based on other types of data headers before the FE data header.
The generating of the pre-isolation field based on other types of data headers before the FE data header according to a certain algorithm and a certain arrangement order specifically includes:
truncating other types of data headers before the FE data header, reserving the middle 8+ 1-9 bits when the other types of data headers before the FE data header are odd bits and the bit number is more than 8 bits, inverting the truncated odd bits in the 9 bits, and forming an isolation field with the original even bits in the original 9 bits according to the original sequence;
when the other types of data headers before the FE data header are even bits and the bit number is not less than 8 bits, reserving the middle 8 bits, inverting the odd bits in the intercepted 8 bits, and forming an isolation field with the even bits in the original 8 bits according to the original sequence;
when the number of bits of the other types of data headers before the FE data header is less than 8 bits, all the data bits are reserved, the odd bits are inverted and combined with the even bits in the original data according to the original sequence, then the combination bits are copied, and the combination bits are cut off into 8 bits from the first bit to form an isolation field.
Wherein the post-exclusion field specifically is: and generating the post-isolation field according to a certain algorithm and an arrangement sequence based on the FE data packet load.
The generating of the rear isolation field according to a certain algorithm and an arrangement sequence based on the FE data packet load specifically includes:
truncating the FE data packet load, keeping the middle 8+ 1-9 bits when the FE data packet load is odd bits and the bit number is more than 8 bits, inverting the odd bits in the truncated 9 bits, and forming an isolation field with the even bits in the original 9 bits according to the original sequence;
when the load of the FE data packet is even number and the number of bits is not less than 8 bits, retaining the middle 8 bits, negating the odd number bits in the intercepted 8 bits, and forming an isolation field with the even number bits in the original 8 bits according to the original sequence;
when the load bit number of the FE data packet is less than 8 bits, all data bits are reserved, odd bits are inverted and combined with even bits in the original data according to the original sequence, and then the combination bits are copied, and the combination bits are cut off into 8 bits from the first bit to form an isolation field.
Wherein the tag field is specifically: the device processing batch id is converted into binary data and then 11111110 is carried out to obtain the tag field of the FE data header.
The FE device field has 6 bits in total, and specifically includes:
setting 1 st-2 nd bits of an equipment field according to a manufacturer of the collected equipment;
setting 3-5 bits of an equipment field according to the type of the equipment to be collected;
and setting the 6 th bit of the equipment field according to the type of the system interface of the acquired equipment.
The FE bottom layer response field specifically includes: and using binary codes of the device identifications of the same type of acquisition devices in the acquisition group as FE (field of function) bottom-layer response fields to judge a specific bottom-layer acquisition group set.
The FE type code field is an optional field, and specifically includes:
WRO: the message retransmission method is used for indicating that the message transmission has errors and needs to be carried out;
UPD: to request or respond to messages related to collector update data;
DEF: the message is used for informing that the message is a message for acquiring related data of the appointed acquisition data;
DEL: a message for deleting the collection group set or a specific collector in the collection group set;
PAT: a message to inform of transmission path errors somewhere from the harvester group up to the parsing component;
and (6) TEST: to test the messages of the collection set.
In another embodiment, the service platform system further comprises a data processing image index layer comprising: the first interface is used for connecting with a database, processing the initialization process of the database, establishing a logic data table, data table association, a data main key and a data inclusion item, and defining data query and data modification principles; the second interface is connected with a user and used for accessing the data processing mapping index layer, inquiring and modifying the analysis object data and setting a data inquiring and modifying principle; a first data mapping index generating component, configured to establish a data storage grid when a data processing mapping index layer processes and stores data, and establish a data mapping index grid at the same time, where the data mapping index grid corresponds to a data storage grid structure one to one, and when a platform bottom storage medium generates the data storage grid structure, the mapping index grid is also generated; and the first data mapping index operation part is used for acquiring a corresponding processing task according to user operation and acquiring a corresponding mapping index grid node according to processing task data so as to acquire a corresponding data storage grid structure node according to the corresponding relation between the mapping index grid and the data storage grid, and fragmenting the task, handing the task to the corresponding storage grid structure node for processing and returning processing result data.
In addition, the service platform system also comprises a result set layer which comprises a first data extraction part, wherein the first data extraction part comprises a processing result detection device which is used for detecting the result data set processed by the storage grid structure node and classifying the result data set according to the storage grid structure; and the first service providing component is used for classifying the result data set extracted by the first data extraction component according to the service deployment mode, and distributing the result data set to the service providing components of corresponding classes after load balancing.
And a first billing service section for billing the service-provided party by a service time (S) by service unit (U) by service weight coefficient, wherein the service weight coefficient is obtained by weighting and calculating the same collection ID of the collection group set.
In all the above embodiments, to meet the requirements of some special read/write functions, the central control unit, the data aggregation unit, the data analysis unit, the at least one collector, the data processing image index layer unit, the first data extraction unit, the first service providing unit, and the first billing service unit may add hardware, pin connections, or memory differences to expand the functions.
While various embodiments have been shown and described with particular reference thereto, it should be noted that various other changes and modifications can be made without departing from the scope of the invention.

Claims (14)

1. A data transmission method of an industrial Internet big data service system comprises the steps of adopting a data aggregation analysis device of the system to finish data acquisition object grouping, collector grouping, matching acquisition, aggregation and analysis; the data processing mapping index device of the system is adopted to finish the rapid processing and handling of data and files; extracting and applying a big data processing result set by adopting a result set device of the system, and providing a charging rule for use and deployment; wherein:
the data aggregation analysis device comprises a central control part, a data aggregation part, a data analysis part and at least one collector, wherein the central control part is used for setting 6-bit acquisition ID for the acquired equipment and grouping the collectors according to the type of an adaptive acquisition object manufacturer, the type of the adaptive acquisition object equipment and the type of an adaptive acquisition object system interface;
the central control part organizes a plurality of collected devices with the same collection ID into a group, allocates data collectors matched with the grouping of the collected devices to form a collection group set so as to refine the collected data and prevent data identification errors and collection errors between the collectors and the collected devices caused by different types of the collected devices and interface types,
the data aggregation part aggregates the collected data of each collection group set, encapsulates the data by adopting a data datagram in a specific format to form a uniform aggregated data format and sends the uniform aggregated data format to the data analysis part;
the data analysis component is used for decapsulating, decrypting and reversely transposing the aggregated data format data sent by the data aggregation component, and analyzing the data to obtain analysis object data;
the aggregation of the collected data of each collection group set, the encapsulation of the data by using a data header with a specific format to form a uniform aggregated data format, and the transmission of the aggregated data format to a data analysis component specifically comprises the following steps:
encapsulating the data header as an FE data header, the FE data header comprising at least the following fields:
a front isolated field: using the field to isolate the upper header;
a mark field: using this field to hint the start position of the FE data header;
FE device field: using the field to distinguish FE collected devices and types thereof;
bottom layer response field: using the field to determine the specific identification of the underlying acquisition group set;
FE type codeword section: using the field to determine a specific type of data message;
post-isolation field: using the field to isolate packet payload;
FE data header check field;
wherein the pre-exclusion field specifically is: generating the front isolated field according to a certain algorithm and an arrangement sequence based on other types of data headers before the FE data header;
the generating the previous isolated field based on other types of data headers before the FE data header according to a certain algorithm and a certain sequence specifically includes:
truncating other types of data headers before the FE data header, reserving the middle 8+ 1-9 bits when the other types of data headers before the FE data header are odd bits and the bit number is more than 8 bits, inverting the truncated odd bits in the 9 bits, and forming an isolation field with the original even bits in the original 9 bits according to the original sequence;
when the other types of data headers before the FE data header are even bits and the bit number is not less than 8 bits, reserving the middle 8 bits, inverting the odd bits in the intercepted 8 bits, and forming an isolation field with the even bits in the original 8 bits according to the original sequence;
when the number of bits of the other types of data headers before the FE data header is less than 8 bits, all the data bits are reserved, the odd bits are inverted and combined with the even bits in the original data according to the original sequence, and then the combined bits are copied and are cut off into 8 bits from the first bit to form an isolation field.
2. The data transmission method of claim 1, wherein the postcursor-off field is specifically: and generating the post-isolation field according to a certain algorithm and an arrangement sequence based on the FE data packet load.
3. The data transmission method according to claim 2, wherein the generating the postbarrier field according to a certain algorithm and an arrangement order based on the FE packet load specifically includes:
truncating the FE data packet load, keeping the middle 8+ 1-9 bits when the FE data packet load is odd bits and the bit number is more than 8 bits, inverting the odd bits in the truncated 9 bits, and forming an isolation field with the even bits in the original 9 bits according to the original sequence;
when the load of the FE data packet is even number and the number of bits is not less than 8 bits, retaining the middle 8 bits, negating the odd number bits in the intercepted 8 bits, and forming an isolation field with the even number bits in the original 8 bits according to the original sequence;
when the load bit number of the FE data packet is less than 8 bits, all data bits are reserved, the odd bits are inverted and combined with the even bits in the original data according to the original sequence, and then the combination bits are copied, and the combination bits are cut off into 8 bits from the first bit to form an isolation field.
4. The data transmission method according to claim 3, wherein the flag field is specifically: the device process lot id is converted to binary data and then 11111110, resulting in the tag field of the FE data header.
5. The data transmission method according to claim 4, wherein the FE device field has 6 bits in total, and specifically comprises:
setting 1 st-2 nd bits of an equipment field according to a manufacturer of the collected equipment;
setting 3-5 bits of an equipment field according to the type of the equipment to be collected;
and setting the 6 th bit of the equipment field according to the type of the system interface of the acquired equipment.
6. The data transmission method according to claim 5, wherein the FE bottom layer response field specifically includes:
and using binary codes of the device identifications of the same type of acquisition devices in the acquisition group as FE (field of function) bottom-layer response fields to judge a specific bottom-layer acquisition group set.
7. The transmission method according to claim 6, wherein the FE type code field is an optional field, and specifically comprises:
WRO: the message retransmission method is used for indicating that the message transmission has errors and needs to be carried out;
UPD: to request or respond to messages related to collector update data;
DEF: the message is used for informing that the message is a message for acquiring related data of the appointed acquisition data;
DEL: a message for deleting the collection group set or a specific collector in the collection group set;
PAT: a message to inform of transmission path errors somewhere from the harvester group up to the parsing component;
and (6) TEST: to test the messages of the collection set.
8. A data aggregation analysis device of an industrial Internet big data service system comprises a data aggregation analysis device, a data acquisition object grouping device and a data acquisition object grouping device, wherein the data aggregation analysis device completes data acquisition object grouping, matching acquisition, aggregation and analysis; the data processing mapping index device is used for finishing the rapid processing and handling of data and files; the result set device is used for extracting and applying the big data processing result set and providing a charging rule for use and deployment; wherein:
the data aggregation analysis device comprises a central control part, a data aggregation part, a data analysis part and at least one collector, wherein the central control part is used for setting 6-bit acquisition ID for the acquired equipment and grouping the collectors according to the type of an adaptive acquisition object manufacturer, the type of the adaptive acquisition object equipment and the type of an adaptive acquisition object system interface;
the central control part organizes a plurality of collected devices with the same collection ID into a group, allocates data collectors matched with the grouping of the collected devices to form a collection group set so as to refine the collected data and prevent data identification errors and collection errors between the collectors and the collected devices caused by different types of the collected devices and interface types,
the data aggregation part aggregates the collected data of each collection group set, encapsulates the data by adopting a data datagram in a specific format to form a uniform aggregated data format and sends the uniform aggregated data format to the data analysis part; the data analysis component is used for decapsulating, decrypting and reversely transposing the aggregated data format data sent by the data aggregation component, and analyzing the data to obtain analysis object data;
the data aggregation part aggregates the collected data of each collection group set, encapsulates the data by adopting a data header with a specific format to form a uniform aggregated data format, and sends the aggregated data format to the data analysis part, wherein the data aggregation part specifically comprises the following steps: the data header is an FE data header, and the FE data header at least comprises the following fields:
a front isolated field: using the field to isolate the upper header;
a mark field: using this field to hint the start position of the FE data header;
FE device field: using the field to distinguish FE collected devices and types thereof;
bottom layer response field: using the field to determine the specific identification of the underlying acquisition group set;
FE type codeword section: using the field to determine a specific type of data message;
post-isolation field: using the field to isolate packet payload;
FE data header check field;
the front isolation field specifically comprises: generating the front isolated field according to a certain algorithm and an arrangement sequence based on other types of data headers before the FE data header;
the generating the previous isolated field based on other types of data headers before the FE data header according to a certain algorithm and a certain sequence specifically includes:
truncating other types of data headers before the FE data header, reserving the middle 8+ 1-9 bits when the other types of data headers before the FE data header are odd bits and the bit number is more than 8 bits, inverting the truncated odd bits in the 9 bits, and forming an isolation field with the original even bits in the original 9 bits according to the original sequence;
when the other types of data headers before the FE data header are even bits and the bit number is not less than 8 bits, reserving the middle 8 bits, inverting the odd bits in the intercepted 8 bits, and forming an isolation field with the even bits in the original 8 bits according to the original sequence;
when the number of bits of the other types of data headers before the FE data header is less than 8 bits, all the data bits are reserved, the odd bits are inverted and combined with the even bits in the original data according to the original sequence, and then the combined bits are copied and are cut off into 8 bits from the first bit to form an isolation field.
9. The apparatus according to claim 8, wherein the post exclusion field is specifically: and generating the post-isolation field according to a certain algorithm and an arrangement sequence based on the FE data packet load.
10. The data aggregation analysis device according to claim 9, wherein the generating the post-exclusion field according to a certain algorithm and an arrangement order based on the FE packet load specifically includes:
truncating the FE data packet load, keeping the middle 8+ 1-9 bits when the FE data packet load is odd bits and the bit number is more than 8 bits, inverting the odd bits in the truncated 9 bits, and forming an isolation field with the even bits in the original 9 bits according to the original sequence;
when the load of the FE data packet is even number and the number of bits is not less than 8 bits, retaining the middle 8 bits, negating the odd number bits in the intercepted 8 bits, and forming an isolation field with the even number bits in the original 8 bits according to the original sequence;
when the load bit number of the FE data packet is less than 8 bits, all data bits are reserved, the odd bits are inverted and combined with the even bits in the original data according to the original sequence, and then the combination bits are copied, and the combination bits are cut off into 8 bits from the first bit to form an isolation field.
11. The data aggregation resolution device according to claim 10, wherein the tag field is specifically:
the device process lot id is converted to binary data and then 11111110, resulting in the tag field of the FE data header.
12. The apparatus according to claim 11, wherein the FE device field has 6 bits in total, and specifically includes:
setting 1 st-2 nd bits of an equipment field according to a manufacturer of the collected equipment;
setting 3-5 bits of an equipment field according to the type of the equipment to be collected;
and setting the 6 th bit of the equipment field according to the type of the system interface of the acquired equipment.
13. The data aggregation resolution device according to claim 12, wherein the FE bottom layer response field specifically is:
and using binary codes of the device identifications of the same type of acquisition devices in the acquisition group as FE (field of function) bottom-layer response fields to judge a specific bottom-layer acquisition group set.
14. The apparatus according to claim 13, wherein the FE type code field is an optional field, and specifically includes:
WRO: the message retransmission method is used for indicating that the message transmission has errors and needs to be carried out;
UPD: to request or respond to messages related to collector update data;
DEF: the message is used for informing that the message is a message for acquiring related data of the appointed acquisition data;
DEL: a message for deleting the collection group set or a specific collector in the collection group set;
PAT: a message to inform of transmission path errors somewhere from the harvester group up to the parsing component;
and (6) TEST: to test the messages of the collection set.
CN201811539335.5A 2018-12-14 2018-12-14 Data transmission method and data aggregation analysis device for industrial internet big data service system Active CN109617654B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811539335.5A CN109617654B (en) 2018-12-14 2018-12-14 Data transmission method and data aggregation analysis device for industrial internet big data service system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811539335.5A CN109617654B (en) 2018-12-14 2018-12-14 Data transmission method and data aggregation analysis device for industrial internet big data service system

Publications (2)

Publication Number Publication Date
CN109617654A CN109617654A (en) 2019-04-12
CN109617654B true CN109617654B (en) 2021-03-05

Family

ID=66010157

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811539335.5A Active CN109617654B (en) 2018-12-14 2018-12-14 Data transmission method and data aggregation analysis device for industrial internet big data service system

Country Status (1)

Country Link
CN (1) CN109617654B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110336698A (en) * 2019-07-05 2019-10-15 精英数智科技股份有限公司 A kind of failure data analyzing method, server and storage medium
CN116186613B (en) * 2023-05-04 2023-07-18 利维智能(深圳)有限公司 Intelligent acquisition processing method and system for industrial Internet data

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101194482A (en) * 2003-08-13 2008-06-04 高通股份有限公司 Signal interface for higher data rates
CN102497427A (en) * 2011-12-13 2012-06-13 山东省建筑科学研究院 Method and device for realizing data acquisition services of renewable energy source monitoring system
CN106094777A (en) * 2016-08-26 2016-11-09 北京航空航天大学 A kind of industry internet Hub device
CN106169988A (en) * 2016-02-26 2016-11-30 北京元心科技有限公司 The method transmitting data in cruising inspection system
CN107483372A (en) * 2017-08-31 2017-12-15 杭州京宁自动化技术有限公司 Data transmission method and system based on industrial Internet of things
CN108462754A (en) * 2018-03-28 2018-08-28 西安西电电气研究院有限责任公司 A kind of industry internet framework and implementation method
CN108737539A (en) * 2018-05-18 2018-11-02 济南浪潮高新科技投资发展有限公司 A method of it is serviced based on industry internet platform IOT Hub
US10148680B1 (en) * 2015-06-15 2018-12-04 ThetaRay Ltd. System and method for anomaly detection in dynamically evolving data using hybrid decomposition

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140147583A (en) * 2013-06-20 2014-12-30 한국전자통신연구원 Apparatus for preventing illegal access of industrial control system and method thereof

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101194482A (en) * 2003-08-13 2008-06-04 高通股份有限公司 Signal interface for higher data rates
CN102497427A (en) * 2011-12-13 2012-06-13 山东省建筑科学研究院 Method and device for realizing data acquisition services of renewable energy source monitoring system
US10148680B1 (en) * 2015-06-15 2018-12-04 ThetaRay Ltd. System and method for anomaly detection in dynamically evolving data using hybrid decomposition
CN106169988A (en) * 2016-02-26 2016-11-30 北京元心科技有限公司 The method transmitting data in cruising inspection system
CN106094777A (en) * 2016-08-26 2016-11-09 北京航空航天大学 A kind of industry internet Hub device
CN107483372A (en) * 2017-08-31 2017-12-15 杭州京宁自动化技术有限公司 Data transmission method and system based on industrial Internet of things
CN108462754A (en) * 2018-03-28 2018-08-28 西安西电电气研究院有限责任公司 A kind of industry internet framework and implementation method
CN108737539A (en) * 2018-05-18 2018-11-02 济南浪潮高新科技投资发展有限公司 A method of it is serviced based on industry internet platform IOT Hub

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Development of an Internet of Things Gateway Applied to a Multimask Industrial Plant;Fabricio Tietz;《2018 13th IEEE International Conference on Industry Applications (INDUSCON)》;20181112;全文 *
面向工业大数据的数据采集系统;谢青松;《中国优秀硕士学位论文全文数据库信息科技辑》;20180115;第I140-796页 *

Also Published As

Publication number Publication date
CN109617654A (en) 2019-04-12

Similar Documents

Publication Publication Date Title
TWI742980B (en) Computerized system for application programming interface migration and computer-implemented method for application programming interface migration
CN105677648B (en) A kind of Combo discovering method and system based on label propagation algorithm
CN107003906A (en) The type of cloud computing technology part is to type analysis
CN106301829A (en) A kind of method and apparatus of Network dilatation
CN109656997B (en) Industrial internet big data service platform system and service method
CN109617654B (en) Data transmission method and data aggregation analysis device for industrial internet big data service system
CN110889656B (en) Warehouse rule configuration method and device
CN104331772A (en) Process management method and system of cloud data center for achieving resource examination and approval
CN107515857A (en) Semantic understanding method and system based on customization technical ability
CN114663143B (en) Intervention user screening method and device based on differential intervention response model
CN110347593A (en) Flow testing method and device
Larrinaga et al. Node-red workflow manager for edge service orchestration
CN108711074B (en) Service classification method, device, server and readable storage medium
CN107623555B (en) Method and device for realizing universal communication simulation platform
EP4418179A1 (en) Microservices-architecture-based full-lifecycle management system for new-energy power generation devices
CN109669777B (en) Industrial internet big data element demand service providing method and system
CN106357418A (en) Method and device for extracting features on basis of complex networks
CN108446815A (en) A kind of manufacturing capacity modeling method based on cloud manufacturing recourses
CN111431664A (en) Dispatching data packet download method and device based on JSON data protocol
CN109739910B (en) Method and system for managing openness label
CN107844536A (en) The methods, devices and systems of application program selection
CN101877866A (en) Method and device for detecting mobile terminal model capability
CN113590348B (en) Parameter transmission method, device, equipment and medium based on tree structure
CN105590232A (en) Client relation generation method and apparatus, and electronic device
CN108196844A (en) Information processing method, device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Industrial Internet Big Data Service System Data Transmission Method and Data Aggregation and Analysis Device

Granted publication date: 20210305

Pledgee: Bank of Communications Ltd. Zhuhai branch

Pledgor: GUANGDONG FLYING ENTERPRISE INTERNET TECHNOLOGY Co.,Ltd.

Registration number: Y2024980000817

PE01 Entry into force of the registration of the contract for pledge of patent right