CN109617654A - Industry internet big data service system data transmission method and data aggregate resolver - Google Patents

Industry internet big data service system data transmission method and data aggregate resolver Download PDF

Info

Publication number
CN109617654A
CN109617654A CN201811539335.5A CN201811539335A CN109617654A CN 109617654 A CN109617654 A CN 109617654A CN 201811539335 A CN201811539335 A CN 201811539335A CN 109617654 A CN109617654 A CN 109617654A
Authority
CN
China
Prior art keywords
data
field
acquisition
datagram header
header
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811539335.5A
Other languages
Chinese (zh)
Other versions
CN109617654B (en
Inventor
何泰霖
史玉洁
袁志远
吴恺
喻勋勋
陈亮
欧阳少海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZHUHAI FLYRISE SOFTWARE CO Ltd
Original Assignee
ZHUHAI FLYRISE SOFTWARE CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZHUHAI FLYRISE SOFTWARE CO Ltd filed Critical ZHUHAI FLYRISE SOFTWARE CO Ltd
Priority to CN201811539335.5A priority Critical patent/CN109617654B/en
Publication of CN109617654A publication Critical patent/CN109617654A/en
Application granted granted Critical
Publication of CN109617654B publication Critical patent/CN109617654B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22Parsing or analysis of headers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/0001Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0006Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission format
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/004Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0056Systems characterized by the type of code used
    • H04L1/0061Error detection codes

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The present invention discloses a kind of industry internet big data service platform system and its method of servicing, specific data header is introduced in data transmission procedure in a creative way to be arranged and manage Industry Control internet big data service system and platform, pass through tag field therein, FE device field (DFLD), bottom response field, FE type code field is accurately to the process object parameter type of acquisition data, acquisition and control message type, different types of acquisition combination is determined and is distinguished, and by completely cutting off field and FE datagram header check field is accurately controlled from FE datagram header this and error checking after preceding isolation field, so as to convenient, the acquisition tasks of the multipair elephant of big data multi-user are effectively performed, solve data transmission, processing format consistency problem, effectively management transmits data and promotes big data System administration efficiency.

Description

Industry internet big data service system data transmission method and data aggregate parse Device
Technical field
Patent application relates generally to big data transmission technologys, relate more specifically to a kind of industry internet big data Service system data transmission method and data aggregate resolver.
Background technique
For enterprise, industrial business chain is long, from raw material supply, buying storage to production testing, then arrives sale ring Section, needs multiparty collaboration, and is managed low efficiency, error-prone by traditional approach, therefore there are construction in many industrial enterprises mutually Networking system, optimization chain realize the demand of Informatization Cooperative.
The industrial change of enterprise is in the ascendant.From industrial enterprise itself and demand is solved the problems, such as, pass through " connection " Shorten each node such as enterprise and feed end, management end, the manufacturing side, sales end between and each intra-node communication at This, reduces error rate, promotes communication efficiency etc..By making enterprise network, integrated planning pipe can be carried out to enterprises ecology Reason effectively pushes upper, middle and lower trip in enterprise system, the association of the difference plate such as management, research and development, buying, production, quality inspection, decision Same operation allows enterprises ecosystem to contact more closely, and industry chain (supply chain) more optimizes.
Enterprise informatization evolution reasonably can be effectively facilitated with big data technology in industrial circle, it is raw to promote enterprise It produces operational efficiency, production information flowing in the fabrication process, power-assisted enterprise upgrading is accelerated make the transitions and form completely new intelligence to make Modeling formula.
It is superposition Internet of Things, big due to the appearance of the new infrastructure such as the sensor of Ultra Low Cost, connection and data storage Data, artificial intelligence, cloud computing, 5G, the development of the new technologies such as chip technology, application and upgrading, the service of industrial department and quotient Industry mode is also gradually evolved, and industrial Internet of Things is entire science and technology, the necessarily crystallization under industrial progress background.
Industry internet is the product of the generation information communication technology Yu modern industrial technology depth integration, is manufacturing industry number Word, networking, intelligentized important carrier, and the commanding elevation of global new round inter-industry competition.Industry internet passes through structure Build connection machine, material, people, information system basic network, he realizes the complete perception of industrial data, dynamic transmission, in real time point Analysis forms science decision and intelligent control, improves manufacturing resource allocation efficiency, just as the new racing track of leading competition among enterprises, complete The new focus that the new direction of ball industrial pattern, manufacture big country compete.As the big element of industry internet three, industry internet platform Be the hinge of industrial total factor link, be the core of industrial resources configuration, for development China real economy, push manufacturing industry to Middle and high end, which strides forward, to be of great significance.Industry internet platform is the digitlization of Facing to Manufacturing industry, networking, intelligent demand, structure Build the service system based on mass data collection, convergence, analysis, the ubiquitous connection of support manufacturing recourses, elastic supply, high-efficient disposition Industrial cloud platform.Its essence is to acquire interconnection system by constructing accurate, real-time, efficient data, is established towards industrial big Data storage, integrated, access, analysis, management exploitation environment, realize industrial technology, experience, the modelling of knowledge, standardization, Software implementation, multiplexingization, continue to optimize the Allocation Efficiencies such as R & D design, the manufacturing, operation management, formed resource concentration, Multi-party participation, win-win cooperation, synergistic evolution manufacturing industry nascent state.
Industry internet platform has become the important handgrip of enterprise intelligentization transition.Enterprise can be helped to realize intelligent metaplasia It produces and manages.By to production scene " man-machine material method ring " Various types of data it is comprehensive acquisition and depth analysis, it can be found that causing The profound cause of production bottleneck and product defects, constantly upgrades the efficiency and product quality.Based on field data and enterprise The comprehensive analysis for planning the data such as resource, operation management, can be realized more accurately supply chain management and financial management, reduce Operation cost of enterprises.Enterprise can be helped to realize production method and business model innovation again.Enterprise may be implemented by platform to production Product are got through using the data of link after sale, provide the new business modes such as equipment health control, product value-added service, realize from The transformation of product to the service of selling is sold, realized value is promoted.It can also more fully be interacted with user based on platform, Users ' individualized requirement is solved, and effectively organizes resources of production, realizes that more high profit is horizontal by personalized product.In addition, different Enterprise is also based on platform and carries out information exchange, and realization is gathered across enterprise, trans-regional, inter-trade resource and ability, made More efficient collaborative design, Collaborative Manufacturing, cooperation with service system.
But in the bottom acquisition of industry internet, to the acquisition of different types of data often broadly using unified or phase Close acquisition equipment does not have earlier examination and differentiation to acquisition data, and in data transmission procedure, can not be accurately Process object parameter type, acquisition and the control message type of acquisition data, different types of acquisition combination are sentenced Fixed and differentiation, so that the acquisition tasks of the multipair elephant of big data multi-user cannot be carried out accurately and efficiently, data is caused to be transmitted, Processing format consistency problem, and transmission data can not be effectively managed, reduce big data system administration efficiency.
Summary of the invention
This application involves a kind of data transmission methods of industry internet big data service system, including using system Data aggregate resolver, the marshalling of data acquisition object, collector marshalling, matching acquisition, polymerization and parsing;Using system The data processing image index device of system, completes data and the quick of file handles and handle up;Using the result packaging of system It sets, carries out big data processing result collection and extract and apply, and provide to the charging regulation for using deployment;Wherein:
Data aggregate resolver include central control unit, data aggregate component, data analysis portion part and at least one Collector, central control unit are that collected equipment carries out 6 acquisition ID settings, and according to be adapted to acquisition target vendor types, Adaptation acquisition target device type, adaptation acquisition target system interface type are that collector is organized into groups;
It is one group that the central control unit, which compiles multiple collected equipment with identical acquisition ID, and distribution is compiled with it The compatible data collector of group, composition acquisition group set are prevented with refining acquisition data because of collection device type, interface Collector caused by type is different polymerize each with collected device data identification mistake and acquisition mistake, data aggregate component The acquisition data of acquisition group set are packaged processing to data using the datagram header of specific format, form unified polymerization Data format is sent to data analysis portion part;
Data analysis portion part decapsulates the aggregated data formatted data that the data aggregate component is sent, is solved Close, reverse sets, and carries out data parsing, obtains analysis object data.
The wherein acquisition data of each acquisition group set of the polymerization, using specific format datagram header to data into Row encapsulation process forms unified aggregated data format, is sent to data analysis portion part, specifically:
Encapsulating the datagram header is FE datagram header, and the FE datagram header includes at least following field:
Preceding isolation field: using the field to completely cut off upper layer packet header;
Tag field: the initial position using the field to prompt FE datagram header;
FE device field (DFLD): equipment and its type are collected to distinguish FE using the field;
Bottom response field: using the field to judge being specifically identified for acquisition group set described in bottom;
FE type code field: the concrete type using the field to determine data-message;
After completely cut off field: using the field to completely cut off packet load;And FE datagram header check field.
On the other hand, this application provides a kind of parsings of the data aggregate of industry internet big data service system to fill It sets, the system comprises data aggregate resolver, the marshalling of data acquisition object, matching acquisition, gathers at collector marshalling It closes and parses;Data processing image index device, completes data and the quick of file handles and handle up;As a result acquisition means carry out Big data processing result collection extracts and application, and provides to the charging regulation for using deployment;Wherein:
Data aggregate resolver include central control unit, data aggregate component, data analysis portion part and at least one Collector, central control unit are that collected equipment carries out 6 acquisition ID settings, and according to be adapted to acquisition target vendor types, Adaptation acquisition target device type, adaptation acquisition target system interface type are that collector is organized into groups;
It is one group that the central control unit, which compiles multiple collected equipment with identical acquisition ID, and distribution is compiled with it The compatible data collector of group, composition acquisition group set are prevented with refining acquisition data because of collection device type, interface Collector caused by type is different and collected device data identification mistake and acquisition mistake,
Data aggregate component polymerize the acquisition data of each acquisition group set, using the datagram header logarithm of specific format According to processing is packaged, unified aggregated data format is formed, data analysis portion part is sent to;
Data analysis portion part decapsulates the aggregated data formatted data that the data aggregate component is sent, is solved Close, reverse sets, and carries out data parsing, obtains analysis object data.
The wherein data aggregate component polymerize the acquisition data of each acquisition group set, using the data of specific format Header is packaged processing to data, forms unified aggregated data format, is sent to data analysis portion part, specifically:
The datagram header is FE datagram header, and the FE datagram header includes at least following field:
Preceding isolation field: using the field to completely cut off upper layer packet header;
Tag field: the initial position using the field to prompt FE datagram header;
FE device field (DFLD): equipment and its type are collected to distinguish FE using the field;
Bottom response field: using the field to judge being specifically identified for acquisition group set described in bottom;
FE type code field: the concrete type using the field to determine data-message;
After completely cut off field: using the field to completely cut off packet load;
FE datagram header check field.
Industry internet big data service system data transmission method provided by the present invention and data aggregate resolver, FE datagram header is introduced in data transmission procedure in a creative way, to be arranged and manage the big number in FE Industry Control internet According to service system and platform, wherein use preceding isolation field, tag field, FE device field (DFLD), bottom response field, FE type Code field, rear isolation field and FE datagram header check field form FE datagram header, pass through tag field therein, FE Device field (DFLD), bottom response field, FE type code field accurately order the process object parameter type of acquisition data, acquisition It enables and control message type, different types of acquisition combination is determined and distinguished, and by completely cutting off field after preceding isolation field And FE datagram header check field is accurately controlled from FE datagram header this and error checking, so as to facilitate, The acquisition tasks of the multipair elephant of big data multi-user are effectively performed, solve data transmission, processing format consistency problem, effectively Management transmission data simultaneously promote big data system administration efficiency.
Detailed description of the invention
Fig. 1 shows the number in the data transmission method of industry internet big data service system comprising FE datagram header According to transmission direction schematic diagram.
Fig. 2 shows transmission data packets most basic in the data transmission method of industry internet big data service system Format.
Fig. 3 shows basic group of FE datagram header in the data transmission method of industry internet big data service system At format.
Fig. 4 shows the basic of FE type code field in the data transmission method of industry internet big data service system Form format.
Specific embodiment description
To keep the above objects, features and advantages of the present invention more obvious and easy to understand, with reference to the accompanying drawing and specific embodiment party The present invention is described in further detail for formula:
Present patent application is described in detail now about industry internet big data service system data transmission method and data It polymerize the preferred embodiment of resolver, also provides multiple examples in the following description.Although this patent Shen is described in detail Please disclosed system and method, but for the sake of clarity, it is clear that for those skilled in the art understand that the system and method Non-specifically important some functional components may not be shown.
Further, it is understood that system and method disclosed in present patent application are not limited to as described below definitely in fact Example is applied, can realize various changes in without departing from its spirit or range is claimed in the case where by those skilled in the art And modification.For example, within the scope of this disclosure, the element and/or functional component of different exemplary embodiments can be tied each other It closes and/or is replaced mutually.
Fig. 1 is shown according in a kind of data transmission method of industry internet big data service system of present patent application Data transfer direction schematic diagram comprising FE datagram header.Fig. 2 shows the data of industry internet big data service system biographies Most basic transmission data packet format in transmission method.Fig. 3 shows the transmission side data of industry internet big data service system The basic composition format of FE datagram header in method.Referring to Figures 1 and 2, Fig. 3, the number of the industry internet big data service system According to transmission method, including the data aggregate resolver using system, the marshalling of data acquisition object, collector marshalling, With acquisition, polymerization and parsing;Using the data processing image index device of system, complete data and file quick processing and It handles up;It using the result acquisition means of system, carries out big data processing result collection and extracts and application, and provide to using deployment Charging regulation;Wherein: data aggregate resolver include central control unit, data aggregate component, data analysis portion part with extremely A few collector, central control unit are 6 acquisition ID settings of collected equipment progress, and according to adaptation acquisition target factory Quotient's type, adaptation acquisition target device type, adaptation acquisition target system interface type are that collector is organized into groups;In described It is one group that heart control unit, which compiles multiple collected equipment with identical acquisition ID, and distribution organizes into groups compatible data with it Collector, form acquisition group set, to refine acquisition data, prevent because collection device type, interface type it is different caused by Collector and collected device data identification mistake and acquisition mistake,
Central control unit is according to production firm's setting acquisition ID 1-2 for being collected equipment;According to collected equipment Type setting acquisition ID 3-5;ID the 6th is acquired according to the system interface type setting for being collected equipment.It is controlled with rear center Each collected equipment of the component distribution acquisition ID processed into plateform system.
A collected device id allocation table is safeguarded, wherein the principle and concrete mode of each ID distribution, example has been determined Such as, for demand manufacturer " Hong Kong bossini ", it is 01 that its 1-2 manufacturer's cognizance code for acquiring ID, which is arranged, in this patent, " sea That group " is 02 etc..Central control unit inquires every acquisition corresponding with device characteristics from collected device id allocation table ID is combined into 6 acquisition ID according to certain combination after obtaining each acquisition ID.
Such as when collected equipment is the equipment of industrial product, setting acquisition ID the 3rd is 1, when collected equipment is family When with equipment, setting acquisition ID the 3rd is 2, and when collected equipment is industrial control equipment, setting acquisition ID the 3rd is 3; When collected equipment is manual equipment, setting acquisition ID the 4th is 1, and when collected equipment is automatic equipment, setting is adopted Collection ID the 4th is 2, and when collected equipment is intelligence AI equipment, setting acquisition ID the 4th is 3;When collected equipment is void When quasi-ization equipment, setting acquisition ID the 5th is 1, and when collected equipment is physical equipment, setting acquisition ID the 5th is 2.
According to device id allocation table is collected, 6 ID are distributed for collected equipment.
Data aggregate component polymerize the acquisition data of each acquisition group set, using specific format datagram header to data into Row encapsulation process forms unified aggregated data format, is sent to data analysis portion part;Data analysis portion part, it is poly- to the data It closes the aggregated data formatted data that component is sent decapsulated, decrypted, reversed and set, and carries out data parsing, obtain analysis pair Image data.
It is poly- in a kind of industry internet big data service system data transmission method of present patent application and data with reference to Fig. 1 Close in resolver, the acquisition data of each acquisition group set of the polymerization, using specific format datagram header to data into Row encapsulation process forms unified aggregated data format, is sent to data analysis portion part, specifically: encapsulating the datagram header is FE datagram header, the FE datagram header include at least following field: preceding isolation field: using the field to completely cut off upper layer Packet header;
Tag field: the initial position using the field to prompt FE datagram header;
FE device field (DFLD): equipment and its type are collected to distinguish FE using the field;
Bottom response field: using the field to judge being specifically identified for acquisition group set described in bottom;
FE type code field: the concrete type using the field to determine data-message;
After completely cut off field: using the field to completely cut off packet load;
FE datagram header check field.
In one embodiment, it is preferred that, based on other categorical data headers before FE datagram header, according to certain Algorithm and putting in order generate it is described before completely cut off field.The step specifically: by other categorical datas before FE datagram header Header is truncated, and other categorical data headers before FE datagram header retain for odd bits and when digit is greater than 8 The intermediate position 8+1=9, the odd bits in intercepted 9 are negated, and are formed with the even bit in 9 former according to former sequence Completely cut off field;Other categorical data headers before FE datagram header are for even bit and when digit is not less than 8, in reservation Between 8, the odd bits in intercepted 8 are negated, and with former 8 in even bit according to former sequence composition isolation word Section;When other categorical data header digits before FE datagram header are less than 8, retain all data bit, it will be therein Odd bits negate, and combine with the even bit in former data according to former sequence, the duplication of the combination bit are followed by, from first Truncation is 8, composition isolation field.
In another embodiment, it is preferred that FE packet load is based on, according to certain algorithm and the generation that puts in order Completely cut off field after described.The step specifically: FE packet load is truncated, when FE packet load be odd bits and When digit is greater than 8, retains the intermediate position 8+1=9, the odd bits in intercepted 9 negated, and with original 9 in idol Numerical digit is according to former sequence composition isolation field;When FE packet load is even bit and digit is not less than 8, retain intermediate 8, the odd bits in intercepted 8 are negated, and with former 8 in even bit according to former sequence composition isolation field; When FE packet load digit is less than 8, retains all data bit, odd bits therein negated, and in former data Even bit is combined according to former sequence, is followed by the duplication of the combination bit, and truncation is 8 from first, composition isolation field.
In another embodiment, for example, the tag field specifically: convert equipment processing batch identification to Binary data, and 11111110 are connected, obtain the tag field of FE datagram header.
It note that in this example, it is actually hexadecimal character that the 11111110 of connecting is used as in tag field The binary representation of " FE ", to be used as marking purposes during FE industry internet system research and development.
In another embodiment, it is preferred that the FE device field (DFLD) totally 6, specifically: according to collected equipment Production firm is arranged device field (DFLD) 1-2;It is arranged device field (DFLD) 3-5 according to device type is collected;According to collected The system interface type of equipment is arranged device field (DFLD) the 6th.
Special setting is carried out by acquiring to data, three totally different fields is divided into acquisition target, 6 acquisition ID is set, And the acquisition ID difference according to acquisition target is grouped it, meanwhile, corresponding collector is according to type organized into groups, The collector accordingly organized into groups is matched one by one with the acquisition target equipment that corresponding ID is organized into groups again, it is convenient, definite and be directed to Property solve because acquisition target attribute it is different caused by collector adaptation issues.
In another embodiment, it is preferred that the FE bottom response field, specific setting method are as follows: use acquisition group The binary code of the device identification of middle same type acquisition equipment is as FE bottom response field, to judge specific bottom Layer acquisition group set.
The device identification of same type acquisition equipment in acquisition group, it should be designed as same value.For example, for collected Object acquires the acquisition group set that ID is 022312, carries out Polarization Coding after being translated into binary system, approaches it Polarization Coding result and collected object acquisition ID are 022312 progress binary system and calculated by the transmission efficiency of channel capacity Afterwards, the device identification of the type acquisition equipment is obtained;
The corresponding collector equipment mark that equipment is acquired is collected to a certain type or, being arranged in system initialization Know, to obtain the device identification of the type acquisition equipment.
Fig. 4 shows the basic of FE type code field in the data transmission method of industry internet big data service system Form format.In another embodiment, for example, the FE type code field is Optional Field, specifically:
WRO: to indicate message transmission, there are mistakes, need to carry out retransmitting message;
UPD: to request or respond message related with collector more new data;
DEF: to inform that the message is to obtain specified acquisition message of the data in relation to data;
DEL: the message to be acquired the deletion of particular acquisition device in group set or acquisition group set;
PAT: to inform by collector group until the message of the somewhere transmission path mistake of resolution component;
TEST: the message to test acquisition group set.
On the other hand, this application provides a kind of parsings of the data aggregate of industry internet big data service system to fill It sets, system locating for the device includes data aggregate resolver, the marshalling of data acquisition object, collector marshalling, matching Acquisition, polymerization and parsing;Data processing image index device, completes data and the quick of file handles and handle up;As a result packaging It sets, carries out big data processing result collection and extract and apply, and provide to the charging regulation for using deployment;Wherein: data aggregate solution Analysis apparatus includes central control unit, data aggregate component, data analysis portion part and at least one collector, center control unit Part is 6 acquisition ID settings of collected equipment progress, and according to adaptation acquisition target vendor types, adaptation acquisition target equipment Type, adaptation acquisition target system interface type are that collector is organized into groups;The central control unit will have identical acquisition It is one group that multiple collected equipment of ID, which are compiled, and distribution organizes into groups compatible data collector with it, forms acquisition group set, with Fining acquisition data prevent from knowing because of collector and collected device data caused by collection device type, interface type are different Not mistake and acquisition mistake, data aggregate component polymerize the acquisition data of each acquisition group set, using the number of specific format Processing is packaged to data according to header, unified aggregated data format is formed, is sent to data analysis portion part;Data analysis portion Part decapsulates the aggregated data formatted data that the data aggregate component is sent, is decrypted, reverses and set, and carries out data Parsing obtains analysis object data.
The wherein data aggregate component polymerize the acquisition data of each acquisition group set, using the data of specific format Header is packaged processing to data, forms unified aggregated data format, is sent to data analysis portion part, specifically:
The datagram header is FE datagram header, and the FE datagram header includes at least following field:
Preceding isolation field: using the field to completely cut off upper layer packet header;
Tag field: the initial position using the field to prompt FE datagram header;
FE device field (DFLD): equipment and its type are collected to distinguish FE using the field;
Bottom response field: using the field to judge being specifically identified for acquisition group set described in bottom;
FE type code field: the concrete type using the field to determine data-message;
After completely cut off field: using the field to completely cut off packet load;
FE datagram header check field.
The wherein preceding isolation field specifically: based on other categorical data headers before FE datagram header, according to one Determine algorithm and put in order to generate the preceding isolation field.
It is wherein described based on other categorical data headers before FE datagram header, according to certain algorithm with put in order The preceding isolation field is generated, specifically:
Other categorical data headers before FE datagram header are truncated, other number of types before FE datagram header According to header for odd bits and when digit is greater than 8, retains the intermediate position 8+1=9, the odd bits in intercepted 9 are taken Instead, and with the even bit in 9 former completely cut off field according to former sequence composition;
Other categorical data headers before FE datagram header retain intermediate 8 for even bit and when digit is not less than 8 Position, the odd bits in intercepted 8 are negated, and form isolation field according to former sequence with the even bit in 8 former;
When other categorical data header digits before FE datagram header are less than 8, retain all data bit, it will be therein Odd bits negate, and combine with the even bit in former data according to former sequence, the duplication of the combination bit are followed by, from first Truncation is 8, composition isolation field.
The wherein rear isolation field specifically: FE packet load is based on, according to certain algorithm and the generation that puts in order Completely cut off field after described.
It is wherein described to be based on FE packet load, according to certain algorithm and putting in order generate it is described after isolation field tool Body are as follows:
FE packet load is truncated, when FE packet load is odd bits and digit is greater than 8, in reservation Between the position 8+1=9, the odd bits in intercepted 9 are negated, and with former 9 in even bit according to former sequence composition every Exhausted field;
When FE packet load is even bit and digit is not less than 8, retain intermediate 8, by intercepted 8 In odd bits negate, and with former 8 in even bit according to former sequence composition isolation field;
When FE packet load digit is less than 8, retains all data bit, odd bits therein negated, and with original Even bit in data is combined according to former sequence, is followed by the duplication of the combination bit, and truncation is 8 from first, composition isolation Field.
The wherein tag field specifically: convert binary data for equipment processing batch identification, and connect 11111110, obtain the tag field of FE datagram header.
The wherein FE device field (DFLD) totally 6, specifically:
It is arranged device field (DFLD) 1-2 according to the production firm for being collected equipment;
It is arranged device field (DFLD) 3-5 according to device type is collected;
It is arranged device field (DFLD) the 6th according to the system interface type for being collected equipment.
The wherein FE bottom response field, specifically: use the device identification of same type acquisition equipment in acquisition group Binary code as FE bottom response field, to judge specific bottom acquisition group set.
Wherein the FE type code field is Optional Field, specifically:
WRO: to indicate message transmission, there are mistakes, need to carry out retransmitting message;
UPD: to request or respond message related with collector more new data;
DEF: to inform that the message is to obtain specified acquisition message of the data in relation to data;
DEL: the message to be acquired the deletion of particular acquisition device in group set or acquisition group set;
PAT: to inform by collector group until the message of the somewhere transmission path mistake of resolution component;
TEST: the message to test acquisition group set.
In another embodiment, which further includes data processing image indicator layer, includes: first connects Mouthful, for connect with database, processing database initialization procedure, establish logical data table, tables of data association, data major key, Data include item, define data query and data modification principle;Second interface is connect with user, at user accesses data Manage image indicator layer, inquiry and modification analysis object data, setting data query and modification principle;First data mapping index Generating unit to establish data save mesh in the processing of data processing image indicator layer and storing data, and is established simultaneously Data mapping index grid, wherein data mapping index grid and data save mesh structure correspond, in platform bottom When storage medium generates data save mesh structure, image index grid is also being generated;First data mapping pointer operation portion Part obtains corresponding image index grid section according to processing task data for obtaining corresponding processing task according to user's operation Point, to obtain respective data storage network section according to the corresponding relationship of image index grid and data save mesh Point, and to task fragment, it transfers to respective stored network node processing and returns to processing result data.
In addition, the service platform system further includes result set layer, it include the first data pick-up component, first data are taken out Taking component includes processing result detection device, and detection handles the result data collection completed, and foundation by save mesh structure node Save mesh structure classifies to result data collection;First service provides component, is used in a manner of service arrangement, will be described The result data collection that first data pick-up component extracts is distributed to the clothes of respective classes according to its classification after load balancing Business provides component.
And the first billing of services component, in a manner of service time (S) * service unit (U) * service weight coefficient To the service side of being provided carry out charging, wherein service weight coefficient by the identical acquisition ID of acquisition group set it is weighted calculate and ?.
In all above embodiment, for the requirement for realizing some special read/write functions, central control unit, number It is taken out according to polymeric components, data analysis portion part and at least one collector, data processing image indicator layer component and the first data It takes component, first service offer component, the first billing of services component that can increase hardware, pin connection or memory difference to come Extend function.
Although present patent application has been shown and with particular reference to describing multiple embodiments, it is to be noted that, it is not taking off From under the scope of the present invention, various other be altered or modified can be carried out.

Claims (20)

1. a kind of data transmission method of industry internet big data service system, including parsing dress using the data aggregate of system It sets, the marshalling of data acquisition object, collector marshalling, matching acquisition, polymerization and parsing;Using the data processing image of system Index device, completes data and the quick of file handles and handle up;Using the result acquisition means of system, big data processing knot is carried out Fruit collection extracts and application, and provides to the charging regulation for using deployment;Wherein:
Data aggregate resolver includes central control unit, data aggregate component, data analysis portion part and at least one acquisition Device, central control unit are 6 acquisition ID settings of collected equipment progress, and according to adaptation acquisition target vendor types, adaptation Acquisition target device type, adaptation acquisition target system interface type are that collector is organized into groups;
It is one group that the central control unit, which compiles multiple collected equipment with identical acquisition ID, and distribution is organized into groups with it mutually fits The data collector matched, composition acquisition group set are prevented because of collection device type, interface type not with refining acquisition data Collector caused by one and collected device data identification mistake and acquisition mistake,
Data aggregate component polymerize the acquisition data of each acquisition group set, using specific format datagram header to data into Row encapsulation process forms unified aggregated data format, is sent to data analysis portion part;
Data analysis portion part decapsulates the aggregated data formatted data that the data aggregate component is sent, is decrypted, is reversed It sets, and carries out data parsing, obtain analysis object data.
2. data transmission method as described in claim 1, which is characterized in that wherein described to polymerize adopting for each acquisition group set Collect data, processing is packaged to data using the datagram header of specific format, unified aggregated data format is formed, is sent to number According to resolution component, specifically:
Encapsulating the datagram header is FE datagram header, and the FE datagram header includes at least following field:
Preceding isolation field: using the field to completely cut off upper layer packet header;
Tag field: the initial position using the field to prompt FE datagram header;
FE device field (DFLD): equipment and its type are collected to distinguish FE using the field;
Bottom response field: using the field to judge being specifically identified for acquisition group set described in bottom;
FE type code field: the concrete type using the field to determine data-message;
After completely cut off field: using the field to completely cut off packet load;
FE datagram header check field.
3. data transmission method as claimed in claim 2, which is characterized in that the wherein preceding isolation field specifically: be based on Other categorical data headers before FE datagram header, according to certain algorithm and putting in order generate it is described before completely cut off field.
4. data transmission method as claimed in claim 3, which is characterized in that wherein its based on before FE datagram header Its categorical data header, according to certain algorithm and putting in order generate it is described before completely cut off field, specifically:
Other categorical data headers before FE datagram header are truncated, other categorical datas before FE datagram header Header retains the intermediate position 8+1=9, the odd bits in intercepted 9 is negated for odd bits and when digit is greater than 8, and Completely cut off field according to former sequence composition with the even bit in 9 former;
Other categorical data headers before FE datagram header retain intermediate 8 for even bit and when digit is not less than 8 Position, the odd bits in intercepted 8 are negated, and form isolation field according to former sequence with the even bit in 8 former;
When other categorical data header digits before FE datagram header are less than 8, retain all data bit, by surprise therein Numerical digit negates, and combines with the even bit in former data according to former sequence, is followed by the duplication of the combination bit, is truncated from first It is 8, composition isolation field.
5. data transmission method as claimed in claim 4, which is characterized in that the wherein rear isolation field specifically: be based on FE packet load, according to certain algorithm and putting in order generate it is described after completely cut off field.
6. data transmission method as claimed in claim 5, which is characterized in that it is wherein described to be based on FE packet load, according to Certain algorithm and putting in order generate it is described after completely cut off field specifically:
FE packet load is truncated, when FE packet load is odd bits and digit is greater than 8, retains intermediate 8+ 1=9, the odd bits in intercepted 9 are negated, and completely cuts off field according to former sequence composition with the even bit in 9 former;
When FE packet load is even bit and digit is not less than 8, retain intermediate 8, by the surprise in intercepted 8 Numerical digit negates, and completely cuts off field according to former sequence composition with the even bit in 8 former;
When FE packet load digit is less than 8, retains all data bit, odd bits therein negated, and with former data In even bit combined according to former sequence, be followed by the duplication of the combination bit, truncation is 8 from first, composition isolation field.
7. data transmission method as claimed in claim 6, which is characterized in that the wherein tag field specifically: set this Standby processing batch identification is converted into binary data, and connects 1,111 1110, obtains the tag field of FE datagram header.
8. data transmission method as claimed in claim 7, which is characterized in that the wherein FE device field (DFLD) totally 6, specifically Are as follows:
It is arranged device field (DFLD) 1-2 according to the production firm for being collected equipment;
It is arranged device field (DFLD) 3-5 according to device type is collected;
It is arranged device field (DFLD) the 6th according to the system interface type for being collected equipment.
9. data transmission method as claimed in claim 8, which is characterized in that the wherein FE bottom response field, specifically:
Use the binary code of the device identification of the acquisition equipment of same type in acquisition group as FE bottom response field, to Judge specific bottom acquisition group set.
10. transmission method as claimed in claim 9, which is characterized in that wherein the FE type code field is Optional Field, tool Body are as follows:
WRO: to indicate message transmission, there are mistakes, need to carry out retransmitting message;
UPD: to request or respond message related with collector more new data;
DEF: to inform that the message is to obtain specified acquisition message of the data in relation to data;
DEL: the message to be acquired the deletion of particular acquisition device in group set or acquisition group set;
PAT: to inform by collector group until the message of the somewhere transmission path mistake of resolution component;
TEST: the message to test acquisition group set.
11. a kind of data aggregate resolver of industry internet big data service system, the system comprises data aggregate solutions Analysis apparatus, the marshalling of data acquisition object, collector marshalling, matching acquisition, polymerization and parsing;Data processing image index dress It sets, completes data and the quick of file handles and handle up;As a result acquisition means carry out big data processing result collection and extract and apply, And it provides to the charging regulation for using deployment;Wherein:
Data aggregate resolver includes central control unit, data aggregate component, data analysis portion part and at least one acquisition Device, central control unit are 6 acquisition ID settings of collected equipment progress, and according to adaptation acquisition target vendor types, adaptation Acquisition target device type, adaptation acquisition target system interface type are that collector is organized into groups;
It is one group that the central control unit, which compiles multiple collected equipment with identical acquisition ID, and distribution is organized into groups with it mutually fits The data collector matched, composition acquisition group set are prevented because of collection device type, interface type not with refining acquisition data Collector caused by one and collected device data identification mistake and acquisition mistake,
Data aggregate component polymerize the acquisition data of each acquisition group set, using specific format datagram header to data into Row encapsulation process forms unified aggregated data format, is sent to data analysis portion part;Data analysis portion part, it is poly- to the data It closes the aggregated data formatted data that component is sent decapsulated, decrypted, reversed and set, and carries out data parsing, obtain analysis pair Image data.
12. data aggregate resolver as claimed in claim 11, which is characterized in that the wherein data aggregate component gathers The acquisition data for closing each acquisition group set are packaged processing to data using the datagram header of specific format, and composition is unified Aggregated data format, be sent to data analysis portion part, specifically:
The datagram header is FE datagram header, and the FE datagram header includes at least following field:
Preceding isolation field: using the field to completely cut off upper layer packet header;
Tag field: the initial position using the field to prompt FE datagram header;
FE device field (DFLD): equipment and its type are collected to distinguish FE using the field;
Bottom response field: using the field to judge being specifically identified for acquisition group set described in bottom;
FE type code field: the concrete type using the field to determine data-message;
After completely cut off field: using the field to completely cut off packet load;
FE datagram header check field.
13. data aggregate resolver as claimed in claim 11, which is characterized in that wherein the preceding isolation field is specific Are as follows: based on other categorical data headers before FE datagram header, according to certain algorithm and putting in order generate it is described before isolation Field.
14. data aggregate resolver as claimed in claim 13, which is characterized in that wherein it is described based on FE datagram header it Preceding other categorical data headers, according to certain algorithm and putting in order generate it is described before completely cut off field, specifically:
Other categorical data headers before FE datagram header are truncated, other categorical datas before FE datagram header Header retains the intermediate position 8+1=9, the odd bits in intercepted 9 is negated for odd bits and when digit is greater than 8, and Completely cut off field according to former sequence composition with the even bit in 9 former;
Other categorical data headers before FE datagram header retain intermediate 8 for even bit and when digit is not less than 8 Position, the odd bits in intercepted 8 are negated, and form isolation field according to former sequence with the even bit in 8 former;
When other categorical data header digits before FE datagram header are less than 8, retain all data bit, by surprise therein Numerical digit negates, and combines with the even bit in former data according to former sequence, is followed by the duplication of the combination bit, is truncated from first It is 8, composition isolation field.
15. data aggregate resolver as claimed in claim 14, which is characterized in that wherein the rear isolation field is specific Are as follows: be based on FE packet load, according to certain algorithm and putting in order generate it is described after completely cut off field.
16. data aggregate resolver as claimed in claim 15, which is characterized in that wherein described negative based on FE data packet Carry, according to certain algorithm and putting in order generate it is described after completely cut off field specifically:
FE packet load is truncated, when FE packet load is odd bits and digit is greater than 8, retains intermediate 8+ 1=9, the odd bits in intercepted 9 are negated, and completely cuts off field according to former sequence composition with the even bit in 9 former;
When FE packet load is even bit and digit is not less than 8, retain intermediate 8, by the surprise in intercepted 8 Numerical digit negates, and completely cuts off field according to former sequence composition with the even bit in 8 former;
When FE packet load digit is less than 8, retains all data bit, odd bits therein negated, and with former data In even bit combined according to former sequence, be followed by the duplication of the combination bit, truncation is 8 from first, composition isolation field.
17. data aggregate resolver as claimed in claim 16, which is characterized in that the wherein tag field specifically:
Binary data is converted by equipment processing batch identification, and connects 1,111 1110, obtains the label of FE datagram header Field.
18. data aggregate resolver as claimed in claim 17, which is characterized in that the wherein FE device field (DFLD) totally 6, Specifically:
It is arranged device field (DFLD) 1-2 according to the production firm for being collected equipment;
It is arranged device field (DFLD) 3-5 according to device type is collected;
It is arranged device field (DFLD) the 6th according to the system interface type for being collected equipment.
19. data aggregate resolver as claimed in claim 18, which is characterized in that the wherein FE bottom response field, Specifically:
Use the binary code of the device identification of the acquisition equipment of same type in acquisition group as FE bottom response field, to Judge specific bottom acquisition group set.
20. data aggregate resolver as claimed in claim 19, which is characterized in that wherein the FE type code field be can Word selection section, specifically:
WRO: to indicate message transmission, there are mistakes, need to carry out retransmitting message;
UPD: to request or respond message related with collector more new data;
DEF: to inform that the message is to obtain specified acquisition message of the data in relation to data;
DEL: the message to be acquired the deletion of particular acquisition device in group set or acquisition group set;
PAT: to inform by collector group until the message of the somewhere transmission path mistake of resolution component;
TEST: the message to test acquisition group set.
CN201811539335.5A 2018-12-14 2018-12-14 Data transmission method and data aggregation analysis device for industrial internet big data service system Active CN109617654B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811539335.5A CN109617654B (en) 2018-12-14 2018-12-14 Data transmission method and data aggregation analysis device for industrial internet big data service system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811539335.5A CN109617654B (en) 2018-12-14 2018-12-14 Data transmission method and data aggregation analysis device for industrial internet big data service system

Publications (2)

Publication Number Publication Date
CN109617654A true CN109617654A (en) 2019-04-12
CN109617654B CN109617654B (en) 2021-03-05

Family

ID=66010157

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811539335.5A Active CN109617654B (en) 2018-12-14 2018-12-14 Data transmission method and data aggregation analysis device for industrial internet big data service system

Country Status (1)

Country Link
CN (1) CN109617654B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110336698A (en) * 2019-07-05 2019-10-15 精英数智科技股份有限公司 A kind of failure data analyzing method, server and storage medium
CN116186613A (en) * 2023-05-04 2023-05-30 利维智能(深圳)有限公司 Intelligent acquisition processing method and system for industrial Internet data

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101194482A (en) * 2003-08-13 2008-06-04 高通股份有限公司 Signal interface for higher data rates
CN102497427A (en) * 2011-12-13 2012-06-13 山东省建筑科学研究院 Method and device for realizing data acquisition services of renewable energy source monitoring system
US20140380458A1 (en) * 2013-06-20 2014-12-25 Electronics And Telecommunications Research Institute Apparatus for preventing illegal access of industrial control system and method thereof
CN106094777A (en) * 2016-08-26 2016-11-09 北京航空航天大学 A kind of industry internet Hub device
CN106169988A (en) * 2016-02-26 2016-11-30 北京元心科技有限公司 The method transmitting data in cruising inspection system
CN107483372A (en) * 2017-08-31 2017-12-15 杭州京宁自动化技术有限公司 Data transmission method and system based on industrial Internet of things
CN108462754A (en) * 2018-03-28 2018-08-28 西安西电电气研究院有限责任公司 A kind of industry internet framework and implementation method
CN108737539A (en) * 2018-05-18 2018-11-02 济南浪潮高新科技投资发展有限公司 A method of it is serviced based on industry internet platform IOT Hub
US10148680B1 (en) * 2015-06-15 2018-12-04 ThetaRay Ltd. System and method for anomaly detection in dynamically evolving data using hybrid decomposition

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101194482A (en) * 2003-08-13 2008-06-04 高通股份有限公司 Signal interface for higher data rates
CN102497427A (en) * 2011-12-13 2012-06-13 山东省建筑科学研究院 Method and device for realizing data acquisition services of renewable energy source monitoring system
US20140380458A1 (en) * 2013-06-20 2014-12-25 Electronics And Telecommunications Research Institute Apparatus for preventing illegal access of industrial control system and method thereof
US10148680B1 (en) * 2015-06-15 2018-12-04 ThetaRay Ltd. System and method for anomaly detection in dynamically evolving data using hybrid decomposition
CN106169988A (en) * 2016-02-26 2016-11-30 北京元心科技有限公司 The method transmitting data in cruising inspection system
CN106094777A (en) * 2016-08-26 2016-11-09 北京航空航天大学 A kind of industry internet Hub device
CN107483372A (en) * 2017-08-31 2017-12-15 杭州京宁自动化技术有限公司 Data transmission method and system based on industrial Internet of things
CN108462754A (en) * 2018-03-28 2018-08-28 西安西电电气研究院有限责任公司 A kind of industry internet framework and implementation method
CN108737539A (en) * 2018-05-18 2018-11-02 济南浪潮高新科技投资发展有限公司 A method of it is serviced based on industry internet platform IOT Hub

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
FABRICIO TIETZ: "Development of an Internet of Things Gateway Applied to a Multimask Industrial Plant", 《2018 13TH IEEE INTERNATIONAL CONFERENCE ON INDUSTRY APPLICATIONS (INDUSCON)》 *
谢青松: "面向工业大数据的数据采集系统", 《中国优秀硕士学位论文全文数据库信息科技辑》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110336698A (en) * 2019-07-05 2019-10-15 精英数智科技股份有限公司 A kind of failure data analyzing method, server and storage medium
CN116186613A (en) * 2023-05-04 2023-05-30 利维智能(深圳)有限公司 Intelligent acquisition processing method and system for industrial Internet data
CN116186613B (en) * 2023-05-04 2023-07-18 利维智能(深圳)有限公司 Intelligent acquisition processing method and system for industrial Internet data

Also Published As

Publication number Publication date
CN109617654B (en) 2021-03-05

Similar Documents

Publication Publication Date Title
CN108932588B (en) Hydropower station group optimal scheduling system with separated front end and rear end and method
CN107390650A (en) A kind of data collecting system based on Internet of Things and the data compression method based on the system
CN106713018A (en) Message queue business data scheduling method and message queue implementation method
CN102439818A (en) Method and device for auto-generating goose signal connection topology from substation level
CN112311808A (en) Method for automatically mapping Modbus protocol data to OPCUA address space
CN109617654A (en) Industry internet big data service system data transmission method and data aggregate resolver
CN105243116A (en) Automatic generation method for electronic device capability description file of intelligent substation
CN106027674A (en) Technology architecture of "Internet & smart manufacturing"
CN102739788B (en) A kind of field device communicating method based on EIB agreement
CN100514928C (en) Method for rapidly forming dendriform topology structure of network equipment
CN106713019A (en) Design method of service operation support system applied to Internet of Things self-management platform
CN106713428A (en) Business operation support system applied to Internet-of-things self-management platform
CN101448020A (en) Data source return method and device
Shu et al. Novel modbus adaptation method for IoT gateway
CN115185663A (en) Intelligent data processing system based on big data
CN109656997B (en) Industrial internet big data service platform system and service method
CN114095535A (en) Method for automatically mapping time sequence variable of physical equipment into digital model
CN106993296A (en) The performance estimating method and device of terminal
CN109672668A (en) A kind of mapping method of GDA interface and OPC UA service
CN109947764A (en) A kind of inquiry enhancing system and method constructing elasticity scene based on time delay
CN1322709C (en) A method for implementing configuration data organization and centralized management in network management system
CN102208998B (en) Field programmable gate array (FPGA)-based common object request broker architecture (CORBA) communication device
CN109669777A (en) Industry internet big data member Demand and service providing method and system
CN105138581B (en) A kind of write-in of mobile message and read method and system
Akanbi et al. Semantic interoperability middleware architecture for heterogeneous environmental data sources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Industrial Internet Big Data Service System Data Transmission Method and Data Aggregation and Analysis Device

Granted publication date: 20210305

Pledgee: Bank of Communications Ltd. Zhuhai branch

Pledgor: GUANGDONG FLYING ENTERPRISE INTERNET TECHNOLOGY Co.,Ltd.

Registration number: Y2024980000817