CN115102951A - Data real-time publishing method, device and equipment - Google Patents
Data real-time publishing method, device and equipment Download PDFInfo
- Publication number
- CN115102951A CN115102951A CN202210911207.9A CN202210911207A CN115102951A CN 115102951 A CN115102951 A CN 115102951A CN 202210911207 A CN202210911207 A CN 202210911207A CN 115102951 A CN115102951 A CN 115102951A
- Authority
- CN
- China
- Prior art keywords
- frequency data
- data
- frequency
- time
- protocol type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000013144 data compression Methods 0.000 claims description 27
- 238000012856 packing Methods 0.000 claims description 26
- 238000007906 compression Methods 0.000 claims description 22
- 230000006835 compression Effects 0.000 claims description 22
- 239000000872 buffer Substances 0.000 claims description 13
- 238000003860 storage Methods 0.000 claims description 13
- 238000012544 monitoring process Methods 0.000 claims description 12
- 238000004806 packaging method and process Methods 0.000 claims description 11
- 238000005259 measurement Methods 0.000 claims description 6
- 238000009826 distribution Methods 0.000 claims description 5
- 238000005538 encapsulation Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 abstract description 10
- 238000004891 communication Methods 0.000 abstract description 9
- 238000005516 engineering process Methods 0.000 abstract description 8
- 230000005540 biological transmission Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 12
- 238000004590 computer program Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 238000005070 sampling Methods 0.000 description 6
- 230000003993 interaction Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 101000939676 Androctonus crassicauda Toxin a Proteins 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/163—In-band adaptation of TCP data exchange; In-band control procedures
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The application provides a real-time data issuing method, a real-time data issuing device and a real-time data issuing device, when industrial equipment issues high-frequency data, when the cache duration of the high-frequency data acquired on the industrial equipment reaches a preset duration T, the high-frequency data in the time range of the duration T with the current time as the termination time and the duration as the duration are read from a set data cache region, the read high-frequency data are packed according to a target protocol type, and the packed high-frequency data are issued to a registered user according to an issuing strategy matched with the target protocol type. Therefore, according to the technical scheme provided by the embodiment of the application, communication hardware for supporting the real-time Ethernet technology is not required to be additionally added, the issuing efficiency of high-frequency data at the data side can be improved, and the processing efficiency of the acquisition side and the consumption side can be improved.
Description
Technical Field
The application belongs to the technical field of data processing technology, and particularly relates to a method and a device for real-time data release.
Background
The real-time monitoring of the high-frequency data generated in the operation process of the industrial equipment has very important values for state monitoring, online diagnosis and offline analysis, however, the millisecond-level high-frequency data corresponding to a large number of monitoring variables faces a serious challenge for the release and collection of mass data.
At present, a hardware device, such as a PowerLink or Profinet, specially designed for data transmission real-time performance in the field of industrial control and data acquisition is needed in an existing high-frequency data issuing method to solve the problem of real-time data transmission in a real-time ethernet technology, and the acquired high-frequency data is directly issued by using the hardware device, but the issuing method needs support of high-cost communication hardware needed by a special real-time ethernet technology, and meanwhile, because a standard protocol used for transmitting the high-frequency data is not further optimized for a high-frequency scene, too high data volume is hardly supported by network bandwidth and arithmetic performance, such as continuous transmission of more than 1000 high-frequency variables of 20ms, and further, the high-frequency data transmission performance is poor.
Disclosure of Invention
The application provides a method, a device and equipment for real-time data release, so that the transmission performance of high-frequency data is improved under the condition that communication hardware is not additionally added.
The technical scheme provided by the application comprises the following steps:
in a first aspect, an embodiment of the present application provides a method for publishing data in real time, where the method is applied to an industrial device, and the method includes:
when the time length for acquiring the high-frequency data on the industrial equipment is determined to reach a preset time length T, reading the cache data in a target time range from a set data cache region, wherein the target time range takes the current time as the termination time and the time length as the time length T, the time length T is determined according to the maximum allowable delay, and the maximum allowable delay is determined according to the service scene of a data consumption end in the industrial equipment;
and packaging the read high-frequency data according to a target protocol type, and issuing the packaged high-frequency data to a registered user according to an issuing strategy matched with the target protocol type, wherein the time consumption for issuing the high-frequency data is less than T.
In a second aspect, an embodiment of the present application provides a data real-time publishing device, which is applied to an industrial device, and the device includes:
the data reading unit is used for reading the cache data in a target time range from a set data cache region when the time length of the acquired high-frequency data on the industrial equipment reaches a preset time length T, wherein the target time range takes the current time as the termination time and the time length as the time length T, the time length T is determined according to the maximum allowable delay, and the maximum allowable delay is determined according to the service scene of a data consumption end in the industrial equipment;
and the data issuing unit is used for packaging the read high-frequency data according to the target protocol type and issuing the packaged high-frequency data to the registered user according to an issuing strategy matched with the target protocol type, wherein the time consumption for issuing the high-frequency data is less than T.
According to the technical scheme, when the industrial equipment issues the high-frequency data, when the time length of the acquired high-frequency data on the industrial equipment reaches the preset time length T, the cache data in the time range with the current time as the termination time and the time length as the time length T are read from the set data cache region, the read high-frequency data are packaged according to the target protocol type, and the packaged high-frequency data are issued to the registered user according to the issuing strategy matched with the target protocol type. Therefore, according to the technical scheme provided by the embodiment of the application, communication hardware for supporting a real-time Ethernet technology is not required to be additionally added, meanwhile, the duration T is determined according to a service scene of a data consumption end in industrial equipment, and when the data is published, the packed high-frequency data can be published according to a publishing strategy matched with a target protocol type, so that the data can be read in order and published according to the publishing strategy, the transmission performance of the high-frequency data can be improved, meanwhile, the communication interaction can be reduced by publishing the batch data, the bandwidth occupation can be reduced, and the processing efficiency of the data side and the consumption side can be further improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1 is a flow chart of a real-time data publishing method provided by the present application;
FIG. 2 is a flow chart of a data compression method provided in the present application;
FIG. 3 is a schematic structural diagram of a data real-time publishing device provided by the present application;
fig. 4 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in detail with reference to the accompanying drawings and specific embodiments.
Referring to fig. 1, fig. 1 is a flowchart of a real-time data publishing method provided by the present application, which is applied to an industrial device. In practical applications, each industrial device is connected to a corresponding edge computing device, and each edge computing device is connected to the central server, so that an edge computing platform for the industrial device is formed.
As shown in fig. 1, the process may include the following steps:
The target time range is a time range with the current time as the termination time and the duration as the duration T, the duration T is determined according to the maximum allowable delay, and the maximum allowable delay is determined according to the service scene of the data consumption end in the industrial equipment.
For one embodiment, the time duration T is half of the maximum allowable delay, and if the maximum allowable delay is 1000 milliseconds, T is 500 milliseconds.
It should be noted that the real-time performance requirement T of the data consumption side is greater than the sampling interval T of the data generation side, and in practical applications, T/T >10 is one example.
As an embodiment, when the time length for acquiring the high-frequency data on the industrial device reaches a preset time length, the data generation side sends the acquired high-frequency data to the data consumption side to be cached in the set data cache region.
In this step, every T time period, step 102 is executed.
The data consuming side in this embodiment is a device in the data consuming side for acquiring the high-frequency data and processing the acquired high-frequency data, and if the data consuming side is an edge computing platform, the data consuming side is an edge computing device in the edge computing platform.
And 102, reading the cache data in the target time range from the set data cache region.
The data buffer is a predetermined buffer, and in some embodiments, the data buffer buffers all high frequency data for at least 2T, so as to prevent data errors caused by time spent in publishing exceeding T.
After step 102 is executed, as an embodiment, the method further includes: and checking whether the quantity of the high-frequency data corresponding to each read high-frequency variable is a preset quantity or not aiming at the high-frequency data corresponding to each read high-frequency variable, and if not, adjusting the acquired high-frequency data, namely adjusting the point increasing or point decreasing of the acquired high-frequency data so as to enable the quantity of the high-frequency data corresponding to the high-frequency variable acquired within the time length T to reach the preset quantity. The technical scheme provided by the embodiment can check whether each high-frequency variable just collects a preset number of data points, namely high-frequency data, in the latest T time duration. If a predetermined number of data points are collected, this indicates that the clock used for the sampling interval has not drifted. If the data points are collected to be higher than the preset number or lower than the preset number, the clock drift of the clock used in the sampling interval occurs, and the data point increase and decrease caused by the clock drift needs to be solved by the interval sampling technology. In some embodiments, the predetermined number is T × f, and f is the acquisition frequency.
And 103, packaging the read high-frequency data according to the target protocol type, and issuing the packaged high-frequency data to the registered user according to an issuing strategy matched with the target protocol type.
As an embodiment, the target protocol type is a default protocol type or another protocol type determined according to the selection instruction, the default protocol type is a standard protocol type, and the time consumed for issuing the high-frequency data is less than T.
In this embodiment, the data publishing recommends a default standard Protocol type, but supports other Protocol types for the user to select, and exemplarily, high-frequency data is transmitted in real time by using a proprietary format based on TCP (Transmission Control Protocol).
Each standard protocol type corresponds to an issuing strategy matched with the standard protocol type, and all high-frequency data in the T duration are packaged and issued in a quasi-real-time mode by adopting a proper issuing strategy according to the standard protocol type. In some embodiments, publishing the policy includes: and (4) corresponding to 1 monitoring variable by one protocol publishing point, and publishing according to a strategy of independently encapsulating each monitoring variable. In still other embodiments, issuing the policy includes: and aiming at different sub-components divided by one industrial device, issuing a strategy for packaging the high-frequency data corresponding to each sub-component. In yet another embodiment, issuing the policy includes: and aiming at the high-frequency data of the same industrial equipment, carrying out strategy distribution of integral encapsulation on the high-frequency data of the industrial equipment.
The packed high-frequency data is published in real time to the registered user or the signed user in advance, so that the safety of the data is improved.
It should be noted that, because data acquisition can be continuously performed at a higher priority level in the real-time requirement data release process, based on this, the time consumed for data release must not exceed the time length of T, the data is transmitted after the time length of T is full of high-frequency data, the high-frequency data of the next time length of T is simultaneously acquired during the transmission period, and two buffer areas with the length of T are performed in turn to ensure the data continuity.
So far, the description shown in fig. 1 is completed.
Therefore, in the technical scheme provided by the embodiment of the application, when the industrial equipment issues the high-frequency data, when the time length of the acquired high-frequency data on the industrial equipment reaches the preset time length T, the cache data in the time range with the current time as the termination time and the time length as the time length T are read from the set data cache region, the read high-frequency data are packaged according to the target protocol type, and the packaged high-frequency data are issued to the registered user according to the issuing strategy matched with the target protocol type. Therefore, according to the technical scheme provided by the embodiment of the application, communication hardware for supporting a real-time Ethernet technology is not required to be additionally added, meanwhile, the duration T is determined according to a service scene of a data consumption end in industrial equipment, and when the data is published, the packed high-frequency data can be published according to a publishing strategy matched with a target protocol type, so that the data can be read in order and published according to the publishing strategy, the transmission performance of the high-frequency data can be improved, meanwhile, the communication interaction can be reduced by publishing the batch data, the bandwidth occupation can be reduced, and the processing efficiency of the data side and the consumption side can be improved.
After the flowchart of fig. 1 is completed, as an embodiment, if the protocol type selected by the user is a standard protocol type, the implementation manner of packing the read high-frequency data according to the target protocol type in the implementation step 103 includes: and selecting the measuring point type matched with the standard protocol selected by the user according to the support and release performance of each standard protocol on the measuring point type to which the high-frequency data belongs, so as to package the high-frequency data corresponding to the measuring point type. In this embodiment, the measurement point type is an analog quantity type or a switch quantity type, based on this, a suitable measurement point type is selected based on the fixed-length or variable-length characteristics of a issued data packet, for example, a BIN byte array is mostly used for a fixed-length data packet (no compression), a coding string is mostly used for a variable-length data packet (compression), and the selection basis is the support and issuance performance of the measurement point type by a standard protocol.
As an embodiment, as shown in fig. 2, the following steps are further included after step 101:
and A, removing the time scale corresponding to each high-frequency data from the high-frequency data corresponding to the measuring point type, and compressing the high-frequency data after the time scale is removed.
Therefore, according to the technical scheme provided by the embodiment, the high-frequency data amount can be further reduced by compressing the high-frequency data without the time scale.
As an embodiment, an implementation manner for implementing the step A may include the step A1 to the step A3.
In step A1, when it is determined that the read high frequency data contains analog quantity data with analog quantity type, step A2 is executed. When it is determined that the read high frequency data contains switching amount data whose station type is a switching amount, step a3 is executed.
Step A2, extracting analog quantity data from the analog quantity data according to a preset frequency, removing a time scale carried by the analog quantity data, and compressing the analog variable data after the time scale is removed.
In this embodiment, the clock drift inevitably causes that the number of the high frequency data sampled within the period T may not be the preset number N, where N is T × f, and the time scale may be omitted after N is T × f according to the frequency sampling. Based on this, the analog data in this step is a method of removing a clock after sampling according to a frequency, and lossy compression is performed according to a precision requirement without a time scale, and the purpose is to reduce the data amount.
And step A3, compressing the switching value data.
As an embodiment, when it is determined that the read high frequency data contains switching value data in which the type of the station is a switching value, the method further includes: and removing the time scales corresponding to the switching value data from the switching value data, and compressing the switching value data after the time scales are removed.
The time scale index in this embodiment takes a value of 0 to N-1. And N is the number of high-frequency data in the time length T.
As another embodiment, as shown in fig. 2, after the high frequency data corresponding to the measurement point types is packed, the method further includes the following steps:
And 202, performing secondary compression on the compressed high-frequency data compression packet by using the compression algorithm to obtain a new high-frequency data compression packet.
As one example, the compressed high frequency data compression packet may be recompressed using LZW (Lempel-Ziv-Welch Encoding, string table compression algorithm). So that the data amount of the high frequency data can be further reduced.
Some standard protocols support encrypted transmission, and some standard protocols do not support encrypted transmission, based on which, the embodiment needs to encrypt the high-frequency data compression packet corresponding to the protocol type that needs to be encrypted. As an example, the Encryption algorithm may adopt an AES (Advanced Encryption Standard) algorithm matched with LZW.
The compressed high-frequency data compression packet is subjected to secondary compression in the step, so that the data volume is further reduced, and the bandwidth occupation is reduced.
In this embodiment, the metadata may be used to describe compressed and/or encrypted data, and may not be compressed and encrypted, otherwise, it is not possible to decompress and decrypt the encrypted high-frequency data.
Therefore, in the technical scheme provided by the embodiment, the data length can be reduced by two times of data compression, the bandwidth occupation can be reduced, and meanwhile, the use of the encryption algorithm can ensure the security of the data.
To further facilitate understanding of the above embodiments, by way of example, a wind turbine converter is designed to distribute the high frequency data shown in table 1 to an edge computing platform in the opuua protocol, wherein the high frequency data pertaining to sub-component a, sub-component B, and sub-component C of the wind turbine converter needs to be collected. The fan converter is connected to an edge computing device in the edge computing platform. Determining that the maximum allowable time delay of the edge computing platform is 2000ms according to the service scene of the edge computing platform, wherein the time T is half of the maximum allowable time delay, namely 1000ms, and the fan converter is provided with a data buffer area for storing all high-frequency data of the last 2 seconds. The method for releasing data in real time by the fan converter comprises the following steps:
the fan converter collects real-time data corresponding to high-frequency variables every 20ms, 100ms and 500ms and caches the real-time data in a set cache region, and reads all the high-frequency data of the latest 1000ms in the data cache region every 1000ms, namely when the time length of the collected high-frequency data reaches 1000ms, the cache data in the 1000ms before the current time is read from the data cache region capable of caching 2s of high-frequency data, and in addition, new data in the cache data can cover old data before 2 s.
Table 1 all high frequency data that the wind turbine converter needs to publish
And aiming at the read high-frequency data corresponding to each high-frequency variable, checking whether the quantity of the high-frequency data corresponding to the high-frequency variable is a preset quantity, and if not, adjusting the acquired high-frequency data so as to enable the quantity of the high-frequency data corresponding to the high-frequency variable acquired within 1000ms to reach the preset quantity. Therefore, the technical problem of data increase and decrease caused by clock drift can be solved, for example, the preset number N corresponding to the standard points of the subcomponent A of the fan converter is as follows: 1000/20, wherein the acquisition frequency f is 1/20ms 50 Hz. The number N of standard points for the subcomponent B of the fan converter is: 1000/100, wherein the acquisition frequency f is 1/100 ms-10 Hz. The number N of standard points for the subcomponent C of the fan converter is: 1000/500 is 2, and the collection frequency f is 1/500ms 2 Hz.
Compressing the read high-frequency data packet, specifically: the read high-frequency data packet is analyzed, as shown in tables 1 and 2, the time scale corresponding to each data is removed from the high-frequency data including 5+1+ 1-7 analog quantity data and 2+ 2-4 switching quantity data, and the analog quantity data and the switching quantity data from which the time scale is removed are compressed, so that the data quantity of the high-frequency data can be reduced.
And performing secondary compression on the high-frequency data compression packet compressed by the black word part in the table 2 by utilizing an LZW compression algorithm to obtain a new high-frequency data compression packet. This step is a second compression. Encrypting a high-frequency data compression packet corresponding to the protocol type to be encrypted by using an AES encryption algorithm matched with the LZW; and adding the encrypted high-frequency data compression packet (the black part in the table 2 is the encryption compression part) to the data corresponding to the protocol type which does not need to be encrypted so as to generate the high-frequency data packet to be issued. The data information which does not need to be encrypted is 'notice sequence number + data time stamp + compression algorithm + encryption algorithm'. After adding the information, the data packet shown in table 2 is finally generated. And updating a corresponding publishing point X of the OPCUA, and selecting a variable length coding character string from the measuring point X. The OPCUA standard protocol module of the fan converter sends the latest data packet to all data consumers subscribing to the measuring point X.
Table 2 packet structure schematic of a single issue point for all high frequency variables
The above examples are now described.
The following describes the apparatus provided in the present application:
referring to fig. 3, fig. 3 is a schematic structural diagram of a data real-time distribution apparatus 300, which is applied to an industrial device, and includes:
the data reading unit 301 is configured to, when it is determined that the time length for acquiring the high-frequency data on the industrial device reaches a preset time length T, read the cache data in a target time range from a set data cache region, where the target time range is a time range in which the current time is an end time and the time length is the time length T, where the time length T is determined according to a maximum allowable delay time, and the maximum allowable delay time is determined according to a service scenario of a data consuming end in the industrial device.
A data issuing unit 302, configured to pack the read high-frequency data according to a target protocol type, and issue the packed high-frequency data to a registered user according to an issuing policy that is matched with the target protocol type, where the time consumed for issuing the high-frequency data is less than T.
As an embodiment, the apparatus further comprises: the target protocol type is a default protocol type or other protocol types determined according to the selection instruction, and the default protocol type is a standard protocol type.
As an embodiment, the apparatus further comprises:
and the checking unit is used for checking whether the quantity of the high-frequency data corresponding to the high-frequency variable is a preset quantity or not aiming at the read high-frequency data corresponding to each high-frequency variable, and if not, adjusting the acquired high-frequency data so as to enable the quantity of the high-frequency data corresponding to the high-frequency variable acquired within the time length T to reach the preset quantity.
As an embodiment, if the protocol type selected by the user is a standard protocol type, the data issuing unit includes a packing subunit for packing the read high-frequency data according to the protocol type selected by the user;
the packing subunit is specifically configured to:
and selecting the measuring point type matched with the standard protocol selected by the user according to the support and release performance of each standard protocol on the measuring point type to which the high-frequency data belongs, so as to package the high-frequency data corresponding to the measuring point type.
As an embodiment, the packing subunit includes a first packing module for packing the high-frequency data corresponding to the measuring point type;
the first packing module is specifically configured to:
and removing the time scale corresponding to each high-frequency data from the high-frequency data corresponding to the measuring point type, and compressing the high-frequency data after the time scale is removed.
As an embodiment, the packing subunit further includes a second packing module for packing the high-frequency data corresponding to the measurement point type;
the second packing module is specifically configured to:
determining a compression algorithm used for compressing the high-frequency data compression packet, and selecting an encryption algorithm matched with the compression algorithm;
and encrypting the high-frequency data compression packet corresponding to the measuring point type needing to be compressed by using the encryption algorithm, and adding the data corresponding to the measuring point type needing not to be compressed to the encrypted high-frequency data compression packet to generate a high-frequency data packet to be issued.
As an embodiment, the publication policy includes: and (3) corresponding to 1 monitoring variable by one protocol publishing point, and publishing according to a strategy of independently packaging each monitoring variable.
As an embodiment, the publication policy includes: and aiming at different sub-components divided by one industrial device, issuing a strategy for packaging the high-frequency data corresponding to each sub-component.
As an embodiment, the publication policy includes: and aiming at the high-frequency data of the same industrial equipment, carrying out strategy distribution of integral encapsulation on the high-frequency data of the industrial equipment.
As an embodiment, the data buffer buffers at least all high frequency data for 2T time.
As an embodiment, the predetermined number is T × f, and f is the acquisition frequency.
Up to this point, the description shown in fig. 3 is completed.
Therefore, in the technical scheme provided by the embodiment of the application, when the industrial equipment issues the high-frequency data, when the time length of the acquired high-frequency data on the industrial equipment reaches the preset time length T, the cache data in the time range with the current time as the termination time and the time length as the time length T are read from the set data cache region, the read high-frequency data are packaged according to the target protocol type, and the packaged high-frequency data are issued to the registered user according to the issuing strategy matched with the target protocol type. Therefore, according to the technical scheme provided by the embodiment of the application, additional communication hardware for supporting the real-time Ethernet technology is not required to be added, meanwhile, the duration T is determined according to the service scene of a data consumption end in industrial equipment, and when the data is published, the packed high-frequency data can be published according to the publishing strategy matched with the standard protocol type or the protocol type selected by a user, so that the data can be read in order and published according to the publishing strategy, the transmission performance of the high-frequency data can be improved, meanwhile, the communication interaction can be reduced by publishing the batch data, the bandwidth occupation can be reduced, and the processing efficiency of the data side and the consumption side can be improved.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
In the electronic device provided in the embodiment of the present application, from a hardware level, a schematic diagram of a hardware architecture can be seen as shown in fig. 4. The method comprises the following steps: a machine-readable storage medium and a processor, wherein: the machine-readable storage medium stores machine-executable instructions executable by the processor; the processor is configured to execute machine-executable instructions to perform the data real-time publication operations disclosed in the above examples.
Machine-readable storage media are provided by embodiments of the present application that store machine-executable instructions that, when invoked and executed by a processor, cause the processor to implement the data real-time publication operations disclosed in the examples above.
Here, a machine-readable storage medium may be any electronic, magnetic, optical, or other physical storage device that can contain or store information such as executable instructions, data, and so forth. For example, the machine-readable storage medium may be: a RAM (random Access Memory), a volatile Memory, a non-volatile Memory, a flash Memory, a storage drive (e.g., a hard drive), a solid state drive, any type of storage disk (e.g., an optical disk, a dvd, etc.), or similar storage medium, or a combination thereof.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. A typical implementation device is a computer, which may take the form of a personal computer, laptop computer, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email messaging device, game console, tablet computer, wearable device, or a combination of any of these devices.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Furthermore, these computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement without inventive effort.
So far, the description of the apparatus shown in fig. 4 is completed.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (17)
1. A real-time data release method is applied to industrial equipment and comprises the following steps:
when the time length for acquiring the high-frequency data on the industrial equipment is determined to reach a preset time length T, reading the cache data in a target time range from a set data cache region, wherein the target time range takes the current time as the termination time and the time length as the time length T, the time length T is determined according to the maximum allowable delay, and the maximum allowable delay is determined according to the service scene of a data consumption end in the industrial equipment;
and packaging the read high-frequency data according to a target protocol type, and issuing the packaged high-frequency data to a registered user according to an issuing strategy matched with the target protocol type, wherein the time consumption for issuing the high-frequency data is less than T.
2. The method of claim 1, wherein the target protocol type is a default protocol type or other protocol type determined according to a selection instruction, and wherein the default protocol type is a standard protocol type.
3. The method according to claim 2, further comprising, after the reading the buffered data in the target time range from the set data buffer, the step of:
and aiming at the read high-frequency data corresponding to each high-frequency variable, checking whether the quantity of the high-frequency data corresponding to the high-frequency variable is a preset quantity, and if not, adjusting the acquired high-frequency data so as to enable the quantity of the high-frequency data corresponding to the high-frequency variable acquired within the time length T to reach the preset quantity.
4. The method of claim 3, wherein if the protocol type selected by the user is a standard protocol type, the packing the read high frequency data according to the target protocol type comprises:
and selecting the measuring point type matched with the standard protocol selected by the user according to the support and release performance of each standard protocol on the measuring point type to which the high-frequency data belongs, so as to package the high-frequency data corresponding to the measuring point type.
5. The method of claim 4, wherein the packing of the high-frequency data corresponding to the station types comprises:
and removing the time scale corresponding to each high-frequency data from the high-frequency data corresponding to the measuring point type, and compressing the high-frequency data after the time scale is removed.
6. The method of claim 5, wherein after the packing the high frequency data corresponding to the station types, the method further comprises:
determining a compression algorithm used for compressing the high-frequency data compression packet, and selecting an encryption algorithm matched with the compression algorithm;
carrying out secondary compression on the compressed high-frequency data compression packet by using the compression algorithm to obtain a new high-frequency data compression packet;
encrypting the high-frequency data compression packet corresponding to the protocol type to be encrypted by using the encryption algorithm; and adding metadata which does not need to be encrypted before the encrypted high-frequency data compression packet to generate a high-frequency data packet to be issued, wherein the metadata is used for describing the encrypted high-frequency data compression packet.
7. The method according to any one of claims 1 to 6, wherein the publishing policy comprises at least:
1 monitoring variable is corresponding to one protocol publishing point and published according to a strategy of independently packaging each monitoring variable; or/and
aiming at different sub-components divided by one industrial device, issuing a strategy for packaging high-frequency data corresponding to each sub-component; or/and
and aiming at the high-frequency data of the same industrial equipment, carrying out strategy distribution of integral encapsulation on the high-frequency data of the industrial equipment.
8. The method of claim 3, wherein the data buffer buffers at least all high frequency data for 2T time, and/or
The preset number is T x f, and f is the collection frequency.
9. A real-time data distribution device is applied to industrial equipment and comprises:
the data reading unit is used for reading the cache data in a target time range from a set data cache region when the time length of the acquired high-frequency data on the industrial equipment reaches a preset time length T, wherein the target time range takes the current time as the termination time and the time length as the time length T, the time length T is determined according to the maximum allowable delay, and the maximum allowable delay is determined according to the service scene of a data consumption end in the industrial equipment;
and the data issuing unit is used for packaging the read high-frequency data according to the target protocol type and issuing the packaged high-frequency data to the registered user according to an issuing strategy matched with the target protocol type, wherein the time consumption for issuing the high-frequency data is less than T.
10. The apparatus of claim 9, wherein the target protocol type is a default protocol type or other protocol type determined according to a selection instruction, and wherein the default protocol type is a standard protocol type.
11. The apparatus of claim 10, further comprising:
and the checking unit is used for checking whether the quantity of the high-frequency data corresponding to the high-frequency variable is a preset quantity or not aiming at the read high-frequency data corresponding to each high-frequency variable, and if not, adjusting the acquired high-frequency data so as to enable the quantity of the high-frequency data corresponding to the high-frequency variable acquired within the time length T to reach the preset quantity.
12. The apparatus of claim 11, wherein if the protocol type selected by the user is a standard protocol type, the data publishing unit comprises a packing subunit for packing the read high frequency data according to the protocol type selected by the user;
the packing subunit is specifically configured to:
and selecting the measuring point type matched with the standard protocol selected by the user according to the support and release performance of each standard protocol on the measuring point type to which the high-frequency data belongs, so as to package the high-frequency data corresponding to the measuring point type.
13. The apparatus of claim 12, wherein the packing subunit comprises a first packing module for packing the high frequency data corresponding to the station types;
the first packing module is specifically configured to:
and removing the time scale corresponding to each high-frequency data from the high-frequency data corresponding to the measuring point type, and compressing the high-frequency data after the time scale is removed.
14. The device of claim 13, wherein the packing subunit further comprises a second packing module for packing the high-frequency data corresponding to the measurement point type;
the second packing module is specifically configured to:
determining a compression algorithm used for compressing the high-frequency data compression packet, and selecting an encryption algorithm matched with the compression algorithm;
and encrypting the high-frequency data compression packet corresponding to the measuring point type needing to be compressed by utilizing the encryption algorithm, and adding the data corresponding to the measuring point type needing not to be compressed in front of the encrypted high-frequency data compression packet to generate a high-frequency data packet to be issued.
15. The apparatus according to any of claims 9-14, wherein the publishing policy comprises at least:
1 monitoring variable is corresponding to one protocol publishing point, and the monitoring variables are published according to a strategy of individual encapsulation of each monitoring variable; or/and
aiming at different sub-components divided by one industrial device, issuing a strategy for packaging high-frequency data corresponding to each sub-component; or/and
and aiming at the high-frequency data of the same industrial equipment, carrying out strategy release of integral encapsulation on the high-frequency data of the industrial equipment.
16. The apparatus of claim 11, wherein the data buffer buffers at least all high frequency data for 2T time, and/or
The preset number is T x f, and f is the collection frequency.
17. An electronic device comprising a processor and a machine-readable storage medium storing machine-executable instructions executable by the processor; the processor is configured to execute machine executable instructions to perform the method steps of any of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210911207.9A CN115102951A (en) | 2022-07-29 | 2022-07-29 | Data real-time publishing method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210911207.9A CN115102951A (en) | 2022-07-29 | 2022-07-29 | Data real-time publishing method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115102951A true CN115102951A (en) | 2022-09-23 |
Family
ID=83301371
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210911207.9A Pending CN115102951A (en) | 2022-07-29 | 2022-07-29 | Data real-time publishing method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115102951A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170078916A1 (en) * | 2014-05-05 | 2017-03-16 | Huawei Technologies Co., Ltd. | Data processing method and apparatus |
| CN108737347A (en) * | 2017-04-21 | 2018-11-02 | 腾讯科技（深圳）有限公司 | Data communications method, device and its equipment |
| CN111538875A (en) * | 2020-04-27 | 2020-08-14 | 支付宝(杭州)信息技术有限公司 | Service index acquisition method and device and wind control equipment |
| CN112162691A (en) * | 2020-09-29 | 2021-01-01 | 深圳市英威腾电动汽车驱动技术有限公司 | Data acquisition method, device and storage medium |
| CN112202742A (en) * | 2020-09-23 | 2021-01-08 | 航天云网数据研究院(广东)有限公司 | Data processing method of rolling mill equipment based on 5G network and related equipment |
| US20210250427A1 (en) * | 2017-07-03 | 2021-08-12 | Zte Corporation | Data transmission method and device |
| CN114531332A (en) * | 2020-11-06 | 2022-05-24 | 中兴通讯股份有限公司 | Data transmission method, data processing method, device and storage medium |
-
2022
- 2022-07-29 CN CN202210911207.9A patent/CN115102951A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170078916A1 (en) * | 2014-05-05 | 2017-03-16 | Huawei Technologies Co., Ltd. | Data processing method and apparatus |
| CN108737347A (en) * | 2017-04-21 | 2018-11-02 | 腾讯科技（深圳）有限公司 | Data communications method, device and its equipment |
| US20210250427A1 (en) * | 2017-07-03 | 2021-08-12 | Zte Corporation | Data transmission method and device |
| CN111538875A (en) * | 2020-04-27 | 2020-08-14 | 支付宝(杭州)信息技术有限公司 | Service index acquisition method and device and wind control equipment |
| CN112202742A (en) * | 2020-09-23 | 2021-01-08 | 航天云网数据研究院(广东)有限公司 | Data processing method of rolling mill equipment based on 5G network and related equipment |
| CN112162691A (en) * | 2020-09-29 | 2021-01-01 | 深圳市英威腾电动汽车驱动技术有限公司 | Data acquisition method, device and storage medium |
| CN114531332A (en) * | 2020-11-06 | 2022-05-24 | 中兴通讯股份有限公司 | Data transmission method, data processing method, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101594150B (en) | Method of efficient compression for measurement data | |
| CN105578207A (en) | Video frame rate conversion method and device | |
| EP2265029A1 (en) | Image processor, image generator and computer program | |
| CN110266494B (en) | Time service authentication method, device and equipment in block chain type account book | |
| JP2012198598A (en) | Data storage device and data storage method | |
| CN108966283B (en) | Telemetering data compression transmission method, device and computer readable medium | |
| CN104834247A (en) | Device setting apparatus, storage storing device setting program, and method for sharing information among a plurality of device setting apparatuses | |
| CN108875035B (en) | Data storage method of distributed file system and related equipment | |
| CN110728834A (en) | WAMS measurement data compression transmission method based on Beidou short message | |
| CN106020722A (en) | Method, device and system for deduplication of repeated data of cloud storage system | |
| CN106776663B (en) | Audio file compression method and device | |
| CN111680016A (en) | Distributed server cluster log data processing method, device and system | |
| CN112632568B (en) | Temperature data storage and acquisition method, system, electronic equipment and storage medium | |
| CN106878196B (en) | Data processing method and device of ADC plug-in | |
| CN115102951A (en) | Data real-time publishing method, device and equipment | |
| CN104503862B (en) | The method and apparatus for obtaining the check value using channel bag | |
| CN113452630B (en) | Data merging method, data splitting method, device, equipment and storage medium | |
| CN104219102B (en) | A kind of methods, devices and systems of network data compression statistics | |
| CN105915930A (en) | Video file sending method and apparatus | |
| CN110515591B (en) | Random number generation method and device based on block chain | |
| CN103297482A (en) | Information processing method and device | |
| US8140488B2 (en) | Reducing memory required for prediction by partial matching models | |
| CN114095570B (en) | Data transmission method for power transmission and transformation Internet of things and power transmission and transformation Internet of things | |
| CN116405482A (en) | Log file transmission method, system, terminal and storage medium | |
| CN111414341B (en) | Data normalization description method in Internet of things environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhou Jinghui Inventor after: Cheng Dong Inventor after: Ma Hanzheng Inventor before: Zhou Jinghui Inventor before: Cheng Dong Inventor before: Ma Hanzheng |