CN116614492A - Laboratory unified data acquisition platform based on various data sources of internet of things - Google Patents
Laboratory unified data acquisition platform based on various data sources of internet of things Download PDFInfo
- Publication number
- CN116614492A CN116614492A CN202310561587.2A CN202310561587A CN116614492A CN 116614492 A CN116614492 A CN 116614492A CN 202310561587 A CN202310561587 A CN 202310561587A CN 116614492 A CN116614492 A CN 116614492A
- Authority
- CN
- China
- Prior art keywords
- data
- protocol
- unit
- data sources
- transmission protocols
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 claims abstract description 108
- 238000006243 chemical reaction Methods 0.000 claims abstract description 10
- 238000004458 analytical method Methods 0.000 claims description 23
- 238000000034 method Methods 0.000 claims description 8
- 238000006467 substitution reaction Methods 0.000 claims description 7
- 230000003044 adaptive effect Effects 0.000 claims description 5
- 238000013075 data extraction Methods 0.000 claims description 5
- 230000001502 supplementing effect Effects 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/08—Protocols for interworking; Protocol conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The application discloses a laboratory unified data acquisition platform based on various data sources of the Internet of things, which relates to the technical field of data acquisition, solves the technical problems that the back and forth conversion of transmission protocols of different data sources can cause slower data acquisition efficiency and overlong overall acquisition time, sequentially acquires different data sources according to a confirmed i-value arrangement table and an i-value arrangement table, retains repeated data of the previous data source and the original data source when the next data source is acquired after the previous data source is acquired, fills non-repeated data in the original data source into the previous data source directly to obtain the transmission protocol of the original data source, acquires data according to the determined transmission protocol, sequentially acquires data according to protocol content in a data acquisition mode, and has higher efficiency and higher speed.
Description
Technical Field
The application belongs to the technical field of data acquisition, and particularly relates to a laboratory unified data acquisition platform based on various data sources of the Internet of things.
Background
The data acquisition refers to automatically acquiring non-electric quantity or electric quantity signals from analog and digital tested units such as a sensor and other devices to be tested, and sending the signals to an upper computer for analysis and processing.
The application of patent publication number CN104111983B relates to an open type multi-source data acquisition system and method, comprising a task management module for creating acquisition tasks according to requirements, configuring acquisition task information and generating corresponding data acquisition interface rules; the task execution module is used for loading the data acquisition interface rule, executing the acquisition task in the activated state, carrying out data source monitoring and data acquisition by the corresponding acquisition task, packaging the acquired data according to a unified format and sending the data to the data storage module; the application covers a relatively comprehensive data source acquisition type, supports a current universal data acquisition mode, supports dynamic expansion of a data acquisition interface and parallel acquisition of a plurality of data sources, and can easily realize data acquisition of a new data source by only configuring data acquisition task information without deploying an acquisition agent and a data mode conversion tool when the new data source is accessed.
When the data acquisition work is carried out between a plurality of different data sources in the laboratory, the transmission protocols among the different data sources are different, so that the data acquisition efficiency is slower due to the back-and-forth conversion of the transmission protocols of the different data sources when the data acquisition is carried out, the overall acquisition time is too long, and the specific work of subsequent operators can be influenced.
Disclosure of Invention
The present application aims to solve at least one of the technical problems existing in the prior art; therefore, the application provides a laboratory unified data acquisition platform based on various data sources of the Internet of things, which is used for solving the technical problems that the data acquisition efficiency is slower and the overall acquisition time is overlong due to the back-and-forth conversion of transmission protocols of different data sources.
To achieve the above objective, an embodiment according to a first aspect of the present application provides a laboratory unified data acquisition platform based on multiple data sources of the internet of things, including a protocol acquisition unit, an acquisition management center, and a data extraction unit;
the acquisition management center comprises a protocol analysis unit, a self-adaptive processing unit, an acquisition unit, a storage unit, a capacity reduction unit and a redundant data removal unit;
the protocol acquisition unit is used for acquiring transmission protocols of different data sources and sending the acquired transmission protocols to the acquisition management center;
the protocol analysis unit receives the acquired transmission protocols of different data sources, and confirms the transmission protocol with the minimum overall capacity according to the transmission protocol content of the different data sources and marks the transmission protocol as an initial protocol in the specific mode that:
confirming IP address contents existing in different transmission protocols and marking the contents;
reject such marked content, confirm the capacity parameter of the corresponding transport protocol, and mark it as RL i Wherein i represents different transmission protocols, and the marked transmission protocols are transmitted to a storage unit for storage;
from several sets of capacity parameters RL i Confirming the minimum value, marking the transmission protocol corresponding to the minimum value as an initial protocol, transmitting all contents of the initial protocol into the self-adaptive processing unit, wherein all contents comprise IP address contents existing in the initial protocol;
the self-adaptive processing unit performs similarity analysis on transmission protocols of different data sources according to the determined initial protocol, and specifically comprises the following steps:
according to the confirmed initial protocol, carrying out coincidence analysis on the initial protocol and transmission protocols of other different data sources, confirming a group of transmission protocols with the highest coincidence with the initial protocol, marking the transmission protocols as two types of protocols, if no coincidence exists among the transmission protocols of the different data sources, confirming the transmission protocol capacity values of the different data sources, confirming the capacity values of the initial protocol, carrying out difference processing on the transmission protocol capacity values of the different data sources and the capacity values of the initial protocol, confirming the analysis difference value, marking a group of transmission protocols with the smallest analysis difference value as two types of protocols, and if a plurality of groups of transmission protocols with the same difference value exist, randomly selecting one group of transmission protocols and marking the one group of transmission protocols as two types of protocols;
then using the second class protocol as the initial protocol, adopting the same mode to confirm a group of transmission protocols, marking the transmission protocols as three classes of protocols, then using the three classes of protocols as the initial protocol to confirm the four classes of protocols, and so on, generating an i value list according to the mark i and according to the ordering of the initial protocol, the second class protocol and the subsequent transmission protocols, and transmitting the generated i value list into a storage unit for storage;
the acquisition unit confirms a data acquisition rule according to the i value list and performs data acquisition on different data sources, and the specific mode is as follows:
s1, directly extracting an i value arrangement table from a storage unit, confirming a first bit transmission protocol in the i value arrangement table, acquiring data of a designated data source through the content of the transmission protocol, and transmitting the acquired data to a redundant data removing unit after the acquisition is finished;
s2, confirming a next group of transmission protocols according to the i value arrangement table, confirming repeated data between the transmission protocols and a previous group of transmission protocols, reserving the repeated data on the basis of the previous group of transmission protocols, supplementing corresponding non-repeated data at corresponding positions of the previous group of transmission protocols according to specific positions of the non-repeated data, acquiring data of a designated data source by adopting a processed protocol after processing, and transmitting the acquired data to a redundant data removing unit;
s3, repeatedly executing the step S2, sequentially collecting data of different data sources, and transmitting the collected data into a redundant data removing unit;
the redundant data removing unit is used for receiving collected data of different data sources, confirming repeated data in the different data sources, replacing the repeated data by adopting a repeated mark, generating a repeated data replacement table, and transmitting the processed data packets of the different data sources into the capacity reducing unit, wherein the specific mode is as follows:
receiving collected data of different data sources, and generating different data packets from the different collected data;
confirm the repeated data in the same data packet and adopt the repeated mark CF k Substitution of the duplicate data, wherein k=1, 2, … …, m, and k is 1 or 2, represents different duplicate data;
after the replacement is finished, according to the repetition mark CF k The repeated data are replaced, a repeated data replacement table is generated and stored in the corresponding data packet, and the processed data packet is transmitted to the capacity reduction unit;
the capacity reduction unit performs capacity reduction on the data packets of different data sources, and transmits the data packets subjected to capacity reduction processing to the storage unit for storage, wherein the specific mode is as follows:
a dividing interval is arranged between each group of different data in the data packet, and interval marks are arranged at the positions of each group of dividing intervals;
after the interval mark is set, combining a plurality of groups of different data, and transmitting the combined data packet into a storage unit for storage.
Compared with the prior art, the application has the beneficial effects that: according to the confirmed i value arrangement table, sequentially acquiring different data sources according to an ordering mode of the i value arrangement table, when acquiring the next group of data sources after the previous group of data sources are acquired, reserving repeated data of the previous group of data sources and the previous group of data sources, directly filling non-repeated data in the previous group of data sources into the previous group of data sources to obtain a transmission protocol of the previous group of data sources, and sequentially acquiring data according to the determined transmission protocol, wherein the data acquisition mode sequentially acquires data according to protocol content, has higher efficiency and higher speed;
and then replacing the repeated data in the data packet, recording a corresponding replacement table, reducing the capacity of the data packet, reasonably utilizing the storage space in the storage unit, and improving the space utilization rate.
Drawings
Fig. 1 is a schematic diagram of a principle frame of the present application.
Detailed Description
The technical solutions of the present application will be clearly and completely described in connection with the embodiments, and it is obvious that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Example 1
Referring to fig. 1, the application provides a laboratory unified data acquisition platform based on various data sources of the internet of things, which comprises a protocol acquisition unit, an acquisition management center and a data extraction unit;
the protocol acquisition unit is electrically connected with the input end of the acquisition management center, the acquisition management center comprises a protocol analysis unit, an adaptive processing unit, an acquisition unit, a storage unit, a capacity reduction unit and a redundant data removal unit, the protocol analysis unit is electrically connected with the input end of the adaptive processing unit, the adaptive processing unit is electrically connected with the input end of the acquisition unit, the adaptive processing unit is electrically connected with the input end of the storage unit, the storage unit is electrically connected with the input end of the acquisition unit, the acquisition unit is electrically connected with the input end of the redundant data removal unit, the redundant data removal unit is electrically connected with the input end of the capacity reduction unit, the capacity reduction unit is electrically connected with the input end of the storage unit, and the storage unit is electrically connected with the input end of the data extraction unit;
the protocol acquisition unit is used for acquiring transmission protocols of different data sources and sending the acquired transmission protocols to the acquisition management center;
the protocol analysis unit receives the acquired transmission protocols of different data sources, and confirms the transmission protocol with the minimum overall capacity according to the transmission protocol content of the different data sources, wherein the specific mode of confirming the transmission protocol with the minimum capacity is as follows:
confirming IP address contents existing in different transmission protocols and marking the contents;
reject such marked content, confirm the capacity parameter of the corresponding transport protocol, and mark it as RL i Wherein i represents different transmission protocols, and the marked transmission protocols are transmitted to a storage unit for storage;
from several sets of capacity parameters RL i And (3) confirming the minimum value, marking the transmission protocol corresponding to the minimum value as an initial protocol, and transmitting the whole content of the initial protocol into the self-adaptive processing unit, wherein the whole content comprises the IP address content existing in the initial protocol.
Specifically, when the capacity is acquired, the IP address is not considered, and after the subsequent capacity value is compared, the IP address is automatically filled into the corresponding transmission protocol content.
The self-adaptive processing unit performs similarity analysis on transmission protocols of different data sources according to the determined initial protocol, confirms a second class protocol belonging to the initial protocol, confirms a conversion data packet, transmits the confirmed conversion data packet into the storage unit for storage, sequentially processes different transmission protocols, generates an i-value list, and transmits the i-value list into the storage unit for storage, wherein the specific mode of performing similarity analysis is as follows:
according to the confirmed initial protocol, carrying out coincidence analysis on the initial protocol and transmission protocols of other different data sources, confirming a group of transmission protocols with the highest coincidence with the initial protocol, marking the transmission protocols as two types of protocols, if no coincidence exists among the transmission protocols of the different data sources, confirming the transmission protocol capacity values of the different data sources, confirming the capacity values of the initial protocol, carrying out difference processing on the transmission protocol capacity values of the different data sources and the capacity values of the initial protocol, confirming the analysis difference value, marking a group of transmission protocols with the smallest analysis difference value as two types of protocols, and if a plurality of groups of transmission protocols with the same difference value exist, randomly selecting one group of transmission protocols and marking the one group of transmission protocols as two types of protocols;
and then taking the second class protocol as an initial protocol, adopting the same mode to confirm a group of transmission protocols, marking the transmission protocols as three classes of protocols, then taking the three classes of protocols as the initial protocol to confirm the fourth class of protocols, and so on, generating an i value list according to the mark i and according to the initial protocol, the second class protocol and the sequence of the subsequent transmission protocols, and transmitting the generated i value list into a storage unit for storage.
Specifically, according to the predetermined initial protocol, the second-class protocol is confirmed through the operation, then the second-class protocol is used as the initial protocol, three types of protocols are confirmed, and the like, a plurality of groups of protocol contents appearing subsequently are confirmed in sequence, and a corresponding i-value list is generated.
The acquisition unit confirms a data acquisition rule according to the i value list, performs data acquisition on different data sources, performs protocol conversion after a certain group of data sources are acquired, acquires the next group of data sources, and transmits the acquired data of the different data sources to the redundant data removal unit, wherein the specific mode for acquiring is as follows:
s1, directly extracting an i value arrangement table from a storage unit, confirming a first bit transmission protocol in the i value arrangement table, acquiring data of a designated data source through the content of the transmission protocol, and transmitting the acquired data to a redundant data removing unit after the acquisition is finished;
s2, confirming a next group of transmission protocols according to the i value arrangement table, confirming repeated data between the transmission protocols and a previous group of transmission protocols, reserving the repeated data on the basis of the previous group of transmission protocols, supplementing corresponding non-repeated data at corresponding positions of the previous group of transmission protocols according to specific positions of the non-repeated data, acquiring data of a designated data source by adopting a processed protocol after processing, and transmitting the acquired data to a redundant data removing unit;
and S3, repeatedly executing the step S2, sequentially collecting the data of different data sources, and transmitting the collected data into the redundant data removing unit.
Specifically, according to the confirmed i value arrangement table, different data sources are sequentially collected according to an i value arrangement table sorting mode, when the next group of data sources are collected after the previous group of data sources are collected, repeated data of the previous group of data sources and the previous group of data sources are reserved, non-repeated data in the previous group of data sources are directly filled into the previous group of data sources to obtain a transmission protocol of the previous group of data sources, and data collection is carried out according to the confirmed transmission protocol.
Example two
In the implementation process of this embodiment, compared with the first embodiment, the specific difference is that:
the redundant data removing unit is used for receiving collected data of different data sources, confirming repeated data in the different data sources, replacing the repeated data by adopting a repeated mark, generating a repeated data replacement table, and transmitting the processed data packets of the different data sources into the capacity reducing unit, wherein the specific mode for replacing is as follows:
receiving collected data of different data sources, and generating different data packets from the different collected data;
confirm the repeated data in the same data packet and adopt the repeated mark CF k Substitution of the duplicate data, wherein k=1, 2, … …, m, and k is 1 or 2, represents different duplicate data;
after the replacement is finished, according to the repetition mark CF k And generating a repeated data substitution table by the substituted repeated data, storing the repeated data substitution table in the corresponding data packet, and transmitting the processed data packet to the capacity reduction unit.
Specifically, after data acquisition is performed on a certain data source, partial repeated data exist, different repeated marks are directly adopted for replacing different repeated data, a corresponding repeated data replacement table is generated after the replacement is finished, and then the corresponding repeated data can be filled up through the repeated data replacement table.
The capacity reduction unit performs capacity reduction on data packets of different data sources, and transmits the data packets after capacity reduction processing to the storage unit for storage, wherein the specific mode of performing capacity reduction is as follows:
a dividing interval is arranged between each group of different data in the data packet, and interval marks are arranged at the positions of each group of dividing intervals;
after the interval marks are set, combining a plurality of groups of different data, and transmitting the combined data packets into a storage unit for storage;
specifically, in the plurality of groups of data packets, corresponding intervals are arranged between each group of data, and in the actual storage process, the corresponding intervals occupy a certain data capacity, so that the intervals are removed in the form of interval marks, and the corresponding data packet capacity is reduced.
The data extraction unit is operated by an external operator, extracts the data packet of the designated data source, automatically deletes the interval mark in the extraction process, generates an original segmentation interval, and simultaneously replaces the repeated mark in the data packet according to the repeated data replacement table stored in the data packet to obtain the original acquired data, and displays the data for the external operator to check.
The partial data in the formula are all obtained by removing dimension and taking the numerical value for calculation, and the formula is a formula closest to the real situation obtained by simulating a large amount of collected data through software; the preset parameters and the preset threshold values in the formula are set by those skilled in the art according to actual conditions or are obtained through mass data simulation.
The above embodiments are only for illustrating the technical method of the present application and not for limiting the same, and it should be understood by those skilled in the art that the technical method of the present application may be modified or substituted without departing from the spirit and scope of the technical method of the present application.
Claims (6)
1. The laboratory unified data acquisition platform based on the multiple data sources of the Internet of things is characterized by comprising a protocol acquisition unit, an acquisition management center and a data extraction unit;
the acquisition management center comprises a protocol analysis unit, a self-adaptive processing unit, an acquisition unit, a storage unit, a capacity reduction unit and a redundant data removal unit;
the protocol acquisition unit is used for acquiring transmission protocols of different data sources and sending the acquired transmission protocols to the acquisition management center;
the protocol analysis unit receives the acquired transmission protocols of different data sources, and confirms the transmission protocol with the minimum overall capacity according to the transmission protocol content of the different data sources and marks the transmission protocol as an initial protocol;
the self-adaptive processing unit performs similarity analysis on transmission protocols of different data sources according to the determined initial protocol, confirms a second class protocol belonging to the initial protocol, confirms a conversion data packet, transmits the confirmed conversion data packet into the storage unit for storage, sequentially processes different transmission protocols, generates an i-value list and transmits the i-value list into the storage unit for storage;
the acquisition unit confirms a data acquisition rule according to the i value list, performs data acquisition on different data sources, performs protocol conversion after the acquisition of a certain group of data sources is completed, acquires the next group of data sources, and transmits the acquired data of the different data sources to the redundant data removal unit;
the redundant data removing unit is used for receiving collected data of different data sources, confirming repeated data in the different data sources, replacing the repeated data by adopting a repeated mark, generating a repeated data replacement table and transmitting the processed data packets of the different data sources into the capacity reducing unit;
the capacity reduction unit is used for carrying out capacity reduction on the data packets of different data sources and transmitting the data packets subjected to capacity reduction processing into the storage unit for storage.
2. The laboratory unified data acquisition platform based on the multiple data sources of the internet of things according to claim 1, wherein the protocol analysis unit confirms the specific mode of the transmission protocol with the minimum capacity as follows:
confirming IP address contents existing in different transmission protocols and marking the contents;
reject such marked content, confirm the capacity parameter of the corresponding transport protocol, and mark it as RL i Wherein i represents different transmission protocols, and the marked transmission protocols are transmitted to a storage unit for storage;
from several sets of capacity parameters RL i And (3) confirming the minimum value, marking the transmission protocol corresponding to the minimum value as an initial protocol, and transmitting the whole content of the initial protocol into the self-adaptive processing unit, wherein the whole content comprises the IP address content existing in the initial protocol.
3. The laboratory unified data acquisition platform based on various data sources of the internet of things according to claim 2, wherein the specific way for the adaptive processing unit to perform similarity analysis on the transmission protocols of different data sources is as follows:
according to the confirmed initial protocol, carrying out coincidence analysis on the initial protocol and transmission protocols of other different data sources, confirming a group of transmission protocols with the highest coincidence with the initial protocol, marking the transmission protocols as two types of protocols, if no coincidence exists among the transmission protocols of the different data sources, confirming the transmission protocol capacity values of the different data sources, confirming the capacity values of the initial protocol, carrying out difference processing on the transmission protocol capacity values of the different data sources and the capacity values of the initial protocol, confirming the analysis difference value, marking a group of transmission protocols with the smallest analysis difference value as two types of protocols, and if a plurality of groups of transmission protocols with the same difference value exist, randomly selecting one group of transmission protocols and marking the one group of transmission protocols as two types of protocols;
and then taking the second class protocol as an initial protocol, adopting the same mode to confirm a group of transmission protocols, marking the transmission protocols as three classes of protocols, then taking the three classes of protocols as the initial protocol to confirm the fourth class of protocols, and so on, generating an i value list according to the mark i and according to the initial protocol, the second class protocol and the sequence of the subsequent transmission protocols, and transmitting the generated i value list into a storage unit for storage.
4. The laboratory unified data acquisition platform based on various data sources of internet of things according to claim 3, wherein the specific way for the acquisition unit to acquire data of different data sources is:
s1, directly extracting an i value arrangement table from a storage unit, confirming a first bit transmission protocol in the i value arrangement table, acquiring data of a designated data source through the content of the transmission protocol, and transmitting the acquired data to a redundant data removing unit after the acquisition is finished;
s2, confirming a next group of transmission protocols according to the i value arrangement table, confirming repeated data between the transmission protocols and a previous group of transmission protocols, reserving the repeated data on the basis of the previous group of transmission protocols, supplementing corresponding non-repeated data at corresponding positions of the previous group of transmission protocols according to specific positions of the non-repeated data, acquiring data of a designated data source by adopting a processed protocol after processing, and transmitting the acquired data to a redundant data removing unit;
and S3, repeatedly executing the step S2, sequentially collecting the data of different data sources, and transmitting the collected data into the redundant data removing unit.
5. The laboratory unified data acquisition platform based on the multiple data sources of the internet of things according to claim 4, wherein the specific way for replacing the repeated data by the redundant data removal unit by adopting the repeated mark is as follows:
receiving collected data of different data sources, and generating different data packets from the different collected data;
confirm the repeated data in the same data packet andusing repeated marks CF k Substitution of the duplicate data, wherein k=1, 2, … …, m, and k is 1 or 2, represents different duplicate data;
after the replacement is finished, according to the repetition mark CF k And generating a repeated data substitution table by the substituted repeated data, storing the repeated data substitution table in the corresponding data packet, and transmitting the processed data packet to the capacity reduction unit.
6. The laboratory unified data acquisition platform based on multiple data sources of internet of things according to claim 5, wherein the specific way for the capacity reduction unit to reduce the capacity of the data packets of different data sources is as follows:
a dividing interval is arranged between each group of different data in the data packet, and interval marks are arranged at the positions of each group of dividing intervals;
after the interval mark is set, combining a plurality of groups of different data, and transmitting the combined data packet into a storage unit for storage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310561587.2A CN116614492B (en) | 2023-05-18 | 2023-05-18 | Laboratory unified data acquisition platform based on various data sources of internet of things |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310561587.2A CN116614492B (en) | 2023-05-18 | 2023-05-18 | Laboratory unified data acquisition platform based on various data sources of internet of things |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116614492A true CN116614492A (en) | 2023-08-18 |
| CN116614492B CN116614492B (en) | 2023-10-24 |
Family
ID=87679392
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310561587.2A Active CN116614492B (en) | 2023-05-18 | 2023-05-18 | Laboratory unified data acquisition platform based on various data sources of internet of things |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116614492B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117033498A (en) * | 2023-10-10 | 2023-11-10 | 浙江宇通信息技术工程有限公司 | Integrated converged communication command method and system |
| CN117880338A (en) * | 2024-03-12 | 2024-04-12 | 时代云英(深圳)科技有限公司 | Data acquisition system based on internet of things equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108449407A (en) * | 2018-03-14 | 2018-08-24 | 中煤科工集团重庆研究院有限公司 | Multi-source heterogeneous coal mine safety monitoring collecting method |
| CN111090268A (en) * | 2020-03-24 | 2020-05-01 | 上海飞旗网络技术股份有限公司 | Data acquisition method and device based on thread division and data acquisition equipment |
| CN111737329A (en) * | 2020-06-13 | 2020-10-02 | 北京京投亿雅捷交通科技有限公司 | Unified data acquisition platform for rail transit |
| CN111901381A (en) * | 2020-06-29 | 2020-11-06 | 北京智芯微电子科技有限公司 | Internet of things agent device based on edge calculation and data decision method |
| CN111914015A (en) * | 2020-08-25 | 2020-11-10 | 河北时代电子有限公司 | Multisource data gateway data analysis early warning system based on industrial protocol |
| CN112255984A (en) * | 2020-10-28 | 2021-01-22 | 河北时代电子有限公司 | Multisource data acquisition system based on distributed industrial protocol analysis technology |
| CN114943089A (en) * | 2022-07-22 | 2022-08-26 | 清华大学苏州汽车研究院（吴江） | Information security protection system for enterprise operation online data sharing |
| CN115150204A (en) * | 2022-09-05 | 2022-10-04 | 广州中浩控制技术有限公司 | Data transmission system |
| CN115248578A (en) * | 2022-09-22 | 2022-10-28 | 南京旭上数控技术有限公司 | Industrial equipment data acquisition method |
-
2023
- 2023-05-18 CN CN202310561587.2A patent/CN116614492B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108449407A (en) * | 2018-03-14 | 2018-08-24 | 中煤科工集团重庆研究院有限公司 | Multi-source heterogeneous coal mine safety monitoring collecting method |
| CN111090268A (en) * | 2020-03-24 | 2020-05-01 | 上海飞旗网络技术股份有限公司 | Data acquisition method and device based on thread division and data acquisition equipment |
| CN111737329A (en) * | 2020-06-13 | 2020-10-02 | 北京京投亿雅捷交通科技有限公司 | Unified data acquisition platform for rail transit |
| CN111901381A (en) * | 2020-06-29 | 2020-11-06 | 北京智芯微电子科技有限公司 | Internet of things agent device based on edge calculation and data decision method |
| CN111914015A (en) * | 2020-08-25 | 2020-11-10 | 河北时代电子有限公司 | Multisource data gateway data analysis early warning system based on industrial protocol |
| CN112255984A (en) * | 2020-10-28 | 2021-01-22 | 河北时代电子有限公司 | Multisource data acquisition system based on distributed industrial protocol analysis technology |
| CN114943089A (en) * | 2022-07-22 | 2022-08-26 | 清华大学苏州汽车研究院（吴江） | Information security protection system for enterprise operation online data sharing |
| CN115150204A (en) * | 2022-09-05 | 2022-10-04 | 广州中浩控制技术有限公司 | Data transmission system |
| CN115248578A (en) * | 2022-09-22 | 2022-10-28 | 南京旭上数控技术有限公司 | Industrial equipment data acquisition method |
Non-Patent Citations (1)
| Title |
|---|
| 冯文博; 洪征; 吴礼发; 付梦琳: "网络协议识别技术综述", 《中国人民解放军陆军工程大学指挥控制工程学院》, pages 3604 - 3614 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117033498A (en) * | 2023-10-10 | 2023-11-10 | 浙江宇通信息技术工程有限公司 | Integrated converged communication command method and system |
| CN117033498B (en) * | 2023-10-10 | 2023-12-19 | 浙江宇通信息技术工程有限公司 | Integrated converged communication command method and system |
| CN117880338A (en) * | 2024-03-12 | 2024-04-12 | 时代云英(深圳)科技有限公司 | Data acquisition system based on internet of things equipment |
| CN117880338B (en) * | 2024-03-12 | 2024-05-14 | 时代云英(深圳)科技有限公司 | Data acquisition system based on internet of things equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116614492B (en) | 2023-10-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116614492B (en) | Laboratory unified data acquisition platform based on various data sources of internet of things | |
| CN111476002B (en) | Data file coding format conversion method and system | |
| CN103067218B (en) | A kind of express network packet content analytical equipment | |
| CN106095597B (en) | Client data processing method and processing device | |
| CN106850559B (en) | Extensible network protocol analysis system and method | |
| CN103942311B (en) | Multiplexing method of monitoring system variables | |
| CN103810197A (en) | Hadoop-based data processing method and system | |
| CN109407578A (en) | A kind of data processing method of Profibus-DP bus control unit | |
| CN101853025B (en) | Method and device for data acquisition and processing of multiple industrial-control system platforms | |
| CN112416557B (en) | Method and device for determining call relation, storage medium and electronic device | |
| CN109270885B (en) | Data communication method, device and equipment for monitoring PLC system and storage medium | |
| CN109299132B (en) | SQL data processing method and system and electronic equipment | |
| CN103957119A (en) | Method for managing network devices through MIB file and browser | |
| CN116319878A (en) | Method, equipment and computer storage medium for data transmission | |
| CN103914304B (en) | Method for converting different structure type parameters on basis of SAP (service access point) platforms | |
| CN110191028A (en) | It can the test device of interconnection equipment of software definition, system and method | |
| CN112532432B (en) | Automatic mapping method and system based on LTU terminal | |
| CN112217896A (en) | JSON message conversion method and related device | |
| CN110620682B (en) | Resource information acquisition method and device, storage medium and terminal | |
| CN117880338B (en) | Data acquisition system based on internet of things equipment | |
| CN109714218B (en) | Internet of things server configuration information synchronization method | |
| CN111782475A (en) | Distributed log access method and system based on command mode | |
| CN113759884B (en) | Method and system for generating input/output point product file of distributed control system | |
| CN211857459U (en) | Debugging system of FPGA system | |
| CN116633870B (en) | Operation and maintenance data processing system and method based on cloud end-added mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |