CN115766615B - Cloud-edge-based equipment twin data management method and system - Google Patents
Cloud-edge-based equipment twin data management method and system Download PDFInfo
- Publication number
- CN115766615B CN115766615B CN202211527281.7A CN202211527281A CN115766615B CN 115766615 B CN115766615 B CN 115766615B CN 202211527281 A CN202211527281 A CN 202211527281A CN 115766615 B CN115766615 B CN 115766615B
- Authority
- CN
- China
- Prior art keywords
- data
- cloud
- equipment
- rule
- edge
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a cloud-edge-based equipment twin data management method and a cloud-edge-based equipment twin data management system, wherein the cloud-edge-based equipment twin data management method comprises the steps of receiving a registration request of a device terminal by a cloud end, wherein the registration request comprises an equipment data portrait; based on the equipment data portrait, establishing a data storage or uploading strategy rule of the equipment terminal to form an equipment rule base; the equipment terminal respectively uploads the generated data to the cloud or stores the data to the edge node according to the equipment rule base; according to the cloud-based edge computing technology framework, the transmission assembly and the processing assembly are issued to the edge node from the cloud for deployment, data uploading pre-management is directly carried out on the edge, whether the data need to be stored at the edge side is analyzed by combining the characteristics of various devices and the data, the data are uploaded to the cloud for storage and use through the transmission system according to the network condition of the edge cloud before transmission, the online rate and instantaneity of the data are improved, and the twin data application value of the device is improved.
Description
Technical Field
The invention relates to the technical field of data management, in particular to a cloud edge-based equipment twin data management method and system.
Background
With the development and the gradual maturity of cloud computing and the internet of things technology and the continuous expansion of the 5G network scale, the number of terminal devices is rapidly increased, and mass data is generated in the whole life cycle of the devices.
The traditional internet of things technology has the advantages that data generated by equipment are all uploaded to a cloud center for processing, the processing speed is influenced by factors such as computing capacity of the cloud center and network bandwidth, the data is excessively dependent on a network during uploading, the transmission speed is influenced by the network, hysteresis exists in the data, meanwhile, the expansion of data volume increases the high consumption of cloud center storage and computing resources, and how to manage the effective uploading of mass equipment data, so that mapping between equipment entities and virtual worlds is better achieved, and the problem to be solved is urgent.
The data volume generated by the terminal equipment is huge, the computing capacity and the resource size of the terminal equipment are uneven, the requirement of directly carrying out mass data processing on the local after the data is generated cannot be met, meanwhile, the data cannot be uploaded in real time in a complex network environment, even the risk of direct loss is faced, and the accuracy of twin information mapping and data fusion analysis of the subsequent equipment is affected.
Disclosure of Invention
Aiming at the defects existing in the problems, the invention provides a cloud-edge-based equipment twinning data management method and system.
In order to achieve the above object, the present invention provides a cloud-edge-based device twin data management method, including:
the cloud receives a registration request of a receiving device terminal, wherein the registration request comprises a device data portrait;
based on the equipment data portraits, establishing data storage or uploading policy rules of the equipment terminals to form an equipment rule base;
the equipment terminal respectively uploads the generated data to the cloud or stores the data to an edge node according to the equipment rule base;
the method for constructing the equipment rule base comprises the following steps of:
setting a storage rule and a cloud loading rule for the data of the equipment terminal;
the storage rule comprises a storage size setting and a rotation rule setting;
the cloud uploading rule comprises the steps of configuring the data uploading priority weight;
the number of repetitions is configured.
Preferably, the constructing the rule base of the device further includes updating the rule base of the edge node, and the steps include:
the cloud end is provided with a controller, and the controller is used for detecting the cloud end rule base and issuing rules of the cloud end rule base to the edge node;
the edge node is provided with an agent, and the agent is in communication connection with the controller and receives rules from the controller.
Preferably, the agent receiving the rule from the controller includes:
if the rule is received for the first time, directly storing the rule;
if not, updating the difference from the first configuration rule.
Preferably, the edge node runs a data transmission component and a data processing component;
the data transmission component comprises a queue to be uploaded, the data is uploaded to the queue to be uploaded based on a rule base of the edge node, the data is uploaded to the cloud through a priority weight sequence, and when the data is uploaded to the cloud, the data are ordered according to the sequence from first to last if the same priority weight exists;
the data processing component maintains a data storage state based on the storage rules.
Preferably, the device data representation includes a protocol type and format description, a device attribute and data structure description, and a device access mode description.
The invention also comprises a cloud-edge-based equipment twin data management system, which comprises:
the registration module is used for receiving a registration request of the equipment terminal by the cloud, wherein the registration request comprises an equipment data portrait;
the establishing module is used for establishing data storage or uploading policy rules of the equipment terminal based on the equipment data portrait to form an equipment rule base;
the uploading storage module is used for uploading the generated data to the cloud or storing the data to an edge node according to the equipment rule base by the equipment terminal;
the method for constructing the equipment rule base comprises the following steps of:
setting a storage rule and a cloud loading rule for the data of the equipment terminal;
the storage rule comprises a storage size setting and a rotation rule setting;
the cloud uploading rule comprises the steps of configuring the data uploading priority weight;
the number of repetitions is configured.
Preferably, the constructing the rule base of the device further includes updating the rule base of the edge node, and the steps include:
the cloud end is provided with a controller, and the controller is used for detecting the cloud end rule base and issuing rules of the cloud end rule base to the edge node;
the edge node is provided with an agent, and the agent is in communication connection with the controller and receives rules from the controller.
Preferably, the agent receiving the rule from the controller includes:
if the rule is received for the first time, directly storing the rule;
if not, updating the difference from the first configuration rule.
Preferably, the edge node runs a data transmission component and a data processing component;
the data transmission component comprises a queue to be uploaded, the data is uploaded to the queue to be uploaded based on a rule base of the edge node, the data is uploaded to the cloud through a priority weight sequence, and when the data is uploaded to the cloud, the data are ordered according to the sequence from first to last if the same priority weight exists;
the data processing component maintains a data storage state based on the storage rules.
Preferably, the device data representation includes a protocol type and format description, a device attribute and data structure description, and a device access mode description.
Compared with the prior art, the invention has the beneficial effects that:
according to the cloud-based edge computing technology framework, the transmission assembly and the processing assembly are issued to the edge node from the cloud for deployment, data uploading pre-management is directly carried out on the edge, whether the data need to be stored at the edge side is analyzed by combining the characteristics of various devices and the data, the data are uploaded to the cloud for storage and use through the transmission system according to the network condition of the edge cloud before transmission, the online rate and instantaneity of the data are improved, and the twin data application value of the device is improved.
Drawings
FIG. 1 is a flow chart of a cloud-edge-based device twinning data management method of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, the invention provides a cloud-edge-based device twin data management method, which comprises the following steps:
the cloud receives a registration request of a receiving device terminal, wherein the registration request comprises a device data portrait, and the device data portrait comprises a protocol type and format description, a device attribute and data structure description and a device access mode description;
based on the equipment data portrait, establishing a data storage or uploading strategy rule of the equipment terminal to form an equipment rule base;
the equipment terminal respectively uploads the generated data to the cloud or stores the data to the edge node according to the equipment rule base;
the method for constructing the equipment rule base comprises the following steps of:
setting a storage rule and a cloud loading rule for data of the equipment terminal;
the storage rules comprise setting storage size and rotation rules;
the cloud uploading rule comprises configuration data uploading priority weights, and the weight value range is between 0 and 100;
the number of repetitions is configured.
Specifically, the cloud-up rule further includes a configuration threshold, where the threshold range is used to preferentially upload which data when the network is unstable, and its configuration field is as follows:
further, the step of constructing the device rule base further comprises updating the rule base of the edge node, and the step comprises the following steps:
the cloud end is provided with a controller, and the controller is used for detecting a cloud end rule base and issuing rules of the cloud end rule base to the edge node; the controller continuously monitors the rule configuration in the cloud rule base to sense the new addition and change of the equipment rules, if the change exists, the latest rules are issued to the edge nodes where the equipment is located in real time, and only the changed rules are updated in an incremental mode in the issuing process;
the edge node is provided with a agent, and the agent communicates with the cloud controller through the quick or websocket and receives rules from the controller. The analysis is the first issue when received, and when the configuration is received for the first time, it is stored in the disk of the edge node. And matching the difference between the subsequent updating configuration and the initial configuration, and performing incremental updating on the content in the disk. The edge equipment perceives the update content in real time and applies the configuration change in real time to realize the configuration hot update.
The edge node operates a data transmission component and a data processing component, and deploys the transmission component and the processing component into the edge node generating data through a cloud-native edge computing technology;
the data transmission assembly obtains rule bases of all devices on the edge node in a mounting mode so as to obtain device rule configuration; the data transmission assembly comprises a queue to be uploaded, the data is uploaded to the queue to be uploaded based on a rule base of the edge node, the data is uploaded to the cloud through a priority weight sequence, when the data is uploaded to the cloud, if the same priority weight occurs, the data are ordered according to the sequence from first to last, and at the moment, the sequence of the uploading list is changed. Ordering occurs on a first come last come principle when the same priority occurs. The priority of the long-waiting low-priority data is gradually increased along with time, so that the phenomenon of starvation is avoided, and the cloud receives the uploaded data and stores the data into a corresponding database;
the data processing component maintains a data storage state based on the storage rules.
According to the method, the importance degree of the data is considered in the uploading of the edge node data, the high-value data circulation efficiency is improved, and the data vitality in the complex network environment is enhanced; according to the equipment twin data with different characteristics, the twin data labeling full life cycle management can be realized, the instantaneity and the online rate of the traditional Internet of things equipment data are improved, the data value is improved, and the cloud resource cost is reduced.
The invention also comprises a cloud-edge-based equipment twin data management system, which comprises:
the registration module is used for receiving a registration request of the equipment terminal by the cloud, wherein the registration request comprises an equipment data portrait, and the equipment data portrait comprises protocol type and format description, equipment attribute and data structure description and equipment access mode description;
the establishing module is used for establishing data storage or uploading policy rules of the equipment terminal based on the equipment data portrait to form an equipment rule base;
the uploading storage module is used for uploading the generated data to the cloud or storing the data to the edge node according to the equipment rule base by the equipment terminal;
the method for constructing the equipment rule base comprises the following steps of:
setting a storage rule and a cloud loading rule for data of the equipment terminal;
the storage rules comprise setting storage size and rotation rules;
the cloud uploading rule comprises configuration data uploading priority weights, and the weight value range is between 0 and 100;
the number of repetitions is configured.
Specifically, the cloud-up rule further includes a configuration threshold, where the threshold range is used to preferentially upload which data when the network is unstable, and its configuration field is as follows:
further, the step of constructing the device rule base further comprises updating the rule base of the edge node, and the step comprises the following steps:
the cloud end is provided with a controller, and the controller is used for detecting a cloud end rule base and issuing rules of the cloud end rule base to the edge node; the controller continuously monitors the rule configuration in the cloud rule base to sense the new addition and change of the equipment rules, if the change exists, the latest rules are issued to the edge nodes where the equipment is located in real time, and only the changed rules are updated in an incremental mode in the issuing process;
the edge node is provided with a agent, and the agent communicates with the cloud controller through the quick or websocket and receives rules from the controller. The analysis is the first issue when received, and when the configuration is received for the first time, it is stored in the disk of the edge node. And matching the difference between the subsequent updating configuration and the initial configuration, and performing incremental updating on the content in the disk. The edge equipment perceives the update content in real time and applies the configuration change in real time to realize the configuration hot update.
The edge node operates a data transmission component and a data processing component, and deploys the transmission component and the processing component into the edge node generating data through a cloud-native edge computing technology;
the data transmission assembly obtains rule bases of all devices on the edge node in a mounting mode so as to obtain device rule configuration; the data transmission assembly comprises a queue to be uploaded, the data is uploaded to the queue to be uploaded based on a rule base of the edge node, the data is uploaded to the cloud through a priority weight sequence, when the data is uploaded to the cloud, if the same priority weight occurs, the data are ordered according to the sequence from first to last, and at the moment, the sequence of the uploading list is changed. Ordering occurs on a first come last come principle when the same priority occurs. The priority of the long-waiting low-priority data is gradually increased along with time, so that the phenomenon of starvation is avoided, and the cloud receives the uploaded data and stores the data into a corresponding database;
the data processing component maintains a data storage state based on the storage rules.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. The cloud edge-based equipment twin data management method is characterized by comprising the following steps of:
the cloud receives a registration request of a device terminal, wherein the registration request comprises a device data portrait, and the device data portrait comprises a protocol type and format description, a device attribute and data structure description and a device access mode description;
based on the equipment data portraits, establishing data storage or uploading policy rules of the equipment terminals to form an equipment rule base;
the equipment terminal respectively uploads the generated data to the cloud or stores the data to an edge node according to the equipment rule base;
the method for constructing the equipment rule base comprises the following steps of:
setting a storage rule and a cloud loading rule for the data of the equipment terminal;
the storage rule comprises a storage size setting and a rotation rule setting;
the cloud uploading rule comprises the steps of configuring the data uploading priority weight;
the number of repetitions is configured.
2. The cloud-edge based device twinning data management method of claim 1, wherein constructing a device rule base further comprises updating a rule base of edge nodes, the steps comprising:
the cloud end is provided with a controller, and the controller is used for detecting the cloud end rule base and issuing rules of the cloud end rule base to the edge node;
the edge node is provided with an agent, and the agent is in communication connection with the controller and receives rules from the controller.
3. The cloud-edge based device twinning data management method of claim 2, wherein the agent receiving a rule from the controller comprises:
if the rule is received for the first time, directly storing the rule;
if not, updating the difference from the first configuration rule.
4. A cloud edge based device twinning data management method in accordance with claim 3, wherein said edge node runs a data transmission component and a data processing component;
the data transmission component comprises a queue to be uploaded, the data is uploaded to the queue to be uploaded based on a rule base of the edge node, the data is uploaded to the cloud through a priority weight sequence, and when the data is uploaded to the cloud, the data are ordered according to the sequence from first to last if the same priority weight exists;
the data processing component maintains a data storage state based on the storage rules.
5. A cloud-edge based device twinning data management system, comprising:
the registration module is used for receiving a registration request of the equipment terminal by the cloud, wherein the registration request comprises an equipment data portrait, and the equipment data portrait comprises protocol type and format description, equipment attribute and data structure description and equipment access mode description;
the establishing module is used for establishing data storage or uploading policy rules of the equipment terminal based on the equipment data portrait to form an equipment rule base;
the uploading storage module is used for uploading the generated data to the cloud or storing the data to an edge node according to the equipment rule base by the equipment terminal;
the method for constructing the equipment rule base comprises the following steps of:
setting a storage rule and a cloud loading rule for the data of the equipment terminal;
the storage rule comprises a storage size setting and a rotation rule setting;
the cloud uploading rule comprises the steps of configuring the data uploading priority weight;
the number of repetitions is configured.
6. The cloud-edge based device twinning data management system of claim 5, wherein constructing a device rule base further comprises updating a rule base of edge nodes, comprising the steps of:
the cloud end is provided with a controller, and the controller is used for detecting the cloud end rule base and issuing rules of the cloud end rule base to the edge node;
the edge node is provided with an agent, and the agent is in communication connection with the controller and receives rules from the controller.
7. The cloud-based device twinning data management system of claim 6, wherein the agent receiving a rule from the controller comprises:
if the rule is received for the first time, directly storing the rule;
if not, updating the difference from the first configuration rule.
8. The cloud-edge based device twinning data management system of claim 7, wherein the edge node runs a data transmission component and a data processing component;
the data transmission component comprises a queue to be uploaded, the data is uploaded to the queue to be uploaded based on a rule base of the edge node, the data is uploaded to the cloud through a priority weight sequence, and when the data is uploaded to the cloud, the data are ordered according to the sequence from first to last if the same priority weight exists;
the data processing component maintains a data storage state based on the storage rules.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211527281.7A CN115766615B (en) | 2022-11-30 | 2022-11-30 | Cloud-edge-based equipment twin data management method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211527281.7A CN115766615B (en) | 2022-11-30 | 2022-11-30 | Cloud-edge-based equipment twin data management method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115766615A CN115766615A (en) | 2023-03-07 |
| CN115766615B true CN115766615B (en) | 2023-08-25 |
Family
ID=85341846
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211527281.7A Active CN115766615B (en) | 2022-11-30 | 2022-11-30 | Cloud-edge-based equipment twin data management method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115766615B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111770014A (en) * | 2020-06-17 | 2020-10-13 | 上海乾隆节能科技有限公司 | Data information processing method, edge gateway and system for processing data information |
| CN112559133A (en) * | 2020-12-22 | 2021-03-26 | 北京滴普科技有限公司 | Cloud-edge coordination system and cloud-edge coordination method based on native container technology |
| KR102262321B1 (en) * | 2019-11-29 | 2021-06-08 | 주식회사 두두원 | IoT GATEWAY SYSTEM FOR INDUSTRIAL |
| CN112988327A (en) * | 2021-03-04 | 2021-06-18 | 杭州谐云科技有限公司 | Container safety management method and system based on cloud edge cooperation |
| CN113708974A (en) * | 2021-09-03 | 2021-11-26 | 南方电网数字电网研究院有限公司 | Edge cloud network system based on self-adaptive networking and cooperation method |
| CN114338353A (en) * | 2021-12-31 | 2022-04-12 | 新开普电子股份有限公司 | Internet of things platform operation and maintenance method based on cloud edge cooperation |
| CN115002148A (en) * | 2022-04-21 | 2022-09-02 | 浪潮云信息技术股份公司 | Internet of things cloud side communication method and system |
-
2022
- 2022-11-30 CN CN202211527281.7A patent/CN115766615B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102262321B1 (en) * | 2019-11-29 | 2021-06-08 | 주식회사 두두원 | IoT GATEWAY SYSTEM FOR INDUSTRIAL |
| CN111770014A (en) * | 2020-06-17 | 2020-10-13 | 上海乾隆节能科技有限公司 | Data information processing method, edge gateway and system for processing data information |
| CN112559133A (en) * | 2020-12-22 | 2021-03-26 | 北京滴普科技有限公司 | Cloud-edge coordination system and cloud-edge coordination method based on native container technology |
| CN112988327A (en) * | 2021-03-04 | 2021-06-18 | 杭州谐云科技有限公司 | Container safety management method and system based on cloud edge cooperation |
| CN113708974A (en) * | 2021-09-03 | 2021-11-26 | 南方电网数字电网研究院有限公司 | Edge cloud network system based on self-adaptive networking and cooperation method |
| CN114338353A (en) * | 2021-12-31 | 2022-04-12 | 新开普电子股份有限公司 | Internet of things platform operation and maintenance method based on cloud edge cooperation |
| CN115002148A (en) * | 2022-04-21 | 2022-09-02 | 浪潮云信息技术股份公司 | Internet of things cloud side communication method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115766615A (en) | 2023-03-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230376347A1 (en) | Task allocation method, apparatus, storage medium, and electronic device | |
| CN106487850B (en) | The methods, devices and systems of mirror image are obtained under a kind of cloud environment | |
| CN104811473B (en) | A kind of method, system and management system for creating virtual non-volatile storage medium | |
| CN111045715B (en) | Cloud game hot updating method, system and readable storage medium | |
| WO2020042612A1 (en) | Method and device for storing and reading a message, server, and storage medium | |
| CN113110800A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN110515728B (en) | Server scheduling method and device, electronic equipment and machine-readable storage medium | |
| CN112491609A (en) | System application architecture discovery method and system based on business service | |
| CN103326925A (en) | Message push method and device | |
| CN115766615B (en) | Cloud-edge-based equipment twin data management method and system | |
| CN116360954B (en) | Industrial Internet of things management and control method and system based on cloud edge cooperative technology | |
| CN107040475B (en) | Resource scheduling method and device | |
| CN114385596A (en) | Data processing method and device | |
| CN114461369A (en) | Adaptive data scheduling system and method for complex application scene | |
| CN112106327B (en) | Resource management and resource allocation method in self-optimization network of heterogeneous processing nodes | |
| CN109962948B (en) | P2P task processing method and device | |
| CN113467718A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN112799849A (en) | Data processing method, device, equipment and storage medium | |
| CN112612848A (en) | Method, device and system for real-time data synchronization, electronic equipment and storage medium | |
| CN113472590B (en) | QoS configuration method based on machine learning in DDS | |
| CN116991541B (en) | Mirror image access request processing method, device, equipment and storage medium | |
| CN114793234B (en) | Message processing method, device, equipment and storage medium | |
| WO2024114645A1 (en) | Instantiation method for virtualization network function (vnf), and apparatus | |
| CN116991815B (en) | Log collection method, device, equipment and medium of distributed storage system | |
| CN108769098B (en) | Method, device and system for establishing network connection of distributed storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |