WO2022000720A1 - 一种边缘计算网关数据的存储方法及系统 - Google Patents
一种边缘计算网关数据的存储方法及系统 Download PDFInfo
- Publication number
- WO2022000720A1 WO2022000720A1 PCT/CN2020/109097 CN2020109097W WO2022000720A1 WO 2022000720 A1 WO2022000720 A1 WO 2022000720A1 CN 2020109097 W CN2020109097 W CN 2020109097W WO 2022000720 A1 WO2022000720 A1 WO 2022000720A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- time
- linked list
- grid
- configuration information
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000013500 data storage Methods 0.000 title abstract description 12
- 238000004590 computer program Methods 0.000 claims abstract description 8
- 230000008859 change Effects 0.000 claims description 34
- 230000002085 persistent effect Effects 0.000 claims description 30
- 230000008569 process Effects 0.000 claims description 6
- 238000013523 data management Methods 0.000 abstract description 4
- 230000000737 periodic effect Effects 0.000 description 9
- 238000007726 management method Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9024—Graphs; Linked lists
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
Definitions
- the present invention relates to the technical field of data management, and more particularly, to a method and system for storing edge computing gateway data.
- Edge computing originated in the media field. It refers to the use of an open platform that integrates network, computing, storage, and application core capabilities on the side close to the source of objects or data to provide the most recent services nearby. Its applications are initiated on the edge side to generate faster network service responses and meet the basic needs of the industry in real-time business, application intelligence, security and privacy protection. Edge computing sits between, or on top of, physical entities and industrial connections. With cloud computing, historical data from edge computing can still be accessed.
- the name of the invention is: A data processing method and system applied to an edge computing gateway (application date: December 18, 2019; application number: 201911312788.9), this scheme discloses a data processing applied to an edge computing gateway
- the method and system include acquiring industrial application data generated when each industrial device in a production system performs an application operation, and forwarding the industrial application data to a plurality of data branches after data preprocessing, so that each data branch performs corresponding branch data Processing; classify and store the industrial application data for branch data processing in the corresponding storage space, and monitor the space capacity of each storage space in real time; when the space capacity of the current storage space is insufficient, according to the industrial application data to be stored
- the corresponding space management strategy is executed according to the amount of data, and the generated space warning log is sent to the cloud server, so that the cloud server can execute the corresponding decision strategy according to the log level of the current log.
- edge computing gateway data there are the following problems: 1) It is difficult to guarantee the consistency of the data in the same period; 2) The speed of persistent storage and update is slower than that of memory operation, and once the power is off, it will lead to The data is inconsistent; 3) The data query efficiency is low, and the data management efficiency requires the gateway to have powerful hardware resources or software capabilities.
- the purpose of the present invention is to overcome the shortage in the prior art that it is difficult to ensure the synchronization of edge computing gateway data storage, and to provide a storage method and system for edge computing gateway data, which can ensure the periodic consistency of edge computing gateway data, and Further, fast query of edge computing gateway data can be realized.
- a method for storing edge computing gateway data of the present invention includes establishing n linked lists in a memory, each linked list is provided with m nodes, and the linked lists are associated with devices in a one-to-one correspondence; then the linked lists are used to store device data, Specifically, first obtain the real-time data of n different devices at the same time; then store the real-time data of the n different devices synchronously to the nodes of the respective linked lists, wherein each node stores the time interval between the start time and the end time of the data Therefore, the periodic storage of data can be ensured. Further, the data of n different devices at the same time are stored in the corresponding linked list with the same node sequence number, that is, the periodic consistency of device data can be guaranteed.
- the persistent storage space is the hard disk.
- a time wheel is established in the persistent storage space, and a grid is added to the time wheel every unit period, and each unit period corresponds to a grid of the time wheel; each grid corresponds to a linked list A, and the linked list A has n Node a; then store the data of n devices in the unit period to the linked list A of the corresponding grid in sequence; store the data of the xth device to the xth node a in the linked list A of the corresponding grid; where x ⁇ [1,2 ,3...n].
- the real-time data includes configuration information, and when the configuration information of a certain device changes within a certain unit period, a grid is added on the time wheel according to the current configuration information change time, and the newly added grid is provided with a linked list A; Store all device data in the time period from the start time of the unit period or the time period from the last configuration information change time to the current configuration information change time in the linked list A of the newly added grid.
- the storage method of the present invention is as follows: the real-time data includes configuration information, and when the configuration information of a certain device changes at time t, the data of n devices stored in the memory in the period from the last change time t0 to time t are saved. to persistent storage, where t0 ⁇ [0,1,2...t].
- the specific process of saving the data of n devices stored in memory in the period from the last change time t0 to time t to the persistent storage space is as follows: establishing a time wheel in the persistent storage space, when the configuration information of the device changes , then add a grid on the time wheel according to the change time of the configuration information; each grid corresponds to a linked list B, and the linked list B is provided with n nodes b; The data of n devices are sequentially stored in the linked list B of the corresponding grid; the data of the y-th device is stored in the y-th node b in the linked list B of the corresponding grid; where y ⁇ [1,2,3...n].
- An edge computing gateway data storage system of the present invention includes a memory and a processor; the memory is used for storing a computer program; the processor is used for executing the computer program to realize the above-mentioned storage method for edge computing gateway data.
- edge computing gateway data of the present invention by setting up multiple linked lists in the memory to store corresponding device data, it can be ensured that a certain node corresponding to each linked list stores data of the same period, thereby ensuring that different devices
- the synchronization of data storage can further realize the periodic consistency of edge computing gateway data.
- the present invention stores the device data persistently by setting the time wheel, which facilitates the addition, deletion, management and query of the data, and further increases the grid by the configuration information, so that the data can be quickly queried according to the change of the configuration information, and no additional settings are required.
- the index can quickly locate the data that needs to be queried through the binary search of the time wheel, which greatly improves the efficiency of data retrieval and query, and saves a lot of storage space.
- the system of the invention can realize the storage method of the gateway data, ensure the periodic consistency of the edge computing gateway data, and realize the fast query of the edge computing gateway data.
- Fig. 1 is the schematic flow chart of the device data storage to the internal memory in the present invention
- FIG. 2 is a schematic flowchart of the storage of device data to a persistent storage space in the present invention.
- a method for storing data of an edge computing gateway of the present invention is applied to various industrial equipment in an industrial system.
- the edge computing gateway collects the data of each industrial equipment, and the present invention can store data in the edge computing gateway.
- the data of various devices is stored synchronously to ensure the periodic consistency of the data of each device.
- the specific steps of the method of the present invention are:
- n linked lists are established in the memory according to the number of devices, each linked list has m nodes, and n and m are both integers; further, the linked list is associated with the device one-to-one, that is, one device corresponds to a linked list Used to store data.
- the specific process is as follows:
- the first node in each linked list stores data from 0 to T
- the second node stores data from T to T 2T data
- the Kth node stores (K-1)T ⁇ KT data, K ⁇ [1,2,3...m].
- the data collected in the period 0-T of n devices is stored to the first node of each corresponding linked list, that is, the data of the p-th device is stored To the first node of the p-th linked list, p ⁇ [1,2,3...n], it can ensure that a certain node in each linked list saves the data of the same segment, thus ensuring the data storage of different devices
- the synchronization can further realize the periodic consistency of edge computing gateway data.
- the memory has a fast reading speed for data, but it is difficult to store a large amount of data of the device, and then the data of the device is moved from the memory to a persistent storage space.
- the persistent storage space in this embodiment is a hard disk.
- the memory data when the memory data is full, or the data is periodically and synchronously written into the persistent storage space. In this embodiment, the memory periodically writes device data into the persistent storage space synchronously.
- a unit period is set first, and the data of n devices in the memory is synchronously stored in the persistent storage space at every unit period;
- the time interval between the unit time period and the start time and the end time of the data stored by the node is equal, that is, the unit time period is T, and the memory sequentially stores the equipment data in the time periods of 0 ⁇ T, T ⁇ 2T, 2T ⁇ 3T, etc. Persistent storage space.
- a time wheel is established in the persistent storage space, and a grid is added to the time wheel every other unit period, and each unit period corresponds to a grid of the time wheel; that is, when the time reaches time T, a grid is added to the time wheel.
- Grid the newly added grid corresponds to the unit period 0 ⁇ T; in the same way, when the time reaches 2T, a second grid is added to the time wheel, and the newly added grid corresponds to the unit period T ⁇ 2T.
- the qth grid is added to the time wheel, and the qth grid corresponds to (q-1)T ⁇ qT.
- each grid is provided with a linked list A
- the linked list A is provided with n nodes a; that is, the number of nodes a in each linked list A is the same as the number of devices.
- This embodiment takes the device data storage in the 0-T period as an example.
- the 0-T period corresponds to the first grid of the time wheel, and the data in the first node of the linked list corresponding to each of the n devices is sequentially stored from the memory to
- the first linked list A of the corresponding grid that is, the data in the first node of the first device corresponding to the linked list is stored in the first node a
- the data in the first node of the second device corresponding to the linked list is stored in the second node a
- the data of the nth device is stored to the nth node a. Therefore, it is convenient to query the data of different devices in this period.
- the data of different devices in the same period can be deleted uniformly, which ensures the periodic consistency of the data of different devices and avoids the data of different devices in different periods. Hybrid storage greatly improves data storage efficiency and query efficiency.
- the real-time data of the present invention includes configuration information, and when the configuration information changes, the device data stored in the memory is written into the persistent storage space. Specifically, when the configuration information of a certain device changes within a certain unit period, a grid is added to the time wheel according to the moment when the current configuration information changes, and the newly added grid is provided with a linked list A; the grid on the time wheel is based on The timeline is arranged sequentially.
- the configuration information refers to the attributes of the device data. For example, if the device is a motor, the configuration information includes temperature, vibration frequency, vibration torque, current, voltage, unbalance, harmonic current, instantaneous active power, instantaneous Power, power factor and other information. According to the change of configuration information, the time wheel grid is added and the data is stored, which is convenient for data management and retrieval.
- the configuration information change time is t
- the unit time period corresponding to the configuration information change time is 3T to 4T, that is, 3T ⁇ t ⁇ 4T, and all the properties of the motor are collected during the period from 3T to t, and the period from t to 4T
- Some types of motor attributes are collected in the , such as temperature, vibration frequency, vibration torque, current and voltage, which means that the collected data attributes of the motor have changed since time t.
- a new grid P1 is added to the time wheel.
- the grid P1 corresponds to a linked list A
- the time period corresponding to the grid P1 is 3T to t
- the grids corresponding to t to 4T are added after the grid P1 corresponding to 3T to t.
- a new grid is added to the time wheel, and the newly added grid is used to store the start time of the corresponding unit period or the time from the last configuration change time to the current configuration information change time.
- Data within a period of time can ensure the consistency of the data, and can realize the fast retrieval of the data.
- the data is stored according to the change of the configuration information, so that the data can be quickly queried according to the change of the configuration information, no need to set another index, and the binary search of the time wheel can quickly locate the required query. It greatly improves the efficiency of data retrieval and query. Further, the storage space can be allocated according to the configuration information, that is, the node a does not need to set fields for the uncollected data attributes, thereby greatly saving a lot of space.
- An edge computing gateway data storage system of the present invention includes a memory and a processor, where the memory is used to store a computer program; the processor is used to execute the computer program to implement the above-mentioned method for storing edge computing gateway data, thereby ensuring that Period consistency of edge computing gateway data, and further can realize fast query of edge computing gateway data.
- the content of this embodiment is basically the same as that of Embodiment 1.
- the specific process of storing data in the persistent storage space in this embodiment is as follows:
- the real-time data includes configuration information.
- the configuration information of a certain device changes at time t
- the data of n devices stored in memory in the period from the last change time t0 to time t is saved to the persistent storage space, where t0 ⁇ [0,1,2...t]. That is, every time the configuration information of a certain device changes, the data of all devices in the corresponding time period stored in the memory is stored in the persistent storage space.
- a time wheel is established in the persistent storage space, and when the configuration information of the device changes, a grid is added to the time wheel according to the time when the configuration information changes; that is, when there are L configurations in the total time period corresponding to the time wheel If the information changes, the number of grids in the time wheel is L+1; each grid corresponds to a linked list B, and the linked list B has n nodes b; The data of the device is sequentially stored in the linked list B of the corresponding grid; the data of the y-th device is stored in the y-th node b in the linked list B of the corresponding grid; where y ⁇ [1,2,3...n].
- 0 to t0 corresponds to the first grid
- t0 to t corresponds to the second grid
- the data of n devices stored in the memory during the period of 0 to t0 is stored in the linked list B of the first grid
- the data of the first device is stored in the first node b
- the data of the second device is stored in the second node.
- the data of the nth device is stored to the nth node b.
- This embodiment can quickly query data according to changes in configuration information, which greatly improves the efficiency of data retrieval and query
- each linked list B stores the data of all devices in the same segment, which ensures the synchronization of device data, and further Improved cycle consistency of device data.
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
一种边缘计算网关数据的存储方法及系统，涉及数据管理技术领域。上述方法为：在内存中建立n个链表，每个链表设有m个节点，且链表与设备进行一一对应关联；同时获取n个不同设备的实时数据，再将n个不同设备的实时数据同步存储至对应链表的节点，其中，每个节点存储数据的开始时刻和结束时刻之间的时间间隔相同，且n个不同设备同时刻的数据存储至对应链表的节点序号相同。上述系统包括存储器和处理器；存储器用于存储计算机程序，处理器用于执行计算机程序，实现上述的方法。可以保证网关数据的周期一致性，且可以实现对网关数据的快速查询。
Description
本发明涉及数据管理技术领域，更具体地说，涉及一种边缘计算网关数据的存储方法及系统。
边缘计算起源于传媒领域，是指在靠近物或数据源头的一侧，采用网络、计算、存储、应用核心能力为一体的开放平台，就近提供最近端服务。其应用程序在边缘侧发起，产生更快的网络服务响应，满足行业在实时业务、应用智能、安全与隐私保护等方面的基本需求。边缘计算处于物理实体和工业连接之间，或处于物理实体的顶端。而云端计算，仍然可以访问边缘计算的历史数据。
现有技术中，工业系统的设备会产生海量的工业数据，海量工业数据需要进行存储分析，这对网络带宽提出了的巨大的挑战；将边缘计算应用至工业系统，结合边缘计算网关可以实现工业数据上云等IOT互联网应用。例如发明创造名称为：一种应用于边缘计算网关的数据处理方法及系统(申请日：2019年12月18日；申请号：201911312788.9)，该方案公开了一种应用于边缘计算网关的数据处理方法及系统，包括获取生产系统中各工业设备进行应用操作时所产生的工业应用数据，并将该工业应用数据进行数据预处理后转发至多个数据分支，以使各数据分支进行相应的分支数据处理；将进行分支数据处理的工业应用数据分类存储于相应的存储空间内，并对各存储空间的空间容量进行实时监测；当当前存储空间的空间容量不足时，根据所需存储的工业应用数据的数据量执行相应的空间管理策略，并将生成的空间预警日志传送至云端服务器，以使云端服务器根据当前日志的日志等级执行相应的决策策略。该方案解决了工业数据的实时存储管理问题。
但是现有技术中，针对边缘计算网关数据的存储，现有存在以下问题：1) 数据的同周期一致性难以保证；2)持久化存储和更新的速度比内存操作慢，一旦掉电会导致数据不一致；3)数据查询效率低，且数据管理效率要求网关具有强大的硬件资源或软件能力。
综上所述，如何实现边缘计算网关数据的周期一致性，是现有技术亟需解决的问题。
发明内容
1.要解决的问题
本发明的目的在于克服现有技术中，难以保证边缘计算网关数据存储的同步性的不足，提供了一种边缘计算网关数据的存储方法及系统，可以保证边缘计算网关数据的周期一致性，并且进一步可以实现对边缘计算网关数据的快速查询。
2.技术方案
为了解决上述问题，本发明所采用的技术方案如下：
本发明的一种边缘计算网关数据的存储方法，包括在内存中建立n个链表，每个链表设有m个节点，且链表与设备进行一一对应关联；而后利用链表对设备数据进行存储，具体地，先同时获取n个不同设备的实时数据；而后将n个不同设备的实时数据同步存储至各自对应链表的节点，其中，每个节点存储数据的开始时刻和结束时刻之间的时间间隔相同，从而可以保证数据的周期性存储，进一步的n个不同设备同时刻的数据存储至对应链表的节点序号相同，即可以保证设备数据的周期一致性。
进一步地，设定单位时段，每隔一个单位时段将内存中n个设备的数据同步存储至持久性存储空间；本方案中单位时段与节点存储数据的开始时刻和结束时刻之间的时间间隔相等，持久性存储空间为硬盘。其中，每隔一个单位时段将内存中n个设备的数据同步存储至持久性存储空间的具体过程为：
在持久性存储空间内建立时间轮，每隔一个单位时段则在时间轮上增加一个格子，每个单位时段对应一个时间轮的格子；每个格子对应设有链表A，链表A设有n个节点a；而后将单位时段内的n个设备数据依序存储至对应格子 的链表A；第x个设备的数据存储至对应格子的链表A中第x个节点a；其中x∈[1,2,3…n]。
进一步地，实时数据包括配置信息，当某个设备在某个单位时段内配置信息有变化时，根据当前配置信息变化时刻在时间轮上增加一个格子，且该新增的格子设有链表A；将单位时段的开始时刻或者上一个配置信息变化时刻至当前配置信息变化时刻的时段内的所有设备数据存储至新增格子的链表A。通过根据配置信息的变化新增格子并对数据进行存储，从而可实现根据配置信息的变化对数据进行快速查询，不需要另设置索引，大大提高了数据的检索查询效率，并且节省了大量的存储空间。
此外，本发明的存储方法为：实时数据包括配置信息，当某个设备的配置信息在时刻t进行变化时，将上一个变化时刻t0至时刻t时段内的内存存储的n个设备的数据保存至持久性存储空间，其中，t0∈[0,1,2…t]。其中，将上一个变化时刻t0至时刻t时段内的内存存储的n个设备的数据保存至持久性存储空间的具体过程为：在持久性存储空间内建立时间轮，当有设备的配置信息变化时，则根据配置信息变化时刻在时间轮上增加一个格子；每个格子对应设有链表B，链表B设有n个节点b；而后在上一个变化时刻t0至时刻t时段内的内存存储的n个设备的数据依序存储至对应格子的链表B；第y个设备的数据存储至对应格子的链表B中第y个节点b；其中y∈[1,2,3…n]。
本发明的一种边缘计算网关数据的存储系统，包括存储器和处理器；存储器用于存储计算机程序；处理器用于执行计算机程序，实现上述的一种边缘计算网关数据的存储方法。
3.有益效果
相比于现有技术，本发明的有益效果为：
本发明的一种边缘计算网关数据的存储方法，通过在内存中设置多个链表存储对应设备数据，可以保证各链表中对应的某个节点保存的都是同时段的数据，从而可以保证不同设备数据存储的同步性，进一步可以实现边缘计算网关数据的周期一致性。此外，本发明通过设置时间轮对设备数据进行持久性存储， 便于对数据进行增删管理和查询，进一步通过配置信息增加格子，即可实现根据配置信息的变化对数据进行快速查询，不需要另设置索引，通过时间轮的二分法查找，即可快速定位到需要查询的数据，大大提高了数据的检索查询效率，并且节省了大量的存储空间。本发明的系统可以实现网关数据的存储方法，保证了边缘计算网关数据的周期一致性，并且实现了对边缘计算网关数据的快速查询。
图1为本发明中设备数据存储至内存的流程示意图；
图2为本发明中设备数据存储至持久性存储空间的流程示意图。
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例；而且，各个实施例之间不是相对独立的，根据需要可以相互组合，从而达到更优的效果。因此，以下对在附图中提供的本发明的实施例的详细描述并非旨在限制要求保护的本发明的范围，而是仅仅表示本发明的选定实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
为进一步了解本发明的内容，结合附图和实施例对本发明作详细描述。
实施例1
结合图1所示，本发明的一种边缘计算网关数据的存储方法，应用至工业系统中的各种工业设备，边缘计算网关对各工业设备的数据进行采集，本发明可以对边缘计算网关中各种设备的数据进行同步存储，以此保证各设备数据的周期一致性。本发明的方法具体步骤为：
(1)将数据存储至内存
首先，根据设备的数量在内存中建立n个链表，每个链表设有m个节点，n和m均为整数；进一步地，链表与设备进行一一对应关联，即一个设备对应 设有一个链表用于存储数据。针对数据在内存缓存中的存储，具体过程如下：
将同时获取的n个设备的实时数据传输至内存缓存，具体地，将n个不同设备的实时数据同步存储至各自对应链表的节点，值得说明的是，每个节点存储数据的开始时刻和结束时刻之间的时间间隔相同，即每隔一段固定时间，则各设备对应的链表上建立新的节点，将设备的数据存储至新增节点。进一步地，n个不同设备同时刻的数据存储至对应链表的节点序号相同。
本实施例中令每个节点存储数据的开始时刻和结束时刻之间的时间间隔为T，则各链表中第一个节点存储的为0～T的数据，第二个节点存储的为T～2T的数据，以此类推，第K个节点存储的则为(K-1)T～KT的数据，K∈[1,2,3…m]。针对各个设备的实时数据的同步存储，以第一个节点为例，同时将n个设备的0～T时段采集的数据存储至各自对应链表的第一个节点，即将第p个设备的数据存储至第p个链表的第一个节点，p∈[1,2,3…n]，从而可以保证各链表中对应的某个节点保存的都是同时段的数据，从而可以保证不同设备数据存储的同步性，进一步可以实现边缘计算网关数据的周期一致性。
(2)将数据存储至持久性存储空间
内存对于数据的读取速度快，但难以存储设备的大量数据，进而将设备的数据从内存中移至持久性存储空间，本实施例中的持久性存储空间为硬盘。本发明中当内存数据存满时或将数据周期性同步写入持久性存储空间。本实施例中内存则将设备数据周期性同步写入持久性存储空间，具体地，先设定单位时段，每隔一个单位时段将内存中n个设备的数据同步存储至持久性存储空间；本实施例中单位时段与节点存储数据的开始时刻和结束时刻之间的时间间隔相等，即单位时段为T，内存先后依次将0～T、T～2T、2T～3T等时段的设备数据存储至持久性存储空间。
对数据在持久性存储空间的存储进行进一步详细的描述，具体如下：
在持久性存储空间内建立时间轮，每隔一个单位时段则在时间轮上增加一个格子，每个单位时段对应一个时间轮的格子；即当时间到T时刻时，则在时间轮上增加一个格子，该新增的格子对应单位时段0～T；同理当时间到2T时刻 时，则在时间轮上增加第二个格子，该新增的格子对应单位时段T～2T，此次类推，当时间到qT时刻时，则在时间轮上增加第q个格子，第q个格子对应(q-1)T～qT。通过单位时段对应设置格子，从而可以保证数据存储的一致性。
进一步地，每个格子对应设有链表A，链表A设有n个节点a；即每个链表A的节点a的数量与设备的数量相同。将单位时段内的n个设备数据依序存储至对应格子的链表A；第x个设备的数据存储至对应格子的链表A中第x个节点a；其中x∈[1,2,3…n]。本实施例以0～T时段的设备数据存储进行举例，0～T时段对应时间轮的第一个格子，将n个设备各自对应链表的第一个节点内的数据从内存中依序存储至对应格子的第一个链表A，即第一个设备对应链表的第一个节点内的数据存储至第一个节点a，第二个设备对应链表的第一个节点内的数据存储至第二个节点a，以此类推，第n个设备的数据存储至第n个节点a。从而便于对该时段的不同设备的数据进行查询，进一步对数据进行删除时，可以统一删除同时段的不同设备的数据，保证了不同设备的数据的周期一致性，避免了不同设备不同时段数据的混合存储，大大提高了数据的存储效率以及查询效率。
进一步地，结合图2所示，本发明的实时数据包括配置信息，当配置信息变化时，将内存中存储的设备数据写入持久性存储空间。具体地，当某个设备在某个单位时段内配置信息有变化时，根据当前配置信息变化时刻在时间轮上增加一个格子，且该新增的格子设有链表A；时间轮上的格子根据时间轴依序排布。需要说明的是，配置信息指的是设备数据的属性，例如设备为电机，则配置信息包括温度、振动频率、振动力矩、电流、电压、不平衡度、谐波电流、瞬时有功功率、瞬时无功功率、功率因数等信息。根据配置信息变化增加时间轮格子并对数据进行存储，便于对数据进行管理和检索。
进一步通过举例说明，例如配置信息变化时刻为t，该配置信息变化时刻对应的单位时段为3T～4T，即3T≤t≤4T，3T至t时段内采集了电机的所有属性，t至4T时段内采集了电机属性中的某几类，例如温度、振动频率、振动力矩、电流和电压，即表示从t时刻开始电机的采集数据属性有所变化，此时在时间 轮上新增一个格子P1，格子P1对应设置链表A，该格子P1对应的时段为3T～t，t～4T对应的格子则增加于3T～t对应的格子P1后面。
进一步地将单位时段的开始时刻或者上一个配置信息变化时刻至当前配置信息变化时刻的时段内的所有设备数据存储至新增格子的链表A，即包括两种情况：
一、将单位时段的开始时刻至当前配置信息变化时刻的时段内的所有设备数据存储至新增格子的链表A；例如当单位时段3T～4T只有一次配置信息变化时，当前配置信息变化时刻为t，则先将3T至t时段内的n个设备的数据依序存储至格子P1的链表A，具体地，3T至t时段内的第x个设备的数据存储至对应格子P1的链表A中第x个节点a；而后当时间到时刻4T时，则在时间轮上的格子P1后新增一个格子P2，格子P2对应设置链表A格子P2对应的时段为t～4T，再将t至4T时段内的n个设备的数据依序存储至格子P2的链表A，具体地，将t至4T时段内的第x个设备的数据存储至对应格子P2的链表A中第x个节点a；其中x∈[1,2,3…n]。
二、将上一个配置信息变化时刻至当前配置信息变化时刻的时段内的所有设备数据存储至新增格子的链表A，例如：当单位时段3T～4T有多次配置信息变化时，本实施例以两次配置信息变化为例，即t至4T时段内又有一次配置信息变化，令配置信息变化时刻为t1，根据配置信息变化时刻t1在时间轮的格子P1后新增一个格子P2，该格子P2对应设有链表A，链表A对应存储t至新的配置变化时刻t1时段内的所有设备的数据；而后在格子P2后新增一个格子P3，该格子P3对应设有链表A，链表A对应存储t1至4T时段内的所有设备的数据。综上所述，每当有配置信息变化时，即在时间轮上对应新增一个格子，新增的格子用于存储对应单位时段的开始时刻或者上一个配置变化时刻至当前配置信息变化时刻的时段内数据，从而可以保证数据的一致性，并且可以实现数据的快速检索。
此外值得说明的是，根据配置信息的变化对数据进行存储，从而可以根据配置信息的变化对数据进行快速查询，不需要另设置索引，通过时间轮的二分 法查找，即可快速定位到需要查询的数据，大大提高了数据的检索查询效率。进一步地根据配置信息可分配存储空间，即节点a不需要为未采集的数据属性设置字段，进而大大节省了大量的空间。
本发明的一种边缘计算网关数据的存储系统，包括存储器和处理器，该存储器用于存储计算机程序；处理器用于执行计算机程序，实现上述的一种边缘计算网关数据的存储方法，从而可以保证边缘计算网关数据的周期一致性，并且进一步可以实现对边缘计算网关数据的快速查询。
实施例2
本实施例的内容基本同实施例1，本实施例将数据存储至持久性存储空间的具体过程为：
实时数据包括配置信息，当某个设备的配置信息在时刻t进行变化时，将上一个变化时刻t0至时刻t时段内的内存存储的n个设备的数据保存至持久性存储空间，其中，t0∈[0,1,2…t]。即每当某个设备的配置信息变化时，则将内存存储的对应时段的所有设备的数据存储至持久性存储空间。
具体地，在持久性存储空间内建立时间轮，当有设备的配置信息变化时，则根据配置信息变化时刻在时间轮上增加一个格子；即当时间轮对应的总时间段中有L次配置信息变化，则时间轮的格子数量为L+1个；每个格子对应设有链表B，链表B设有n个节点b；在上一个变化时刻t0至时刻t时段内的内存存储的n个设备的数据依序存储至对应格子的链表B；第y个设备的数据存储至对应格子的链表B中第y个节点b；其中y∈[1,2,3…n]。例如0～t0对应第一个格子，t0～t对应第二个格子，以此类推。0～t0时段内的内存存储的n个设备的数据存储至第一个格子的链表B，第一个设备的数据存储至第一个节点b，第二个设备的数据存储至第二个节点b，以此类推，第n个设备的数据存储至第n个节点b。本实施例可以根据配置信息的变化对数据进行快速查询，大大提高了数据的检索查询效率；此外每个链表B保存的都是同时段的所有设备的数据，保证了设备数据的同步性，进而提高了设备数据的周期一致性。
在上文中结合具体的示例性实施例详细描述了本发明。但是，应当理解， 可在不脱离由所附权利要求限定的本发明的范围的情况下进行各种修改和变型。详细的描述和附图应仅被认为是说明性的，而不是限制性的，如果存在任何这样的修改和变型，那么它们都将落入在此描述的本发明的范围内。此外，背景技术旨在为了说明本技术的研发现状和意义，并不旨在限制本发明或本申请和本发明的应用领域。
Claims (9)
- 一种边缘计算网关数据的存储方法，其特征在于，包括：在内存中建立n个链表，每个链表设有m个节点，且链表与设备进行一一对应关联；同时获取n个不同设备的实时数据；将n个不同设备的实时数据同步存储至各自对应链表的节点，其中，每个节点存储数据的开始时刻和结束时刻之间的时间间隔相同，且n个不同设备同时刻的数据存储至对应链表的节点序号相同。
- 根据权利要求1所述的一种边缘计算网关数据的存储方法，其特征在于，设定单位时段，每隔一个单位时段将内存中n个设备的数据同步存储至持久性存储空间。
- 根据权利要求2所述的一种边缘计算网关数据的存储方法，其特征在于，每隔一个单位时段将内存中n个设备的数据同步存储至持久性存储空间的具体过程为：在持久性存储空间内建立时间轮，每隔一个单位时段则在时间轮上增加一个格子，每个单位时段对应一个时间轮的格子；每个格子对应设有链表A，链表A设有n个节点a；将单位时段内的n个设备数据依序存储至对应格子的链表A；第x个设备的数据存储至对应格子的链表A中第x个节点a；其中x∈[1，2，3...n]。
- 根据权利要求3所述的一种边缘计算网关数据的存储方法，其特征在于，实时数据包括配置信息，当某个设备在某个单位时段内配置信息有变化时，根据当前配置信息变化时刻在时间轮上增加一个格子，且该新增的格子设有链表A；将单位时段的开始时刻或者上一个配置信息变化时刻至当前配置信息变化时刻的时段内的所有设备数据存储至新增格子的链表A。
- 根据权利要求1所述的一种边缘计算网关数据的存储方法，其特征在于，实时数据包括配置信息，当某个设备的配置信息在时刻t进行变化时，将上一 个变化时刻t0至时刻t时段内的内存存储的n个设备的数据保存至持久性存储空间，其中，t0∈[0，1，2...t]。
- 根据权利要求5所述的一种边缘计算网关数据的存储方法，其特征在于，将上一个变化时刻t0至时刻t时段内的内存存储的n个设备的数据保存至持久性存储空间的具体过程为：在持久性存储空间内建立时间轮，当有设备的配置信息变化时，则根据配置信息变化时刻在时间轮上增加一个格子；每个格子对应设有链表B，链表B设有n个节点b；在上一个变化时刻t0至时刻t时段内的内存存储的n个设备的数据依序存储至对应格子的链表B；第y个设备的数据存储至对应格子的链表B中第y个节点b；其中y∈[1，2，3...n]。
- 根据权利要求2～4任一项所述的一种边缘计算网关数据的存储方法，其特征在于，单位时段与节点存储数据的开始时刻和结束时刻之间的时间间隔相等。
- 根据权利要求2～6任一项所述的一种边缘计算网关数据的存储方法，其特征在于，持久性存储空间为硬盘。
- 一种边缘计算网关数据的存储系统，其特征在于，包括存储器和处理器；所述存储器，用于存储计算机程序；所述处理器，用于执行所述计算机程序，实现如权利要求1～8任一项所述的一种边缘计算网关数据的存储方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010629689.XA CN111523004B (zh) | 2020-07-03 | 2020-07-03 | 一种边缘计算网关数据的存储方法及系统 |
| CN202010629689.X | 2020-07-03 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2022000720A1 true WO2022000720A1 (zh) | 2022-01-06 |
Family
ID=71911798
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2020/109097 WO2022000720A1 (zh) | 2020-07-03 | 2020-08-14 | 一种边缘计算网关数据的存储方法及系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111523004B (zh) |
| WO (1) | WO2022000720A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115150932A (zh) * | 2022-09-01 | 2022-10-04 | 深圳慧城智联科技有限公司 | 一种基于5g的边缘网关通信信息同步方法 |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111523004B (zh) * | 2020-07-03 | 2020-10-02 | 南京智能制造研究院有限公司 | 一种边缘计算网关数据的存储方法及系统 |
| CN115150294B (zh) * | 2022-06-20 | 2023-10-13 | 浪潮工业互联网股份有限公司 | 一种用于监控物联网设备的数据分析方法、设备及介质 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106597049A (zh) * | 2016-12-15 | 2017-04-26 | 电子科技大学 | 基于链表数组的多幅波形包络提取方法 |
| US20200008044A1 (en) * | 2019-09-12 | 2020-01-02 | Intel Corporation | Multi-access edge computing service for mobile user equipment method and apparatus |
| CN110836990A (zh) * | 2018-08-16 | 2020-02-25 | 云丁智能科技（北京）有限公司 | 一种电量计费系统、方法及相关装置 |
| CN111125978A (zh) * | 2019-12-31 | 2020-05-08 | 国微集团(深圳)有限公司 | 一种仿真数据处理方法及系统 |
| CN111523004A (zh) * | 2020-07-03 | 2020-08-11 | 南京智能制造研究院有限公司 | 一种边缘计算网关数据的存储方法及系统 |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103543988B (zh) * | 2013-10-23 | 2017-05-10 | 华为终端有限公司 | 队列消息的处理方法、控制消息进入队列的方法及装置 |
| CN105988876B (zh) * | 2015-03-27 | 2019-09-17 | 杭州迪普科技股份有限公司 | 内存分配方法及装置 |
| CN109788514B (zh) * | 2017-11-13 | 2021-03-23 | 中国电信股份有限公司 | 边缘计算应用的数据同步方法、系统及边缘计算平台 |
-
2020
- 2020-07-03 CN CN202010629689.XA patent/CN111523004B/zh active Active
- 2020-08-14 WO PCT/CN2020/109097 patent/WO2022000720A1/zh active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106597049A (zh) * | 2016-12-15 | 2017-04-26 | 电子科技大学 | 基于链表数组的多幅波形包络提取方法 |
| CN110836990A (zh) * | 2018-08-16 | 2020-02-25 | 云丁智能科技（北京）有限公司 | 一种电量计费系统、方法及相关装置 |
| US20200008044A1 (en) * | 2019-09-12 | 2020-01-02 | Intel Corporation | Multi-access edge computing service for mobile user equipment method and apparatus |
| CN111125978A (zh) * | 2019-12-31 | 2020-05-08 | 国微集团(深圳)有限公司 | 一种仿真数据处理方法及系统 |
| CN111523004A (zh) * | 2020-07-03 | 2020-08-11 | 南京智能制造研究院有限公司 | 一种边缘计算网关数据的存储方法及系统 |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115150932A (zh) * | 2022-09-01 | 2022-10-04 | 深圳慧城智联科技有限公司 | 一种基于5g的边缘网关通信信息同步方法 |
| CN115150932B (zh) * | 2022-09-01 | 2022-11-18 | 深圳慧城智联科技有限公司 | 一种基于5g的边缘网关通信信息同步方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111523004B (zh) | 2020-10-02 |
| CN111523004A (zh) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022000720A1 (zh) | 一种边缘计算网关数据的存储方法及系统 | |
| CN104735110B (zh) | 元数据管理方法和系统 | |
| WO2017167171A1 (zh) | 一种数据操作方法，服务器及存储系统 | |
| US20230362248A1 (en) | Tiered Queuing System | |
| WO2013155751A1 (zh) | 面向并发olap的数据库查询处理方法 | |
| WO2021103403A1 (zh) | 区块链交易信息管理方法、装置、计算机设备及存储介质 | |
| CN104462185A (zh) | 一种基于混合结构的数字图书馆云存储系统 | |
| US20170351620A1 (en) | Caching Framework for Big-Data Engines in the Cloud | |
| WO2024041376A1 (zh) | 分布式图数据处理系统、方法、装置、设备及存储介质 | |
| CN105760391B (zh) | 数据动态重分布的方法、数据节点、名字节点及系统 | |
| CN112632027A (zh) | 一种日志数据存储方法及装置 | |
| Li et al. | Study on the data processing of the IOT sensor network based on hadoop cloud platform and TWLGA scheduling algorithm | |
| CN109189724B (zh) | 提高视频监控系统音视频数据存储效率的方法及装置 | |
| Feng et al. | Review of hadoop performance optimization | |
| US20240220334A1 (en) | Data processing method in distributed system, and related system | |
| Ding et al. | Distributed storage of network measurement data on HBase | |
| WO2021249027A1 (zh) | 数据存储方法、装置、终端设备及存储介质 | |
| CN111427920A (zh) | 数据采集方法、装置、系统、计算机设备及存储介质 | |
| WO2012171363A1 (zh) | 分布式缓存系统中的数据操作方法和装置 | |
| CN116303246A (zh) | 存储增量统计方法、装置、计算机设备及存储介质 | |
| Abead et al. | A comparative study of HDFS replication approaches | |
| Jia et al. | Optimizing the performance-cost tradeoff in cross-edge analytics | |
| CN115314403B (zh) | 一种混沌工程平台集成私有云的方法、系统及装置 | |
| CN112948206B (zh) | 基于云计算的时序日志管理系统及包含该系统的电子设备 | |
| Mhalagi et al. | Designing and evaluating hybrid storage for high performance cloud computing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20943501 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20943501 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 030823) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20943501 Country of ref document: EP Kind code of ref document: A1 |