CN117235029A - Edge file storage method, system, electronic equipment and storage medium - Google Patents
Edge file storage method, system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117235029A CN117235029A CN202311015833.0A CN202311015833A CN117235029A CN 117235029 A CN117235029 A CN 117235029A CN 202311015833 A CN202311015833 A CN 202311015833A CN 117235029 A CN117235029 A CN 117235029A
- Authority
- CN
- China
- Prior art keywords
- file
- data
- storage
- load balancing
- internet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000006243 chemical reaction Methods 0.000 claims abstract description 30
- 238000004891 communication Methods 0.000 claims abstract description 25
- 238000012545 processing Methods 0.000 claims description 33
- 230000004044 response Effects 0.000 claims description 20
- 238000004422 calculation algorithm Methods 0.000 claims description 16
- 238000005516 engineering process Methods 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 10
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 238000012795 verification Methods 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 12
- 238000004590 computer program Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- RZVAJINKPMORJF-UHFFFAOYSA-N Acetaminophen Chemical compound CC(=O)NC1=CC=C(O)C=C1 RZVAJINKPMORJF-UHFFFAOYSA-N 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a method, a system, an electronic device and a storage medium for storing an edge file, wherein the system comprises: the system comprises a data sending module arranged on the Internet of things equipment, a data conversion module arranged on the edge side server, a load balancing module and at least one storage node, wherein the Internet of things equipment and the edge side server use a preset communication protocol to establish a communication channel. According to the method, the device and the system, the resource data packet generated by the Internet of things equipment is sent to the edge server for storage, the storage node generates the hash value by encrypting the hash value of the file data packet, the uniqueness verification is carried out based on the hash value, and the data file packet is written into the local area when the verification passes, so that the edge side storage of the Internet of things equipment data file is realized, the storage efficiency of the Internet of things equipment is greatly improved, the performance influence of a third party system on the Internet of things equipment when the resource file is operated is reduced, and the occurrence probability of data file loss caused by the failure of the Internet of things equipment is reduced.
Description
Technical Field
The invention relates to the technical field of application of the internet of things, in particular to a method, a system, electronic equipment and a storage medium for storing edge files.
Background
The Internet of things equipment is a novel technology, and combines a sensor, a controller, a communication network, electronic equipment and the like together to form a complete Internet of things system. Using this technology, various devices and systems can interface with various hardware or software devices to enable remote connection and data acquisition. The internet of things device can be used for realizing automatic detection, data acquisition and remote control. The wireless sensor network can be used for detecting, monitoring and managing all objects in a specific area, so that detection and monitoring become more accurate. The internet of things device can also be used for various monitoring systems, such as intelligent home, intelligent traffic, intelligent agriculture, intelligent building, intelligent security and the like. These systems can effectively monitor and manage a variety of data from housing to business. In addition, the Internet of things equipment can also help medical institutions to investigate and monitor health conditions of patients, and help factories and companies to monitor the conditions of equipment and machines in real time so as to ensure smooth work.
Along with popularization of smart cities and smart environments, the Internet of things equipment is widely applied. In the application of smart cities and smart environments, as more and more devices and points need to be monitored, more and more internet of things devices need to process and generate a large amount of file data, and the traditional centralized storage mode of utilizing a server has the problems of high delay, limited transmission bandwidth and the like, so that the method is not suitable for the internet of things scene any more, and therefore, how to further improve the storage efficiency of the internet of things devices is a problem to be solved urgently.
Disclosure of Invention
Aiming at the technical problems in the prior art, the invention provides an edge file storage method, an edge file storage system, electronic equipment and a storage medium, which are used for solving the problem of how to further improve the storage efficiency of the internet of things equipment.
In a first aspect of the present invention, there is provided an edge file storage system comprising: the system comprises a data sending module, a data conversion module, a load balancing module and at least one storage node, wherein the data sending module is arranged on the Internet of things equipment, the data conversion module is arranged on an edge side server, and the Internet of things equipment and the edge side server establish a communication channel by using a preset communication protocol;
the data transmitting module is used for transmitting the resource data packet generated by the internet of things equipment to the data conversion module through the communication channel;
the data conversion module is used for converting the resource data packet into a file data packet and instruction data, and sending the file data packet and the instruction data to the load balancing module;
the load balancing module is used for sending the file data packet to a storage node based on the instruction data and the corresponding preset load balancing technology;
the storage node is used for carrying out hash encryption on the file data packet to generate a corresponding hash value, judging whether the hash value is unique in the storage node, and writing the data file packet and the hash value into a local storage space when the judging result is unique.
On the basis of the technical scheme, the invention can also make the following improvements.
Preferably, the preset communication protocol includes: serial port protocol, MQTT protocol, TCP/UDP protocol and/or 4G/5G/WiFi protocol.
Preferably, the load balancing module includes: a polling processing module;
the polling processing module is used for sequencing the storage nodes accessed to the load balancing module in sequence and sending the file data packet and the instruction data to the storage node corresponding to the sequence based on the sequence.
Preferably, the load balancing module further comprises: a minimum connection processing module;
and the minimum connection processing module is used for checking the current request connection numbers of all the storage nodes accessed to the load balancing module and sending the file data packet and the instruction data to the storage node with the minimum current request connection number.
Preferably, the load balancing module further comprises: a minimum response time processing module;
and the minimum response time processing module is used for checking the response time of all the storage nodes accessed to the load balancing module and sending the file data packet and the instruction data to the storage node with the minimum response time.
Preferably, the load balancing module further comprises: a hash calculation processing module;
the hash calculation processing module is used for carrying out hash calculation on the attribute values of the file data packets to obtain attribute hash values, and sending the file data packets with the same attribute hash values and the instruction data to the same storage node, wherein the attribute values comprise the IP address and/or the sending time of the Internet of things equipment.
In a second aspect of the present invention, there is provided an edge file storage method applied to the edge file storage system, including:
converting a resource data packet generated by the Internet of things equipment into a file data packet and instruction data;
transmitting the file data packet to a storage node based on the instruction data and a corresponding preset load balancing technology;
and the storage node carries out hash encryption on the file data packet to generate a corresponding hash value, judges whether the hash value is unique in the storage node, and writes the data file packet and the hash value into a local storage space when the judging result is unique.
Preferably, the preset load balancing technology includes a polling algorithm, a least connection algorithm, a least response time algorithm and a hash algorithm.
In a third aspect of the present invention, there is provided an electronic device comprising a memory, a processor for implementing the steps of any one of the edge file storage methods of the second aspect described above when executing a computer management class program stored in the memory.
In a fourth aspect of the present invention, there is provided a computer-readable storage medium having stored thereon a computer management class program which, when executed by a processor, implements the steps of any one of the edge file storage methods of the second aspect described above.
The invention provides a method, a system, an electronic device and a storage medium for storing an edge file, wherein the system comprises: the system comprises a data sending module, a data conversion module, a load balancing module and at least one storage node, wherein the data sending module is arranged on the Internet of things equipment, the data conversion module is arranged on an edge side server, and the Internet of things equipment and the edge side server establish a communication channel by using a preset communication protocol; the data transmitting module is used for transmitting the resource data packet generated by the internet of things equipment to the data conversion module through the communication channel; the data conversion module is used for converting the resource data packet into a file data packet and instruction data, and sending the file data packet and the instruction data to the load balancing module; the load balancing module is used for sending the file data packet to a storage node based on the instruction data and the corresponding preset load balancing technology; the storage node is used for carrying out hash encryption on the file data packet to generate a corresponding hash value, judging whether the hash value is unique in the storage node, and writing the data file packet and the hash value into a local storage space when the judging result is unique. According to the method, the device and the system, the resource data packet generated by the Internet of things equipment is sent to the edge server for storage, the storage node generates the hash value by encrypting the hash value of the file data packet, the uniqueness verification is carried out based on the hash value, and the data file packet is written into the local area when the verification passes, so that the edge side storage of the Internet of things equipment data file is realized, the storage efficiency of the Internet of things equipment is greatly improved, the performance influence of a third party system on the Internet of things equipment when the resource file is operated is reduced, and the occurrence probability of data file loss caused by the failure of the Internet of things equipment is reduced.
Drawings
FIG. 1 is a schematic diagram of an edge file storage system according to the present invention;
FIG. 2 is a schematic diagram of an edge server storage structure according to the present invention;
FIG. 3 is a schematic diagram of an edge server storage data flow according to the present invention;
FIG. 4 is a flowchart of an edge file storing method provided by the present invention;
fig. 5 is a schematic hardware structure of one possible electronic device according to the present invention;
fig. 6 is a schematic hardware structure of a possible computer readable storage medium according to the present invention.
Detailed Description
The following describes in further detail the embodiments of the present invention with reference to the drawings and examples. The following examples are illustrative of the invention and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an edge file storage system according to the present invention, where, as shown in fig. 1, the system includes: the system comprises a data sending module 100 arranged on the internet of things equipment, a data conversion module 200 arranged on an edge side server, a load balancing module 300 and at least one storage node 400, wherein the internet of things equipment and the edge side server establish a communication channel by using a preset communication protocol.
The data transmitting module is used for transmitting the resource data packet generated by the internet of things equipment to the data conversion module through the communication channel; the data conversion module is used for converting the resource data packet into a file data packet and instruction data, and sending the file data packet and the instruction data to the load balancing module; the load balancing module is used for sending the file data packet to a storage node based on the instruction data and the corresponding preset load balancing technology; the storage node is used for carrying out hash encryption on the file data packet to generate a corresponding hash value, judging whether the hash value is unique in the storage node, and writing the data file packet and the hash value into a local storage space when the judging result is unique.
It may be understood that the internet of things device may be a gateway device with specific data acquisition and data transmission functions, the edge server may be an industrial personal computer or a mini-server device installed on site, and the preset communication protocol includes, but is not limited to, a serial port protocol, an MQTT protocol, a TCP/UDP protocol, and/or a 4G/5G/WiFi protocol.
Further, the data conversion module, the load balancing module and the storage node are deployed on the edge server, and when the data conversion module, the load balancing module and the storage node are deployed, the compressed package corresponding to the file can be uploaded to the industrial personal computer or the mini-server, the compressed package is decompressed after logging in the industrial personal computer through the remote SSH, and an installation command is input to wait for the completion of installation.
Specifically, referring to fig. 2, in the storage structure of the edge server, in fig. 2, the storage space of the edge server is partitioned, so that distributed storage of file data is realized, and the purposes of load balancing and dynamic capacity expansion are achieved.
It should be understood that, the internet of things device is connected with the edge side server, that is, the edge side server can be regarded as the edge side of the internet of things device, and data in the internet of things device is written into the edge side server through a data transmission channel, that is, the edge side of the data is stored; meanwhile, when the edge side server is accessed to the third party storage system, the edge side server can be in data synchronization with the third party storage system, so that redundant backup of data is realized, and disaster recovery capacity of the system is improved.
Further, after the resource file generated by the internet of things device is sent to the data conversion module, the data conversion module analyzes the resource file to obtain a file data packet and instruction data, where the instruction data includes, but is not limited to, whether to use a load balancing algorithm or what kind of load balancing algorithm to use.
Specifically, the data flow after the resource data generated by the internet of things device is sent to the edge side server is shown in fig. 3, the data conversion module performs data conversion on the resource data through a preset communication protocol to obtain a file data packet and instruction data, requests load balancing service based on the instruction data, so that the load balancing service issues an uploading instruction, selects a storage node based on the instruction data, hashes and encrypts the file data packet to obtain a hash value, performs repeatability verification based on the obtained hash value, and finally stores a file which is not repeated and the hash value to a designated partition.
Further, the load balancing module includes: a polling processing module; the polling processing module is used for sequencing the storage nodes accessed to the load balancing module in sequence and sending the file data packet and the instruction data to the storage node corresponding to the sequence based on the sequence.
Specifically, the load balancing module sequentially arranges all the storage nodes according to the sequential access sequence, the first request is sent to the first storage node, the second request is sent to the second storage node, and so on, once all the storage nodes accept the requests, the load balancing service can restart from the first storage node and continue to distribute the requests according to the polling mode.
Further, the load balancing module further includes: a minimum connection processing module; and the minimum connection processing module is used for checking the current request connection numbers of all the storage nodes accessed to the load balancing module and sending the file data packet and the instruction data to the storage node with the minimum current request connection number.
Specifically, after a request comes to the load balancing module, the load balancing module checks the number of requested connections (the current number of requested processing) of all storage nodes, and selects the storage node with the smallest current number of connections as a target storage node, so that the request is sent to the target storage node, and after the target storage node receives the request, a new connection is established for processing, at this time, the number of connections of the storage node is increased, and the connection number calculation is needed before the subsequent new request comes.
Further, the load balancing module further includes: a minimum response time processing module; and the minimum response time processing module is used for checking the response time of all the storage nodes accessed to the load balancing module and sending the file data packet and the instruction data to the storage node with the minimum response time.
Specifically, after a request arrives at the load balancing module, the load balancing module may check the response time of all storage nodes in processing the latest request. The storage node with the shortest response time is selected as the target storage node, so that the request is sent to the target storage node, and the target storage node receives the request, processes the request and calculates the response time of the request. The response time includes a request processing time, a data transmission time, a data parsing time, and the like. Once the request is processed, the node automatically updates its own response time for subsequent inspection by the load balancing module.
Further, the load balancing module further includes: a hash calculation processing module; the hash calculation processing module is used for carrying out hash calculation on the attribute values of the file data packets to obtain attribute hash values, and sending the file data packets with the same attribute hash values and the instruction data to the same storage node, wherein the attribute values comprise the IP address and/or the sending time of the Internet of things equipment.
It can be appreciated that, based on the defects in the background art, the embodiment of the invention provides an edge file storage system. The system comprises: the system comprises a data sending module, a data conversion module, a load balancing module and at least one storage node, wherein the data sending module is arranged on the Internet of things equipment, the data conversion module is arranged on an edge side server, and the Internet of things equipment and the edge side server establish a communication channel by using a preset communication protocol; the data transmitting module is used for transmitting the resource data packet generated by the internet of things equipment to the data conversion module through the communication channel; the data conversion module is used for converting the resource data packet into a file data packet and instruction data, and sending the file data packet and the instruction data to the load balancing module; the load balancing module is used for sending the file data packet to a storage node based on the instruction data and the corresponding preset load balancing technology; the storage node is used for carrying out hash encryption on the file data packet to generate a corresponding hash value, judging whether the hash value is unique in the storage node, and writing the data file packet and the hash value into a local storage space when the judging result is unique. According to the method, the device and the system, the resource data packet generated by the Internet of things equipment is sent to the edge server for storage, the storage node generates the hash value by encrypting the hash value of the file data packet, the uniqueness verification is carried out based on the hash value, and the data file packet is written into the local area when the verification passes, so that the edge side storage of the Internet of things equipment data file is realized, the storage efficiency of the Internet of things equipment is greatly improved, the performance influence of a third party system on the Internet of things equipment when the resource file is operated is reduced, and the occurrence probability of data file loss caused by the failure of the Internet of things equipment is reduced.
In a possible embodiment, the system in the embodiment of the present invention may also implement a high availability distributed cluster mode using haproxy+keepalive; specifically, a Haproxy is installed and configured on each load balancing node, for example: configuring a load balancing algorithm, etc. Meanwhile, keepalive is installed and configured on each load balancing node, and a Virtual IP (VIP) is created, wherein the VIP is used as an instruction to send the IP. Meanwhile, a certain load balancing node is designated as a Master node (Backup), other nodes are standby nodes, the Master node manages all the VIPs and processes instructions at the same time, the standby nodes monitor the fault state of the Master node, and once the Master node breaks down, the standby nodes automatically take over the VIPs and upgrade the VIPs to the Master node to replace the acting processing instructions of the Master node. And after the fault node is repaired, automatically converting the fault node into a standby node. Haproxy manages all nodes in the load balancing pool through health check, and when one node fails, haproxy eliminates the node from the load balancing pool, so that file requests are prevented from being sent to unavailable nodes. When the node is in a healthy state after fault repair, haproxy can find that the node is in a healthy state, and the node is automatically added into a load balancing pool. This enables a high availability distributed deployment mode.
In a possible embodiment, the embodiment of the invention also realizes the dynamic capacity expansion of the edge side server, and particularly, the dynamic capacity expansion is carried out on the premise that cluster deployment is needed, and in a stand-alone deployment mode, the node is a program in the system. In cluster mode, the node is an industrial personal computer or a small server. The specific scheme is as follows: and a plurality of file systems are arranged at the edge of the equipment, one of the file systems is selected as a load balancing service node, and the other of the file systems is taken as a node and put into a load balancing pool, so that the disk in an industrial personal computer or a small server where each system is located can be used for storing files. Therefore, once the disk is full, a set of disk can be deployed again, the newly deployed disk is put into a load balancing pool, a newly deployed system is automatically found through a Haproxy health monitoring function, and a request is sent to the newly deployed system through a load balancing algorithm, so that dynamic capacity expansion is realized.
In this embodiment, the edge file storage system is distributed and expanded, so that the system is provided with a backup mechanism, and files are stored on different nodes, so that even if one node fails, files can be recovered from other nodes and accessed. Meanwhile, the edge side server provided by the embodiment can also provide an API interface, through which the third system can operate the files stored in the storage node to realize the functions of file viewing, uploading, downloading, synchronizing, backup and the like. Meanwhile, the Internet of things equipment is directly communicated with the edge side server through the equipment protocol, so that the process of data interaction by using the Ethernet is avoided, the privacy and the safety of file data are improved, and the risk of the file transmission process in the network is reduced.
Referring to fig. 4, fig. 4 is a flowchart of an edge file storage method according to an embodiment of the present invention, and as shown in fig. 4, an edge file storage method includes:
step S100: converting a resource data packet generated by the Internet of things equipment into a file data packet and instruction data;
step S200: transmitting the file data packet to a storage node based on the instruction data and a corresponding preset load balancing technology;
step S300: and the storage node carries out hash encryption on the file data packet to generate a corresponding hash value, judges whether the hash value is unique in the storage node, and writes the data file packet and the hash value into a local storage space when the judging result is unique.
Further, the preset load balancing technology comprises a polling algorithm, a least connection algorithm, a least response time algorithm and a hash algorithm.
It can be understood that, in the edge file storage method provided by the present invention, corresponding to the edge file storage system provided in the foregoing embodiments, relevant technical features of the edge file storage method may refer to relevant technical features of the edge file storage system, which are not described herein again.
Referring to fig. 5, fig. 5 is a schematic diagram of an embodiment of an electronic device according to an embodiment of the invention. As shown in fig. 5, an embodiment of the present invention provides an electronic device including a memory 1310, a processor 1320, and a computer program 1311 stored on the memory 1310 and executable on the processor 1320, the processor 1320 implementing the following steps when executing the computer program 1311:
converting a resource data packet generated by the Internet of things equipment into a file data packet and instruction data; transmitting the file data packet and the instruction data to a storage node based on a preset load balancing technology; the storage node performs hash encryption on the file data packet to generate a corresponding hash value, judges whether the hash value is unique in the storage node, and writes the data file packet and the hash value into a local storage space based on the instruction data when the judging result is unique.
Referring to fig. 6, fig. 6 is a schematic diagram of an embodiment of a computer readable storage medium according to the present invention. As shown in fig. 6, the present embodiment provides a computer-readable storage medium 1400 having stored thereon a computer program 1411, which computer program 1411, when executed by a processor, performs the steps of:
converting a resource data packet generated by the Internet of things equipment into a file data packet and instruction data; transmitting the file data packet and the instruction data to a storage node based on a preset load balancing technology; the storage node performs hash encryption on the file data packet to generate a corresponding hash value, judges whether the hash value is unique in the storage node, and writes the data file packet and the hash value into a local storage space based on the instruction data when the judging result is unique.
The embodiment of the invention provides a method, a system and a storage medium for storing edge files, wherein the system comprises the following steps: the system comprises a data sending module, a data conversion module, a load balancing module and at least one storage node, wherein the data sending module is arranged on the Internet of things equipment, the data conversion module is arranged on an edge side server, and the Internet of things equipment and the edge side server establish a communication channel by using a preset communication protocol; the data transmitting module is used for transmitting the resource data packet generated by the internet of things equipment to the data conversion module through the communication channel; the data conversion module is used for converting the resource data packet into a file data packet and instruction data, and sending the file data packet and the instruction data to the load balancing module; the load balancing module is used for sending the file data packet to a storage node based on the instruction data and the corresponding preset load balancing technology; the storage node is used for carrying out hash encryption on the file data packet to generate a corresponding hash value, judging whether the hash value is unique in the storage node, and writing the data file packet and the hash value into a local storage space when the judging result is unique. According to the method, the device and the system, the resource data packet generated by the Internet of things equipment is sent to the edge server for storage, the storage node generates the hash value by encrypting the hash value of the file data packet, the uniqueness verification is carried out based on the hash value, and the data file packet is written into the local area when the verification passes, so that the edge side storage of the Internet of things equipment data file is realized, the storage efficiency of the Internet of things equipment is greatly improved, the performance influence of a third party system on the Internet of things equipment when the resource file is operated is reduced, and the occurrence probability of data file loss caused by the failure of the Internet of things equipment is reduced.
In the foregoing embodiments, the descriptions of the embodiments are focused on, and for those portions of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (10)
1. An edge file storage system, the system comprising: the system comprises a data sending module, a data conversion module, a load balancing module and at least one storage node, wherein the data sending module is arranged on the Internet of things equipment, the data conversion module is arranged on an edge side server, and the Internet of things equipment and the edge side server establish a communication channel by using a preset communication protocol;
the data transmitting module is used for transmitting the resource data packet generated by the internet of things equipment to the data conversion module through the communication channel;
the data conversion module is used for converting the resource data packet into a file data packet and instruction data, and sending the file data packet and the instruction data to the load balancing module;
the load balancing module is used for sending the file data packet to a storage node based on the instruction data and the corresponding preset load balancing technology;
the storage node is used for carrying out hash encryption on the file data packet to generate a corresponding hash value, judging whether the hash value is unique in the storage node, and writing the data file packet and the hash value into a local storage space when the judging result is unique.
2. The edge file storage system of claim 1, wherein the preset communication protocol comprises: serial port protocol, MQTT protocol, TCP/UDP protocol and/or 4G/5G/WiFi protocol.
3. The edge file storage system of claim 1, wherein the load balancing module comprises: a polling processing module;
the polling processing module is used for sequencing the storage nodes accessed to the load balancing module in sequence and sending the file data packet and the instruction data to the storage node corresponding to the sequence based on the sequence.
4. The edge file storage system of claim 3 wherein the load balancing module further comprises: a minimum connection processing module;
and the minimum connection processing module is used for checking the current request connection numbers of all the storage nodes accessed to the load balancing module and sending the file data packet and the instruction data to the storage node with the minimum current request connection number.
5. The edge file storage system of claim 3 wherein the load balancing module further comprises: a minimum response time processing module;
and the minimum response time processing module is used for checking the response time of all the storage nodes accessed to the load balancing module and sending the file data packet and the instruction data to the storage node with the minimum response time.
6. The edge file storage system of claim 3 wherein the load balancing module further comprises: a hash calculation processing module;
the hash calculation processing module is used for carrying out hash calculation on the attribute values of the file data packets to obtain attribute hash values, and sending the file data packets with the same attribute hash values and the instruction data to the same storage node, wherein the attribute values comprise the IP address and/or the sending time of the Internet of things equipment.
7. An edge file storage method, characterized by being applied to the edge file storage system, comprising:
converting a resource data packet generated by the Internet of things equipment into a file data packet and instruction data;
transmitting the file data packet to a storage node based on the instruction data and a corresponding preset load balancing technology;
and the storage node carries out hash encryption on the file data packet to generate a corresponding hash value, judges whether the hash value is unique in the storage node, and writes the data file packet and the hash value into a local storage space when the judging result is unique.
8. The edge file storage system of claim 7 wherein the pre-set load balancing technique comprises a polling algorithm, a least connection algorithm, a least response time algorithm, and a hash algorithm.
9. An electronic device comprising a memory, a processor for implementing the steps of the edge file storage method of any of claims 7-8 when executing a computer management class program stored in the memory.
10. A computer readable storage medium, having stored thereon a computer management class program which when executed by a processor implements the steps of the edge file storage method of any of claims 7-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311015833.0A CN117235029A (en) | 2023-08-12 | 2023-08-12 | Edge file storage method, system, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311015833.0A CN117235029A (en) | 2023-08-12 | 2023-08-12 | Edge file storage method, system, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117235029A true CN117235029A (en) | 2023-12-15 |
Family
ID=89086940
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311015833.0A Pending CN117235029A (en) | 2023-08-12 | 2023-08-12 | Edge file storage method, system, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117235029A (en) |
-
2023
- 2023-08-12 CN CN202311015833.0A patent/CN117235029A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107800565B (en) | Inspection method, inspection device, inspection system, computer equipment and storage medium | |
| CN113037560B (en) | Service flow switching method and device, storage medium and electronic equipment | |
| US9762546B2 (en) | Multi-connection system and method for service using internet protocol | |
| US10027574B2 (en) | Redundant pathways for network elements | |
| JP2016096549A (en) | Method and device for providing redundancy to process control system | |
| CN106911648B (en) | Environment isolation method and equipment | |
| CN108696581A (en) | Caching method, device, computer equipment and the storage medium of distributed information | |
| CN104038376A (en) | Method and device for managing real servers and LVS clustering system | |
| CN101488902A (en) | Dynamic establishing method and device for GRE tunnel | |
| CN103036719A (en) | Cross-regional service disaster method and device based on main cluster servers | |
| JP6434021B2 (en) | Manage data feeds | |
| CN104283780A (en) | Method and device for establishing data transmission route | |
| CN110768840A (en) | Control method, device, equipment and storage medium of communication equipment | |
| JP5708078B2 (en) | Verification device, verification method, and verification program | |
| CN114531373A (en) | Node state detection method, node state detection device, equipment and medium | |
| CN110290163A (en) | A kind of data processing method and device | |
| CN117061524A (en) | Load balancing method and device, electronic equipment and storage medium | |
| CN117235029A (en) | Edge file storage method, system, electronic equipment and storage medium | |
| CN116915827A (en) | Data transmission method and device of internet of things edge gateway, electronic equipment and medium | |
| CN113824801B (en) | Intelligent integration terminal unified access management component system | |
| CN111083182B (en) | Distributed Internet of things equipment management method and device | |
| CN112787868A (en) | Information synchronization method and device | |
| CN111064618A (en) | Method, device, equipment and storage medium for realizing high availability of server | |
| GB2537657A (en) | Subsea control system communication network | |
| CN111490886B (en) | Network data processing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |