CN114069847B - Distributed photovoltaic data backfill system and method - Google Patents
Distributed photovoltaic data backfill system and method Download PDFInfo
- Publication number
- CN114069847B CN114069847B CN202111268884.5A CN202111268884A CN114069847B CN 114069847 B CN114069847 B CN 114069847B CN 202111268884 A CN202111268884 A CN 202111268884A CN 114069847 B CN114069847 B CN 114069847B
- Authority
- CN
- China
- Prior art keywords
- data
- backfill
- task
- intelligent terminal
- data packet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000004891 communication Methods 0.000 claims abstract description 41
- 238000012544 monitoring process Methods 0.000 claims abstract description 31
- 238000012545 processing Methods 0.000 claims abstract description 15
- 238000012937 correction Methods 0.000 claims abstract description 11
- 230000003993 interaction Effects 0.000 claims abstract description 3
- 230000005540 biological transmission Effects 0.000 claims description 22
- 230000008569 process Effects 0.000 claims description 21
- 238000007726 management method Methods 0.000 claims description 13
- 238000012795 verification Methods 0.000 claims description 7
- 230000006837 decompression Effects 0.000 claims description 6
- 230000008520 organization Effects 0.000 claims description 6
- 238000013500 data storage Methods 0.000 claims description 5
- 230000004044 response Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 238000004422 calculation algorithm Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 7
- 238000007906 compression Methods 0.000 description 6
- 230000006835 compression Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000002360 preparation method Methods 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010248 power generation Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00002—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by monitoring
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
- H02J13/00028—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment involving the use of Internet protocols
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J3/00—Circuit arrangements for ac mains or ac distribution networks
- H02J3/38—Arrangements for parallely feeding a single network by two or more generators, converters or transformers
- H02J3/381—Dispersed generators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J2300/00—Systems for supplying or distributing electric power characterised by decentralized, dispersed, or local generation
- H02J2300/20—The dispersed energy generation being of renewable origin
- H02J2300/22—The renewable source being solar energy
- H02J2300/24—The renewable source being solar energy of photovoltaic origin
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E10/00—Energy generation through renewable energy sources
- Y02E10/50—Photovoltaic [PV] energy
- Y02E10/56—Power conversion systems, e.g. maximum power point trackers
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E40/00—Technologies for an efficient electrical power generation, transmission or distribution
- Y02E40/70—Smart grids as climate change mitigation technology in the energy generation sector
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E60/00—Enabling technologies; Technologies with a potential or indirect contribution to GHG emissions mitigation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/12—Monitoring or controlling equipment for energy generation units, e.g. distributed energy generation [DER] or load-side generation
- Y04S10/123—Monitoring or controlling equipment for energy generation units, e.g. distributed energy generation [DER] or load-side generation the energy generation units being or involving renewable energy sources
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S40/00—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them
- Y04S40/12—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them characterised by data transport means between the monitoring, controlling or managing units and monitored, controlled or operated electrical equipment
Landscapes
- Engineering & Computer Science (AREA)
- Power Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a distributed photovoltaic data backfill system and a method in the technical field of distributed photovoltaic, wherein the system comprises the following steps: cloud platform system, intelligent terminal equipment and supply cloud platform system and intelligent terminal equipment data interaction's communication module, wherein: the cloud platform system comprises a breakpoint checking module, a task list management module and a data processing module, wherein the breakpoint checking module receives a monitoring data packet and judges whether the monitoring data packet has a breakpoint or not; updating a task list containing data backfill task items when the monitoring data packet has a breakpoint; the task list management module sends a data backfill selection data packet to the intelligent terminal based on the initial state of the task item in the task list; and receiving the data backfill and correction data packet fed back by the intelligent terminal equipment, and updating the task item. The invention effectively improves the communication flexibility under the unstable communication channel, not only can the file be sent up immediately after being prepared, but also can be sent up in batches after the communication channel is frequently switched on and off.
Description
Technical Field
The invention relates to a distributed photovoltaic data backfill system and a distributed photovoltaic data backfill method, and belongs to the technical field of distributed photovoltaics.
Background
Along with the large-scale development of the distributed photovoltaic power stations, in order to facilitate unified management of the photovoltaic power stations, a power generation group generally establishes regional/national centralized control centers/operation and maintenance centers, the centralized control centers establish cloud platform systems, interact with intelligent terminal equipment of all the distributed photovoltaic power stations, and are responsible for collecting relevant data of the photovoltaic power stations and carrying out unified monitoring and management. At present, the distributed photovoltaic power station has a wide range of points, and the link between the distributed photovoltaic power station and the centralized control center is generally 2G/3G/4G wireless. For various reasons, the situation of 2G/3G/4G wireless communication abnormality or interruption occurs sometimes. During the wireless communication interruption period, the data collected by the distributed photovoltaic power station cannot be normally uploaded to the centralized control center, so that the data at the side of the centralized control center is lost, and the calculation and operation and maintenance management of various production indexes at the later stage are greatly influenced.
In order to avoid such a situation, the photovoltaic centralized control system generally needs to have a data backfilling function, that is, when wireless communication is interrupted, the collecting equipment at the photovoltaic power station side can temporarily store the collected power station data, and when wireless communication is recovered, the temporarily stored data at the photovoltaic power station side needs to be backfilled to the centralized control center side to supplement missing data. However, the existing breakpoint continuous transmission technology has more or less problems, and when the existing breakpoint continuous transmission technology is used for continuous transmission, the transmission of historical data can influence the transmission of real-time data, and the real-time monitoring of a centralized control center is influenced; some data packets are not considered in transmission efficiency and reliability, and the method is generally applied to data synchronization after stable and short-time interruption of a communication channel, and is not suitable for application situations of poor quality and intermittent communication channels of a distributed photovoltaic system.
Disclosure of Invention
The invention aims to overcome the defects in the prior art, and provides a distributed photovoltaic data backfilling system and a distributed photovoltaic data backfilling method, which effectively improve the communication flexibility under an unstable communication channel, and can be used for immediately uploading files after the files are prepared, and can also be used for arranging subsequent batch uploading when the communication channel is frequently opened and closed.
In order to achieve the above purpose, the invention is realized by adopting the following technical scheme:
in a first aspect, the present invention provides a distributed photovoltaic data backfill system comprising: cloud platform system, intelligent terminal equipment and supply cloud platform system and intelligent terminal equipment data interaction's communication module, wherein:
the cloud platform system comprises a breakpoint checking module, a task list management module and a data processing module,
the breakpoint checking module receives the monitoring data packet and judges whether the monitoring data packet has a breakpoint or not; updating a task list containing data backfill task items when the monitoring data packet has a breakpoint;
the task list management module sends a data backfill selection data packet to the intelligent terminal based on the initial state of the task item in the task list; receiving a data backfill and correction data packet fed back by the intelligent terminal equipment, and updating a task item; based on the ready state of the task item, receiving the data backfill compressed file uploaded by the intelligent terminal equipment; deleting the task items processed in the task list, and notifying the intelligent terminal equipment to delete all the data backfill compressed files in response to the task list emptying;
and the data processing module performs verification, decompression and data backfilling on the uploaded data backfilling compressed file.
Further, the intelligent terminal equipment comprises a data organization module, wherein the data organization module organizes data into data backfill compressed files after inquiring corresponding data based on data backfill selection data packets, and generates data backfill correction data packets by combining file check codes.
Further, the monitoring data packet includes a data packet time stamp and a terminal number, the data packet time stamp is generated in seconds based on a time sequence of data generation, and the terminal number is a number of the intelligent terminal device.
Further, the breakpoint checking module judges whether the terminal number in the received monitoring data packet is consistent with the terminal number of the broken wire: if not, performing real-time data storage; otherwise, storing the real-time data and updating the data backfill task list corresponding to the terminal number.
Further, the data backfill task list comprises a plurality of task items, wherein the task items are time scale pair sets formed by a starting time scale and an ending time scale of a data packet which is not transmitted between each time of disconnection and re-disconnection, and the time interval between adjacent time scale pairs is smaller than a threshold and is classified as the same task item.
Further, after receiving the data backfill and correction data packet fed back by the intelligent terminal, the task list management module updates the task item ready mark, the corresponding data backfill compressed file name and the file check code.
Further, the task list management module establishes a file uploading process allowing a breakpoint continuous transmission mode based on a task item ready mark of the task list, and receives data backfill compressed files uploaded by the intelligent terminal equipment.
In a second aspect, the present invention provides a distributed photovoltaic data backfilling method, which is executed by a cloud platform system in the distributed photovoltaic data backfilling system, and includes:
receiving a monitoring data packet sent by intelligent terminal equipment, and judging whether the monitoring data packet has a breakpoint or not;
updating a task list containing data backfill task items when the monitoring data packet has a breakpoint;
based on the initial state of the task item in the task list, sending a data backfill selection data packet to the intelligent terminal;
receiving a data backfill and correction data packet fed back by the intelligent terminal equipment, and updating a task item;
based on the ready state of the task item, receiving the data backfill compressed file uploaded by the intelligent terminal equipment;
checking, decompressing and backfilling the data backfill compressed file;
deleting the task items completed in the task list, and notifying the intelligent terminal equipment to delete all the data backfill compressed files in response to the task list emptying.
Compared with the prior art, the invention has the beneficial effects that:
1. the invention provides a multi-scene 'cloud' layer data backfill task list generation method and an asynchronous processing based on a 'selection-execution' mechanism for realizing data backfill compressed file preparation and data packet transmission, which effectively improves communication flexibility under an unstable communication channel, can immediately upload files after preparation, can arrange subsequent batch uploading when the communication channel is frequently switched on and off, and can effectively solve the problem of reliable and efficient data synchronization of photovoltaic intelligent terminal equipment and a cloud platform system under the application scene of unstable communication channel and frequent switching on and off.
2. According to the invention, the dynamic and reliable management of the data backfill task can be realized through the data backfill task list, the accurate and efficient positioning of the backfill data is ensured, and the size of a data packet is effectively reduced; the data backfill data are converted into compressed files, and the file uploading process allowing breakpoint continuous transmission is added, so that the communication efficiency and reliability of the data package can be effectively improved, and the communication pressure is reduced. And recommending an idle period (such as evening, the real-time data traffic is greatly reduced) to initiate a data backfill file uploading process, so that the idle communication bandwidth can be fully utilized.
Drawings
FIG. 1 is a schematic diagram of a distributed photovoltaic data backfill system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a distributed photovoltaic data backfill flow according to an embodiment of the present invention.
Detailed Description
The invention is further described below with reference to the accompanying drawings. The following examples are only for more clearly illustrating the technical aspects of the present invention, and are not intended to limit the scope of the present invention.
Embodiment one:
as shown in FIG. 1, the distributed photovoltaic data backfill system comprises a cloud platform system and intelligent terminal equipment. The cloud platform system periodically checks whether the data has break points, if yes, automatically creates a data backfill task list (the task list is composed of a plurality of task items, one task item is a time scale pair set composed of a starting time scale and an ending time scale of a data packet which is not transmitted between each time of disconnection and online again, the time interval of adjacent time scale pairs is smaller than the threshold value and falls into the same task item), then starts a data backfill selection task according to the initial state of the task item, informs the intelligent terminal equipment to organize related data into a data backfill compressed file, then establishes a file uploading process allowing a breakpoint continuous transmission mode according to the ready state of the task item, completes uploading, checking, decompressing and data backfilling of the data backfill compressed file, and finally, after the task list is emptied, the cloud platform system sends a message packet of completion of the data backfill task, and informs the intelligent terminal equipment to delete all the data backfill compressed file.
The cloud platform system comprises a breakpoint checking module, a task list management module, a communication module and a data processing module, and the intelligent terminal equipment comprises a data organization module and a communication module. The cloud platform system regularly checks whether the data has a breakpoint or not through a breakpoint checking module, and if the data has the breakpoint, a data backfilling task item is automatically created; the cloud platform task list management module starts a data backfill selection task according to the initial state of a task item, establishes a file uploading process allowing a breakpoint continuous transmission mode according to the ready state of the task item, and notifies the intelligent terminal device to delete all data backfill compression files after the task list is emptied; the cloud platform system interacts with the intelligent terminal equipment through the communication module, sends a data backfill selection data packet, receives the data backfill correction data packet, updates a task item ready mark, operates as a client in the file uploading process to upload data backfill compressed files, and sends a message packet of the completion of the data backfill task; and the cloud platform data processing module realizes verification, decompression and data backfilling of the data backfilling compressed file. The intelligent terminal equipment interacts with the cloud platform system through the communication module, receives the data backfill selection data packet, invokes the data organization module, sends the data backfill correction data packet, operates as a server in the file uploading process to upload the data backfill compression file, receives the message packet of the completion of the data backfill task and deletes all the data backfill compression files; the intelligent terminal equipment queries corresponding data through the data organization module, and organizes the data into data backfill compression files.
In order to realize the data backfill function, each intelligent terminal device is provided with a unique terminal number, and each monitoring data packet is provided with a unique data packet time mark which is generated in seconds according to the time sequence of data generation and is attached with the unique terminal number.
Embodiment two:
as shown in fig. 2, a distributed photovoltaic data backfilling method, wherein a cloud platform system performs the following steps:
(1) And receiving a monitoring data packet sent by the intelligent terminal equipment, wherein the monitoring data packet comprises a data packet time mark and a terminal number.
(2) And judging whether the terminal number in the received monitoring data packet is consistent with the terminal number of the disconnected line, if not, executing real-time data storage, otherwise, executing real-time data storage and updating a data backfill task list corresponding to the terminal number.
The data backfill task list consists of a plurality of task items, one task item is a time scale pair set consisting of a starting time scale and an ending time scale of a data packet which is not transmitted between disconnection and re-disconnection each time, the time interval of adjacent time scale pairs is less than the threshold value and is classified into the same task item, and the threshold value is set to be 0.5 hour.
The cloud platform system analyzes the received monitoring data packet, judges whether the newly connected terminal number is consistent with the broken terminal number, if not, the cloud platform system can identify normal terminal equipment, and if so, the cloud platform system identifies normal terminal equipmentThe device stores the received monitoring data packet into the cloud layer historical data storage space; if the data packet is not normal terminal equipment, namely terminal equipment with broken lines in the monitoring process, the data packet of the current monitoring data packet is marked as B, the data packet of the last monitoring data packet before the broken lines is marked as A, and the data backfill task items corresponding to the terminal numbers are formed by the time marks A-B and added into a task list. After terminal equipment with the same terminal number is disconnected again and recovered within the threshold time, the formed time mark pair A i -B i The same data backfill task item will be incorporated.
(3) Starting a data backfill selection task according to the initial state of the task item of the task list, namely creating and sending a data backfill selection data packet, wherein the format of the data backfill selection data packet is as follows:
(4) Receiving a data backfill and reckoning data packet sent by intelligent terminal equipment, updating a task item ready mark, a corresponding data backfill compressed file name and a file check code, wherein the format of the data backfill and reckoning data packet is as follows:
| packet head | Terminal numbering | Correction mark | File name | File check code | Tail wrapping |
(5) And establishing a file uploading process allowing a breakpoint continuous transmission mode according to the task item ready mark of the task list, and completing data backfill compression file uploading corresponding to the task item.
The file uploading process can be composed of a plurality of threads according to the size of the data backfill compressed file, and has breakpoint continuous transmission attribute, such as lftp as a client and vsftpd as a server.
The file uploading process can be arranged to be performed during idle periods of a communication channel of the distributed photovoltaic system (such as evening); and uploading the data backfill compressed files corresponding to all ready task items of the task list in a batch mode.
(6) And finishing the verification, decompression and data backfilling of the data backfilling compressed file.
And according to the file check code of the task item, checking the receiving correctness of the data backfill compressed file. The verification algorithm is consistent with the intelligent terminal equipment, including MD5, SHA-1, SHA-256, SHA-512 and the like.
The decompression algorithm is consistent with the compression algorithm of the intelligent terminal equipment, and comprises dictionary conversion, huffman coding or algorithms of the combination of the dictionary conversion and the Huffman coding.
The data backfill storage space includes a database and a data cache, i.e., the data backfill data may be stored in the database or the data backfill data may be stored in the data cache. The advantage of storing the data backfill data in the database is that more data can be stored, and the advantage of storing the data backfill data in the data cache is that the data is fast to store, fast to read, and beneficial to refresh.
(7) The completed task item is deleted from the task list. And after the task list is emptied, sending a message packet for completing the data backfilling task.
As shown in fig. 2, a distributed photovoltaic data backfilling method, wherein an intelligent terminal device performs the following steps:
(1) And monitoring data backfill selection data packets sent by the cloud platform system.
The data backfill communication service port employs a different port than the real-time data communication service port (two ports are not two separate hardware interfaces, but two data interfaces implemented by software). TCP or UDP may be used for communication, as determined by the cloud platform system.
(2) And selecting a data packet according to the data backfill, inquiring corresponding data, and organizing the data into a data backfill compressed file.
The data compression algorithm includes dictionary conversion, huffman coding or a combination of both algorithms, etc.
The data backfill compressed file is named with a time stamp a in the data backfill select data packet.
(3) After the data backfill compressed file is generated, a data backfill correction data packet is sent, wherein the data backfill correction data packet comprises a data backfill compressed file name and a file check code.
The verification algorithm includes MD5, SHA-1, SHA-256, SHA-512, etc.
(4) And responding to the cloud platform system to initiate an established file uploading process through an online file downloading service, and completing data backfill data packet transmission.
The data body in the data backfill data packet is the whole or split content of the data backfill compressed file specified in the file uploading process.
(5) And after receiving the message packet of the completion of the data backfilling task, deleting all the data backfilling compressed files.
The invention discloses a distributed photovoltaic data backfill system and a method, wherein a cloud platform system periodically checks whether data has break points, if yes, a data backfill task list is automatically created (the task list consists of a plurality of task items, one task item is a time scale pair set consisting of a starting time scale and an ending time scale of a data packet which is not transmitted between each time of disconnection and re-disconnection, the time interval between adjacent time scale pairs is smaller than a threshold value and is included in the same task item), then a data backfill selection task is started according to the initial state of the task item, an intelligent terminal device is informed of organizing relevant data into a data backfill compressed file, then a file uploading process allowing a breakpoint continuous transmission mode is established according to the ready state of the task item, uploading, verification, decompression and data backfill of the data backfill compressed file are completed, and finally after the task list is cleared, the cloud platform system sends a message packet for completing the data backfill task, and the intelligent terminal device is informed of deleting all the data backfill compressed file.
The task list can realize dynamic and reliable management of the data backfill task, ensure accurate and efficient positioning of backfill data and effectively reduce the size of a data packet. The data backfill data are converted into compressed files, and the file uploading process allowing breakpoint continuous transmission is added, so that the communication efficiency and reliability of the data package can be effectively improved, and the communication pressure is reduced. The selection-execution mechanism realizes asynchronous processing of data backfill compressed file preparation and data packet transmission, effectively improves communication flexibility under an unstable communication channel, and can be used for immediately uploading after the file preparation is finished or arranging subsequent batch uploading when the communication channel is frequently switched on and switched off. And recommending an idle period (such as evening, the real-time data traffic is greatly reduced) to initiate a data backfill file uploading process, so that the idle communication bandwidth can be fully utilized.
The invention provides a multi-scene 'cloud' layer data backfill task list generation method and an asynchronous data synchronization method based on a 'selection-execution' mechanism and a file uploading process allowing a breakpoint continuous transmission mode, which can effectively solve the problem of reliable and efficient data synchronization of photovoltaic intelligent terminal equipment and a cloud platform system in an application scene of unstable communication channels and frequent on-off.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing is merely a preferred embodiment of the present invention, and it should be noted that modifications and variations could be made by those skilled in the art without departing from the technical principles of the present invention, and such modifications and variations should also be regarded as being within the scope of the invention.
Claims (5)
1. A distributed photovoltaic data backfill system, comprising: cloud platform system, intelligent terminal equipment and supply cloud platform system and intelligent terminal equipment data interaction's communication module, wherein:
the cloud platform system comprises a breakpoint checking module, a task list management module and a data processing module;
the breakpoint checking module receives a monitoring data packet sent by the intelligent terminal equipment and judges whether the monitoring data packet has a breakpoint or not; updating a data backfill task list containing data backfill task items when the monitoring data packet has a breakpoint; the data backfill task list comprises a plurality of data backfill task items, wherein the data backfill task items are time scale pair sets consisting of a starting time scale and an ending time scale of a data packet which is not transmitted between each disconnection and a re-disconnection, and the time intervals of adjacent time scale pairs are less than a threshold value and belong to the same task item;
the task list management module creates a data backfill selection data packet based on the initial state of the data backfill task item in the data backfill task list and sends the data backfill selection data packet to the intelligent terminal; receiving a data backfill and reckoning data packet fed back by the intelligent terminal equipment, and updating a ready mark of a data backfill task item, a corresponding data backfill compressed file name and a file check code;
establishing a file uploading process allowing a breakpoint continuous transmission mode according to a ready mark of a task item in a data backfill task list, and receiving a data backfill compressed file uploaded by intelligent terminal equipment; when the communication channel is frequently switched on and off, arranging the file uploading process in an idle period of the communication channel, and replacing a breakpoint continuous transmission mode by adopting a batch processing mode;
deleting the processed data backfill task items in the data backfill task list, and notifying the intelligent terminal equipment to delete all the data backfill compressed files in response to the emptying of the data backfill task list;
and the data processing module performs verification, decompression and data backfilling on the uploaded data backfilling compressed file.
2. The distributed photovoltaic data backfill system of claim 1, wherein the intelligent terminal device comprises a data organization module that organizes data into data backfill compressed files after querying corresponding data based on the data backfill selection data packet, and generates data backfill and correction data packets in combination with file check codes.
3. The distributed photovoltaic data backfill system of claim 1 wherein the monitoring data packet comprises a data packet time stamp and a terminal number, the data packet time stamp being generated in seconds based on a time sequence of data generation, the terminal number being a number of an intelligent terminal device.
4. The distributed photovoltaic data backfill system of claim 3, wherein the breakpoint check module determines if the terminal number in the received monitoring packet is consistent with the broken terminal number: if not, performing real-time data storage; otherwise, storing the real-time data and updating the data backfill task list corresponding to the terminal number.
5. A method of distributed photovoltaic data backfilling performed by the cloud platform system in the distributed photovoltaic data backfilling system of claim 1, comprising:
receiving a monitoring data packet sent by intelligent terminal equipment, and judging whether the monitoring data packet has a breakpoint or not;
updating a data backfill task list containing data backfill task items when the monitoring data packet has a breakpoint; the data backfill task list comprises a plurality of data backfill task items, wherein the data backfill task items are time scale pair sets formed by a starting time scale and an ending time scale of a data packet which is not transmitted between each disconnection and a re-disconnection, and the time intervals of adjacent time scale pairs are smaller than a threshold value and belong to the same data backfill task item;
creating a data backfill selection data packet based on the initial state of the data backfill task item in the data backfill task list and sending the data backfill selection data packet to the intelligent terminal;
receiving a data backfill and reckoning data packet fed back by the intelligent terminal equipment, and updating a ready mark of a data backfill task item, a corresponding data backfill compressed file name and a file check code;
establishing a file uploading process allowing a breakpoint continuous transmission mode according to a ready mark of a task item in a data backfill task list, and receiving a data backfill compressed file uploaded by intelligent terminal equipment; when the communication channel is frequently switched on and off, arranging the file uploading process in an idle period of the communication channel, and replacing a breakpoint continuous transmission mode by adopting a batch processing mode;
checking, decompressing and backfilling the data backfill compressed file;
deleting the completed data backfill task items in the data backfill task list, and notifying the intelligent terminal equipment to delete all the data backfill compressed files in response to the emptying of the data backfill task list.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111268884.5A CN114069847B (en) | 2021-10-29 | 2021-10-29 | Distributed photovoltaic data backfill system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111268884.5A CN114069847B (en) | 2021-10-29 | 2021-10-29 | Distributed photovoltaic data backfill system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114069847A CN114069847A (en) | 2022-02-18 |
| CN114069847B true CN114069847B (en) | 2024-03-26 |
Family
ID=80235923
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111268884.5A Active CN114069847B (en) | 2021-10-29 | 2021-10-29 | Distributed photovoltaic data backfill system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114069847B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103442003A (en) * | 2013-08-26 | 2013-12-11 | 北京科东电力控制系统有限责任公司 | Data acquisition backfill system for SCADA system and method thereof |
| CN104636352A (en) * | 2013-11-08 | 2015-05-20 | 中国石油天然气股份有限公司 | SCADA system historical data complement and query processing method based on quality stamp |
| CN105407135A (en) * | 2015-10-21 | 2016-03-16 | 西安理邦科学仪器有限公司 | Method and system for data breakpoint continuous transmission |
| CN108347463A (en) * | 2017-01-23 | 2018-07-31 | 普天信息技术有限公司 | A kind of terminal document method for uploading |
| CN111723116A (en) * | 2020-06-30 | 2020-09-29 | 上海豫源电力科技有限公司 | Data backfill method, device and system |
-
2021
- 2021-10-29 CN CN202111268884.5A patent/CN114069847B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103442003A (en) * | 2013-08-26 | 2013-12-11 | 北京科东电力控制系统有限责任公司 | Data acquisition backfill system for SCADA system and method thereof |
| CN104636352A (en) * | 2013-11-08 | 2015-05-20 | 中国石油天然气股份有限公司 | SCADA system historical data complement and query processing method based on quality stamp |
| CN105407135A (en) * | 2015-10-21 | 2016-03-16 | 西安理邦科学仪器有限公司 | Method and system for data breakpoint continuous transmission |
| CN108347463A (en) * | 2017-01-23 | 2018-07-31 | 普天信息技术有限公司 | A kind of terminal document method for uploading |
| CN111723116A (en) * | 2020-06-30 | 2020-09-29 | 上海豫源电力科技有限公司 | Data backfill method, device and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114069847A (en) | 2022-02-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108334367A (en) | A kind of firmware remote update system and method towards BMC chip | |
| CN103874113A (en) | Wireless network maintenance method, device and system | |
| CN104954101B (en) | Multiple terminals method of data synchronization based on synchronous ACK | |
| CN106649711A (en) | Distributed type preposed acquisition system based on Redis real-time database | |
| CN107659629A (en) | A kind of efficient electrical power archives synchronous method suitable for power information acquisition system | |
| CN114069847B (en) | Distributed photovoltaic data backfill system and method | |
| CN105338107A (en) | Stronghold operation synchronous management system and stronghold operation synchronous management method | |
| CN114297444A (en) | Network fault analysis method based on RESET message | |
| EP3660679B1 (en) | Data backup method, device and system | |
| CN105281940B (en) | Method, equipment and system for HELLO message interaction based on NETCONF protocol | |
| CN114157675A (en) | Complete synchronous communication system for operation information of multiple low-voltage transformer areas | |
| CN112822171A (en) | Preposed acquisition system and method based on Internet of things protocol | |
| CN108900621A (en) | A kind of otherness cloud synchronous method calculating mode based on mist | |
| CN103414252B (en) | A kind of transformer substation communication service configuration information real-time synchronization system and method thereof | |
| CN103246497B (en) | A kind of real time data method for parallel processing based on Data Placement | |
| CN114401147B (en) | New energy power station communication message comparison method and system based on abstract algorithm | |
| CN102497306A (en) | Method for realizing data transmission of distribution network substation and system thereof | |
| CN116095146A (en) | Source configuration method of relay protection information model of main substation and sub station based on block chain | |
| CN113434604B (en) | Time sequence database synchronization method, system, equipment and storage medium | |
| CN112181594A (en) | Virtual machine live migration method, device, equipment and storage medium | |
| CN109086390A (en) | A kind of realization data consistency method for real-time monitoring | |
| CN111475478A (en) | Heterogeneous power distribution automation system, provincial-regional 1+ N graph synchronization method, provincial-level power distribution master station and storage medium | |
| CN114666406B (en) | Electric power Internet of things data compression method and device based on object model | |
| CN108965002B (en) | Method and system for solving sudden service failure in mobile cloud computing network | |
| Xu et al. | Distributed PV Data Backfill System with Cloud-end Collaboration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |