WO2022236809A1 - Data collection system and method, electronic device, and storage medium - Google Patents

Abstract

A data collection system and method, an electronic device, and a storage medium. The system comprises gateway collection modules (11), an MQTT server (12), data storage modules (13), and a data statistics module (14). The gateway collection modules (11) are used for obtaining operation data information of photovoltaic power stations connected thereto and sending the operation data information to the MQTT server (12). The MQTT server (12) is used for receiving the operation data information of the photovoltaic power stations and distributing the operation data information to the corresponding data storage modules (13). The data storage modules (13) are used for receiving the operation data information of the photovoltaic power stations sent from the MQTT server (12), and if the operation data information is abnormal, recording anomaly log information and sending the anomaly log information to a database, or if the operation data information is normal, sending the operation data information of the photovoltaic power stations to a REDIS cache for caching. The data statistics module (14) is used for regularly obtaining from the REDIS cache the cached operation data information of the photovoltaic power stations and collecting statistics to obtain data statistics information, and sending the data statistics information to the database.

Description

A data acquisition system, method, electronic device and storage medium technical field

The present invention relates to the technical field of data collection, in particular to a data collection system, method, electronic equipment and storage medium.

Background technique

The photovoltaic data acquisition system is used to collect the operating data of photovoltaic power stations. However, the scale and collection volume of traditional photovoltaic data acquisition systems are small, and the scale of photovoltaic power stations is getting larger and larger, especially the development of distributed photovoltaic power stations. faster, and the demand for data acquisition accuracy is getting higher and higher, resulting in an increasing amount of photovoltaic data acquisition. The current photovoltaic data acquisition system is not effective in collecting and storing such a large amount of photovoltaic data. Moreover, the current photovoltaic data acquisition The system mostly uses the HTTP protocol for data transmission during the uploading and communication of collected data, resulting in high network overhead, resulting in low data collection efficiency, system instability and low scalability of the photovoltaic data collection system.

Contents of the invention

In order to solve the problems of low data collection efficiency, system instability and low scalability of existing photovoltaic data collection systems, embodiments of the present invention provide a data collection system, method, electronic equipment, and storage medium.

In the first aspect, an embodiment of the present invention provides a data collection system, including at least one gateway collection module, a message queue telemetry transmission MQTT server, at least one data storage module and a data statistics module, wherein:

The gateway acquisition module is used to obtain the operation data information of the connected photovoltaic power station, and send the currently acquired operation data information of the photovoltaic power station to the MQTT server;

The MQTT server is used to receive the operation data information of the photovoltaic power station, and distribute the operation data information of the photovoltaic power station to the corresponding data storage module according to the subscription information;

The data storage module is configured to subscribe to the MQTT server, receive the operation data information of the photovoltaic power station sent by the MQTT server; when it is determined that the operation data information of the photovoltaic power station is abnormal, record the abnormal log information, And the abnormal log information is sent to the database for storage; when it is determined that there is no abnormality in the operation data information of the photovoltaic power station, the operation data information of the photovoltaic power station is sent to the remote dictionary service REDIS cache for caching;

The data statistics module is used to obtain the cached photovoltaic power station operation data information from the REDIS cache according to a preset time period, and perform statistics on the obtained photovoltaic power station operation data information, obtain data statistics information, and store the obtained The data statistics information is sent to the database for storage.

In one embodiment, the operation data information of the photovoltaic power station includes at least operation data information and inverter operation data information of each photovoltaic node in the photovoltaic power station;

The gateway collection module is specifically configured to send data requests to the photovoltaic node and the inverter respectively in a polling manner, and receive the returned operation data information of the photovoltaic node and the inverter operation data information, Carry out data verification on the operation data information of the photovoltaic node and the operation data information of the inverter respectively, convert the operation data information of the photovoltaic node and the operation data information of the inverter that have passed the verification into a preset data format and send it to the MQTT server.

In one embodiment, the system further includes a front-end server;

The front-end server is configured to receive a data query request sent by a client, obtain data satisfying query conditions from the database or REDIS cache, and return the data satisfying query conditions to the client.

In one embodiment, when the query condition is to query real-time data, the data query request includes the identification information of the target photovoltaic power station and the identification information of the query object, wherein the query object includes the PV nodes and/or inverters in the target PV power plant;

The front-end server is specifically configured to acquire the identification information of the target photovoltaic power station and the current real-time operation data information corresponding to the identification information of the query object from the currently cached data in the REDIS cache, and obtain the acquired Current data information is returned to the client.

In one embodiment, when the query condition is to query statistical data, the data query request includes the identification information of the target photovoltaic power station requested to query, the identification information of the query object, and the start and end time information of the query period, wherein, The query objects include photovoltaic nodes and/or inverters in the target photovoltaic power station;

The front-end server is specifically configured to obtain from the database the identification information of the target photovoltaic power station and the data statistical information corresponding to the identification information of the query object during the query period, and the obtained data statistical information Return to the client.

In one embodiment, the data storage module is further configured to push the abnormality log information to a corresponding client when it is determined that the operation data information of the photovoltaic power station is abnormal.

In one embodiment, the client includes a physical sorting interface, a wiring diagram interface and a data statistics interface, wherein:

The physical sorting interface is used to display the physical position sorting of each photovoltaic node in the photovoltaic power station managed by the client and the real-time operation data information of each photovoltaic node;

The wiring diagram interface is used to display the connection wiring diagram of photovoltaic nodes and inverters in the photovoltaic power station managed by the client;

The data statistics interface is used to display the respective data statistics information and operation status information of each photovoltaic node and inverter in the photovoltaic power station managed by the client.

In a second aspect, an embodiment of the present invention provides a data collection method, including:

The message queue telemetry transmission MQTT server receives the photovoltaic power station operation data information sent by the gateway collection module, and the photovoltaic power station operation data information is obtained by the gateway collection module from the connected photovoltaic power station;

According to the subscription information, the operation data information of the photovoltaic power station is distributed to the corresponding data storage module, so that when the data storage module determines that the operation data information of the photovoltaic power station is abnormal, it will record the abnormal log information and store the The abnormal log information is sent to the database for storage. When it is determined that there is no abnormality in the operation data information of the photovoltaic power station, the operation data information of the photovoltaic power station is sent to the remote dictionary service REDIS cache for caching, so that the data statistics module Obtain the cached photovoltaic power station operating data information from the REDIS cache according to the preset time period, and perform statistics on the obtained photovoltaic power station operating data information to obtain data statistics information, and send the data statistics information to the database for storage.

In one embodiment, the operating data information of the photovoltaic power station includes at least the operating data information of each photovoltaic node in the photovoltaic power station and the inverter operating data information; the operating data information of the photovoltaic power station is collected by the gateway The module is acquired and sent to the MQTT server in the following manner: the gateway acquisition module sends data requests to the photovoltaic node and the inverter respectively in a polling manner, and receives the returned operating data of the photovoltaic node information and the inverter operation data information, data verification is performed on the operation data information of the photovoltaic node and the inverter operation data information respectively, and the operation data information and the inverter operation data information of the photovoltaic node that have passed the verification The operating data information is converted into a preset data format and then sent to the MQTT server.

In a third aspect, an embodiment of the present invention provides a data collection method, including:

The gateway acquisition module obtains the operation data information of the connected photovoltaic power station;

Send the currently obtained operating data information of the photovoltaic power station to the message queue telemetry transmission MQTT server, so that the MQTT server distributes the operating data information of the photovoltaic power station to the corresponding data storage module according to the subscription information, so that all When the data storage module determines that the operation data information of the photovoltaic power station is abnormal, it records the abnormal log information, and sends the abnormal log information to the database for storage; when it determines that the operation data information of the photovoltaic power station is not abnormal , the operating data information of the photovoltaic power station is sent to the remote dictionary service REDIS cache for caching, so that the data statistics module acquires the cached photovoltaic power station operating data information from the REDIS cache according to the preset time period, and The acquired operational data information of the photovoltaic power station is counted to obtain data statistical information, and the data statistical information is sent to the database for storage.

In one embodiment, the operation data information of the photovoltaic power station includes at least operation data information and inverter operation data information of each photovoltaic node in the photovoltaic power station;

Obtain the operation data information of the connected photovoltaic power station, including:

sending data requests to the photovoltaic node and the inverter respectively in a polling manner;

receiving the returned operating data information of the photovoltaic node and the inverter operating data information; and

Send the currently obtained operating data information of the photovoltaic power station to the MQTT server, specifically including:

Carrying out data verification on the operation data information of the photovoltaic node and the operation data information of the inverter respectively;

The operation data information of the photovoltaic node and the inverter operation data information that have passed the verification are converted into a preset data format and then sent to the MQTT server.

In a fourth aspect, an embodiment of the present invention provides a data collection method, including:

The data storage module receives subscribed message queue telemetry and transmits the operating data information of the photovoltaic power station sent by the MQTT server. The operating data information of the photovoltaic power station is obtained by the gateway collection module from the connected photovoltaic power station and sent to the MQTT server. The MQTT server distributes to the data storage module according to the subscription information;

When it is determined that the operating data information of the photovoltaic power station is abnormal, record the abnormal log information, and send the abnormal log information to the database for storage;

When it is determined that there is no abnormality in the operation data information of the photovoltaic power station, the operation data information of the photovoltaic power station will be sent to the remote dictionary service REDIS cache for caching, so that the data statistics module can retrieve the information from the REDIS according to the preset time period. The cached photovoltaic power station operation data information is acquired in the cache, and the acquired photovoltaic power station operation data information is counted to obtain data statistics information, and the data statistics information is sent to the database for storage.

In one embodiment, the method further includes:

When it is determined that there is an abnormality in the operation data of the photovoltaic power station, the abnormal log information is pushed to the corresponding client, and the operation data information of the photovoltaic power station includes at least the operation data information and inverse information of each photovoltaic node in the photovoltaic power station. Transformer operating data information.

In the fifth aspect, an embodiment of the present invention provides an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the program when executing the program. The data collection method described in the present invention.

In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps in the data collection method of the present invention are implemented.

The beneficial effects of the embodiments of the present invention are as follows:

The data acquisition system provided by the embodiment of the present invention includes at least one gateway acquisition module, MQTT (Message Queuing Telemetry Transport, message queue telemetry transmission) server, at least one data storage module and data statistics module, and the gateway acquisition module obtains the connected photovoltaic power generation station operation data information, and send the currently obtained photovoltaic power station operation data information to the MQTT server. The MQTT server receives the photovoltaic power station operation data information sent by the gateway acquisition module, and distributes the photovoltaic power station operation data information to the corresponding The data storage module, the data storage module that has subscribed to the information of the MQTT server receives the operation data information of the photovoltaic power station sent by the MQTT server. When it is determined that the operation data information of the photovoltaic power station is abnormal, the data storage module records the abnormal log information, and sends The abnormal log information is sent to the database for storage. When it is determined that there is no abnormality in the operation data information of the photovoltaic power station, the data storage module sends the operation data information of the photovoltaic power station to the REDIS (Remote Dictionary Server, remote dictionary service) cache for caching. The data statistics module obtains temporarily stored photovoltaic power station operating data information from the REDIS cache according to the preset time period, and performs statistics on the obtained photovoltaic power station operating data information, obtains data statistical information, and sends the data statistical information to the database for further processing. For storage, compared with the traditional single system architecture, the coupling degree between the functional modules is higher, and the failure of a single module may cause the entire system to be paralyzed. The data acquisition system provided by the embodiment of the present invention adopts a multi-level distributed architecture. The gateway module can be used to collect the operating data of different photovoltaic power stations. The distributed system architecture based on MQTT server can collect, store and process massive photovoltaic power station operating data in parallel. The data upload adopts the lightweight MQTT communication protocol to ensure The high availability of the data acquisition system improves the efficiency of data acquisition. Since the system function modules are distributed, the coupling degree of the system is reduced. The distributed architecture can redundant the system to eliminate single point failures. The system has high reliability and the system The availability and scalability are higher, and the operation speed is faster. Moreover, the normal operation data information of the photovoltaic power station is temporarily stored in the REDIS cache, so that users can obtain real-time relevant data of the photovoltaic power station and other services to facilitate the operation of the photovoltaic power station. The statistics of operation data, the abnormal log information and data statistics information are persisted in the database, and the remote monitoring of the photovoltaic power station is convenient for users to grasp the key equipment of the photovoltaic power station and the overall operation status and information of the power station.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Description of drawings

The accompanying drawings described here are used to provide a further understanding of the present invention, and constitute a part of the present invention. The schematic embodiments of the present invention and their descriptions are used to explain the present invention, and do not constitute improper limitations to the present invention. In the attached picture:

Fig. 1 is a schematic structural diagram of a data acquisition system provided by an embodiment of the present invention;

Fig. 2 is a schematic flow diagram of the implementation of the data acquisition method implemented on the MQTT server side provided by the embodiment of the present invention;

3 is a schematic diagram of the implementation process of the data collection method implemented on the side of the gateway collection module provided by the embodiment of the present invention;

FIG. 4 is a schematic diagram of the implementation flow of the data collection method implemented on the side of the data storage module provided by the embodiment of the present invention;

FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.

Detailed ways

Photovoltaic power stations include photovoltaic modules (solar battery modules), inverters, combiner boxes, power distribution cabinets, box transformers and other operating equipment. Photovoltaic modules consist of a certain number of photovoltaic panels (that is, solar cells) in series and parallel. In the existing technology, the traditional photovoltaic operation and maintenance system only monitors photovoltaic modules, and does not have the function of monitoring individual photovoltaic panels. If a single photovoltaic panel operates abnormally, it may cause abnormalities in the entire photovoltaic module. It is often difficult for professional users to find the point of failure. The scale and amount of collection of traditional photovoltaic data collection systems are small, and the scale of photovoltaic power stations is getting larger and larger, especially the development of distributed photovoltaic power stations is getting faster and faster, and the demand for data collection accuracy is getting higher and higher, resulting in photovoltaic The amount of data collection is also increasing. The current photovoltaic data collection system is not effective in collecting and storing such a large amount of photovoltaic data, and cannot concurrently process massive data, which indirectly affects the development of photovoltaic systems. Moreover, the current photovoltaic data acquisition system mostly uses the HTTP protocol for data transmission in the process of uploading and communicating collected data. Re-establishing an HTTP connection for each new request message will lead to high network overhead, resulting in the failure of the photovoltaic data acquisition system. The data collection efficiency is low, the system is unstable and the scalability is not high.

In order to solve the above problems, embodiments of the present invention provide a data acquisition system, method, electronic equipment, and storage medium.

The preferred embodiments of the present invention will be described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, and are not intended to limit the present invention, and in the absence of conflict, the present invention The embodiments and the features in the embodiments can be combined with each other.

As shown in Figure 1, it is a schematic structural diagram of the data collection system provided by the embodiment of the present invention, the data collection system includes at least one gateway collection module 11, MQTT server 12, at least one data storage module 13 and data statistics module 14, each The gateway acquisition module 11 can be connected to a photovoltaic power station through a network, wherein:

The gateway acquisition module 11 is used to acquire the operating data information of the connected photovoltaic power station, and send the currently acquired operating data information of the photovoltaic power station to the MQTT server.

During specific implementation, the operation data information of the photovoltaic power station may include, but is not limited to, the operation data information and inverter operation data information of each photovoltaic node in the photovoltaic power station, where each photovoltaic node is the composition of the photovoltaic modules in the photovoltaic power station For each photovoltaic panel, the operating data information of the photovoltaic node may include, but is not limited to: information such as temperature, voltage, current, and signal strength of the photovoltaic panel, and the operating data information of the inverter may include, but is not limited to: the input power of the inverter, Inverter efficiency, active power, insulation resistance value, cumulative power generation and other information. The operating data information of the photovoltaic power station may also include the operating data information of other operating equipment in the photovoltaic power station, such as combiner boxes, power distribution cabinets, box transformers, etc. This is not limited by the embodiment of the present invention. The operation data information of each photovoltaic node and the inverter operation data information are taken as examples for illustration.

Each gateway acquisition module 11 and each photovoltaic node in the corresponding photovoltaic power station can collect the operation data information of each photovoltaic node through the wireless module, and can collect the inverter operation data information through 485 wired transmission.

Each gateway acquisition module 11 is specifically used to send data requests to the photovoltaic nodes and inverters in the corresponding photovoltaic power station in a polling manner, and receive the returned operating data information of photovoltaic nodes and inverter operating data information, Perform data verification on the operating data information of the photovoltaic node and the inverter operating data information, and convert the operating data information of the photovoltaic node and the inverter operating data information that have passed the verification into a preset data format and send it to the MQTT server 12 .

Specifically, the gateway acquisition module 11 polls and sends data requests to the photovoltaic nodes in the photovoltaic power station connected to it in a cyclic manner. After the photovoltaic node receives the data request, it returns the operating data of the current photovoltaic node to the gateway acquisition module 11. information, after the gateway acquisition module 11 receives the operating data information of the current photovoltaic node returned by the photovoltaic node, it performs data verification on the operating data information of the photovoltaic current photovoltaic node, such as CRC verification, and when the verification is passed, the current photovoltaic node The operating data information of the photovoltaic node is converted into JSON format and sent to the MQTT server 12 through the network port. If the verification fails, the operating data information of the photovoltaic node is discarded. Similarly, the gateway collection module 11 polls and sends data requests to the inverters in the photovoltaic power stations connected to it in a cyclic manner. After receiving the data requests, the inverter returns the current inverter running status Data information, after the gateway acquisition module 11 receives the current inverter operation data information returned by the inverter, it performs data verification on the current inverter operation data information, such as CRC verification, and when the verification is passed, the current inverter operation data information is verified. The inverter operation data information is converted into JSON format and sent to the MQTT server 12 through the network port. If the verification fails, the inverter operation data information is discarded.

The MQTT protocol is a publish/subscribe message protocol designed for remote devices with low hardware performance and poor network quality. Due to the complex operating environment of photovoltaic power stations, the MQTT protocol is suitable as a reporting protocol for collecting operating data of photovoltaic power stations, and , the system and the gateway acquisition module 11 do not need to formulate complex protocols, the transmitted data is more intuitive, and the coupling degree is lower.

The MQTT server 12 is used to receive the operation data information of the photovoltaic power station, and distribute the operation data information of the photovoltaic power station to corresponding data storage modules according to the subscription information.

During specific implementation, each data storage module 13 subscribes to the MQTT server 12, and each data storage module 13 can subscribe to the same topic to the MQTT server 12 to obtain the photovoltaic power station operation data information. When each data storage module 13 subscribes to the MQTT server 12 at the same time. When the power station operation data information is issued, the MQTT server 12 can send the operation data information of different photovoltaic nodes and the inverter operation data information to different data storage modules 13 in parallel when the MQTT server 12 sends the operation data information of the photovoltaic power station, so as to ensure sufficient Storage space, and improve the efficiency of data transmission.

Data storage module 13, is used for subscribing to MQTT server 12, receives the photovoltaic power station operation data information that MQTT server 12 sends; When determining that there is abnormality in photovoltaic power station operation data information, then record abnormal log information, and abnormal log information is sent to The database is stored; when it is determined that there is no abnormality in the operation data information of the photovoltaic power station, the operation data information of the photovoltaic power station is sent to the REDIS cache for caching.

During specific implementation, after the data storage module 13 receives the operating data information of the photovoltaic node and the inverter operating data information in the JSON format sent by the MQTT server 12, it parses the operating data information and the inverter operating data information of the photovoltaic nodes in the JSON format , respectively judge whether there is any abnormality in the operating data information of the photovoltaic node and the inverter operating data information, if there is an abnormality, record the corresponding abnormal log information, and persist the abnormal log information into the database, if there is no abnormality, save the photovoltaic node Node operating data information and inverter operating data information are sent to the REDIS cache for caching, that is, real-time photovoltaic node operating data information and real-time inverter operating data information are temporarily stored in the REDIS cache, so that when When users query the implementation and operation data information of photovoltaic nodes and inverters through the client, they can be obtained directly from the REDIS cache, which improves the efficiency of data acquisition and eases the data storage pressure of the database.

When judging whether there is an abnormality, take judging whether there is an abnormality in the temperature information in the operating data information of the photovoltaic node as an example, compare the temperature information with the preset temperature threshold, and if the temperature of the photovoltaic panel exceeds the temperature threshold, determine that the photovoltaic The temperature information of the node is abnormal. If the temperature of the photovoltaic panel does not exceed the temperature threshold, it is determined that the temperature information of the photovoltaic node is normal.

In one embodiment, the data storage module 13 is further configured to push the abnormality log information to the corresponding client when it is determined that there is an abnormality in the operation data information of the photovoltaic power station.

Specifically, if there is abnormality in the operation data information of the photovoltaic node or the inverter operation data information, the data storage module 13 can start the abnormal push service, and the abnormal data information can be pushed to the corresponding client in the form of a short message to remind the user ( Such as operation and maintenance personnel), and record the corresponding exception log information, and persist the exception log information into the database.

In the embodiment of the present invention, single-board monitoring is performed on each photovoltaic panel in the photovoltaic power station to accurately locate the fault point. When the photovoltaic panel is abnormal, the operation and maintenance personnel can accurately locate the fault occurrence point through the front-end web page of the client, improving Improve operation and maintenance efficiency and reduce security risks.

The data statistics module 14 is used to obtain the cached photovoltaic power station operation data information from the REDIS cache according to the preset time period, and perform statistics on the obtained photovoltaic power station operation data information, obtain data statistics information, and send the data statistics information to the database for storage.

During specific implementation, the data statistics module 14 can create a timed task in advance, and execute regularly according to the preset time period to obtain the current buffered photovoltaic power plant operating data from the REDIS cache. The preset time period can be set to 1 hour, 1 day, or 1 week. Or 1 month, which is not limited in this embodiment of the present invention. For example, if a timed task with a time period of 1 hour is created, it is executed every 1 hour to obtain all the current cached photovoltaic power plant operating data from the REDIS cache, and Delete the obtained operating data of the photovoltaic power station from the REDIS cache, and then, the data statistics module 14 performs statistics on the obtained operating data of the photovoltaic power station in the current period (that is, within one hour), and obtains the corresponding photovoltaic node and/or inverter Data statistics information of each inverter in the current statistical period, and persist the obtained data statistics information of photovoltaic nodes and/or inverters in the current period into the database for storage, where the data statistics information of photovoltaic nodes is taken as an example , may include, but is not limited to: the highest temperature information, the lowest temperature information, the average temperature information, the highest voltage information, the lowest voltage information, the highest current information, the lowest current information, and the highest signal strength for each photovoltaic node acquired in the current period information, minimum signal strength information and other information, and generate corresponding operation reports for each photovoltaic node. During specific implementation, the manner of data statistics can be set as required, which is not limited in this embodiment of the present invention.

In this way, only the statistical information of the operating data of the photovoltaic power station in each period is stored in the database, which improves data availability, saves database storage space, and relieves database storage pressure.

The data acquisition system provided by the embodiments of the present invention may also include a front-end server, wherein:

The front-end server is configured to receive the data query request sent by the client, obtain data satisfying the query condition from the database or REDIS cache, and return the data satisfying the query condition to the client.

Wherein, the query condition can be to query real-time data, and can also be to query statistical data. When the query condition is to query real-time data, the data query request includes the identification information of the target photovoltaic power station and the identification information of the query object, Wherein, the query object includes photovoltaic nodes and/or inverters in the target photovoltaic power station, the identifier of the photovoltaic node may be the physical address of the photovoltaic node, and the identifier of the inverter may be the physical address of the inverter.

When the query condition is to query real-time data, the front-end server is specifically used to obtain the identification information of the target photovoltaic power station and the current real-time operation data information corresponding to the identification information of the query object from the currently cached data in the REDIS cache, and will obtain the current Data information is returned to the client.

When the query condition is to query statistical data, the data query request includes the identification information of the target photovoltaic power station that requests the query, the identification information of the query object, and the start and end time information of the query period, wherein the query object includes the target photovoltaic power station. PV nodes and/or inverters.

When the query condition is to query statistical data, the front-end server is specifically used to obtain the identification information of the target photovoltaic power station and the data statistical information corresponding to the identification information of the query object in the query period from the database, and return the obtained data statistical information to the client.

In this way, when the user (operation and maintenance personnel) wants to view the current operating data information of the photovoltaic power station, he can send a data query request for real-time data to the front-end server through the client, and the front-end server can directly obtain the current operating data of the photovoltaic power station from the REDIS cache. Operational data information improves the efficiency of data acquisition. When the user wants to view the statistical data information of the photovoltaic power station, the client can send a data query request for statistical data to the front-end server, and the front-end server can directly obtain the current operating data information of the photovoltaic power station from the database. To query real-time data and statistical data, the front-end server can obtain the requested data from the REDIS cache and the database in parallel, further improving the efficiency of data acquisition.

In one embodiment, the front-end webpage interface in the client may include a physical sorting interface, a wiring diagram interface and a data statistics interface, wherein:

The physical sorting interface is used to display the physical position sorting of each photovoltaic node in the photovoltaic power station managed by the client and the real-time operation data information of each photovoltaic node.

The wiring diagram interface is used to display the connection wiring diagram of photovoltaic nodes and inverters in the photovoltaic power station managed by the client.

When there is an abnormality in the photovoltaic node, the wiring diagram interface can quickly locate which inverter the photovoltaic node is connected to and which photovoltaic component of the inverter the photovoltaic node is located in, so that users can view it more intuitively.

The data statistics interface is used to display the respective data statistics and operating status information of each photovoltaic node and inverter in the photovoltaic power station managed by the client.

The data acquisition system provided by the embodiment of the present invention includes at least one gateway acquisition module, MQTT (Message Queuing Telemetry Transport, message queue telemetry transmission) server, at least one data storage module and data statistics module, and the gateway acquisition module obtains the connected photovoltaic power generation station operation data information, and send the currently obtained photovoltaic power station operation data information to the MQTT server. The MQTT server receives the photovoltaic power station operation data information sent by the gateway acquisition module, and distributes the photovoltaic power station operation data information to the corresponding The data storage module, the data storage module that has subscribed to the information of the MQTT server receives the operation data information of the photovoltaic power station sent by the MQTT server. When it is determined that the operation data information of the photovoltaic power station is abnormal, the data storage module records the abnormal log information, and sends The abnormal log information is sent to the database for storage. When it is determined that there is no abnormality in the operation data information of the photovoltaic power station, the data storage module sends the operation data information of the photovoltaic power station to the REDIS (Remote Dictionary Server, remote dictionary service) cache for caching. The data statistics module obtains temporarily stored photovoltaic power station operating data information from the REDIS cache according to the preset time period, and performs statistics on the obtained photovoltaic power station operating data information, obtains data statistical information, and sends the data statistical information to the database for further processing. For storage, compared with the traditional single system architecture, the coupling degree between the functional modules is higher, and the failure of a single module may cause the entire system to be paralyzed. The data acquisition system provided by the embodiment of the present invention adopts a multi-level distributed architecture. The gateway module can be used to collect different photovoltaic power station operating data. Using the distributed system architecture based on MQTT server can collect, store and process massive photovoltaic power station operating data in parallel. The data upload adopts the lightweight MQTT communication protocol to ensure The high availability of the data acquisition system improves the efficiency of data acquisition. Since the system function modules are distributed, the coupling degree of the system is reduced. The distributed architecture can redundant the system to eliminate single point failures. The system has high reliability and the system The availability and scalability are higher, and the operation speed is faster. Moreover, the normal operation data information of the photovoltaic power station is temporarily stored in the REDIS cache, so that users can obtain real-time relevant data of the photovoltaic power station and other services to facilitate the operation of the photovoltaic power station. The statistics of operation data, the abnormal log information and data statistics information are persisted in the database, and the remote monitoring of the photovoltaic power station is convenient for users to grasp the key equipment of the photovoltaic power station and the overall operation status and information of the power station.

Based on the same inventive concept, the embodiment of the present invention also provides a data collection method, which is applied to the above-mentioned data collection system provided by the embodiment of the present invention and implemented on the MQTT server side. Because the above-mentioned data collection method solves the problem and the data collection system Similar, therefore, the implementation of the above method can refer to the implementation of the system, and the repetition will not be repeated.

As shown in Figure 2, it is a schematic diagram of the implementation process of the data collection method implemented on the MQTT server side provided by the embodiment of the present invention, and may include the following steps:

S21. The MQTT server receives the photovoltaic power station operation data information sent by the gateway collection module, and the photovoltaic power station operation data information is obtained by the gateway collection module from the connected photovoltaic power station.

S22. Distribute the operation data information of the photovoltaic power station to corresponding data storage modules according to the subscription information.

During specific implementation, the MQTT server distributes the operating data information of the photovoltaic power station to the corresponding data storage module according to the subscription information, so that when the data storage module determines that there is an abnormality in the operating data information of the photovoltaic power station, it will record the abnormality Log information, and send the abnormal log information to the database for storage, when it is determined that there is no abnormality in the operation data information of the photovoltaic power station, then send the operation data information of the photovoltaic power station to the REDIS cache for caching, so that The data statistics module obtains the cached photovoltaic power station operation data information from the REDIS cache according to the preset time period, and performs statistics on the obtained photovoltaic power station operation data information, obtains data statistics information, and sends the data statistics information to to the database for storage.

In one embodiment, the operating data information of the photovoltaic power station includes at least the operating data information of each photovoltaic node in the photovoltaic power station and the inverter operating data information; the operating data information of the photovoltaic power station is collected by the gateway The module is acquired and sent to the MQTT server in the following manner: the gateway acquisition module sends data requests to the photovoltaic node and the inverter respectively in a polling manner, and receives the returned operating data of the photovoltaic node information and the inverter operation data information, data verification is performed on the operation data information of the photovoltaic node and the inverter operation data information respectively, and the operation data information and the inverter operation data information of the photovoltaic node that have passed the verification The operating data information is converted into a preset data format and then sent to the MQTT server.

Based on the same inventive concept, the embodiment of the present invention also provides a data collection method, which is applied to the above-mentioned data collection system provided by the embodiment of the present invention and implemented in the gateway collection module. Because the above-mentioned data collection method solves the problem and the data collection system Similar, therefore, the implementation of the above method can refer to the implementation of the system, and the repetition will not be repeated.

As shown in Figure 3, it is a schematic diagram of the implementation process of the data acquisition method implemented on the gateway acquisition module side provided by the embodiment of the present invention, and may include the following steps:

S31. The gateway acquisition module acquires the operation data information of the connected photovoltaic power station.

S32. Send the currently acquired operational data information of the photovoltaic power station to an MQTT server, so that the MQTT server distributes the operational data information of the photovoltaic power station to corresponding data storage modules according to subscription information.

During specific implementation, the gateway collection module sends the currently acquired operating data information of the photovoltaic power station to the MQTT server, so that the MQTT server distributes the operating data information of the photovoltaic power station to the corresponding data storage module according to the subscription information, When the data storage module determines that the operation data information of the photovoltaic power station is abnormal, it records the abnormal log information, and sends the abnormal log information to the database for storage, and when it determines that the operation data information of the photovoltaic power station When there is no abnormality, the operating data information of the photovoltaic power station is sent to the REDIS cache for caching, so that the data statistics module obtains the cached photovoltaic power station operating data information from the REDIS cache according to a preset time period, and The acquired operational data information of the photovoltaic power station is counted to obtain data statistical information, and the data statistical information is sent to the database for storage.

In one embodiment, the operating data information of the photovoltaic power station includes at least the operating data information and inverter operating data information of each photovoltaic node in the photovoltaic power station;

Obtain the operation data information of the connected photovoltaic power station, including:

sending data requests to the photovoltaic node and the inverter respectively in a polling manner;

receiving the returned operating data information of the photovoltaic node and the inverter operating data information; and

Send the currently obtained operating data information of the photovoltaic power station to the MQTT server, specifically including:

Carrying out data verification on the operation data information of the photovoltaic node and the operation data information of the inverter respectively;

The operation data information of the photovoltaic node and the inverter operation data information that have passed the verification are converted into a preset data format and then sent to the MQTT server.

Based on the same inventive concept, the embodiment of the present invention also provides a data collection method, which is applied to the above-mentioned data collection system provided by the embodiment of the present invention and implemented in the data storage module. Similar, therefore, the implementation of the above method can refer to the implementation of the system, and the repetition will not be repeated.

As shown in Figure 4, it is a schematic diagram of the implementation process of the data collection method implemented on the side of the data storage module provided by the embodiment of the present invention, and may include the following steps:

S41. The data storage module receives the operation data information of the photovoltaic power station sent by the subscribed MQTT server.

The operation data information of the photovoltaic power station is obtained by the gateway collection module from the connected photovoltaic power station and sent to the MQTT server, and the MQTT server distributes it to the data storage module according to the subscription information.

S42. Determine whether the operation data information of the photovoltaic power station is abnormal. When it is determined that the operation data information of the photovoltaic power station is abnormal, perform step S43. When it is determined that the operation data information of the photovoltaic power station is not abnormal, then Execute step S44.

S43. Record abnormal log information, and send the abnormal log information to a database for storage.

S44. Send the operation data information of the photovoltaic power station to the REDIS buffer for buffering.

During specific implementation, when the data storage module determines that there is no abnormality in the operation data information of the photovoltaic power station, it will send the operation data information of the photovoltaic power station to the REDIS cache for caching, so that the data statistics module will start from The cached photovoltaic power station operation data information is obtained from the REDIS cache, and the obtained photovoltaic power station operation data information is counted to obtain data statistics information, and the data statistics information is sent to the database for storage.

In one embodiment, the data collection method further includes:

When it is determined that there is an abnormality in the operation data of the photovoltaic power station, the abnormal log information is pushed to the corresponding client, and the operation data information of the photovoltaic power station includes at least the operation data information and inverse information of each photovoltaic node in the photovoltaic power station. Transformer operating data information.

Based on the same technical concept, an embodiment of the present invention also provides an electronic device 500. Referring to FIG. 5, the electronic device 500 is used to implement the data collection method described in the above method embodiment. The electronic device 500 in this embodiment may include: A memory 501, a processor 502, and a computer program stored in the memory and operable on the processor, such as a data collection program. When the processor executes the computer program, the steps in the above embodiments of the data collection method are implemented, for example, step S21 shown in FIG. 2 .

The specific connection medium between the memory 501 and the processor 502 is not limited in this embodiment of the present invention. In the embodiment of the present application, in FIG. 5, the memory 501 and the processor 502 are connected through the bus 503. The bus 503 is represented by a thick line in FIG. As far as possible. The bus 503 can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 5 , but it does not mean that there is only one bus or one type of bus.

The memory 501 can be a volatile memory (volatile memory), such as a random-access memory (random-access memory, RAM); the memory 501 can also be a non-volatile memory (non-volatile memory), such as a read-only memory, flash memory A memory (flash memory), a hard disk (hard disk drive, HDD) or a solid-state drive (solid-state drive, SSD), or the memory 501 can be used to carry or store desired program codes in the form of instructions or data structures and can be controlled by Any other medium accessed by a computer, but not limited to. The memory 501 may be a combination of the above-mentioned memories.

The processor 502 is configured to implement the data collection method shown in FIGS. 2-4 .

The embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions for executing the above-mentioned processor, and includes a program for executing the above-mentioned processor.

In some possible implementations, various aspects of the data collection method provided by the present invention can also be implemented in the form of a program product, which includes program code. When the program product runs on an electronic device, the program code It is used to make the electronic device execute the steps in the data collection method according to various exemplary embodiments of the present invention described above in this specification.

Those skilled in the art should understand that the embodiments of the present invention may be provided as a system, method, or computer program product. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow diagram procedure or procedures and/or block diagram procedures or blocks.

While preferred embodiments of the present invention have been described, additional changes and modifications can be made to these embodiments by those skilled in the art once the basic inventive concept is appreciated. Therefore, it is intended that the appended claims be construed to cover the preferred embodiment as well as all changes and modifications which fall within the scope of the invention.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims (15)

1. A data acquisition system, characterized in that it includes at least one gateway acquisition module, a message queue telemetry transmission MQTT server, at least one data storage module and a data statistics module, wherein:

   The gateway acquisition module is used to obtain the operation data information of the connected photovoltaic power station, and send the currently acquired operation data information of the photovoltaic power station to the MQTT server;

   The MQTT server is used to receive the operation data information of the photovoltaic power station, and distribute the operation data information of the photovoltaic power station to the corresponding data storage module according to the subscription information;

   The data storage module is configured to subscribe to the MQTT server, receive the operation data information of the photovoltaic power station sent by the MQTT server; when it is determined that the operation data information of the photovoltaic power station is abnormal, record the abnormal log information, And the abnormal log information is sent to the database for storage; when it is determined that there is no abnormality in the operation data information of the photovoltaic power station, the operation data information of the photovoltaic power station is sent to the remote dictionary service REDIS cache for caching;

   The data statistics module is used to obtain the cached photovoltaic power station operation data information from the REDIS cache according to a preset time period, and perform statistics on the obtained photovoltaic power station operation data information, obtain data statistics information, and store the obtained The data statistics information is sent to the database for storage.
2. The system according to claim 1, wherein the operation data information of the photovoltaic power station includes at least operation data information and inverter operation data information of each photovoltaic node in the photovoltaic power station;

   The gateway collection module is specifically configured to send data requests to the photovoltaic node and the inverter respectively in a polling manner, and receive the returned operation data information of the photovoltaic node and the inverter operation data information, Carry out data verification on the operation data information of the photovoltaic node and the operation data information of the inverter respectively, convert the operation data information of the photovoltaic node and the operation data information of the inverter that have passed the verification into a preset data format and send it to the MQTT server.
3. The system according to claim 1 or 2, further comprising a front-end server;

   The front-end server is configured to receive a data query request sent by a client, obtain data satisfying query conditions from the database or REDIS cache, and return the data satisfying query conditions to the client.
4. The system according to claim 3, wherein when the query condition is to query real-time data, the data query request includes the identification information of the target photovoltaic power station and the identification information of the query object, wherein, The query objects include photovoltaic nodes and/or inverters in the target photovoltaic power station;

   The front-end server is specifically configured to acquire the identification information of the target photovoltaic power station and the current real-time operation data information corresponding to the identification information of the query object from the currently cached data in the REDIS cache, and obtain the acquired Current data information is returned to the client.
5. The system according to claim 3, wherein when the query condition is to query statistical data, the data query request includes the identification information of the target photovoltaic power station, the identification information of the query object, and the query period The start and end time information of , wherein the query object includes the photovoltaic nodes and/or inverters in the target photovoltaic power station;

   The front-end server is specifically configured to obtain from the database the identification information of the target photovoltaic power station and the data statistical information corresponding to the identification information of the query object during the query period, and the obtained data statistical information Return to the client.
6. The system of claim 1, wherein

   The data storage module is further configured to push the abnormality log information to a corresponding client when it is determined that the operational data information of the photovoltaic power station is abnormal.
7. The system according to any one of claims 4 to 6, wherein the client includes a physical sorting interface, a wiring diagram interface and a data statistics interface, wherein:

   The physical sorting interface is used to display the physical position sorting of each photovoltaic node in the photovoltaic power station managed by the client and the real-time operation data information of each photovoltaic node;

   The wiring diagram interface is used to display the connection wiring diagram of photovoltaic nodes and inverters in the photovoltaic power station managed by the client;

   The data statistics interface is used to display the respective data statistics information and operation status information of each photovoltaic node and inverter in the photovoltaic power station managed by the client.
8. A data collection method, characterized in that, comprising:

   The message queue telemetry transmission MQTT server receives the photovoltaic power station operation data information sent by the gateway collection module, and the photovoltaic power station operation data information is obtained by the gateway collection module from the connected photovoltaic power station;

   According to the subscription information, the operation data information of the photovoltaic power station is distributed to the corresponding data storage module, so that when the data storage module determines that the operation data information of the photovoltaic power station is abnormal, it will record the abnormal log information and store the The abnormal log information is sent to the database for storage. When it is determined that there is no abnormality in the operation data information of the photovoltaic power station, the operation data information of the photovoltaic power station is sent to the remote dictionary service REDIS cache for caching, so that the data statistics module Obtain the cached photovoltaic power station operating data information from the REDIS cache according to the preset time period, and perform statistics on the obtained photovoltaic power station operating data information to obtain data statistics information, and send the data statistics information to the database for storage.
9. The method according to claim 8, wherein the operation data information of the photovoltaic power station includes at least operation data information and inverter operation data information of each photovoltaic node in the photovoltaic power station; The data information is sent to the MQTT server by the gateway acquisition module after being acquired in the following manner: the gateway acquisition module sends data requests to the photovoltaic node and the inverter respectively in a polling manner, and receives the returned The operating data information of the photovoltaic node and the inverter operating data information, respectively perform data verification on the operating data information of the photovoltaic node and the inverter operating data information, and verify the The operation data information and the inverter operation data information are converted into a preset data format and then sent to the MQTT server.
10. A data collection method, characterized in that, comprising:

    The gateway acquisition module obtains the operation data information of the connected photovoltaic power station;

    Send the currently obtained operating data information of the photovoltaic power station to the message queue telemetry transmission MQTT server, so that the MQTT server distributes the operating data information of the photovoltaic power station to the corresponding data storage module according to the subscription information, so that all When the data storage module determines that the operation data information of the photovoltaic power station is abnormal, it records the abnormal log information, and sends the abnormal log information to the database for storage; when it determines that the operation data information of the photovoltaic power station is not abnormal , the operating data information of the photovoltaic power station is sent to the remote dictionary service REDIS cache for caching, so that the data statistics module acquires the cached photovoltaic power station operating data information from the REDIS cache according to the preset time period, and The acquired operational data information of the photovoltaic power station is counted to obtain data statistical information, and the data statistical information is sent to the database for storage.
11. The method according to claim 10, wherein the operation data information of the photovoltaic power station includes at least operation data information and inverter operation data information of each photovoltaic node in the photovoltaic power station;

    Obtain the operation data information of the connected photovoltaic power station, including:

    sending data requests to the photovoltaic node and the inverter respectively in a polling manner;

    receiving the returned operating data information of the photovoltaic node and the inverter operating data information; and

    Send the currently obtained operating data information of the photovoltaic power station to the MQTT server, specifically including:

    Carrying out data verification on the operation data information of the photovoltaic node and the operation data information of the inverter respectively;

    The operation data information of the photovoltaic node and the inverter operation data information that have passed the verification are converted into a preset data format and then sent to the MQTT server.
12. A data collection method, characterized in that, comprising:

    The data storage module receives subscribed message queue telemetry and transmits the operating data information of the photovoltaic power station sent by the MQTT server. The operating data information of the photovoltaic power station is obtained by the gateway collection module from the connected photovoltaic power station and sent to the MQTT server. The MQTT server distributes to the data storage module according to the subscription information;

    When it is determined that the operating data information of the photovoltaic power station is abnormal, record the abnormal log information, and send the abnormal log information to the database for storage;

    When it is determined that there is no abnormality in the operation data information of the photovoltaic power station, the operation data information of the photovoltaic power station will be sent to the remote dictionary service REDIS cache for caching, so that the data statistics module can retrieve the information from the REDIS according to the preset time period. The cached photovoltaic power station operation data information is acquired in the cache, and the acquired photovoltaic power station operation data information is counted to obtain data statistics information, and the data statistics information is sent to the database for storage.
13. The method of claim 12, further comprising:

    When it is determined that there is an abnormality in the operation data of the photovoltaic power station, the abnormal log information is pushed to the corresponding client, and the operation data information of the photovoltaic power station includes at least the operation data information and inverse information of each photovoltaic node in the photovoltaic power station. Converter operating data information.
14. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, characterized in that, when the processor executes the program, it implements claims 8-13 The data collection method described in any one.
15. A computer-readable storage medium, on which a computer program is stored, characterized in that, when the program is executed by a processor, the steps in the data collection method according to any one of claims 8-13 are realized.

Images