CN111752918B - Historical data interaction system and configuration method thereof - Google Patents
Historical data interaction system and configuration method thereof Download PDFInfo
- Publication number
- CN111752918B CN111752918B CN202010413492.2A CN202010413492A CN111752918B CN 111752918 B CN111752918 B CN 111752918B CN 202010413492 A CN202010413492 A CN 202010413492A CN 111752918 B CN111752918 B CN 111752918B
- Authority
- CN
- China
- Prior art keywords
- data
- configuration
- acquisition
- history
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000003993 interaction Effects 0.000 title claims abstract description 20
- 238000012544 monitoring process Methods 0.000 claims abstract description 63
- 230000008859 change Effects 0.000 claims description 40
- 230000008569 process Effects 0.000 claims description 14
- 238000001514 detection method Methods 0.000 claims description 13
- 230000004044 response Effects 0.000 claims description 8
- 238000013507 mapping Methods 0.000 claims description 7
- 238000013480 data collection Methods 0.000 claims description 6
- 238000007726 management method Methods 0.000 abstract description 14
- 238000013523 data management Methods 0.000 abstract description 5
- 238000013461 design Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 9
- 238000004590 computer program Methods 0.000 description 7
- 238000003860 storage Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 4
- 238000004220 aggregation Methods 0.000 description 3
- 238000004140 cleaning Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000002776 aggregation Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 230000014759 maintenance of location Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 238000012958 reprocessing Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/219—Managing data history or versioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Economics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Water Supply & Treatment (AREA)
- Computational Linguistics (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a historical data interaction system and a configuration method thereof, wherein the historical data interaction system comprises a historical server, a data monitoring terminal and a data application client; the configuration method comprises the following steps: configuring unique reference names of each history server, and enabling the configuration data application client to access the corresponding history server according to the reference names; configuring and generating a startup configuration file, wherein the configuration content comprises: the history service name selects state information, data acquisition tag point information and acquisition parameter information corresponding to each data acquisition tag point, so that after the history server is configured according to a startup configuration file, a data subscription request can be sent to a data monitoring terminal corresponding to the corresponding acquisition tag point according to the acquisition parameter information, and push data of the data monitoring terminal can be further received; and carrying out on-line management configuration on the history server to modify the configured acquisition tag point information and acquisition parameter information in the history server. The invention can improve the safety and flexibility of the history data management.
Description
Technical Field
The invention relates to the technical field of historical data management in a power system, in particular to a historical data interaction system and a configuration method thereof.
Background
Along with the rapid development of the Internet and the continuous and deep intelligent construction, the advanced information technology provides technical support for the intelligent development of the power system, the advanced information technologies such as big data, cloud computing, the Internet of things, the mobile Internet and the like are deeply fused with the power industry, the scale of the measuring point which needs to be supported becomes huge, and the data quantity generated by the technology is exponentially increased.
The historical library server is in charge of collecting data from a data source and then storing the data in a lasting mode, and is convenient for carrying out trend playback, fault analysis and various index statistical analysis on the historical data. But the dramatic increase in data volume tends to present a significant challenge to the historian server. In the face of huge measurement point quantity and different data change characteristics, how to design configuration logic to collect data more efficiently and reasonably, how to design access modes of a history base server to obtain data more safely, how to design configuration files and select formats of the configuration files to enable data management to be safer and more general, and the method becomes a problem to be solved in the field.
In terms of historical data configuration, most of the prior art adopts a single configuration file, or adopts an Access database to store configuration information, or directly configures the IP of a server in the configuration file to Access the server, which is not comprehensive in terms of flexibility, safety and cross-platform.
Disclosure of Invention
The invention aims to provide a historical data interaction system and a configuration method thereof, which improve the safety and flexibility of historical data management.
The technical scheme adopted by the invention is as follows:
in one aspect, the invention provides a configuration method of a historical data interaction system, wherein the historical data interaction system comprises a historical server, a data monitoring terminal and a data application client; the configuration method comprises the following steps:
configuring unique reference names of each history server and a mapping relation between the reference names and the IP addresses of the history servers, so that a data application client can respond to the reference names appointed by a user to access the history servers of the corresponding IP addresses;
configuring and generating a boot configuration file for the history server to boot, read and load the configuration, wherein the configuration content of the boot configuration file comprises: the method comprises the steps that state information, data acquisition tag point information and acquisition parameter information corresponding to each data acquisition tag point are selected by a history service name corresponding to each history server, so that after the history server is configured according to a startup configuration file, a data subscription request can be sent to a data monitoring terminal corresponding to the corresponding acquisition tag point according to the acquisition parameter information, and the corresponding data monitoring terminal pushes data to the history server according to the acquisition parameter information in the received data subscription request;
and carrying out on-line management configuration on the history server to modify the configured acquisition tag point information and acquisition parameter information in the history server.
Optionally, the data acquisition tag point information comprises tag point names, tag point attributes and tag point engineering description information corresponding to each data monitoring terminal; the acquisition parameter information comprises a minimum acquisition period, a maximum acquisition period and minimum variation value parameter information;
the method further comprises the steps of: the method comprises the steps that a data monitoring terminal is configured to respond to a data subscription request of a history server, and a minimum acquisition period, a maximum acquisition period and a minimum variation value parameter are obtained, so that:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is smaller than the minimum acquisition period, not pushing the monitoring data after the change; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and the monitoring data change amount is larger than the minimum change amount value, and pushing the changed detection data to a subscriber history server; and in response to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period, pushing the changed detection data to the subscriber history server.
Through the scheme, the minimum acquisition period, the maximum acquisition period and the minimum variation value can be reasonably configured according to different application requirements, so that data meeting the requirements can be acquired, resources can be saved, and the data acquisition efficiency is improved.
Optionally, in the configuration process of the startup configuration file, the data collection tag points with the same collection parameters are configured by adding the data collection tag points to a preset same tag point type template, wherein the tag point type template comprises collection parameter attributes which can be preset or dynamically set. The invention can be used for setting the label point template in the configuration software generated by the startup configuration file, so that a user can conveniently classify the label points and determine the acquisition parameters according to the needs, for example, a certain label point needs to subscribe data according to a certain acquisition parameter, and only the label point needs to be dragged into the template corresponding to the acquisition parameter, namely, the corresponding label point is endowed with the acquisition parameter attribute of the template.
Optionally, the configuration content of the startup configuration file further includes: and configuring a pre-statistics rule of the history server, wherein the pre-statistics rule comprises information to be counted, a counting method and a counting period. If the daily statement statistics of related measuring points is needed by the history service corresponding to a certain history server is pre-configured, the corresponding history server carries out statistics of the corresponding information daily statement according to a corresponding statistics period and a corresponding statistics method according to a pre-configured statistics rule after loading the startup configuration file, and the scheme design can enable the data application client to directly inquire the statistics result without aggregation operation, so that the inquiring and operation efficiency of the data application client can be improved.
In a second aspect, the present invention provides a method for generating a boot configuration file in the configuration method of the historical data interaction system according to the first aspect, including:
receiving unique reference name information of each history server input by a user, and storing the unique reference name information to an offline configuration file;
responding to the configuration user to select any history service through an operation interface, and storing the selected state information of the corresponding history service into an offline configuration file, so that when the history server is started to read the starting configuration file, the corresponding history service application can be started according to the selected state information of the history service;
receiving acquisition label points and acquisition parameter information input by a configuration user, and storing corresponding information into an offline configuration file;
responding to a file synchronization instruction input by a configuration user, and synchronizing configuration information in an offline configuration file into a preset online configuration file;
responding to configuration rollback instructions input by a configuration user, and synchronizing configuration information in an online configuration file into an offline configuration file;
and taking the online configuration file as a finally generated starting configuration file and outputting the starting configuration file.
Through the scheme, the offline configuration file and the online configuration file form a mutual backup mechanism, so that the configuration safety and the restorability under the misoperation condition can be improved.
Optionally, the offline configuration file adopts a sqlite database file, and the online configuration file adopts a csv file. The Sqlite is a cross-platform lightweight embedded database, does not need to be installed and configured in a system, does not need to be used as any recovery operation after the system crashes, does not need any external dependence when in use, and has the functions of all operations, and the like inherited by itself, so that resources are rarely occupied. The csv file has a simple structure and is similar to a text file, and the size of the space for storing information can be reduced due to a simple storage mode, so that network transmission and reprocessing of a client side are facilitated.
In a third aspect, the present invention provides a device for generating a boot configuration file in the configuration method of the historical data interaction system according to the first aspect, including:
the reference name configuration module is configured to receive unique reference name information of each history server input by a user and store the unique reference name information into an offline configuration file;
the history service configuration module is configured to respond to the configuration of any history service selected by a configuration user through an operation interface, and save the selected state information of the corresponding history service to an offline configuration file, so that when the history server is started to read the starting configuration file, the corresponding history service application can be started according to the selected state information of the history service;
the acquisition tag point configuration module is configured to receive acquisition tag points and acquisition parameter information input by a configuration user and store corresponding information into an offline configuration file;
the configuration information synchronizing module is configured to synchronize the configuration information in the offline configuration file to a preset online configuration file in response to a configuration user input file synchronizing instruction;
the configuration rollback module is configured to respond to configuration rollback instructions input by a configuration user and synchronize configuration information in the online configuration file into the offline configuration file;
the starting-up configuration file generating module is configured to take the online configuration file as a finally generated starting-up configuration file and output the finally generated starting-up configuration file.
Optionally, the collected tag point configuration module includes a tag point template and a tag point class template that can be displayed on an operation interface; the label point templates comprise data acquisition label point attributes which can be preset or dynamically set, and the label point templates are configured to be dragged into any label point type template; the label point class templates comprise acquisition parameter attributes which can be preset or dynamically set, and the label point class templates are configured to respond to the fact that any label point template is dragged into the current label point class templates, and then the acquisition parameter attributes of the current label point class templates are assigned to the data acquisition label points corresponding to the corresponding label point templates.
The scheme design can facilitate users to classify the tag points and determine the acquisition parameters according to the needs, if a certain tag point needs to subscribe data with a certain acquisition parameter, the corresponding tag point can be endowed with the acquisition parameter attribute of the template only by dragging the tag point into the class template corresponding to the acquisition parameter, and the operation convenience of configuration personnel is greatly improved.
In a fourth aspect, the invention also provides a historical data interaction system, which comprises a historical server, a data monitoring terminal and a data application client; the method is characterized in that:
each history server is respectively configured with a unique reference name, the mapping relation between the unique reference name of each history server and the IP address is stored in the data application client, and the data application client responds to the reference name appointed by the user to access the history server of the corresponding IP address;
the history server reads a preset starting configuration file when starting up, and configuration information of the starting configuration file comprises: the history service name corresponding to each history server selects state information, data acquisition tag point information and acquisition parameter information corresponding to each data acquisition tag point; the history server performs starting configuration according to configuration information in the starting configuration file, so that the history server can: starting corresponding historical service according to the state information selected by the historical service name, and sending a data subscription request to a data monitoring terminal corresponding to the corresponding acquisition tag point according to the acquisition parameter information;
the data monitoring terminal pushes data to the history server according to the acquired parameter information in the received data subscription request;
the history server is also provided with an on-line management configuration interface, receives an on-line management configuration request input by a user through the on-line management configuration interface in the process of running the history service, and responds to the on-line management configuration request, modifies the configured acquisition tag point information and acquisition parameter information.
Optionally, the collected parameter information of the collected tag point includes a minimum collection period, a maximum collection period and a minimum variation value parameter;
the data monitoring terminal responds to the data subscription request of the history server to acquire the minimum acquisition period, the maximum acquisition period and the minimum variation value parameter, and then:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is smaller than the minimum acquisition period, not pushing the monitoring data after the change; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and the monitoring data change amount is larger than the minimum change amount value, and pushing the changed detection data to a subscriber history server; and in response to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period, pushing the changed detection data to the subscriber history server.
Advantageous effects
Compared with the prior art, the invention has the following advantages:
1) The data application client side is accessed to the data by configuring the unique reference name for the history server instead of accessing the server through the computer name or the IP address of the history server, so that only the user knowing the reference name of the target history server can access the data, and the access security of the server data is improved;
2) The history server collects data from the data monitoring terminal in a subscription mode, and designs a minimum sampling period, a maximum sampling period and a minimum variation value as subscription parameters, so that the data meeting the requirements can be collected, resources can be saved, and the data collection efficiency is improved;
3) The method has the advantages that the off-line configuration file is realized by adopting the universal cross-platform sqlite database, the on-line configuration file is realized by adopting the csv file, and the reliability and portability of the configured data are improved by combining the two configuration files;
4) When the parameters are collected and configured, common configuration parameters are abstracted through the class template, so that the configuration efficiency of collecting tag points can be improved, and the operation of configuration personnel is simplified;
5) Through the configuration design of the pre-statistics, the statistics of the data with high utilization rate of the application terminal at the historical server terminal can be performed in advance, the direct query of the data application client terminal is facilitated, the re-aggregation calculation is not needed, and the data query and application efficiency is improved.
Drawings
FIG. 1 is a schematic diagram of the working principle of the historical data interaction system of the invention;
FIG. 2 is a schematic diagram of a power-on configuration flow of a history server;
FIG. 3 is a schematic flow diagram of a data application client accessing a history server;
fig. 4 is a schematic configuration flow chart of a boot configuration file.
Detailed Description
Further description is provided below in connection with the drawings and the specific embodiments.
Example 1
The embodiment introduces a historical data interaction system, which is shown by referring to fig. 1, and comprises a historical server, a data monitoring terminal and a data application client;
each history server is respectively configured with a unique reference name, the mapping relation between the unique reference name of each history server and the IP address is stored in the data application client, and the data application client responds to the reference name appointed by the user to access the history server of the corresponding IP address;
the history server reads a preset starting configuration file when starting up, and configuration information of the starting configuration file comprises: the history service name corresponding to each history server selects state information, data acquisition tag point information and acquisition parameter information corresponding to each data acquisition tag point; the history server performs starting configuration according to configuration information in the starting configuration file, so that the history server can: starting corresponding historical service according to the state information selected by the historical service name, and sending a data subscription request to a data monitoring terminal corresponding to the corresponding acquisition tag point according to the acquisition parameter information;
the data monitoring terminal pushes data to the history server according to the acquired parameter information in the received data subscription request;
the history server is also provided with an on-line management configuration interface, receives an on-line management configuration request input by a user through the on-line management configuration interface in the process of running the history service, and responds to the on-line management configuration request, modifies the configured acquisition tag point information and acquisition parameter information.
In this embodiment, the data monitoring terminal may be an RTU, an english full name Remote Terminal Unit of the RTU, and a chinese full name remote terminal control system, which are responsible for monitoring and controlling field signals and industrial devices. Most of the power systems collect data in a polled manner, i.e. the RTU transmits data to the master only after receiving a request from the master. The polling mode is to send a request to the RTU periodically, and the data may not change in the polling time, but the RTU still sends the data, which causes waste of resources.
The invention designs the minimum acquisition period, the maximum acquisition period and the minimum variation value parameter aiming at different measuring points, namely data acquisition label points, and reads configuration when the historical server is started up, and transmits the configuration to the data detection terminal, such as RTU, through the data subscription request. Referring to fig. 3, the data monitoring terminal responds to a data subscription request of the history server to obtain parameters of a minimum acquisition period, a maximum acquisition period and a minimum variation value, and then:
when the monitoring data changes, and the time interval between the current time and the previous data pushing is smaller than the minimum acquisition period, pushing the monitoring data after the change is not performed; when the monitoring data changes, and the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and the monitoring data change amount is larger than the minimum change amount value, pushing the changed detection data to a subscriber history server; when the monitoring data changes and the time interval between the current time and the previous data pushing is larger than the maximum acquisition period, pushing the changed detection data to a subscriber history server. The method can collect the data meeting the requirements, save resources and improve the data collection efficiency.
Example 2
The present embodiment specifically describes a configuration method of a history data interaction system based on the same inventive concept as that of embodiment 1.
The history data interaction system comprises a history server, a data monitoring terminal and a data application client as described in the embodiment 1;
the configuration method comprises the following steps:
configuring unique reference names of each history server and a mapping relation between the reference names and the IP addresses of the history servers, so that a data application client can respond to the reference names appointed by a user to access the history servers of the corresponding IP addresses;
configuring and generating a boot configuration file for the history server to boot, read and load the configuration, wherein the configuration content of the boot configuration file comprises: the method comprises the steps that state information, data acquisition tag point information and acquisition parameter information corresponding to each data acquisition tag point are selected by a history service name corresponding to each history server, so that after the history server is configured according to a startup configuration file, a data subscription request can be sent to a data monitoring terminal corresponding to the corresponding acquisition tag point according to the acquisition parameter information, and the corresponding data monitoring terminal pushes data to the history server according to the acquisition parameter information in the received data subscription request;
and carrying out on-line management configuration on the history server to modify the configured acquisition tag point information and acquisition parameter information in the history server.
Referring to fig. 3, in this embodiment, when the application is performed, the mapping relationship configuration of the unique reference name and the IP address of the history server needs to be synchronized to the data application client, when the data application client accesses the history server, the client can access the history server only through the unique reference name, the logic of the bottom layer of the data application client is that the corresponding IP address is obtained by searching in the local Cache through the reference name first, if so, otherwise, whether the reference name is misspelled or not registered is checked, and then the data application client is linked to the corresponding server through the IP address, so that the data access in the server is started. The security of the history server data access is greatly improved.
The data acquisition tag point information comprises tag point names, tag point attributes and tag point engineering description information corresponding to each data monitoring terminal; the acquisition parameter information comprises a minimum acquisition period, a maximum acquisition period and minimum variation value parameter information;
the configuration method further comprises the following steps: the method comprises the steps that a data monitoring terminal is configured to respond to a data subscription request of a history server, and a minimum acquisition period, a maximum acquisition period and a minimum variation value parameter are obtained, so that:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is smaller than the minimum acquisition period, not pushing the monitoring data after the change; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and the monitoring data change amount is larger than the minimum change amount value, and pushing the changed detection data to a subscriber history server; and in response to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period, pushing the changed detection data to the subscriber history server.
Through the scheme, the minimum acquisition period, the maximum acquisition period and the minimum variation value can be reasonably configured according to different application requirements, so that data meeting the requirements can be acquired, resources can be saved, and the data acquisition efficiency is improved.
In this embodiment, considering that the data change characteristics of different measurement points may have similarity, a template is designed for collecting the grouping of the label points, so as to facilitate classification definition. Parameters to be configured of the template comprise template names, the number of actual tag points of the template, the number of maximum tag points of the template, the minimum acquisition period, the maximum acquisition period, the minimum variation value, data statistics options and data cleaning options; parameters to be configured for the tag point include tag roll name, attribute, description and template name to which the tag point belongs. If the numerical change rules of some label points are similar, the label points are placed under one template, and the minimum acquisition period, the maximum acquisition period and the minimum change value corresponding to different templates can be set differently according to the numerical change rules of the label points, so that the flexibility of configuration and the accuracy of data acquisition are greatly improved. The combination of tag point name and attribute is the unique identification requested from the RTU, and what is shown in the description is the actual meaning of the tag point in the project.
In a specific implementation manner, in the configuration process of the startup configuration file, the data acquisition tag points with the same acquisition parameters are configured by adding the data acquisition tag points to a preset same tag point type template, wherein the tag point type template comprises acquisition parameter attributes which can be preset or dynamically set. The invention can be used for setting the label point template in the configuration software generated by the startup configuration file, so that a user can conveniently classify the label points and determine the acquisition parameters according to the needs, for example, a certain label point needs to subscribe data according to a certain acquisition parameter, and only the label point needs to be dragged into the template corresponding to the acquisition parameter, namely, the corresponding label point is endowed with the acquisition parameter attribute of the template.
The configuration content of the startup configuration file further comprises: and configuring a pre-statistics rule of the history server, wherein the pre-statistics rule comprises information to be counted, a counting method and a counting period. If the daily statement statistics of related measuring points is needed by the history service corresponding to a certain history server is pre-configured, the corresponding history server carries out statistics of the corresponding information daily statement according to a corresponding statistics period and a corresponding statistics method according to a pre-configured statistics rule after loading the startup configuration file, and the scheme design can enable the data application client to directly inquire the statistics result without aggregation operation, so that the inquiring and operation efficiency of the data application client can be improved.
Through the configuration of the pre-statistics rules, the method and the device can realize that after a certain label point is selected, the start and stop time is input, and all historical data in the time interval can be checked to know the detailed information of data change. The daily report, the monthly report and the like can be counted according to the requirements, the pre-statistics setting can be carried out for improving the performance of checking the statistical information, the data statistics can be selected to be non-statistics, and the statistical period can be manually input; when a statistics period is input, a label point can be selected firstly, meanwhile, a statistics function is selected, the statistics function has a minimum value, a maximum value, an average value and the like, and after data statistics is set, statistics information is generated and persisted in a background periodically. When the storage space of the magnetic disk is insufficient, the data needs to be cleaned, so the invention can also carry out data cleaning setting, wherein the data retention time can be set, and if the retention time is set to be 6 months, the data with the distance of more than 6 months is deleted; the purpose of data export is to perform data backup, or alternatively, a certain period of time may be selected to conduct export, so as to facilitate offline analysis, and the format of the exported file may be xml or csv. The data import may be to parse data from other xml or csv files and store it in the current system.
Regarding online management configuration of a history server, since the content of a startup configuration file is only loaded when a history service process is started, and the history service process is continuously operated for 7×24 hours under normal conditions, a function of online adding/deleting a tag point must be provided, and after a certain tag point is added online, the history service process immediately performs data acquisition and persistence on the tag point; after deleting a certain tag point on line, the history service process does not collect data. The invention can be realized by management tool software corresponding to the online management configuration thought to perform online label adding, online label deleting, original data checking, data statistics setting, data cleaning setting, data importing and exporting and other data management operations,
example 3
The present embodiment specifically describes the configuration and generation of the boot configuration file described in embodiment 2.
Referring to fig. 4, the method for generating a boot configuration file includes:
receiving unique reference name information of each history server input by a user, and storing the unique reference name information to an offline configuration file;
responding to the configuration user to select any history service through an operation interface, and storing the selected state information of the corresponding history service into an offline configuration file, so that when the history server is started to read the starting configuration file, the corresponding history service application can be started according to the selected state information of the history service;
receiving acquisition label points and acquisition parameter information input by a configuration user, and storing corresponding information into an offline configuration file;
responding to a file synchronization instruction input by a configuration user, and synchronizing configuration information in an offline configuration file into a preset online configuration file;
responding to configuration rollback instructions input by a configuration user, and synchronizing configuration information in an online configuration file into an offline configuration file;
and taking the online configuration file as a finally generated starting configuration file and outputting the starting configuration file.
Through the scheme, the offline configuration file and the online configuration file form a mutual backup mechanism, so that the configuration safety and the restorability under the misoperation condition can be improved.
In consideration of convenience of configuration of collection label points, the boot file configuration method of the embodiment can firstly configure a plurality of class templates and parameters thereof, and then directly import collection labels of corresponding collection parameters into corresponding class templates. Or the label points are increased by dragging the template on the interface and the definition of the template is realized.
In this embodiment, the offline configuration file adopts a sqlite database file, and the online configuration file adopts a csv file. The Sqlite is a cross-platform lightweight embedded database, does not need to be installed and configured in a system, does not need to be used as any recovery operation after the system crashes, does not need any external dependence when in use, and has the functions of all operations, and the like inherited by itself, so that resources are rarely occupied. The csv file has a simple structure and is similar to a text file, and the size of the space for storing information can be reduced due to a simple storage mode, so that network transmission and reprocessing of a client side are facilitated.
When the boot configuration file is generated through the embodiment, the required historical service process name can be checked on the corresponding boot configuration tool software interface, and after configuration is completed, the boot configuration tool is closed to automatically generate a boot configuration file. Referring to fig. 2, after restarting the history server, the history server reads the boot configuration file, if the corresponding history service of the local machine is selected and a unique reference name is configured, the history service process is started, the computer name of the local machine is mapped by the reference name, and if the reference name is not configured, a default reference name is used; if the history service is not selected, the starting configuration file is not provided with the history service, and the history service process is not started.
Example 4
Based on the same inventive concept as embodiment 3, this embodiment introduces a startup configuration file generating device, including:
the reference name configuration module is configured to receive unique reference name information of each history server input by a user and store the unique reference name information into an offline configuration file;
the history service configuration module is configured to respond to the configuration of any history service selected by a configuration user through an operation interface, and save the selected state information of the corresponding history service to an offline configuration file, so that when the history server is started to read the starting configuration file, the corresponding history service application can be started according to the selected state information of the history service;
the acquisition tag point configuration module is configured to receive acquisition tag points and acquisition parameter information input by a configuration user and store corresponding information into an offline configuration file;
the configuration information synchronizing module is configured to synchronize the configuration information in the offline configuration file to a preset online configuration file in response to a configuration user input file synchronizing instruction;
the configuration rollback module is configured to respond to configuration rollback instructions input by a configuration user and synchronize configuration information in the online configuration file into the offline configuration file;
the starting-up configuration file generating module is configured to take the online configuration file as a finally generated starting-up configuration file and output the finally generated starting-up configuration file.
In this embodiment, the collected tag point configuration module includes a tag point template and a tag point class template that can be displayed on an operation interface; the label point templates comprise data acquisition label point attributes which can be preset or dynamically set, and the label point templates are configured to be dragged into any label point type template; the label point class templates comprise acquisition parameter attributes which can be preset or dynamically set, and the label point class templates are configured to respond to the fact that any label point template is dragged into the current label point class templates, and then the acquisition parameter attributes of the current label point class templates are assigned to the data acquisition label points corresponding to the corresponding label point templates.
The scheme design can facilitate users to classify the tag points and determine the acquisition parameters according to the needs, if a certain tag point needs to subscribe data with a certain acquisition parameter, the corresponding tag point can be endowed with the acquisition parameter attribute of the template only by dragging the tag point into the class template corresponding to the acquisition parameter, and the operation convenience of configuration personnel is greatly improved.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are all within the protection of the present invention.
Claims (9)
1. A configuration method of a historical data interaction system comprises a historical server, a data monitoring terminal and a data application client; the method is characterized by comprising the following steps:
configuring unique reference names of each history server and a mapping relation between the reference names and the IP addresses of the history servers, so that a data application client can respond to the reference names appointed by a user to access the history servers of the corresponding IP addresses;
configuring and generating a boot configuration file for the history server to boot, read and load the configuration, wherein the configuration content of the boot configuration file comprises: the method comprises the steps that state information, data acquisition tag point information and acquisition parameter information corresponding to each data acquisition tag point are selected by a history service name corresponding to each history server, so that after the history server is configured according to a startup configuration file, a data subscription request can be sent to a data monitoring terminal corresponding to the corresponding acquisition tag point according to the acquisition parameter information, and the corresponding data monitoring terminal pushes data to the history server according to the acquisition parameter information in the received data subscription request; the data acquisition tag point information comprises tag point names, tag point attributes and tag point engineering description information corresponding to all the data monitoring terminals; the acquisition parameter information comprises a minimum acquisition period, a maximum acquisition period and minimum variation value parameter information;
performing online management configuration on the history server to modify configured data acquisition tag point information and acquisition parameter information in the history server;
the method comprises the steps that a data monitoring terminal is configured to respond to a data subscription request of a history server, and a minimum acquisition period, a maximum acquisition period and a minimum variation value parameter are obtained, so that:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is smaller than the minimum acquisition period, not pushing the monitoring data after the change; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and the monitoring data change amount is larger than the minimum change amount value, and pushing the changed detection data to a subscriber history server; and in response to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period, pushing the changed detection data to the subscriber history server.
2. The method of claim 1, wherein in the configuration process of the startup configuration file, the data collection tag points with the same collection parameters are configured by adding the data collection tag points to a preset same tag point class template, wherein the tag point class template comprises collection parameter attributes capable of being preset or dynamically set.
3. The method of claim 1, wherein the configuration content of the boot configuration file further comprises: and configuring a pre-statistics rule of the history server, wherein the pre-statistics rule comprises information to be counted, a counting method and a counting period.
4. A method for generating a boot configuration file in a configuration method of a history data interaction system according to any one of claims 1 to 3, comprising:
receiving unique reference name information of each history server input by a user, and storing the unique reference name information to an offline configuration file;
responding to the configuration user to select any history service through an operation interface, and storing the selected state information of the corresponding history service into an offline configuration file, so that when the history server is started to read the starting configuration file, the corresponding history service application can be started according to the selected state information of the history service;
receiving acquisition label points and acquisition parameter information input by a configuration user, and storing corresponding information into an offline configuration file;
responding to a file synchronization instruction input by a configuration user, and synchronizing configuration information in an offline configuration file into a preset online configuration file;
responding to configuration rollback instructions input by a configuration user, and synchronizing configuration information in an online configuration file into an offline configuration file;
and taking the online configuration file as a finally generated starting configuration file and outputting the starting configuration file.
5. The power-on profile generation method of claim 4, wherein the offline profile uses a sqlite database file and the online profile uses a csv file.
6. A power-on profile generation apparatus in a configuration method of a history data interaction system according to any one of claims 1 to 3, comprising:
the reference name configuration module is configured to receive unique reference name information of each history server input by a user and store the unique reference name information into an offline configuration file;
the history service configuration module is configured to respond to the configuration of any history service selected by a configuration user through an operation interface, and save the selected state information of the corresponding history service to an offline configuration file, so that when the history server is started to read the starting configuration file, the corresponding history service application can be started according to the selected state information of the history service;
the acquisition tag point configuration module is configured to receive acquisition tag points and acquisition parameter information input by a configuration user and store corresponding information into an offline configuration file;
the configuration information synchronizing module is configured to synchronize the configuration information in the offline configuration file to a preset online configuration file in response to a configuration user input file synchronizing instruction;
the configuration rollback module is configured to respond to configuration rollback instructions input by a configuration user and synchronize configuration information in the online configuration file into the offline configuration file;
the starting-up configuration file generating module is configured to take the online configuration file as a finally generated starting-up configuration file and output the finally generated starting-up configuration file.
7. The power-on profile generation apparatus according to claim 6, wherein the acquisition tag point configuration module includes a tag point template and a tag point class template that can be displayed on an operation interface; the label point templates comprise data acquisition label point attributes which can be preset or dynamically set, and the label point templates are configured to be dragged into any label point type template; the label point class templates comprise acquisition parameter attributes which can be preset or dynamically set, and the label point class templates are configured to respond to the fact that any label point template is dragged into the current label point class templates, and then the acquisition parameter attributes of the current label point class templates are assigned to the data acquisition label points corresponding to the corresponding label point templates.
8. A history data interaction system based on the configuration method of any one of claims 1-3, comprising a history server, a data monitoring terminal and a data application client; the method is characterized in that:
each history server is respectively configured with a unique reference name, the mapping relation between the unique reference name of each history server and the IP address is stored in the data application client, and the data application client responds to the reference name appointed by the user to access the history server of the corresponding IP address;
the history server reads a preset starting configuration file when starting up, and configuration information of the starting configuration file comprises: the history service name corresponding to each history server selects state information, data acquisition tag point information and acquisition parameter information corresponding to each data acquisition tag point; the history server performs starting configuration according to configuration information in the starting configuration file, so that the history server can: starting corresponding historical service according to the state information selected by the historical service name, and sending a data subscription request to a data monitoring terminal corresponding to the corresponding acquisition tag point according to the acquisition parameter information;
the data monitoring terminal pushes data to the history server according to the acquired parameter information in the received data subscription request;
the history server is also provided with an on-line management configuration interface, receives an on-line management configuration request input by a user through the on-line management configuration interface in the process of running the history service, and responds to the on-line management configuration request, modifies the configured acquisition tag point information and acquisition parameter information.
9. The historical data interaction system of claim 8, wherein the collection parameter information for the collection tag points includes a minimum collection period, a maximum collection period, and a minimum variance value parameter;
the data monitoring terminal responds to the data subscription request of the history server to acquire the minimum acquisition period, the maximum acquisition period and the minimum variation value parameter, and then:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is smaller than the minimum acquisition period, not pushing the monitoring data after the change; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and the monitoring data change amount is larger than the minimum change amount value, and pushing the changed detection data to a subscriber history server; and in response to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period, pushing the changed detection data to the subscriber history server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010413492.2A CN111752918B (en) | 2020-05-15 | 2020-05-15 | Historical data interaction system and configuration method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010413492.2A CN111752918B (en) | 2020-05-15 | 2020-05-15 | Historical data interaction system and configuration method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111752918A CN111752918A (en) | 2020-10-09 |
| CN111752918B true CN111752918B (en) | 2023-12-22 |
Family
ID=72673413
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010413492.2A Active CN111752918B (en) | 2020-05-15 | 2020-05-15 | Historical data interaction system and configuration method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111752918B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112835853B (en) * | 2020-12-31 | 2024-03-22 | 北京聚云科技有限公司 | Data processing type determining method and device |
| CN114900511B (en) * | 2022-04-25 | 2023-02-03 | 湖南大学 | Device and method for synchronously acquiring and loading middleware by industrial robot |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1353840A (en) * | 2000-02-03 | 2002-06-12 | 网派网络公司 | Web page accessing system and method usijng real manes |
| CN102594826A (en) * | 2012-02-24 | 2012-07-18 | 清华大学 | Real-time data compression communication method suitable for power system terminal device |
| CN103944973A (en) * | 2014-04-02 | 2014-07-23 | 北京中交兴路车联网科技有限公司 | Method and device for collecting logs |
| CN107895017A (en) * | 2017-11-14 | 2018-04-10 | 国网江苏省电力公司电力科学研究院 | A kind of electric energy quality monitoring system construction method based on big data technology |
| JP2019061412A (en) * | 2017-09-26 | 2019-04-18 | 三菱電機株式会社 | Plant equipment monitoring control system |
| CN109669406A (en) * | 2018-11-21 | 2019-04-23 | 上海资鑫机电设备有限公司 | A kind of remote online monitoring system and its workflow of industrial equipment |
| CN109962980A (en) * | 2019-03-20 | 2019-07-02 | 北京易沃特科技有限公司 | A kind of data uploading method based on Internet of Things, device, equipment and medium |
| CN110030700A (en) * | 2019-04-22 | 2019-07-19 | 珠海格力电器股份有限公司 | Operation parameter acquisition method and device, computer equipment and air conditioner system |
| CN110035055A (en) * | 2019-02-19 | 2019-07-19 | 中国铁建重工集团股份有限公司 | Industrial equipment remote data acquisition and processing method and transmission method |
| CN111064402A (en) * | 2019-12-25 | 2020-04-24 | 孚创动力控制技术（启东）有限公司 | Diesel generating set cloud communication module with long connection and small data flow |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU2007214459B2 (en) * | 2006-02-14 | 2012-05-10 | Edsa Micro Corporation | Systems and methods for real-time system monitoring and predictive analysis |
| WO2014165858A2 (en) * | 2013-04-05 | 2014-10-09 | Veedims, Llc | System for device control, monitoring, data gathering and data analytics over a network |
| US20160254979A1 (en) * | 2013-10-23 | 2016-09-01 | Nec Corporation | Communication system, common service control apparatus, data transmission method, and non-transitory computer readable medium |
| BR112018003599A2 (en) * | 2015-08-28 | 2018-09-25 | Nissan Motor | probe data collection method and device for probe data collection |
| US10290160B2 (en) * | 2016-11-07 | 2019-05-14 | United Technologies Corporation | Vehicle data collection system and method |
| CN109150641B (en) * | 2017-06-15 | 2020-04-17 | 北京国双科技有限公司 | Data acquisition and query method, device, storage medium and processor |
-
2020
- 2020-05-15 CN CN202010413492.2A patent/CN111752918B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1353840A (en) * | 2000-02-03 | 2002-06-12 | 网派网络公司 | Web page accessing system and method usijng real manes |
| CN102594826A (en) * | 2012-02-24 | 2012-07-18 | 清华大学 | Real-time data compression communication method suitable for power system terminal device |
| CN103944973A (en) * | 2014-04-02 | 2014-07-23 | 北京中交兴路车联网科技有限公司 | Method and device for collecting logs |
| JP2019061412A (en) * | 2017-09-26 | 2019-04-18 | 三菱電機株式会社 | Plant equipment monitoring control system |
| CN107895017A (en) * | 2017-11-14 | 2018-04-10 | 国网江苏省电力公司电力科学研究院 | A kind of electric energy quality monitoring system construction method based on big data technology |
| CN109669406A (en) * | 2018-11-21 | 2019-04-23 | 上海资鑫机电设备有限公司 | A kind of remote online monitoring system and its workflow of industrial equipment |
| CN110035055A (en) * | 2019-02-19 | 2019-07-19 | 中国铁建重工集团股份有限公司 | Industrial equipment remote data acquisition and processing method and transmission method |
| CN109962980A (en) * | 2019-03-20 | 2019-07-02 | 北京易沃特科技有限公司 | A kind of data uploading method based on Internet of Things, device, equipment and medium |
| CN110030700A (en) * | 2019-04-22 | 2019-07-19 | 珠海格力电器股份有限公司 | Operation parameter acquisition method and device, computer equipment and air conditioner system |
| CN111064402A (en) * | 2019-12-25 | 2020-04-24 | 孚创动力控制技术（启东）有限公司 | Diesel generating set cloud communication module with long connection and small data flow |
Non-Patent Citations (6)
| Title |
|---|
| Compressive data gathering for large-scale wireless sensor networks;Luo Chong等;Proceedings of the 15th annual international conference on Mobile computing and networking;全文 * |
| SQL Server 2000分布式数据库系统的构建;葛芝宾;;南京师范大学学报(工程技术版)(04);全文 * |
| 具有双机热备功能智能电网数据采集系统;于雪松;王孝良;张雪源;;东北电力技术(01);全文 * |
| 基于IEC61850的变电站监测系统设计;杨家全;;云南电力技术(05);全文 * |
| 用电信息采集异常精确定位技术研究;赵莉;何容;蒲箭;赵祥林;郑迎春;;电气技术(01);全文 * |
| 网络化运动控制系统行为特性的研究;云利军;中国博士学位论文全文数据库 信息科技辑;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111752918A (en) | 2020-10-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111752918B (en) | Historical data interaction system and configuration method thereof | |
| CN108958959B (en) | Method and device for detecting hive data table | |
| CN112162821A (en) | Container cluster resource monitoring method, device and system | |
| CN114745448B (en) | Multi-channel protocol adaptation processing method, system and device | |
| CN112506969A (en) | BMC address query method, system, equipment and readable storage medium | |
| CN111339118A (en) | Kubernetes-based resource change history recording method and device | |
| CN110598051A (en) | Power industry monitoring system, method and device | |
| CN108228432A (en) | A kind of distributed link tracking, analysis method and server, global scheduler | |
| CN111913933A (en) | Power grid historical data management method and system based on unified support platform | |
| CN114915634A (en) | Industrial data acquisition and storage system and method based on data lake | |
| CN117093555A (en) | Method, device, equipment and readable storage medium for acquiring equipment state information | |
| CN107894942B (en) | Method and device for monitoring data table access amount | |
| Jin et al. | Research on Wide-area Distributed Power Quality Data Fusion Technology of Power Grid | |
| EP4209933A1 (en) | Data processing method and apparatus, and electronic device and storage medium | |
| CN113656378A (en) | Server management method, device and medium | |
| CN113760856B (en) | Database management method and device, computer readable storage medium and electronic equipment | |
| CN115391286A (en) | Link tracking data management method, device, equipment and storage medium | |
| CN113515425A (en) | Method and device for dynamically reporting data | |
| WO2019218677A1 (en) | Data storage method for power grid simulation analysis, device, and electronic apparatus | |
| CN111654410B (en) | Gateway request monitoring method, device, equipment and medium | |
| CN113407504B (en) | Data processing method, user space file system and storage medium | |
| CN115774752A (en) | Data synchronization method, device, equipment and medium | |
| Han et al. | Communication Wiring Network Management System and its Application Based on SG-UAP Framework | |
| CN117493098A (en) | Resource use cost determining method, system, electronic equipment and storage medium | |
| CN115933417A (en) | Information processing apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |