CN111752918A - Historical data interaction system and configuration method thereof - Google Patents

Historical data interaction system and configuration method thereof Download PDF

Info

Publication number
CN111752918A
CN111752918A CN202010413492.2A CN202010413492A CN111752918A CN 111752918 A CN111752918 A CN 111752918A CN 202010413492 A CN202010413492 A CN 202010413492A CN 111752918 A CN111752918 A CN 111752918A
Authority
CN
China
Prior art keywords
data
configuration
acquisition
configuration file
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010413492.2A
Other languages
Chinese (zh)
Other versions
CN111752918B (en
Inventor
白忠贺
吴科
黄蕾
吴加兵
杨家恺
孙斌
熊晨阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Guodian Nanzi Weimeide Automation Co ltd
Original Assignee
Nanjing Guodian Nanzi Weimeide Automation Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Guodian Nanzi Weimeide Automation Co ltd filed Critical Nanjing Guodian Nanzi Weimeide Automation Co ltd
Priority to CN202010413492.2A priority Critical patent/CN111752918B/en
Publication of CN111752918A publication Critical patent/CN111752918A/en
Application granted granted Critical
Publication of CN111752918B publication Critical patent/CN111752918B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/219Managing data history or versioning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/06Energy or water supply

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Economics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Water Supply & Treatment (AREA)
  • Computational Linguistics (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a historical data interaction system and a configuration method thereof, wherein the historical data interaction system comprises a historical server, a data monitoring terminal and a data application client; the configuration method comprises the following steps: configuring unique reference names of the history servers, and configuring a data application client to access the corresponding history servers according to the reference names; configuring and generating a startup configuration file, wherein the configuration content comprises: selecting state information, data acquisition label point information and acquisition parameter information corresponding to each data acquisition label point from the historical service names, so that after the historical server is configured according to the startup configuration file, a data subscription request can be sent to the data monitoring terminal corresponding to the corresponding acquisition label point according to the acquisition parameter information, and then pushed data of the data monitoring terminal can be received; and performing online management configuration on the history server to modify the configured acquisition label point information and acquisition parameter information in the history server. The invention can improve the safety and flexibility of historical data management.

Description

Historical data interaction system and configuration method thereof
Technical Field
The invention relates to the technical field of historical data management in a power system, in particular to a historical data interaction system and a configuration method thereof.
Background
With the rapid development of the internet and the continuous deepening of the intelligent construction, the advanced information technology provides technical support for the intelligent development of the power system, the advanced information technologies such as big data, cloud computing, the internet of things, the mobile internet and the like are deeply integrated with the power industry, the scale of the measuring points needing to be supported becomes huge, and the generated data amount is exponentially increased.
The historical database server is responsible for collecting data from a data source and then storing the data persistently, so that trend playback, fault analysis and various index statistical analysis can be conveniently carried out on the historical data. But the dramatic increase of the data volume will bring great challenges to the historian server. In the face of huge measuring point quantity and different data change characteristics, how to design configuration logic can collect data more efficiently and reasonably, how to design access mode of a historical library server can acquire data more safely, how to design configuration files and select format of the configuration files can make data management more safe and universal, and the problem to be solved urgently in the field is formed.
In the aspect of historical data configuration, most of the prior art adopts a single configuration file, or adopts an Access database to store configuration information, or directly configures the IP of the server in the configuration file to Access the server, and the consideration is not comprehensive in the aspects of flexibility, safety and cross-platform.
Disclosure of Invention
The invention aims to provide a historical data interaction system and a configuration method thereof, which can improve the safety and flexibility of historical data management.
The technical scheme adopted by the invention is as follows:
on one hand, the invention provides a configuration method of a historical data interaction system, wherein the historical data interaction system comprises a historical server, a data monitoring terminal and a data application client; the configuration method comprises the following steps:
configuring unique reference names of the history servers and mapping relations between the reference names and the IP addresses of the history servers, so that the data application client can respond to the reference names specified by a user to access the history servers of the corresponding IP addresses;
configuring and generating a starting configuration file for the historical server to read and load the configuration during starting, wherein the configuration content of the starting configuration file comprises: selecting state information, data acquisition label point information and acquisition parameter information corresponding to each data acquisition label point from the historical service names corresponding to the historical servers, so that the historical servers can send data subscription requests to the data monitoring terminals corresponding to the corresponding acquisition label points according to the acquisition parameter information after being configured according to the startup configuration file, and the corresponding data monitoring terminals push data to the historical servers according to the acquisition parameter information in the received data subscription requests;
and performing online management configuration on the history server to modify the configured acquisition label point information and acquisition parameter information in the history server.
Optionally, the data acquisition label point information includes label point names, label point attributes and label point engineering description information corresponding to each data monitoring terminal; the acquisition parameter information comprises minimum acquisition period, maximum acquisition period and minimum variation value parameter information;
the method further comprises the following steps: the data monitoring terminal is configured to respond to a data subscription request of the history server, acquire a minimum acquisition period, a maximum acquisition period and a minimum variation value parameter, and further:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is less than the minimum acquisition period, not pushing the changed monitoring data; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and meanwhile, the variation of the monitoring data is greater than the minimum variation value, and pushing the changed detection data to a historical server of the subscriber; and responding to the change of the monitoring data, and pushing the changed detection data to the historical server of the subscriber if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period.
Through the scheme design, the minimum acquisition period, the maximum acquisition period and the minimum variation value can be reasonably configured according to different application requirements, so that the data meeting the requirements can be acquired, the resources can be saved, and the data acquisition efficiency is improved.
Optionally, in the configuration process of the startup configuration file, data acquisition label points with the same acquisition parameters are configured by adding the data acquisition label points to a preset same label point type template, where the label point type template includes acquisition parameter attributes that can be preset or dynamically set. That is, the configuration software for generating the startup configuration file of the present invention can set the label point template, so that the user can classify the label points and determine the acquisition parameters according to the needs, and if a certain label point needs to subscribe data with a certain acquisition parameter, the label point is dragged into the template corresponding to the acquisition parameter, that is, the corresponding label point is endowed with the acquisition parameter attribute of the template.
Optionally, the configuration content of the startup configuration file further includes: and configuring a pre-statistical rule of the history server, wherein the pre-statistical rule comprises information needing to be counted, a statistical method and a statistical period. If the historical service corresponding to a certain historical server is configured in advance and the daily report statistics of the relevant measuring points needs to be carried out, the corresponding historical server carries out the statistics of the corresponding information daily report according to the preset statistical rule and the corresponding statistical period and statistical method after the startup configuration file is loaded, the scheme design can enable the data application client to directly inquire the statistical result without carrying out aggregation operation, and the inquiry and operation efficiency of the data application client can be improved.
In a second aspect, the present invention provides a method for generating a boot configuration file in a configuration method of a historical data interaction system in the first aspect, including:
receiving unique reference name information of each history server input by a user, and storing the unique reference name information to an offline configuration file;
responding to a configuration user to select any historical service through an operation interface, and storing selected state information of the corresponding historical service to an offline configuration file, so that when a history server reads a startup configuration file at startup, the history server can start corresponding historical service application according to the selected state information of the historical service;
receiving the acquisition label point and acquisition parameter information input by a configuration user, and storing corresponding information to an offline configuration file;
responding to a file synchronization instruction input by a configuration user, and synchronizing configuration information in an offline configuration file into a preset online configuration file;
synchronizing the configuration information in the online configuration file into the offline configuration file in response to the configuration user inputting a configuration rollback instruction;
and taking the online configuration file as a finally generated starting configuration file and outputting the finally generated starting configuration file.
Through the scheme design, the offline configuration file and the online configuration file form a mutual backup mechanism, and the configuration safety and the recoverability under the misoperation condition can be improved.
Optionally, the offline configuration file adopts a sqlite database file, and the online configuration file adopts a csv file. The Sqlite is a cross-platform lightweight embedded database, does not need to be installed and configured in a system, does not need any recovery operation after the system is crashed, does not need any external dependence when in use, and has all functions such as all operations and the like inherited by the Sqlite, so that few resources are occupied. The csv file is simple in structure, similar to a text file, and due to the simple storage mode, the size of the space for storing information can be reduced, so that network transmission and reprocessing of the client side are facilitated.
In a third aspect, the present invention provides a device for generating a boot configuration file in a configuration method of a historical data interaction system in the first aspect, including:
the reference name configuration module is configured for receiving unique reference name information of each history server input by a user and storing the unique reference name information to an offline configuration file;
the history service configuration module is configured for responding to any history service selected by a configuration user through an operation interface, and storing selected state information of the corresponding history service to an offline configuration file, so that when the history server reads a startup configuration file at startup, the history server can start corresponding history service application according to the selected state information of the history service;
the acquisition label point configuration module is configured for receiving acquisition label points and acquisition parameter information input by a configuration user and storing corresponding information to an offline configuration file;
the configuration information synchronization module is configured for responding to a configuration user input file synchronization instruction and synchronizing the configuration information in the offline configuration file into a preset online configuration file;
the configuration rollback module is configured for responding to a configuration rollback instruction input by a configuration user and synchronizing the configuration information in the online configuration file into the offline configuration file;
and the starting configuration file generation module is configured to take the online configuration file as a finally generated starting configuration file and output the finally generated starting configuration file.
Optionally, the collected tag point configuration module includes a tag point template and a tag point class template that can be displayed on the operation interface; the label point template comprises a data acquisition label point attribute which can be preset or dynamically set, and the label point template is configured to be dragged into any label point type template; the label point type template comprises a collection parameter attribute which can be preset or dynamically set, and the label point type template is configured to respond to the fact that any label point template is dragged into the current label point type template, and then the collection parameter attribute of the current label point type template is assigned to the data collection label point corresponding to the corresponding label point template.
The scheme design can facilitate users to classify the label points and determine the acquisition parameters according to the requirements, if a certain label point needs to subscribe data with a certain acquisition parameter, the label point only needs to be dragged into the class template corresponding to the acquisition parameter, so that the acquisition parameter attribute of the template is given to the corresponding label point, and the operation convenience of configuration personnel is greatly improved.
In a fourth aspect, the present invention further provides a historical data interaction system, which includes a historical server, a data monitoring terminal and a data application client; the method is characterized in that:
each history server is configured with a unique reference name, the mapping relation between the unique reference name and the IP address of each history server is stored in the data application client, and the data application client responds to the reference name specified by the user to access the history server of the corresponding IP address;
the method comprises the following steps that a historical server reads a pre-configured starting configuration file when starting, and the configuration information of the starting configuration file comprises the following steps: selecting state information, data acquisition label point information and acquisition parameter information corresponding to each data acquisition label point by using a historical service name corresponding to each historical server; the history server carries out startup configuration according to the configuration information in the startup configuration file, so that the history server can: selecting state information according to the historical service name to start corresponding historical service, and sending a data subscription request to a data monitoring terminal corresponding to a corresponding acquisition label point according to acquisition parameter information;
the data monitoring terminal pushes data to the history server according to the acquisition parameter information in the received data subscription request;
the history server is also provided with an online management configuration interface, and receives an online management configuration request input by a user through the online management configuration interface in the process of running the history service, and modifies the configured acquisition label point information and acquisition parameter information in response to the online management configuration request.
Optionally, the acquisition parameter information of the acquired tag point includes a minimum acquisition period, a maximum acquisition period, and a minimum variation value parameter;
the data monitoring terminal responds to a data subscription request of the history server, acquires a minimum acquisition period, a maximum acquisition period and a minimum variation value parameter, and further:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is less than the minimum acquisition period, not pushing the changed monitoring data; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and meanwhile, the variation of the monitoring data is greater than the minimum variation value, and pushing the changed detection data to a historical server of the subscriber; and responding to the change of the monitoring data, and pushing the changed detection data to the historical server of the subscriber if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period.
Advantageous effects
Compared with the prior art, the invention has the following advantages and progresses:
1) the data access of the data application client to the data is realized by configuring the unique reference name to the history server, and the server is not accessed through the computer name or the IP address of the history server, so that only a user knowing the reference name of the target history server can access the data, and the access safety of the server data is improved;
2) the history server collects data from the data monitoring terminal in a subscription mode, and designs a minimum sampling period, a maximum sampling period and a minimum variation value as subscription parameters, so that the data meeting the requirements can be collected, resources can be saved, and the data collection efficiency is improved;
3) the method adopts a general cross-platform sqlite database to realize an offline configuration file, a csv file to realize an online configuration file, and a mode of combining the two configuration files improves the reliability and the portability of the configured data;
4) when the acquisition parameters are configured, the common configuration parameters are abstracted through the class template, so that the configuration efficiency of the acquisition label points can be improved, and the operation of configuration personnel is simplified;
5) through the configuration design of pre-statistics, the data with high utilization rate of the application end can be counted at the history server end in advance, the direct query of the data application client side is facilitated, the re-aggregation calculation is not needed, and the data query and application efficiency is improved.
Drawings
FIG. 1 is a schematic diagram illustrating the operation of a historical data interaction system according to the present invention;
FIG. 2 is a schematic diagram of a boot configuration process of a history server;
FIG. 3 is a schematic flow chart illustrating a data application client accessing a history server;
fig. 4 is a schematic configuration flow diagram of the boot configuration file.
Detailed Description
The following further description is made in conjunction with the accompanying drawings and the specific embodiments.
Example 1
The embodiment introduces a history data interaction system, which is shown in fig. 1 and includes a history server, a data monitoring terminal, and a data application client;
each history server is configured with a unique reference name, the mapping relation between the unique reference name and the IP address of each history server is stored in the data application client, and the data application client responds to the reference name specified by the user to access the history server of the corresponding IP address;
the method comprises the following steps that a historical server reads a pre-configured starting configuration file when starting, and the configuration information of the starting configuration file comprises the following steps: selecting state information, data acquisition label point information and acquisition parameter information corresponding to each data acquisition label point by using a historical service name corresponding to each historical server; the history server carries out startup configuration according to the configuration information in the startup configuration file, so that the history server can: selecting state information according to the historical service name to start corresponding historical service, and sending a data subscription request to a data monitoring terminal corresponding to a corresponding acquisition label point according to acquisition parameter information;
the data monitoring terminal pushes data to the history server according to the acquisition parameter information in the received data subscription request;
the history server is also provided with an online management configuration interface, and receives an online management configuration request input by a user through the online management configuration interface in the process of running the history service, and modifies the configured acquisition label point information and acquisition parameter information in response to the online management configuration request.
In this embodiment, the data monitoring Terminal may be an RTU, the english language of the RTU is called Remote Terminal Unit, and the chinese language is called Remote Terminal control system, and is responsible for monitoring and controlling field signals and industrial equipment. Most of the power systems collect data in a polling manner, i.e. the RTU transmits data to the master station only after receiving a request from the master station for it. The polling method is to send a request to the RTU periodically, and data may not change during the polling time, but the RTU will still send data, which results in waste of resources.
The invention designs a history server to acquire monitoring data from a data monitoring terminal in a subscription mode, only needs to send a request to an RTU once, and simultaneously considers the complexity of the requirement. Referring to fig. 3, the data monitoring terminal responds to the data subscription request of the history server, and obtains a minimum acquisition period, a maximum acquisition period, and a minimum variation value parameter, thereby:
when the monitoring data are changed and the time interval between the current time and the previous data pushing is less than the minimum acquisition period, the changed monitoring data are not pushed; when the monitoring data are changed, the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and the variation of the monitoring data is greater than the minimum variation value, pushing the changed detection data to a historical server of the subscriber; and when the monitoring data changes and the time interval between the current time and the previous data pushing is greater than the maximum acquisition period, pushing the changed detection data to the historical server of the subscriber. The data acquisition system can acquire data meeting requirements, save resources and improve the data acquisition efficiency.
Example 2
Based on the same inventive concept as embodiment 1, this embodiment specifically introduces a configuration method of a historical data interaction system.
The historical data interaction system comprises a historical server, a data monitoring terminal and a data application client as described in embodiment 1;
the configuration method comprises the following steps:
configuring unique reference names of the history servers and mapping relations between the reference names and the IP addresses of the history servers, so that the data application client can respond to the reference names specified by a user to access the history servers of the corresponding IP addresses;
configuring and generating a starting configuration file for the historical server to read and load the configuration during starting, wherein the configuration content of the starting configuration file comprises: selecting state information, data acquisition label point information and acquisition parameter information corresponding to each data acquisition label point from the historical service names corresponding to the historical servers, so that the historical servers can send data subscription requests to the data monitoring terminals corresponding to the corresponding acquisition label points according to the acquisition parameter information after being configured according to the startup configuration file, and the corresponding data monitoring terminals push data to the historical servers according to the acquisition parameter information in the received data subscription requests;
and performing online management configuration on the history server to modify the configured acquisition label point information and acquisition parameter information in the history server.
Referring to fig. 3, in application of this embodiment, the unique reference name of the history server and the mapping relationship configuration of the IP address thereof need to be synchronized to the data application client, when the data application client accesses the history server, the client can access the history server only by the unique reference name, the underlying logic of the data application client is to search in the local Cache by the reference name, if found, obtain the corresponding IP address, otherwise, check whether the reference name is misspelled or not registered, and then link to the corresponding server by the IP address, so as to start to access the data in the server. The safety of historical server data access is greatly improved.
The data acquisition label point information comprises label point names, label point attributes and label point engineering description information corresponding to each data monitoring terminal; the acquisition parameter information comprises minimum acquisition period, maximum acquisition period and minimum variation value parameter information;
the configuration method further comprises the following steps: the data monitoring terminal is configured to respond to a data subscription request of the history server, acquire a minimum acquisition period, a maximum acquisition period and a minimum variation value parameter, and further:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is less than the minimum acquisition period, not pushing the changed monitoring data; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and meanwhile, the variation of the monitoring data is greater than the minimum variation value, and pushing the changed detection data to a historical server of the subscriber; and responding to the change of the monitoring data, and pushing the changed detection data to the historical server of the subscriber if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period.
Through the scheme design, the minimum acquisition period, the maximum acquisition period and the minimum variation value can be reasonably configured according to different application requirements, so that the data meeting the requirements can be acquired, the resources can be saved, and the data acquisition efficiency is improved.
In the embodiment, the templates are designed for collecting the grouping of the label points in consideration of the possibility of similarity of data change characteristics of different measuring points, so that classification and definition are facilitated. The parameters of the template to be configured comprise a template name, the number of actual label points of the template, the maximum number of label points of the template, a minimum acquisition period, a maximum acquisition period, a minimum variation value, a data statistics option and a data cleaning option; the parameters of the label point needing to be configured comprise a label point name, attributes, description and a template name to which the label point belongs. If the numerical value change rules of some label points are similar, the label points are placed under one template, and the minimum acquisition period, the maximum acquisition period and the minimum change value corresponding to different templates can be set differently according to the numerical value change rules of the label points, so that the flexibility of configuration and the accuracy of data acquisition are greatly improved. The combination of the name and attribute of the tag point is the unique identifier requested from the RTU, and what is shown in the description is the actual meaning of the tag point in the project.
As a specific implementation manner, in the configuration process of the startup configuration file, data acquisition label points with the same acquisition parameters are configured by adding the data acquisition label points to a preset same label point type template, where the label point type template includes acquisition parameter attributes that can be preset or dynamically set. That is, the configuration software for generating the startup configuration file of the present invention can set the label point template, so that the user can classify the label points and determine the acquisition parameters according to the needs, and if a certain label point needs to subscribe data with a certain acquisition parameter, the label point is dragged into the template corresponding to the acquisition parameter, that is, the corresponding label point is endowed with the acquisition parameter attribute of the template.
The configuration content of the startup configuration file further comprises: and configuring a pre-statistical rule of the history server, wherein the pre-statistical rule comprises information needing to be counted, a statistical method and a statistical period. If the historical service corresponding to a certain historical server is configured in advance and the daily report statistics of the relevant measuring points needs to be carried out, the corresponding historical server carries out the statistics of the corresponding information daily report according to the preset statistical rule and the corresponding statistical period and statistical method after the startup configuration file is loaded, the scheme design can enable the data application client to directly inquire the statistical result without carrying out aggregation operation, and the inquiry and operation efficiency of the data application client can be improved.
Through the configuration of the pre-statistical rule, the invention can input the starting and stopping time after selecting a certain label point, and can check all historical data in the time interval to know the detailed information of data change. The daily report, the monthly report and the like can be counted according to the needs, in order to improve the performance of checking the statistical information, the pre-statistical setting can be carried out, the data statistics can be selected to be non-statistical, and the statistical period can also be manually input; when the statistical period is input, a label point can be selected first, and a statistical function is selected at the same time, wherein the statistical function has a minimum value, a maximum value, an average value and the like, and after data statistics is set, statistical information is generated at the background periodically and is persisted. When the storage space of the disk is insufficient, the data needs to be cleaned, so the invention can also carry out data cleaning setting, wherein the data retention time can be set, and if the retention time is set to be 6 months, the data with the distance of more than 6 months at present can be deleted; the purpose of data export is to perform data backup, a certain period of time can be selected for export so as to facilitate offline analysis, and the format of an export file can be xml or csv. Data import may be parsing data from other xml or csv files and storing into the current system.
Regarding the online management configuration of the history server, because the content of the boot configuration file is loaded only when the history service process is started, and the history service process is continuously operated for 7 × 24 hours under a normal condition, a function of adding/deleting label points on line must be provided, and after a certain label point is added on line, the history service process immediately collects and persists data; after a certain label point is deleted online, the historical service process does not collect data any more. Particularly, the method can be realized by management tool software corresponding to the online management configuration thought of the invention, and can carry out data management operations such as online tag point adding, online tag point deleting, original data checking, data statistics setting, data cleaning setting, data importing and exporting and the like,
example 3
This embodiment specifically describes the configuration and generation of the boot configuration file described in embodiment 2.
Referring to fig. 4, the method for generating a boot configuration file includes:
receiving unique reference name information of each history server input by a user, and storing the unique reference name information to an offline configuration file;
responding to a configuration user to select any historical service through an operation interface, and storing selected state information of the corresponding historical service to an offline configuration file, so that when a history server reads a startup configuration file at startup, the history server can start corresponding historical service application according to the selected state information of the historical service;
receiving the acquisition label point and acquisition parameter information input by a configuration user, and storing corresponding information to an offline configuration file;
responding to a file synchronization instruction input by a configuration user, and synchronizing configuration information in an offline configuration file into a preset online configuration file;
synchronizing the configuration information in the online configuration file into the offline configuration file in response to the configuration user inputting a configuration rollback instruction;
and taking the online configuration file as a finally generated starting configuration file and outputting the finally generated starting configuration file.
Through the scheme design, the offline configuration file and the online configuration file form a mutual backup mechanism, and the configuration safety and the recoverability under the misoperation condition can be improved.
In consideration of convenience of configuration of the collection label points, the startup file configuration method of the embodiment can configure a plurality of class templates and parameters thereof, and then directly import the collection labels of the corresponding collection parameters into the corresponding class templates. Or the addition of the label points and the definition of the template are realized through the dragging of the template on the interface.
In this embodiment, the offline configuration file is an sql ite database file, and the online configuration file is a csv file. The Sqlite is a cross-platform lightweight embedded database, does not need to be installed and configured in a system, does not need any recovery operation after the system is crashed, does not need any external dependence when in use, and has all functions such as all operations and the like inherited by the Sqlite, so that few resources are occupied. The csv file is simple in structure, similar to a text file, and due to the simple storage mode, the size of the space for storing information can be reduced, so that network transmission and reprocessing of the client side are facilitated.
When the startup configuration file is generated through the embodiment, the required historical service process name can be selected on the corresponding software interface of the startup configuration tool, and after the configuration is completed, the startup configuration tool is closed, and a startup configuration file is automatically generated. Referring to fig. 2, after the history server is restarted, the history server reads the boot configuration file, if the corresponding history service of the local computer is selected and the unique reference name is configured, the history service process is started, the reference name is used to map the computer name of the local computer, and if the reference name is not configured, the default reference name is used; if the historical service is not selected, the item is not in the boot configuration file, and the historical service process is not started.
Example 4
Based on the same inventive concept as embodiment 3, this embodiment introduces a boot configuration file generating apparatus, including:
the reference name configuration module is configured for receiving unique reference name information of each history server input by a user and storing the unique reference name information to an offline configuration file;
the history service configuration module is configured for responding to any history service selected by a configuration user through an operation interface, and storing selected state information of the corresponding history service to an offline configuration file, so that when the history server reads a startup configuration file at startup, the history server can start corresponding history service application according to the selected state information of the history service;
the acquisition label point configuration module is configured for receiving acquisition label points and acquisition parameter information input by a configuration user and storing corresponding information to an offline configuration file;
the configuration information synchronization module is configured for responding to a configuration user input file synchronization instruction and synchronizing the configuration information in the offline configuration file into a preset online configuration file;
the configuration rollback module is configured for responding to a configuration rollback instruction input by a configuration user and synchronizing the configuration information in the online configuration file into the offline configuration file;
and the starting configuration file generation module is configured to take the online configuration file as a finally generated starting configuration file and output the finally generated starting configuration file.
In this embodiment, the tag point collecting configuration module includes a tag point template and a tag point class template that can be displayed on the operation interface; the label point template comprises a data acquisition label point attribute which can be preset or dynamically set, and the label point template is configured to be dragged into any label point type template; the label point type template comprises a collection parameter attribute which can be preset or dynamically set, and the label point type template is configured to respond to the fact that any label point template is dragged into the current label point type template, and then the collection parameter attribute of the current label point type template is assigned to the data collection label point corresponding to the corresponding label point template.
The scheme design can facilitate users to classify the label points and determine the acquisition parameters according to the requirements, if a certain label point needs to subscribe data with a certain acquisition parameter, the label point only needs to be dragged into the class template corresponding to the acquisition parameter, so that the acquisition parameter attribute of the template is given to the corresponding label point, and the operation convenience of configuration personnel is greatly improved.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (10)

1. A configuration method of a historical data interaction system comprises a historical server, a data monitoring terminal and a data application client; the configuration method is characterized by comprising the following steps:
configuring unique reference names of the history servers and mapping relations between the reference names and the IP addresses of the history servers, so that the data application client can respond to the reference names specified by a user to access the history servers of the corresponding IP addresses;
configuring and generating a starting configuration file for the historical server to read and load the configuration during starting, wherein the configuration content of the starting configuration file comprises: selecting state information, data acquisition label point information and acquisition parameter information corresponding to each data acquisition label point from the historical service names corresponding to the historical servers, so that the historical servers can send data subscription requests to the data monitoring terminals corresponding to the corresponding acquisition label points according to the acquisition parameter information after being configured according to the startup configuration file, and the corresponding data monitoring terminals push data to the historical servers according to the acquisition parameter information in the received data subscription requests;
and performing online management configuration on the history server to modify the configured acquisition label point information and acquisition parameter information in the history server.
2. The method as claimed in claim 1, wherein the data acquisition label point information includes label point names, label point attributes and label point engineering description information corresponding to each data monitoring terminal; the acquisition parameter information comprises minimum acquisition period, maximum acquisition period and minimum variation value parameter information;
the method further comprises the following steps: the data monitoring terminal is configured to respond to a data subscription request of the history server, acquire a minimum acquisition period, a maximum acquisition period and a minimum variation value parameter, and further:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is less than the minimum acquisition period, not pushing the changed monitoring data; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and meanwhile, the variation of the monitoring data is greater than the minimum variation value, and pushing the changed detection data to a historical server of the subscriber; and responding to the change of the monitoring data, and pushing the changed detection data to the historical server of the subscriber if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period.
3. The method as claimed in claim 1, wherein during configuration of the boot configuration file, data acquisition label points with the same acquisition parameters are configured by adding to a preset same label point class template, and the label point class template comprises acquisition parameter attributes which can be preset or dynamically set.
4. The method of claim 1, wherein the configuration content of the boot-up configuration file further comprises: and configuring a pre-statistical rule of the history server, wherein the pre-statistical rule comprises information needing to be counted, a statistical method and a statistical period.
5. A method for generating a boot configuration file in a method for configuring a historical data interactive system as claimed in any one of claims 1 to 4, comprising:
receiving unique reference name information of each history server input by a user, and storing the unique reference name information to an offline configuration file;
responding to a configuration user to select any historical service through an operation interface, and storing selected state information of the corresponding historical service to an offline configuration file, so that when a history server reads a startup configuration file at startup, the history server can start corresponding historical service application according to the selected state information of the historical service;
receiving the acquisition label point and acquisition parameter information input by a configuration user, and storing corresponding information to an offline configuration file;
responding to a file synchronization instruction input by a configuration user, and synchronizing configuration information in an offline configuration file into a preset online configuration file;
synchronizing the configuration information in the online configuration file into the offline configuration file in response to the configuration user inputting a configuration rollback instruction;
and taking the online configuration file as a finally generated starting configuration file and outputting the finally generated starting configuration file.
6. The method as claimed in claim 5, wherein the offline configuration file is a sqlite database file, and the online configuration file is a csv file.
7. A device for generating a boot configuration file in a method for configuring a historical data interactive system as claimed in any one of claims 1 to 4, comprising:
the reference name configuration module is configured for receiving unique reference name information of each history server input by a user and storing the unique reference name information to an offline configuration file;
the history service configuration module is configured for responding to any history service selected by a configuration user through an operation interface, and storing selected state information of the corresponding history service to an offline configuration file, so that when the history server reads a startup configuration file at startup, the history server can start corresponding history service application according to the selected state information of the history service;
the acquisition label point configuration module is configured for receiving acquisition label points and acquisition parameter information input by a configuration user and storing corresponding information to an offline configuration file;
the configuration information synchronization module is configured for responding to a configuration user input file synchronization instruction and synchronizing the configuration information in the offline configuration file into a preset online configuration file;
the configuration rollback module is configured for responding to a configuration rollback instruction input by a configuration user and synchronizing the configuration information in the online configuration file into the offline configuration file;
and the starting configuration file generation module is configured to take the online configuration file as a finally generated starting configuration file and output the finally generated starting configuration file.
8. The boot configuration file generation device according to claim 7, wherein the collection tag point configuration module includes a tag point template and a tag point class template that can be displayed on the operation interface; the label point template comprises a data acquisition label point attribute which can be preset or dynamically set, and the label point template is configured to be dragged into any label point type template; the label point type template comprises a collection parameter attribute which can be preset or dynamically set, and the label point type template is configured to respond to the fact that any label point template is dragged into the current label point type template, and then the collection parameter attribute of the current label point type template is assigned to the data collection label point corresponding to the corresponding label point template.
9. A historical data interaction system comprises a historical server, a data monitoring terminal and a data application client; the method is characterized in that:
each history server is configured with a unique reference name, the mapping relation between the unique reference name and the IP address of each history server is stored in the data application client, and the data application client responds to the reference name specified by the user to access the history server of the corresponding IP address;
the method comprises the following steps that a historical server reads a pre-configured starting configuration file when starting, and the configuration information of the starting configuration file comprises the following steps: selecting state information, data acquisition label point information and acquisition parameter information corresponding to each data acquisition label point by using a historical service name corresponding to each historical server; the history server carries out startup configuration according to the configuration information in the startup configuration file, so that the history server can: selecting state information according to the historical service name to start corresponding historical service, and sending a data subscription request to a data monitoring terminal corresponding to a corresponding acquisition label point according to acquisition parameter information;
the data monitoring terminal pushes data to the history server according to the acquisition parameter information in the received data subscription request;
the history server is also provided with an online management configuration interface, and receives an online management configuration request input by a user through the online management configuration interface in the process of running the history service, and modifies the configured acquisition label point information and acquisition parameter information in response to the online management configuration request.
10. The interactive system for historical data as claimed in claim 9, wherein the collection parameter information of the collection tag point includes a minimum collection period, a maximum collection period and a minimum variation value parameter;
the data monitoring terminal responds to a data subscription request of the history server, acquires a minimum acquisition period, a maximum acquisition period and a minimum variation value parameter, and further:
responding to the change of the monitoring data, and if the time interval between the current time and the previous data pushing is less than the minimum acquisition period, not pushing the changed monitoring data; responding to the change of the monitoring data, wherein the time interval between the current time and the previous data pushing is between the minimum acquisition period and the maximum acquisition period, and meanwhile, the variation of the monitoring data is greater than the minimum variation value, and pushing the changed detection data to a historical server of the subscriber; and responding to the change of the monitoring data, and pushing the changed detection data to the historical server of the subscriber if the time interval between the current time and the previous data pushing is larger than the maximum acquisition period.
CN202010413492.2A 2020-05-15 2020-05-15 Historical data interaction system and configuration method thereof Active CN111752918B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010413492.2A CN111752918B (en) 2020-05-15 2020-05-15 Historical data interaction system and configuration method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010413492.2A CN111752918B (en) 2020-05-15 2020-05-15 Historical data interaction system and configuration method thereof

Publications (2)

Publication Number Publication Date
CN111752918A true CN111752918A (en) 2020-10-09
CN111752918B CN111752918B (en) 2023-12-22

Family

ID=72673413

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010413492.2A Active CN111752918B (en) 2020-05-15 2020-05-15 Historical data interaction system and configuration method thereof

Country Status (1)

Country Link
CN (1) CN111752918B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112835853A (en) * 2020-12-31 2021-05-25 北京聚云科技有限公司 Data processing type determination method and device
CN114900511A (en) * 2022-04-25 2022-08-12 湖南大学 Device and method for synchronously acquiring and loading middleware by industrial robot

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1353840A (en) * 2000-02-03 2002-06-12 网派网络公司 Web page accessing system and method usijng real manes
US20070192078A1 (en) * 2006-02-14 2007-08-16 Edsa Micro Corporation Systems and methods for real-time system monitoring and predictive analysis
CN102594826A (en) * 2012-02-24 2012-07-18 清华大学 Real-time data compression communication method suitable for power system terminal device
CN103944973A (en) * 2014-04-02 2014-07-23 北京中交兴路车联网科技有限公司 Method and device for collecting logs
US20140303808A1 (en) * 2013-04-05 2014-10-09 Veedims, Llc System for device control, monitoring, data gathering and data analytics over a network
US20160254979A1 (en) * 2013-10-23 2016-09-01 Nec Corporation Communication system, common service control apparatus, data transmission method, and non-transitory computer readable medium
CN107895017A (en) * 2017-11-14 2018-04-10 国网江苏省电力公司电力科学研究院 A kind of electric energy quality monitoring system construction method based on big data technology
US20180130270A1 (en) * 2016-11-07 2018-05-10 United Technologies Corporation Vehicle data collection system and method
US20180225962A1 (en) * 2015-08-28 2018-08-09 Nissan Motor Co., Ltd. Probe data collection method and probe data collection device
JP2019061412A (en) * 2017-09-26 2019-04-18 三菱電機株式会社 Plant equipment monitoring control system
CN109669406A (en) * 2018-11-21 2019-04-23 上海资鑫机电设备有限公司 A kind of remote online monitoring system and its workflow of industrial equipment
CN109962980A (en) * 2019-03-20 2019-07-02 北京易沃特科技有限公司 A kind of data uploading method based on Internet of Things, device, equipment and medium
CN110035055A (en) * 2019-02-19 2019-07-19 中国铁建重工集团股份有限公司 The acquisition of industrial equipment teledata and processing method, transmission method
CN110030700A (en) * 2019-04-22 2019-07-19 珠海格力电器股份有限公司 Operating parameter acquisition method, device, computer equipment and air-conditioner system
US20200073906A1 (en) * 2017-06-15 2020-03-05 Beijing Gridsum Technology Co., Ltd. Method, Device, Storage Medium and Processor for Data Acquisition and Query
CN111064402A (en) * 2019-12-25 2020-04-24 孚创动力控制技术(启东)有限公司 Diesel generating set cloud communication module with long connection and small data flow

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1353840A (en) * 2000-02-03 2002-06-12 网派网络公司 Web page accessing system and method usijng real manes
US20070192078A1 (en) * 2006-02-14 2007-08-16 Edsa Micro Corporation Systems and methods for real-time system monitoring and predictive analysis
CN102594826A (en) * 2012-02-24 2012-07-18 清华大学 Real-time data compression communication method suitable for power system terminal device
US20140303808A1 (en) * 2013-04-05 2014-10-09 Veedims, Llc System for device control, monitoring, data gathering and data analytics over a network
US20160254979A1 (en) * 2013-10-23 2016-09-01 Nec Corporation Communication system, common service control apparatus, data transmission method, and non-transitory computer readable medium
CN103944973A (en) * 2014-04-02 2014-07-23 北京中交兴路车联网科技有限公司 Method and device for collecting logs
US20180225962A1 (en) * 2015-08-28 2018-08-09 Nissan Motor Co., Ltd. Probe data collection method and probe data collection device
US20180130270A1 (en) * 2016-11-07 2018-05-10 United Technologies Corporation Vehicle data collection system and method
US20200073906A1 (en) * 2017-06-15 2020-03-05 Beijing Gridsum Technology Co., Ltd. Method, Device, Storage Medium and Processor for Data Acquisition and Query
JP2019061412A (en) * 2017-09-26 2019-04-18 三菱電機株式会社 Plant equipment monitoring control system
CN107895017A (en) * 2017-11-14 2018-04-10 国网江苏省电力公司电力科学研究院 A kind of electric energy quality monitoring system construction method based on big data technology
CN109669406A (en) * 2018-11-21 2019-04-23 上海资鑫机电设备有限公司 A kind of remote online monitoring system and its workflow of industrial equipment
CN110035055A (en) * 2019-02-19 2019-07-19 中国铁建重工集团股份有限公司 The acquisition of industrial equipment teledata and processing method, transmission method
CN109962980A (en) * 2019-03-20 2019-07-02 北京易沃特科技有限公司 A kind of data uploading method based on Internet of Things, device, equipment and medium
CN110030700A (en) * 2019-04-22 2019-07-19 珠海格力电器股份有限公司 Operating parameter acquisition method, device, computer equipment and air-conditioner system
CN111064402A (en) * 2019-12-25 2020-04-24 孚创动力控制技术(启东)有限公司 Diesel generating set cloud communication module with long connection and small data flow

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
LUO CHONG等: "Compressive data gathering for large-scale wireless sensor networks", PROCEEDINGS OF THE 15TH ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING *
于雪松;王孝良;张雪源;: "具有双机热备功能智能电网数据采集系统", 东北电力技术, no. 01 *
云利军: "网络化运动控制系统行为特性的研究", 中国博士学位论文全文数据库 信息科技辑 *
杨家全;: "基于IEC61850的变电站监测系统设计", 云南电力技术, no. 05 *
葛芝宾;: "SQL Server 2000分布式数据库系统的构建", 南京师范大学学报(工程技术版), no. 04 *
赵莉;何容;蒲箭;赵祥林;郑迎春;: "用电信息采集异常精确定位技术研究", 电气技术, no. 01 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112835853A (en) * 2020-12-31 2021-05-25 北京聚云科技有限公司 Data processing type determination method and device
CN112835853B (en) * 2020-12-31 2024-03-22 北京聚云科技有限公司 Data processing type determining method and device
CN114900511A (en) * 2022-04-25 2022-08-12 湖南大学 Device and method for synchronously acquiring and loading middleware by industrial robot
CN114900511B (en) * 2022-04-25 2023-02-03 湖南大学 Device and method for synchronously acquiring and loading middleware by industrial robot

Also Published As

Publication number Publication date
CN111752918B (en) 2023-12-22

Similar Documents

Publication Publication Date Title
CN110147411B (en) Data synchronization method, device, computer equipment and storage medium
CN107506451B (en) Abnormal information monitoring method and device for data interaction
WO2022126974A1 (en) Kafka-based incremental data synchronization method and apparatus, device, and medium
EP3318991A1 (en) Monitoring processes running on a platform as a service architecture
CN108958959B (en) Method and device for detecting hive data table
CN111752918B (en) Historical data interaction system and configuration method thereof
CN111339118A (en) Kubernetes-based resource change history recording method and device
CN114328759A (en) Data construction and management method and terminal of data warehouse
CN111913933B (en) Power grid historical data management method and system based on unified support platform
CN112506969A (en) BMC address query method, system, equipment and readable storage medium
CN112182025A (en) Log analysis method, device, equipment and computer readable storage medium
CN113268530A (en) Mass heterogeneous data acquisition method and system, computer equipment and storage medium
CN111460021B (en) Data export method and device
CN107894942B (en) Method and device for monitoring data table access amount
CN111161818A (en) Medical data exchange sharing system and method based on big data technology
CN115510139A (en) Data query method and device
CN115774750A (en) Database lake entering configuration method and system, electronic equipment and storage medium
CN113760856B (en) Database management method and device, computer readable storage medium and electronic equipment
EP4209933A1 (en) Data processing method and apparatus, and electronic device and storage medium
CN115185774A (en) Automatic database based on open source technology
CN115391286A (en) Link tracking data management method, device, equipment and storage medium
CN113656378A (en) Server management method, device and medium
WO2019218677A1 (en) Data storage method for power grid simulation analysis, device, and electronic apparatus
CN115225345B (en) Log downloading method, device and medium thereof
CN111104558A (en) Distributed multi-source data processing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant