CN111913950A - Event index analysis system for time sequence data storage - Google Patents
Event index analysis system for time sequence data storage Download PDFInfo
- Publication number
- CN111913950A CN111913950A CN201910386707.3A CN201910386707A CN111913950A CN 111913950 A CN111913950 A CN 111913950A CN 201910386707 A CN201910386707 A CN 201910386707A CN 111913950 A CN111913950 A CN 111913950A
- Authority
- CN
- China
- Prior art keywords
- event
- data
- relational database
- module
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2272—Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2474—Sequence data queries, e.g. querying versioned data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Abstract
The invention provides an event index analysis system for storing time sequence data, which relates to the field of process industry informatization, and comprises a time sequence database, a relational database, an event data service module, a data analysis service module, a plan scheduling module and a web report engine module; the scheduling module is respectively connected with the event data service module, the data analysis service module and the relational database, the event data service module is also respectively connected with the relational database and the time sequence database, and the relational database is also respectively connected with the data analysis service module and the web report engine module. According to the invention, the event definition information set in the relational database generates an event period according to the trigger rule in a mode of periodical rotation training or subscription data change, the event information is stored in the relational database in real time, and the event information is associated to the historical data of the collection place, so that the purpose of acquiring the historical data of the corresponding collection place for the index according to the event information is achieved.
Description
Technical Field
The invention relates to the field of process industrial informatization, in particular to an event index analysis system for time sequence data storage.
Background
In the flow industry field, in order to ensure the stability and high efficiency of the production process, the real-time acquisition of equipment state data, production process data and the like is required.
At present, a database (also called a real-time database) based on a time series storage structure is mainly used for data processing, the processed data is time series data (namely data with time marks), and the characteristic of the time series data processing is that each piece of data needs to store the time marks of the data at the same time when being stored; similarly, the data at the corresponding time needs to be accessed by a time stamp. Thus, current data analysis for real-time databases is based on historical data or statistical forms of historical data indexed by time stamps.
An analysis system for time series data based on time scale index generally accesses historical data or historical data trend of an acquisition point according to a time sequence, and performs basic statistical analysis such as simple averaging and accumulation of the historical data on the basis. However, in the field of process industry, analysis of Equipment and process data often involves event analysis based on real-time data, such as OEE (Overall Equipment Efficiency), batch data analysis, and the like, and such event analysis requires access to historical data according to the start time and the end time of an event occurrence, so that the current analysis system for time series data based on time scale index cannot achieve the purpose of event analysis.
Disclosure of Invention
In view of the above drawbacks of the prior art, an object of the present invention is to provide an event index analysis system for storing time series data, where event definition information set in a relational database includes an event name, an event trigger point, an event trigger rule and an event data analysis calculation model, an event cycle is generated according to the trigger rule by means of periodic training or subscribing to data changes (i.e., the event cycle is determined according to an event start time and an event end time), the event information is stored in the relational database in real time, and the event information is associated with collected historical data, so as to achieve the purpose of obtaining corresponding collected historical data for an index according to the event information, i.e., obtaining and analyzing time series data based on the event index.
The invention provides an event index analysis system for storing time sequence data, which comprises a time sequence database, a relational database, an event data service module, a data analysis service module, a plan scheduling module and a web report engine module, wherein the time sequence database is used for storing time sequence data; the system comprises a planning scheduling module, an event data service module, a data analysis service module and a relational database, wherein the planning scheduling module is respectively connected with the event data service module, the data analysis service module and the relational database;
the time sequence database is used for providing real-time data and historical data;
the relational database is used for storing event information and event analysis results;
the event data service module is used for generating event information in real time;
the data analysis service module is used for analyzing event information;
the plan scheduling module is used for executing service management;
the web report engine module is used for visually analyzing the event result.
Further, the event information stored in the relational database includes event definition information and event record information.
Furthermore, the time sequence database comprises a data acquisition module, and the data acquisition module acquires the measurement data of the equipment sensor in real time and stores the measurement data into the time sequence database according to the event sequence.
Further, the relational database stores event definition information to be analyzed, event record information, event analysis results, and basic configuration information of all services, where the event definition information includes an event name, an event trigger point, an event trigger rule, and an event data analysis calculation model.
Further, the event data service module loads event trigger points and event trigger rules in the relational database, simultaneously acquires measurement data of the relevant trigger points in the time sequence database, generates event start and event end times according to the event trigger rules, and stores the event start and event end times in the relational database as basic event record information.
Furthermore, the data analysis service module loads an event data analysis calculation model and event record information in the relational database, simultaneously obtains measurement data of relevant trigger points in the time sequence database for calculation, and stores calculation results in the relational database as event analysis results.
Further, the plan scheduling module is an execution management tool of the system service, and includes setting of the execution cycle, the execution start time, the execution parameters, and the execution times instruction of the service, and providing query of all error information in the service execution process.
Further, the web report engine module is a visual data display tool, acquires data in the relational database according to specific display mode requirements, and visually displays the data in a form and a graph mode.
As described above, the event index analysis system for time series data storage of the present invention has the following beneficial effects: the invention sets event definition information in a relational database, which comprises an event name, an event trigger point, an event trigger rule and an event data analysis and calculation model, generates an event cycle (namely, an event cycle is from the event starting time to the event ending time) according to the trigger rule by means of periodical rotation training or subscription data change, stores the event information in the relational database in real time, and associates the event information with the historical data of a collection place, so as to achieve the purpose of acquiring the historical data of the corresponding collection place according to the event information as an index, namely acquiring and analyzing time sequence data based on the event index.
Drawings
FIG. 1 is a block diagram of an event index analysis system disclosed in an embodiment of the present invention;
FIG. 2 is a flowchart illustrating the operation of the event data service module disclosed in the embodiment of the present invention;
fig. 3 is a flowchart illustrating a data analysis service module according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the drawings only show the components related to the present invention rather than the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
As shown in fig. 1, the present invention provides an event index analysis system for storing time series data, the system includes a time series database, a relational database, an event data service module, a data analysis service module, a plan scheduling module, and a web report engine module; the system comprises a planning scheduling module, an event data service module, a data analysis service module and a relational database, wherein the planning scheduling module is respectively connected with the event data service module, the data analysis service module and the relational database;
the time sequence database is used for providing real-time data and historical data;
the relational database is used for storing event information and event analysis results, and the event information comprises event definition information and event record information;
the event data service module is used for generating event information in real time;
the data analysis service module is used for analyzing event information;
the plan scheduling module is used for executing service management;
the web report engine module is used for visually analyzing the event result;
specifically, the time sequence database comprises a data acquisition module driven by an equipment automatic control system interface, and the data acquisition module acquires measurement data of an equipment sensor in real time and stores the measurement data into the time sequence database according to an event sequence;
in addition, the time sequence database also comprises an open data acquisition interface, so that other equipment can conveniently acquire real-time data and historical data in the time sequence database;
the relational database stores event definition information to be analyzed, wherein the event definition information comprises an event name, an event trigger point, an event trigger rule, an event data analysis calculation model and the like; meanwhile, event record information obtained according to the trigger point and the trigger rule and calculation result data calculated according to the event record information and the event data analysis calculation model are stored; basic information of the event data service and the data analysis service is stored at the same time;
the event data service module loads event trigger points and event trigger rules in event definition information in a relational database, acquires related trigger point data in real time through a time sequence database interface, generates event start and event end time according to the event trigger rules and stores the event start and event end time in the relational database as basic event recording information;
the data analysis service module loads an event data analysis calculation model in event definition information in a relational database, acquires and calculates event record information and data of trigger points according to the event data analysis calculation model, and stores a calculation result in the relational database as an event analysis result;
the plan scheduling module is an execution management tool of system service, and comprises basic information including the setting of instructions such as the execution period, the execution starting time, the execution parameters, the execution times and the like of the service, and simultaneously provides the query of all error information and the like in the service execution process;
the web report engine module is a visual data display tool, acquires data in the relational database through standard SQL (structured Query language) according to specific display mode requirements, and displays the data in a form, a graph and other modes in a visual mode.
The working principle of the system is as follows:
generating basic information of event data service and data analysis service in a plan scheduling module, wherein the basic information comprises instruction information of service execution period, execution starting time, execution parameters, execution times and the like, and writing the instruction information into a relational database;
when the service execution starting time is reached, starting a data analysis service and an event data service, and returning information to a plan scheduling module when the service is started successfully or fails;
after the event data service is successfully started, as shown in fig. 2, the schedule scheduling module is connected with the relational database, and acquires a corresponding event trigger point and an event trigger rule from the event definition information, the event data service module is connected with the time sequence database through an interface function, acquires corresponding point data in real time according to the event trigger point, and simultaneously judges whether to trigger a corresponding event according to the event trigger rule, if the start condition of the event is met, the event data service module generates an event message according to the event definition information, records the start time of the event, and writes the event message and the start time of the event into the relational database; circularly acquiring corresponding point data according to the event trigger point, judging whether to trigger a corresponding event according to the event trigger rule, recording the event end time if the event end condition is met, and writing the time end time into a relational database; continuously acquiring real-time data of event trigger points and event trigger rules until a plan scheduling module sends an execution stopping instruction, and closing the connection between the relational database and the time sequence database;
after the data analysis service is successfully started, as shown in fig. 3, the plan scheduling module is connected with the relational database, acquires a corresponding event data analysis calculation model from the event definition information, acquires the start time and the end time of an event from an event record according to the event data analysis calculation model, acquires time sequence data of the time period from the acquired real-time data, calculates according to the event data analysis calculation model, and writes the calculation result into the relational database; and continuously acquiring the latest event record and the time sequence data for calculation until the scheduling module sends an execution stopping instruction, and closing the connection between the relational database and the time sequence database.
In summary, the event definition information set in the relational database according to the present invention includes an event name, an event trigger point, an event trigger rule, and an event data analysis calculation model, and generates an event cycle according to the trigger rule (i.e., an event cycle is from an event start time to an event end time) by means of periodic training or subscription data change, stores the event information in the relational database in real time, and associates the event information with the collected historical data, so as to achieve the purpose of obtaining the corresponding collected historical data for the index according to the event information, i.e., obtaining and analyzing the time series data based on the event index, and can meet the analysis requirements of the process industry field on the equipment and the industrial data. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (8)
1. An event index analysis system for time series data storage, characterized by: the system comprises a time sequence database, a relation database, an event data service module, a data analysis service module, a plan scheduling module and a web report engine module; the system comprises a planning scheduling module, an event data service module, a data analysis service module and a relational database, wherein the planning scheduling module is respectively connected with the event data service module, the data analysis service module and the relational database;
the time sequence database is used for providing real-time data and historical data;
the relational database is used for storing event information and event analysis results;
the event data service module is used for generating event information in real time;
the data analysis service module is used for analyzing event information;
the plan scheduling module is used for executing service management;
the web report engine module is used for visually analyzing the event result.
2. The event index analysis system for time series data storage according to claim 1, wherein: the event information stored in the relational database includes event definition information and event record information.
3. The event index analysis system for time series data storage according to claim 1, wherein: the time sequence database comprises a data acquisition module, and the data acquisition module acquires the measurement data of the equipment sensor in real time and stores the measurement data into the time sequence database according to the event sequence.
4. The event index analysis system for time series data storage according to claim 2, wherein: the relational database stores event definition information, event record information, event analysis results and basic configuration information of all services, wherein the event definition information comprises event names, event trigger points, event trigger rules and event data analysis calculation models.
5. The event index analysis system for time series data storage according to claim 4, wherein: the event data service module loads event trigger points and event trigger rules in the relational database, simultaneously acquires measurement data of the relevant trigger points in the time sequence database, generates event start and event end time according to the event trigger rules and stores the event start and event end time in the relational database as basic event record information.
6. The event index analysis system for time series data storage according to claim 5, wherein: and the data analysis service module loads an event data analysis calculation model and event record information in the relational database, simultaneously acquires measurement data of related trigger points in the time sequence database for calculation, and stores the calculation result in the relational database as an event analysis result.
7. The event index analysis system for time series data storage according to claim 1, wherein: the plan scheduling module is an execution management tool of system service, and comprises the setting of service execution period, execution starting time, execution parameters and execution times instructions, and provides the query of all error information in the service execution process.
8. The event index analysis system for time series data storage according to claim 1, wherein: the web report engine module is a visual data display tool, acquires data in the relational database according to specific display mode requirements, and displays the data in a table and graph mode in a visual mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910386707.3A CN111913950A (en) | 2019-05-10 | 2019-05-10 | Event index analysis system for time sequence data storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910386707.3A CN111913950A (en) | 2019-05-10 | 2019-05-10 | Event index analysis system for time sequence data storage |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111913950A true CN111913950A (en) | 2020-11-10 |
Family
ID=73242399
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910386707.3A Pending CN111913950A (en) | 2019-05-10 | 2019-05-10 | Event index analysis system for time sequence data storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111913950A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112650756A (en) * | 2020-12-29 | 2021-04-13 | 成都科来网络技术有限公司 | Time projection indexing method and system based on time sequence data |
-
2019
- 2019-05-10 CN CN201910386707.3A patent/CN111913950A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112650756A (en) * | 2020-12-29 | 2021-04-13 | 成都科来网络技术有限公司 | Time projection indexing method and system based on time sequence data |
| CN112650756B (en) * | 2020-12-29 | 2023-05-02 | 科来网络技术股份有限公司 | Time projection indexing method and system based on time sequence data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6154542B2 (en) | Time-series data management method and time-series data management system | |
| Kemerer et al. | An empirical approach to studying software evolution | |
| CN108027763B (en) | Relational database adjusting device and method | |
| US9354867B2 (en) | System and method for identifying, analyzing and integrating risks associated with source code | |
| US20100249978A1 (en) | Method for Evaluating Key Production Indicators (KPI) in a Manufacturing Execution System (MES) | |
| CN112817865A (en) | Coverage precision test method and system based on componentized distributed system | |
| CN116578040A (en) | Digital twin model construction method, system and terminal for machine tool fault diagnosis | |
| CN111400288A (en) | Data quality inspection method and system | |
| CN111913950A (en) | Event index analysis system for time sequence data storage | |
| CN108416137B (en) | Method for conveniently dividing and tracking simplified expression standard part in aircraft manufacturing | |
| CN105956037A (en) | Factory database system | |
| KR100979408B1 (en) | Information service system for energy saving and method thereof | |
| CN114841509A (en) | Product manufacturing method, computing device and readable storage medium | |
| CN111190817B (en) | Method and device for processing software defects | |
| Changchien et al. | Concurrent design of machined products: a multivariate decision approach | |
| CN114077600B (en) | ARM (advanced RISC machine) kernel-based data heterogeneous migration visual analysis method | |
| CN114897394A (en) | Power consumption monitoring system and method | |
| CN114648280A (en) | Inventory stagnation reason tracing method and system based on big data | |
| CN114757482A (en) | Method, system, device and medium for analyzing electric quantity use trend of user group | |
| CN111931017A (en) | Intelligent configuration method and system suitable for coal preparation plant | |
| CN112270619A (en) | Intelligent lean overhaul management system for power transformation equipment based on big data | |
| CN110688424A (en) | Production monitoring method and device | |
| JP2020135520A (en) | Computer system and monitoring method for facility | |
| CN117093643B (en) | Industrial rule platform system | |
| AU2017269730B2 (en) | Smart trender for industrial control systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |