CN110222113A - A kind of data extraction process visualization method for early warning - Google Patents
A kind of data extraction process visualization method for early warning Download PDFInfo
- Publication number
- CN110222113A CN110222113A CN201910534424.9A CN201910534424A CN110222113A CN 110222113 A CN110222113 A CN 110222113A CN 201910534424 A CN201910534424 A CN 201910534424A CN 110222113 A CN110222113 A CN 110222113A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- node
- early warning
- extraction process
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Maintenance And Management Of Digital Transmission (AREA)
Abstract
The invention discloses a kind of data extraction process to visualize method for early warning, include the following steps: that S1, Data access module send inquiry request to database by data interface module, and after Data access module obtains the agreement of database, data are acquired by acquisition module, and are stored by memory module；S2, data are extracted, unwanted data is then fallen by data filtering modular filtration, the data retained after filtering module is filtered are converted into unified form by data conversion module；S3, two nodes are connected using directed line segment to create flow chart of data processing by visual mode；S4, directly bring into operation entire output process flow, handles data.Compared with traditional technology, the present invention can parse a variety of data of processing, will be original sightless, and the importing process flow write by engineer shows in visual form, is conducive to the early warning during data extraction process.
Description
Technical field
The invention belongs to data extraction process technical fields, and more specifically more particularly to a kind of data extraction process can
Depending on changing method for early warning.
Background technique
The type of equipment data is more and more at present, this data for having resulted in the acquisition of different acquisition equipment in time can
There is some differences (but also the acquisition sampling instant of each equipment is inconsistent), but required according to some test for identification sections purpose, it is necessary to
Same section's purpose is put together analysis from the relevant parameter of different acquisition device, and also requires tool in data processing
Standby visualization warning function, for this purpose, we release a kind of data extraction process visualization method for early warning.
Summary of the invention
The purpose of the present invention is to solve disadvantages existing in the prior art, and a kind of data extraction process proposed can
Depending on changing method for early warning.
To achieve the above object, the invention provides the following technical scheme: a kind of data extraction process visualizes method for early warning,
Include the following steps:
S1, Data access module send inquiry request to database by data interface module, and obtain in Data access module
After the agreement of database, data are acquired by acquisition module, and is stored by memory module；
S2, the data in memory module are extracted by data extraction module, obtains the data field of data, then passes through
Data filtering modular filtration falls unwanted data, and the data retained after filtering module is filtered are turned by data conversion module
Change unified form into；
S3, two nodes are connected using directed line segment to create flow chart of data processing, data processing stream by visual mode
The node of journey must include input node and output node, and the node type that can choose further includes switching node and filtering section
Point needs input node to be placed on the most starting position of flow chart of data processing, and data output is placed on the position that process terminates
It sets；
S4, directly bring into operation entire output process flow, handles data, when adding data analysis protocol,
It needs to be arranged data analysis protocol file and inputs the title of agreement.
Preferably, database includes determination module and cue module in the step S1, and the determination module is for connecing
The inquiry request that Data access module is sent is received, and prompts user's progress to click confirmation manually by cue module and agrees to, completion
Afterwards, Data access module obtains the agreement of database.
Preferably, data filtering module is filtered data by the node of flow chart of data processing in the step S2.
Preferably, the filter node can filter out undesirable in data processing according to relevant configuration
Data, switching node can convert different types of data, for example logarithm or time carry out increase reduction.
Preferably, flow chart of data processing is created in the step S3 to need to configure node, input node needs are matched
Input source information is set, output node needs to configure the message of output position, and filter node needs to configure filter condition, switching node
Need to configure the concrete operations of conversion.
Compared with prior art, the beneficial effects of the present invention are: a kind of data extraction process visualization provided by the invention
Method for early warning, compared with traditional technology, this method can parse a variety of data of processing, and flow path switch is designed for data
It imports, generates and import model.Will be original sightless, the importing process flow write by engineer table in visual form
It is existing, be conducive to the early warning during data extraction process.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with specific embodiment, to this
Invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, not
For limiting the present invention.Based on the embodiments of the present invention, those of ordinary skill in the art are not before making creative work
Every other embodiment obtained is put, shall fall within the protection scope of the present invention.
A kind of data extraction process visualization method for early warning, includes the following steps:
S1, Data access module send inquiry request to database by data interface module, and obtain in Data access module
After the agreement of database, data are acquired by acquisition module, and is stored by memory module；
S2, the data in memory module are extracted by data extraction module, obtains the data field of data, then passes through
Data filtering modular filtration falls unwanted data, and the data retained after filtering module is filtered are turned by data conversion module
Change unified form into；
S3, two nodes are connected using directed line segment to create flow chart of data processing, data processing stream by visual mode
The node of journey must include input node and output node, and the node type that can choose further includes switching node and filtering section
Point needs input node to be placed on the most starting position of flow chart of data processing, and data output is placed on the position that process terminates
It sets；
S4, directly bring into operation entire output process flow, handles data, when adding data analysis protocol,
It needs to be arranged data analysis protocol file and inputs the title of agreement.
Specifically, database includes determination module and cue module in the step S1, the determination module is for connecing
The inquiry request that Data access module is sent is received, and prompts user's progress to click confirmation manually by cue module and agrees to, completion
Afterwards, Data access module obtains the agreement of database.
Specifically, data filtering module is filtered data by the node of flow chart of data processing in the step S2.
Specifically, the filter node can be filtered out in data processing according to relevant configuration it is undesirable
Data, switching node can convert different types of data, for example logarithm or time carry out increase reduction.
It needs to configure node specifically, creating flow chart of data processing in the step S3, input node needs are matched
Input source information is set, output node needs to configure the message of output position, and filter node needs to configure filter condition, switching node
Need to configure the concrete operations of conversion.
In summary: a kind of data extraction process visualization method for early warning provided by the invention, compared with traditional technology, this
Method can parse a variety of data of processing, and flow path switch is imported designed for data, generates and imports model.It will originally not
Visible, the importing process flow write by engineer shows in visual form, during being conducive to data extraction process
Early warning.
Finally, it should be noted that the foregoing is only a preferred embodiment of the present invention, it is not intended to restrict the invention,
Although the present invention is described in detail referring to the foregoing embodiments, for those skilled in the art, still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features,
All within the spirits and principles of the present invention, any modification, equivalent replacement, improvement and so on should be included in of the invention
Within protection scope.
Claims (5)
1. a kind of data extraction process visualizes method for early warning, characterized by the following steps:
S1, Data access module send inquiry request to database by data interface module, and obtain in Data access module
After the agreement of database, data are acquired by acquisition module, and is stored by memory module；
S2, the data in memory module are extracted by data extraction module, obtains the data field of data, then passes through
Data filtering modular filtration falls unwanted data, and the data retained after filtering module is filtered are turned by data conversion module
Change unified form into；
S3, two nodes are connected using directed line segment to create flow chart of data processing, data processing stream by visual mode
The node of journey must include input node and output node, and the node type that can choose further includes switching node and filtering section
Point needs input node to be placed on the most starting position of flow chart of data processing, and data output is placed on the position that process terminates
It sets；
S4, directly bring into operation entire output process flow, handles data, when adding data analysis protocol,
It needs to be arranged data analysis protocol file and inputs the title of agreement.
2. a kind of data extraction process described in claim 1 visualizes method for early warning, it is characterised in that: number in the step S1
It include determination module and cue module according to library, the determination module inquiry request that access modules are sent for receiving data,
And it prompts user to carry out click confirmation manually by cue module and agrees to that after the completion, Data access module obtains the same of database
Meaning.
3. a kind of data extraction process described in claim 1 visualizes method for early warning, it is characterised in that: number in the step S2
Data are filtered by the node of flow chart of data processing according to filtering module.
4. a kind of data extraction process described in claim 1 visualizes method for early warning, it is characterised in that: the filter node can
To filter out undesirable data in data processing according to relevant configuration, switching node can be to different types of
Data are converted, for example logarithm or time carry out increase reduction.
5. a kind of data extraction process described in claim 1 visualizes method for early warning, it is characterised in that: created in the step S3
It builds flow chart of data processing to need to configure node, input node needs to configure input source information, and output node needs to configure
The message of output position, filter node need to configure filter condition, and switching node needs to configure the concrete operations of conversion.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910534424.9A CN110222113A (en) | 2019-06-20 | 2019-06-20 | A kind of data extraction process visualization method for early warning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910534424.9A CN110222113A (en) | 2019-06-20 | 2019-06-20 | A kind of data extraction process visualization method for early warning |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110222113A true CN110222113A (en) | 2019-09-10 |
Family
ID=67814123
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910534424.9A Pending CN110222113A (en) | 2019-06-20 | 2019-06-20 | A kind of data extraction process visualization method for early warning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110222113A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113613078A (en) * | 2021-08-02 | 2021-11-05 | 四川长虹网络科技有限责任公司 | Method for receiving digital television section data |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104317928A (en) * | 2014-10-31 | 2015-01-28 | 北京思特奇信息技术股份有限公司 | Service ETL (extraction-transformation-loading) method and service ETL system both based on distributed database |
| CN106021378A (en) * | 2016-05-11 | 2016-10-12 | 吕骏 | Query and analysis method and system based on data extraction and data visualization |
| CN106909610A (en) * | 2017-01-10 | 2017-06-30 | 中电科华云信息技术有限公司 | Visualization based on browser pulls the method and system of inquiry data |
| CN107766572A (en) * | 2017-11-13 | 2018-03-06 | 北京国信宏数科技有限责任公司 | Distributed extraction and visual analysis method and system based on economic field data |
| CN107766428A (en) * | 2017-09-15 | 2018-03-06 | 北京大学 | A kind of automatic method and system for realizing data visualization |
| US20190179829A1 (en) * | 2017-12-12 | 2019-06-13 | Hashplay Inc. | System and method for generating data visualization |
-
2019
- 2019-06-20 CN CN201910534424.9A patent/CN110222113A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104317928A (en) * | 2014-10-31 | 2015-01-28 | 北京思特奇信息技术股份有限公司 | Service ETL (extraction-transformation-loading) method and service ETL system both based on distributed database |
| CN106021378A (en) * | 2016-05-11 | 2016-10-12 | 吕骏 | Query and analysis method and system based on data extraction and data visualization |
| CN106909610A (en) * | 2017-01-10 | 2017-06-30 | 中电科华云信息技术有限公司 | Visualization based on browser pulls the method and system of inquiry data |
| CN107766428A (en) * | 2017-09-15 | 2018-03-06 | 北京大学 | A kind of automatic method and system for realizing data visualization |
| CN107766572A (en) * | 2017-11-13 | 2018-03-06 | 北京国信宏数科技有限责任公司 | Distributed extraction and visual analysis method and system based on economic field data |
| US20190179829A1 (en) * | 2017-12-12 | 2019-06-13 | Hashplay Inc. | System and method for generating data visualization |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113613078A (en) * | 2021-08-02 | 2021-11-05 | 四川长虹网络科技有限责任公司 | Method for receiving digital television section data |
| CN113613078B (en) * | 2021-08-02 | 2023-06-23 | 四川长虹网络科技有限责任公司 | Digital television section data receiving method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107786000B (en) | Intelligent generation method for configuration file of digital relay protection tester | |
| CN103425497B (en) | The method and apparatus that a kind of network engineering script is changed across producer | |
| CN107394892B (en) | Method and system for determining debugging range of interval change of intelligent substation | |
| CN102945262B (en) | A kind of RNC configuration data control methods and device | |
| CN109542985B (en) | Universal stream data analysis model and construction method thereof | |
| CN109491735A (en) | Integrated data generates the comprehensively monitoring human-machine interface configuration implementation method with verification | |
| CN109272571A (en) | A kind of system and method that PDS three-dimensional data is converted to Flowmaster model | |
| CN105550361B (en) | Log processing method and device and question and answer information processing method and device | |
| CN110222113A (en) | A kind of data extraction process visualization method for early warning | |
| CN106199323A (en) | A kind of virtual terminals of intelligent substation connects correctness method of discrimination | |
| CN109408601B (en) | Data model conversion method based on graph data and graph data structure converter | |
| CN110198254B (en) | Communication protocol online diagnosis method and diagnosis system | |
| CN102156799A (en) | Cascadable complex event processing engine and train overhauling automatic recording method | |
| CN105488293B (en) | A kind of method and system configuring virtual terminator line in SCD | |
| CN102135939A (en) | Test case operation dispatching device and method | |
| CN108920377A (en) | A kind of log playback test method, system, device and readable storage medium storing program for executing | |
| CN110532305A (en) | A kind of business datum method for cutting over and system | |
| CN110209722A (en) | A kind of data-interface for data exchange | |
| CN110471823A (en) | Communication configuration method, device and the computer readable storage medium of configuration software | |
| CN116167719A (en) | Method and system for realizing mapping between different systems of power equipment ledgers | |
| CN110290226A (en) | A kind of general client and server-side mating interface protocol method | |
| CN110045678A (en) | A kind of program scheduler method, apparatus, equipment, system and storage medium | |
| CN110334001A (en) | A kind of method and apparatus that batch automatically generates echo test | |
| CN114398085A (en) | Automatic configuration method, device and medium for picture signals of intelligent substation monitoring system | |
| CN110244096B (en) | Method for automatically discovering and processing electric meter full code in electric energy metering system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190910 |