CN109408448A - One kind can carry out centralized processing integration data to data and show platform - Google Patents

One kind can carry out centralized processing integration data to data and show platform Download PDF

Info

Publication number
CN109408448A
CN109408448A CN201811479525.2A CN201811479525A CN109408448A CN 109408448 A CN109408448 A CN 109408448A CN 201811479525 A CN201811479525 A CN 201811479525A CN 109408448 A CN109408448 A CN 109408448A
Authority
CN
China
Prior art keywords
data
analysis
module
carry out
real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811479525.2A
Other languages
Chinese (zh)
Inventor
黄伟
赵雪凤
李婷
李亮
沙敏
陆伟
尤崇久
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Heng Chuan Softcom Ltd
Original Assignee
Jiangsu Heng Chuan Softcom Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Heng Chuan Softcom Ltd filed Critical Jiangsu Heng Chuan Softcom Ltd
Priority to CN201811479525.2A priority Critical patent/CN109408448A/en
Publication of CN109408448A publication Critical patent/CN109408448A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/02Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators
    • G06F15/025Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators adapted to a specific application
    • G06F15/0283Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators adapted to a specific application for data storage and retrieval
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16MFRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
    • F16M11/00Stands or trestles as supports for apparatus or articles placed thereon Stands for scientific apparatus such as gravitational force meters
    • F16M11/20Undercarriages with or without wheels
    • F16M11/2007Undercarriages with or without wheels comprising means allowing pivoting adjustment
    • F16M11/2014Undercarriages with or without wheels comprising means allowing pivoting adjustment around a vertical axis

Abstract

Can data be carried out with centralized processing integration data the invention discloses one kind and show platform, the data carry out centralized processing integration data to show platform including data acquisition, data routing, data analysis, Real-time Alarm analysis and data exhibiting.This can carry out centralized processing integration data to data and show platform, the processing unified to important real time data, make equipment operation condition, the real time monitoring of the data such as energy consumption, Real-time Alarm and subsequent retrospective analysis possess system support, line operation and administrative staff can be made to found the abnormal situation and be handled in time in time, data are focused on, it can log in and operate to obtain different data in different operation systems, data in each operation system connect each other, each operation system data can be observed directly, facilitate executive group quick obtaining information needed, it is easy to operate, improve data acquisition efficiency.

Description

One kind can carry out centralized processing integration data to data and show platform
Technical field
The present invention relates to data exhibiting platform technology field, specially one kind can carry out centralized processing integration to data Data exhibiting platform.
Background technique
With group company's informatization and enterprise two change fusion not to propulsion, it is contemplated that enterprises it is all kinds of IT data will enter explosive growth period, how to the storage of the big data of magnanimity, analysis mining and to show in real time will be many The urgent need of multiple enterprises, information dataization have substantially covered each face of each side of production and management;
Current informationization system acquires in data, analyzes, shows that upper there are two big weak spots: first is that important real time data Lack unified processing platform, to realize the functions such as the acquisition storage of important real time data, monitoring alarm, retrospective analysis, second is that Data are dispersed, and the data in each operation system are established one's own system, and data are closed in operation system, this just gives administrator on the middle and senior level Member can not quick obtaining information needed, current Information System, which has, in terms of comprehensive following several insufficient needs to make up:
1. the real time monitoring of the data such as pair equipment operation condition, energy consumption, Real-time Alarm and subsequent retrospective analysis lack system It supports, line operation and administrative staff is caused to be not easy found the abnormal situation and be handled in time;
2. data are dispersed, need to log in and operated to obtain different data in different operation systems;
3. various dimensions statistical analysis is difficult, the mutual independence of data determines can not be by technological means, according to management The demand customized management instrument board of person, so that one-stop gets desired consulting;
Can data be carried out with centralized processing integration data the purpose of the present invention is to provide one kind and show platform, with solution The problem of certainly above-mentioned background technique proposes.
Summary of the invention
Can data be carried out with centralized processing integration data the purpose of the present invention is to provide one kind and show platform, with solution Certainly the problems mentioned above in the background art:
1. the real time monitoring of the data such as pair equipment operation condition, energy consumption, Real-time Alarm and subsequent retrospective analysis lack system It supports, line operation and administrative staff is caused to be not easy found the abnormal situation and be handled in time;
2. data are dispersed, need to log in and operated to obtain different data in different operation systems;
3. various dimensions statistical analysis is difficult, the mutual independence of data determines can not be by technological means, according to management The demand customized management instrument board of person, so that one-stop gets desired consulting.
To achieve the above object, the invention provides the following technical scheme: one kind can carry out centralized processing one to data Change data exhibiting platform, the data carry out centralized processing integration data to show platform including data acquisition, data routing, number According to analysis, Real-time Alarm analysis and data exhibiting.
Preferably, the data acquisition comprises the following steps:
Step 1: module being lined up to data are delivered to source by acquisition interface, data are marked by lining up source module Note and distribution;
Step 2: label and distribution module duplication shunting is carried out to data, to data carry out Real-time Alarm, data storage and Analytic operation;
Step 3: data are delivered to alarm by Real-time Alarm, data storage and analytic operation respectively by way of lining up Judgment module, data storage module and analytic operation module determined by the complete paired data of alarm judgment module, and to judgement after Data carry out short message/push, data are delivered to by time series databases, relevant database by data storage module With classified storage is carried out in mongodb.
Preferably, the data analysis comprises the following steps:
Step 1: by extracting cleaning, conversion and reprinting module to external data source progress data pick-up and data will be extracted It carries out data conversion and data is reprinted into data warehouse, external data source includes data service and data file;
Step 2: data are delivered on line data analysis module by data warehouse, and on line data analysis module will need to analyze Data analyzed according to Data Analysis Model, form the association between master data and associated each related angle, then will The cube that data are delivered to after analysis;
Step 3: data are delivered in data warehouse and principal database and store by multidimensional data, while passing through multidimensional Database completes data exhibiting.
Preferably, the data exhibiting includes such as under type:
Mode 1: completing data exhibiting by real time monitoring, shows even if being used in process control real time monitoring, including will be real When alert analysis data by Real-time Alarm module generate warning information reflect in real time to monitor in real time;
Mode 2: completing data exhibiting by routine work report mode, i.e., those in business use than more frequently, The data analytical statement that format and content are fixed, this system will use mature finereport as Report Designer and report Show tool;
Mode 3: completing data exhibiting by way of data billboard, i.e., subject data is analyzed mould according to relevant data Type carries out data pick-up, and is showed using chart, data form, and can carry out drilling analysis to data.
Compared with prior art, the beneficial effects of the present invention are: this can carry out centralized processing integration data to data Show platform, first is that the processing unified to important real time data, come realize the acquisition storage of important real time data, monitoring alarm, The functions such as retrospective analysis, second is that focusing on to data, the data in each operation system are connected each other, each operation system Data can be observed directly, and executive group quick obtaining information needed is facilitated;
1, system is possessed to the real time monitoring of the data such as equipment operation condition, energy consumption, Real-time Alarm and subsequent retrospective analysis It supports, line operation and administrative staff can be made to found the abnormal situation and be handled in time in time;
2, data are concentrated, can be logged in and operate in different operation systems to obtain different data, behaviour Facilitate, improves data acquisition efficiency;
3, by data exhibiting, enable data by technological means, according to the demand customized management instrument board of manager, To which one-stop gets desired consulting.
Detailed description of the invention
Fig. 1 is overall framework schematic diagram of the present invention;
Fig. 2 is data acquisition schematic diagram of the present invention;
Fig. 3 is that data of the present invention analyze schematic diagram;
Fig. 4 is operation system schematic diagram of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
Fig. 1-4 is please referred to, the present invention provides a kind of technical solution: one kind can carry out data to focus on integrated number According to showing platform, data carry out centralized processing integration data show platform include data acquisition, data routing, data analysis, Real-time Alarm analysis and data exhibiting.
Data acquisition comprises the following steps: step 1: lining up module to data are delivered to source by acquisition interface, pass through Line up source module data are marked and are distributed;Step 2: label and distribution module carry out duplication shunting to data, to data Carry out Real-time Alarm, data storage and analytic operation;Step 3: Real-time Alarm, data storage and analytic operation, which pass through, lines up Data are delivered to alarm judgment module, data storage module and analytic operation module by mode respectively, by alerting judgment module Complete paired data determines, and short message/push to the data progress after judgement, when being delivered to data by data storage module Between carry out classified storage in sequence database, relevant database and mongodb, line operation and administrative staff can be made quick It found the abnormal situation and handled in time in time;
Data analysis comprise the following steps: step 1: by extract cleaning, conversion and reprint module to external data source into Row data pick-up simultaneously will extract data progress data conversion and data reprinting into data warehouse, and external data source includes data industry Business and data file;Step 2: data are delivered on line data analysis module by data warehouse, and on line data analysis module need to The data to be analyzed are analyzed according to Data Analysis Model, form the association between master data and associated each related angle, Then cube data after analysis being delivered to;Step 3: data are delivered to data warehouse and main body number by multidimensional data Data exhibiting is completed according to being stored in library, while by multi-dimensional database, benefit load balancing, multiserver trunking mode, It prevents business datum concentrations and data jamming is caused to interrupt service, using audit-trail, it is all what is occurred in this system Event;
Data exhibiting includes such as under type: mode 1: data exhibiting is completed by real time monitoring, even if being used in process control Real time monitoring shows, including Real-time Alarm analysis data are generated warning information by Real-time Alarm module and are reflected in real time to real-time Monitoring;Mode 2: completing data exhibiting by routine work report mode, i.e., those in business use than more frequently, format The fixed data analytical statement with content, this system will use mature finereport as Report Designer and report form showing Tool;3: completing data exhibiting by way of data billboard, i.e., carry out subject data according to relevant Data Analysis Model Data pick-up, and showed using chart, data form, and acquisition analysis can be carried out to data, to corresponding important number Prevent significant data data leak to unauthorized user and entity, guarantee data according to needing to carry out data encryption using cipher mode Availability, reliability, confidentiality, while ensuring to obtain the safety of data, while the acquisition that manager can be made one-stop To desired consulting.
Working principle: when can data be carried out with centralized processing integration data using this showing platform, data first By database, TPC/IP agreement, http protocol receives data and transmitted according to agreement data format for acquisition To MQ message, then by data routing module data are read from MQ message queue and unpack according to routing policy and be distributed to downstream Processing module, will receive data packet according to storage strategy by data storage is storage to real-time data base, or stores and arrive Relevant database, or storage, into non-institutional database, complete paired data avoids data to the classification processing of data Confusion, the inquiry convenient for the later period to data, by ETL data conversion module, OLAP on-line analysis module carries out data analysis, Data conversion module mainly carries out data pick-up and will extract data progress data conversion, and on line data analysis will need to analyze Data analyzed according to Data Analysis Model, the association between master data and associated each related angle is formed, to make User can obtain data from all angles, and also the multi-angle comprehensive that switches over or carry out between all angles of dynamic divides Analysis, ensure that obtain data it is comprehensive, using identification with confirm, the permission of user is controlled, phase can only be accessed The resource and data for answering permission prevent or limit the unauthorized access through convert channel, benefit load balancing, multiserver cluster side Formula prevents business datum concentrations and data jamming is caused to interrupt service, using audit-trail, the institute occurred in this system There is event, usage log record to analyze reason, distinguishes responsibility, takes appropriate measures in time, to corresponding significant data It needs to carry out data encryption using cipher mode to prevent significant data data leak to unauthorized user and entity, guarantees data Availability, reliability, confidentiality, while ensuring to obtain the safety of data, data acquisition is collected into data according to alarm plan Real-time Alarm analysis is slightly carried out, and analysis alarm result is pushed to user terminal, is routed to other processing modules, to its data It is handled in time, by data exhibiting, enables data by technological means, according to the demand customized management instrument of manager Plate provides effective and rapid data service so that one-stop gets desired consulting for enterprise's production at different levels and administrative staff, Here it is this, and can data be carried out with the application method that centralized processing integration data shows platform.
The standardized element that the present invention uses can commercially, and shaped piece is according to specification and attached drawing note Load can carry out customized, and the specific connection type of each part is all made of in the prior art mature bolt, rivet, welding etc. Conventional means, mechanical, part and equipment are all made of in the prior art, conventional model, in addition circuit connection uses the prior art Middle conventional connection type, this will not be detailed here, and the content being not described in detail in this specification belongs to this field professional technique The prior art well known to personnel.
Although the present invention is described in detail referring to the foregoing embodiments, for those skilled in the art, It is still possible to modify the technical solutions described in the foregoing embodiments, or part of technical characteristic is carried out etc. With replacement, all within the spirits and principles of the present invention, any modification, equivalent replacement, improvement and so on should be included in this Within the protection scope of invention.

Claims (4)

1. one kind can carry out centralized processing integration data to data shows platform, it is characterised in that: the data are collected It includes data acquisition, data routing, data analysis, Real-time Alarm analysis and data exhibition that middle processing integration data, which shows platform, It is existing.
2. one kind according to claim 1 can carry out centralized processing integration data to data shows platform, feature Be: the data acquisition comprises the following steps:
Step 1: module is lined up to data are delivered to source by acquisition interface, data are marked by lining up source module and Distribution;
Step 2: label and distribution module carry out duplication shunting to data, carry out Real-time Alarm, data storage and analysis to data Operation;
Step 3: data are delivered to alarm judgement by Real-time Alarm, data storage and analytic operation respectively by way of lining up Module, data storage module and analytic operation module, by the complete paired data judgement of alarm judgment module, and to the number after judgement According to short message/push of progress, by data storage module by data be delivered to time series databases, relevant database and Classified storage is carried out in mongodb.
3. one kind according to claim 1 can carry out centralized processing integration data to data shows platform, feature Be: the data analysis comprises the following steps:
Step 1: by extracting cleaning, converting and reprinting module to external data source progress data pick-up and data progress will be extracted Data conversion simultaneously reprint into data warehouse by data, and external data source includes data service and data file;
Step 2: data are delivered on line data analysis module, the number that on line data analysis module analyzes needs by data warehouse It is analyzed according to according to Data Analysis Model, forms the association between master data and associated each related angle, it then will analysis The cube that data are delivered to afterwards;
Step 3: data are delivered in data warehouse and principal database and store by multidimensional data, while passing through multidimensional data Complete data exhibiting in library.
4. one kind according to claim 1 can carry out centralized processing integration data to data shows platform, feature Be: the data exhibiting includes such as under type:
Mode 1: completing data exhibiting by real time monitoring, shows even if being used in process control real time monitoring, including will accuse in real time Alert analysis data generate warning information by Real-time Alarm module and reflect in real time to real time monitoring;
Mode 2: completing data exhibiting by routine work report mode, i.e., those in business use than more frequently, format The fixed data analytical statement with content, this system will use mature f i nereport as Report Designer and report exhibition Existing tool;
Mode 3: completing data exhibiting by way of data billboard, i.e., by subject data according to relevant Data Analysis Model into Row data pick-up, and showed using chart, data form, and drilling analysis can be carried out to data.
CN201811479525.2A 2018-12-05 2018-12-05 One kind can carry out centralized processing integration data to data and show platform Pending CN109408448A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811479525.2A CN109408448A (en) 2018-12-05 2018-12-05 One kind can carry out centralized processing integration data to data and show platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811479525.2A CN109408448A (en) 2018-12-05 2018-12-05 One kind can carry out centralized processing integration data to data and show platform

Publications (1)

Publication Number Publication Date
CN109408448A true CN109408448A (en) 2019-03-01

Family

ID=65457268

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811479525.2A Pending CN109408448A (en) 2018-12-05 2018-12-05 One kind can carry out centralized processing integration data to data and show platform

Country Status (1)

Country Link
CN (1) CN109408448A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109993661A (en) * 2019-04-04 2019-07-09 凯泰铭科技(北京)有限公司 A kind of settlement of insurance claim data analysing method and system
CN112306801A (en) * 2020-10-28 2021-02-02 联通(广东)产业互联网有限公司 Monitoring data processing method, system and medium based on heterogeneous data source
CN112597232A (en) * 2020-12-29 2021-04-02 南京小灿灿网络科技有限公司 Data distributed publishing method and system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101075304A (en) * 2006-05-18 2007-11-21 河北全通通信有限公司 Method for constructing decision supporting system of telecommunication industry based on database
CN101197876A (en) * 2006-12-06 2008-06-11 中兴通讯股份有限公司 Method and system for multi-dimensional analysis of message service data
CN101854277A (en) * 2010-06-12 2010-10-06 河北全通通信有限公司 Method for monitoring mobile communication operation analysis system
CN103530805A (en) * 2013-07-19 2014-01-22 广东电网公司电力科学研究院 Automatic settling system and method based on database and system interface
CN104301147A (en) * 2014-10-24 2015-01-21 国家电网公司 Method for monitoring service and process activities in service application system
CN105354616A (en) * 2015-12-18 2016-02-24 国电南瑞科技股份有限公司 Processing device and on-line processing method for electric power measurement asset data
CN105574657A (en) * 2015-12-11 2016-05-11 山东新网格信息技术有限公司 Intelligent police actual combat comprehensive application platform
CN107330826A (en) * 2017-07-07 2017-11-07 博弗教育科技(上海)有限公司 A kind of teaching information management system and its application method
CN107943668A (en) * 2017-12-15 2018-04-20 江苏神威云数据科技有限公司 Computer server cluster daily record monitoring method and monitor supervision platform

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101075304A (en) * 2006-05-18 2007-11-21 河北全通通信有限公司 Method for constructing decision supporting system of telecommunication industry based on database
CN101197876A (en) * 2006-12-06 2008-06-11 中兴通讯股份有限公司 Method and system for multi-dimensional analysis of message service data
CN101854277A (en) * 2010-06-12 2010-10-06 河北全通通信有限公司 Method for monitoring mobile communication operation analysis system
CN103530805A (en) * 2013-07-19 2014-01-22 广东电网公司电力科学研究院 Automatic settling system and method based on database and system interface
CN104301147A (en) * 2014-10-24 2015-01-21 国家电网公司 Method for monitoring service and process activities in service application system
CN105574657A (en) * 2015-12-11 2016-05-11 山东新网格信息技术有限公司 Intelligent police actual combat comprehensive application platform
CN105354616A (en) * 2015-12-18 2016-02-24 国电南瑞科技股份有限公司 Processing device and on-line processing method for electric power measurement asset data
CN107330826A (en) * 2017-07-07 2017-11-07 博弗教育科技(上海)有限公司 A kind of teaching information management system and its application method
CN107943668A (en) * 2017-12-15 2018-04-20 江苏神威云数据科技有限公司 Computer server cluster daily record monitoring method and monitor supervision platform

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109993661A (en) * 2019-04-04 2019-07-09 凯泰铭科技(北京)有限公司 A kind of settlement of insurance claim data analysing method and system
CN112306801A (en) * 2020-10-28 2021-02-02 联通(广东)产业互联网有限公司 Monitoring data processing method, system and medium based on heterogeneous data source
CN112306801B (en) * 2020-10-28 2023-01-03 联通(广东)产业互联网有限公司 Monitoring data processing method, system and medium based on heterogeneous data source
CN112597232A (en) * 2020-12-29 2021-04-02 南京小灿灿网络科技有限公司 Data distributed publishing method and system

Similar Documents

Publication Publication Date Title
CN108763957A (en) A kind of safety auditing system of database, method and server
CN109408448A (en) One kind can carry out centralized processing integration data to data and show platform
CN108197261A (en) A kind of wisdom traffic operating system
CN106371986A (en) Log treatment operation and maintenance monitoring system
CN104036365A (en) Method for constructing enterprise-level data service platform
CN104504014A (en) Data processing method and device based on large data platform
CN103714434A (en) Chemical industry production site patrol system based on internet of things technology
CN109784788A (en) A kind of intelligent comprehensive patrol checking server, terminal and system
CN107547228A (en) A kind of safe operation management platform based on big data realizes framework
CN109361576A (en) A kind of PIM monitoring data processing method and system
CN106355489A (en) Data center system and data processing method for management
CN111737549A (en) Economic index intelligent analysis system
CN113506096B (en) Inter-system interface method based on industrial internet identification analysis system
KR100696083B1 (en) Information Technology Service Management Method
CN104484734A (en) Low-carbon city energy optimized configuration data center architecture
CN111125450A (en) Management method of multilayer topology network resource object
CN109709839A (en) A kind of biomass electric power plant multistage method for real-time monitoring
CN103442212A (en) Network security and protection comprehensive early warning type management system platform
CN102984013A (en) Alarm analysis method for communication transmission network
CN113592210A (en) Internet of things integrated management platform for water supply non-negative-pressure secondary water supply facility
CN112883001A (en) Data processing method, device and medium based on marketing and distribution through data visualization platform
CN117112702A (en) Service rapid processing system for long and large bridge tunneling scene
CN106293975B (en) Information processing method, information processing unit and information processing system
CN110322218A (en) Intelligent society insurance business operation and monitoring method and system
CN109857809A (en) A kind of raw data base data are synchronized to the synchronous method and system of target database

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination