CN107451283A - The analysis method and device of data - Google Patents
The analysis method and device of data Download PDFInfo
- Publication number
- CN107451283A CN107451283A CN201710674058.8A CN201710674058A CN107451283A CN 107451283 A CN107451283 A CN 107451283A CN 201710674058 A CN201710674058 A CN 201710674058A CN 107451283 A CN107451283 A CN 107451283A
- Authority
- CN
- China
- Prior art keywords
- data
- advance
- target
- information
- analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a kind of analysis method of data and device, it is related to the technical field of data processing, this method includes：Pending initial data is obtained by the data access interface built in advance, wherein, the data source of initial data is at least one；Initial data is carried out based on configuration information set in advance to redefine configuration, definition obtains target data, wherein, configuration information includes：Data dimension information and/or data target information；Control targe data are handled according to predetermined flow chart of data processing, obtain data processed result；By calling the data display interface built in advance that data processed result is illustrated on display interface, the existing processing method technical problem that cost is higher when analyzing different data sources and treatment effeciency is relatively low is alleviated.
Description
Technical field
The present invention relates to technical field of data processing, more particularly, to the analysis method and device of a kind of data.
Background technology
Present society is the society of a high speed development, and science and technology is flourishing, information flow, and the exchange between people is increasingly
Closely, life is also more and more convenient, and big data is exactly the product of current cyberage.With the arriving of cloud era, big data
Also increasing concern has been attracted.For enterprise, data have become the wealth of enterprise, and a kind of important strategy
Resource.But in an enterprise, different types of data are typically distributed in several independent information systems.
By taking operator as an example, the charging of user and bill information are generated by information-based or market department operation analysis system
And maintenance, and caused signaling and internet behavior record then by the network O＆M system of network O＆M department user in a network
Storage.Due to a variety of history and practical reasons, lack unified interface between these independent information systems, and data structure is poor
It is different huge, cause the data fusion of enterprises difficult, also can not economy and social value that fully mining data is included.With
Exemplified by network O＆M, O＆M index relate to a variety of data sources such as the network equipment, server, network traffics.Generally
In the case of, it is necessary to which a variety of manufacturers or service provider pass through not during information system operation conditions monitoring is carried out
Same method collects, arranges and analyze KPI data.
In face of more and more large-scale data, more and more changeable dimension, the multidimensional analysis to become increasingly complex, normal conditions
Under, when collecting, arranging data, in face of various information islands, want all data unified plannings and analyze data, conventional method
It is by BI system architectures, by a series of standardization ETL flows, will be uniformly placed in BI systems after data cleansing, wherein,
Typical BI frameworks are as shown in Figure 1.
Typical BI frameworks defect when different scenes are applied is as follows：Need to build BI data centers, extra input is a large amount of
Hardware resource；Business datum writes olap database from OLTP database, substantial amounts of to standardize ETL processes, data conversion storage resource
Consumption is big；Data analysis delay is higher, can not realize extemporaneous analysis decision substantially；BI frameworks are right specially towards OLAP scenes
OLTP scene fitness is relatively low；Data pick-up, data conversion process are needed in framework to possess the data overall situation considerable degree of
Understand；Although algorithm is very more, need to possess suitable mathematics grounding in basic skills, the methods that can be shown are deficient.
The content of the invention
In view of this, it is an object of the invention to provide a kind of analysis method of data and device, to alleviate existing place
The reason method technical problem that cost is higher when analyzing different data sources and treatment effeciency is relatively low.
In a first aspect, the embodiments of the invention provide a kind of analysis method of data, including：Pass through the data built in advance
Access interface obtains pending initial data, wherein, the data source of the initial data is at least one；Based on setting in advance
Fixed configuration information carries out redefining configuration to the initial data, and definition obtains target data, wherein, the configuration information
Including：Data dimension information and/or data target information；The target data is controlled to be carried out according to predetermined flow chart of data processing
Processing, obtains data processed result；By calling the data display interface built in advance to be illustrated in the data processed result
On display interface.
Further, control the target data to be handled according to predetermined flow chart of data processing, obtain data processing
As a result include：Obtain pre-defined KPI calculation process；The target data is controlled to be counted according to the KPI calculation process
Calculate, obtain KPI result of calculations.
Further, control the target data to be handled according to predetermined flow chart of data processing, obtain data processing
As a result also include：Pre-defined data analysis flow is obtained, wherein, the data analysis flow includes at least one data
Analysis node, each data analysis node are used to perform corresponding data analysis task；The target data is controlled according to described
Data analysis node in data analysis flow performs data analysis task, obtains data results.
Further, the target data is being controlled to perform number according to the data analysis node in the data analysis flow
According to analysis task, after obtaining data results, methods described also includes：Thematic information set in advance is obtained, it is described special
Topic information is used to represent the different situations residing for the data results；Based on the thematic information to the data analysis knot
Fruit is analyzed again, obtains thematic data, wherein, the thematic data is used to represent the data results described special
Inscribe the object information under information state.
Further, the target data includes the first data acquisition system and the second data acquisition system, and the initial data includes
Initial data form, the initial data, which is carried out redefining configuration, based on configuration information set in advance includes：Obtain pre-
The data dimension information first set, and the initial data form is entered based on the data dimension information set in advance
Row definition configuration, obtains first data acquisition system；And the data target information set in advance is obtained, and based on pre-
The data target information first set is defined configuration to the initial data form, obtains second data acquisition system.
Further, the initial data includes the data of following at least one type：Relevant database, file format
Data, from kafka data, from hadoop data.
Second aspect, the embodiment of the present invention also provide a kind of analytical equipment of data, including：First acquisition unit, it is used for
Pending initial data is obtained by the data access interface built in advance, wherein, the data source of the initial data is extremely
It is one less；Dispensing unit is defined, for redefine matching somebody with somebody to the initial data based on configuration information set in advance
To put, definition obtains target data, wherein, the configuration information includes：Data dimension information and/or data target information；Control
Unit, for controlling the target data to be handled according to predetermined flow chart of data processing, obtain data processed result；Displaying
Unit, for by calling the data display interface built in advance that the data processed result is illustrated in into display interface.
Further, described control unit is used for：Obtain pre-defined KPI calculation process；Control the target data
Calculated according to the KPI calculation process, obtain KPI result of calculations.
Further, described control unit is additionally operable to：Pre-defined data analysis flow is obtained, wherein, the data
Analysis process includes at least one data analysis node, and each data analysis node is used to perform corresponding data analysis times
Business；Control the target data to perform data analysis task according to the data analysis node in the data analysis flow, obtain
Data results.
Further, methods described also includes：Second acquisition unit, for controlling the target data according to the number
Data analysis task is performed according to the data analysis node in analysis process, after obtaining data results, acquisition is preset
Thematic information, the thematic information is used to represent different situations residing for the data results；Analytic unit, for base
The data results are analyzed again in the thematic information, obtain thematic data, wherein, the thematic data is used
In object information of the expression data results in the case of the thematic information.
In embodiments of the present invention, pending initial data is obtained by the data access interface built in advance first；
Then, the initial data is carried out based on configuration information set in advance redefining configuration, definition obtains target data；Connect
Get off, control the target data to be handled according to predetermined flow chart of data processing, obtain data processed result；Finally, lead to
Cross and call the data display interface built in advance that the data processed result is illustrated on display interface.In the embodiment of the present invention
In, on legacy data/hardware foundation, few hardware resource is only put into, (cost is high, specialty not building professional BI platforms
Property it is strong), avoid carrying out ETL process (hardware cost high), without customized development (when limit for length, input big) in the case of, quickly
The fusion displaying of various dimensions, multi-data source is realized, eliminates information island, and by unified algorithm, Row control, can realize more
The purpose of the complicated analysis of data source data fusion, and then alleviate existing processing method and analyzed to different data sources
The technical problem that Shi Chengben is higher and treatment effeciency is relatively low.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages are in specification, claims
And specifically noted structure is realized and obtained in accompanying drawing.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical scheme of the prior art
The required accompanying drawing used is briefly described in embodiment or description of the prior art, it should be apparent that, in describing below
Accompanying drawing is some embodiments of the present invention, for those of ordinary skill in the art, before creative work is not paid
Put, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of schematic diagram of business intelligence system framework of the prior art；
Fig. 2 is a kind of flow chart of the analysis method of data according to embodiments of the present invention；
Fig. 3 is a kind of schematic diagram of data analysis framework according to embodiments of the present invention；
Fig. 4 is a kind of schematic diagram of the handling process of data access interface according to embodiments of the present invention；
Fig. 5 is a kind of schematic diagram of the flow chart of data processing of data configuration layer according to embodiments of the present invention；
Fig. 6 is a kind of schematic diagram of the displaying flow of data display interface according to embodiments of the present invention；
Fig. 7 is a kind of schematic diagram of the analytical equipment of data according to embodiments of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with accompanying drawing to the present invention
Technical scheme be clearly and completely described, it is clear that described embodiment is part of the embodiment of the present invention, rather than
Whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creative work premise
Lower obtained every other embodiment, belongs to the scope of protection of the invention.
Embodiment one：
According to embodiments of the present invention, there is provided a kind of embodiment of the analysis method of data is, it is necessary to illustrate, in accompanying drawing
Flow the step of illustrating can be performed in the computer system of such as one group computer executable instructions, although also,
Show logical order in flow charts, but in some cases, can with different from order herein perform it is shown or
The step of description.
Fig. 2 is a kind of flow chart of the analysis method of data according to embodiments of the present invention, as shown in Fig. 2 this method bag
Include following steps：
Step S202, pending initial data is obtained by the data access interface built in advance, wherein, initial data
Data source be at least one；
Step S204, initial data is carried out based on configuration information set in advance to redefine configuration, definition obtains mesh
Data are marked, wherein, configuration information includes：Data dimension information and/or data target information；
It should be noted that in embodiments of the present invention, the extensive concepts of Key-Value are proposed, it is general that Key is generalized for dimension
Read (that is, above-mentioned data dimension information), Value is generalized for index or index set concept (that is, above-mentioned data target information).Respectively
Independent legacy data attendant is redefined and configured to legacy data under unified Key-Value demands.Wherein,
By being re-defined to Key, the switching of any dimension can be achieved, dimension can be switched to original table to carry out free analysis；
By being re-defined to Value, the function that addition parameter can be achieved is calculated already present index item again to realize
New parameter is obtained, data polymerizeing again under new dimension can also be realized；Data pick-up, transfer process are avoided, is avoided
Need have global knowledge to global data.
Step S206, control targe data are handled according to predetermined flow chart of data processing, obtain data processed result；
Step S208, by calling the data display interface built in advance that data processed result is illustrated in into display interface
On.
In embodiments of the present invention, pending initial data is obtained by the data access interface built in advance first；
Then, initial data is carried out based on configuration information set in advance redefining configuration, definition obtains target data；Connect down
Come, control targe data are handled according to predetermined flow chart of data processing, obtain data processed result；Finally, calling is passed through
Data processed result is illustrated on display interface by the data display interface built in advance.In embodiments of the present invention, original
On data/hardware foundation, few hardware resource is only put into, professional BI platforms (cost is high, strongly professional) need not built,
Avoid carrying out ETL process (hardware cost high), without customized development (when limit for length, input big) in the case of, it is quick realize it is more
The fusion displaying of dimension, multi-data source, eliminates information island, and by unified algorithm, Row control, can realize multi-data source
The purpose of the complicated analysis of data fusion, and then alleviate existing processing method cost when analyzing different data sources
Higher and relatively low treatment effeciency technical problem.
It should be noted that the method described by above-mentioned steps S202 to step S208 is a kind of number of data analysis framework
According to analysis method, the data analysis framework is installed on the server, when data analyst is analyzed data, can adjusted
Corresponding data are analyzed with the data analysis framework.For example, operation maintenance personnel is divided in the data to multiple data origin
During analysis, the data framework can be called to analyze it；In another example operation personnel is to dividing the data of data source
During analysis, the data structure can be called to analyze it.
As shown in Figure 3 is above-mentioned described data analysis framework, from figure 3, it can be seen that the data analysis frame
Structure includes data access interface, data configuration layer and data display interface.
Data access interface can realize the access of the initial data of the various data formats of bottom, and initial data includes following
The data of at least one type：Relevant database, the data of file format, from kafka data, from hadoop
Data.
In embodiments of the present invention, data access interface can realize the data access of the various data formats of bottom.Comprising
But it is not limited to various relevant databases, file format, the data from kafka, data from hadoop etc..Pass through
General data access interface, it is adapted to the data access of various data formats.Original still be present without ETL in the data of access
Have in memory module, both avoided putting into great amount of hardware resources again, realize the initial data access of various nonstandardized techniques again, it is each
Data source is managed independently in framework, and original data maintenance personnel are without understanding other data sources.
It is as shown in Figure 4 for a kind of function of data access interface and the schematic diagram of flow.As shown in figure 4, initial data
Data access interface is accessed under the control of data access control, then, it is possible to pass through standard data format modulus of conversion
Block is standardized to initial data, next, can by data output interface by required data output to next
Analysis layer (that is, data configuration layer).It can also be seen that input to the data in data configuration layer pass through Key-Value from Fig. 4
After configuration definition, then, the data after configuration definition are converted into structuralized query language by standardizing SQL generator
Speech；Next, can is by standardizing SQL conversion data source inquiry mode modules come to being converted to SQL
Data inquired about.
As shown in figure 3, data configuration layer is connected with data access interface, data configuration layer is except proposing Key-Value
Extensive concept, abundant data algorithm interface is also provided, support primary machine learning data mining storehouse MADLib, can complete
In the case of data are nonmigratory, under OLTP Method of Data Organization scene, the basic multidimensional analysis that data are carried out with OLAP operates,
Containing drilling through, cut into slices and stripping and slicing and data are carried out with the operation such as depth data excavation.
In an optional embodiment, include the first data acquisition system and the second data acquisition system in target data, it is original
In the case that data include raw data table lattice, initial data is carried out based on configuration information set in advance to redefine configuration
Comprise the following steps：
Step S2041, data dimension information set in advance is obtained, and based on data dimension information set in advance to original
Beginning data form is defined configuration, obtains the first data acquisition system.
As shown in figure 4, data dimension information, which can be independent dimension, defines or combines dimension definition, wherein, independent dimension
It can be the time to spend definition, and combination dimension defines the combination of when and where.Further, the time again may be used in independent dimension definition
To be divided into minute, hour, day, week and the moon；Minute and provincial capital's combination, and Tian He cities can be split as in combination dimension definition again
Combination.
Step S2042, data target information set in advance is obtained, and based on data target information set in advance to original
Beginning data form is defined configuration, obtains the second data acquisition system.
It should be noted that data target information is properly termed as KPI information again, then by data target information to original
When beginning information is redefined, KPI definition is properly termed as.Initial data is being matched somebody with somebody again according to data target information
After putting definition, in an optional embodiment, it is possible to match somebody with somebody according to pre-defined KPI calculation process to redefining
Initial data (that is, the second data acquisition system) after putting carries out KPI calculating.
As shown in figure 3, in data configuration layer, KPI algorithms can be defined, and define data analysis flow, with according to
Pre-defined KPI algorithms and data analysis process is analyzed the data after configuration definition, and detailed process is described as follows.
In an optional embodiment, control targe data are handled according to predetermined flow chart of data processing, are obtained
Comprise the following steps to data processed result：
Step S11, obtain pre-defined KPI calculation process；
Step S12, control targe data are calculated according to KPI calculation process, obtain KPI result of calculations.
In embodiments of the present invention, various KPI calculation process can be freely defined in data configuration layer, wherein, such as Fig. 5
Shown, KPI calculation process includes KPI column counts algorithm (for example, A+B, A+B/C), and KPI rows computational algorithm is (for example, polymerization meter
Calculate), other algorithms, for example, ranks are changed, more KPI form a KQI, data mining etc..
By foregoing description, the embodiment of the present invention compared with prior art, simplifies algorithm in data analysis process
Application, while open data algorithm interface can realize compound KPI flexible definition using KPI algorithms are defined, while by outer
Put algorithm bank interface so that the divergence of algorithm is greatly improved, and no longer as traditional BI frameworks, sticks to BI and is carried
The algorithm of confession, constrained by the algorithm of BI softwares.
In another optional embodiment, control targe data are handled according to predetermined flow chart of data processing,
Data processed result is obtained also to comprise the following steps：
Step S21, pre-defined data analysis flow is obtained, wherein, data analysis flow includes at least one number
According to analysis node, each data analysis node is used to perform corresponding data analysis task；
Step S22, control targe data perform data analysis task according to the data analysis node in data analysis flow,
Obtain data results.
In embodiments of the present invention, there is provided the editing machine of data analysis flow, pass through the editing machine, definable data analysis
Flow, wherein, include at least one data analysis node in the data analysis flow.Specifically, can be to the data in flow
Analysis node carries out node definition, and input (containing multidimensional) equal definable in each data analysis node, node algorithm passes through calculation
Method interface defines, and the data that different data sources can be achieved complete Cooperative Analysis in same analysis process, complete complex data
Analytic function, drawn a conclusion with data, the analysis process modularization that will be repeated, realize the sequencing of professional experiences.
It should be noted that target data after being analyzed by each data analysis node, will obtain one point
Conclusion is analysed, the analytical conclusions are used for the flow direction for indicating next data analysis node of target data.
In embodiments of the present invention, number is performed according to the data analysis node in data analysis flow in control targe data
According to analysis task, after obtaining data results, thematic information set in advance can also be obtained, thematic information is used to represent
Different situations residing for data results；Then, data results are analyzed again based on thematic information, obtained specially
Data are inscribed, wherein, thematic data is used to represent object information of the data results in the case of thematic information.
As shown in figure 5, after being analyzed by data analysis flow target data, can also be defined by special topic
The thematic information pre-defined in module carries out classification analysis to above-mentioned analytical conclusions, and obtains point in the case of thematic information
Analyse result (i.e. thematic data).
As shown in fig. 6, after thematic data is obtained, it is possible to which thematic data is exported to aobvious by data display interface
Show on the display interface of equipment.Specifically, as shown in fig. 6, it is possible, firstly, to visual control is selected, then, in thematic space of a whole page cloth
Office's configuration module configures the thematic space of a whole page；Next, in the display mode (example of thematic data exhibition method configuration module configuration special topic
Such as, form or chart)；Next, relevant configuration can be carried out (for example, matching somebody with somebody by specific form, diagram data configuration module
Put the definition of X/Y axles, the information such as sequence definition and TOPN), finally, it is possible to configured by interaction relation configuration module between chart
Interaction relation between chart.After above-mentioned configuration, it is possible to which thematic data is included on display interface.
By foregoing description, the present invention compared with prior art, opens in presentation layer, there is provided universal data interface,
The various visual controls having been carried out can be docked, break away from the constraint that conventional BI frameworks have bound output control, extreme enrichment exhibition
Show the exhibition method of layer, improve data display flexibility ratio.
To sum up, method provided in an embodiment of the present invention compared with prior art, has advantages below：
The present invention saves a large amount of ETL times without specialty, complicated ETL processes, without overlapping investment hardware resource, respectively
It is individually present between individual data source, it is only necessary to which data source externally provides query interface；In the feelings of very small amount increase hardware cost
Under condition, existing system is neither influenceed, a data multiple use can be realized again.
The present invention completes the data cleansing of conventional BI framework layers, transfer process using the data configuration layer of innovation.By with
Put, can flexibly, arbitrarily change dimension, index algorithm,, must if index cleaning, transfer process error without as BI frameworks
It must clean again after ETL again, change data.
The present invention opens in presentation layer, there is provided conventional data display interface, can dock the various visualization controls having been carried out
Part, the constraint that conventional BI frameworks have bound output control is broken away from, the exhibition method of extreme enrichment presentation layer, improves data display
Flexibility ratio.
Compared with prior art, data complexity extending transversely substantially reduces the present invention, and data establishment officer only needs
Which kind of data is solution need, without needing the organizational form to source data, storage organization to understand in depth as conventional BI frameworks.
The present invention is using the data configuration layer flexible configuration Data Mart concept innovated, for different user, it is only necessary to pin
To user's request configuration data dimension and data target, without being created as traditional BI frameworks, it is necessary to pass through a large amount of ETL processes
Towards the Data Mart of different objects, a newly-increased Data Mart needs to parse data needed for fairground in data warehouse again
ETL is into standalone version.And in this framework, it is only necessary to which a newly-increased configuration can be completed to increase a Data Mart newly.Greatly letter
Change the process for forming Data Mart, save the plenty of time.
This invention simplifies the application of algorithm in data analysis process, while open data algorithm interface, using defining KPI
Algorithm can realize compound KPI flexible definition, while pass through external algorithm bank interface so that the divergence of algorithm obtains greatly
Lifting, no longer as traditional BI frameworks, sticks to the algorithm that BI is provided, and is constrained by the algorithm of BI softwares.
The present invention opens in presentation layer, there is provided universal data interface, can dock the various visual controls having been carried out, put
The constraint that conventional BI frameworks have bound output control is taken off, the exhibition method of extreme enrichment presentation layer, it is flexible to improve data display
Degree.
Embodiment two：
The embodiment of the present invention additionally provides a kind of analytical equipment of data, and the analytical equipment of the data is mainly used in performing sheet
The analysis method for the data that inventive embodiments the above is provided, the below analysis to data provided in an embodiment of the present invention fill
Put and do specific introduction.
Fig. 7 is a kind of schematic diagram of the analytical equipment of data according to embodiments of the present invention, as shown in fig. 7, the data
Analytical equipment mainly includes：First acquisition unit 71, dispensing unit 72, control unit 73 and display unit 74 are defined, wherein：
First acquisition unit, pending initial data is obtained for the data access interface by building in advance, wherein,
The data source of initial data is at least one；
Dispensing unit is defined, it is fixed for carrying out redefining configuration to initial data based on configuration information set in advance
Justice obtains target data, wherein, configuration information includes：Data dimension information and/or data target information；
Control unit, handled for control targe data according to predetermined flow chart of data processing, obtain data processing
As a result；
Display unit, for by calling the data display interface built in advance that data processed result is illustrated in into display circle
On face.
In embodiments of the present invention, pending initial data is obtained by the data access interface built in advance first；
Then, initial data is carried out based on configuration information set in advance redefining configuration, definition obtains target data；Connect down
Come, control targe data are handled according to predetermined flow chart of data processing, obtain data processed result；Finally, calling is passed through
Data processed result is illustrated on display interface by the data display interface built in advance.In embodiments of the present invention, original
On data/hardware foundation, few hardware resource is only put into, professional BI platforms (cost is high, strongly professional) need not built,
Avoid carrying out ETL process (hardware cost high), without customized development (when limit for length, input big) in the case of, it is quick realize it is more
The fusion displaying of dimension, multi-data source, eliminates information island, and by unified algorithm, Row control, can realize multi-data source
The purpose of the complicated analysis of data fusion, and then alleviate existing processing method cost when analyzing different data sources
Higher and relatively low treatment effeciency technical problem.
Alternatively, control unit is used for：Obtain pre-defined KPI calculation process；Control targe data calculate according to KPI
Flow is calculated, and obtains KPI result of calculations.
Alternatively, control unit is additionally operable to：Pre-defined data analysis flow is obtained, wherein, in data analysis flow
Including at least one data analysis node, each data analysis node is used to perform corresponding data analysis task；Control targe
Data perform data analysis task according to the data analysis node in data analysis flow, obtain data results.
Alternatively, device also includes：Second acquisition unit, in control targe data according in data analysis flow
Data analysis node performs data analysis task, after obtaining data results, obtains thematic information set in advance, special topic
Information is used to represent the different situations residing for data results；Analytic unit, for based on thematic information to data analysis knot
Fruit is analyzed again, obtains thematic data, wherein, thematic data is used to represent data results in the case of thematic information
Object information.
Alternatively, the first data acquisition system and the second data acquisition system are included in target data, initial data includes initial data
In the case of form, define dispensing unit and be used for：Data dimension information set in advance is obtained, and is based on data set in advance
Dimensional information is defined configuration to initial data form, obtains the first data acquisition system；And obtain data set in advance and refer to
Information is marked, and configuration is defined to initial data form based on data target information set in advance, obtains the second data set
Close.
Alternatively, initial data includes the data of following at least one type：Relevant database, the number of file format
According to from kafka data, from hadoop data.
In addition, in the description of the embodiment of the present invention, unless otherwise clearly defined and limited, term " installation ", " phase
Even ", " connection " should be interpreted broadly, for example, it may be being fixedly connected or being detachably connected, or be integrally connected；Can
To be mechanical connection or electrical connection；Can be joined directly together, can also be indirectly connected by intermediary, Ke Yishi
The connection of two element internals.For the ordinary skill in the art, with concrete condition above-mentioned term can be understood at this
Concrete meaning in invention.
In the description of the invention, it is necessary to explanation, term " " center ", " on ", " under ", "left", "right", " vertical ",
The orientation or position relationship of the instruction such as " level ", " interior ", " outer " be based on orientation shown in the drawings or position relationship, merely to
Be easy to the description present invention and simplify description, rather than instruction or imply signified device or element must have specific orientation,
With specific azimuth configuration and operation, therefore it is not considered as limiting the invention.In addition, term " first ", " second ",
" the 3rd " is only used for describing purpose, and it is not intended that instruction or hint relative importance.
A kind of analysis method of data of progress and the computer program product of device that the embodiment of the present invention is provided, including
Store the computer-readable recording medium of the executable non-volatile program code of processor, the finger that described program code includes
Order can be used for performing the method described in previous methods embodiment, and specific implementation can be found in embodiment of the method, will not be repeated here.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, can be with
Realize by another way.Device embodiment described above is only schematical, for example, the division of the unit,
Only a kind of division of logic function, can there is other dividing mode when actually realizing, in another example, multiple units or component can
To combine or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or beg for
The mutual coupling of opinion or direct-coupling or communication connection can be by some communication interfaces, device or unit it is indirect
Coupling or communication connection, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.
If the function is realized in the form of SFU software functional unit and is used as independent production marketing or in use, can be with
It is stored in the executable non-volatile computer read/write memory medium of a processor.Based on such understanding, the present invention
The part that is substantially contributed in other words to prior art of technical scheme or the part of the technical scheme can be with software
The form of product is embodied, and the computer software product is stored in a storage medium, including some instructions are causing
One computer equipment (can be personal computer, server, or network equipment etc.) performs each embodiment institute of the present invention
State all or part of step of method.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-
Only Memory), random access memory (RAM, Random AccessMemory), magnetic disc or CD etc. are various to deposit
Store up the medium of program code.
Finally it should be noted that：Embodiment described above, it is only the embodiment of the present invention, to illustrate the present invention
Technical scheme, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, it will be understood by those within the art that：Any one skilled in the art
The invention discloses technical scope in, it can still modify to the technical scheme described in previous embodiment or can be light
Change is readily conceivable that, or equivalent substitution is carried out to which part technical characteristic；And these modifications, change or replacement, do not make
The essence of appropriate technical solution departs from the spirit and scope of technical scheme of the embodiment of the present invention, should all cover the protection in the present invention
Within the scope of.Therefore, protection scope of the present invention described should be defined by scope of the claims.
Claims (10)
- A kind of 1. analysis method of data, it is characterised in that including：Pending initial data is obtained by the data access interface built in advance, wherein, the data of the initial data are come Source is at least one；The initial data is carried out based on configuration information set in advance to redefine configuration, definition obtains target data, its In, the configuration information includes：Data dimension information and/or data target information；Control the target data to be handled according to predetermined flow chart of data processing, obtain data processed result；By calling the data display interface built in advance that the data processed result is illustrated on display interface.
- 2. according to the method for claim 1, it is characterised in that control the target data according to predetermined data processing stream Cheng Jinhang processing, obtaining data processed result includes：Obtain pre-defined KPI calculation process；Control the target data to be calculated according to the KPI calculation process, obtain KPI result of calculations.
- 3. according to the method for claim 1, it is characterised in that control the target data according to predetermined data processing stream Cheng Jinhang processing, obtaining data processed result also includes：Pre-defined data analysis flow is obtained, wherein, the data analysis flow includes at least one data analysis section Point, each data analysis node are used to perform corresponding data analysis task；Control the target data to perform data analysis task according to the data analysis node in the data analysis flow, obtain Data results.
- 4. according to the method for claim 3, it is characterised in that controlling the target data according to the data analysis stream Data analysis node in journey performs data analysis task, and after obtaining data results, methods described also includes：Thematic information set in advance is obtained, the thematic information is used to represent not sympathizing with residing for the data results Condition；The data results are analyzed again based on the thematic information, obtain thematic data, wherein, the special topic Data are used to represent object information of the data results in the case of the thematic information.
- 5. according to the method for claim 1, it is characterised in that the target data includes the first data acquisition system and the second number According to set, the initial data includes raw data table lattice, and the initial data is carried out based on configuration information set in advance Redefining configuration includes：The data dimension information set in advance is obtained, and based on the data dimension information set in advance to described original Data form is defined configuration, obtains first data acquisition system；AndThe data target information set in advance is obtained, and based on the data target information set in advance to described original Data form is defined configuration, obtains second data acquisition system.
- 6. according to the method for claim 1, it is characterised in that the initial data includes the number of following at least one type According to：Relevant database, the data of file format, from kafka data, from hadoop data.
- A kind of 7. analytical equipment of data, it is characterised in that including：First acquisition unit, pending initial data is obtained for the data access interface by building in advance, wherein, it is described The data source of initial data is at least one；Dispensing unit is defined, it is fixed for carrying out redefining configuration to the initial data based on configuration information set in advance Justice obtains target data, wherein, the configuration information includes：Data dimension information and/or data target information；Control unit, for controlling the target data to be handled according to predetermined flow chart of data processing, obtain data processing As a result；Display unit, for by calling the data display interface built in advance that the data processed result is illustrated in into display circle On face.
- 8. device according to claim 7, it is characterised in that described control unit is used for：Obtain pre-defined KPI calculation process；Control the target data to be calculated according to the KPI calculation process, obtain KPI result of calculations.
- 9. device according to claim 7, it is characterised in that described control unit is additionally operable to：Pre-defined data analysis flow is obtained, wherein, the data analysis flow includes at least one data analysis section Point, each data analysis node are used to perform corresponding data analysis task；Control the target data to perform data analysis task according to the data analysis node in the data analysis flow, obtain Data results.
- 10. device according to claim 9, it is characterised in that described device also includes：Second acquisition unit, for controlling the target data to be held according to the data analysis node in the data analysis flow Row data analysis task, after obtaining data results, thematic information set in advance is obtained, the thematic information is used for table Show the different situations residing for the data results；Analytic unit, for being analyzed again the data results based on the thematic information, thematic data is obtained, Wherein, the thematic data is used to represent object information of the data results in the case of the thematic information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710674058.8A CN107451283A (en) | 2017-08-09 | 2017-08-09 | The analysis method and device of data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710674058.8A CN107451283A (en) | 2017-08-09 | 2017-08-09 | The analysis method and device of data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107451283A true CN107451283A (en) | 2017-12-08 |
Family
ID=60491329
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710674058.8A Pending CN107451283A (en) | 2017-08-09 | 2017-08-09 | The analysis method and device of data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107451283A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111611236A (en) * | 2020-05-28 | 2020-09-01 | 宁波和利时智能科技有限公司 | Data analysis method and system |
| CN113420009A (en) * | 2021-06-02 | 2021-09-21 | 军事科学院系统工程研究院网络信息研究所 | Electromagnetic data analysis device, system and method based on big data |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105528400A (en) * | 2015-12-02 | 2016-04-27 | 浪潮通用软件有限公司 | Web-based multidimensional analysis system and method |
| CN105653830A (en) * | 2014-10-21 | 2016-06-08 | 北京京航计算通讯研究所 | Data analysis method based on model driving |
| CN106682057A (en) * | 2016-07-21 | 2017-05-17 | 深圳奇迹智慧网络有限公司 | Multi-dimensional data visualization presentation method |
-
2017
- 2017-08-09 CN CN201710674058.8A patent/CN107451283A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105653830A (en) * | 2014-10-21 | 2016-06-08 | 北京京航计算通讯研究所 | Data analysis method based on model driving |
| CN105528400A (en) * | 2015-12-02 | 2016-04-27 | 浪潮通用软件有限公司 | Web-based multidimensional analysis system and method |
| CN106682057A (en) * | 2016-07-21 | 2017-05-17 | 深圳奇迹智慧网络有限公司 | Multi-dimensional data visualization presentation method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111611236A (en) * | 2020-05-28 | 2020-09-01 | 宁波和利时智能科技有限公司 | Data analysis method and system |
| CN113420009A (en) * | 2021-06-02 | 2021-09-21 | 军事科学院系统工程研究院网络信息研究所 | Electromagnetic data analysis device, system and method based on big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9773029B2 (en) | Generation of a data model | |
| CN112181960B (en) | Intelligent operation and maintenance framework system based on AIOps | |
| CN110334274A (en) | Information-pushing method, device, computer equipment and storage medium | |
| CN106874482A (en) | A kind of device and method of the patterned data prediction based on big data technology | |
| CN108876019A (en) | A kind of electro-load forecast method and system based on big data | |
| CN112580831B (en) | Intelligent auxiliary operation and maintenance method and system for power communication network based on knowledge graph | |
| CN108804630A (en) | A kind of big data intellectual analysis service system of Industry-oriented application | |
| CN113741883B (en) | RPA lightweight data middling station system | |
| CN101071412A (en) | Neural network analysis system and method based on self-definition model | |
| CN112163017B (en) | Knowledge mining system and method | |
| CN109582837A (en) | A kind of visualized data processing method based on cloud and system | |
| CN110414926A (en) | Account management method, device and computer readable storage medium | |
| CN106844669A (en) | Big data visual analyzing display frame construction method and visual analyzing display frame | |
| CN107451283A (en) | The analysis method and device of data | |
| US20080147587A1 (en) | Decision support system | |
| CN108427709A (en) | A kind of multi-source mass data processing system and method | |
| CN114662793A (en) | Business process remaining time prediction method and system based on interpretable hierarchical model | |
| CN110007905A (en) | A kind of generation method and system of the software development scheme based on big data | |
| CN102819616B (en) | Cloud online real-time multi-dimensional analysis system and method | |
| CN110389944B (en) | Metadata management system and method based on model | |
| CN117182910A (en) | Intelligent assembly robot assembly control method and control system | |
| CN107357919A (en) | User behaviors log inquiry system and method | |
| CN110222032A (en) | A kind of generalised event model based on software data analysis | |
| EP4113418B1 (en) | Non-linear planning model based production planning system, production planning method and computer-readable storage medium | |
| CN115035044A (en) | Be applied to intelligent AI platform of industry quality inspection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171208 |
|
| RJ01 | Rejection of invention patent application after publication |