CN102571403A - Realization method and device for general data quality control adapter - Google Patents
Realization method and device for general data quality control adapter Download PDFInfo
- Publication number
- CN102571403A CN102571403A CN2010106170525A CN201010617052A CN102571403A CN 102571403 A CN102571403 A CN 102571403A CN 2010106170525 A CN2010106170525 A CN 2010106170525A CN 201010617052 A CN201010617052 A CN 201010617052A CN 102571403 A CN102571403 A CN 102571403A
- Authority
- CN
- China
- Prior art keywords
- data
- rule
- setting
- adapter
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 92
- 238000003908 quality control method Methods 0.000 title abstract 3
- 238000012545 processing Methods 0.000 claims abstract description 27
- 238000007726 management method Methods 0.000 claims description 82
- 238000013515 script Methods 0.000 claims description 33
- 230000008569 process Effects 0.000 claims description 32
- 238000013523 data management Methods 0.000 claims description 28
- 238000004458 analytical method Methods 0.000 claims description 21
- 238000012544 monitoring process Methods 0.000 claims description 20
- 238000012795 verification Methods 0.000 claims description 19
- 238000012360 testing method Methods 0.000 claims description 15
- 238000004891 communication Methods 0.000 claims description 13
- 238000013507 mapping Methods 0.000 claims description 13
- 238000000605 extraction Methods 0.000 claims description 10
- 230000000694 effects Effects 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 7
- 238000012986 modification Methods 0.000 claims description 7
- 230000004048 modification Effects 0.000 claims description 7
- 101000746134 Homo sapiens DNA endonuclease RBBP8 Proteins 0.000 claims description 6
- 101000969031 Homo sapiens Nuclear protein 1 Proteins 0.000 claims description 6
- 102100021133 Nuclear protein 1 Human genes 0.000 claims description 6
- 208000037656 Respiratory Sounds Diseases 0.000 claims description 6
- 239000012141 concentrate Substances 0.000 claims description 6
- 206010037833 rales Diseases 0.000 claims description 6
- 238000012423 maintenance Methods 0.000 claims description 3
- 238000012956 testing procedure Methods 0.000 claims description 2
- 238000009960 carding Methods 0.000 abstract description 2
- 238000013499 data model Methods 0.000 description 15
- 239000012467 final product Substances 0.000 description 9
- 230000008859 change Effects 0.000 description 7
- 238000003745 diagnosis Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000003044 adaptive effect Effects 0.000 description 5
- 230000002776 aggregation Effects 0.000 description 5
- 238000004220 aggregation Methods 0.000 description 5
- 230000008676 import Effects 0.000 description 5
- 230000011664 signaling Effects 0.000 description 5
- 230000009466 transformation Effects 0.000 description 4
- 230000006978 adaptation Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000007689 inspection Methods 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000001131 transforming effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000007596 consolidation process Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009472 formulation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000011112 process operation Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000036962 time dependent Effects 0.000 description 1
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a realization method and a device for a general data quality control adapter. The realization method comprises the following steps of: extracting the service processing flow of the controlled service system and the attribute of the processed data to form an entity model set; listing the attribute of each model object in the entity model set and relevant operation for the model object and the data quality; establishing the association relationship between every two model objects according to the preset rule to form a dedicated control adapter of a certain system; and then accessing to a data quality control platform through a data quality standard open interface and realizing the data quality management of the system. According to the scheme provided by the invention, a set of general rule setting template is established by carrying out data quality model carding on different service system, so that the newly-accessed controlled service system is configured to realize the data quality adapter for the system, further the characteristics of the system can be utilized to the maximum extent, the upgrading reconstruction work is reduced to the maximum extent, the risk is reduced and the value is improved.
Description
Technical field
The present invention relates to technical field of data processing, particularly relate to a kind of implementation method and device of conventional data quality management and control adapter.
Background technology
Development along with telecommunication industry; The equipment of telecommunication administration is increasing; Need the corresponding data of management also increasing with exponential mode, data quality problem becomes increasingly conspicuous, and the user to the communication network quality require increasingly high; In this case, find that automatically network problem will be more and more important.
Be used to support the telecommunication supporting network data of telecommunication network management, from whether producing in each processing procedure of using complete and accurate, whether crucial index is unusual; Whether relate to the data of operator examination, in time report, exactly etc. all is to obtain the problem paid close attention to day by day.
Therefore; Press for a kind of quality of data managing and control system; Can carry out end-to-end processing procedure comprehensive monitoring to the data of operation system, find aspect problems such as data accuracy, integrality, promptness, validity automatically, and the data quality is carried out tap/dip deep into through several different methods such as statistical analysis, association, assessments; Find the question essence place of the quality of data, improve and lifting scheme thereby propose the quality of data.
Quality of data managing and control system comprises quality of data management and control platform and adapter two parts.Adapter is used to gather the data relevant with operation system, reports the management and control platform, thereby comprehensively all are reached the comprehensive monitoring to the end-to-end processing procedure of whole communication network by the data of managing and control system to the management and control platform.
In the available data quality managing and control system; To different by management and control operation system (like the voice service network management system, data service network management system, signaling detection system etc.); Need be according to the different quality of data management and control adapter of characteristics such as the framework of operation system, interface, agreement, operation flow configuration; Like this, for online operation system, have bigger upgrading cost; Secondly; Adapter possibly increase new function and carry out corresponding transformation along with the operation system upgrading; If have influence on the operation system interface section when transforming, just need all transform meeting traffic affecting stability to operation system interface and quality of data managing and control system platform; The transformation cycle is long, cost is big, the also bad assessment of the benefit of generation; The 3rd, existing adapter often need depend on each operation system and provide, and transformation amount and complexity differ, so adaptable interface formulation process complicacy is very long, forms the situation that each side compromises probably at last, causes interface requirement not reach the consequence of expectation; And each operation system is transformed the cycle, cost differs, and causes the assessment of project input to lack accurate, quantitative criteria.Given this, just need conventional data quality management and control adapter a kind of unification, that adapt to all operation systems.
Summary of the invention
Technical problem to be solved by this invention provides a kind of implementation method of conventional data quality management and control adapter, can be adapted to variously by the management and control operation system, solves the problem that prior art does not have unified conventional data quality management and control adapter.
The present invention also provides a kind of automatic implement device of conventional data quality management and control adapter, to guarantee the application of said method in reality.
In order to address the above problem, the invention discloses a kind of implementation method of conventional data quality management and control adapter, comprising: extract the attribute that is possessed by the business processing flow of management and control operation system and handled data, form the physical model collection; List said physical model and concentrate type, value range and the input mode of all properties of each model object, and, to input parameter, handling process and the output parameter of the relevant operation of this model object with the quality of data; Rule by preset is set up the incidence relation between the said model object, generates conventional data quality management and control adapter.Said then adapter inserts quality of data management and control platform through the quality of data open interface of standard.
Preferably; The said method of setting up the incidence relation between the said model object by preset rule is specially: adopt rule template to set up mode: in preset rule template by the attribute and the associative operation thereof of each model object of input/output sequence typing between the said model object; All incidence relations of disposable importing are verified every complete rule then; Or adopt customization guide to set up mode: according to the attribute and the associative operation thereof of the said model object of rules customization guide typing, treat that every complete rule checking is passed through after, carry out the setting of next bar rule again.
Preferably, also comprise the new regulation foundation step: the service conditions of confirming effect, rale store mode, regular Run Script and the rule script of attribute field that rule name, parameter of regularity, the rule of new regulation possess, rule.
Preferably, also comprise quality of data management and control adaptable interface testing procedure: test said conventional data quality management and control adapter with by the situation that is connected of management and control operation system, and, carry out various information interactions by above-mentioned incidence relation, judge the correctness of output information.
Preferably, also comprise intelligent assistant: if regular authentication failed, then intelligent assistant can be according to regular keyword automatically from empirical data library searching concrete reason and solution, and provides the incidence relation editing interface to make amendment.
Preferably, intelligent assistant can write down said incidence relation setting up procedure automatically in experience database; Or, increase or modification empirical data library information, comprise keyword, keyword explanation and intelligent prompt content.
Preferably, also comprise: the configuration information of said adapter is backed up to predeterminated position; Or the backup information of preserving according to said predeterminated position recovers said adapter.
Preferably; Said preset rule comprises interface mode setting, the setting of data source obtain manner, information analysis rule, the setting of system monitoring point, the incidence relation of control point and the verification content of each control point, and wherein: said interface mode setting comprises selects communication protocol, interface type, COM1 and IP address; The setting of said data source obtain manner comprises the unique identification that disposes respective data sources; Said information analysis rule comprises message format and the data map relation of the concrete data object of each type at said quality of data management and control platform; Information type and concrete executive mode that the setting of said system monitoring point comprises the control point title, acts on, possesses; The incidence relation of said control point is confirmed through the input/output relation or the orbution of the data processing between the initialization system control point; The verification content of said each control point comprises integrality, accuracy, the promptness of data, the algorithmic formula of coincident indicator; If contain field in the above-mentioned algorithmic formula, then need in said data source, add corresponding data object and in said information analysis rule, set up mapping relations without mapping.
According to another preferred embodiment of the present invention; A kind of implement device of conventional data quality management and control adapter is also disclosed; Comprise that physical model extraction unit, physical model are set up the unit and adapter is set up the unit; Wherein: said physical model extraction unit is used to extract the attribute that is possessed by the business processing flow of management and control operation system and handled data, forms the physical model collection; Said physical model is set up the unit and is used for the physical model collection of said physical model extraction unit generation is specialized; List said physical model and concentrate type, value range and the input mode of all properties of each model object; And; To this model object and quality of data associative operation, comprise input parameter, handling process and the output parameter of this operation; Said universal adapter is set up the unit and is used for setting up said physical model by preset rule and sets up the incidence relation between the model object of listing the unit, forms to adapt to by the quality of data management and control adapter of management and control operation system.
Preferably, comprise that also new regulation creates the unit, be used for confirming the service conditions of effect, rale store mode, regular Run Script and the rule script of attribute field that rule name, parameter of regularity, the rule of new regulation possess, rule.
Preferably; Also comprise the adapter test cell, be used to test said conventional data quality management and control adapter with by the situation that is connected of management and control operation system, and; Set up the incidence relation of setting up the unit by said universal adapter and carry out information interaction, judge the correctness of output information.
Preferably, also comprise intelligent assistant unit, be used to judge that universal adapter sets up the whether success of rule checking of unit, if not,, make amendment for the user provides the incidence relation editing interface then from intelligent helper data library searching concrete reason and solution.
Preferably, also comprise the experience database maintenance unit,, write down said universal adapter automatically and set up the process that the unit is provided with incidence relation through intelligent assistant; Increase or modification empirical data library information, comprise keyword, keyword combination, operation or the problem interpretation that occurs, solution, example.
Preferably, also comprise the data backup restoration unit, be used for the configuration information of said conventional data quality management and control adapter is backed up to predeterminated position; And the backup information of preserving according to said predeterminated position recovers said conventional data quality management and control adapter arrangement file and experience database.
Preferably; Said universal adapter is set up the unit and is comprised that specifically template is set up subelement and/or guide is set up subelement; Wherein: said template is set up subelement and is used to the user and provides incidence relation to set up template; Make user's attribute and associative operation thereof by each model object of input/output sequence typing in preset rule template, all incidence relations of disposable importing are verified every complete rule then; Said guide is set up subelement and is used to the user and provides incidence relation to set up guide, makes attribute and the associative operation thereof of user according to the said model object of rules customization guide typing, treat that every complete rule checking is passed through after, carry out the setting of next bar rule again.
Preferably; Also comprise rules customization guide unit; Be used for interface mode setting, the setting of data source obtain manner, the setting of information analysis rule, the setting of system monitoring point, the incidence relation setting of control point and the verification content setting of each control point, wherein: said interface mode setting comprises selects communication protocol, interface type, COM1 and IP address; The setting of said data source obtain manner comprises the unique identification that disposes respective data sources; Said information analysis rule is provided with content and comprises message format and the data map relation of the concrete data object of each type at said quality of data management and control platform; Said system monitoring point is provided with information type and the concrete executive mode that content comprises the control point title, acts on, possesses; The incidence relation setting of said control point comprises the input/output relation or the orbution of the data processing between the initialization system control point; The verification content setting of said each control point comprises integrality, accuracy, the promptness of data, the computing formula of coincident indicator; If contain field in the above-mentioned algorithmic formula, then need in said data source, add corresponding data object and in said information analysis rule, set up mapping relations without mapping.
Compared with prior art, the present invention has the following advantages:
The preferred embodiment of the present invention is through carrying out the combing of quality of data model to different business systems; Set up the general setting rule of a cover; What make new access can be realized the quality of data adapter to this system by the management and control operation system through configuration; Through quality of data standard open interface, insert quality of data management and control platform then, realize the quality of data management and control of this operation system; Embodiment of the invention scheme is utilized system's self character to greatest extent, at utmost reduces upgrading work, reduces risk, promotes to be worth; In further preferred embodiment, also to support to a certain degree to become privileged and handle, promptly newly-increased Rulemaking and custom script move, and have greatly expanded adaptive scope especially.
Based on preferred embodiment of the present invention scheme, after the upgrading of management and control operation system, only need suitably revise getting final product to this system convention inventory, do not need adaptable interface transformation.
In the further preferred embodiment of the present invention,, plug-in type new regulation adaptive through wizard-like rule customization and intelligent combined authentication are easily understood the rule configuration, and proving correctness at any time; Can onlinely answer the problem of the appearance in user policy customization and the proof procedure at any time through intelligent assistant, can drive adapter select and related correlation module automatically, have very big adaptability and versatility through intelligent memory; In addition, experience database can constantly replenish knowledge through the user, thereby makes intelligent assistant have more powerful support function, makes the adaptive intelligent evolution of carrying out voluntarily, can further improve the adaptation ability to different business systems.
Description of drawings
Fig. 1 is the implementation method first embodiment flow chart of conventional data quality management and control adapter of the present invention;
Fig. 2 is the implementation method second embodiment flow chart of conventional data quality management and control adapter of the present invention;
Fig. 3-the 1st, the rule of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention imports the template sketch map;
Fig. 3-the 2nd, the interface of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention and data source are selected the guide sketch map;
Fig. 3-the 3rd, the resolution rules of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention is provided with the guide sketch map;
Fig. 3-the 4th, the control point of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention and incidence relation thereof are selected the guide sketch map;
Fig. 3-the 5th, the control point of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention is verified content the guide sketch map is set;
Fig. 3-the 6th, " connected mode rule " checking guide sketch map of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention;
Fig. 3-the 7th, the new regulation of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention is created the guide sketch map;
Fig. 3-the 8th, the experience storehouse typing guide sketch map of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention;
Fig. 3-the 9th, the data backup of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention is provided with the interface sketch map;
Fig. 3-the 10th, the data restore operation interface sketch map of the implementation method specific embodiment of conventional data quality management and control adapter of the present invention;
Fig. 4 is the structured flowchart of implement device one embodiment of conventional data quality management and control adapter of the present invention.
Embodiment
For make above-mentioned purpose of the present invention, feature and advantage can be more obviously understandable, below in conjunction with accompanying drawing and embodiment the present invention done further detailed explanation.
With reference to Fig. 1, show the flow process of implementation method first embodiment of conventional data quality management and control adapter of the present invention, specifically may further comprise the steps:
Step S101: extract the attribute that is possessed by the business processing flow of management and control operation system and handled data, form the physical model collection;
Corresponding to the business processing flow of operation system, analyze the attribute that possesses, set up the business diagnosis model; Corresponding to the data of the processing of operation system, analyze the attribute that possesses, set up data model.
Step S102: list said physical model and concentrate all properties of each model object and the operation relevant of this model object with the quality of data;
Wherein, the attribute of each model object comprises type, value range and the input mode of attribute; The operation relevant with the quality of data of this model object comprises input parameter, handling process and output parameter;
Step S103: the rule by preset is set up the incidence relation between the said model object, generates quality of data management and control adapter.
After adapter generated, the configuration information that adapter connects according to communication automatically connected by the management and control operation system, simultaneously through quality of data standard open interface, inserted quality of data management and control platform, realized this by the instant quality of data management and control of management and control operation system.
Present embodiment is based on by the data model of management and control operation system and business diagnosis modelling conventional data quality management and control adapter; Can be adapted to various by the management and control operation system; Solving prior art does not have the problem of unified conventional data quality management and control adapter; Under a cover interface, a kind of operator scheme, can become streamline production to the adaptive work that different system is carried out.
Above-mentionedly set up the incidence relation between the model object, can adopt rule template to set up mode, also can adopt customization guide to set up mode by preset rule, wherein:
Rule template is set up mode and specifically comprised: in preset rule template, press the attribute and the associative operation thereof of each model object of input/output sequence typing between the model object, all incidence relations of disposable importing are verified every complete rule then;
Customization guide is set up mode and is specifically comprised: according to the attribute and the associative operation thereof of each model object of rules customization guide typing, treat that every complete rule checking is passed through after, carry out the setting of next bar rule again.
The new regulation foundation step that comprises in the further preferred embodiment of the present invention comprises the service conditions etc. of effect, rale store mode, regular Run Script and the rule script of attribute field that rule name, parameter of regularity, the rule of confirming new regulation possess, rule; Can be unknown new system, particularly have the system of becoming privileged requirement that Run Script is provided, therefore, have stronger row expanded and applicability.
In the further preferred embodiment of present embodiment; Also comprise the step that conventional data quality management and control adapter is tested: test this conventional data quality management and control adapter with by the situation that is connected of management and control operation system; And, carry out information interaction and judge the correctness of output information by above-mentioned incidence relation.
In the above-mentioned incidence relation process of setting up between the model object; If regular authentication failed; Then the on-line intelligence assistant automatically from information such as empirical data library searching concrete reason, solution, concrete examples, and provides the incidence relation editing interface to make amendment according to regular keyword.In addition; In the above-mentioned incidence relation process of setting up between the model object; System is record incidence relation setting up procedure in experience database automatically, or the interface of increase, modification intelligent data library information (comprising keyword, keyword combination, keyword explanation and intelligent prompt content) is provided; Based on the intelligent assistant that this experience database engine provides, can be the user and in the rules customization process, offer help at any time, when system goes wrong, the analysis of causes and correction way are provided; Through the continuous accumulation of experience database, can be the user more help and promptings of working out about system convention are provided, also can accumulate the requirement source of transforming as system upgrade; Aspect deployment, the various rule configurations of certain system are changed more new capital and are remembered warehouse-in or file automatically, when disposing new engine, only need with Ku Biaonei perhaps configuration file duplicate and get final product, do not need to be configured once more.
In addition, also can the configuration information of the adapter of this system be dumped to place of safety, cause system crash when breaking down after, refitting system, and provide intelligent prompt to recover related data.
Because of the present embodiment scheme can be adapted to various by the management and control operation system; One cover system can be that numerous operation systems generate different adaptable interfaces according to rule just; Adapter upgrade generally only needs some rule change or increases to get final product; Therefore, in the implementation process, insert the new needed cycle of operation system short, cost is low, risk is little, instant effect.Particularly the adapter upgrade direction is clear and definite, has from the adaptive model of unification that improves ability, and different business systems is merged rapidly, can avoid a large amount of negotiation, cooperatings, and can avoid a large amount of duplications of labour and useless work, and the efficiency of management is improved.
With reference to Fig. 2; Show the flow process of implementation method second embodiment of conventional data quality management and control adapter of the present invention; In this preferred embodiment; Is that example describes by the management and control operation system with certain communication traffic data acquisition system, soon is abstracted into business model and data model by the operation system of management and control according to preset rule.Its business model is by the operation flow of managing and control system, and operation flow comprises in data acquisition system: be connected to by acquisition target, whether the judgment data source is ready to; Gather, resolve, calculate or conversion; Steps such as warehouse-in, when setting up model, each step is conceptualized as several attributes that business model comprises; Obtain each attribute information and be exactly its associative operation method of operation of each step (promptly to); The needed message structure of attribute information, corresponding field implication, and the required processing of carrying out.Its data model is the content of data acquisition; Comprise performance and resource data; The attribute that these data all have comprises professional type (traffic, transmission, rotating ring, data, signaling detection etc.), affiliated data Layer (data source layer; Acquisition layer; Gather layer etc.), data type (performance, resource, alarm, knowledge, group are single etc.), NE type (omc, bsc, msc etc.), time (granularity), geography, index (cutting off rate etc.) etc., concrete method comprises check data integrity, accuracy, promptness, traceability etc.Therefore the quality of data is regular; Be business model and the data model object-instantiated in the system; Be model and give actual value; Comprise and set up rule name (like rule: layer performance data omc city, unified image data source is the quality of data management and control of explanation to the performance data of certain omc network element data source, city layer in the unified acquisition system), regular attribute (the various dimensions of time, type, parameter, information field form etc.), regular associative operation (method of operation name, input, output, processing etc.).The implementation method flow process of this quality of data management and control adaptable interface specifically comprises:
Step S201:, form the physical model set to being carried out the model combing by the business diagnosis model of management and control operation system and data model;
The model carding process specifically comprises: at first choose the operation system that will insert; The attribute that acquisition physical model object possesses and the set of method are refined in data model (business characteristic of data and the attribute that possesses) two aspects to its business diagnosis model (the key point order and the content of business processing flow) and processing.
The promptly preset rule of the business diagnosis model of this communication service data acquisition system and data model comprises the verification content of interface protocol setting, the setting of data source obtain manner, information analysis rule, the crucial processing links-setting of system monitoring point, the incidence relation of control point (ordinal relation, operation relation etc.) and each control point etc., wherein:
The interface mode agreement is set and is comprised: select communication protocol and interface type, and like data flow, file, database etc., and, concrete COM1, the needed information of correct connection such as IP address;
The data source obtain manner is set and comprised: how with the original Various types of data of unique identification difference, the unique identification form of configuration data file obtains corresponding data source according to the unique identification form that disposes;
The information analysis rule; To the resolution rules of the concrete data object of each type, distinguish with unique identification, be kept in the system with the xml document form; Comprise how original Various types of data being resolved with unique identification difference (like information type); Form consolidation form, send to quality of data management and control platform, the information analysis rule itself need be according to the data object attribute human configuration field mappings of practical application; The message format of data source in quality of data managing and control system that promptly obtains makes that the message format in the data source is consistent with the message format in the quality of data managing and control system;
The setting of crucial processing links-system monitoring point that system had comprises monitors the information type of calling the roll, acting on, possess, concrete executive mode etc.;
The incidence relation of control point is through the input/output relation of the data processing between the initialization system control point, and perhaps orbution is confirmed;
The verification content of each control point support comprises: the algorithmic formula of integrality, accuracy (reasonability), promptness, consistency indexs such as (fluctuations); Algorithmic formula can be carried out human configuration by managing and control system to data integrality, accuracy, promptness, conforming check method according to different, and each sub-entry in the formula all is in the sets of fields after the mapping of information analysis rule.If contain field in the formula, need in data source, add corresponding data object and shine upon in the information analysis rule without mapping.
Step S202:, list all properties of each model object and the operation relevant with the quality of data (comprising checking integrality, accuracy etc.) to this model object to above-mentioned physical model aggregation physics and chemistry (be about to above-mentioned physical model and be output as XML file or extended formatting);
With the physical model collection physicsization that step S201 refines, list attribute type, value range and the input mode of each model object; The operation relevant with the quality of data comprises input parameter, handling process, output parameter (or return value type) etc. to this model object.
Step S203: judge that above-mentioned model object needs new regulation? If change step S204; Otherwise, change step S205;
When being upgraded by managing and control system or transforming, if data model and business model change, then need on original model basis, carry out combing once more, do corresponding modification.
Step S204: the service conditions of creating new regulation and rule script;
Possibly there is the not enough situation of existing rule in this preferred embodiment scheme to unknown system, and promptly monitored operation system possibly exist some to become privileged regular part; This preferred embodiment provides newly-increased regular setting scheme; Become privileged script (need at page typing script name, script operating path, parameter, script function etc.) through operation, generate the function of the special demands of some system; This particularization script needs secondary development, inserts existing universal adapter as plug-in unit.
Above-mentioned newly-increased regular setting scheme is specially: provide one to become privileged script runnable interface (rule-making interface) through the interface; Interface property comprises rule name, regular implication; Rule fill order and parameter (promptly becoming privileged script); The script operation generates the rules results form that requires; The script runnable interface provides script classification, dissimilar scripts (such as data source, information type, control point information or newly-increased rule etc.) the demands of different form is arranged, after the generation also as the part of this adaptable interface.
Step S205: according to Rule Wizard or in rule template the attribute and the associative operation thereof of typing model object, and every complete rule verified;
This preferred embodiment scheme provides dual mode generation system proprietary adapters: a kind of quality of data rule that provides imports template; The physical model that forms among the step S202 is required entry information according to rule template; With the disposable importing of rule, then every complete rule is verified, if authentication failed; The intelligence assistant can provide concrete reason and solution, and provides the rule editing interface to improve;
The another kind of wizard-like rules customization page that provides according to intelligent adaptation, the user fills in step by step, and complete rule of the every completion of this process just can be checked, and after checking is passed through, carries out the setting up procedure of next rule again.
In addition, in above-mentioned proprietary adapters production process, system records the details of generative process in the experience database automatically, as the reference of later adaptable interface upgrading.
Step S206: judge whether above-mentioned rule checking successful? If change step S208; Otherwise, change step S207;
Step S207: revise the correlation model object according to intelligent assistant's prompting, carry out rule checking after, commentaries on classics step S206;
Step S208: test data quality management and control adapter with by the situation that is connected of management and control operation system, and judge correctness by above-mentioned incidence relation interactive information;
The principle that test realizes is exactly this adaptable interface with actual by being connected of management and control operation system, and sets according to rule and to carry out information interaction, obtains feedback result and shows, system is correctly or mistake according to rule based judgment then.
Step S209: the configuration information of quality of data management and control adaptable interface is backed up to predeterminated position;
In this preferred embodiment scheme; All adaptation datas regularly unloading are file; Backup to other places of safety, in case system crash or database collapse take place to cause unusually, then reinstall native system next time after; Intelligence assistant meeting prompting automatically recovers relevant setting, and the path that the user selects to back up gets final product.
In addition; The user utilizes such scheme to carry out in the rule-making process; If perhaps its associative operation (method) is when having problem to attribute, (according to the diverse location keyword of Different Rule page or leaf, perhaps key combination carries out association) can ask for help to intelligent assistant; Can also different themes be described through keyword or keyword combination.For the mistake that occurs in default and the test, intelligent assistant perhaps numbers to provide according to wrong keyword and explains and the correction way.As, after having set, each rule all supports to test, and the interface provides " test " button, can accomplish test, if concrete failure result is returned in failure.As connection failure, data source obtain failure, resolve failure, control point information is obtained failure, the script operation is failed etc.If the user is not satisfied to intelligent assistant's help, can be with good solution, example or the typing experience database of improving one's methods, thus make intelligent assistant can provide better help.Above-mentioned entry information must be undertaken by preset step and form, comprises selecting information classification, selecting perhaps module name of related rule, and the help purport that selection will provide (answer questions, example, solution) is then according to the above-mentioned information of typing form typing.
In this preferred embodiment, intelligent assistant's information content comprises that keyword, keyword are explained, information such as problem is promised, solution, illustrative example.
After all customization work were accomplished, system just carried out assembly working automatically, the functions of modules that generation unified interface mode and message interchange format are connected with quality of data management and control platform.After the complete adapter through checking generates; All configuration informations solidify storage automatically, when disposing new equipment, and only need be through the long-range designated equipment catalogue that sends to of the bag that the interface will generate; Start operation and get final product (because regular inventory has write configuration, program reads configuration and gets final product).
Below, to certain communication traffic data acquisition system, specify the implementation procedure of quality of data management and control adapter of the present invention:
At first, to monitored operation system, promptly the business diagnosis model of this data acquisition system and data model carry out the model combing, form the physical model set.
The business model of monitored operation system comprises performance data collection flow process and resource data acquisition flow process, wherein:
The performance data collection flow process comprises that from front to back acquisition phase, aggregation stages and calculating are present stage; For the file type data source, acquisition phase comprises obtains key points such as performance file, resolution file, initial data warehouse-in, data computation from OMC; For the data source of database type, acquisition phase comprises that reading initial data from the OMC database writes key points such as acquisition database, data computation; Aggregation stages comprises key points such as net synchronization capability storehouse, framework gather, business hours geography gathers;
The resource data acquisition flow process comprises acquisition phase, aggregation stages from front to back; For the file type data source, acquisition phase comprise from OMC obtain resource file, resolution file, initial data warehouse-in, data computation writes key points such as resources bank; For the data source of database type, acquisition phase comprises and reads from the OMC database that initial data writes acquisition database, data computation writes key points such as resources bank; Aggregation stages comprises the net synchronization capability storehouse, the key points such as association to performance is provided.
Control point to above-mentioned operation flow comprises each stage and key point thereof, and monitor control index requires referring to table 1 with examination.
Monitor control index of table 1, monitored operation system (KPI) and examination requirement
The data model of monitored operation system comprises that by the professional type webmaster of managing and control system name, access, the data Layer that possesses, the data type that possesses, geography dimensionality, NE type dimension, index dimension, manufacturer's dimension, time dimension, verification dimension, monitoring dimension and self-defined dimension the data type of data model and corresponding objectification thereof are described referring to table 2.
The data type of the data model of table 2, monitored operation system and corresponding objectification thereof are described
Secondly, with above-mentioned physical model physicsization, be about to above-mentioned business model and data model object-instantiated.
Complete data flow represents and comprises that one group of management and control point set that strict orbution arranged, management and control point comprise and verify task definition, verify content acquisition, verify task management, verify the result and present, verify key elements such as results abnormity notice; Verification object comprises storage mode, data pick-up condition, verifies attribute, verification cycle, access mode etc.; The verification object attribute comprises that professional dimension (traffic, data, transmission, dynamic environment, signaling detection etc.), data dimension (resource, performance, alarm, parameter etc.), data analysis layer dimension (data source layer, acquisition layer, computation layer, gather layer, form layer, portion economize interface and report layer), data check function dimension (integrality, reasonability, consistency, promptness, traceability), Mission Monitor dimension (data processing process, finger daemon, flow direction monitoring), control point order (progressively consume according to produce data from data; Order is divided into 1; 2; 3,4...), verify and the condition dimension (geography, manufacturer, NE type, OMC, time, table, index) of monitoring and relevant detaileds description (interface mode, interface message description, this some business act on etc.).
Then, import the attribute and the associative operation thereof of template typing model object, and every complete rule is verified according to Rule Wizard or rule, wherein:
Import template way for rule, shown in Fig. 3-1, can select " telephone traffic network system-acquisition layer " item wherein, import corresponding rule, accomplish the implementation procedure of conventional data quality management and control adapter.
For the Rule Wizard mode; Its process mainly comprises interface and data source selection (shown in Fig. 3-2); Resolution rules is provided with (shown in Fig. 3-3), and control point and incidence relation selection (shown in Fig. 3-4) thereof, and content setting (shown in Fig. 3-5) etc. is verified in the control point;
The operation system information that above-mentioned resolution rules comprises, verification result, monitored results, measurement scheme and verification threshold value etc. are referring to table 3.
The XML message structure of table 3, certain communication traffic system
The XML file example is following:
<?xml?version＝′1.0′encoding＝′GB2312′?>
<dqmcp>
<besystem>1</besysem>
<msg_type>1110</msg_type>
<unique_id>0</unique_id>
<major_version>5</major_version>
<minor_version>20</minor_version>
<send_time>2010-06-0908:03:51</send_time>
<profession_id>1</profession_id>
<sub_professionid>1</sub_professionid>
<datalayer_id>1</datalayer_id>
<datatype_id>1</datatype_id>
<scan_start_time>2010-12-0906:00:00</scan_start_time>
<scan_stop_time>2010-12-0907:00:00</scan_stop_time>
<netype_id>100</netype_id>
<omc_id>44011(nokia4401omc_4401)</omc_id>
<checkoption_id>1</checkoption_id>
<table>op_eri_ios</table>
<vendor_id>1</vendor_id>
<version>V1.0</version>
<result></result>
<force_flag>1</force_flag>
</dqmcp>
The verification content (KPI) that each control point is supported is explained as follows:
Integrality: comprise attribute field integrality, related integrality (performance configuration data consistency) in the integrality of record strip number, every the record; Writing down quantity complete is to verify resource whether normally to collect the network management data storehouse; With in the database historical data as reference point relatively; Require data consistent with reference point on the order of magnitude, allow fluctuation quantity scope N% (N% can establish, and need divide be arranged) according to NE type; The attribute field integrality is meant that the determinant attribute of network element can not be sky; Should also there be the integrality requirement of content field in bar number and the signaling for signaling; Related integrality is meant that certain type of data and such data that are associated together compare; Be as the criterion with a kind of data type wherein and judge whether another kind of data record is complete (like through performance data and resource data contrast in the traffic net; Find differences; Can with the resource data reference, the integrality of inspection performance data).
Accuracy (reasonability): the achievement data setting threshold, according to the threshold value judgement of crossing the border.
Promptness: guaranteeing that data integrity is processed under the requirement, show each link processing time, computing time is poor; It is 100% that the ratio that native system requires complete data times to be no more than threshold value is promptly prepared promptness rate.
Consistency (fluctuation): main index is according to time dependent trend; With historical variations trend whether consistent (quantity rank); The fluctuation of mainly comparing with the historical reference point data of setting through the data of verifying time point, and set corresponding fluctuation threshold values, with the inspection unusual fluctuations.
Traceability: the index that examine exists index algorithmic formula and corresponding base values data to get final product;
Data task monitoring: monitor data job name, treatment conditions,, initial, the concluding time of task, the present situation is if failure will provide the failure concrete reason;
Resident process monitoring: process name, start-up time, current state, resource occupation are (like CPU; Occupation condition such as internal memory), process effect; The user clicks and to check that details can specifically check the log information of process operation, if unusual, unusual concrete reason is provided.
For the rule checking, can whether correct through " beginning self check " button inspection rule setting of user interface, if incorrect, provide error reason.With reference to Fig. 3-6, show the sketch map of this specific embodiment " connected mode rule ".
In the implementation procedure of above-mentioned quality of data management and control adapter; If there is special part in this system; Then can provide one to become privileged script runnable interface (rule-making interface) through the interface shown in Fig. 3-7; Its attribute comprises rule name, regular implication, and rule is carried out row and parameter (promptly becoming privileged script).Script operation generates the rules results form that requires, and the script runnable interface provides the script classification, dissimilar scripts (such as data source, information type, control point information or newly-increased rule etc.) the demands of different form arranged.
In above-mentioned regular assignment procedure, if run into query, perhaps go wrong, can directly ask for help to intelligent assistant, intelligent assistant can provide example or advise solution; If the user is not satisfied to above-mentioned help, can be through after system be investigated, with good solution, example or the typing experience storehouse engine of improving one's methods, when others used so later on, intelligent assistant just can provide better help.Shown in Fig. 3-8, in the typing process in experience storehouse, can select a series of keywords; Write problem phenomenon, solution then, recommendation on improvement etc., afterwards; The intelligence assistant just can obtain corresponding information exhibition and give the user according to these keywords or its combination automatically from the experience storehouse.Wherein, above-mentioned serial keyword comprises by managing and control system name, professional webmaster, data Layer, data type or the like; The information content needs form typing on request, comprises selecting information classification, selecting not according to then related rule or module name, and the help purport that selection will provide (answer questions, example, solution) is then according to the specific format typing.
In addition, this preferred embodiment also provides data backup/restore funcitons, can regularly data conversion storage be arrived place of safety; The collapse in case break down; As situation such as place equipment collapse, database collapse appear, then reinstall native system after, intelligent assistant can point out and recover; The user only need formulate the problem of unloading, and system is recovered automatically.For data backup, shown in Fig. 3-9, can select to back up zero-time, by managing and control system, the content that back up, information such as the time interval of backup, system automated back-up information at regular intervals arrive assigned address; Recover for data, opposite with above-mentioned steps, shown in Fig. 3-10, select the time period of backup and by managing and control system, system just can arrive assigned address and obtain information and recover.
For aforesaid each method embodiment; Simple in order to describe; So it all is expressed as a series of combination of actions, but those skilled in the art should know that the present invention does not receive the restriction of described sequence of movement; Because according to the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art should know that also said method embodiment all belongs to preferred embodiment, and related action and module might not be that the present invention is necessary.
With reference to Fig. 4, show the structured flowchart of implement device one embodiment of conventional data quality management and control adapter of the present invention, comprise that specifically physical model extraction unit 41, physical model are set up unit 42 and adapter is set up unit 43, wherein:
Physical model extraction unit 41 is used to extract the attribute that is possessed by the business processing flow of management and control operation system and handled data, forms the physical model collection;
Physical model is set up unit 42 and is used for the physical model collection that said physical model extraction unit 41 generates is specialized; List said physical model and concentrate type, value range and the input mode of all properties of each model object; And, input parameter, handling process and the output parameter relevant of this model object with operation;
Adapter is set up unit 43 and is used for setting up physical model by preset rule and sets up the incidence relation between the model object of listing unit 42, forms quality of data management and control adapter.
Above-mentioned adapter is set up unit 43 and is comprised that specifically template is set up subelement 43-1 and guide is set up subelement 43-2; Template is set up subelement 43-1 and is used to the user and provides incidence relation to set up template; Make user's attribute and associative operation thereof by each model object of input/output sequence typing between the model object in preset rule template; All incidence relations of disposable importing are verified every complete rule then; Guide is set up subelement 43-2 and is used to the user and provides incidence relation to set up guide, makes attribute and the associative operation thereof of user according to the said model object of rules customization guide typing, treat that every complete rule checking is passed through after, carry out the setting of next bar rule again.
In the further preferred embodiment of present embodiment, also comprise:
New regulation is created unit 44: the service conditions that is used for confirming effect, rale store mode, regular Run Script and the rule script of attribute field that rule name, parameter of regularity, the rule of new regulation possess, rule;
Adaptable interface test cell 45: be used for test all-purpose quality of data management and control adapter with by the situation that is connected of management and control operation system, and, set up the incidence relation of setting up unit 43 by adapter and carry out information interaction, judge the correctness of output information;
Intelligence assistant unit 46: be used to judge that adapter sets up the whether success of rule checking of unit 43, if not,, make amendment for the user provides the incidence relation editing interface then from empirical data library searching concrete reason, solution and example;
Experience database maintenance unit 47:, write down adapter automatically and set up the process that unit 43 is provided with incidence relation through intelligent assistant unit 46; And, increase or modification empirical data library information, comprise keyword, keyword combination, operation or the problem interpretation that occurs, solution, contents such as example;
Data backup restoration unit 48: be used for the configuration information of quality of data management and control adapter is backed up to predeterminated position; And the backup information of preserving according to predeterminated position recovers said quality of data management and control adapter;
Rules customization guide unit 49 is used for interface mode setting, the setting of data source obtain manner, the setting of information analysis rule, the setting of system monitoring point, the incidence relation setting of control point and the verification content setting of each control point, wherein:
The interface mode setting comprises selects communication protocol, interface type, COM1 and IP address;
The setting of data source obtain manner comprises the unique identification that disposes respective data sources;
The information analysis rule is provided with content and comprises message format and the data map relation of the concrete data object of each type at said quality of data management and control platform;
The system monitoring point is provided with information type and the concrete executive mode that content comprises the control point title, acts on, possesses;
The incidence relation setting of control point comprises the input/output relation or the orbution of the data processing between the initialization system control point;
The verification content setting of each control point comprises integrality, accuracy, the promptness of data, the computing formula of coincident indicator; If contain field in the above-mentioned algorithmic formula, then need in said data source, add corresponding data object and in said information analysis rule, set up mapping relations without mapping.
Need to prove that said apparatus embodiment belongs to preferred embodiment, related unit and module might not be that the present invention is necessary.
Each embodiment in this specification all adopts the mode of going forward one by one to describe, and what each embodiment stressed all is and the difference of other embodiment that identical similar part is mutually referring to getting final product between each embodiment.For device embodiment of the present invention, because it is similar basically with method embodiment, so description is fairly simple, relevant part gets final product referring to the part explanation of method embodiment.
More than the implementation method and the device of a kind of conventional data quality management and control adapter provided by the present invention carried out detailed introduction; Used concrete example among this paper principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that on embodiment and range of application, all can change, in sum, this description should not be construed as limitation of the present invention.
Claims (16)
1. the implementation method of a conventional data quality management and control adapter is characterized in that, comprising:
The attribute that extraction is possessed by the business processing flow of management and control operation system and handled data forms the physical model collection;
List said physical model and concentrate type, value range and the input mode of all properties of each model object, and, to input parameter, handling process and the output parameter of the relevant operation of this model object with the quality of data;
Rule by preset is set up the incidence relation between the said model object, generates conventional data quality management and control adapter.
2. the method for claim 1 is characterized in that, the said method of setting up the incidence relation between the said model object by preset rule is specially:
Adopt rule template to set up mode:
By the attribute and the associative operation thereof of each model object of input/output sequence typing between the said model object, all incidence relations of disposable importing are verified every complete rule then in preset rule template;
Or adopt customization guide to set up mode:
According to the attribute and the associative operation thereof of the said model object of rules customization guide typing, treat that every complete rule checking is passed through after, carry out the setting of next bar rule again.
3. method as claimed in claim 2 is characterized in that, also comprises the new regulation foundation step:
Confirm the service conditions of effect, rale store mode, regular Run Script and the rule script of attribute field that rule name, parameter of regularity, the rule of new regulation possess, rule.
4. method as claimed in claim 2 is characterized in that, also comprises quality of data management and control adaptable interface testing procedure:
Test said conventional data quality management and control adapter with by the situation that is connected of management and control operation system, and, carry out various information interactions by above-mentioned incidence relation, judge the correctness of output information.
5. method as claimed in claim 2 is characterized in that, also comprises intelligent assistant:
When regular authentication failed, be used for according to regular keyword automatically from empirical data library searching concrete reason and solution, and provide the incidence relation editing interface to make amendment.
6. method as claimed in claim 2 is characterized in that, also comprises:
The intelligence assistant is the said incidence relation setting up procedure of record in experience database automatically;
Or
Increase or modification empirical data library information, comprise keyword, keyword explanation and intelligent prompt content.
7. method as claimed in claim 2 is characterized in that, also comprises:
The configuration information of said adapter is backed up to predeterminated position; Or the backup information of preserving according to said predeterminated position recovers said adapter.
8. like the described method of one of claim 1 to 7; It is characterized in that; Said preset rule comprises interface mode setting, the setting of data source obtain manner, information analysis rule, the setting of system monitoring point, the incidence relation of control point and the verification content of each control point, wherein:
Said interface mode setting comprises selects communication protocol, interface type, COM1 and IP address;
The setting of said data source obtain manner comprises the unique identification that disposes respective data sources;
Said information analysis rule comprises message format and the data map relation of the concrete data object of each type at said quality of data management and control platform;
Information type and concrete executive mode that the setting of said system monitoring point comprises configuration monitoring point title, acts on, possesses;
The incidence relation of said control point is through the input/output relation or the orbution of the data processing between the initialization system control point;
The verification content of said each control point comprises integrality, accuracy, the promptness of data, the algorithmic formula of coincident indicator; If contain field in the said algorithmic formula, then need in said data source, add corresponding data object and in said information analysis rule, set up mapping relations without mapping.
9. the implement device of a conventional data quality management and control adapter is characterized in that, comprises that physical model extraction unit, physical model are set up the unit and adapter is set up the unit, wherein:
Said physical model extraction unit is used to extract the attribute that is possessed by the business processing flow of management and control operation system and handled data, forms the physical model collection;
Said physical model is set up the unit and is used for the physical model collection of said physical model extraction unit generation is specialized; List said physical model and concentrate type, value range and the input mode of all properties of each model object; And; To this model object and quality of data associative operation, comprise input parameter, handling process and the output parameter of this operation;
Said universal adapter is set up the unit and is used for setting up said physical model by preset rule and sets up the incidence relation between the model object of listing the unit, forms to adapt to by the quality of data management and control adapter of management and control operation system.
10. device as claimed in claim 9 is characterized in that, said universal adapter is set up the unit and comprised that specifically template is set up subelement and/or guide is set up subelement, wherein:
Said template is set up subelement and is used to the user and provides incidence relation to set up template; Make user's attribute and associative operation thereof by each model object of input/output sequence typing in preset rule template; All incidence relations of disposable importing are verified every complete rule then;
Said guide is set up subelement and is used to the user and provides incidence relation to set up guide, makes attribute and the associative operation thereof of user according to the said model object of rules customization guide typing, treat that every complete rule checking is passed through after, carry out the setting of next bar rule again.
11. device as claimed in claim 10; It is characterized in that; Comprise that also new regulation creates the unit, be used for confirming the service conditions of effect, rale store mode, regular Run Script and the rule script of attribute field that rule name, parameter of regularity, the rule of new regulation possess, rule.
12. device as claimed in claim 10; It is characterized in that; Also comprise the adapter test cell, be used to test said conventional data quality management and control adapter with by the situation that is connected of management and control operation system, and; Set up the incidence relation of setting up the unit by said universal adapter and carry out information interaction, judge the correctness of output information.
13. device as claimed in claim 10; It is characterized in that; Also comprise intelligent assistant unit, be used to judge that universal adapter sets up the whether success of rule checking of unit, if not; Then,, the user makes amendment for providing the incidence relation editing interface from intelligent helper data library searching concrete reason and solution.
14. device as claimed in claim 10 is characterized in that, also comprises the experience database maintenance unit, through intelligent assistant, writes down said universal adapter automatically and sets up the process that the unit is provided with incidence relation; Increase or modification empirical data library information, comprise keyword, keyword combination, operation or the problem interpretation that occurs, solution, example.
15. device as claimed in claim 10 is characterized in that, also comprises the data backup restoration unit, is used for the configuration information of said conventional data quality management and control adapter is backed up to predeterminated position; And the backup information of preserving according to said predeterminated position recovers said conventional data quality management and control adapter arrangement file and experience database.
16. like the described device of one of claim 9 to 15; It is characterized in that; Also comprise rules customization guide unit; Be used for interface mode setting, the setting of data source obtain manner, the setting of information analysis rule, the setting of system monitoring point, the incidence relation setting of control point and the verification content setting of each control point, wherein:
Said interface mode setting comprises selects communication protocol, interface type, COM1 and IP address;
The setting of said data source obtain manner comprises the unique identification that disposes respective data sources;
Said information analysis rule is provided with content and comprises message format and the data map relation of the concrete data object of each type at said quality of data management and control platform;
Said system monitoring point is provided with information type and the concrete executive mode that content comprises the control point title, acts on, possesses;
The incidence relation setting of said control point comprises the input/output relation or the orbution of the data processing between the initialization system control point;
The verification content setting of said each control point comprises integrality, accuracy, the promptness of data, the computing formula of coincident indicator; If contain field in the above-mentioned algorithmic formula, then need in said data source, add corresponding data object and in said information analysis rule, set up mapping relations without mapping.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010617052.5A CN102571403B (en) | 2010-12-31 | 2010-12-31 | The implementation method of general data quality control adapter and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010617052.5A CN102571403B (en) | 2010-12-31 | 2010-12-31 | The implementation method of general data quality control adapter and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102571403A true CN102571403A (en) | 2012-07-11 |
| CN102571403B CN102571403B (en) | 2016-04-13 |
Family
ID=46415932
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010617052.5A Active CN102571403B (en) | 2010-12-31 | 2010-12-31 | The implementation method of general data quality control adapter and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102571403B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105573224A (en) * | 2014-10-08 | 2016-05-11 | 深圳中兴力维技术有限公司 | Monitoring method, monitoring device, and monitoring system based on abstract model |
| CN105824870A (en) * | 2016-01-15 | 2016-08-03 | 优品财富管理有限公司 | Classification and quality inspection method and system based on verification rules |
| CN106664224A (en) * | 2014-08-20 | 2017-05-10 | 华为技术有限公司 | System and method for metadata enhanced inventory management of a communications system |
| CN107222351A (en) * | 2017-06-29 | 2017-09-29 | 济南浪潮高新科技投资发展有限公司 | A kind of analysis method of the network equipment quality of data |
| CN107390662A (en) * | 2017-08-29 | 2017-11-24 | 清华大学 | Industrial monitoring method and device based on monitored object model |
| CN107748775A (en) * | 2017-10-17 | 2018-03-02 | 上海计算机软件技术开发中心 | A kind of data governing system based on the quality of data |
| CN107948309A (en) * | 2017-12-15 | 2018-04-20 | 神思电子技术股份有限公司 | A kind of integrated management method and system of the server resource based on Restful API |
| CN108268997A (en) * | 2017-11-23 | 2018-07-10 | 国网陕西省电力公司经济技术研究院 | A kind of electricity grid substation quality of data wire examination method |
| CN108595563A (en) * | 2018-04-13 | 2018-09-28 | 林秀丽 | A kind of data quality management method and device |
| CN109933907A (en) * | 2019-03-14 | 2019-06-25 | 北京五维星宇科技有限公司 | A kind of method for building up and device of military equipment management business model |
| CN110611576A (en) * | 2018-06-14 | 2019-12-24 | 亿阳信通股份有限公司 | Data quality monitoring method, device, equipment and storage medium |
| CN110647509A (en) * | 2018-06-26 | 2020-01-03 | 北京亿阳信通科技有限公司 | Rapid checking and sharing method and device for passenger collecting data |
| CN110795302A (en) * | 2018-08-02 | 2020-02-14 | 北京嘀嘀无限科技发展有限公司 | Data monitoring method, data monitoring system, computer device and storage medium |
| CN110930069A (en) * | 2019-12-10 | 2020-03-27 | 航天新长征大道科技有限公司 | Data acquisition and packaging method and system, readable storage medium and computer |
| CN111858646A (en) * | 2020-07-21 | 2020-10-30 | 国网浙江省电力有限公司营销服务中心 | Method and system for checking quality data format of electric energy meter |
| CN111885180A (en) * | 2020-07-28 | 2020-11-03 | 海尔优家智能科技（北京）有限公司 | Message issuing method and device |
| CN113469559A (en) * | 2021-07-19 | 2021-10-01 | 广东电网有限责任公司 | Quality bit design and display method and system based on data quality inspection |
| CN113656139A (en) * | 2021-08-27 | 2021-11-16 | 上海云轴信息科技有限公司 | Interface rule adding method and equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080091385A1 (en) * | 2006-10-13 | 2008-04-17 | Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd. | Cable use tracking apparatus |
| CN101197876A (en) * | 2006-12-06 | 2008-06-11 | 中兴通讯股份有限公司 | Method and system for multi-dimensional analysis of message service data |
| CN101409643A (en) * | 2008-11-24 | 2009-04-15 | 北京中创信测科技股份有限公司 | Method, apparatus and corresponding system for analyzing telecom network modeling |
-
2010
- 2010-12-31 CN CN201010617052.5A patent/CN102571403B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080091385A1 (en) * | 2006-10-13 | 2008-04-17 | Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd. | Cable use tracking apparatus |
| CN101197876A (en) * | 2006-12-06 | 2008-06-11 | 中兴通讯股份有限公司 | Method and system for multi-dimensional analysis of message service data |
| CN101409643A (en) * | 2008-11-24 | 2009-04-15 | 北京中创信测科技股份有限公司 | Method, apparatus and corresponding system for analyzing telecom network modeling |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106664224A (en) * | 2014-08-20 | 2017-05-10 | 华为技术有限公司 | System and method for metadata enhanced inventory management of a communications system |
| CN106664224B (en) * | 2014-08-20 | 2020-04-28 | 华为技术有限公司 | Method and system for metadata enhanced inventory management for communication systems |
| CN105573224A (en) * | 2014-10-08 | 2016-05-11 | 深圳中兴力维技术有限公司 | Monitoring method, monitoring device, and monitoring system based on abstract model |
| CN105824870A (en) * | 2016-01-15 | 2016-08-03 | 优品财富管理有限公司 | Classification and quality inspection method and system based on verification rules |
| CN107222351A (en) * | 2017-06-29 | 2017-09-29 | 济南浪潮高新科技投资发展有限公司 | A kind of analysis method of the network equipment quality of data |
| CN107390662A (en) * | 2017-08-29 | 2017-11-24 | 清华大学 | Industrial monitoring method and device based on monitored object model |
| CN107748775A (en) * | 2017-10-17 | 2018-03-02 | 上海计算机软件技术开发中心 | A kind of data governing system based on the quality of data |
| CN108268997A (en) * | 2017-11-23 | 2018-07-10 | 国网陕西省电力公司经济技术研究院 | A kind of electricity grid substation quality of data wire examination method |
| CN107948309A (en) * | 2017-12-15 | 2018-04-20 | 神思电子技术股份有限公司 | A kind of integrated management method and system of the server resource based on Restful API |
| CN108595563A (en) * | 2018-04-13 | 2018-09-28 | 林秀丽 | A kind of data quality management method and device |
| CN110611576A (en) * | 2018-06-14 | 2019-12-24 | 亿阳信通股份有限公司 | Data quality monitoring method, device, equipment and storage medium |
| CN110611576B (en) * | 2018-06-14 | 2023-05-09 | 亿阳信通股份有限公司 | Data quality monitoring method, device, equipment and storage medium |
| CN110647509B (en) * | 2018-06-26 | 2024-05-14 | 北京亿阳信通科技有限公司 | Quick checking and sharing method and device for collecting customer data |
| CN110647509A (en) * | 2018-06-26 | 2020-01-03 | 北京亿阳信通科技有限公司 | Rapid checking and sharing method and device for passenger collecting data |
| CN110795302A (en) * | 2018-08-02 | 2020-02-14 | 北京嘀嘀无限科技发展有限公司 | Data monitoring method, data monitoring system, computer device and storage medium |
| CN109933907B (en) * | 2019-03-14 | 2023-10-20 | 北京五维星宇科技有限公司 | Method and device for establishing equipment management service model |
| CN109933907A (en) * | 2019-03-14 | 2019-06-25 | 北京五维星宇科技有限公司 | A kind of method for building up and device of military equipment management business model |
| CN110930069A (en) * | 2019-12-10 | 2020-03-27 | 航天新长征大道科技有限公司 | Data acquisition and packaging method and system, readable storage medium and computer |
| CN111858646A (en) * | 2020-07-21 | 2020-10-30 | 国网浙江省电力有限公司营销服务中心 | Method and system for checking quality data format of electric energy meter |
| CN111858646B (en) * | 2020-07-21 | 2023-11-07 | 国网浙江省电力有限公司营销服务中心 | Electric energy meter quality data format checking method and system |
| CN111885180A (en) * | 2020-07-28 | 2020-11-03 | 海尔优家智能科技（北京）有限公司 | Message issuing method and device |
| CN113469559A (en) * | 2021-07-19 | 2021-10-01 | 广东电网有限责任公司 | Quality bit design and display method and system based on data quality inspection |
| CN113656139A (en) * | 2021-08-27 | 2021-11-16 | 上海云轴信息科技有限公司 | Interface rule adding method and equipment |
| CN113656139B (en) * | 2021-08-27 | 2024-06-04 | 上海云轴信息科技有限公司 | Interface rule adding method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102571403B (en) | 2016-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102571403A (en) | Realization method and device for general data quality control adapter | |
| CN110309071B (en) | Test code generation method and module, and test method and system | |
| EP2778929B1 (en) | Test script generation system | |
| Hussain et al. | The role of requirements in the success or failure of software projects | |
| US9836710B2 (en) | Resource planning for data protection validation | |
| US8151248B1 (en) | Method and system for software defect management | |
| Hussain et al. | Requirements: Towards an understanding on why software projects fail | |
| CN108959059B (en) | Test method and test platform | |
| EP4339802A2 (en) | Methods and apparatus for integrated management of structured data from various sources and having various formats | |
| CN108628748B (en) | Automatic test management method and automatic test management system | |
| US10990370B1 (en) | System, apparatus and method for deploying infrastructure to the cloud | |
| US10560484B2 (en) | Managing access in one or more computing systems | |
| US9513997B2 (en) | Test data management | |
| CN109871963A (en) | Operation troubles restoring method, device, electronic equipment and storage medium | |
| CN111190814B (en) | Method and device for generating software test case, storage medium and terminal | |
| Valverde et al. | ITIL-based IT service support process reengineering | |
| CN111984882A (en) | Data processing method, system and equipment | |
| CN110362294A (en) | Development task executes method, apparatus, electronic equipment and storage medium | |
| Foganholi et al. | Supporting Technical Debt Cataloging with TD‐Tracker Tool | |
| US10162849B1 (en) | System, method, and computer program for automatic database validation associated with a software test | |
| CN115269387A (en) | Automatic interface testing method and device | |
| CN107085553B (en) | Input box testing method and device | |
| US20230289241A1 (en) | Automatic data pipeline generation | |
| CN115309644A (en) | Method and device for testing query page | |
| CN110515828A (en) | Document test method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C53 | Correction of patent of invention or patent application | ||
| CB02 | Change of applicant information |
Address after: 100093, Beijing, Haidian District, apricot Road, No. 99, block B Applicant after: Beijing BOCO Inter-Telecom Technology Co., Ltd. Applicant after: Yiyang Xintong Co., Ltd. Address before: 100093, Beijing, Haidian District, apricot Road, No. 99, block B Applicant before: Beijing Yiyang Xintong Software Inst. Co., Ltd. Applicant before: Yiyang Xintong Co., Ltd. |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: APPLICANT; FROM: BEIJING YIYANG XINTONG SOFTWARE INST. CO., LTD. TO: BEIJING BRIGHT OCEAN XINTONG TECHNOLOGY CO., LTD. |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160225 Address after: 150090 Heilongjiang, Nangang District, Songshan Road, high tech Development Zone, building No. 1, building No. Applicant after: Yiyang Xintong Co., Ltd. Address before: 100093, Beijing, Haidian District, apricot Road, No. 99, block B Applicant before: Beijing BOCO Inter-Telecom Technology Co., Ltd. Applicant before: Yiyang Xintong Co., Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180801 Address after: 100093 Haidian District, Haidian District, Xing Shi Kou Road, No. 1 20302, 20302 Patentee after: Beijing BOCO Inter-Telecom Technology Co., Ltd. Address before: 150090 1 building, hi tech Development Zone, Songshan Road, Nangang District, Harbin, Heilongjiang. Patentee before: Yiyang Xintong Co., Ltd. |