CN108830554A - The outcome data information quality intelligent detecting method and system of task based access control model - Google Patents
The outcome data information quality intelligent detecting method and system of task based access control model Download PDFInfo
- Publication number
- CN108830554A CN108830554A CN201810529197.6A CN201810529197A CN108830554A CN 108830554 A CN108830554 A CN 108830554A CN 201810529197 A CN201810529197 A CN 201810529197A CN 108830554 A CN108830554 A CN 108830554A
- Authority
- CN
- China
- Prior art keywords
- task
- detection
- data
- groups
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000001514 detection method Methods 0.000 claims abstract description 312
- 238000012372 quality testing Methods 0.000 claims abstract description 80
- 238000007689 inspection Methods 0.000 claims abstract description 77
- 238000012360 testing method Methods 0.000 claims abstract description 31
- 238000007405 data analysis Methods 0.000 claims abstract description 25
- 238000005259 measurement Methods 0.000 claims abstract description 12
- 238000012545 processing Methods 0.000 claims description 24
- 230000006870 function Effects 0.000 claims description 20
- 235000013399 edible fruits Nutrition 0.000 claims description 7
- 230000015572 biosynthetic process Effects 0.000 claims description 6
- 238000011895 specific detection Methods 0.000 claims description 6
- 238000004321 preservation Methods 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 4
- 241000208340 Araliaceae Species 0.000 claims 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims 1
- 235000003140 Panax quinquefolius Nutrition 0.000 claims 1
- 235000008434 ginseng Nutrition 0.000 claims 1
- 230000008439 repair process Effects 0.000 claims 1
- 230000000875 corresponding effect Effects 0.000 description 43
- 238000007726 management method Methods 0.000 description 16
- 230000008569 process Effects 0.000 description 9
- 230000007246 mechanism Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000012550 audit Methods 0.000 description 2
- 230000001105 regulatory effect Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000000739 chaotic effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Human Resources & Organizations (AREA)
- Operations Research (AREA)
- Economics (AREA)
- Marketing (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Stored Programmes (AREA)
Abstract
The present invention provides the outcome data information quality intelligent detecting method and system of a kind of task based access control model, several Detection task information corresponding to the outcome data various dimensions quality testing factor are first based on quality inspection algorithm and carry out Detection task computation modeling by this method, to establish task model；Task groups are input to task model, Detection task whole in task groups are executed by task model by Detection task required for acquiring outcome data to be detected again and selecting to form task groups, and then obtain Detection task calculated result；Then it will test task computation result and carry out Data Analysis Services and output data achievement information quality testing report to realize intelligent measurement.This method can handle mass data, and the Detection task of selection is directly inputted into task model and is detected automatically, to save time cost and cost of labor, be integrally improved the efficiency and accuracy and comprehensive of outcome data infomation detection.
Description
Technical field
The present invention relates to system task management fields, are specifically related to a kind of outcome data information matter of task based access control model
Measure intelligent detecting method and system.
Background technique
In the Ministry of Agriculture《The land contract in the countryside power of management really weighs registered database specification》(hereinafter referred to as " standardizing ") and phase
Close in attachment, it is specified that the rule that is detected to the true flexible strategy of the land contract in the countryside power of management according to achievement information, realize data at
Fruit information content detection, to guarantee the quality of outcome data information.Wherein, detection project includes：Outcome data information it is complete
Property, logical consistency, the topologically correct property of vector data etc..Since the land contract in the countryside power of management really weighs registration data achievement information
In file type it is varied, it is a variety of comprising mdb database, Raster Images, vector file, word document, Excel document etc.
The data file of format；And the data volume of outcome data information, to occupy memory space all very big, ground number of blocks in million ranks,
Boundary mark, boundary location line data volume are ten million ranks, and individual data achievement information occupies memory space up to TB rank；In addition, complete
The data volume in the county state-owned 2800 Duo Ge, the outcome data information in the final whole nation is a huge number, again, " specification " and its
Rule quantity as defined in attachment is also very much, and is also possible to carry out in a deep going way with true power work and adjusted and updated, it is difficult to
It is completed using traditional detection method.Finally, entire really power registration work having time limitation, it is necessary to before the deadline, right
The performance requirement of the efficiency and detection instrument software that detect work is high.Make to pass through land contract in the countryside due to the above reasons,
Battalion's power, which is really weighed registration data achievement information and detect, has biggish difficulty, in junction outcome data information, quality testing
Work faces huge challenge.
Currently, existing quality determining method is completed by all kinds of tool software combination artificial detections, for example, by using
Microsoft Access opens mdb database file, and Esri ArcGis opens Raster Images and vector file, at text
Reason and spreadsheet software open all kinds of documents and table and carry out testing number according to rule in conjunction with sql sentence and spreadsheet formulas
Whether meet " specification " requirement according to achievement information.Traditional quality detection method needs manually to be calculated using above-mentioned software,
Integration and check and correction, can inevitably have certain fault or randomness, cause the reliability for testing result occur not high, and detection is not
Comprehensive problem.In addition, that there is also detection efficiencies is low, tool confusion is difficult to the problems such as managing.
Summary of the invention
The present invention for current quality determining method be open all kinds of tool software in conjunction with artificial realize to data at
The detection of fruit information, there are certain fault or randomness, not high so as to cause the reliability of testing result, detection not comprehensively,
The problems such as inefficiency, tool are easily chaotic, proposes a kind of side of the outcome data information quality intelligent measurement of task based access control model
Method, this method uses the thought of task model, by several Detection tasks corresponding to the outcome data various dimensions quality testing factor
Information carries out Detection task computation modeling, establishes unified standardization and powerful task model, by quality testing rule
Be defined as task, the Detection task of selection be directly inputted into task model and is detected automatically, improve detection efficiency and
Accuracy, comprehensive, the reduction unnecessary loss of human error's bring.The invention further relates to the data of task based access control model at
Fruit information quality intelligent checking system.
Technical scheme is as follows：
A kind of outcome data information quality intelligent detecting method of task based access control model, which is characterized in that the method is first
Several Detection task information corresponding to the outcome data various dimensions quality testing factor are based on quality inspection algorithm and carry out Detection task
Computation modeling, to establish task model；Detection task required for acquiring outcome data to be detected again and selecting is to form
Task groups；The task groups are input to the task model, are executed by the task model in the task groups all
Detection task, and then obtain Detection task calculated result；Then the Detection task calculated result is carried out at data analysis
It manages and output data achievement information quality testing report is to realize intelligent measurement.
Further, the outcome data various dimensions quality testing factor includes the integrity detection factor, Format Type number
According to detecting factor and the consistency detection factor, it is complete that several Detection tasks corresponding to the integrity detection factor are based on data
Property detection algorithm carry out Detection task computation modeling, the detection of vector data corresponding to the format type data detecting factor is appointed
Business carries out Detection task computation modeling, the format type data detecting factor based on detection of attribute algorithm and test pattern algorithm
Corresponding Property data Detection task is based on field detection algorithm and carries out Detection task computation modeling, the format type data
Raster data Detection task corresponding to detecting factor is based on raster data algorithm for space analysis and carries out Detection task computation modeling,
Inspection of the metadata Detection task based on metadata structure, space and content corresponding to the format type data detecting factor
Method of determining and calculating carries out Detection task computation modeling, data consistency Detection task corresponding to the consistency detection factor and summarizes
Table consistency detection task is based on Algorithm for Consistency Checking and carries out Detection task computation modeling；The task model is in nesting
The model framework of formula.
Further, the content for the outcome data to be detected of acquisition and data type are from associated Detection task
For Detection task required for selecting in information to form task groups, required Detection task is that outcome data to be detected is related
All or part of task in the Detection task information of connection, the Detection task in the task groups include independent task and/or extremely
Few level-one cascades subtask group, and the independent task refers to the realizing single specific detection function of the task；The subtask group is
Refer to the realizing multiple specific detection functions of the task.
Further, it is additionally provided with the task set library for saving task groups；It is from task groups for outcome data to be detected
The task groups being saved are called to obtain the path of outcome data to be detected again to acquire outcome data to be detected simultaneously in library
Detection task required for selecting realizes that task parameters are configured to form new task groups, and the new task groups are input to
The new task groups of the task model, formation are also saved into task set library.
Further, the task model is executed based on Topology Algorithm according to preset priority complete in the task groups
The Detection task in portion, when the Detection task in task groups is independent task according to each independent task of priority processing,
When the Detection task in task groups is to handle subtask group according to Cascade algorithms when at least one level cascades subtask group, and then obtain
Detection task calculated result.
Further, it will be examined in output data achievement information quality testing report there are when quality testing error message
The outcome data information of survey is modified, and the quality testing error message includes attribute error information and Topology Error information；
The attribute error information checks that the Topology Error information is checked by ArcGIS map by error listing, for checking
The outcome data information for the quality testing error message amendment detection arrived, and held after amendment by re-entering task model
Detection task required for row task groups, until output data achievement information quality testing report mark data to be tested achievement disappears
Except detection mistake is to reach examination criteria.
A kind of outcome data information quality intelligent checking system of task based access control model, which is characterized in that the system packet
Include sequentially connected task model creation module, task configuration module, task groups execution module and data analysis and processing module：
The task model creation module is by several Detection tasks corresponding to the outcome data various dimensions quality testing factor
Information is based on quality inspection algorithm and carries out Detection task computation modeling, to establish task model；
Detection task required for the task configuration module acquires outcome data to be detected and selects is to form task
The task groups are input to the task model by group；
The task groups execution module executes Detection task whole in the task groups by the task model, into
And obtain Detection task calculated result；
The Detection task calculated result is carried out Data Analysis Services and output data by the Data Analysis Services module
Achievement information quality testing is reported to realize intelligent measurement.
Further, which is characterized in that the system also includes task set library, the task set library is for saving task groups
And be connected with the task configuration module, the task configuration module for outcome data to be detected is adjusted from task set library
The path of outcome data to be detected is obtained again with the task groups being saved to acquire outcome data to be detected and select institute
The Detection task needed realizes task parameters configuration to form new task groups, and the new task groups is input to described appoint
Business model, the new task groups of formation are also saved into task set library.
Further, the system also includes memory module and false judgment processing module, the memory module and mistake
Judging treatmenting module is connected with Data Analysis Services module, the false judgment processing module also with task groups execution module phase
Even, the memory module saves the outcome data information quality examining report of Data Analysis Services module output；
The false judgment processing module whether there is in output data achievement information quality testing report for judging
Quality testing error message, when there are quality testing error message, the outcome data information that will test is modified, the matter
Amount detection error message includes attribute error information and Topology Error information；The attribute error information is looked by error listing
It sees, the Topology Error information is checked by ArcGIS map, for the quality testing error message amendment detection viewed
Outcome data information, and be back to task groups execution module after amendment and execute task groups institute by re-entering task model
The Detection task needed, until output data achievement information quality testing report mark data to be tested achievement eliminates detection mistake
To reach examination criteria.
Further, which is characterized in that content of the task configuration module for the outcome data to be detected of acquisition
Detection task required for selecting from associated Detection task information with data type is to form task groups, required inspection
Survey task is all or part of task in the associated Detection task information of outcome data to be detected, in the task groups
Detection task includes independent task and/or at least one level cascade subtask group, and the task groups are input to the task model；
The task groups execution module executes Detection task whole in the task groups, the task mould by the task model
Type executes Detection task whole in the task groups based on Topology Algorithm according to preset priority, when the inspection in task groups
According to each independent task of priority processing when survey task is independent task, when the Detection task in task groups is at least one
Subtask group is handled according to Cascade algorithms when grade cascade subtask group, and then obtains Detection task calculated result.
Technical effect of the invention is as follows：
The present invention provides a kind of outcome data information quality intelligent detecting method of task based access control model, and outcome data is more
Several Detection task information corresponding to the dimension quality testing factor are based on quality inspection algorithm and carry out Detection task computation modeling, thus
Task model is established, which is alternatively referred to as task management model or Detection task computation model, and this method is base
Automation quality examination is carried out in task management model, so-called task refers to multiprogramming in computer systems or more originally
The groundwork unit completed under process context by computer, it is the one or more sequence of instructions handled by control program
The concept of task model in computer operating system is used and is extended by column, task model of the present invention, is utilized
Task model mechanism realizes the definition and mappings work of quality inspection rule to task well, will be as defined in " specification " and its attachment
Quality testing regular break is the task sequence being made of multiple Detection task information, and the principle of task resolution is by each matter
Inspection rule is defined as a task or multiple tasks, constitutes task management model, which has been compatible with various types
Outcome data the various dimensions quality testing factor corresponding to many Detection task information, in this way, being acquired in practical application
Outcome data to be detected simultaneously selects required Detection task to be configured with the inspection parameter of task groups, forms pending
The task groups are input to the task model, it will be able to the task groups are executed by the task model by task groups
Middle whole Detection task, and then obtain Detection task calculated result, it is not necessary that successively to open different tools soft as the prior art
Part execution Detection task in every particular, outcome data capacity to be detected is huge usually more than TB magnitude and data type is various,
The task to be detected of selection is directly inputted into unified standardization to the present invention and powerful task model is examined automatically
Survey, and this method can mass simultaneous quality testing is carried out to data achievement information, avoid it is artificial using corresponding auxiliary software,
According to detected rule is carried out to detection data achievement information the problems such as detecting bring low efficiency and high error rate one by one, thus
Time cost and cost of labor are saved, the efficiency of outcome data infomation detection is integrally improved.
Further, the outcome data various dimensions quality testing factor being related to includes the integrity detection factor, Format Type
The Data Detection factor and the consistency detection factor can use data integrity detection algorithm, detection of attribute algorithm, figure respectively
Detection algorithm, field detection algorithm raster data algorithm for space analysis, metadata structure space content detection algorithm and one
Cause property detection algorithm etc. many quality inspection algorithms carry out Detection task computation modeling, and the task model established is in the mould of nested type
Type frame structure.That is, mapping that corresponding task according to quality inspection rule, when definition rule is task, need to rule
Classification Management, the rule of every one kind are carried out, the data of inspection emphasize particularly on different fields, and it is also different to define the task details come.These
Classification mainly has " data integrity inspection ", " vector data inspection ", " Property data inspection ", " raster data inspection ", " first number
According to checking ", " data consistent check ", " summarizing table consistency check " etc., each quality inspection rule is defined as one and appoints
Business or multiple tasks constitute powerful standardized task management model, improve quality inspection efficiency.
Further, the outcome data information quality intelligent detecting method of a kind of task based access control model provided by the invention,
It include independent task and/or at least one level cascade subtask group using task groups, for example level-one subtask group and second level are appointed
Business group and multistage subtask group, task groups are nested layer by layer, a kind of task structure of nesting is formed, task model is preferably also in embedding
The model framework of shell type, task model execute inspection whole in the task groups based on Topology Algorithm according to preset priority
Survey task, so that user interface is friendly, when creating new task groups, user can very easily choose accordingly according to data type
Detection form task groups, i.e., the inspection parameter of flexibly configurable task as needed, convenient for management, indirectly improve data inspection
The accuracy of survey.
Further, the outcome data information quality intelligent detecting method of a kind of task based access control model provided by the invention,
There are when quality testing error message in output data achievement information quality testing report, it is preferably provided with amendment step, will be examined
The outcome data information of survey is modified, and quality testing error message includes attribute error information and Topology Error information；It is described
Attribute error information checks that the Topology Error information is checked by ArcGIS map, for what is viewed by error listing
Quality testing error message can will test unsanctioned detection using the outcome data information of auxiliary tool amendment detection
New task groups are formed, then the revised outcome data information is back to task model to execute inspection required for task groups
Survey task, until output data achievement information quality testing report mark data to be tested achievement eliminates detection mistake to reach inspection
Mark is quasi-, i.e., until, there is no detection error message, further improving the accuracy of Data Detection in testing result information.
The invention further relates to a kind of outcome data information quality intelligent checking system of task based access control model, the system with it is upper
The outcome data information quality intelligent checking system method for stating task based access control model is corresponding, it will be appreciated that be to realize task based access control
System corresponding to the outcome data information quality intelligent detecting method of model, task model creation module including connection are appointed
Business configuration module, task groups execution module and data analysis and processing module.It is established and is marked by task model creation module particular job
The powerful task model of standardization cooperates with other each modules to work together, which can handle mass data, to be detected
The task groups that task is formed can be executed in batches directly, avoided artificial use and accordingly assisted software, examine one by one according to detected rule
The fault of measured data achievement information bring, to save time cost and cost of labor, is integrally improved outcome data information
The efficiency of detection.
Further, the outcome data information quality intelligent checking system of a kind of task based access control model provided by the invention,
It further include memory module and false judgment processing module, which saves the outcome data of Data Analysis Services module output
Information quality examining report, false judgment processing module for judge output data achievement information quality testing report in whether
There are quality testing error messages can be used auxiliary tool when there are quality testing error message, according to detection error message
The outcome data information of detection is modified, unsanctioned detection is will test and forms new task groups, then will be after the amendment
Outcome data information be back to task model and detect again, until in testing result information there is no detection error message, on
The setting for stating preferred module enriches system architecture, so that system function is more perfect, and further improves Data Detection
Accuracy enhances the unfailing performance of system.
Detailed description of the invention
Fig. 1 is that the present invention is based on the processes of one embodiment of outcome data information quality intelligent detecting method of task model
Figure.
Fig. 2 is task model schematic diagram of the present invention.
Fig. 3 is that the present invention is based on the preferred flow charts of the outcome data information quality intelligent detecting method of task model.
Fig. 4 is that the present invention is based on the structural schematic diagrams of the outcome data information quality intelligent checking system of task model.
Fig. 5 is that the present invention is based on the signals of the preferred structure of the outcome data information quality intelligent checking system of task model
Figure.
Fig. 6 a-6l is that the present invention is based on the excellent of the outcome data information quality intelligent detecting method specific example of task model
Select working state figure.
Specific embodiment
The present invention will be described with reference to the accompanying drawing.
The present invention relates to a kind of outcome data information quality automatic testing method of task based access control model, process such as Fig. 1
It is shown, include the following steps：S1, first by several Detection task information bases corresponding to the outcome data various dimensions quality testing factor
Detection task computation modeling is carried out in quality inspection algorithm, to establish task model；S2, outcome data to be detected is acquired again and is selected
The task groups are input to the task model, pass through the task mould by Detection task required for selecting to form task groups
Type executes Detection task whole in the task groups, and then obtains Detection task calculated result；S3, then by the detection
Task computation result carries out Data Analysis Services and output data achievement information quality testing report to realize intelligent measurement.
Specifically, to the present invention is based on the progress of the outcome data information quality intelligent detecting method of task model is further detailed
It describes in detail bright.
Step S1, several Detection task information corresponding to the outcome data various dimensions quality testing factor are first based on quality inspection
Algorithm carries out Detection task computation modeling, to establish task model；
In the present embodiment, above-mentioned outcome data refers to that land contract in the countryside is managed in really power enrollment process, preferably with county
Grade administrative area is that basic unit forms power registered database achievement really.And vector data is (with coordinate or orderly coordinate string list
The graph datas such as the space point, line, surface shown and related attribute data general name associated there), raster data is (by geographical space
The unit for being divided into row, column rule and arranging, and each unit has the data set of different " values "), graph data (indicate geography object
Position, form, size and the distribution characteristics and set type data of body).The above-mentioned outcome data various dimensions quality testing factor
Refer at least one outcome data information quality intelligent measurement item.Preferably, the above-mentioned outcome data various dimensions quality testing factor
It may include the integrity detection factor, format type data detecting factor and consistency detection factor etc.；Wherein, integrality is examined
It surveys several Detection tasks corresponding to the factor and is based on data integrity detection algorithm progress Detection task computation modeling, Format Type
Vector data Detection task corresponding to the Data Detection factor is based on detection of attribute algorithm and test pattern algorithm carries out detection and appoints
It is engaged in computation modeling, raster data Detection task corresponding to format type data detecting factor is based on raster data space analysis algorithm
Method carries out Detection task computation modeling, and metadata Detection task corresponding to format type data detecting factor is based on metadata knot
The detection algorithm of structure, space and content carries out Detection task computation modeling；Data corresponding to the consistency detection factor are consistent
Property Detection task and summarize table consistency detection task be based on Algorithm for Consistency Checking carry out Detection task computation modeling；Appoint
Business model is in the model framework of nested type.It is preferred task model, in the present embodiment, various dimensions detecting factor referring to table 1
Including：Data integrity detecting factor, vector data detecting factor, Property data detecting factor, raster data detecting factor, member
The Data Detection factor, data consistency detecting factor and summarize the table consistency detection factor.Wherein vector data detection because
Son, Property data detecting factor, raster data detecting factor, metadata detecting factor belong to format type data detection because
Son.
In the present embodiment, task, refer under multiprogramming in computer systems or multi-process environment by computer Lai
The basic unit of completion, the one or more instruction sequences handled by control program.Task model refers to a kind of nested layer by layer
Task structure, the task model using task in computer operating system thought, by the Data Detection specification of national regulation and
The rule detected as defined in its attachment to data achievement information quality is classified, and will test rule according to classification results
It is defined as task structure be made of multiple tasks or task groups, nested layer by layer.
Step S2, Detection task required for acquiring outcome data to be detected and selecting, will be described to form task groups
Task groups are input to the task model, and Detection task whole in the task groups is executed by the task model, into
And obtain Detection task calculated result.
In the present embodiment, outcome data information to be detected is to exist in the form of a file mostly, and this document type is more
Kind multiplicity, including a variety of data files such as mdb database, Raster Images, vector file, word document, Excel file.
In the present embodiment, outcome data to be detected is acquired, all Detection task information groups can be built up into task
Group is input to task model, and whole Detection tasks in task groups are executed by task model, and then obtains Detection task calculating
As a result；Can also according to the content and data type of outcome data to be detected collected, from outcome data to be detected
Detection task required for selecting in associated Detection task information is to form task groups.Preferably, in the present embodiment, root
According to the content and data type of outcome data to be detected collected, required for being selected in associated Detection task information
Detection task to form task groups, required Detection task is the associated Detection task information of outcome data to be detected
In all or part of task.Obtained task groups are input in the task model pre-established, are executed by task model
Whole Detection tasks in task groups, obtain the calculated result of Detection task according to corresponding detection algorithm.
In the present embodiment, it is referring to fig. 2 the present invention that above-mentioned task model, which is a kind of task groups structure nested layer by layer,
The schematic illustration of task model, the Detection task in the task groups include independent task and/or at least one level cascade subtask
Group, independent task refer to the realizing single specific detection function of the task；The subtask group, which refers to, realizes multiple specific detection functions
Task.As shown in Fig. 2, mark 1 represents task groups, and it include several independent tasks, such as task 1 of 2 representative of mark, Yi Jiren
Business n is independent task, these independent tasks can have different function or identical function.Detection task further includes cascade
The subtask group that the task 2 and mark 4 that subtask group, such as mark 3 represent represent constitutes cascade subtask group, as in task
Task groups in group, that is to say, that task groups also may include other task groups, as task 2 include it is several can have it is different
The task of function or identical function：Task 2.1, task 2.2 (mark 5) ... task 2.n.No matter task groups show as independent appoint
Business or cascade subtask group, are inherently tasks, only their realization content and mode are had any different.Any task
All have complete life cycle, it can be according to the life cycle of different inspection rule overwriting tasks, to realize different industry
Business function.Referring back to table 1, outcome data quality testing rule is defined as task model, various dimensions detecting factor is defined as appointing
Business group, detection corresponding to various dimensions detecting factor is defined as independent task and/or level-one cascade subtask group, table 1 are corresponding
It include check item, the scope of examination, inspection requirements and requirement description.Each check item therein is the definition of various dimensions detecting factor
Each task groups, the sequence between each task groups can be fixed or random alignment, and the subtask group in check item is (in corresponding table
The scope of examination) preferably permanent order arrangement.For example, data integrity detecting factor is defined as task groups, detecting factor institute
Corresponding detection：Catalogue and filespec inspection, data validity inspection, vector data integrity checking, attribute data
Integrity checking is defined as level-one cascade subtask group.
In the present embodiment, the execution of task groups can be according to the selecting sequence of selected detection, by task model
To execute whole Detection tasks in task groups；It can also be based on opening up by task model according to the pre-set priority of user
Algorithm is flutterred, to execute whole Detection tasks in task groups.Preferably, in the present embodiment, task model is based on topology calculation
Method executes Detection task whole in task groups according to preset priority, when the Detection task in task groups is independent appoints
According to each independent task of priority processing when business, when the Detection task in task groups be when at least one level cascades subtask group according to
Cascade algorithms handle subtask group, and then obtain Detection task calculated result.
When executing task groups, specific step is as follows：
L1：The task groups of the task based access control model are initialized, first task in task groups is obtained；
L2：Initialize the information of choosing for task；
L3：Judge whether task is independent task, if so, first task of configuration, and to acquired outcome data
Information is calculated according to quality inspection algorithm, obtains testing result information；If not, performing the next step rapid；
L4：If level-one cascades subtask group, configuration level-one cascades subtask group, chooses in level-one cascade subtask group
First level-one cascades independent task and is calculated according to quality inspection algorithm acquired outcome data information, obtains detection knot
Fruit information.
Step S3, the Detection task calculated result is subjected to Data Analysis Services and output data achievement information quality is examined
Announcement is observed and predicted to realize intelligent measurement.
It should be noted that according to the content and data type of outcome data to be detected, it can be by the inspection of national regulation
The rule of gauge model and its attachment defined carries out more detailed careful classification, according to classification results, defines two-level concatenation task
Group even multi-stage cascade task groups.Referring back to table 1, for example, vector data in format type data detecting factor check because
Son, including level-one cascade subtask group：Figure inspection, two-level concatenation subtask group：Point element inspection, Linear element inspection,
Area pattern inspection, multi-section sorting are looked into.Cascade subtasks at different levels group is successively executed according to Cascade algorithms, is executing second task group
Or when multistage task groups, execution mechanism when implementation procedure and execution mechanism and aforementioned execution level-one cascade task groups is complete
The same, details are not described herein.
Table 1
The present invention provides a kind of outcome data information quality intelligent detecting method of task based access control model, and outcome data is more
Several Detection task information corresponding to the dimension quality testing factor are based on quality inspection algorithm and carry out Detection task computation modeling, thus
Task model is established, which is alternatively referred to as task management model or Detection task computation model, and this method is base
Automation quality examination is carried out in task management model, so-called task refers to multiprogramming in computer systems or more originally
The groundwork unit completed under process context by computer, it is the one or more sequence of instructions handled by control program
The concept of task model in computer operating system is used and is extended by column, task model of the present invention, is utilized
Task model mechanism realizes the definition and mappings work of quality inspection rule to task well, will be as defined in " specification " and its attachment
Quality testing regular break is the task sequence being made of multiple Detection task information, and the principle of task resolution is by each matter
Inspection rule is defined as a task or multiple tasks, constitutes task management model, which has been compatible with various types
Outcome data the various dimensions quality testing factor corresponding to many Detection task information, in this way, being acquired in practical application
Outcome data to be detected simultaneously selects required Detection task to be configured with the inspection parameter of task groups, forms pending
The task groups are input to the task model, it will be able to the task groups are executed by the task model by task groups
Middle whole Detection task, and then obtain Detection task calculated result, it is not necessary that successively to open different tools soft as the prior art
Part execution Detection task in every particular, outcome data capacity to be detected is huge usually more than TB magnitude and data type is various,
The task to be detected of selection is directly inputted into unified standardization to the present invention and powerful task model is examined automatically
Survey, and this method can mass simultaneous quality testing is carried out to data achievement information, avoid it is artificial using corresponding auxiliary software,
According to detected rule is carried out to detection data achievement information the problems such as detecting bring low efficiency and high error rate one by one, thus
Time cost and cost of labor are saved, the efficiency of outcome data infomation detection is integrally improved.
The present invention realizes the definition and mappings work of quality inspection rule to task using task model mechanism well.Using
All-mass detected rule can be created as by the above-mentioned task model that the present invention creates after realizing to task management functions
The task groups that computer software can be read.All quality examination rules are all defined as after corresponding task groups, it will be appreciated that are
It is the task management mechanism by component-based development framework establishment, the automatic execution of configuration and scheduler task group, i.e. times of selection
Business group is automatically entered to task model, is finally completed the quality examination work of outcome data.
The present invention should be preferably based on the outcome data information quality intelligent detecting method of task model in embodiment one
On the basis of, including：It is provided with the task set library for saving task groups；It for outcome data to be detected is called from task set library
Needed for the task groups being saved obtain the path of outcome data to be detected again to acquire outcome data to be detected and select
The Detection task wanted realizes that task parameters are configured to form new task groups, and the new task groups are input to task model,
The new task groups formed are also saved into task set library.
The present invention should be preferably based on the outcome data information quality intelligent detecting method of task model in embodiment one
On the basis of, further include：There are when quality testing error message in output data achievement information quality testing report, will test
Outcome data information is modified, and quality testing error message includes attribute error information and Topology Error information；Attribute error
Information checks that Topology Error information is checked by ArcGIS map by error listing, for the quality testing mistake viewed
The outcome data information of Information revision detection, and executed required for task groups after amendment by re-entering task model
Detection task, until output data achievement information quality testing report mark data to be tested achievement eliminates detection mistake to reach
Examination criteria.It is preferably provided with amendment step, it can be using auxiliary tool amendment inspection for the quality testing error message viewed
The outcome data information of survey can will test unsanctioned detection and form new task groups, then by the revised outcome data
Information is back to task model to execute Detection task required for task groups, until there is no detection mistakes in testing result information
False information further improves the accuracy of Data Detection.
It is the preferred flow of the outcome data information quality intelligent detecting method the present invention is based on task model referring to Fig. 3
Figure.The step of flow chart is construed as a kind of preferred flow simplified pinciple figure, first creates task model does not show in figure
Show, be considered as and created task model, starts quality testing；One group of new task groups is created after starting or is pressed using opening
Button opens the task groups saved in the past；The inspection parameter of configuration task, that is, acquire outcome data to be detected and select
Required Detection task is selected to form task groups, mainly includes：Achievement data path is selected, the check item etc. of needs is chosen；
Task groups are executed, that is, the task groups are input to the task model, described appoint is executed by the task model
Whole Detection task in business group, starts to check, by according to quality inspection rule and the check item chosen, sequence executes checking process,
It generally comprises：Catalogue inspection, attribute inspection, topology inspection, consistency check etc.；Checking process can generate several information, packet
It includes：Task execution log, Topology Error, attribute error, other mistakes etc.；Obtain Detection task calculated result；Using aforementioned
Preservation task function in task model saves check item parameter and inspection result etc. at file；By the Detection task meter
It calculates result and carries out Data Analysis Services and output data achievement information quality testing report, check inspection knot using suitable function
Fruit, such as：Attribute error and audit log are checked using error listing function；Topological mistake is checked using ArcGIS map function
Accidentally；Mistake is determined whether, if identifying data to be checked without mistake and passing through inspection；If wrong, mistake is modified, that is,
Output data achievement information quality testing report in there are the outcome data information that when quality testing error message, will test into
Row amendment；Mistake is modified using suitable mode.Quality inspection software does not provide data modification function, and user needs using other tools
To modify mistake.Such as：ArcGIS or Access.Inspection is executed again after the completion of bug patch, repeatedly, until no longer going out
Existing mistake, it is final to realize outcome data information quality intelligent measurement.
The invention further relates to a kind of outcome data information quality intelligent checking system of task based access control model, the system with it is upper
The outcome data information quality intelligent checking system method for stating task based access control model is corresponding, it will be appreciated that be to realize task based access control
System corresponding to the outcome data information quality intelligent detecting method of model, structure is as shown in figure 4, include sequentially connected
Task model creation module, task configuration module, task groups execution module and data analysis and processing module, wherein task model
Creation module carries out several Detection task information corresponding to the outcome data various dimensions quality testing factor based on quality inspection algorithm
Detection task computation modeling, to establish task model；Needed for task configuration module acquires outcome data to be detected and selects
The Detection task wanted is input to task model to form task groups, by task groups；Task groups execution module passes through the task mould
Type executes Detection task whole in the task groups, and then obtains Detection task calculated result；Data Analysis Services module
It will test task computation result and carry out Data Analysis Services and output data achievement information quality testing report to realize intelligent inspection
It surveys.Standardized powerful task model is established by task model creation module particular job, cooperates with other each modules total
With work, which can handle mass data, and the task groups that task to be detected is formed can be executed in batches directly, avoid artificial
Using corresponding auxiliary software, according to detected rule, detection data achievement information bring is made mistakes one by one, thus save the time at
Sheet and cost of labor, are integrally improved the efficiency of outcome data infomation detection.
It is a kind of outcome data information quality intelligent checking system of task based access control model provided by the invention referring to Fig. 5
Preferred structure schematic diagram, in system preferred structure schematic diagram, other than aforementioned four module, further comprise task groups
Library, for task set library for saving task groups and being connected with the task configuration module, task configuration module is directed to number to be detected
According to achievement be call the task groups being saved to obtain the path of outcome data to be detected again from task set library with acquire to
The outcome data of detection simultaneously selects required Detection task to realize that task parameters are configured to form new task groups, and will be new
Task groups are input to task model, and the new task groups of formation are also saved into task set library.
Referring to Fig. 5, preferred outcome data information quality intelligent checking system further comprises memory module and mistake
Judging treatmenting module, memory module and false judgment processing module are connected with Data Analysis Services module, false judgment processing
Module is also connected with task groups execution module, and memory module saves the outcome data information quality of Data Analysis Services module output
Examining report；False judgment processing module is for judging in output data achievement information quality testing report with the presence or absence of quality
Error message is detected, when there are quality testing error message, the outcome data information that will test is modified, and quality testing is wrong
False information includes attribute error information and Topology Error information；Attribute error information checks that Topology Error is believed by error listing
Breath is checked by ArcGIS map, for the outcome data information of the quality testing error message amendment detection viewed, and
It is back to task groups execution module after amendment and executes Detection task required for task groups by re-entering task model, directly
Report that mark data to be tested achievement eliminates detection mistake to reach examination criteria to output data achievement information quality testing.Appoint
The content and data type that configuration module of being engaged in is directed to the outcome data to be detected of acquisition are from associated Detection task information
For Detection task required for selecting to form task groups, required Detection task is the associated inspection of outcome data to be detected
All or part of task in mission bit stream is surveyed, the Detection task in task groups includes independent task and/or at least one level cascade
Task groups are input to the task model by subtask group；Task groups execution module is executed in task groups by task model
Whole Detection tasks, task model execute detection whole in task groups according to preset priority based on Topology Algorithm and appoint
Business, when the Detection task in task groups is independent task according to each independent task of priority processing, when in task groups
Detection task be to handle subtask group according to Cascade algorithms when at least one level cascades subtask group, and then obtain Detection task meter
Calculate result.
A kind of outcome data information quality intelligent checking system preferred embodiment of task based access control model provided by the invention, also
Including memory module and false judgment processing module, which saves the outcome data letter of Data Analysis Services module output
Quality testing report is ceased, false judgment processing module is for judging whether deposit in output data achievement information quality testing report
Auxiliary tool can be used when there are quality testing error message in quality testing error message, according to detection error message pair
The outcome data information of detection is modified, and be will test unsanctioned detection and is formed new task groups, then this is revised
Outcome data information is back to task model and detects again, until in testing result information there is no detection error message, it is above-mentioned
The setting of preferred module enriches system architecture, so that system function is more perfect, and further improves the standard of Data Detection
True property, enhances the unfailing performance of system.
A kind of outcome data information quality intelligent checking system of task based access control model provided by the invention is by task model
Creation module particular job establishes standardized powerful task model, using above-mentioned task model, realizes to task pipe
After managing function, all-mass inspection rule can be created as to the task groups that computer software can be read.All quality examinations
Rule is all defined as after corresponding task groups, it will be appreciated that be to configure mould by the task of component-based development framework establishment
Block, task groups execution module and data analysis and processing module, configuration and scheduler task group automatic execution, be finally completed data at
The quality examination of fruit works.
Below by taking the detection of the outcome data information quality of Wenxi County as an example, to the outcome data of the application task based access control model
Information quality intelligent detecting method is described in detail.
Several Detection task information corresponding to the outcome data various dimensions quality testing factor are carried out based on quality inspection algorithm
Detection task computation modeling, to establish task model.Task model as shown in Table 1 above can be established.Outcome data multidimensional
Spending the quality testing factor includes the integrity detection factor, format type data detecting factor and the consistency detection factor；Wherein, lattice
Formula categorical data detecting factor includes vector data detection, raster data detection, metadata detection；Consistency detection includes：Number
According to consistency detection and junction material consistency detection.Wherein, each of outcome data various dimensions quality testing factor is examined
It surveys the factor and all corresponds to several Detection task information.It should be noted that the corresponding corresponding quality inspection of each single item Detection task is calculated
Method, for example, in quality inspection algorithm, " vector data inspection "-" figure inspection "-" area pattern "-" broken small figure of area pattern
Spot inspection "-" check item requirement "-" when plot element area is less than 1 square metre, should verify the authenticity of plot element ", should
The corresponding quality inspection algorithm of detection is：All plot element figure spots are traversed, the area of each piece of figure spot is sought；If area be greater than etc.
It is just skipped in 1 square metre, prompts plot figure spot XXXX area less than 1 square metre if area is less than 1 square metre, plot please be verify
The authenticity of element；It is completed until all plot figure spots traverse." the broken small figure of area pattern is just completed by aforementioned quality inspection algorithm
The detection of spot ".Through the above steps, task model can be established.
It is executed under the component-based development frame that subsequent step can be regarded as building in application, it can be integrated in one
It is executed in APP, really power registration data achievement information quality intelligent inspection software is managed in referred to as land contract in the countryside.In conjunction with Fig. 6 a~
The preferred working state figure of 6l.Main interface figure is as shown in Figure 6 a, and the top of the main interface is functional area, below functional area
Left side is that newly-built task accesses column, and the right side below functional area is data display area.
Then task groups are created, are the processes of task groups creation referring to Fig. 6 b~6e.Referring to 6b, that is, left side is new
It builds in task access column, checks that the "+" on the right of data task creates quality inspection task clicking, pop-up checks the window of data task
Mouthful, the parameter configuration in the window includes data path to be checked, unit under inspection's title, County Level Regional code, generation in data time
Code, checks the projects such as configuration, configuration inspection item at inspection result path.The inspection of the embodiment is configured to junction inspection.To be checked
Path selection is carried out in the button of data path, as fig. 6 c, clicks position shown in arrow in figure, openable lookup is to be detected
The position of outcome data data information storage, data to be tested can be acquired by choosing, can also direct in the figure to be detected
The position of data to be tested storage is inputted in the path of data file.It determines and acquires performance data to be detected.Again successively into
Each parameter configuration of row in the inspection configuration item of the configuration page, clicks configuration button referring to Fig. 6 d, into choosing check item pair
Talk about frame；Referring to Fig. 6 e, in choosing the check item dialog box page, for the content and data of the outcome data to be detected of acquisition
Detection task required for type is selected from associated Detection task information is to form task groups, required Detection task
It can be all or part of task in the associated Detection task information of outcome data to be detected, data as shown in the drawing
The corresponding several Detection task information of integrity checking (i.e. data integrity detecting factor) include：Bibliographic structure integrality, must
It wants file integrality, vector necessity file integrality, grid necessity file integrality, ownership data source file path, give out a contract for a project
Square mesh records consistency, graph file authentication etc., which is that the check item for the needs chosen (is all appointed for whole options
Business).
Referring to Fig. 6 f~6g, the task groups of formation are directed into task model, clicks and starts review button, task model is held
Whole Detection tasks in row task groups start the inspection of junction task, can check whether Wenxi County's corresponding data meets specification
Property require, and can instant playback Detection task implementation progress, and during the inspection process can real-time display execute state, such as
Progress be 21% when, state be the accordance inspection of vector data identification code, as Fig. 6 g be shown in progress be 23% when, state is boundary
Location line field element code check, Detection task obtain task testing result after being finished, Detection task result information is to arrange
The form of table shows.Referring to Fig. 6 h, testing result can indicate file detection result type, including：Mistake, completion and warning；
Wherein, the expression outcome data information for indicating mistake does not meet code requirement, such as the bibliographic structure integrality of the embodiment
Regulatory requirements are not met with necessary file integrality, therefore the state of testing result is mistake；Indicate the expression of the completion data
Achievement information meets code requirement, such as vector necessity file integrality, the grid necessity integrality, square mesh of giving out a contract for a project of the embodiment
Record consistency, data validity etc. meet Regulatory requirements, therefore the state of testing result is to complete；Mark warning indicates should
There is wrong hidden danger in outcome data information, for example the state of testing result of graph resolution ratio of the embodiment is warning.Referring to
Fig. 6 i clicks error listing, checks error message details, the aforementioned detection error message for indicating mistake includes attribute error information
With Topology Error information.Wherein, attribute error information can check attribute error message details by clicking error listing, and topology is wrong
False information can be checked by ArcGIS map.Miscue is indicated for the testing result of outcome data, can be examined according to quality
Sniffing false information corrects outcome data information, and revised outcome data information is re-entered task model to execute task
Being detected required for group for task, until in output data achievement information quality testing report, all mark is completed, and can pass through intelligence
It can detection.Referring to Fig. 6 j, report button is clicked, the examining report of the quality of data intelligent measurement of Wenxi County can be checked (as being somebody's turn to do
Land contract in the countryside power of management in Wenxi County's shown in figure really weighs registered database quality of achievement audit report), export button is clicked,
Can the examining report be exported and be saved.
Referring to Fig. 6 k~6l, for the task groups created, it is conducted into task model and carries out outcome data quality letter
After breath detection, which can be saved, as shown in Fig. 6 k, preservation task dialogue frame can be popped up by clicking preservation task,
The preservation for completing task groups, obtains task set library.When carrying out outcome data detection next time, outcome data to be detected can be directed to
Data type and content, corresponding task groups are selected in task set library, as shown in Fig. 6 l, click opening task, can beat
Having saved for task is opened, and configures the task groups and is input to task model, completes the intelligent measurement of outcome data information.
It should be pointed out that specific embodiment described above can make those skilled in the art that the present invention be more fully understood
It creates, but do not limit the invention in any way is created.Therefore, although this specification creates the present invention referring to drawings and examples
It makes and has been carried out detailed description, it will be understood by those skilled in the art, however, that still can be modified to the invention
Or equivalent replacement, in short, the technical solution and its improvement of all spirit and scope for not departing from the invention, should all contain
It covers in the protection scope of the invention patent.
Claims (10)
1. a kind of outcome data information quality intelligent detecting method of task based access control model, which is characterized in that the method first will
Several Detection task information corresponding to the outcome data various dimensions quality testing factor are based on quality inspection algorithm progress Detection task
Modeling is calculated, to establish task model；Detection task required for acquiring outcome data to be detected again and selecting is appointed with being formed
Business group；The task groups are input to the task model, are executed by the task model whole in the task groups
Detection task, and then obtain Detection task calculated result；Then the Detection task calculated result is subjected to Data Analysis Services
And output data achievement information quality testing report is to realize intelligent measurement.
2. outcome data information quality intelligent detecting method according to claim 1, which is characterized in that the outcome data
The various dimensions quality testing factor includes the integrity detection factor, format type data detecting factor and the consistency detection factor, institute
Several Detection tasks corresponding to the integrity detection factor are stated to build based on the progress Detection task calculating of data integrity detection algorithm
Mould, vector data Detection task corresponding to the format type data detecting factor are based on detection of attribute algorithm and test pattern
Algorithm carries out Detection task computation modeling, and Property data Detection task corresponding to the format type data detecting factor is based on
Field detection algorithm carries out Detection task computation modeling, the detection of raster data corresponding to the format type data detecting factor
Task is based on raster data algorithm for space analysis and carries out Detection task computation modeling, and the format type data detecting factor institute is right
The metadata Detection task answered carries out Detection task computation modeling based on the detection algorithm of metadata structure, space and content,
Data consistency Detection task corresponding to the consistency detection factor and summarizes table consistency detection task and be based on one
Cause property detection algorithm carries out Detection task computation modeling；The task model is in the model framework of nested type.
3. outcome data information quality intelligent detecting method according to claim 2, which is characterized in that for acquisition to
The content and data type of the outcome data of detection selected from associated Detection task information required for Detection task with
Task groups are formed, required Detection task is whole or portion in the associated Detection task information of outcome data to be detected
Divide task, the Detection task in the task groups includes that independent task and/or at least one level cascade subtask group, the independence are appointed
Business refers to the realizing single specific detection function of the task；The subtask group refers to the realizing multiple specific detection functions of the task.
4. outcome data information quality intelligent detecting method according to claim 3, which is characterized in that be additionally provided with preservation
The task set library of task groups；It is that the task groups being saved is called to obtain from task set library again for outcome data to be detected
The path of outcome data to be detected is to acquire outcome data to be detected and required Detection task is selected to realize task ginseng
The new task groups are input to the task model, the new task groups of formation to form new task groups by number configuration
Also it saves into task set library.
5. outcome data information quality intelligent detecting method according to claim 3, which is characterized in that the task model
Detection task whole in the task groups is executed according to preset priority based on Topology Algorithm, when the detection in task groups
According to each independent task of priority processing when task is independent task, when the Detection task in task groups is at least one level
Subtask group is handled according to Cascade algorithms when cascading subtask group, and then obtains Detection task calculated result.
6. outcome data information quality intelligent detecting method according to one of claims 1 to 5, which is characterized in that defeated
Out there are when quality testing error message in outcome data information quality examining report, the outcome data information that will test is repaired
Just, the quality testing error message includes attribute error information and Topology Error information；The attribute error information passes through mistake
Misrepresentation table checks that the Topology Error information is checked by ArcGIS map, repairs for the quality testing error message viewed
The outcome data information just detected, and execute detection required for task groups by re-entering task model after amendment and appoint
Business, until output data achievement information quality testing report mark data to be tested achievement eliminates detection mistake to reach detection mark
It is quasi-.
7. a kind of outcome data information quality intelligent checking system of task based access control model, which is characterized in that the system comprises
Sequentially connected task model creation module, task configuration module, task groups execution module and data analysis and processing module：
The task model creation module is by several Detection task information corresponding to the outcome data various dimensions quality testing factor
Detection task computation modeling is carried out based on quality inspection algorithm, to establish task model；
Detection task required for the task configuration module acquires outcome data to be detected and selects, will to form task groups
The task groups are input to the task model；
The task groups execution module executes Detection task whole in the task groups by the task model, and then obtains
To Detection task calculated result；
The Detection task calculated result is carried out Data Analysis Services and output data achievement by the Data Analysis Services module
Information quality examining report is to realize intelligent measurement.
8. outcome data information quality intelligent checking system according to claim 7, which is characterized in that further include task groups
Library, the task set library for saving task groups and be connected with the task configuration module, the task configuration module for
The outcome data of detection is the path for calling the task groups being saved to obtain outcome data to be detected again from task set library
To acquire outcome data to be detected and required Detection task selected to realize that task parameters are configured to form new task groups,
And the new task groups are input to the task model, the new task groups of formation are also saved into task set library.
9. outcome data information quality intelligent checking system according to claim 8, which is characterized in that the system is also wrapped
Include memory module and false judgment processing module, the memory module and false judgment processing module with Data Analysis Services mould
Block is connected, and the false judgment processing module is also connected with task groups execution module,
The memory module saves the outcome data information quality examining report of Data Analysis Services module output；
The false judgment processing module is for judging in output data achievement information quality testing report with the presence or absence of quality
Error message is detected, when there are quality testing error message, the outcome data information that will test is modified, the quality inspection
Sniffing false information includes attribute error information and Topology Error information；The attribute error information checked by error listing, institute
Topology Error information is stated to check by ArcGIS map, for view quality testing error message amendment detection data at
Fruit information, and be back to task groups execution module after amendment and executed required for task groups by re-entering task model
Detection task, until output data achievement information quality testing report mark data to be tested achievement eliminates detection mistake to reach
Examination criteria.
10. the outcome data information quality intelligent checking system according to one of claim 7 to 9, which is characterized in that described
Task configuration module for the outcome data to be detected of acquisition content and data type from associated Detection task information
For Detection task required for middle selection to form task groups, required Detection task is that outcome data to be detected is associated
All or part of task in Detection task information, the Detection task in the task groups includes independent task and/or at least one
The task groups are input to the task model by grade cascade subtask group；The task groups execution module passes through the task
Model executes Detection task whole in the task groups, and the task model is based on Topology Algorithm according to preset priority
Detection task whole in the task groups is executed, when the Detection task in task groups is independent task according to priority
Handle each independent task, when the Detection task in task groups be at least one level cascade subtask group when according to Cascade algorithms at
Subtask group is managed, and then obtains Detection task calculated result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810529197.6A CN108830554B (en) | 2018-05-29 | 2018-05-29 | Task model-based intelligent detection method and system for data result information quality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810529197.6A CN108830554B (en) | 2018-05-29 | 2018-05-29 | Task model-based intelligent detection method and system for data result information quality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108830554A true CN108830554A (en) | 2018-11-16 |
| CN108830554B CN108830554B (en) | 2020-07-03 |
Family
ID=64146077
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810529197.6A Active CN108830554B (en) | 2018-05-29 | 2018-05-29 | Task model-based intelligent detection method and system for data result information quality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108830554B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109544341A (en) * | 2018-11-23 | 2019-03-29 | 中链科技有限公司 | Digitizing detection method and device based on block chain |
| CN111563074A (en) * | 2020-04-28 | 2020-08-21 | 厦门市美亚柏科信息股份有限公司 | Data quality detection method and system based on multi-dimensional label |
| CN111625519A (en) * | 2020-05-28 | 2020-09-04 | 杨军 | Data complexity-based space vector data modeling method |
| CN112540989A (en) * | 2020-12-08 | 2021-03-23 | 北京交通大学 | Data authority confirming and managing method based on data exchange log |
| CN115827620A (en) * | 2023-01-10 | 2023-03-21 | 住房和城乡建设部信息中心(住房和城乡建设部住房信息管理中心) | Quality inspection method, device, equipment and storage medium for construction facility transaction data |
| CN115860573A (en) * | 2023-02-03 | 2023-03-28 | 蜀道投资集团有限责任公司 | Highway engineering detection method based on detection items, electronic equipment and readable medium |
| CN116028481A (en) * | 2023-03-30 | 2023-04-28 | 紫金诚征信有限公司 | Data quality detection method, device, equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080195440A1 (en) * | 2006-02-21 | 2008-08-14 | Sugato Bagchi | Data quality management using business process modeling |
| CN103699693A (en) * | 2014-01-10 | 2014-04-02 | 中国南方电网有限责任公司 | Metadata-based data quality management method and system |
| CN107180097A (en) * | 2017-05-16 | 2017-09-19 | 沈阳国源科技发展有限公司 | Really power registers the quality detecting method and device of performance data |
-
2018
- 2018-05-29 CN CN201810529197.6A patent/CN108830554B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080195440A1 (en) * | 2006-02-21 | 2008-08-14 | Sugato Bagchi | Data quality management using business process modeling |
| CN103699693A (en) * | 2014-01-10 | 2014-04-02 | 中国南方电网有限责任公司 | Metadata-based data quality management method and system |
| CN107180097A (en) * | 2017-05-16 | 2017-09-19 | 沈阳国源科技发展有限公司 | Really power registers the quality detecting method and device of performance data |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109544341B (en) * | 2018-11-23 | 2023-07-07 | 苏州朗润创新知识产权运营有限公司 | Digital detection method and device based on block chain |
| CN109544341A (en) * | 2018-11-23 | 2019-03-29 | 中链科技有限公司 | Digitizing detection method and device based on block chain |
| CN111563074A (en) * | 2020-04-28 | 2020-08-21 | 厦门市美亚柏科信息股份有限公司 | Data quality detection method and system based on multi-dimensional label |
| CN111563074B (en) * | 2020-04-28 | 2022-05-31 | 厦门市美亚柏科信息股份有限公司 | Data quality detection method and system based on multi-dimensional label |
| CN111625519A (en) * | 2020-05-28 | 2020-09-04 | 杨军 | Data complexity-based space vector data modeling method |
| CN111625519B (en) * | 2020-05-28 | 2021-03-23 | 杨军 | Data complexity-based space vector data modeling method |
| CN112540989A (en) * | 2020-12-08 | 2021-03-23 | 北京交通大学 | Data authority confirming and managing method based on data exchange log |
| CN112540989B (en) * | 2020-12-08 | 2024-05-03 | 北京交通大学 | Data right-determining and managing method based on data exchange log |
| CN115827620A (en) * | 2023-01-10 | 2023-03-21 | 住房和城乡建设部信息中心(住房和城乡建设部住房信息管理中心) | Quality inspection method, device, equipment and storage medium for construction facility transaction data |
| CN115860573B (en) * | 2023-02-03 | 2023-06-16 | 蜀道投资集团有限责任公司 | Highway engineering detection method based on detection item, electronic equipment and readable medium |
| CN115860573A (en) * | 2023-02-03 | 2023-03-28 | 蜀道投资集团有限责任公司 | Highway engineering detection method based on detection items, electronic equipment and readable medium |
| CN116028481B (en) * | 2023-03-30 | 2023-06-27 | 紫金诚征信有限公司 | Data quality detection method, device, equipment and storage medium |
| CN116028481A (en) * | 2023-03-30 | 2023-04-28 | 紫金诚征信有限公司 | Data quality detection method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108830554B (en) | 2020-07-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108830554A (en) | The outcome data information quality intelligent detecting method and system of task based access control model | |
| CN104756106B (en) | Data source in characterize data storage system | |
| US8799859B2 (en) | Augmented design structure matrix visualizations for software system analysis | |
| US20080155335A1 (en) | Graphical analysis to detect process object anomalies | |
| JP2002530659A (en) | IC test software system for mapping logic functional test data of a logic integrated circuit to a physical representation | |
| Hétroy-Wheeler et al. | Segmentation of tree seedling point clouds into elementary units | |
| CN109033322A (en) | A kind of test method and device of multidimensional data | |
| CN113033516A (en) | Object identification statistical method and device, electronic equipment and storage medium | |
| Möller et al. | rhizoTrak: a flexible open source Fiji plugin for user-friendly manual annotation of time-series images from minirhizotrons | |
| CN116416884A (en) | Testing device and testing method for display module | |
| CN110264392A (en) | A kind of strongly connected graph detection method based on more GPU | |
| CN116909901B (en) | Software performance visual evaluation method based on rich sample radial projection credible clustering | |
| CN111581197B (en) | Method and device for sampling and checking data table in data set | |
| Smith et al. | The geodiv r package: Tools for calculating gradient surface metrics | |
| CN111240978A (en) | Data report generation and analysis method | |
| Korotkova et al. | Decision algorithm with uncertainties in a multi-purpose flight safety system | |
| CN115689126A (en) | Data processing method, device, equipment and medium | |
| Daudt et al. | Learning to understand earth observation images with weak and unreliable ground truth | |
| Khokhlov et al. | Data security and quality evaluation framework: Implementation empirical study on android devices | |
| CN113657179A (en) | Image recognition and modeling method and device, electronic equipment and storage medium | |
| CN104915486B (en) | A kind of part link information search method | |
| US7987203B2 (en) | Method of processing data for a system model | |
| EP4128038A1 (en) | System and method for data validation and correction in a hydrocarbon exploration system | |
| Li et al. | Persistent homology demarcates a leaf morphospace | |
| CN110457705A (en) | A kind of interest point data processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: No. 41 Maizidian Street, Chaoyang District, Beijing 100125 Applicant after: Ministry of Agriculture and Rural Planning and Design Institute Address before: No. 41 Maizidian Street, Chaoyang District, Beijing 100125 Applicant before: Academy of Agricultural Planning and Engineering,MOA |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240428 Address after: 100125 Building 2, national agricultural exhibition hall, No. 16, North East Third Ring Road, Chaoyang District, Beijing Patentee after: Big data development center of the Ministry of agriculture and rural areas Country or region after: China Address before: 100125, No. 41, wheat Street, Chaoyang District, Beijing Patentee before: Ministry of Agriculture and Rural Planning and Design Institute Country or region before: China |