CN109670697A - Marine economy monitoring data method of quality control and device - Google Patents
Marine economy monitoring data method of quality control and device Download PDFInfo
- Publication number
- CN109670697A CN109670697A CN201811523047.0A CN201811523047A CN109670697A CN 109670697 A CN109670697 A CN 109670697A CN 201811523047 A CN201811523047 A CN 201811523047A CN 109670697 A CN109670697 A CN 109670697A
- Authority
- CN
- China
- Prior art keywords
- data
- pending
- reliability
- integrated
- data collection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 238000012544 monitoring process Methods 0.000 title claims abstract description 41
- 238000003908 quality control method Methods 0.000 title claims abstract description 24
- 238000013480 data collection Methods 0.000 claims abstract description 66
- 241001269238 Data Species 0.000 claims abstract description 11
- 238000007689 inspection Methods 0.000 claims description 13
- 230000007812 deficiency Effects 0.000 claims description 4
- 238000012216 screening Methods 0.000 claims description 3
- 239000012141 concentrate Substances 0.000 claims description 2
- 239000000463 material Substances 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 8
- 238000003860 storage Methods 0.000 description 6
- 230000008520 organization Effects 0.000 description 5
- 230000002093 peripheral effect Effects 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000011835 investigation Methods 0.000 description 2
- 239000013535 sea water Substances 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000007430 reference method Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06393—Score-carding, benchmarking or key performance indicator [KPI] analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06395—Quality analysis or management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Entrepreneurship & Innovation (AREA)
- General Physics & Mathematics (AREA)
- Marketing (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Game Theory and Decision Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The present invention provides a kind of marine economy monitoring data method of quality control and devices, this method comprises: acquisition includes the first pending data collection of multiple system data associated with marine economy and multiple integrated datas based on the data collection system constructed in advance；The integrality and repeatability for examining the first pending data collection screen out the incomplete integrated data and/or the duplicate integrated data, using remaining integrated data as the second pending data collection；The accuracy for examining the second pending data collection obtains the accuracy identifier of every data of the second pending data concentration；Reliability level division is carried out for every data that the second pending data is concentrated；Second pending data collection of the output with accuracy identifier and reliability level.The method increase the treatment effeciency of marine economy monitoring data and integral levels, reduce rework operation, save cost of human and material resources.
Description
Technical field
The present invention relates to mobile Internet fields, in particular to a kind of marine economy monitoring data quality controlling party
Method and device.
Background technique
With the continuous expansion of marine economy monitoring mode, pass through traditional canal such as system statistics, Enterprise Data-report System, investigation
The monitoring data that the emerging channel such as road and big data obtains become increasingly abundant, and the marine economy monitored data analysis of formation has covering
The features such as content is wide, and data source is more and confidence level is different, but a comprehensive data quality control method is not yet formed at present
And processing unit, different institutions also can not be general for the processing mode of data accuracy and reliability.In addition, working as marine economy
When the purposes of monitoring data changes, data handling procedure is easy to do over again again, not only influences working efficiency, and pass through to ocean
Ji statistical data management work is made troubles.
Summary of the invention
In view of this, the embodiment of the present invention be designed to provide a kind of marine economy monitoring data method of quality control and
Device, to alleviate the above problem.
In a first aspect, the embodiment of the invention provides a kind of marine economy monitoring data method of quality control, the method
Include: to acquire the first pending data collection the described method includes: based on the data collection system constructed in advance, described first to
Handling data set includes multiple system data associated with marine economy and multiple integrated datas；It examines described first wait locate
The integrality and repeatability for managing data set, screen out the incomplete integrated data and/or the duplicate integrated data, will
The remaining integrated data is as the second pending data collection；The accuracy for examining the second pending data collection, obtains
The accuracy identifier for every data that second pending data is concentrated；Every concentrated for second pending data
Data carry out reliability level division；Second pending data collection of the output with accuracy identifier and reliability level.
Second aspect, the embodiment of the invention provides a kind of marine economy monitoring data quality control apparatus, described devices
Include: acquisition module, for based on the data collection system constructed in advance, acquiring the first pending data collection, described first to
Handling data set includes multiple system data associated with marine economy and multiple integrated datas；Inspection module, for examining
The integrality and repeatability for testing the first pending data collection screen out the incomplete integrated data and/or duplicate
The integrated data, using the remaining integrated data as the second pending data collection；The inspection module is also used to examine
The accuracy of the second pending data collection obtains the accuracy mark for every data that second pending data is concentrated
Symbol；Grade classification module, every data for concentrating for second pending data carry out reliability level division；Output
Module, for exporting the second pending data collection for having accuracy identifier and reliability level.
Compared with prior art, marine economy monitoring data method of quality control and device that various embodiments of the present invention propose
Beneficial effect be: by acquiring the first pending data collection, described first wait locate based on the data collection system constructed in advance
Managing data set includes multiple system data associated with marine economy and multiple integrated datas；It examines described first to be processed
The integrality and repeatability of data set screen out the incomplete integrated data and/or the duplicate integrated data, will remain
Under the integrated data as the second pending data collection；The accuracy for examining the second pending data collection, obtains institute
State the accuracy identifier of every data of the second pending data concentration；The every number concentrated for second pending data
According to progress reliability level division；Second pending data collection of the output with accuracy identifier and reliability level.It should
The process and method of method specification monitoring data quality control, improve the standardization level and data matter of monitoring data processing
Amount, the marine economy monitoring standard data set of production have versatility, improve marine economy monitoring data treatment effeciency and
Integral level reduces rework operation, saves cost of human and material resources.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate
Appended attached drawing, is described in detail below.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair
The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 sets for the electronics of operation marine economy monitoring data method of quality control provided in an embodiment of the present invention, device
Standby structural block diagram；
Fig. 2 is the flow chart for the marine economy monitoring data method of quality control that first embodiment of the invention provides；
Fig. 3 is the structural block diagram for the marine economy monitoring data quality control apparatus that second embodiment of the invention provides.
Specific embodiment
Below in conjunction with attached drawing in the embodiment of the present invention, technical solution in the embodiment of the present invention carries out clear, complete
Ground description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Usually exist
The component of the embodiment of the present invention described and illustrated in attached drawing can be arranged and be designed with a variety of different configurations herein.Cause
This, is not intended to limit claimed invention to the detailed description of the embodiment of the present invention provided in the accompanying drawings below
Range, but it is merely representative of selected embodiment of the invention.Based on the embodiment of the present invention, those skilled in the art are not doing
Every other embodiment obtained under the premise of creative work out, shall fall within the protection scope of the present invention.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.Meanwhile of the invention
In description, term " first ", " second " etc. are only used for distinguishing description, are not understood to indicate or imply relative importance.
As shown in Figure 1, being the structural schematic diagram of electronic equipment 100 provided in an embodiment of the present invention.The electronic equipment 100
It can be PC (personal computer, PC), tablet computer, smart phone, personal digital assistant (personal
Digital assistant, PDA) etc..The electronic equipment 100 may include: marine economy monitoring data quality control dress
Set, memory 110, storage control 120, processor 130, Peripheral Interface 140, input-output unit 150, audio unit 160,
Display unit 170.
The memory 110, storage control 120, processor 130, Peripheral Interface 140, input-output unit 150, sound
Frequency unit 160 and each element of display unit 170 are directly or indirectly electrically connected between each other, with realize data transmission or
Interaction.It is electrically connected for example, these elements can be realized between each other by one or more communication bus or signal wire.The sea
Foreign Economic Monitor data quality control device includes that at least one can be stored in institute in the form of software or firmware (firmware)
State in memory 110 or be solidificated in the software function mould in the operating system (operating system, OS) of client device
Block.The processor 130 is for executing the executable module stored in memory 110, such as the marine economy monitoring data
The software function module or computer program that quality control apparatus includes.
Wherein, memory 110 may be, but not limited to, random access memory (Random Access Memory,
RAM), read-only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only
Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only Memory, EPROM),
Electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only Memory, EEPROM) etc..
Wherein, memory 110 is for storing program, and the processor 130 executes described program after receiving and executing instruction, aforementioned
The method that any embodiment of the embodiment of the present invention discloses can be applied in processor 130, or be realized by processor 130.
Processor 130 may be a kind of IC chip, the processing capacity with signal.Above-mentioned processor 130 can
To be general processor, including central processing unit (Central Processing Unit, abbreviation CPU), network processing unit
(Network Processor, abbreviation NP) etc.；Can also be digital signal processor (DSP), specific integrated circuit (ASIC),
Field programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hard
Part component.It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.General processor
It can be microprocessor or the processor be also possible to any conventional processor etc..
Various input/output devices are couple processor 130 and memory 110 by the Peripheral Interface 140.Some
In embodiment, Peripheral Interface 140, processor 130 and storage control 120 can be realized in one single chip.Other one
In a little examples, they can be realized by independent chip respectively.
Input-output unit 150 is used to be supplied to the interaction that user input data realizes user and electronic equipment 100.It is described
Input-output unit 150 may be, but not limited to, mouse and keyboard etc..
Audio unit 160 provides a user audio interface, may include one or more microphones, one or more raises
Sound device and voicefrequency circuit.
Display unit 170 provides an interactive interface (such as user interface) between electronic equipment 100 and user
Or it is referred to for display image data to user.In the present embodiment, the display unit 170 can be liquid crystal display or touching
Control display.It can be the touching of the capacitance type touch control screen or resistance-type of support single-point and multi-point touch operation if touch control display
Control screen etc..Single-point and multi-point touch operation is supported to refer to that touch control display can sense on the touch control display one or more
The touch control operation generated simultaneously at a position, and the touch control operation that this is sensed transfers to processor 130 to be calculated and handled.
First embodiment
Referring to figure 2., Fig. 2 is a kind of marine economy monitoring data method of quality control that first embodiment of the invention provides
Flow chart, the method be applied to electronic equipment.Process shown in Fig. 2 will be described in detail below, the method packet
It includes:
Step S110: based on the data collection system constructed in advance, the first pending data collection is acquired, described first wait locate
Managing data set includes multiple system data associated with marine economy and multiple integrated datas.
Wherein, the data collection system constructed in advance includes that system data make a report on system and integrated date managment system.
System data make a report on system by the way that account is given coastal provinces and cities, and country periodically urges report and (place management is negative for data acquisition
After duty people enters system, the letters such as template requirement filling index name, data, reporter, date, auditor are imported by system data
Breath, then click submission completion data and report).The integrated data acquired in integrated date managment system, which is mainly derived from, relates to extra large portion
Committee creates data importing template again and periodically imports data completion collecting work after obtaining by modes such as coordination of sending a letter, investigation.
Step S120: examining the integrality and repeatability of the first pending data collection, screens out incomplete described
Integrated data and/or the duplicate integrated data, using the remaining integrated data as the second pending data collection.
Optionally, when checking the integrality of data, the every data that can be concentrated for first pending data,
Examine the data whether include and field information corresponding to the preset field that pre-saves.Wherein, preset field may include
The letters such as statistical regions, enterprise name, business code, index name, index unit, the statistics frequency, index time, data source
Breath.When to be, determine that the data are partial data；Otherwise, it determines the data are deficiency of data.Certain She Hai enterprises pass through
Emphasis relates to (with) extra large Enterprise Data-report System when making a report on data, will very in order to improve reporting and submitting rate and submitting success rate for achievement data
Multi objective extends this as 0, and this kind of achievement data later period is caused not to be available, and problems will also be come out by system test and be regarded as
Exception reports and submits data, needs completion attribute information.
Optionally, when checking the repeatability of data, the every data that can be concentrated for first pending data,
Examine the data whether with the integrated data title having the same and frequency that had reported, the frequency include year,
Season is monthly；When to be, determine that the data are repeated data；Otherwise, it determines the data are not repeated data.
Optionally, after screening out the incomplete integrated data and/or the duplicate integrated data, the method
Further include: display screens out reason in the display interface, and the reason that screens out includes: that data are imperfect and/or Data duplication is submitted.
For example, system can prompt " repeated index please don't repeat to report and submit " when detecting that data have repetition.
Step S130: examining the accuracy of the second pending data collection, obtains second pending data and concentrates
Every data accuracy identifier.
When carrying out Test of accuracy, following methods can be taken:
1: logical relation is examined, and refers to that there is increase and decrease balance, relative scale, subitem structure etc. between marine economy monitoring index patrols
The relationship of collecting.Logical relation is broadly divided into increase and decrease logical relation between marine economy monitoring index and interrelated logic relationship, increase and decrease are patrolled
Volume relationship refer to the monitoring index in table or between table exist it is total be equal to the sum of subitem, high frequency index is equal to corresponding low frequency index aggregation
Deng；Interrelated logic relationship mainly includes the structural relation etc. between proportionate relationship, part index number and global index between index.
Such as: necessary logic auditing rule is set by making a report in system in system, can be deposited making a report on link and verifying
Logical relation mistake.
It is examined by logical relation, the oceans in 2016 that discovery Shandong Province, Fujian Province, Jiangsu Province, Guangdong Province report and submit for the first time
The sum of fishery value added and marine aquatic product, marine fishery services industry and marine aquatic product processing value added, there are logic errors；
It is each that the 1-10 month to date operating incomes in 2017 that Shandong International Biotechnology Park Development Co., Ltd. reports and submits are not equal to the 1-10 month
Month the sum of operating income, there are logic errors；It is directly sharp that the direct cooling seawater amounts in 2011 that Jiangsu Province reports and submits are greater than seawater
With total amount, there are logical relation mistakes；The 1-4 month to date main businesses in 2018 that upper Hainan Airlines scholar ocean science Co., Ltd reports
The ratio of income and accumulative main business cost is 79, is higher than average level, the quality of data has suspicious.
2: codomain term of reference is examined, and each marine economy monitoring index has its corresponding codomain range, passes through codomain
Statistical rules can detect the bound whether index exceeds codomain.Codomain term of reference method of inspection include history section maximum most
Small value method, growth rate max min method, method of percentiles, normal distribution method etc. in real work, generally use first 2 kinds
Method, i.e., by calculating monitoring index last decade or maximum value and minimum value within the scope of the longer time or the target rate of growth
Maximum value and minimum value are adjusted accordingly in this, as reference, and in conjunction with expertise, the comprehensive codomain reference for determining index
Range.Numerical value beyond monitoring index threshold range need to contact statistical organization and carry out communication solution as dubious value.Especially note
Meaning differs more person's (1000 times etc.) to certain index value orders of magnitude, it may be possible to which index unit reports and submits mistake to cause.
3: it is inconsistent to cause, it need to be verified to statistical organization.
Such as: by the codomain method of inspection based on growth rate max min, and method of expertise is combined, can integrated really
The codomain range for determining sea fishery value added speedup is [- 3%, 15%], relate to extra large enterprise assets amount to speedup range be [10%,
30%].The sea fishery value added speedups in 2015 that Administration of Ocean and Fisheries, Zhejiang Province reports and submits are up to 1384%, are much larger than threshold value,
There are suspicious, need to be verified to statistical organization；The assets in January, 2018 that off-lying sea fortune heavy industry Co., Ltd reports and submits in Guangdong, which amount to, to be increased
Rate is 571950%, is much larger than 30%, there are suspicious, need to be verified to statistical organization.
4: incidence coefficient examine, in marine economy development system, often exist a fruit mostly because relationship, by " fruit " conduct
Reference sequence, " because " ordered series of numbers (industrial economy, coastal economy, national economy, world economy etc. index) as a comparison, can count
It calculates and obtains the related coefficient sequence from the base period to target phase reference sequence each comparison ordered series of numbers variable, due to these variable phases
There are internal logical relationships between mutually, therefore developing state should also keep certain convergent (anti-) property between variable, so that it is closed
Connection numerical value should also have certain interval range.If the numerical value of incidence coefficient dramatically changes since certain time point or by bearing
(just) number switchs to positive (negative) number, illustrates reference sequence index point data and comparison ordered series of numbers correlation decrease or development trend at this
It is away from each other, there are dubiety, needs further to verify and confirm the accuracy of data.
For example, showing that the sea fishery output value data reported and submitted in Fujian Province in 2016 are suspicious according to the inspection of incidence coefficient method.From
It theoretically sees, the sea fishery output value and marine and aquatic product yield are strong positive correlation, 2007 to the 2016 years seas reported and submitted according to Fujian Province
2007 to 2016 years Fujian Province's marine and aquatic product yield datas that foreign fishery output value data and State Statistics Bureau announce, are calculated two
Index series is in 2007-2008,2007-2009,2007-2010,2007-2011,2007-2012,2007-2013,2007-
2014, the related coefficient in the year section 2007-2015,2007-2016 be respectively 100.0%, 89.9%, 96.0%,
96.7%, 98.1%, 98.9%, 98.7%, 98.4% and 53.6%, it is known that the two indexs in 2015 and before be strong just
Correlation meets economic theory, but 2016 yearly correlation coefficient values are greatly reduced, and weak positive relevant relationship is presented between variable, that is, says
It reports and submits data to have dubiety within bright 2016, needs to verify to statistical organization.
Step S140: reliability level division is carried out for every data that second pending data is concentrated.
When determining the degree of reliability of every kind of data source, reliability assessment indicator system can be constructed first, from data
Timeliness, accessibility, can multiple dimensions such as connecting, comparativity, the transparency, user satisfaction evaluated, then pass through
The score value of the comprehensive weight for determining each evaluative dimension and every kind of source such as analytic hierarchy process (AHP), expert survey is calculated every
The reliability score value of kind data source；High-reliability, general reliability, weak reliable is finally divided into according to reliability score value
Spend three ranks.Data producer and user can carry out targetedly screening according to the reliability level of data source in this way makes
With.
The case where according to same index different data source, need the synthesis rank to every kind of data source to be assessed with
Determine its degree of reliability, specific formula for calculation is as follows:
Wherein, RjFor the reliability of jth kind data source, wiFor the weight of i-th of evaluative dimension, xijFor jth kind data
The score value of i-th of source evaluative dimension.According to the R of above-mentioned calculatingjValue, according to its size order, its degree of reliability is divided etc.
Grade, is generally divided into three high-reliability, general reliability, weak reliability ranks.
For example, there are Ministry of Communications, statistics bureau, third party database in coastal area harbour passenger-cargo handling capacity achievement data source
(such as wind database) 3 kinds of channels, it is assumed that its reliability is respectively R1、R2、R3, each evaluation has been determined by expert survey
The score value of the weight of dimension and the corresponding each evaluative dimension of every kind of data source, is finally calculated reliability R according to formula1
=87, R2=83, R3=79, it is divided into 3 ranks by reliability score value, respectively high-reliability, general reliability and weak reliable
Degree.
Step S150: second pending data collection of the output with accuracy identifier and reliability level.
A kind of marine economy monitoring data method of quality control that first embodiment of the invention provides, by being based on preparatory structure
The data collection system built acquires the first pending data collection, and the first pending data collection includes multiple and marine economy
Associated system data and multiple integrated datas；The integrality and repeatability of the first pending data collection are examined,
The incomplete integrated data and/or the duplicate integrated data are screened out, using the remaining integrated data as second
Pending data collection；The accuracy for examining the second pending data collection obtains the every of the second pending data concentration
The accuracy identifier of data；Reliability level division is carried out for every data that second pending data is concentrated；It is defeated
The second pending data collection with accuracy identifier and reliability level out.The monitoring data quality controls of this method specification
The process and method of system, improve the standardization level and the quality of data of monitoring data processing, and the marine economy of production monitors mark
Quasi- data set has versatility, improves the treatment effeciency and integral level of marine economy monitoring data, reduces rework operation,
Save cost of human and material resources.
Second embodiment
Referring to figure 3., Fig. 3 is a kind of marine economy monitoring data quality control apparatus that second embodiment of the invention provides
400 structural block diagram.Structural block diagram shown in Fig. 3 will be illustrated below, shown device includes:
Acquisition module 410, it is described for acquiring the first pending data collection based on the data collection system constructed in advance
First pending data collection includes multiple system data associated with marine economy and multiple integrated datas；
Inspection module 420 screens out imperfect for examining the integrality and repeatability of the first pending data collection
The integrated data and/or the duplicate integrated data, using the remaining integrated data as the second pending data
Collection；
The inspection module 420 is also used to examine the accuracy of the second pending data collection, obtain described second to
Handle the accuracy identifier of every data in data set；
Grade classification module 430, every data for concentrating for second pending data carry out reliability level
It divides；
Output module 440, for exporting the second pending data collection for having accuracy identifier and reliability level.
Optionally, described device further includes display module, screens out reason for showing in the display interface, described to screen out original
Because including: that data are imperfect and/or Data duplication is submitted.
Optionally, the inspection module 420, every data for concentrating for first pending data, is examined
The data whether include and field information corresponding to the preset field that pre-saves；When to be, determine that the data are complete
Data；Otherwise, it determines the data are deficiency of data.
Optionally, the inspection module 420, every data for concentrating for first pending data, is examined
The data whether with the integrated data title having the same and frequency that had reported, the frequency includes year, season
Or it is monthly；When to be, determine that the data are repeated data；Otherwise, it determines the data are not repeated data.
Optionally, the grade classification module 430, every data for being concentrated for second pending data,
Calculate the reliability score value of the data；Based on the reliability score value, reliability level is divided for the data.Described reliability etc.
Grade includes high-reliability, general reliability and weak reliability.
Mistake of the present embodiment to the respective function of each Implement of Function Module of marine economy monitoring data quality control apparatus 400
Journey refers to content described in above-mentioned Fig. 1 to embodiment illustrated in fig. 2, and details are not described herein again.
In conclusion marine economy monitoring data method of quality control and device that the embodiment of the present invention proposes, pass through base
In the data collection system constructed in advance, acquire the first pending data collection, the first pending data collection include it is multiple with
The associated system data of marine economy and multiple integrated datas；Examine the first pending data collection integrality and
Repeatability screens out the incomplete integrated data and/or the duplicate integrated data, and the remaining integrated data is made
For the second pending data collection；The accuracy for examining the second pending data collection obtains the second pending data collection
In every data accuracy identifier；Reliability level is carried out for every data that second pending data is concentrated to draw
Point；Second pending data collection of the output with accuracy identifier and reliability level.This method specification monitoring data
The process and method of quality control, improve the standardization level and the quality of data of monitoring data processing, the marine economy of production
Monitoring standard data set has versatility, improves the treatment effeciency and integral level of marine economy monitoring data, reduces and return
Work operation, saves cost of human and material resources.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through
Other modes are realized.The apparatus embodiments described above are merely exemplary, for example, flow chart and block diagram in attached drawing
Show the device of multiple embodiments according to the present invention, the architectural framework in the cards of method and computer program product,
Function and operation.In this regard, each box in flowchart or block diagram can represent the one of a module, section or code
Part, a part of the module, section or code, which includes that one or more is for implementing the specified logical function, to be held
Row instruction.It should also be noted that function marked in the box can also be to be different from some implementations as replacement
The sequence marked in attached drawing occurs.For example, two continuous boxes can actually be basically executed in parallel, they are sometimes
It can execute in the opposite order, this depends on the function involved.It is also noted that every in block diagram and or flow chart
The combination of box in a box and block diagram and or flow chart can use the dedicated base for executing defined function or movement
It realizes, or can realize using a combination of dedicated hardware and computer instructions in the system of hardware.
In addition, each functional module in each embodiment of the present invention can integrate one independent portion of formation together
Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module
It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.It needs
Illustrate, herein, relational terms such as first and second and the like be used merely to by an entity or operation with
Another entity or operation distinguish, and without necessarily requiring or implying between these entities or operation, there are any this realities
The relationship or sequence on border.Moreover, the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability
Contain, so that the process, method, article or equipment for including a series of elements not only includes those elements, but also including
Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device.
In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element
Process, method, article or equipment in there is also other identical elements.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field
For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair
Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.It should also be noted that similar label and letter exist
Similar terms are indicated in following attached drawing, therefore, once being defined in a certain Xiang Yi attached drawing, are then not required in subsequent attached drawing
It is further defined and explained.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. a kind of marine economy monitoring data method of quality control, which is characterized in that the described method includes:
Based on the data collection system constructed in advance, the first pending data collection is acquired, the first pending data collection includes
Multiple system data associated with marine economy and multiple integrated datas；
The integrality and repeatability for examining the first pending data collection, screen out the incomplete integrated data and/or
The duplicate integrated data, using the remaining integrated data as the second pending data collection；
The accuracy for examining the second pending data collection obtains the standard for every data that second pending data is concentrated
True property identifier；
Reliability level division is carried out for every data that second pending data is concentrated；
Second pending data collection of the output with accuracy identifier and reliability level.
2. the method according to claim 1, wherein screening out the incomplete integrated data and/or repetition
The integrated data after, the method also includes:
Display screens out reason in the display interface, and the reason that screens out includes: that data are imperfect and/or Data duplication is submitted.
3. being wrapped the method according to claim 1, wherein examining the integrality of the first pending data collection
It includes:
For every data that first pending data is concentrated, examine the data whether include and the predetermined word that pre-saves
Field information corresponding to section；
When to be, determine that the data are partial data；
Otherwise, it determines the data are deficiency of data.
4. being wrapped the method according to claim 1, wherein examining the repeatability of the first pending data collection
It includes:
For every data that first pending data is concentrated, examine the data whether with the integrated data that had reported
Title having the same and frequency, the frequency include year, season or monthly；
When to be, determine that the data are repeated data；
Otherwise, it determines the data are not repeated data.
5. the method according to claim 1, wherein for second pending data concentrate every data into
Row reliability level divides, comprising:
For every data that second pending data is concentrated, the reliability score value of the data is calculated；
Based on the reliability score value, reliability level is divided for the data, and the reliability level includes high-reliability, general
Reliability and weak reliability.
6. a kind of marine economy monitoring data quality control apparatus, which is characterized in that described device includes:
Acquisition module, for acquiring the first pending data collection, described first wait locate based on the data collection system constructed in advance
Managing data set includes multiple system data associated with marine economy and multiple integrated datas；
Inspection module screens out incomplete described for examining the integrality and repeatability of the first pending data collection
Integrated data and/or the duplicate integrated data, using the remaining integrated data as the second pending data collection；
The inspection module is also used to examine the accuracy of the second pending data collection, obtains the described second number to be processed
According to the accuracy identifier of every data of concentration；
Grade classification module, every data for concentrating for second pending data carry out reliability level division；
Output module, for exporting the second pending data collection for having accuracy identifier and reliability level.
7. device according to claim 6, which is characterized in that described device further includes display module, on display circle
Display screens out reason on face, and the reason that screens out includes: that data are imperfect and/or Data duplication is submitted.
8. device according to claim 6, which is characterized in that the inspection module, for be processed for described first
Every data in data set, examine the data whether include and field information corresponding to the preset field that pre-saves；?
When to be, determine that the data are partial data；Otherwise, it determines the data are deficiency of data.
9. device according to claim 6, which is characterized in that the inspection module, for be processed for described first
Every data in data set, examine the data whether with the integrated data title having the same and frequency that had reported
Degree, the frequency include year, season or monthly；When to be, determine that the data are repeated data；Otherwise, it determines the number
According to for not repeated data.
10. device according to claim 6, which is characterized in that the grade classification module, for for described second to
Every data in data set is handled, the reliability score value of the data is calculated；Based on the reliability score value, for data division
Reliability level, the reliability level include high-reliability, general reliability and weak reliability.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811523047.0A CN109670697A (en) | 2018-12-12 | 2018-12-12 | Marine economy monitoring data method of quality control and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811523047.0A CN109670697A (en) | 2018-12-12 | 2018-12-12 | Marine economy monitoring data method of quality control and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109670697A true CN109670697A (en) | 2019-04-23 |
Family
ID=66144300
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811523047.0A Pending CN109670697A (en) | 2018-12-12 | 2018-12-12 | Marine economy monitoring data method of quality control and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109670697A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102651093A (en) * | 2012-03-31 | 2012-08-29 | 上海海洋大学 | Marine information management system based on time series outlier detection technology |
| CN106649881A (en) * | 2017-01-10 | 2017-05-10 | 国家海洋信息中心 | Processing method and system of ocean engineering environment survey data |
-
2018
- 2018-12-12 CN CN201811523047.0A patent/CN109670697A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102651093A (en) * | 2012-03-31 | 2012-08-29 | 上海海洋大学 | Marine information management system based on time series outlier detection technology |
| CN106649881A (en) * | 2017-01-10 | 2017-05-10 | 国家海洋信息中心 | Processing method and system of ocean engineering environment survey data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11544793B2 (en) | Dimensionality reduction of multi-attribute consumer profiles | |
| US11532052B2 (en) | Using simulated consumer profiles to form calibration data for models | |
| US20190333078A1 (en) | Methods of assessing long-term indicators of sentiment | |
| Arbesser et al. | Visplause: Visual data quality assessment of many time series using plausibility checks | |
| US20180336638A1 (en) | Classifying rate factors in consumer profiles based on effects of the factors in high-dimensional models | |
| AU2012231158B2 (en) | Credibility scoring and reporting | |
| US20180336640A1 (en) | Rate analyzer models and user interfaces | |
| CN109522746A (en) | A kind of data processing method, electronic equipment and computer storage medium | |
| CN110347561A (en) | Monitoring alarm method and terminal device | |
| US20160132798A1 (en) | Service-level agreement analysis | |
| CN109582859B (en) | Insurance pushing method and device, computer equipment and storage medium | |
| CN108268624A (en) | User data method for visualizing and system | |
| CN108519989A (en) | The reduction retroactive method and device of a kind of day electricity missing data | |
| CN105740434B (en) | Network information methods of marking and device | |
| CN115641019A (en) | Index anomaly analysis method and device, computer equipment and storage medium | |
| CN109359874A (en) | A kind of multidimensional index monitoring and early warning method and device | |
| CN112927050A (en) | Method and device for determining financial product to be recommended, electronic equipment and storage medium | |
| US20190205341A1 (en) | Systems and methods for measuring collected content significance | |
| CN104820719A (en) | Web service creditworthiness measuring method based on context data of user | |
| Lyu et al. | Three-level views of the web service network: an empirical study based on programmableweb | |
| CN108074108A (en) | A kind of display methods and its terminal of net recommendation | |
| CN109670697A (en) | Marine economy monitoring data method of quality control and device | |
| CN110489732A (en) | Method for processing report data and equipment | |
| Bertrand et al. | Overfitting of Hurst estimators for multifractional Brownian motion: A fitting test advocating simple models | |
| CN107016044A (en) | A kind of method and device of data visualization processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zheng Li Inventor after: Guo Yue Inventor after: Fu Ruiquan Inventor after: Song Weiling Inventor after: Peng Xing Inventor after: Hua Rong Inventor after: Huang Chao Inventor before: Guo Yue Inventor before: Zheng Li Inventor before: Fu Ruiquan Inventor before: Peng Xing Inventor before: Song Weiling Inventor before: Hua Rong Inventor before: Huang Chao |
|
| CB03 | Change of inventor or designer information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190423 |
|
| RJ01 | Rejection of invention patent application after publication |