CN106529891A - Platform data cleaning method - Google Patents
Platform data cleaning method Download PDFInfo
- Publication number
- CN106529891A CN106529891A CN201610639998.9A CN201610639998A CN106529891A CN 106529891 A CN106529891 A CN 106529891A CN 201610639998 A CN201610639998 A CN 201610639998A CN 106529891 A CN106529891 A CN 106529891A
- Authority
- CN
- China
- Prior art keywords
- data
- platform
- group
- template
- checking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Economics (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a platform data cleaning method. A user inputs an account name and a password, and then enters a data importing interface, and then continues to carry out the following steps: S1, importing data; S2, checking the data which is not successfully imported; S3, verifying the data of an extracting layer; S4, exporting non-standard data of the extracting layer; S5 synchronizing the data to a central layer; S6, verifying the data of the central layer; S7, exporting the central non-standard data; S8, exporting the data of the central layer. The method provides an effective data management method for a group enterprise, branch companies and second-level mechanisms of other provincial companies, can effectively detect the error data and give a prompt, and guarantees the effective monitoring of data.
Description
Technical field
The invention belongs to cell art, particularly a kind of intelligent lighting power supply.
Background technology
At present, in enterprise platform data management field, the importing and statistics to information data is mainly by simple artificial
Come what is carried out, this does not much reach the requirement of management in the response speed of Job events, in addition environmental sanitation service management point for management
Many, Real-time Collection has high demands, and workload is big, and statistical accuracy has high demands, and the mode of labor management is not reached at all in real time
Collection and the requirement of quick response.
The content of the invention
For solving above-mentioned technical problem, the invention provides a kind of platform data method for cleaning, user input account name with
Password, enters into data and imports interface, and which continues executing with following steps：
S1：Data are imported：
S11：Tissue distribution described in data：According to the affiliated tissue distribution data of login personnel, this platform data is divided into collection
Company of group and branch company and other company's secondary facilities, group company's login system have the authority of all data of management, point public affairs
Department and other company's secondary facilities have the authority for operating oneself related data；
S12：Obtain data template：
The index that higher level issues, can be quick to position by coding or index name module polls, if pure craft refers to
Mark, then can download empty template, by empty template button below, then be input into downloads template after corresponding index item title, enter
Row data are filled in, if the manual index with system, then can be with download system initial data template table, and and manual Mandatory fields；
S13：Import：After user fills index item table, the index item table for selecting oneself to fill in is browsed, selection completes laggard
Row is imported, and before importing data, mathematical logic is deleted, to distinguish upper secondary data after index item is chosen；If data are filled out
Write error can point out to import the data strip number of error, check wrong data by step S3；
S2：Check importing miss data：
The data malfunctioned in step S1 are checked, importing is re-started after modifying；
S3：Abstraction, layer data verification：
Data are carried out with preliminary check in abstraction, layer, concrete data include major key repetition, length, numeric type, date class
Type, data dictionary value, single table amount of money checking, checking terminate to point out success or not, the prompting failure bar number if checking, and by mistake
Data are derived by step S4 by mistake；
S4：Abstraction, layer data lack of standardization are derived：
The wrong data of deriving step S3, repeats above steps after modification；
S5：Data syn-chronization is to intermediate layer：
By data syn-chronization to intermediate layer database, verified according to presetting rule；
S6：Intermediate layer data verification:
Verified according to presetting rule, including the checking whether the old and new's conversion completes to operate, terminated meeting in checking
Prompting success or not, points out unsuccessfully bar number, wrong data be derived by step S7 if authentication failed；
S7：Middle data lack of standardization are derived：
Wrong data in deriving step S6, repeats each step above after modification；
S8：Middle layer data is derived：
If checking all passes through, whether inspection system data are consistent with importing data.
It is preferred that further comprising the steps of after step S8：
S9：Data are derived：
Index is issued according to organization unit, group derives intermediate layer authentication error and group's data platform authentication error number
According to.
It is preferred that further comprising the steps of after step S9：
S10：Quality of data management and control：
Display to the user that the process log recording of index item, two level checkings by situation and report group's number
According to the time of platform, the monitor in real time of data is realized.
It is preferred that further comprising the steps of after step S10：
S11：Group is reported to operate：
When province end cleaning platform validation all passes through, data are reported group's data platform carries out deeper testing
Card；Whether, after selecting corresponding index item, click reports button, report and successfully can all be pointed out；When group's data platform
After the completion of process, corresponding index can be selected, click on verification of synchronization results button, realize taking for group's data platform wrong data
Return and derive, processed for each branch company of districts and cities, secondary facility, third party developer related personnel.
It is preferred that also including step：
S12：Importing after group's template change：
When group's template is changed, new group's template can be imported in back-end data base by this step, be realized
The quick succinct modification of template.
The invention has the advantages that：
The platform data method for cleaning that the present invention is provided is carried with branch company and other provincial company secondary facilities for group company
Effective data managing method is supplied, wrong data can have timely and effectively been detected and be made prompting, it is ensured that data are had
Effect monitoring.
Certainly, the arbitrary product for implementing the present invention is it is not absolutely required to while reaching all the above advantage.
Specific embodiment
The technical scheme in the present invention is clearly and completely described below in conjunction with the embodiment of the present invention, it is clear that institute
The embodiment of description is only a part of embodiment of the invention, rather than the embodiment of whole.Based on the embodiment in the present invention,
All other embodiment that those of ordinary skill in the art are obtained under the premise of creative work is not made, belongs to this
The scope of bright protection.
A kind of platform data method for cleaning, user input account name and password is embodiments provided, number is entered into
According to interface is imported, which continues executing with following steps：
S1：Data are imported：
S11：Tissue distribution described in data：According to the affiliated tissue distribution data of login personnel, this platform data is divided into collection
Company of group and branch company and its company's secondary facility, group company's login system have the authority of all data of management, branch company
And other company's secondary facilities have the authority for operating oneself related data；
S12：Obtain data template：
The index that higher level issues, can be quick to position by coding or index name module polls, if pure craft refers to
Mark, then can download empty template, by empty template button below, then be input into downloads template after corresponding index item title, enter
Row data are filled in, if the manual index with system, then can be with download system initial data template table, and and manual Mandatory fields；
S13：Import：After user fills index item table, the index item table for selecting oneself to fill in is browsed, selection completes laggard
Row is imported, and before importing data, mathematical logic is deleted, to distinguish upper secondary data after index item is chosen；If data are filled out
Write error can point out to import the data strip number of error, check wrong data by step S3；
S2：Check importing miss data：
The data malfunctioned in step S1 are checked, importing is re-started after modifying；
S3：Abstraction, layer data verification：
Data are carried out with preliminary check in abstraction, layer, concrete data include major key repetition, length, numeric type, date class
Type, data dictionary value, single table amount of money checking, checking terminate to point out success or not, the prompting failure bar number if checking, and by mistake
Data are derived by step S4 by mistake；
S4：Abstraction, layer data lack of standardization are derived：
The wrong data of deriving step S3, repeats above steps after modification；
S5：Data syn-chronization is to intermediate layer：
By data syn-chronization to intermediate layer database, verified according to presetting rule；
S6：Intermediate layer data verification:
Verified according to presetting rule, including the checking whether the old and new's conversion completes to operate, terminated meeting in checking
Prompting success or not, points out unsuccessfully bar number, wrong data be derived by step S7 if authentication failed；
S7：Middle data lack of standardization are derived：
Wrong data in deriving step S6, repeats each step above after modification；
S8：Middle layer data is derived：
If checking all passes through, whether inspection system data are consistent with importing data.
It is further comprising the steps of after step S8 in the present embodiment：
S9：Data are derived：
Index is issued according to organization unit, group derives intermediate layer authentication error and group's data platform authentication error number
According to.
It is further comprising the steps of after step S9：
S10：Quality of data management and control：
Display to the user that the process log recording of index item, two level checkings by situation and report group's number
According to the time of platform, the monitor in real time of data is realized.
It is further comprising the steps of after step S10：
S11：Group is reported to operate：
When province end cleaning platform validation all passes through, data are reported group's data platform carries out deeper testing
Card；Whether, after selecting corresponding index item, click reports button, report and successfully can all be pointed out；When group's data platform
After the completion of process, corresponding index can be selected, click on verification of synchronization results button, realize taking for group's data platform wrong data
Return and derive, processed for each branch company of districts and cities, secondary facility, third party developer related personnel.
Also include step：
S12：Importing after group's template change：
When group's template is changed, new group's template can be imported in back-end data base by this step, be realized
The quick succinct modification of template.
The platform data method for cleaning that the present invention is provided is carried with branch company and other provincial company secondary facilities for group company
Effective data managing method is supplied, wrong data can have timely and effectively been detected and be made prompting, it is ensured that data are had
Effect monitoring.
Present invention disclosed above preferred embodiment is only intended to help and illustrates the present invention.Preferred embodiment is not detailed
All of details is described, it is only described specific embodiment also not limit the invention.Obviously, the content according to this specification,
Can make many modifications and variations.These embodiments are chosen and specifically described to this specification, is to preferably explain the present invention
Principle and practical application so that skilled artisan can be best understood by and utilize the present invention.The present invention is only
Limited by claims and its four corner and equivalent.
Claims (5)
1. a kind of platform data method for cleaning, user input account name and password, enter into data and import interface, and its feature exists
In continuing executing with following steps：
S1：Data are imported：
S11：Tissue distribution described in data：According to the affiliated tissue distribution data of login personnel, it is public that this platform data is divided into group
Department and branch company and other company's secondary facilities, group company's login system have an authority of all data of management, branch company and
Other company's secondary facilities have the authority for operating oneself related data；
S12：Obtain data template：
The index that higher level issues, can be quick to position by coding or index name module polls, if pure manual index,
Empty template can be then downloaded, by empty template button below, then downloads template after corresponding index item title is input into, is entered line number
According to filling in, if the manual index with system, then can be with download system initial data template table, and manual Mandatory fields；
S13：Import：After user fills index item table, the index item table for selecting oneself to fill in is browsed, is led after the completion of selection
Enter, before data being imported after index item is chosen, mathematical logic is deleted, to distinguish upper secondary data；If data fill in mistake
Misunderstand the data strip number that prompting imports error, wrong data is checked by step S3；
S2：Check importing miss data：
The data malfunctioned in step S1 are checked, importing is re-started after modifying；
S3：Abstraction, layer data verification：
Data are carried out with preliminary check in abstraction, layer, concrete data include major key repetition, length, numeric type, date type, number
According to dictionary value, single table amount of money checking, checking terminates to point out success or not, the prompting failure bar number if checking, and by error number
According to being derived by step S4；
S4：Abstraction, layer data lack of standardization are derived：
The wrong data of deriving step S3, repeats above steps after modification；
S5：Data syn-chronization is to intermediate layer：
By data syn-chronization to intermediate layer database, verified according to presetting rule；
S6：Intermediate layer data verification:
Verified according to presetting rule, including the checking whether the old and new's conversion completes to operate, terminate to point out in checking
Success or not, points out unsuccessfully bar number, wrong data be derived by step S7 if authentication failed；
S7：Middle data lack of standardization are derived：
Wrong data in deriving step S6, repeats each step above after modification；
S8：Middle layer data is derived：
If checking all passes through, whether inspection system data are consistent with importing data.
2. platform data method for cleaning as claimed in claim 1, it is characterised in that further comprising the steps of after step S8：
S9：Data are derived：
Index is issued according to organization unit, group derives intermediate layer authentication error and group's data platform authentication error data.
3. platform data method for cleaning as claimed in claim 2, it is characterised in that further comprising the steps of after step S9：
S10：Quality of data management and control：
Display to the user that the process log recording of index item, two level checkings by situation and report group's data and put down
The time of platform, realize the monitor in real time of data.
4. platform data method for cleaning as claimed in claim 3, it is characterised in that further comprising the steps of after step S10：
S11：Group is reported to operate：
When province end cleaning platform validation all passes through, data are reported group's data platform carries out deeper checking；Choosing
Whether, after selecting corresponding index item, click reports button, report and successfully can all be pointed out；When group, data platform has been processed
Cheng Hou, can select corresponding index, click on verification of synchronization results button, realize fetching and leading for group's data platform wrong data
Go out, processed for each branch company of districts and cities, secondary facility, third party developer related personnel.
5. platform data method for cleaning as claimed in claim 4, it is characterised in that also including step：
S12：Importing after group's template change：
When group's template is changed, new group's template can be imported in back-end data base by this step, realize template
Quick succinct modification.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610639998.9A CN106529891A (en) | 2016-08-05 | 2016-08-05 | Platform data cleaning method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610639998.9A CN106529891A (en) | 2016-08-05 | 2016-08-05 | Platform data cleaning method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106529891A true CN106529891A (en) | 2017-03-22 |
Family
ID=58343470
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610639998.9A Pending CN106529891A (en) | 2016-08-05 | 2016-08-05 | Platform data cleaning method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106529891A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108009146A (en) * | 2017-12-25 | 2018-05-08 | 重庆满荣网络技术有限公司 | intelligent campus management method |
| CN112052284A (en) * | 2020-08-26 | 2020-12-08 | 南京越扬科技有限公司 | Main data management method and system under big data |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473654A (en) * | 2013-09-23 | 2013-12-25 | 国家电网公司 | Asset data cleaning auxiliary method and system for electric ERP system |
| CN105930523A (en) * | 2016-05-25 | 2016-09-07 | 中国科学院新疆理化技术研究所 | Dynamic configurable rule-based data cleaning framework under big data background |
| CN106095837A (en) * | 2016-06-01 | 2016-11-09 | 杭州中奥科技有限公司 | It is applicable to data system and the data processing method of industrial and commercial all kinds of business |
-
2016
- 2016-08-05 CN CN201610639998.9A patent/CN106529891A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473654A (en) * | 2013-09-23 | 2013-12-25 | 国家电网公司 | Asset data cleaning auxiliary method and system for electric ERP system |
| CN105930523A (en) * | 2016-05-25 | 2016-09-07 | 中国科学院新疆理化技术研究所 | Dynamic configurable rule-based data cleaning framework under big data background |
| CN106095837A (en) * | 2016-06-01 | 2016-11-09 | 杭州中奥科技有限公司 | It is applicable to data system and the data processing method of industrial and commercial all kinds of business |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108009146A (en) * | 2017-12-25 | 2018-05-08 | 重庆满荣网络技术有限公司 | intelligent campus management method |
| CN112052284A (en) * | 2020-08-26 | 2020-12-08 | 南京越扬科技有限公司 | Main data management method and system under big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109118123B (en) | BIM management method for evaluating construction quality of water conservancy and hydropower engineering | |
| CN102591223B (en) | Intelligentized diagnostic system of substation-operation operation tickets | |
| CN209118416U (en) | Intelligence tool management equipment | |
| CN111767247A (en) | File specification and synchronous forming control platform for real-time supervision of engineering data | |
| CN103389705A (en) | Operation monitoring system and method | |
| US12137177B2 (en) | Credible alliance blockchain digital calibration certificate system and operation method therefor | |
| CN107168940A (en) | A kind of report generating system and method | |
| CN102117444A (en) | System for comprehensive arrangement and execution management of production equipment maintenance plan | |
| CN104050541A (en) | Maintenance cycle management system for grid equipment | |
| CN109462278B (en) | Power system switching operation method based on PDA | |
| CN110829595A (en) | Intelligent power station relay protection equipment maintenance safety isolation measure execution method and system | |
| CN105448067A (en) | Electric power collection and management system | |
| CN104850934A (en) | Meteorological device maintenance and repair management system | |
| CN104346839B (en) | A kind of employee's electronic attendance system based on LAN | |
| CN102043986A (en) | Online processing system for abnormal electricity information transferring and application method of system | |
| CN106529891A (en) | Platform data cleaning method | |
| CN104599068A (en) | Method for positioning user fault through comprehensive analysis of repair request information | |
| CN109934458A (en) | A kind of power failure real-time analysis method based on the minimum common analytical unit that has a power failure | |
| CN105279588A (en) | Power grid dispatching operation associated monitoring system | |
| CN111210535A (en) | Intelligent inspection system for scheduling master station system equipment | |
| CN108647793B (en) | Intelligent management and control platform for installation and maintenance quality | |
| CN104391872B (en) | PMS systems and anti-error system line chart logical consistency method of calibration | |
| CN107943901A (en) | Automation of transformation substations information point table management method | |
| CN106570807A (en) | National resident identity card information maintenance platform | |
| CN106779889A (en) | Petrol station invoice management method based on mobile interchange equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170322 |
|
| RJ01 | Rejection of invention patent application after publication |