CN106528840A - Service data clearing method and system based on banking system - Google Patents
Service data clearing method and system based on banking system Download PDFInfo
- Publication number
- CN106528840A CN106528840A CN201611038440.1A CN201611038440A CN106528840A CN 106528840 A CN106528840 A CN 106528840A CN 201611038440 A CN201611038440 A CN 201611038440A CN 106528840 A CN106528840 A CN 106528840A
- Authority
- CN
- China
- Prior art keywords
- cleaning
- business datum
- allocation list
- information
- prune policies
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
Abstract
The invention provides a service data clearing method and system based on a banking system and relates to the technical field of database systems. The method includes the steps that service data of the banking system is acquired; a clearing configuration table corresponding to the service data is acquired; the service data is cleared according to the clearing configuration table. The service data clearing serves as one object for processing, the clearing mode is converted into an object class, the executing performance and transportability are improved, it is not needed to compile multiple applications, the labor cost is reduced, a user does not need to pay attention to the interior to achieve logic and only needs to know the functions and effects, and clearing tasks can be completed by configuring clearing time conditions.
Description
Technical field
The present invention with regard to database system technology field, especially with regard to the treatment technology of the business datum of financial field,
Concretely it is a kind of method for cleaning of the business datum based on banking system and system.
Background technology
This part is it is intended that the embodiments of the present invention stated in claims provide background or context.Herein
Description is not because just recognize it is prior art in being included in this part.
The business datum system of the Database Systems of one product, especially financial industry, the product of such as banking system
Database Systems, as its business is complicated, business datum is huge, for which carries out the business rule of data transfer or data scrubbing
It is extremely complex, meanwhile, the relatedness of its Various types of data being related to is very high.
At present, the data scrubbing mode of the business datum system of financial industry is usually simple data rule, generally logical
Cross and write multiple batch programs or script to process.The maintenance cost of this mode is very high, readability is poor, takes substantial amounts of
Time and human cost, meanwhile, if newly-increased tables of data or data scrubbing rule generally need to be further added by code to process, code
Durability is poor, it is impossible to while meet personalisation process requirement and the process of complex rule, and portable, data scrubbing when property
Can be poor.
Therefore, how to research and develop out a kind of new scheme to overcome drawbacks described above to be this area technology urgently to be resolved hurrily
A difficult problem.
The content of the invention
In view of this, the present invention provides a kind of method for cleaning of the business datum based on banking system and system, improves
Execution performance and portability, need not write many application programs, reduce cost of labor.
To achieve these goals, the present invention provides a kind of method for cleaning of the business datum based on banking system, described
Method includes：
Obtain the business datum of banking system；
Obtain cleaning allocation list corresponding with the business datum；
The business datum is cleared up according to the cleaning allocation list.
In a preferred embodiment of the invention, the cleaning allocation list is generated in the following way：
Determine the corresponding cleaning configuration information of the business datum；
The cleaning allocation list of the business datum is generated according to the cleaning configuration information.
In a preferred embodiment of the invention, the cleaning configuration information includes cleaning condition, clearance time, cleaning point
Area, associations and manner of cleaning up.
In a preferred embodiment of the invention, cleaning operation is carried out to the business datum according to the cleaning allocation list
Including：
The corresponding Prune Policies information of the business datum is determined according to the cleaning allocation list；
Cleaning operation is carried out to the business datum according to the Prune Policies information.
In a preferred embodiment of the invention, the corresponding cleaning of the business datum is determined according to the cleaning allocation list
Policy information includes the type of service for obtaining the business datum；Determined according to the type of service and the cleaning allocation list
The Prune Policies information of the business datum.
In a preferred embodiment of the invention, cleaning operation is carried out to the business datum according to the cleaning allocation list
Including：
All of Prune Policies information is extracted according to the cleaning allocation list, set of strategies is constituted；
Prune Policies information is extracted from the set of strategies according to cleaning priority order from high to low；
Judge whether the Prune Policies information extracted can carry out cleaning operation to the business datum；
When being judged as NO, return to perform and extract from the set of strategies clearly according to cleaning priority order from high to low
Reason policy information；
Otherwise, cleaning operation, the cleaning of the extraction are carried out according to the Prune Policies information extracted to the business datum
Policy information is the Prune Policies information of the business datum.
In a preferred embodiment of the invention, cleaning operation is carried out to the business datum according to the cleaning allocation list
Also include：
Judge whether the business datum has associated data according to the associations of the cleaning allocation list；
When being judged as YES, the associated data of the business datum is obtained；
Cleaning operation is carried out to the associated data according to the Prune Policies information of the business datum.
In a preferred embodiment of the invention, methods described also includes：When cleaning operation occurs abnormal, error is generated
Log sheet.
It is an object of the invention to provide a kind of cleaning system of the business datum based on banking system, the system
System includes cleaning equipment, and the cleaning equipment includes：
Business datum acquisition device, for obtaining the business datum of banking system；
Allocation list acquisition device, for obtaining cleaning allocation list corresponding with the business datum；
Business datum cleaning plant, for carrying out cleaning operation according to the cleaning allocation list to the business datum.
In a preferred embodiment of the invention, the system also includes that allocation list generates equipment, and the allocation list is generated
Equipment includes：
Configuration information acquisition device, for obtaining the corresponding cleaning configuration information of the business datum；
Configuration table creating device, for generating the cleaning allocation list of the business datum according to the cleaning configuration information.
In a preferred embodiment of the invention, the business datum cleaning plant includes Prune Policies determining module, uses
According to it is described cleaning allocation list determine the corresponding Prune Policies information of the business datum；Business datum cleaning modul, is used for
Cleaning operation is carried out to the business datum according to the Prune Policies information.
In a preferred embodiment of the invention, the Prune Policies determining module includes：
Type of service acquiring unit, for obtaining the type of service of the business datum；
Prune Policies determining unit, for determining the business number according to the type of service and the cleaning allocation list
According to Prune Policies information.
In a preferred embodiment of the invention, the business datum cleaning plant includes：
Set of strategies determining module, for extracting all of Prune Policies information according to the cleaning allocation list, constitutes plan
Slightly collect；
Information extraction modules, for extracting cleaning plan according to cleaning priority order from high to low from the set of strategies
The information of omiting；
First judge module, for judging whether the Prune Policies information extracted can be cleared up to the business datum
Operation, when being judged as NO, returns and performs described information extraction module；
The cleaning modul, for when first judge module is judged as YES, according to the Prune Policies information extracted
Cleaning operation is carried out to the business datum, and the Prune Policies information of the extraction is the Prune Policies letter of the business datum
Breath.
In a preferred embodiment of the invention, the business datum cleaning plant also includes：
Second judge module, closes for judging whether the business datum has according to the associations of the cleaning allocation list
Connection data；
Associated data acquisition module, for when second judge module is judged as YES, obtaining the business datum
Associated data；
Associated data cleaning modul, is carried out to the associated data for the Prune Policies information according to the business datum
Cleaning operation.
In a preferred embodiment of the invention, the cleaning equipment also includes daily record table creating device, for when cleaning
When operation occurs abnormal, error log sheet is generated.
The beneficial effects of the present invention is, there is provided a kind of method for cleaning of the business datum based on banking system and it is
Manner of cleaning up, by business datum is cleared up as an object processing, is converted object class by system, improve execution performance with
And it is portable, many application programs need not be write, cost of labor is reduced, which need not be paid close attention to simultaneously for user internal real
Existing logic, only need to know its function, by configuring clearance time condition by complete clean-up task.
It is that the above and other objects, features and advantages of the present invention can be become apparent, preferred embodiment cited below particularly,
And coordinate institute's accompanying drawings, it is described in detail below.
Description of the drawings
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
Accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is a kind of embodiment of the method for cleaning of business datum based on banking system provided in an embodiment of the present invention
One flow chart；
Flow charts of the Fig. 2 for the embodiment one of step S103；
Flow charts of the Fig. 3 for the embodiment two of step S103；
Fig. 4 is a kind of embodiment of the method for cleaning of business datum based on banking system provided in an embodiment of the present invention
Two flow chart；
Fig. 5 is a kind of structural frames of the cleaning system of business datum based on banking system provided in an embodiment of the present invention
Figure；
Fig. 6 is a kind of embodiment of the cleaning system of business datum based on banking system provided in an embodiment of the present invention
Two structured flowchart；
Fig. 7 be a kind of business datum based on banking system provided in an embodiment of the present invention cleaning system in business datum
The structured flowchart of the embodiment one of cleaning plant；
Fig. 8 be a kind of business datum based on banking system provided in an embodiment of the present invention cleaning system in Prune Policies
The structured flowchart of determining module；
Fig. 9 be a kind of business datum based on banking system provided in an embodiment of the present invention cleaning system in business datum
The structured flowchart of the embodiment two of cleaning plant；
Figure 10 be a kind of business datum based on banking system provided in an embodiment of the present invention cleaning system in clear up and set
Standby structured flowchart.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than the embodiment of whole.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
Art technology technical staff knows, embodiments of the present invention can be implemented as a kind of system, device, equipment,
Method or computer program.Therefore, the disclosure can be implemented as following form, i.e.,：Completely hardware, completely soft
Part (including firmware, resident software, microcode etc.), or the form that hardware and software is combined.
Below with reference to some representative embodiments of the present invention, the in detail principle and spirit of the explaination present invention.
The Database Systems of one product, especially financial industry business datum, such as banking system product is due to its industry
Business is complicated, and business datum is huge, complicated for the business rule of its data transfer or data scrubbing, while Various types of data relatedness
It is high.In general, simple data rule is processed typically by multiple batch programs or script is write, maintainable
Difference, readability are poor, take substantial amounts of time and human cost；If increase a kind of rule newly to be accomplished by newly writing code to locate simultaneously
Reason.The present invention provides a kind of method for cleaning of the business datum based on banking system and system for this kind of situation, follow-up to use
Family read by daily batch clocked flip shell cleaning allocation list record information be used as |input paramete, call PL/SQL
The objectification function script (the various Prune Policies information for prestoring) write is clearing up data.
Technical term first to the present invention relates to is illustrated：
PL/SQL：Sql like language storing process Procedure Language＆Structured Query Language.
SHELL:Command line Interface shell-commands formula shell is used for linux, unix system.
Fig. 1 is a kind of particular flow sheet of the method for cleaning of business datum based on banking system proposed by the present invention, please
Refering to Fig. 1, described method includes：
S101：Obtain the business datum of banking system；
S102：Obtain cleaning allocation list corresponding with the business datum.The cleaning allocation list is given birth in the following way
Into：
1st, determine the corresponding cleaning configuration information of the business datum, in the specific embodiment of the present invention, cleaning is matched somebody with somebody
Confidence breath can be different according to different banking systems, can preset.The cleaning configuration information includes cleaning condition, cleaning
Time, cleaning subregion, associations and manner of cleaning up.In the present invention, various cleaning patterns have been preset in manner of cleaning up,
The corresponding various manner of cleaning up of every kind of cleaning pattern, the objectification letter that can be write beforehand through PL/SQL in a particular embodiment
Count script to realize various cleaning patterns and its corresponding manner of cleaning up, be stored in advance in data base.
2nd, the cleaning allocation list of the business datum is generated according to the cleaning configuration information.One reality of cleaning allocation list
For example shown in table 1 below.As shown in table 1, pattern 0 is included in manner of cleaning up clears up pattern, every kind of cleaning mould totally into pattern 67
Formula correspondence respective various manner of cleaning up (namely Prune Policies information referred to hereafter), is pre-stored in data.
Such as：Module 0, its corresponding manner of cleaning up include unified cleaning transaction log (numbering 999), and its corresponding cleaning will
Ask as clearing up March former log sheet data, the cleaning allocation list of setting includes：Log sheet table name, retention time 90 days, cleaning industry
Business condition (such as retains abnormal log), and it is 99999 national to arrange and save line number, arranges unified cleaning numbering, has two kinds at present,
999 complete liquidations are unconditional, and 888 have professional qualification to clear up.
For another example in module 1, which includes regular remittance abroad business cleaning, regular debit, regular credit business, sets phase credit industry
The numbering of business is 000.Periodically credit business refers to the parties according to the prior agreement signed, the batch payment industry for periodically occurring
Business, such as pays out wage, insurance money etc., is initiated by paying bank, via forwarding gathering one Send only Account of row after the People's Bank's netting,
Multiple collecting accounts.Due to the cleaning of regular credit business require for cleaning one month in the past periodically the summary info table of credit with
The regular credit business managing detailed catalogue of its correlation is filed simultaneously to history lists, therefore setting data retain natural law in cleaning allocation list
For 31 days, that is, the data and user before clearing up 31 days arranged the other conditions of cleaning, and such as service condition is the state that finishes
Or business has put useless state, the table name of business datum place tables of data is set, regular credit summary info business datum is set
The table name of the table name of table and its related detail list, arranges the Correlation Criteria (service identification in such as two tables between correlation table
It is number identical) etc..
Table 1
S103：The business datum is cleared up according to the cleaning allocation list.Embodiments of the Fig. 2 for step S103
One flow chart, refers to Fig. 2, and step S103 includes in embodiment one：The industry is determined according to the cleaning allocation list
The corresponding Prune Policies information of business data, the step include：
S201：Obtain the type of service of the business datum；
S202：The Prune Policies letter of the business datum is determined according to the type of service and the cleaning allocation list
Breath.
Step S103 also includes：S203：Cleaning operation is carried out to the business datum according to the Prune Policies information.
In a particular embodiment, as business datum type of service be regular credit business, regular credit business report
Text<beps.125.001.01>, then (checked for the regular credit cleaning that cleaning numbering is 000 to match according to cleaning allocation list
Manner of cleaning up configuration text information), regular credit cleaning herein is Prune Policies information, then call regular in data base
Credit cleaning is cleared up to regular credit type of message (the People's Bank specifies type of message).
As above it is a kind of method for cleaning of business datum based on banking system that the present invention is provided, according to business datum
Data scrubbing require that carrying out objectification after sorted generalization in advance is processed, the objectification function script write using PL/SQL is used
Family only need to according to the present invention cleaning classifying ruless by the cleaning condition of business datum, clearance time, cleaning subregion, associations,
The maintenances of information such as manner of cleaning up are read cleaning by daily batch clocked flip shell and are matched somebody with somebody in cleaning information configuration the exterior and the interior face
The record information of table is put as |input paramete, calls the objectification function script that PL/SQL writes to carry out processing data.
Such as certain class data, data before needing single table to clear up 10 days, call allocated single table according to cleaning numbering
DELETE classes, are processed by reading the cleaning condition in allocation list and table name.So in system in each tables of data
If business datum has the attribute of single table cleaning, so can carry out.
Fig. 3 is the flow chart of the embodiment two of step S103, refers to Fig. 3, in embodiment two, step S103 bag
Include：
S301：All of Prune Policies information is extracted according to the cleaning allocation list, set of strategies is constituted；
S302：Prune Policies information is extracted from the set of strategies according to cleaning priority order from high to low；
S303：Judge whether the Prune Policies information extracted can carry out cleaning operation to the business datum, work as judgement
For it is no when, return execution step S302, otherwise, execution step S304；
S304：Prune Policies information according to extracting carries out cleaning operation, the cleaning of the extraction to the business datum
Policy information is the Prune Policies information of the business datum.
Namely in embodiment two, all of Prune Policies letter is called out from data base according to cleaning allocation list directly
Breath, then according to the height of cleaning priority carries out cleaning operation to business datum successively, until running into corresponding cleaning
Business datum is cleared up successfully by strategy.In the present invention, Prune Policies set in advance include in table 1 corresponding 7 kinds of patterns with
And corresponding one or more Prune Policies of each pattern, the cleaning priority of 6 in table a kind cleaning pattern is to reduce successively,
That is the highest priority of pattern 1, the priority of pattern 6 are minimum, i.e., 1～module of module 6 is cleared up in the above sequence (by complicated business
The rule settings first cleared up), module 0 can parallel processing with other modules.
Fig. 4 is a kind of embodiment of the method for cleaning of business datum based on banking system provided in an embodiment of the present invention
Two flow chart, refers to Fig. 4, and in embodiment two, the method includes：
S401：Obtain the business datum of banking system；
S402：Obtain cleaning allocation list corresponding with the business datum；
S403：The business datum is cleared up according to the cleaning allocation list；
S404：Judge whether the business datum has associated data according to the associations of the cleaning allocation list；
S405：When being judged as YES, the associated data of the business datum is obtained；
S406：Cleaning operation is carried out to the associated data according to the Prune Policies information of the business datum.
As shown in table 1, word table 1 is associated data to word table 6.
In the other embodiment of the present invention, when cleaning operation occurs abnormal, error log sheet is generated.Error daily record
One example of table is as shown in table 2.
Table 2
A kind of method for cleaning of business datum based on banking system that the present invention is provided is as mentioned above, will be traditional
Write script cleaning data or write multiple application programs to clear up the mode of data, be improved to data scrubbing as a class
Process like an object inside JAVA language, it includes multiple classes and its various method.Manner of cleaning up is converted into object class
And method.So due to improve program performing performance and portability based on PL/SQL execution, while need not write very
Multiple utility program, reduces cost of labor, need not pay close attention to simultaneously for user and realize inside which logic, only need to know its function
Effect, by configuring clearance time condition by complete clean-up task.
Although it should be noted that describe the operation of the inventive method in the accompanying drawings with particular order, this does not require that
Or hint must perform these operations according to the particular order, or the operation having to carry out shown in whole could realize the phase
The result of prestige.Additionally or alternatively, it is convenient to omit some steps, multiple steps are merged into a step to perform, and/or will
One step is decomposed into execution of multiple steps.
After the method for describing exemplary embodiment of the invention, next, refer to the attached drawing is exemplary to the present invention
The equipment of embodiment is introduced.The enforcement of the equipment may refer to the enforcement of said method, repeats part and repeats no more.With
Lower used term " module " and " unit ", can be the software and/or hardware for realizing predetermined function.Although following examples
Described module is preferably with software realizing, but hardware, or the realization of the combination of software and hardware be also may be simultaneously
It is contemplated.
Fig. 5 is a kind of structural frames of the cleaning system of business datum based on banking system provided in an embodiment of the present invention
Figure, refers to Fig. 5, and the system includes cleaning equipment 100, and the cleaning equipment 100 includes：
Business datum acquisition device 101, for obtaining the business datum of banking system；
Allocation list acquisition device 102, for obtaining cleaning allocation list corresponding with the business datum.
Business datum cleaning plant 103, for clearing up to the business datum according to the cleaning allocation list.
Fig. 6 is a kind of embodiment of the cleaning system of business datum based on banking system provided in an embodiment of the present invention
Two structured flowchart, refers to Fig. 6, and in embodiment two, the system also includes that allocation list generates equipment 200, allocation list
Generation equipment 200 includes：
Configuration information acquisition device 201, for obtaining the corresponding cleaning configuration information of the business datum.The present invention's
In specific embodiment, cleaning configuration information can be different according to different banking systems, can preset.The cleaning configuration
Information includes cleaning condition, clearance time, cleaning subregion, associations and manner of cleaning up.In the present invention, it is pre- in manner of cleaning up
Various cleaning patterns are set first, the corresponding various manner of cleaning up of every kind of cleaning pattern can lead in a particular embodiment in advance
Cross objectification function script that PL/SQL writes to realize various cleaning patterns and its corresponding manner of cleaning up, prestore
In data base.
Configuration table creating device 202, for generating the cleaning configuration of the business datum according to the cleaning configuration information
Table.One example of cleaning allocation list is as shown in table 1 below.As shown in table 1, pattern 0 is included in manner of cleaning up to pattern 6 totally 7
Middle cleaning pattern, every kind of cleaning pattern correspondence respective various manner of cleaning up (namely Prune Policies information referred to hereafter),
It is pre-stored in data.
Such as：Module 0, its corresponding manner of cleaning up include unified cleaning transaction log (numbering 999), and its corresponding cleaning will
Ask as clearing up March former log sheet data, the cleaning allocation list of setting includes：Log sheet table name, retention time 90 days, cleaning industry
Business condition (such as retains abnormal log), and it is 99999 national to arrange and save line number, arranges unified cleaning numbering, has two kinds at present,
999 complete liquidations are unconditional, and 888 have professional qualification to clear up.
For another example in module 1, which includes regular remittance abroad business cleaning, regular debit, regular credit business, sets phase credit industry
The numbering of business is 000.Periodically credit business refers to the parties according to the prior agreement signed, the batch payment industry for periodically occurring
Business, such as pays out wage, insurance money etc., is initiated by paying bank, via forwarding gathering one Send only Account of row after the People's Bank's netting,
Multiple collecting accounts.Due to the cleaning of regular credit business require for cleaning one month in the past periodically the summary info table of credit with
The regular credit business managing detailed catalogue of its correlation is filed simultaneously to history lists, therefore setting data retain natural law in cleaning allocation list
For 31 days, that is, the data and user before clearing up 31 days arranged the other conditions of cleaning, and such as service condition is the state that finishes
Or business has put useless state, the table name of business datum place tables of data is set, regular credit summary info business datum is set
The table name of the table name of table and its related detail list, arranges the Correlation Criteria (service identification in such as two tables between correlation table
It is number identical) etc..
Fig. 7 be a kind of business datum based on banking system provided in an embodiment of the present invention cleaning system in business datum
The structured flowchart of the embodiment one of cleaning plant, refers to Fig. 7, and business datum cleaning 103 includes in embodiment one：
Prune Policies determining module 301, for determining the corresponding cleaning of the business datum according to the cleaning allocation list
Policy information；
Business datum cleaning modul 302, for clearing up to the business datum according to the Prune Policies information
Fig. 8 be a kind of business datum based on banking system provided in an embodiment of the present invention cleaning system in Prune Policies
The structured flowchart of determining module, refers to Fig. 8, and Prune Policies determining module 301 includes：
Type of service acquiring unit 401, for obtaining the type of service of the business datum；
Prune Policies determining unit 402, for determining the industry according to the type of service and the cleaning allocation list
The Prune Policies information of business data.
In a particular embodiment, as business datum type of service be regular credit business, regular credit business report
Text<beps.125.001.01>, then (checked for the regular credit cleaning that cleaning numbering is 000 to match according to cleaning allocation list
Manner of cleaning up configuration text information), regular credit cleaning herein is Prune Policies information, then call regular in data base
Credit cleaning is cleared up to regular credit type of message (the People's Bank specifies type of message).
As above it is a kind of cleaning system of business datum based on banking system that the present invention is provided, according to business datum
Data scrubbing require that carrying out objectification after sorted generalization in advance is processed, the objectification function script write using PL/SQL is used
Family only need to according to the present invention cleaning classifying ruless by the cleaning condition of business datum, clearance time, cleaning subregion, associations,
The maintenances of information such as manner of cleaning up are read cleaning by daily batch clocked flip shell and are matched somebody with somebody in cleaning information configuration the exterior and the interior face
The record information of table is put as |input paramete, calls the objectification function script that PL/SQL writes to carry out processing data.
Such as certain class data, data before needing single table to clear up 10 days, call allocated single table according to cleaning numbering
DELETE classes, are processed by reading the cleaning condition in allocation list and table name.So in system in each tables of data
If business datum has the attribute of single table cleaning, so can carry out.
Fig. 9 be a kind of business datum based on banking system provided in an embodiment of the present invention cleaning system in business datum
The structured flowchart of the embodiment two of cleaning plant, refers to Fig. 9, and in embodiment two, business datum cleaning plant 103 is wrapped
Include：
Set of strategies determining module 303, for extracting all of Prune Policies information according to the cleaning allocation list, constitutes
Set of strategies；
Information extraction modules 304, for extracting clearly according to cleaning priority order from high to low from the set of strategies
Reason policy information；
First judge module 305, for judging whether the Prune Policies information extracted can be carried out to the business datum
Cleaning operation, when being judged as NO, returns and performs described information extraction module 304；
Cleaning modul 306, for when first judge module is judged as YES, according to the Prune Policies information pair extracted
The business datum carries out cleaning operation, and the Prune Policies information of the extraction is the Prune Policies letter of the business datum
Breath.
Namely in embodiment two, all of Prune Policies letter is called out from data base according to cleaning allocation list directly
Breath, then according to the height of cleaning priority carries out cleaning operation to business datum successively, until running into corresponding cleaning
Business datum is cleared up successfully by strategy.In the present invention, Prune Policies set in advance include in table 1 corresponding 7 kinds of patterns with
And corresponding one or more Prune Policies of each pattern, the cleaning priority of 6 in table a kind cleaning pattern is to reduce successively,
That is the highest priority of pattern 1, the priority of pattern 6 are minimum, i.e., 1～module of module 6 is cleared up in the above sequence (by complicated business
The rule settings first cleared up), module 0 can parallel processing with other modules.
Figure 10 be a kind of business datum based on banking system provided in an embodiment of the present invention cleaning system in clear up and set
Standby structured flowchart, refers to Figure 10, and in this embodiment, cleaning equipment also includes：
According to the associations of the cleaning allocation list, second judge module 104, for judging whether the business datum has
Relevant data；
Associated data acquisition module 105, for when second judge module is judged as YES, obtaining the business datum
Associated data；
Associated data cleaning modul 106, for according to the Prune Policies information of the business datum to the associated data
Carry out cleaning operation.
As shown in table 1, word table 1 is associated data to word table 6.
In the other embodiment of the present invention, the cleaning equipment also includes：Daily record table creating device, for when cleaning
When operation occurs abnormal, error log sheet is generated.One example of error log sheet is as shown in table 2.
A kind of cleaning system of business datum based on banking system that the present invention is provided is as mentioned above, will be traditional
Write script cleaning data or write multiple application programs to clear up the mode of data, be improved to data scrubbing as a class
Process like an object inside JAVA language, it includes multiple classes and its various method.Manner of cleaning up is converted into object class
And method.So due to improve program performing performance and portability based on PL/SQL execution, while need not write very
Multiple utility program, reduces cost of labor, need not pay close attention to simultaneously for user and realize inside which logic, only need to know its function
Effect, by configuring clearance time condition by complete clean-up task.
Although additionally, being referred to some unit modules of system in above-detailed, this division is only simultaneously
Non-imposed.In fact, according to the embodiment of the present invention, the feature and function of above-described two or more units can
To embody in a unit.Equally, the feature and function of an above-described unit can also Further Division serve as reasons
Multiple units are embodying.
The present invention provide the business datum based on banking system method for cleaning and system based on Linux shell with
The PL/SQL program languages of ORACLE realize data processing object handles.
Specific data scrubbing or data are carried out typically by batch program or SQL scripts is write and turns history
Generally by the business datum of preservation long period, such as half a year once clears up for operation.Typically all night batch calls correlation
Script/batch program carries out data scrubbing, generally processes the fairly simple business rule data of cleaning rule.
The mode of current generally data scrubbing, usual maintenance cost is very high, while code durability is poor, while can not meet
Personalisation process requirement and the process of complex rule, while portability is looked into, poor-performing during data scrubbing.If newly-increased data
Table or data scrubbing rule generally need to be further added by code to process.
And data scrubbing similar JAVA language objectification is processed by the present invention by PL/SQL, preferably can solve above-mentioned
Problem, simultaneously because PL/SQL is stored on database server, by the function of PL/SQL or process are packaged into
After PACKAGE compilings are installed, the built-in function of similar ORACLE data bases is directly becoming, either application program can be very convenient
Be called process.
All kinds of business datums that the present invention can be carried to user are sorted out and are converted to business data processing objectification
Numbering, preselecting the types of objects completed according to classification carries out the programming of PL/SQL decomposing moduleizations, sets up data processing allocation list, builds
Vertical data processing error log table.
The present invention can be carried out during specific use as follows：
1.Shell programs log-on data deals with objects executive program；
2. log information during last time operation is cleared up using daily record；
3. user data cleaning allocation list information is read；
4. corresponding data processing object module is called according to objectification numbering；
5. data processing object module parsing data scrubbing information is circulated processing business data scrubbing operation；
6. if processing error, calling carries out record error message using log pattern, continues step 4 and processes.
The present invention innovative point be：The process of data processing objectification, i.e. data scrubbing become a class, and the inside has various
Manner of cleaning up, such as single table are deleted as a kind of manner of cleaning up inside data scrubbing class, and external input parameter simply needs
TABLE names, clear up condition, and clearance time need not know internal logic.
It is improvement on hardware (for example, to diode, crystal that clearly can distinguish for the improvement of a technology
Pipe, switch etc. circuit structure improvement) or software on improvement (for the improvement of method flow).However, with technology
Development, the improvement of current many method flows can be considered as directly improving for hardware circuit.Designer is almost
Corresponding hardware circuit is obtained all by improved method flow is programmed in hardware circuit.Therefore, it cannot be said that one
The improvement of individual method flow cannot be realized with hardware entities module.For example, PLD (Programmable
Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate Array, FPGA)) just
It is such a integrated circuit, its logic function is determined to device programming by user.Voluntarily programmed to come one by designer
Individual digital display circuit " integrated " designs and makes special integrated circuit without asking chip maker on a piece of PLD
Chip 2.And, nowadays, replacement manually makes IC chip, and " logic compiler is also used in this programming mostly instead
Realizing, when it is write with program development, software compiler used is similar, and will compile for (logic compiler) " softwares
Source code before also handy specific programming language writing, this is referred to as hardware description language (Hardware
Description Language, HDL), and HDL is also not only a kind of, but have many kinds, such as ABEL (Advanced
Boolean Expression Language)、AHDL(Altera Hardware Description Language)、
Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL(Java
Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware
Description Language) etc., that what is most commonly used at present is VHDL (Very-High-Speed Integrated
Circuit Hardware Description Language) and Verilog2.Those skilled in the art only also will be apparent to the skilled artisan that
Need slightly programming in logic to be programmed in integrated circuit method flow with above-mentioned several hardware description languages, it is possible to hold very much
The hardware circuit of the easy accomplished logical method flow process.
Controller can be implemented in any suitable manner, and for example, controller can take such as microprocessor or process
Device and storage can by the computer of the computer readable program code (such as software or firmware) of (micro-) computing device
Read medium, gate, switch, special IC (Application Specific Integrated Circuit,
ASIC), the form of programmable logic controller (PLC) and embedded microcontroller, the example of controller include but is not limited to following microcontroller
Device：ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, deposit
Memory controller is also implemented as a part for the control logic of memorizer.
It is also known in the art that in addition to realizing controller in pure computer readable program code mode, it is complete
Entirely can by by method and step carry out programming in logic cause controller with gate, switch, special IC, may be programmed
The form of logic controller and embedded microcontroller etc. is realizing identical function.Therefore this controller is considered one kind
Hardware component, and the device for realizing various functions to including in which can also be considered as the structure in hardware component.Or
Even, can be considered as the device of realizing various functions can not only be the software module of implementation method but also can be Hardware Subdivision
Structure in part.
System, device, module or unit that above-described embodiment is illustrated, specifically can be realized by computer chip or entity,
Or by the product with certain function realizing.
For convenience of description, it is divided into various units with function when describing apparatus above to describe respectively.Certainly, implementing this
The function of each unit can be realized in same or multiple softwares and/or hardware during application.
As seen through the above description of the embodiments, those skilled in the art can be understood that the application can
By software plus required general hardware platform mode realizing.Based on such understanding, the technical scheme essence of the application
On part that in other words prior art is contributed can be embodied in the form of software product, the computer software product
Can be stored in storage medium, such as ROM/RAM, magnetic disc, CD etc., use so that a computer equipment including some instructions
(can be personal computer, server, or network equipment etc.) performs some of each embodiment of the application or embodiment
Method described in part.
Each embodiment in this specification is described by the way of progressive, identical similar portion between each embodiment
Divide mutually referring to what each embodiment was stressed is the difference with other embodiment.Especially for system reality
For applying example, as which is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method
Part explanation.
The application can be used in numerous general or special purpose computing system environments or configuration.For example：Personal computer, clothes
Business device computer, handheld device or portable set, laptop device, multicomputer system, based on the system of microprocessor, put
Top box, programmable consumer-elcetronics devices, network PC, minicomputer, mainframe computer, including any of the above system or equipment
Distributed computing environment etc..
The application can be described in the general context of computer executable instructions, such as program
Module.Usually, program module includes execution particular task or realizes the routine of particular abstract data type, program, object, group
Part, data structure etc..The application is put into practice in a distributed computing environment can also, in these distributed computing environment, by
The remote processing devices connected by communication network are performing task.In a distributed computing environment, program module can be with
In local and remote computer-readable storage medium including including storage device.
Although depicting the application by embodiment, it will be appreciated by the skilled addressee that the application have it is many deformation and
Change is without deviating from spirit herein, it is desirable to which appended claim includes these deformations and changes without deviating from the application's
Spirit.
Claims (16)
1. a kind of method for cleaning of the business datum based on banking system, is characterized in that, methods described includes：
Obtain the business datum of banking system；
Obtain cleaning allocation list corresponding with the business datum；
The business datum is cleared up according to the cleaning allocation list.
2. method according to claim 1, is characterized in that, the cleaning allocation list is generated in the following way：
Determine the corresponding cleaning configuration information of the business datum；
The cleaning allocation list of the business datum is generated according to the cleaning configuration information.
3. method according to claim 2, is characterized in that, it is described cleaning configuration information include cleaning condition, clearance time,
Cleaning subregion, associations and manner of cleaning up.
4. method according to claim 2, is characterized in that, the business datum be carried out clearly according to the cleaning allocation list
Reason operation includes：
The corresponding Prune Policies information of the business datum is determined according to the cleaning allocation list；
Cleaning operation is carried out to the business datum according to the Prune Policies information.
5. method according to claim 4, is characterized in that, determine the business datum correspondence according to the cleaning allocation list
Prune Policies information include：
Obtain the type of service of the business datum；
The Prune Policies information of the business datum is determined according to the type of service and the cleaning allocation list.
6. method according to claim 2, is characterized in that, the business datum be carried out clearly according to the cleaning allocation list
Reason operation includes：
All of Prune Policies information is extracted according to the cleaning allocation list, set of strategies is constituted；
Prune Policies information is extracted from the set of strategies according to cleaning priority order from high to low；
Judge whether the Prune Policies information extracted can carry out cleaning operation to the business datum；
When being judged as NO, return to perform and cleaning plan is extracted from the set of strategies according to cleaning priority order from high to low
The information of omiting；
Otherwise, cleaning operation, the Prune Policies of the extraction are carried out according to the Prune Policies information extracted to the business datum
Information is the Prune Policies information of the business datum.
7. the method according to claim 4 or 6, is characterized in that, methods described also includes：
Judge whether the business datum has associated data according to the associations of the cleaning allocation list；
When being judged as YES, the associated data of the business datum is obtained；
Cleaning operation is carried out to the associated data according to the Prune Policies information of the business datum.
8. method according to claim 7, is characterized in that, methods described also includes：
When cleaning operation occurs abnormal, error log sheet is generated.
9. a kind of cleaning system of the business datum based on banking system, is characterized in that, the system includes cleaning equipment, described
Cleaning equipment includes：
Business datum acquisition device, for obtaining the business datum of banking system；
Allocation list acquisition device, for obtaining cleaning allocation list corresponding with the business datum；
Business datum cleaning plant, for carrying out cleaning operation according to the cleaning allocation list to the business datum.
10. system according to claim 9, is characterized in that, the system also includes that allocation list generates equipment, the configuration
Table generates equipment to be included：
Configuration information acquisition device, for obtaining the corresponding cleaning configuration information of the business datum；
Configuration table creating device, for generating the cleaning allocation list of the business datum according to the cleaning configuration information.
11. systems according to claim 10, is characterized in that, when the cleaning configuration information includes cleaning condition, cleaning
Between, cleaning subregion, associations and manner of cleaning up.
12. systems according to claim 10, is characterized in that, the business datum cleaning plant includes：
Prune Policies determining module, for determining the corresponding Prune Policies letter of the business datum according to the cleaning allocation list
Breath；
Business datum cleaning modul, for carrying out cleaning operation according to the Prune Policies information to the business datum.
13. systems according to claim 12, is characterized in that, the Prune Policies determining module includes：
Type of service acquiring unit, for obtaining the type of service of the business datum；
Prune Policies determining unit, for determining the business datum according to the type of service and the cleaning allocation list
Prune Policies information.
14. systems according to claim 10, is characterized in that, the business datum cleaning plant includes：
Set of strategies determining module, for extracting all of Prune Policies information according to the cleaning allocation list, constitutes set of strategies；
Information extraction modules, for extracting Prune Policies letter according to cleaning priority order from high to low from the set of strategies
Breath；
First judge module, for judging whether the Prune Policies information extracted can carry out cleaning behaviour to the business datum
Make, when being judged as NO, return and perform described information extraction module；
Cleaning modul, for when first judge module is judged as YES, according to the Prune Policies information extracted to the industry
Business data carry out cleaning operation, and the Prune Policies information of the extraction is the Prune Policies information of the business datum.
15. systems according to claim 12 or 14, is characterized in that, the cleaning equipment also includes：
According to the associations of the cleaning allocation list, second judge module, for judging whether the business datum has incidence number
According to；
Associated data acquisition module, for when second judge module is judged as YES, obtaining the association of the business datum
Data；
Associated data cleaning modul, clears up to the associated data for the Prune Policies information according to the business datum
Operation.
16. systems according to claim 15, is characterized in that, the cleaning equipment also includes：
Daily record table creating device, for when cleaning operation occurs abnormal, generating error log sheet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611038440.1A CN106528840A (en) | 2016-11-11 | 2016-11-11 | Service data clearing method and system based on banking system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611038440.1A CN106528840A (en) | 2016-11-11 | 2016-11-11 | Service data clearing method and system based on banking system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106528840A true CN106528840A (en) | 2017-03-22 |
Family
ID=58356221
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611038440.1A Pending CN106528840A (en) | 2016-11-11 | 2016-11-11 | Service data clearing method and system based on banking system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106528840A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108509624A (en) * | 2018-04-08 | 2018-09-07 | 武汉斗鱼网络科技有限公司 | A kind of database filing method for cleaning and system, server and storage medium |
| CN109359107A (en) * | 2018-11-05 | 2019-02-19 | 中国建设银行股份有限公司 | Database method for cleaning, system, device and storage medium |
| CN110069481A (en) * | 2019-03-12 | 2019-07-30 | 平安科技（深圳）有限公司 | Storage facility located at processing plant data based on big data unify method for cleaning and relevant device |
| CN110674122A (en) * | 2019-09-04 | 2020-01-10 | 华东江苏大数据交易中心股份有限公司 | Data cleaning system based on data transaction |
| WO2022001627A1 (en) * | 2020-07-03 | 2022-01-06 | 苏宁易购集团股份有限公司 | Data clearing method and apparatus, computer device and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101877099A (en) * | 2010-03-23 | 2010-11-03 | 苏州德融嘉信信用管理技术有限公司 | Day-end processing module based on bank preposing service platforms and application method thereof |
| CN102915353A (en) * | 2012-09-28 | 2013-02-06 | 浙江图讯科技有限公司 | Method for cleaning junk data |
| CN103793530A (en) * | 2014-02-26 | 2014-05-14 | 北京京东尚科信息技术有限公司 | Method, device and system for cleaning up business data regularly |
| CN104182436A (en) * | 2014-02-25 | 2014-12-03 | 无锡天脉聚源传媒科技有限公司 | Method and device for cleaning databases |
| US9274895B1 (en) * | 2013-02-22 | 2016-03-01 | Sandia Corporation | Processing device with self-scrubbing logic |
| CN105760487A (en) * | 2016-02-17 | 2016-07-13 | 中国工商银行股份有限公司 | Historical data cleaning method and device |
-
2016
- 2016-11-11 CN CN201611038440.1A patent/CN106528840A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101877099A (en) * | 2010-03-23 | 2010-11-03 | 苏州德融嘉信信用管理技术有限公司 | Day-end processing module based on bank preposing service platforms and application method thereof |
| CN102915353A (en) * | 2012-09-28 | 2013-02-06 | 浙江图讯科技有限公司 | Method for cleaning junk data |
| US9274895B1 (en) * | 2013-02-22 | 2016-03-01 | Sandia Corporation | Processing device with self-scrubbing logic |
| CN104182436A (en) * | 2014-02-25 | 2014-12-03 | 无锡天脉聚源传媒科技有限公司 | Method and device for cleaning databases |
| CN103793530A (en) * | 2014-02-26 | 2014-05-14 | 北京京东尚科信息技术有限公司 | Method, device and system for cleaning up business data regularly |
| CN105760487A (en) * | 2016-02-17 | 2016-07-13 | 中国工商银行股份有限公司 | Historical data cleaning method and device |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108509624A (en) * | 2018-04-08 | 2018-09-07 | 武汉斗鱼网络科技有限公司 | A kind of database filing method for cleaning and system, server and storage medium |
| CN109359107A (en) * | 2018-11-05 | 2019-02-19 | 中国建设银行股份有限公司 | Database method for cleaning, system, device and storage medium |
| CN110069481A (en) * | 2019-03-12 | 2019-07-30 | 平安科技（深圳）有限公司 | Storage facility located at processing plant data based on big data unify method for cleaning and relevant device |
| CN110674122A (en) * | 2019-09-04 | 2020-01-10 | 华东江苏大数据交易中心股份有限公司 | Data cleaning system based on data transaction |
| CN110674122B (en) * | 2019-09-04 | 2023-09-12 | 华东江苏大数据交易中心股份有限公司 | Data cleaning system based on data transaction |
| WO2022001627A1 (en) * | 2020-07-03 | 2022-01-06 | 苏宁易购集团股份有限公司 | Data clearing method and apparatus, computer device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106528840A (en) | Service data clearing method and system based on banking system | |
| CN107402991B (en) | Method for writing semi-structured data and distributed NewSQL database system | |
| CN109615495B (en) | Data reconciliation method, device, equipment and system | |
| CN103473342B (en) | A kind of report data generation method and system | |
| US10671956B2 (en) | Measure factory | |
| CN108229806A (en) | A kind of method and system for analyzing business risk | |
| CN107424069A (en) | A kind of generation method of air control feature, risk monitoring and control method and apparatus | |
| WO2021063045A1 (en) | Blockchain-based transaction query method, apparatus and device, and blockchain-based transaction data processing method, apparatus and device | |
| CN103425468B (en) | Plug-in type software integrating method and device | |
| CN103559118A (en) | Security auditing method based on aspect oriented programming (AOP) and annotation information system | |
| CN106156119A (en) | A kind of distributed transaction communication means, system and device | |
| CN107832230A (en) | Method of testing, equipment and system based on data tuning | |
| CN109767110A (en) | A kind of risk control system optimization method, device, equipment and storage medium | |
| CN107944996A (en) | A kind of fund account checking method and system | |
| CN108615184A (en) | A kind of method and device of book keeping operation | |
| CN106055325A (en) | Establishing method of service for supporting concurrent operation of multiple systems | |
| CN109033124A (en) | A kind of method and device of Data Migration | |
| CN104200324A (en) | Business knowledge management based configuration management method | |
| CN108268615A (en) | A kind of data processing method, device and system | |
| CN105868216A (en) | Method for realizing object expiration operation and device and equipment | |
| CN111708897A (en) | Target information determination method, device and equipment | |
| CN106651568A (en) | Business processing method and device | |
| CN110046977A (en) | Bookkeeping methods, account checking method, device and server | |
| CN109685636A (en) | Wage number generation method, device, system and computer storage medium | |
| US20220092503A1 (en) | Measure factory |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170322 |
|
| RJ01 | Rejection of invention patent application after publication |