CN114238289A

CN114238289A - Business data cleaning method and device, computer equipment and storage medium

Info

Publication number: CN114238289A
Application number: CN202111424176.6A
Authority: CN
Inventors: 朱浩斌
Original assignee: China Construction Bank Corp
Current assignee: China Construction Bank Corp
Priority date: 2021-11-26
Filing date: 2021-11-26
Publication date: 2022-03-25

Abstract

The application relates to a business data cleaning method, a business data cleaning device, a computer device, a storage medium and a computer program product. The method comprises the following steps: screening out an account to be cleaned based on a service master table, wherein the account to be cleaned is a service account number with an account state in a closed state, and the service master table comprises the service account number; matching the account to be cleaned in a preset parameter assembly, and determining whether a cleaning identifier corresponding to the account to be cleaned meets a cleaning condition; if the cleaning condition is met, determining a product cleaning parameter corresponding to the account to be cleaned according to the preset parameter component; and based on the product cleaning parameters corresponding to the account to be cleaned, cleaning the service data of the account to be cleaned. The method can improve the cleaning efficiency of the service data.

Description

Business data cleaning method and device, computer equipment and storage medium

Technical Field

The present application relates to the field of big data intelligent analysis technology, and in particular, to a method and an apparatus for cleaning service data, a computer device, a storage medium, and a computer program product.

Background

With the development of computer financial technology, more and more businesses can be completed on a computer system, such as loan businesses, the whole process can be completed on a loan system from the time when a user applies for a loan until the user clears the loan, however, under the condition that the loan system operates for a long time, more and more waste data can be generated, particularly, the number of cleared accounts is increased continuously, so that a large amount of data related to the clear accounts is left in the system, the waste data occupies limited production system resources for a long time, extra space and resource expenses are brought, and great hidden dangers are brought to the safe operation of the system.

At present, for waste data in a system, a batch program is used for being matched with a manual processing mode to be developed and cleaned, the cleaning mode greatly increases the workload, and the efficiency is low.

Disclosure of Invention

In view of the foregoing, it is desirable to provide a business data cleaning method, a business data cleaning apparatus, a computer device, a computer readable storage medium, and a computer program product, which can improve the business data cleaning efficiency.

In a first aspect, the present application provides a method for cleaning service data, where the method includes:

screening out an account to be cleaned based on a service master table, wherein the account to be cleaned is a service account number with an account state in a closed state, and the service master table comprises the service account number;

matching the account to be cleaned in a preset parameter assembly, and determining whether a cleaning identifier corresponding to the account to be cleaned meets a cleaning condition;

if the cleaning condition is met, determining a product cleaning parameter corresponding to the account to be cleaned according to the preset parameter component;

and based on the product cleaning parameters corresponding to the account to be cleaned, cleaning the service data of the account to be cleaned.

In one embodiment, the screening out accounts to be cleaned based on the business master table includes:

inquiring an account state field in the service master table, wherein the service master table comprises account state information;

and screening the loan account number with the account state of the account state field being in a closed state as an account to be cleaned.

In one embodiment, the matching the account to be cleaned in a preset parameter component and determining whether a cleaning identifier corresponding to the account to be cleaned meets a cleaning condition include:

inquiring a cleaning master control parameter corresponding to the cleaning identifier from the preset parameter component based on the cleaning identifier corresponding to the account to be cleaned, wherein the cleaning master control parameter comprises a cleaning date parameter;

and if the current date is matched with the cleaning date parameter, determining that the cleaning identifier corresponding to the account to be cleaned meets the cleaning condition.

In one embodiment, the cleaning date parameter includes: a fixed date cleaning mode;

if the account cleaning mode corresponding to the cleaning master control parameter is a fixed date cleaning mode, determining that the account to be cleaned meets the cleaning condition when the data cleaning date is the same as the fixed date of the fixed date cleaning mode.

In one embodiment, the cleaning date parameter includes: special date mode and each cleaning date;

if the account cleaning mode corresponding to the total cleaning parameter is a special date cleaning mode, when the data cleaning date is one of the cleaning dates in the special date cleaning mode, determining that the account to be cleaned meets the cleaning condition.

In one embodiment, the determining, according to the preset parameter component, a product cleaning parameter corresponding to the account to be cleaned if the cleaning condition is met includes:

if the cleaning condition is met, according to the product identification of the account to be cleaned and the cleaning identification, product cleaning parameters corresponding to the product identification and the cleaning identification are inquired from the preset parameter assembly, and the service master table comprises the product identification.

In one embodiment, before performing the service data cleaning on the account to be cleaned, the method includes:

updating the account state of the account to be cleaned in the service master table to be a cleaning state;

acquiring key information of an account to be cleaned, wherein the account state is a cleaning state, and the key information comprises at least one of basic account information, historical bill information and historical transaction details;

backing up and storing the key information;

and writing the account to be cleaned into a cleaning account comparison table.

In one embodiment, the performing service data cleaning on the account to be cleaned based on the product cleaning parameter corresponding to the account to be cleaned includes:

if the product cleaning parameters contain field parameters of specified fields, determining whether parameter conditions corresponding to the field parameters are met, wherein the specified fields comprise account retention time;

and if so, cleaning the service data of the account to be cleaned.

In one embodiment, the performing service data cleaning on the account to be cleaned includes:

acquiring information of a data table to be cleaned configured in a configuration file;

and deleting the record corresponding to the account to be cleaned in the data table corresponding to the data table information to be cleaned.

In a second aspect, the present application further provides a service data cleaning apparatus, where the apparatus includes:

the system comprises a to-be-cleaned account determining module, a to-be-cleaned account determining module and a to-be-cleaned account determining module, wherein the to-be-cleaned account determining module is used for screening out an account to be cleaned based on a service master table, the account to be cleaned is a service account number of which the account state is in a closed state, and the service master table comprises the service account number;

the cleaning condition analysis module is used for matching the account to be cleaned in a preset parameter assembly and determining whether a cleaning identifier corresponding to the account to be cleaned meets a cleaning condition;

the product cleaning parameter acquisition module is used for determining product cleaning parameters corresponding to the account to be cleaned according to the preset parameter component if the cleaning conditions are met;

and the service data cleaning module is used for cleaning the account to be cleaned based on the product cleaning parameters corresponding to the account to be cleaned.

In one embodiment, the to-be-cleaned account determining module is configured to query an account status field in the service master table, where the service master table includes account status information; and screening the loan account number with the account state of the account state field being in a closed state as an account to be cleaned.

In one embodiment, the cleaning condition analysis module is configured to query a cleaning total control parameter corresponding to a cleaning identifier from the preset parameter component based on the cleaning identifier corresponding to the account to be cleaned, where the cleaning total control parameter includes a cleaning date parameter; and if the current date is matched with the cleaning date parameter, determining that the cleaning identifier corresponding to the account to be cleaned meets the cleaning condition.

In one embodiment, the cleaning condition analysis module is configured to determine that the account to be cleaned satisfies a cleaning condition when a data cleaning date is the same as a fixed date of the fixed date cleaning mode if the account cleaning mode corresponding to the total cleaning control parameter is the fixed date cleaning mode, where the cleaning date parameter includes: fixed date cleaning mode.

In one embodiment, the cleaning condition analysis module is configured to determine that the account to be cleaned satisfies a cleaning condition when a data cleaning date is one of cleaning dates in the special date cleaning mode if the account cleaning mode corresponding to the total cleaning control parameter is a special date cleaning mode, where the cleaning date parameter includes: a special date mode and each cleaning date.

In one embodiment, the product cleaning parameter obtaining module is configured to query product cleaning parameters corresponding to the product identifier and the cleaning identifier from the preset parameter component according to the product identifier and the cleaning identifier of the account to be cleaned if a cleaning condition is satisfied, and the service master table includes the product identifier.

In one embodiment, the apparatus further comprises: an account to be cleaned storage module;

the account storage module to be cleaned is used for updating the account state of the account to be cleaned in the service master table to a cleaning state; acquiring key information of an account to be cleaned, wherein the account state is a cleaning state, and the key information comprises at least one of basic account information, historical bill information and historical transaction details; backing up and storing the key information; and writing the account to be cleaned into a cleaning account comparison table.

In one embodiment, the service data cleaning module is configured to determine whether a parameter condition corresponding to a field parameter is met if the product cleaning parameter includes the field parameter of a specified field, where the specified field includes an account retention time; and if so, cleaning the service data of the account to be cleaned.

In one embodiment, the service data cleaning module is configured to obtain information of a data table to be cleaned, which is configured in a configuration file; and deleting the record corresponding to the account to be cleaned in the data table corresponding to the data table information to be cleaned.

In a third aspect, the present application further provides a computer device, which includes a memory and a processor, where the memory stores a computer program, and the processor implements the steps of the service data cleaning method when executing the computer program.

In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the service data cleaning method.

In a fifth aspect, the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the computer program implements the steps of the service data cleaning method.

According to the service data cleaning method, the service data cleaning device, the computer equipment, the storage medium and the computer program product, the account to be cleaned is screened out through the service master table, the account to be cleaned is matched in the preset parameter component, whether the account to be cleaned meets the cleaning condition or not is determined, and when the cleaning condition is met, the product cleaning parameter corresponding to the account to be cleaned is determined according to the preset parameter component; and performing service data cleaning on the account to be cleaned based on the product cleaning parameters corresponding to the account to be cleaned. By using the business data processing method, whether the account to be cleaned meets the cleaning condition is determined firstly, so that the situation that the data cleaning process is required to be executed completely all the time can be avoided, the resource consumption is reduced, and the product cleaning parameters of the account to be cleaned are determined under the situation that the account to be cleaned meets the cleaning condition, so that the corresponding business data cleaning can be carried out aiming at different types of accounts to be cleaned, the requirements of flexibility, changeability, product customization and the like are met, and the business data cleaning efficiency can be improved through the method.

Drawings

FIG. 1 is a diagram of an exemplary embodiment of a method for cleaning service data;

FIG. 2 is a flow chart illustrating a method for clearing service data according to an embodiment;

FIG. 3 is a schematic diagram of data interaction in a service data cleaning method according to an embodiment;

FIG. 4 is a flow chart illustrating a method for clearing service data in another embodiment;

FIG. 5 is a block diagram showing the structure of a service data cleansing apparatus according to an embodiment;

FIG. 6 is a diagram illustrating an internal structure of a computer device according to an embodiment;

FIG. 7 is a diagram illustrating an internal structure of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. It should be noted that, in the technical solution of the present application, the acquisition, storage, use, processing, and the like of data all conform to the relevant regulations of national laws and regulations.

The service data cleaning method provided by the embodiment of the present application, the service data cleaning provided by the embodiment of the present application, may be applied to an application environment as shown in fig. 1. The application environment may relate to only the terminal 102, only the server 104, or both the terminal 102 and the server 104, wherein the terminal 102 communicates with the server 104 via a network. The data storage system may store data that the server 104 needs to process. The data storage system may be integrated on the server 104, or may be located on the cloud or other network server. Specifically, the terminal 102 or the server 104 completes a service data cleaning method, which includes: screening out an account to be cleaned based on a service master table, wherein the account to be cleaned is a service account number with an account state in a closed state, and the service master table comprises the service account number; matching the account to be cleaned in a preset parameter assembly, and determining whether a cleaning identifier corresponding to the account to be cleaned meets a cleaning condition; if the cleaning condition is met, determining a product cleaning parameter corresponding to the account to be cleaned according to the preset parameter component; and based on the product cleaning parameters corresponding to the account to be cleaned, cleaning the service data of the account to be cleaned. The terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, internet of things devices and portable wearable devices, and the internet of things devices may be smart speakers, smart televisions, smart air conditioners, smart car-mounted devices, and the like. The portable wearable device can be a smart watch, a smart bracelet, a head-mounted device, and the like. The server 104 may be implemented as a stand-alone server or as a server cluster comprised of multiple servers.

In an embodiment, as shown in fig. 2, a method for clearing service data is provided, which is described by taking the method as an example applied to the terminal 102 in fig. 1, and includes the following steps:

step S202, screening out accounts to be cleaned based on a service master table, wherein the accounts to be cleaned are service account numbers with account states in closed states, and the service master table comprises the service account numbers.

In one embodiment, the service master table may refer to a pre-established table related to a service, the account to be cleaned refers to an account waiting to be cleaned, the account status refers to a status of the account to be cleaned, and the service master table may include a service account number of the account to be cleaned.

In one embodiment, the business master table may be a loan master table including loan account numbers, and the loan account numbers to be cleared may be screened out based on the loan master table.

In one embodiment, the status of the account to be cleared may include a normal status, an ending status, a closing status, and a clearing status, where, taking the account to be cleared as a loan account as an example for explanation, the default status of the loan account is a normal status, and the status of the loan account is changed to the ending status through ending transaction, if the loan account is an automatic ending account, the status may also be automatically changed to the ending status when the loan of the loan account is still clear, and after the loan of the loan account is ended, the status may be automatically changed to the closing status at the end of the ending day, and the loan account is in the closing status, and thus, no fund or maintenance transaction may not be performed.

Step S204, the account to be cleaned is matched in a preset parameter assembly, and whether the cleaning identifier corresponding to the account to be cleaned meets the cleaning condition is determined.

In one implementation, relevant data is stored in a preset parameter component, a cleaning strategy can be predefined for the relevant data, the data is configurable and can be modified according to different requirements, the data of the parameter component is preset, the preset parameter component can be a multi-level storage design, firstly, a local cache of a data user is adopted, then, a distributed cache (redis) is adopted, secondly, a local cache of a data provider is adopted, and finally, a database is adopted.

Step S206, if the cleaning condition is met, determining product cleaning parameters corresponding to the account to be cleaned according to the preset parameter component.

In one embodiment, the product cleaning parameters are provided with cleaning measures, corresponding cleaning strategies are provided for different products, and when the cleaning conditions are met, the conditions for cleaning accounts to be cleaned by branches are met, and the product cleaning parameters corresponding to the accounts to be cleaned can be determined according to the preset parameter components.

And step S207, if the cleaning condition is not met, exiting the cleaning process of the account to be cleaned.

If the cleaning condition is not met, the subsequent product cleaning parameters are not required to be determined, and the cleaning process of the account to be cleaned is directly quitted, so that the condition that the cleaning process is always required to be completely executed can be avoided, and the resource consumption is reduced.

And S208, performing service data cleaning on the account to be cleaned based on the product cleaning parameters corresponding to the account to be cleaned.

In one embodiment, the service data processing may refer to clearing processing of data associated with an account to be cleared, for example, the account data, account history data, customer-related data, and the like may be cleared according to product clearing parameters corresponding to the account to be cleared, where the account data may include basic loan account information such as information, bill information, interest rate information, and overdue information, the account history data may record various transaction histories and maintenance histories of all loan accounts, and the customer-related data may include information of customers, relationships between customers and loans, and the like.

In the service data cleaning method, an account to be cleaned is screened out through a service master table, the account to be cleaned is matched in a preset parameter component, whether the account to be cleaned meets a cleaning condition or not is determined, and when the cleaning condition is met, a product cleaning parameter corresponding to the account to be cleaned is determined according to the preset parameter component; and performing service data cleaning on the account to be cleaned based on the product cleaning parameters corresponding to the account to be cleaned. By using the business data processing method, whether the account to be cleaned meets the cleaning condition is determined firstly, so that the situation that the data cleaning process is required to be executed completely all the time can be avoided, the resource consumption is reduced, and the product cleaning parameters of the account to be cleaned are determined under the situation that the account to be cleaned meets the cleaning condition, so that the corresponding business data cleaning can be carried out aiming at different types of accounts to be cleaned, the requirements of flexibility, changeability, product customization and the like are met, and the business data cleaning efficiency can be improved through the method.

In one embodiment, the screening out accounts to be cleaned based on the business master table includes: inquiring an account state field in the service master table, wherein the service master table comprises account state information; and screening the loan account number with the account state of the account state field being in a closed state as an account to be cleaned.

In one embodiment, the service master table may be a loan master table, the loan master table may include fields related to cleaning, such as a loan account number field, an account status field, and a product number field, and by querying the account status field in the loan master table, it may be determined whether an account corresponding to the loan needs to be cleaned, and when the value of the account status field is "CL", it indicates that the loan is closed, and specifically, a query statement may be executed in the program to query all loan account numbers whose "account status" is "CL" in the loan master table, and then the account to be cleaned may be screened out. Therefore, the account to be cleaned can be screened out by the method.

In one embodiment, the matching the account to be cleaned in a preset parameter component and determining whether a cleaning identifier corresponding to the account to be cleaned meets a cleaning condition include: inquiring a cleaning master control parameter corresponding to the cleaning identifier from the preset parameter component based on the cleaning identifier corresponding to the account to be cleaned, wherein the cleaning master control parameter comprises a cleaning date parameter; and if the current date is matched with the cleaning date parameter, determining that the cleaning identifier corresponding to the account to be cleaned meets the cleaning condition.

In one embodiment, an incidence relation between a cleaning identifier and a cleaning master control parameter is predefined in a parameter pre-assembly, whether an account to be cleaned can be globally controlled through the cleaning master control parameter, the current cleaning date and the cleaning date parameter are matched, whether the cleaning identifier corresponding to the account to be cleaned meets a cleaning condition can be determined, and if the cleaning identifier corresponding to the account to be cleaned meets the cleaning condition, the cleaning identifier corresponding to the account to be cleaned is determined to meet the cleaning condition. Therefore, whether the cleaning mark meets the cleaning condition or not can be determined through the method.

In one embodiment, the cleaning date parameter includes: a fixed date cleaning mode; if the account cleaning mode corresponding to the cleaning master control parameter is a fixed date cleaning mode, determining that the account to be cleaned meets the cleaning condition when the data cleaning date is the same as the fixed date of the fixed date cleaning mode.

In one embodiment, the account cleaning mode defined by the cleaning date parameter may be a fixed date cleaning mode, which means that account cleaning is performed on a fixed day every month, and whether the data cleaning date on the current day is the cleaning day set in the current month is checked, if yes, it is determined that the account to be cleaned meets the cleaning condition, otherwise, the program is directly exited. So that whether the cleaning condition is satisfied can be determined by the above method.

In one embodiment, the cleaning date parameter includes: special date mode and each cleaning date; if the account cleaning mode corresponding to the total cleaning parameter is a special date cleaning mode, when the data cleaning date is one of the cleaning dates in the special date cleaning mode, determining that the account to be cleaned meets the cleaning condition.

In one embodiment, the account cleaning mode defined by the cleaning date parameter can be a special date mode, which means that account cleaning can be performed on the defined special date, whether cleaning conditions are met is determined by checking whether the date of day data cleaning is one of the set special cleaning dates, and if so, the following processing is performed, or the program is directly quitted, so that whether the cleaning conditions are met can be determined by the method. The cleaning date parameter flexibly controls the cleaning processing time, the system can set different cleaning modes and cleaning dates according to different requirements of each branch, the condition that the cleaning process needs to be completely executed every day is avoided, and the resource consumption is reduced.

In one embodiment, the determining, according to the preset parameter component, a product cleaning parameter corresponding to the account to be cleaned if the cleaning condition is met includes: if the cleaning condition is met, according to the product identification of the account to be cleaned and the cleaning identification, product cleaning parameters corresponding to the product identification and the cleaning identification are inquired from the preset parameter assembly, and the service master table comprises the product identification.

In one of the embodiments, the product identifier may be used to identify which product the account to be cleaned belongs to, because of the diversity of products, different product cleaning requirements may be different, wherein any identifier such as letters, numbers, feature codes and the like may be used as the product identifier, as long as different products can be distinguished, the corresponding relationship between the product identifier, the division number and the product cleaning parameter is predefined in the preset parameter component, if the cleaning condition is satisfied, the product cleaning parameter corresponding to the product identifier and the cleaning identifier may be queried according to the product identifier and the cleaning identifier of the account to be cleaned from the preset parameter component. Therefore, the product cleaning parameters can be determined by the method, and because not all products need special cleaning strategies, different product cleaning parameters corresponding to the products can be set.

In one embodiment, before performing the service data cleaning on the account to be cleaned, the method includes: updating the account state of the account to be cleaned in the service master table to be a cleaning state; acquiring key information of an account to be cleaned, wherein the account state is a cleaning state, and the key information comprises at least one of basic account information, historical bill information and historical transaction details; backing up and storing the key information; and writing the account to be cleaned into a cleaning account comparison table.

In one embodiment, the account state in the main business table may be changed to PU (cleaning state), so that it may be identified that the account to be cleaned may already be cleaned, for the account to be cleaned whose account state is PU state, key information of an association table associated with the main business table, such as basic account information, historical billing information, and historical transaction details, may be queried, and may be written into a data backup intermediate table for backup storage, and then the data backup table is summarized to a data warehouse independent from the system for backup storage, and then the data backup intermediate table is cleaned. So that the account number can be recorded to exist in the system by the method.

In one embodiment, referring to fig. 3, a schematic diagram of data interaction between the cleaning account comparison table and the data warehouse is shown, after an account to be cleaned is cleaned, if there is a subsequent need to query account detailed information, the cleaning account comparison table may be used as a routing table of the data warehouse, and a loan account in the cleaning account comparison table may be used as a routing key value to query the data warehouse for corresponding detailed information.

In one embodiment, the performing service data cleaning on the account to be cleaned based on the product cleaning parameter corresponding to the account to be cleaned includes: if the product cleaning parameters contain field parameters of specified fields, determining whether parameter conditions corresponding to the field parameters are met, wherein the specified fields comprise account retention time; and if so, cleaning the service data of the account to be cleaned.

In one embodiment, the parameter condition may be a preset cleaning condition for different product requirements, such as: fast crediting products have the characteristics of relatively short cycle time and relatively small amount of money involved, so that the time required to be retained after an account is closed does not need to be very long, generally the data of the account does not need to be basically concerned after half a year of closing, for the condition that the number of account reserved days can be set in the parameter condition, the number of account reserved days for fast loan is set to be 180 days, and the cleaning can be carried out when the condition is met, for example, products such as house loan products have the characteristics of long period and large amount of money, it may be necessary to continue the hold for a longer period of time even if it is turned off, so the frequency of cleaning can be set to annual cleaning, the hold time to 2 years, if the product cleaning parameters contain field parameters of specified fields, whether parameter conditions corresponding to the field parameters are met is determined, and the specified fields comprise account retention time; and if so, cleaning the service data of the account to be cleaned. Therefore, the method can be used for developing and cleaning the service data according to the actual situation.

In one embodiment, the performing service data cleaning on the account to be cleaned includes: acquiring information of a data table to be cleaned configured in a configuration file; and deleting the record corresponding to the account to be cleaned in the data table corresponding to the data table information to be cleaned.

In one embodiment, the table name may be configured in the configuration file, the configuration file is directly read to obtain the data table information to be cleaned during program processing, and then the corresponding SQL statement deletion is executed to complete the deletion. Thereby completing the cleaning process by the above method.

In one embodiment, as shown in fig. 4, a flow diagram of a service data cleaning method in a specific embodiment is shown:

in this embodiment, the loan data in the bank loan system is taken as an example for explanation, where the bank loan system may run a batch processing flow at the end of a day every day, each branch may run a batch processing flow, the batch processing flow may include a plurality of batch processing jobs, and the loan data cleaning flow may be one of the batch processing jobs.

When the batch processing operation of any branch line starts, the loan account to be cleared can be screened out according to a loan main table, the loan account to be cleared can be a business account with the account state in a closing state, the loan main table comprises loan business account numbers, wherein the default state of the loan account is a normal state, the state of the loan account is converted into a clearing state through clearing transaction, if the loan account is an automatic clearing account, the loan account can also be automatically converted into the clearing state after all the original information of the loan account is cleared, the loan of the loan account can be automatically converted into the closing state at the end of the clearing day, the loan account is in the closing state, and any fund or maintenance transaction cannot be carried out.

The loan main table may include fields related to cleaning, such as a loan account number field, an account status field, a product number field, and the like, and when a to-be-cleaned loan account is screened based on the loan main table, whether an account corresponding to the loan needs to be cleaned is determined by querying the account status field in the loan main table, and when the value of the account status field is "CL", the loan is closed, specifically, a query statement may be executed in a program to query all loan account numbers whose "account status" is "CL", and the to-be-cleaned loan account may be screened out.

After the loan accounts to be cleaned are screened out, a cleaning master control parameter corresponding to the cleaning identifier can be inquired from a preset parameter component on the basis of the cleaning identifier corresponding to the loan accounts to be cleaned, wherein the cleaning master control parameter comprises a cleaning date parameter; if the current date is matched with the cleaning date parameter, determining that a cleaning identifier corresponding to the account to be cleaned meets the cleaning condition, predefining an association relation between the cleaning identifier and a cleaning master control parameter in a parameter pre-assembly, and globally controlling whether the account to be cleaned can be cleaned through the cleaning master control parameter, wherein an account cleaning mode defined by the cleaning date parameter can be a fixed date cleaning mode, which means that the account is cleaned on a fixed day every month, and whether the cleaning date is the cleaning date set in the month is cleaned through checking the data on the day, if so, determining that the account to be cleaned meets the cleaning condition, otherwise, directly quitting the program. The account cleaning mode defined by the cleaning date parameter can be a special date mode, which means that account cleaning can be carried out on the defined special date, whether the cleaning condition is met is determined by checking whether the date of cleaning data is one of the set special cleaning dates, if so, the following processing is carried out, and if not, the program is directly quitted, so that whether the cleaning condition is met can be determined by the method. The cleaning date parameter flexibly controls the cleaning processing time, the system can set different cleaning modes and cleaning dates according to different requirements of each branch, the condition that the cleaning process needs to be completely executed every day is avoided, and the resource consumption is reduced.

After the cleaning condition is determined to be met, the loan account to be cleaned can be cleared from the preset parameter components according to the product identification and the cleaning identification of the loan account, inquiring product cleaning parameters corresponding to the product identification and the cleaning identification, wherein the loan owner table comprises the product identification which can be used for identifying which product the loan account belongs to, different product cleaning requirements may be different due to the variety of the product, wherein, any identifier such as letter, number and feature code can be used as the product identification, as long as different products can be distinguished, the corresponding relation among the product identification, the line number and the product cleaning parameter is predefined in the preset parameter component, if the cleaning condition is satisfied, product cleaning parameters corresponding to the product identification and the cleaning identification can be inquired from the preset parameter assembly according to the product identification and the cleaning identification of the account to be cleaned. Therefore, the product cleaning parameters can be determined by the method, and since not all products need special cleaning strategies, the general cleaning parameters of the products can be read when the product cleaning parameters cannot be inquired, and cleaning operation can be directly carried out according to the cleaning strategies set by the general cleaning parameters.

In particular, fast-crediting products have the characteristics of relatively short cycle time and small amount of money involved, so that the time required to be retained after an account is closed does not need to be very long, generally the data of the account does not need to be basically concerned after half a year of closing, for the condition that the number of account reserved days can be set in the parameter condition, the number of account reserved days for fast loan is set to be 180 days, and the cleaning can be carried out when the condition is met, for example, products such as house loan products have the characteristics of long period and large amount of money, it may be necessary to continue the hold for a longer period of time even if it is turned off, so the frequency of cleaning can be set to annual cleaning, the hold time to 2 years, if the product cleaning parameters contain field parameters of specified fields, whether parameter conditions corresponding to the field parameters are met is determined, and the specified fields comprise account retention time; and if so, cleaning the service data of the account to be cleaned. Therefore, the method can be used for developing and cleaning the service data according to the actual situation.

After the clearing strategy of the loan account to be cleared is determined, the account state in the loan main table can be changed into PU (clearing state), so that the loan account can be identified to be cleared, for the loan account with the account state of PU, key information of an association table associated with the loan main table, such as account basic information, historical bill information, historical transaction details and the like, can be inquired, the information can be written into a data backup intermediate table for backup storage, then the data backup table is gathered to a data warehouse independent from the system for backup storage, and then the data backup intermediate table is cleared.

Finally, the table name can be configured in the configuration file, the configuration file is directly read during program processing to obtain the data table information needing to be cleaned, and then the corresponding SQL deleting statement is executed to complete the deletion, so that the cleaning process is completed.

It should be understood that, although the steps in the flowcharts related to the embodiments as described above are sequentially displayed as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a part of the steps in the flowcharts related to the embodiments described above may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the execution order of the steps or stages is not necessarily sequential, but may be rotated or alternated with other steps or at least a part of the steps or stages in other steps.

Based on the same inventive concept, the embodiment of the present application further provides a service data cleaning apparatus for implementing the service data cleaning method. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme described in the above method, so specific limitations in one or more embodiments of the service data cleaning device provided below may refer to the limitations on the service data cleaning method in the foregoing, and details are not described here.

In one embodiment, as shown in fig. 5, a business data cleaning apparatus is provided, which includes an account to be cleaned determining module 502, a cleaning condition analyzing module 504, a product cleaning parameter obtaining module 506, and a business data cleaning module 508, where:

a to-be-cleaned account determining module 502, configured to screen out an account to be cleaned based on a service master table, where the account to be cleaned is a service account whose account state is in a closed state, and the service master table includes the service account;

a cleaning condition analysis module 504, configured to match the account to be cleaned in a preset parameter component, and determine whether a cleaning identifier corresponding to the account to be cleaned meets a cleaning condition;

a product cleaning parameter obtaining module 506, configured to determine, according to the preset parameter component, a product cleaning parameter corresponding to the account to be cleaned if a cleaning condition is met;

and the service data cleaning module 508 is configured to perform service data cleaning on the account to be cleaned based on the product cleaning parameter corresponding to the account to be cleaned.

All or part of each module in the service data cleaning device can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.

In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 6. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing business data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a business data cleansing method.

In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 7. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a business data cleansing method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.

Those skilled in the art will appreciate that the configurations shown in fig. 6 and 7 are merely block diagrams of some configurations relevant to the present disclosure, and do not constitute a limitation on the computing devices to which the present disclosure may be applied, and that a particular computing device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, a computer device is provided, which includes a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above-mentioned service data cleaning method when executing the computer program.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the above-mentioned service data cleansing method.

In an embodiment, a computer program product is provided, comprising a computer program which, when executed by a processor, performs the steps of the above-described business data cleansing method.

It should be noted that, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, presented data, etc.) referred to in the present application are information and data authorized by the user or sufficiently authorized by each party.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high-density embedded nonvolatile Memory, resistive Random Access Memory (ReRAM), Magnetic Random Access Memory (MRAM), Ferroelectric Random Access Memory (FRAM), Phase Change Memory (PCM), graphene Memory, and the like. Volatile Memory can include Random Access Memory (RAM), external cache Memory, and the like. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others. The databases referred to in various embodiments provided herein may include at least one of relational and non-relational databases. The non-relational database may include, but is not limited to, a block chain based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, quantum computing based data processing logic devices, etc., without limitation.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.

Claims

1. A method for clearing service data, the method comprising:

if the cleaning condition is met, determining product cleaning parameters corresponding to the account to be cleaned according to the preset parameter component;

2. The method of claim 1, wherein screening out accounts to be cleaned based on the business master table comprises:

3. The method according to claim 1, wherein the matching the account to be cleaned in a preset parameter component to determine whether a cleaning identifier corresponding to the account to be cleaned meets a cleaning condition comprises:

4. The method of claim 3, wherein the cleaning date parameter comprises: a fixed date cleaning mode;

5. The method of claim 3, wherein the cleaning date parameter comprises: special date mode and each cleaning date;

6. The method according to claim 1, wherein determining product cleaning parameters corresponding to the account to be cleaned according to the preset parameter component if the cleaning condition is satisfied comprises:

7. The method of claim 1, wherein before performing the service data cleaning on the account to be cleaned, the method comprises:

backing up and storing the key information;

and writing the account to be cleaned into a cleaning account comparison table.

8. The method according to claim 1, wherein the cleaning of the service data of the account to be cleaned based on the product cleaning parameter corresponding to the account to be cleaned comprises:

and if so, cleaning the service data of the account to be cleaned.

9. The method according to claim 1 or 8, wherein the clearing the business data of the account to be cleared comprises:

10. A service data cleansing apparatus, characterized in that the apparatus comprises:

11. The apparatus of claim 10, wherein the to-be-cleaned account determining module is configured to query an account status field in the service master table, and the service master table includes account status information; and screening the loan account number with the account state of the account state field being in a closed state as an account to be cleaned.

12. The device according to claim 10, wherein the cleaning condition analysis module is configured to query a cleaning total control parameter corresponding to the cleaning identifier from the preset parameter component based on the cleaning identifier corresponding to the account to be cleaned, where the cleaning total control parameter includes a cleaning date parameter; and if the current date is matched with the cleaning date parameter, determining that the cleaning identifier corresponding to the account to be cleaned meets the cleaning condition.

13. The device according to claim 12, wherein the cleaning condition analysis module is configured to determine that the account to be cleaned satisfies a cleaning condition when a data cleaning date is the same as a fixed date of the fixed date cleaning mode if the account cleaning mode corresponding to the cleaning general control parameter is the fixed date cleaning mode, and the cleaning date parameter includes: fixed date cleaning mode.

14. The device according to claim 12, wherein the cleaning condition analysis module is configured to determine that the account to be cleaned satisfies a cleaning condition when the data cleaning date is one of the cleaning dates in the special date cleaning mode if the account cleaning mode corresponding to the cleaning general control parameter is the special date cleaning mode, and the cleaning date parameter includes: a special date mode and each cleaning date.

15. The apparatus according to claim 10, wherein the product cleaning parameter obtaining module is configured to query product cleaning parameters corresponding to the product identifier and the cleaning identifier from the preset parameter component according to the product identifier and the cleaning identifier of the account to be cleaned if a cleaning condition is satisfied, and the service master table includes the product identifier.

16. The apparatus of claim 10, further comprising: an account to be cleaned storage module;

17. The apparatus according to claim 10, wherein the service data cleaning module is configured to determine whether a parameter condition corresponding to a field parameter is satisfied if the product cleaning parameter includes the field parameter of a specified field, where the specified field includes an account retention duration; and if so, cleaning the service data of the account to be cleaned.

18. The apparatus according to claim 10, wherein the service data cleaning module is configured to obtain information of a data table to be cleaned configured in a configuration file; and deleting the record corresponding to the account to be cleaned in the data table corresponding to the data table information to be cleaned.

19. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor realizes the steps of the method of any one of claims 1 to 9 when executing the computer program.

20. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 9.

21. A computer program product comprising a computer program, characterized in that the computer program realizes the steps of the method of any one of claims 1 to 9 when executed by a processor.