CN107291804A

CN107291804A - Method, equipment and the computer-readable recording medium of data scrubbing

Info

Publication number: CN107291804A
Application number: CN201710338705.8A
Authority: CN
Inventors: 杨彩亮
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2017-05-15
Filing date: 2017-05-15
Publication date: 2017-10-24

Abstract

The invention discloses a kind of method of data scrubbing, including：The configuration content of data scrubbing task and the temporal information of data scrubbing task are obtained by visualizing web interface；The configuration content of data scrubbing task includes：The cleaning rule of the title of data scrubbing task, the type of data scrubbing task and data scrubbing task；The execution order of data scrubbing task is generated according to the temporal information of the configuration content of data scrubbing task and data scrubbing task；Corresponding data are cleared up according to the execution order of data scrubbing task.The invention also discloses a kind of equipment of data scrubbing and computer-readable recording medium.The workload of operation and maintenance personnel can greatly be reduced by the solution of the present invention；Meanwhile, the dimension variation of data scrubbing time enables the unwanted data of some in application system to be cleaned out in time, improves operating efficiency.

Description

Method, equipment and the computer-readable recording medium of data scrubbing

Technical field

The present invention relates to field of computer technology, more particularly to a kind of method of data scrubbing, equipment and computer-readable Storage medium.

Background technology

During application system is run, many data can be produced, for example, data related to system business and/or It is the data related to application program；With the passage of application system run time, the quantity of all these data as described above becomes It is more and more, now, if do not cleared up in time these data, it is possible that the process performance reduction of application system, The problems such as disk space takes, so as to cause application system or related service not to run normally.

In the prior art, how the data for application system clear up, under normal circumstances often operation maintenance people Member needs to realize the cleaning of specified data by writing and running backstage code；But, when needing to clear up other data, fortune Battalion attendant needs to write and run backstage code again；Because the data in application system are huge and data class is numerous It is many, the workload that data not only increase operation and maintenance personnel is cleared up by existing manner, also causes some unwanted data It can not in time be cleaned out, so, the operating efficiency of application system will be reduced.

The content of the invention

In view of this, the embodiment of the present invention is expected to provide a kind of method of data scrubbing, equipment and computer-readable storage Medium, to reduce the workload of operation and maintenance personnel and improve the operating efficiency of application system.

To reach above-mentioned purpose, the technical proposal of the invention is realized in this way：

The present invention provides a kind of method of data scrubbing, and methods described includes：

The configuration content and data scrubbing task of data scrubbing task are obtained by visualizing global wide area network web interface Temporal information；The configuration content of the data scrubbing task includes：Title, the type of data scrubbing task of data scrubbing task And the cleaning rule of data scrubbing task；

Data are generated according to the temporal information of the configuration content of the data scrubbing task and the data scrubbing task clear The execution order of reason task；

Corresponding data are cleared up according to the execution order of the data scrubbing task.

In such scheme, cleaning is carried out to corresponding data in the execution order according to the data scrubbing task Afterwards, methods described also includes：

Manage the execution order of the data scrubbing task；

Wherein, the execution order of the management data scrubbing task includes：Delete holding for the data scrubbing task Line command, suspend or start in the performing order, edit the execution order of the data scrubbing task of the data scrubbing task At least one of or any combination in them；

The execution order of editor's data scrubbing task, including：

The configuration content for performing the data scrubbing task in order and the data for editing the data scrubbing task are clear The temporal information of reason task.

Judge whether the execution order of the data scrubbing task runs succeeded；

If the execution order is not carried out success, the execution order according to the data scrubbing task is repeated The step of clearing up corresponding data, untill number of repetition is more than or equal to preset times, will be not carried out successfully knot Fruit is presented by the visualization web interface；

If the execution order of the data scrubbing task runs succeeded, the result after running succeeded is passed through described visual Change web interface to present.

In such scheme, the temporal information of the data scrubbing task includes：It is disposable perform data scrubbing task when Between information or non-disposable execution data scrubbing task temporal information；

The temporal information of the disposable execution data scrubbing task is a first set time point；

The non-disposable temporal information for performing data scrubbing task is that execution data are clear daily in preset time period The temporal information of reason task, the temporal information of data scrubbing task is performed in preset time period weekly or in preset time period Monthly perform the temporal information of data scrubbing task；The preset time period has sart point in time and end time point；Wherein,

If the non-disposable temporal information for performing data scrubbing task is to perform data daily in preset time period The temporal information of clean-up task, then the preset time period is the period more than or equal to two days, and the daily execution data are clear The temporal information of reason task is a second set time point in every day in the preset time period, or described default 1 different set time points in period in every day；

If the non-disposable temporal information for performing data scrubbing task is to perform data weekly in preset time period The temporal information of clean-up task, then the preset time period is the period more than or equal to two weeks, and the data of execution weekly are clear The temporal information of reason task is a 3rd set time point in each week in the preset time period, or described default 1 different set time points in period in each week；

If the non-disposable temporal information for performing data scrubbing task is that data are monthly performed in preset time period The temporal information of clean-up task, then the preset time period be more than or equal to the bimestrial period, it is described monthly to perform data The temporal information of clean-up task is a 4th set time point in each middle of the month in the preset time period, or described The 1 different set time points in each middle of the month in preset time period.

In such scheme, the type of the data scrubbing task includes：File type and/or table data type；

The cleaning rule of the data scrubbing task includes：The cleaning rule of file clean-up task and/or table data scrubbing The cleaning rule of task；

Wherein, file path and corresponding information, file mistake are included in the cleaning rule of the file clean-up task Phase time term and corresponding information, cleaning document convention and corresponding information and exclusion file item and corresponding information；

Include table data source item and corresponding information, table data name in the cleaning rule of the table data scrubbing task And corresponding information, table data source expired time and corresponding information, cleaning table data rule and corresponding information and Once cleaning table data record several and corresponding information.

The present invention also provides a kind of equipment of data scrubbing, and the equipment includes：Interface, processor, memory and communication Bus；

The communication bus, for realizing the connection communication between the interface, the processor and the memory；

The processor, the program for performing the data scrubbing stored in the memory, to realize following steps：

In such scheme, the processor is additionally operable to perform the program of the data scrubbing, to realize following steps：

Manage the execution order of the data scrubbing task；

The processor, is additionally operable to perform the program of the data scrubbing, to realize following steps：

Judge whether the execution order of the data scrubbing task runs succeeded；

The present invention also provides a kind of computer-readable recording medium, the computer-readable recording medium storage have one or The multiple programs of person, one or more of programs can be by one or more computing device, to realize following steps：

Method, equipment and the computer-readable recording medium for the data scrubbing that the embodiment of the present invention is provided, by visual Change web interface and obtain the configuration content of data scrubbing task and the temporal information of data scrubbing task；According to data scrubbing task Configuration content and data scrubbing task temporal information generate data scrubbing task execution order；According to data scrubbing task Execution order corresponding data are cleared up；Cleaning is needed in web interface flexible configuration application system by visualizing Data and clearance time, make the operation of cleaning data flexible, and extensively, operation and maintenance personnel without write again for the data area of covering And run backstage code to realize the cleaning of specified data, greatly reduce the workload of operation and maintenance personnel；Meanwhile, data The dimension variation of clearance time enables the unwanted data of some in application system to be cleaned out in time, improves work effect Rate.

Brief description of the drawings

Fig. 1 is the hardware architecture diagram for an optional mobile terminal for realizing each embodiment of the invention；

Fig. 2 is a kind of communications network system Organization Chart provided in an embodiment of the present invention；

Fig. 3 is the flow chart of the embodiment of the method one of data scrubbing of the present invention；

Fig. 4 is the flow chart of the embodiment of the method two of data scrubbing of the present invention；

Fig. 5 is the embodiment of the method two of data scrubbing of the present invention by visualizing web interface configuration data clean-up task Configuration content and data scrubbing task temporal information schematic diagram；

Fig. 6 is the exectorial signal of the management data scrubbing task of the embodiment of the method two of data scrubbing of the present invention Figure；

After Fig. 7 runs succeeded for the execution order of the data scrubbing task of the embodiment of the method two of data scrubbing of the present invention Result schematic diagram；

After Fig. 8 is performed not successfully for the execution order of the data scrubbing task of the embodiment of the method two of data scrubbing of the present invention Result schematic diagram；

Fig. 9 is the structural representation of the device embodiment of data scrubbing of the present invention；

Figure 10 is the structural representation of the apparatus embodiments of data scrubbing of the present invention.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described.

It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.

In follow-up description, the suffix using such as " module ", " part " or " unit " for representing element is only Be conducive to the explanation of the present invention, itself there is no a specific meaning.Therefore, " module ", " part " or " unit " can be mixed Ground is used.

Terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as mobile phone, flat board Computer, notebook computer, palm PC, personal digital assistant (Personal Digital Assistant, PDA), portable Media player (Portable Media Player, PMP), guider, wearable device, Intelligent bracelet, pedometer etc. are moved Move the fixed terminals such as terminal, and numeral TV, desktop computer.

It will be illustrated in subsequent descriptions by taking mobile terminal as an example, it will be appreciated by those skilled in the art that except special Outside element for moving purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.

Referring to Fig. 1, hardware configuration signals of the Fig. 1 for an optional mobile terminal of realization each embodiment of the invention Figure, the mobile terminal 1 00 can include：RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output Unit 103, A/V (audio/video) input block 104, sensor 105, display unit 106, user input unit 107, interface The parts such as unit 108, memory 109, processor 110 and power supply 111.It will be understood by those skilled in the art that showing in Fig. 1 The mobile terminal structure gone out does not constitute the restriction to mobile terminal, and mobile terminal can be included than illustrating more or less portions Part, either combines some parts or different parts arrangement.

The all parts of mobile terminal are specifically introduced with reference to Fig. 1：

Radio frequency unit 101 can be used for receiving and sending messages or communication process in, the reception and transmission of signal, specifically, by base station Downlink information receive after, handled to processor 110；In addition, up data are sent into base station.Generally, radio frequency unit 101 Including but not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier, duplexer etc..In addition, penetrating Frequency unit 101 can also be communicated by radio communication with network and other equipment.Above-mentioned radio communication can use any communication Standard or agreement, including but not limited to GSM (Global System of Mobile communication, global system for mobile telecommunications System), GPRS (General Packet Radio Service, general packet radio service), CDMA2000 (Code Division Multiple Access 2000, CDMA 2000), WCDMA (Wideband Code Division Multiple Access, WCDMA), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, TD SDMA), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, FDD Long Term Evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution, time division duplex Long Term Evolution) etc..

WiFi belongs to short range wireless transmission technology, and mobile terminal can help user's transmitting-receiving electricity by WiFi module 102 Sub- mail, browse webpage and access streaming video etc., it has provided the user wireless broadband internet and accessed.Although Fig. 1 shows Go out WiFi module 102, but it is understood that, it is simultaneously not belonging to must be configured into for mobile terminal, completely can be according to need To be omitted in the essential scope for do not change invention.

Audio output unit 103 can be in call signal reception pattern, call mode, record mould in mobile terminal 1 00 When under the isotypes such as formula, speech recognition mode, broadcast reception mode, it is that radio frequency unit 101 or WiFi module 102 are received or The voice data stored in memory 109 is converted into audio signal and is output as sound.Moreover, audio output unit 103 The audio output related to the specific function that mobile terminal 1 00 is performed can also be provided (for example, call signal receives sound, disappeared Breath receives sound etc.).Audio output unit 103 can include loudspeaker, buzzer etc..

A/V input blocks 104 are used to receive audio or video signal.A/V input blocks 104 can include graphics processor (Graphics Processing Unit, GPU) 1041 and microphone 1042,1041 pairs of graphics processor is in video acquisition mode Or the view data progress of the static images or video obtained in image capture mode by image capture apparatus (such as camera) Reason.Picture frame after processing may be displayed on display unit 106.Picture frame after being handled through graphics processor 1041 can be deposited Storage is transmitted in memory 109 (or other storage mediums) or via radio frequency unit 101 or WiFi module 102.Mike Wind 1042 can connect in telephone calling model, logging mode, speech recognition mode etc. operational mode via microphone 1042 Quiet down sound (voice data), and can be voice data by such acoustic processing.Audio (voice) data after processing can To be converted to the form output that mobile communication base station can be sent to via radio frequency unit 101 in the case of telephone calling model. Microphone 1042 can implement various types of noises and eliminate (or suppression) algorithm to eliminate (or suppression) in reception and send sound The noise produced during frequency signal or interference.

Mobile terminal 1 00 also includes at least one sensor 105, such as optical sensor, motion sensor and other biographies Sensor.Specifically, optical sensor includes ambient light sensor and proximity transducer, wherein, ambient light sensor can be according to environment The light and shade of light adjusts the brightness of display panel 1061, and proximity transducer can close when mobile terminal 1 00 is moved in one's ear Display panel 1061 and/or backlight.As one kind of motion sensor, accelerometer sensor can detect in all directions (general For three axles) size of acceleration, size and the direction of gravity are can detect that when static, the application available for identification mobile phone posture (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, percussion) etc.； The fingerprint sensor that can also configure as mobile phone, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, The other sensors such as hygrometer, thermometer, infrared ray sensor, will not be repeated here.

Display unit 106 is used for the information for showing the information inputted by user or being supplied to user.Display unit 106 can be wrapped Display panel 1061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used Forms such as (Organic Light-Emitting Diode, OLED) configures display panel 1061.

User input unit 107 can be used for the numeral or character information for receiving input, and produce the use with mobile terminal The key signals input that family is set and function control is relevant.Specifically, user input unit 107 may include contact panel 1071 with And other input equipments 1072.Contact panel 1071, also referred to as touch-screen, collect touch operation of the user on or near it (such as user is using any suitable objects such as finger, stylus or annex on contact panel 1071 or in contact panel 1071 Neighbouring operation), and corresponding attachment means are driven according to formula set in advance.Contact panel 1071 may include touch detection Two parts of device and touch controller.Wherein, touch detecting apparatus detects the touch orientation of user, and detects touch operation band The signal come, transmits a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and by it It is converted into contact coordinate, then gives processor 110, and the order sent of reception processing device 110 and can be performed.In addition, can To realize contact panel 1071 using polytypes such as resistance-type, condenser type, infrared ray and surface acoustic waves.Except contact panel 1071, user input unit 107 can also include other input equipments 1072.Specifically, other input equipments 1072 can be wrapped Include but be not limited to physical keyboard, in function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc. One or more, do not limit herein specifically.

Further, contact panel 1071 can cover display panel 1061, detect thereon when contact panel 1071 or After neighbouring touch operation, processor 110 is sent to determine the type of touch event, with preprocessor 110 according to touch thing The type of part provides corresponding visual output on display panel 1061.Although in Fig. 1, contact panel 1071 and display panel 1061 be input and the output function that mobile terminal is realized as two independent parts, but in certain embodiments, can By contact panel 1071 and the input that is integrated and realizing mobile terminal of display panel 1061 and output function, not do specifically herein Limit.

Interface unit 108 is connected the interface that can pass through as at least one external device (ED) with mobile terminal 1 00.For example, External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing Line FPDP, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end Mouth, video i/o port, ear port etc..Interface unit 108 can be used for receiving the input from external device (ED) (for example, number It is believed that breath, electric power etc.) and the input received is transferred to one or more elements in mobile terminal 1 00 or can be with For transmitting data between mobile terminal 1 00 and external device (ED).

Memory 109 can be used for storage software program and various data.Memory 109 can mainly include storing program area And storage data field, wherein, application program (the such as sound that storing program area can be needed for storage program area, at least one function Sound playing function, image player function etc.) etc.；Storage data field can be stored uses created data (such as according to mobile phone Voice data, phone directory etc.) etc..In addition, memory 109 can include high-speed random access memory, it can also include non-easy The property lost memory, for example, at least one disk memory, flush memory device or other volatile solid-state parts.

Processor 110 is the control centre of mobile terminal, utilizes each of various interfaces and the whole mobile terminal of connection Individual part, by operation or performs and is stored in software program and/or module in memory 109, and calls and be stored in storage Data in device 109, perform the various functions and processing data of mobile terminal, so as to carry out integral monitoring to mobile terminal.Place Reason device 110 may include one or more processing units；It is preferred that, processor 110 can integrated application processor and modulatedemodulate mediate Device is managed, wherein, application processor mainly handles operating system, user interface and application program etc., and modem processor is main Handle radio communication.It is understood that above-mentioned modem processor can not also be integrated into processor 110.

Mobile terminal 1 00 can also include the power supply 111 (such as battery) powered to all parts, it is preferred that power supply 111 Can be logically contiguous by power-supply management system and processor 110, so as to realize management charging by power-supply management system, put The function such as electricity and power managed.

Although Fig. 1 is not shown, mobile terminal 1 00 can also will not be repeated here including bluetooth module etc..

For the ease of understanding the embodiment of the present invention, the communications network system that the mobile terminal of the present invention is based on is entered below Row description.

Referring to Fig. 2, Fig. 2 is a kind of communications network system Organization Chart provided in an embodiment of the present invention, the communication network system Unite as the LTE system of universal mobile communications technology, UE (User Equipment, use of the LTE system including communicating connection successively Family equipment) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, evolved UMTS lands Ground wireless access network) 202, EPC (Evolved Packet Core, evolved packet-based core networks) 203 and operator IP operation 204。

Specifically, UE201 can be above-mentioned terminal 100, and here is omitted.

E-UTRAN202 includes eNodeB2021 and other eNodeB2022 etc..Wherein, eNodeB2021 can be by returning Journey (backhaul) (such as X2 interface) is connected with other eNodeB2022, and eNodeB2021 is connected to EPC203, ENodeB2021 can provide UE201 to EPC203 access.

EPC203 can include MME (Mobility Management Entity, mobility management entity) 2031, HSS (Home Subscriber Server, home subscriber server) 2032, other MME2033, SGW (Serving Gate Way, Gateway) 2034, PGW (PDN Gate Way, grouped data network gateway) 2035 and PCRF (Policy and Charging Rules Function, policy and rate functional entity) 2036 etc..Wherein, MME2031 be processing UE201 and There is provided carrying and connection management for the control node of signaling between EPC203.HSS2032 is all to manage for providing some registers Such as function of attaching position register (not shown) etc, and some are preserved about the use such as service features, data rate The special information in family.All customer data can be transmitted by SGW2034, and PGW2035 can provide UE 201 IP Address is distributed and other functions, and PCRF2036 is strategy and the charging control strategic decision-making of business data flow and IP bearing resources Point, it selects and provided available strategy and charging control decision-making with charge execution function unit (not shown) for strategy.

IP operation 204 can include internet, Intranet, IMS (IP Multimedia Subsystem, IP multimedia System) or other IP operations etc..

Although above-mentioned be described by taking LTE system as an example, those skilled in the art it is to be understood that the present invention not only Suitable for LTE system, be readily applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA with And following new network system etc., do not limit herein.

Based on above-mentioned mobile terminal hardware configuration and communications network system, each embodiment of the inventive method is proposed.

Embodiment one

The method of data scrubbing described in the embodiment of the present invention can be applied in the terminal of data scrubbing, and the terminal can With including such as mobile phone, smart phone, notebook computer, digit broadcasting receiver, personal digital assistant (PDA), flat board The mobile terminal of computer (PAD) etc. and the fixed terminal of such as desktop computer etc..

If terminal has operating system, the operating system can be UNIX, Linux, Windows, Mac OS X, Android (Android), Windows Phone etc..

Application software (Application, APP) is the third party application of intelligent terminal, and user can be by various The application software of various kinds is handled official business, is entertained, obtains information etc., and its form includes such as ipa, pxl, deb, apk lattice Formula.

Fig. 3 is the flow chart of the embodiment of the method one of data scrubbing of the present invention, as shown in figure 3, the embodiment of the present invention is provided The method of data scrubbing can apply in the terminal (hereinafter referred to as terminal) of data scrubbing, this method can specifically be included such as Lower step：

Step 301, by visualize web interface obtain data scrubbing task configuration content and data scrubbing task when Between information.

Terminal can obtain operation and maintenance personnel by visualizing global wide area network (World Wide Web, Web) interface The configuration content of the data scrubbing task set on web interface and the temporal information of data scrubbing task, can also by After terminal and other terminal connection communications, visualization web interface in other terminals obtains operation and maintenance personnel other The configuration content of the data scrubbing task set in terminal and the temporal information of data scrubbing task；By visualizing web interface The data and clearance time of cleaning are needed in flexible configuration application system, make the operation of cleaning data flexible, and the data of covering In extensive range, operation and maintenance personnel is significantly reduced without writing again and running backstage code to realize the cleaning of specified data The workload of operation and maintenance personnel.

Wherein, the configuration content of data scrubbing task includes the title of data scrubbing task, the class of data scrubbing task Cleaning rule of type and data scrubbing task etc., the configuration content of data scrubbing task here can be entered according to actual conditions Row extension, it is not limited to above-mentioned several features.

Here, illustrated for the temporal information of data scrubbing task；The temporal information of data scrubbing task includes The temporal information of the temporal information of disposable execution data scrubbing task or non-disposable execution data scrubbing task；Run Attendant can customize oneself desired temporal information, customize a variety of time dimensions.

The temporal information of the disposable execution data scrubbing task is a first set time point；For example, this first consolidate Fix time and a little only exist once, i.e., will end task, tie after the first set time point performs a data scrubbing task The task can be destroyed after beam task.

The non-disposable temporal information for performing data scrubbing task is to perform data scrubbing daily in preset time period The temporal information of task, the temporal information that data scrubbing task is performed in preset time period weekly or in preset time period it is every The moon performs the temporal information of data scrubbing task；A variety of time dimensions are provided for operation and maintenance personnel, so can be effective Clear up unwanted data.

Wherein, if the non-disposable temporal information for performing data scrubbing task is to perform data daily in preset time period The temporal information of clean-up task, then preset time period is the period more than or equal to two days, and data scrubbing task is performed daily Temporal information is a second set time point in every day in preset time period, or in preset time period in every day 1 different set time points；For example, performing the temporal information of data scrubbing task daily in preset time period A set time point is specified to have at one in the daily effective period of time between sart point in time and end time point, or Person, which has at one in daily effective period of time between sart point in time and end time point, specifies at least two different to consolidate Fix time a little, i.e., data scrubbing task is performed a plurality of times in daily interval time section.

If the non-disposable temporal information for performing data scrubbing task is to perform data scrubbing weekly in preset time period The temporal information of task, then preset time period is the period more than or equal to two weeks, and the time of data scrubbing task is performed weekly Information in preset time period it is each week in a 3rd set time point, or in preset time period it is each week in extremely Few two different set time points；For example, performed weekly in preset time period data scrubbing task temporal information be A set time point, Huo Zhe are specified in the effective period of time weekly that one has between sart point in time and end time point When specifying at least two different fixations in the effective period of time weekly that one has between sart point in time and end time point Between point, i.e., in compartment weekly every data scrubbing task is performed a plurality of times in the period.

If the non-disposable temporal information for performing data scrubbing task is that data scrubbing is monthly performed in preset time period The temporal information of task, then preset time period be more than or equal to the bimestrial period, monthly perform data scrubbing task when Between information be a 4th set time point in each middle of the month in preset time period, or each moon in preset time period In 1 different set time points；For example, monthly performing the time letter of data scrubbing task in preset time period Cease that there is the every month between sart point in time and end time point to specify a set time in effective period of time at one Point, or at least two are specified in effective period of time not in an every month having between sart point in time and end time point With set time point, i.e., compartment in every month is every being performed a plurality of times data scrubbing task in the period.

Explanation is needed exist for, the temporal information of data scrubbing task includes but is not limited to above-mentioned temporal information, Other time information can be included, specifically can according to the actual requirements be configured, not be any limitation as herein.

The type of data scrubbing task includes file type and/or table data type, can also include other data class Type, can be extended and define according to actual needs；It is related to different types of data, the cleaning of a variety of data can be covered Task, improves the operating efficiency of clean-up task.

Next, being specifically described for the cleaning rule of data scrubbing task；The cleaning rule of data scrubbing task Then include the cleaning rule of file clean-up task and/or the cleaning rule of table data scrubbing task, can also include other clear Reason rule, specifically can according to the actual requirements be configured, not be any limitation as herein.

Wherein, when including file path and corresponding information, file expiration in the cleaning rule of file clean-up task Between item and corresponding information, cleaning document convention and corresponding information and exclude file item and corresponding information；

Include in the cleaning rule of table data scrubbing task table data source item and corresponding information, table data name and Corresponding information, table data source expired time and corresponding information, cleaning table data rule and corresponding information and once Cleaning table data record several and corresponding information.

For example, table 1 is the cleaning rule of file clean-up task, such as to clear up 3 months preceding document paths is /home/ Except logs All Fileses, server.log files, then can be configured so that, as shown in table 1.

Table 1

File path (path)	/home/logs
		File expiration time term (expire day), (my god)	90
Clear up document convention (rule)	/home/logs/*
		Exclude file item (exclude files)	/home/logs/server.log

Table 2 is the cleaning rule of table data scrubbing task, such as to clear up the order numbers that description of goods the year before is Samsung According to can be configured so that, as shown in table 2.

Table 2

Once cleaning table data record several, and the configuration is used in and finds many stale datas, it is necessary to clear up in batches, i.e., often The bar number of batch cleaning.

The temporal information generation data of step 302, the configuration content according to data scrubbing task and data scrubbing task are clear The execution order of reason task.

Terminal is believed according to the configuration content of the data scrubbing task got in step 301 and the time of data scrubbing task The execution order of breath generation data scrubbing task, the execution order of the data scrubbing task is used to carry out clearly corresponding data Reason；For example, after the temporal information of the cleaning rule of data scrubbing task and data clean-up task is aware of, terminal is according to data The cleaning rule of clean-up task and the temporal information of data clean-up task generate the execution order of data scrubbing task.

Step 303, according to the execution order of data scrubbing task corresponding data are cleared up.

Cleaning of the terminal according to the execution order of the data scrubbing task generated in step 302 to data clean-up task is advised Corresponding data are cleared up according to the temporal information of data scrubbing task in then, and unwanted data in application system are timely Clean out.

The method of data scrubbing provided in an embodiment of the present invention, data scrubbing task is obtained by visualizing web interface Configure the temporal information of content and data scrubbing task；According to the configuration content of data scrubbing task and data scrubbing task when Between information generate data scrubbing task execution order；Corresponding data are carried out according to the execution order of data scrubbing task clear Reason；The data and clearance time of cleaning are needed in web interface flexible configuration application system by visualizing, make the behaviour of cleaning data Make flexible, extensively, operation and maintenance personnel without writing and running backstage code to realize specified data again for the data area of covering Cleaning, greatly reduce the workload of operation and maintenance personnel；Meanwhile, the dimension variation of data scrubbing time, which makes to apply, is The unwanted data of some in system can be cleaned out in time, improve operating efficiency.

Embodiment two

It is further to illustrate on the basis of above-described embodiment in order to more embody the purpose of the present invention.

Fig. 4 is the flow chart of the embodiment of the method two of data scrubbing of the present invention, as shown in figure 4, the embodiment of the present invention is provided The method of data scrubbing can apply in the terminal (hereinafter referred to as terminal) of data scrubbing, this method can specifically be included such as Lower step：

It is clear that the visualization web interface of step 401, the visualization web interface by itself and/or other terminals obtains data The configuration content of reason task and the temporal information of data scrubbing task.

Terminal can obtain what operation and maintenance personnel was set on web interface by the visualization web interface of terminal itself The configuration content of data scrubbing task and the temporal information of data scrubbing task, and/or can also be by terminal and other ends Hold after connection communication, what the visualization web interface in other terminals was set to obtain operation and maintenance personnel in other terminals The configuration content of data scrubbing task and the temporal information of data scrubbing task；Can synchronously it be carried out on two different terminals Configuration, remotely can also be configured in real time, and no matter whether operation and maintenance personnel can not enter at the scene or timely at the scene Row configuration, facilitates the operation of operation and maintenance personnel；In addition, being needed by visualizing in web interface flexible configuration application system The data and clearance time of cleaning, make cleaning data operation flexibly, and covering data area extensively, operation and maintenance personnel without It need to again write and run backstage code to realize the cleaning of specified data, greatly reduce the workload of operation and maintenance personnel.

Fig. 5 is the embodiment of the method two of data scrubbing of the present invention by visualizing web interface configuration data clean-up task Configuration content and data scrubbing task temporal information schematic diagram, as shown in figure 5, operation and maintenance personnel can be in terminal The configuration content and the temporal information of data scrubbing task of configuration data clean-up task on web interface are visualized, by operation maintenance The configuration content and temporal information that personnel want all are recorded in the terminal.

Here, temporal information and the cleaning rule of data clean-up task for data scrubbing task may be referred to step Illustrating in 301, not in this to go forth.

The temporal information generation data of step 402, the configuration content according to data scrubbing task and data scrubbing task are clear The execution order of reason task.

Terminal is believed according to the configuration content of the data scrubbing task got in step 401 and the time of data scrubbing task The execution order of breath generation data scrubbing task, the execution order of the data scrubbing task is used to carry out clearly corresponding data Reason；For example, after the temporal information of the cleaning rule of data scrubbing task and data clean-up task is aware of, terminal can basis The cleaning rule of data scrubbing task and the temporal information of data clean-up task generate the execution order of data scrubbing task.

Step 403, according to the execution order of data scrubbing task corresponding data are cleared up.

Cleaning of the terminal according to the execution order of the data scrubbing task generated in step 402 to data clean-up task is advised Corresponding data are cleared up according to the temporal information of data scrubbing task in then.

Step 404, the execution order for managing data scrubbing task.

Terminal can manage the execution order of data scrubbing task, specifically, the execution order of management data scrubbing task Including：That deletes data scrubbing task performs order, pause or the execution order of beginning data scrubbing task, editor's data scrubbing At least one in execution order of task etc. or any combination in them；Here, the execution of data scrubbing task is edited Order, including：Edit the configuration content and data scrubbing task of the data scrubbing task in the execution order of data scrubbing task Temporal information.

Fig. 6 is the exectorial signal of the management data scrubbing task of the embodiment of the method two of data scrubbing of the present invention Scheme, as shown in fig. 6, in the visualization web interface in terminal, can be carried out for the execution order of multiple data scrubbing tasks Management, each data scrubbing task execution order in have it is each it is self-corresponding editor, pause or start, editor etc. by Button, operation and maintenance personnel can be by operating different function keys to be managed and grasp come the execution order to data clean-up task Make.

Step 405, judge whether the execution order of data scrubbing task runs succeeded.

Terminal judges whether the execution order of data scrubbing task runs succeeded, if terminal judges data scrubbing task Perform order to run succeeded, then perform step 406；If terminal judges that the execution order of data scrubbing task is not carried out success, Then perform step 407.

Step 406, by the result after running succeeded by itself visualization web interface and/or other terminals it is visual Change web interface to present.

Terminal is presented the result after running succeeded by the visualization web interface of itself, and/or terminal will run succeeded Result afterwards is sent to other terminals, is presented by the visualization web interface of other-end.

After Fig. 7 runs succeeded for the execution order of the data scrubbing task of the embodiment of the method two of data scrubbing of the present invention Result schematic diagram, as shown in fig. 7, in visualization web interface in terminal, the execution order of data scrubbing task is corresponding Result after running succeeded is showed, and the relevant information after data scrubbing is included on visualization web interface, tieed up for operation Shield personnel check.

Step 407, step 403 is repeated, untill number of repetition is more than or equal to preset times, success will be not carried out Result pass through itself visualization web interface or other terminals visualization web interface present.

Terminal can return to step 403 after the execution order for judging data scrubbing task is not carried out successfully, and repetition is held Row step 403 simultaneously records number of times, and after untill number of repetition is more than or equal to preset times, terminal judges data scrubbing task Execution order be still not carried out success, then will be not carried out successful result by by the visualization web interface of itself or its The visualization web interface of its terminal is presented；Here preset times can be configured according to the actual requirements, not limited herein System.

After Fig. 8 is performed not successfully for the execution order of the data scrubbing task of the embodiment of the method two of data scrubbing of the present invention Result schematic diagram, as shown in figure 8, in visualization web interface in terminal, by the execution order correspondence of data scrubbing task Be not carried out successfully after result show, by relevant error information include visualization web interface on, for operation maintenance people Member checks.

The method of data scrubbing provided in an embodiment of the present invention, passes through itself visualization web interface and/or other terminals Visualization web interface obtain data scrubbing task configuration content and data scrubbing task temporal information；It is clear according to data The configuration content of reason task and the temporal information of data scrubbing task generate the execution order of data scrubbing task；It is clear according to data The execution order of reason task is cleared up corresponding data；Data scrubbing task can be managed when performing data scrubbing task Execution order；Judge whether the execution order of data scrubbing task runs succeeded；After running succeeded, after running succeeded As a result presented by the visualization web interface of itself and/or the visualization web interface of other terminals；, will after being not carried out successfully Successful result is not carried out to present by the visualization web interface of itself or the visualization web interface of other terminals；By visual Changing needs the data and clearance time of cleaning in web interface flexible configuration application system, and by the result of data scrubbing task State is showed, and makes the operation of cleaning data flexible, and extensively, result phase is presented the data area of covering in real time, operation dimension Shield personnel greatly reduce operation and maintenance personnel's without writing again and running backstage code to realize the cleaning of specified data Workload；Meanwhile, the dimension variation of data scrubbing time enables the unwanted data of some in application system by clear in time Reason is fallen, and improves operating efficiency.

Embodiment three

Fig. 9 is the structural representation of the device embodiment of data scrubbing of the present invention, as shown in figure 9, the embodiment of the present invention is carried The device 09 of the data scrubbing of confession includes：Acquisition module 91, generation module 92 and processing module 93；Wherein,

The acquisition module 91, the configuration for obtaining data scrubbing task by visualizing global wide area network web interface The temporal information of content and data scrubbing task；The configuration content of the data scrubbing task includes：The name of data scrubbing task The cleaning rule of title, the type of data scrubbing task and data scrubbing task；

The generation module 92, for the configuration content according to the data scrubbing task and the data scrubbing task Temporal information generates the execution order of data scrubbing task；

Corresponding data are carried out clear by the processing module 93 for the execution order according to the data scrubbing task Reason.

Further, described device also includes：Management module 94；Wherein,

The management module 94, the execution order for managing the data scrubbing task；

The management module 94, the data scrubbing task in execution order specifically for editing the data scrubbing task Configuration content and the data scrubbing task temporal information.

Further, described device also includes：Judge module 95；Wherein,

The judge module 95, for judging whether the execution order of the data scrubbing task runs succeeded；

The processing module 93, if being not carried out success specifically for the execution order, is repeated described according to institute The step of execution order for stating data scrubbing task is cleared up corresponding data, until number of repetition is more than or equal to default time Untill number, successful result will be not carried out and presented by the visualization web interface；

The processing module 93, if the execution order also particularly useful for the data scrubbing task runs succeeded, will hold Result after going successfully is presented by the visualization web interface.

Further, the temporal information of the data scrubbing task includes：The disposable time for performing data scrubbing task The temporal information of information or non-disposable execution data scrubbing task；

Further, the type of data scrubbing task includes：File type and/or table data type；

The device of the present embodiment, can be used for perform it is above-mentioned shown in embodiment of the method technical scheme, its realization principle and Technique effect is similar, and here is omitted.

In actual applications, the acquisition module 91, generation module 92, processing module 93, management module 94 and mould is judged Block 95 can be by the central processing unit (Central Processing Unit, CPU) in the device 09 of data scrubbing, micro- Processor (Micro Processor Unit, MPU), digital signal processor (Digital Signal Processor, DSP) Or field programmable gate array (Field Programmable Gate Array, FPGA) etc. is realized.

Example IV

Figure 10 is the structural representation of the apparatus embodiments of data scrubbing of the present invention, as shown in Figure 10, the embodiment of the present invention The equipment 010 of the data scrubbing of offer includes：Interface 101, processor 102, memory 103 and communication bus 104；

Wherein, the communication bus 104, for realizing the interface 101, the processor 102 and the memory 103 Between connection communication；

The processor 102, the program for performing the data scrubbing stored in the memory 103 is following to realize Step：

Further, the processor 102, is additionally operable to perform the program of the data scrubbing, to realize following steps：

Manage the execution order of the data scrubbing task；

The processor 102, is additionally operable to perform the program of the data scrubbing, to realize following steps：

Judge whether the execution order of the data scrubbing task runs succeeded；

The equipment of the present embodiment, can be used for perform it is above-mentioned shown in embodiment of the method technical scheme, its realization principle and Technique effect is similar, and here is omitted.

Embodiment five

Further, cleaning is carried out to corresponding data in the execution order according to the data scrubbing task Afterwards, one or more of programs can also be by one or more of computing devices, to realize following steps：

Manage the execution order of the data scrubbing task；

One or more of programs can be by one or more of computing devices, to implement following step Suddenly：

Judge whether the execution order of the data scrubbing task runs succeeded；

Further, the type of the data scrubbing task includes：File type and/or table data type；

The computer-readable recording medium of the present embodiment, can be used for the technical side for performing above-mentioned shown embodiment of the method Case, its implementing principle and technical effect are similar, and here is omitted.

It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row His property is included, so that process, method, article or device including a series of key elements not only include those key elements, and And also including other key elements being not expressly set out, or also include for this process, method, article or device institute inherently Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this Also there is other identical element in process, method, article or the device of key element.

The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.

Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases The former is more preferably embodiment.Understood based on such, technical scheme is substantially done to prior art in other words Going out the part of contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium In (such as ROM/RAM, magnetic disc, CD), including some instructions are to cause a station terminal (can be mobile phone, computer, service Device, air conditioner, or network equipment etc.) perform method described in each of the invention embodiment.

Embodiments of the invention are described above in conjunction with accompanying drawing, but the invention is not limited in above-mentioned specific Embodiment, above-mentioned embodiment is only schematical, rather than restricted, one of ordinary skill in the art Under the enlightenment of the present invention, in the case of present inventive concept and scope of the claimed protection is not departed from, it can also make a lot Form, these are belonged within the protection of the present invention.

Claims

1. a kind of method of data scrubbing, it is characterised in that methods described includes：

The configuration content of data scrubbing task and the time of data scrubbing task are obtained by visualizing global wide area network web interface Information；The configuration content of the data scrubbing task includes：Title, the type of data scrubbing task and the number of data scrubbing task According to the cleaning rule of clean-up task；

Data scrubbing is generated according to the temporal information of the configuration content of the data scrubbing task and the data scrubbing task to appoint The execution order of business；

2. according to the method described in claim 1, it is characterised in that in the execution order according to the data scrubbing task After clearing up corresponding data, methods described also includes：

Manage the execution order of the data scrubbing task；

Wherein, the execution order of the management data scrubbing task includes：That deletes the data scrubbing task performs life Make, suspend or start performing order, editing performing in order extremely for the data scrubbing task for the data scrubbing task One item missing or any combination in them；

The execution order of editor's data scrubbing task, including：

The configuration content and the data scrubbing for editing the data scrubbing task in the execution order of the data scrubbing task are appointed The temporal information of business.

3. according to the method described in claim 1, it is characterised in that in the execution order according to the data scrubbing task After clearing up corresponding data, methods described also includes：

Judge whether the execution order of the data scrubbing task runs succeeded；

If the execution order is not carried out success, the execution order according to the data scrubbing task is repeated to right The step of data answered are cleared up, untill number of repetition is more than or equal to preset times, will be not carried out successful result and leads to The visualization web interface is crossed to present；

If the execution order of the data scrubbing task runs succeeded, the result after running succeeded is passed through into the visualization Web interface is presented.

4. according to the method described in claim 1, it is characterised in that the temporal information of the data scrubbing task includes：Once Property perform data scrubbing task temporal information or non-disposable execution data scrubbing task temporal information；

The non-disposable temporal information for performing data scrubbing task is to perform data scrubbing daily in preset time period to appoint The temporal information of business, the temporal information that data scrubbing task is performed in preset time period weekly or in preset time period monthly Perform the temporal information of data scrubbing task；The preset time period has sart point in time and end time point；Wherein,

If the non-disposable temporal information for performing data scrubbing task is to perform data scrubbing daily in preset time period The temporal information of task, then the preset time period is the period more than or equal to two days, and the daily execution data scrubbing is appointed The temporal information of business is a second set time point in every day in the preset time period, or in the preset time 1 different set time points in section in every day；

If the non-disposable temporal information for performing data scrubbing task is to perform data scrubbing weekly in preset time period The temporal information of task, then the preset time period is the period more than or equal to two weeks, described to perform data scrubbing times weekly The temporal information of business is a 3rd set time point in each week in the preset time period, or in the preset time 1 different set time points in section in each week；

If the non-disposable temporal information for performing data scrubbing task is that data scrubbing is monthly performed in preset time period The temporal information of task, then the preset time period be more than or equal to the bimestrial period, it is described monthly to perform data scrubbing The temporal information of task is a 4th set time point in each middle of the month in the preset time period, or described default The 1 different set time points in each middle of the month in period.

5. according to the method described in claim 1, it is characterised in that the type of the data scrubbing task includes：File type And/or table data type；

The cleaning rule of the data scrubbing task includes：The cleaning rule and/or table data scrubbing task of file clean-up task Cleaning rule；

Wherein, when including file path and corresponding information, file expiration in the cleaning rule of the file clean-up task Between item and corresponding information, cleaning document convention and corresponding information and exclude file item and corresponding information；

Include in the cleaning rule of the table data scrubbing task table data source item and corresponding information, table data name and Corresponding information, table data source expired time and corresponding information, cleaning table data rule and corresponding information and once Cleaning table data record several and corresponding information.

6. a kind of equipment of data scrubbing, it is characterised in that the equipment includes：Interface, processor, memory and communication are total Line；

7. equipment according to claim 6, it is characterised in that the processor, is additionally operable to perform the data scrubbing Program, to realize following steps：

Manage the execution order of the data scrubbing task；

8. equipment according to claim 6, it is characterised in that the processor, is additionally operable to perform the data scrubbing Program, to realize following steps：

Judge whether the execution order of the data scrubbing task runs succeeded；

9. equipment according to claim 6, it is characterised in that the temporal information of the data scrubbing task includes：Once Property perform data scrubbing task temporal information or non-disposable execution data scrubbing task temporal information；

10. a kind of computer-readable recording medium, it is characterised in that the computer-readable recording medium storage have one or Multiple programs, one or more of programs can be by one or more computing device, to realize following steps：