WO2019062189A1

WO2019062189A1 - Electronic device, method and system for conducting data table filing processing, and storage medium

Info

Publication number: WO2019062189A1
Application number: PCT/CN2018/089708
Authority: WO
Inventors: 王政; 邹学森
Original assignee: 平安科技（深圳）有限公司
Priority date: 2017-09-30
Filing date: 2018-06-03
Publication date: 2019-04-04
Also published as: CN107870981B; CN107870981A

Abstract

The present application relates to an electronic device, a method and system for conducting data table filing processing, and a storage medium. The electronic device comprises a memory and a processor connected to the memory; a processing system, which can be operated on the processor, is stored in the memory; and the processing system is executed by the processor to implement the following steps: establishing a monitoring table for monitoring each data table in an FAS financial database, and analyzing, based on the monitoring table, change information about a data magnitude of each data table; when the data magnitude of a data table increases and satisfies a pre-set condition, generating a prompt message which contains current information about the data table; and acquiring a processing rule which is set on the basis of the current information about the data table, and based on the processing rule, conducting filing processing on the data table. According to the present application, data tables with excessive data magnitudes in an FAS financial database can be processed in a timely manner and filed, thereby improving the system performance and facilitating the management and maintenance of a system.

Description

Method, system and storage medium for electronic device and data table archiving processing

Priority claim

This application is based on the priority of the Chinese Patent Application entitled "Electronic Device, Method of Data Archive Processing and Storage Media", filed on September 30, 2017, with the application number of CN 2017109160673, which is filed on September 30, 2017. The content is incorporated herein by reference.

Technical field

The present application relates to the field of database technologies, and in particular, to an electronic device, a data table archival processing method, a system, and a storage medium.

Background technique

With the use of the financial system of FAS (Financial Accounting Standards), more and more data tables will become of a large data size. For example, some data tables have a data size of millions or even a small amount of data. The data level of the table reaches tens of millions or billions, and the data level of the data table is too large to affect the system performance such as query efficiency. In the prior art, the solution of changing the existing data storage structure by using a scheme such as a sub-division table can be used to solve the problem of more data in the database, but considering the complexity of the data itself and the association between the data in the FAS financial system, This kind of scheme is more complicated in operation and has a greater impact on the existing system, so it cannot be applied in practice. Therefore, timely processing of a single table with a large data size in the FAS financial system to improve system performance becomes a problem to be solved. The problem.

Summary of the invention

The purpose of the present application is to provide an electronic device, a data table archiving processing method, a system and a storage medium, which aim to timely process a data table of an excessively large data size in the FAS financial database for archiving.

To achieve the above object, the present application provides an electronic device including a memory and a processor coupled to the memory, the memory storing a processing system operable on the processor, the processing The system implements the following steps when executed by the processor:

S101: Establish a monitoring table for monitoring each data table in the FAS financial database, and analyze, according to the monitoring table, data change information of each data table;

S102. When a data level of the data table becomes larger and meets a preset condition, generating a prompt message that includes current information of the data table.

S103. Acquire a processing rule set based on current information of the data table, and perform archiving processing on the data table based on the processing rule.

To achieve the above objective, the present application further provides a method for data table archiving processing, the method comprising:

S1, establishing a monitoring table for monitoring each data table in the FAS financial database, and analyzing data change information of each data table based on the monitoring table;

S2, when the data level of the data table becomes large and meets the preset condition, generating a prompt message including current information of the data table;

S3: Obtain a processing rule set based on current information of the data table, and perform archiving processing on the data table based on the processing rule.

To achieve the above objective, the present application further provides a system for data table archiving processing, including:

An analysis module, configured to establish a monitoring table for monitoring each data table in the FAS financial database, and analyzing data change information of each data table based on the monitoring table;

a generating module, configured to generate a prompt message including current information of the data table when the data level of the data table becomes large and meets a preset condition;

The archiving module is configured to obtain a processing rule set based on current information of the data table, and perform archiving processing on the data table based on the processing rule.

The present application also provides a computer readable storage medium having stored thereon a processing system, the processing system being executed by a processor to implement the steps of the data table archiving process described above.

The beneficial effects of the present application are: the present application establishes a monitoring table for monitoring the data magnitude of each data table in the FAS financial database, and obtains a preset when the data level of the data table becomes larger or increases greatly. The processing rule or remind the maintenance personnel to set the corresponding processing rules on the spot, and archive the data table according to the processing rule. The application can timely process the data table of the data level of the FAS financial database, and archive it to improve the system. Performance, easy to manage and maintain the system.

DRAWINGS

1 is a schematic diagram of an optional application environment of each embodiment of the present application;

FIG. 2 is a schematic flowchart diagram of an embodiment of a method for archiving data table of the present application.

Detailed ways

In order to make the objects, technical solutions, and advantages of the present application more comprehensible, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

It should be noted that the descriptions of "first", "second" and the like in the present application are for the purpose of description only, and are not to be construed as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. . Thus, features defining "first" and "second" may include at least one of the features, either explicitly or implicitly. In addition, the technical solutions between the various embodiments may be combined with each other, but must be based on the realization of those skilled in the art, and when the combination of the technical solutions is contradictory or impossible to implement, it should be considered that the combination of the technical solutions does not exist. Nor is it within the scope of protection required by this application.

Referring to FIG. 1 , it is a schematic diagram of an application environment of a preferred embodiment of the method for archiving data table of the present application. The application environment diagram includes an electronic device 1 and a terminal device 2. The electronic device 1 can perform data interaction with the terminal device 2 through a suitable technology such as a network or a near field communication technology.

The terminal device 2 includes, but is not limited to, any electronic product that can interact with a user through a keyboard, a mouse, a remote controller, a touch panel, or a voice control device, for example, a personal computer, a tablet computer, or a smart phone. , Personal Digital Assistant (PDA), game consoles, Internet Protocol Television (IPTV), smart wearable devices, navigation devices, etc., or mobile devices such as digital TVs, desktop computers, Fixed terminal for notebooks, servers, etc. The terminal device 2 is configured to receive an instruction to establish a monitoring table and send it to the electronic device, and receive a processing rule set by the maintenance personnel on site.

The electronic device 1 is an apparatus capable of automatically performing numerical calculation and/or information processing in accordance with an instruction set or stored in advance. The electronic device 1 may be a computer, a single network server, a server group composed of multiple network servers, or a cloud-based cloud composed of a large number of hosts or network servers, where cloud computing is a type of distributed computing. A super virtual computer consisting of a group of loosely coupled computers.

In the present embodiment, the electronic device 1 may include, but is not limited to, a memory 11 communicably connected to each other through a system bus, a processor 12, and a network interface 13, and the memory 11 stores a processing system operable on the processor 12. It should be noted that FIG. 1 only shows the electronic device 1 having the components 11-13, but it should be understood that not all illustrated components may be implemented, and more or fewer components may be implemented instead.

The memory 11 includes a memory and at least one type of readable storage medium. The memory provides a cache for the operation of the electronic device 1; the readable storage medium may be, for example, a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory (SRAM). A non-volatile storage medium such as a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a programmable read only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, or the like. In some embodiments, the readable storage medium may be an internal storage unit of the electronic device 1, such as a hard disk of the electronic device 1; in other embodiments, the non-volatile storage medium may also be external to the electronic device 1. A storage device, such as a plug-in hard disk equipped with an electronic device 1, a smart memory card (SMC), a Secure Digital (SD) card, a flash card, or the like. In this embodiment, the readable storage medium of the memory 11 is generally used to store an operating system installed in the electronic device 1 and various types of application software, such as program codes of the processing system in an embodiment of the present application. Further, the memory 11 can also be used to temporarily store various types of data that have been output or are to be output.

The processor 12 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data processing chip in some embodiments. The processor 12 is typically used to control the overall operation of the electronic device 1, such as performing control and processing related to data interaction or communication with the terminal device 2. In this embodiment, the processor 12 is configured to run program code or process data stored in the memory 11, such as running a processing system or the like.

The network interface 13 may comprise a wireless network interface or a wired network interface, which is typically used to establish a communication connection between the electronic device 1 and other electronic devices. In this embodiment, the network interface 13 is mainly used to connect the electronic device 1 with one or more terminal devices 2, and establish a data transmission channel and a communication connection between the electronic device 1 and one or more terminal devices 2.

The processing system is stored in the memory 11 and includes at least one computer readable instruction stored in the memory 11, the at least one computer readable instruction being executable by the processor 12 to implement the methods of various embodiments of the present application; At least one computer readable instruction may be classified as a different logic module depending on the functions implemented by its various parts.

In an embodiment, when the processing system is executed by the processor 12, the following steps are implemented:

Step S101, establishing a monitoring table for monitoring each data table in the FAS financial database, and analyzing data change information of each data table based on the monitoring table;

In this embodiment, the FAS financial database has a large number of data tables, and a monitoring table is established to monitor each data table. Wherein, in the monitoring table, including the name of the data table, the data magnitude, the type information, and the time information, for example, the monitoring table records the names of the data tables to be monitored in the form of Table 1, Table 2, Table n, After the name of each data table, the corresponding data magnitude, type information, and time information are recorded. For example, for Table 1, one or more data magnitudes of each of the predetermined times are recorded in Table 1 after the monitoring table. Each data table has corresponding type information, including a service type and a non-service type, to distinguish whether the data table is a business data table or a non-business data table.

In this embodiment, each data table in the FAS financial database can be monitored in real time, for example, the data magnitude of each data table is recorded with time, or each data table in the FAS financial database is periodically monitored, preferably. Ground, the data table is monitored regularly, for example, the data level of each data table is captured every 1 hour or 5 hours, or the time of capturing the data level according to the actual situation of each data table, etc., the captured data will be captured. The magnitude is recorded in the monitoring table.

In the FAS financial database, if a new data is added to a data table, the data level of the data table becomes larger. When analyzing the change information of the data magnitude for a certain data table, preferably, the data magnitude of each data table in the FAS database in the monitoring table may be periodically obtained, and whether the data magnitude of each data table reaches a preset threshold is analyzed. For example, whether the data level reaches a million level; or obtain the data magnitude of each data table in the FAS database in the monitoring table every preset time, calculate the data magnitude increase of each data table, and analyze the data of each data table. Whether the increase of the magnitude reaches the preset range, for example, one month as the time interval, whether the increase of the data level of a certain data table for two consecutive months reaches a preset threshold (for example, an increase of 100%).

Step S102, when the data level of the data table becomes large and the preset condition is met, generating a prompt message including current information of the data table;

In this embodiment, when the data level of the data table becomes large and the preset condition is met, for example, the data level of the data table becomes large and reaches a preset threshold, or the data level becomes large and the preset time interval is reached. When the increase reaches the preset threshold, a prompt message containing the current information of the data table is generated, wherein the current information of the data table includes the name of the data table, the data magnitude, and the type information. The prompt message is used to remind the maintenance personnel to process the data table.

The prompt message may be sent to the predetermined terminal in a predetermined format and sent to the mobile terminal and sent to the mobile terminal worn by the maintenance personnel, and the predetermined format of the prompt message is, for example, “Table 1, data volume level”. **, type information**".

Step S103: Acquire a processing rule set based on current information of the data table, and perform archiving processing on the data table based on the processing rule.

In an embodiment, the processing rule may be preset by the maintenance personnel, and includes multiple types, and each processing rule is associated with the data magnitude and the type information of the data table, and the prompt for generating the current information of the data table is generated. After the message, the preset processing rule is automatically acquired based on the current information in the prompt message, and the data table is archived based on the processing rule. In other embodiments, the processing rule may be set by the maintenance personnel on site, that is, when the maintenance clerk receives the prompt message for the data table in the FAS financial database, the data is based on the data magnitude and type information of the data table. The table sets the corresponding processing rule, and the data table is archived based on the processing rule.

The processing rule may be that the data table is archived periodically, or all the data tables may be directly archived.

Compared with the prior art, the present embodiment establishes a monitoring table for monitoring the data magnitude of each data table in the FAS financial database. When the data level of the data table becomes larger or increases, the pre-set is obtained. The processing rule or the maintenance personnel is required to set corresponding processing rules on the spot, and the data table is archived according to the processing rule. This embodiment can timely process the data table of the FAS financial database with excessive data size and archive it. Improve system performance and facilitate system management and maintenance.

In a preferred embodiment, on the basis of the foregoing embodiment of FIG. 1, the step S103 includes: if the service type of the data table is a non-service type, acquiring the first set based on the non-service type Processing a rule, performing an archiving process on the data table based on the first processing rule; if the service type of the data table is a service type, acquiring a second processing rule set based on the service type, based on the second processing rule The data table is archived.

In an embodiment, the processing rule includes a first processing rule preset by the maintenance personnel and a second processing rule set by the maintenance personnel on the spot, and the type information includes a service type (such as a reimbursement form, a bill or an invoice, etc.) and a non-service type. (for example, an approval record table, etc.): if the service type of the data table is a non-service type, obtaining a first processing rule corresponding to the non-service type setting, and archiving the data table based on the first processing rule; If the service type of the data table is a service type, the second processing rule corresponding to the service type setting is obtained, and the data table is archived based on the second processing rule. This embodiment provides a flexible manner of setting processing rules, so that data tables with large data levels are archived according to processing rules based on different actual situations.

Preferably, the first processing rule comprises: assigning a task to the data table, migrating the data in the data table to a corresponding archive table based on the assigned task timing, or retaining a predetermined partial data in the data table, and based on The assigned task timing migrates other unreserved data into the corresponding archive table; the second processing rule includes: assigning a task to the data table, retaining a predetermined portion of the data in the data table, and timing based on the assigned task Migrate other data that has not been retained to the corresponding archive table. In other embodiments, other processing rules may be set, such as directly archiving all the data in the data table into the archive table, and so on, which will not be exemplified herein.

In this embodiment, the task assigned to the data table may be, for example, periodically migrating the data of the previous year in the data table to the archive table, until all the data of the previous year of the data table is migrated into the archive table. Or, retain part of the data from the previous year in the data table, and periodically migrate other data from the previous year to the archive table every day until all the data is migrated to the archive table.

In the specific implementation process, when the data in the data table is archived, the associated data can be correlated, the repeated data can be combined, and the data can be classified and saved according to the preservation value of the data, etc. To facilitate preservation and subsequent use.

As shown in FIG. 2, FIG. 2 is a schematic flowchart of an embodiment of a data table archiving process according to an embodiment of the present application. The method for archiving the data table includes the following steps:

Step S1: Establish a monitoring table for monitoring each data table in the FAS financial database, and analyze data change information of each data table based on the monitoring table;

Step S2, when the data level of the data table becomes large and the preset condition is met, generating a prompt message including the current information of the data table;

Step S3: Obtain a processing rule set based on current information of the data table, and perform archiving processing on the data table based on the processing rule.

In a preferred embodiment, on the basis of the foregoing embodiment of FIG. 2, the step S3 includes: if the service type of the data table is a non-service type, acquiring the first set based on the non-service type Processing a rule, performing an archiving process on the data table based on the first processing rule; if the service type of the data table is a service type, acquiring a second processing rule set based on the service type, based on the second processing rule The data table is archived.

The serial numbers of the embodiments of the present application are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present application, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present application.

The above is only a preferred embodiment of the present application, and is not intended to limit the scope of the patent application, and the equivalent structure or equivalent process transformations made by the specification and the drawings of the present application, or directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of this application.

Claims

An electronic device, comprising: a memory and a processor coupled to the memory, wherein the memory stores a processing system operable on the processor, the processing system being The processor implements the following steps when it executes:

S101: Establish a monitoring table for monitoring each data table in the FAS financial database, and analyze, according to the monitoring table, data change information of each data table;

S102. When a data level of the data table becomes larger and meets a preset condition, generating a prompt message that includes current information of the data table.

S103. Acquire a processing rule set based on current information of the data table, and perform archiving processing on the data table based on the processing rule.
The electronic device according to claim 1, wherein the analyzing the change information of the data magnitude of each data table based on the monitoring table in the step S101 comprises:

Obtaining, at a time, the data magnitude of each data table in the FAS database in the monitoring table, and analyzing whether the data magnitude of each data table reaches a preset threshold; or

Regularly obtaining the data magnitude of each data table in the FAS database in the monitoring table, calculating the increase of the data magnitude of each data table in a predetermined time interval, and analyzing whether the data level of each data table increases by a preset amount. Amplitude.
The electronic device according to claim 1 or 2, wherein the data table current information includes type information, the type information includes a service type and a non-service type, and the processing rule includes a first processing rule and a second Processing the rule, the step S103 includes:

If the service type of the data table is a non-service type, acquiring a first processing rule that is set based on the non-service type, and performing archiving processing on the data table based on the first processing rule;

If the service type of the data table is a service type, the second processing rule set based on the service type is obtained, and the data table is archived based on the second processing rule.
The electronic device according to claim 3, wherein the first processing rule comprises: assigning a task to the data table, and migrating the data in the data table to a corresponding archive table based on the assigned task timing, Or retain a predetermined portion of the data in the data table, and migrate other unreserved data to the corresponding archive table based on the assigned task timing;

The second processing rule includes: assigning a task to the data table, retaining a predetermined portion of data in the data table, and migrating other unreserved data to a corresponding archive table based on the assigned task timing.
The electronic device according to claim 4, wherein when the data is transplanted into the corresponding archive table, the processing system is executed by the processor to implement the following steps: performing association processing and merging processing on the data. And / or classified to save.
A method for data table archiving processing, the method comprising:

S1, establishing a monitoring table for monitoring each data table in the FAS financial database, and analyzing data change information of each data table based on the monitoring table;

S2, when the data level of the data table becomes large and meets the preset condition, generating a prompt message including current information of the data table;

S3: Obtain a processing rule set based on current information of the data table, and perform archiving processing on the data table based on the processing rule.
The method for processing data table archiving according to claim 6, wherein the analyzing the change information of the data magnitude of each data table based on the monitoring table in the step S1 comprises:

Obtaining, at a time, the data magnitude of each data table in the FAS database in the monitoring table, and analyzing whether the data magnitude of each data table reaches a preset threshold; or

Regularly obtaining the data magnitude of each data table in the FAS database in the monitoring table, calculating the increase of the data magnitude of each data table in a predetermined time interval, and analyzing whether the data level of each data table increases by a preset amount. Amplitude.
The data table archival processing method according to claim 6 or 7, wherein the data table current information includes type information, the type information includes a service type and a non-service type, and the processing rule includes a first process. The rule and the second processing rule, the step S3 includes:

If the service type of the data table is a non-service type, acquiring a first processing rule that is set based on the non-service type, and performing archiving processing on the data table based on the first processing rule;

If the service type of the data table is a service type, the second processing rule set based on the service type is obtained, and the data table is archived based on the second processing rule.
The method of data table archiving processing according to claim 8, wherein the first processing rule comprises: assigning a task to the data table, and transplanting data in the data table to a corresponding one based on the assigned task timing Archive the table, or retain the predetermined part of the data in the data table, and transplant other unreserved data to the corresponding archive table based on the assigned task timing;

The second processing rule includes: assigning a task to the data table, retaining a predetermined portion of data in the data table, and migrating other unreserved data to a corresponding archive table based on the assigned task timing.
The method of data table archival processing according to claim 9, wherein when the data is migrated to the corresponding archive table, the data is also subjected to association processing, merge processing, and/or classification storage.
A system for data table archiving processing, comprising:

An analysis module, configured to establish a monitoring table for monitoring each data table in the FAS financial database, and analyzing data change information of each data table based on the monitoring table;

a generating module, configured to generate a prompt message including current information of the data table when the data level of the data table becomes large and meets a preset condition;

The archiving module is configured to obtain a processing rule set based on current information of the data table, and perform archiving processing on the data table based on the processing rule.
The system for data table archiving processing according to claim 11, wherein the analysis module is specifically configured to:

Obtaining, at a time, the data magnitude of each data table in the FAS database in the monitoring table, and analyzing whether the data magnitude of each data table reaches a preset threshold; or

Regularly obtaining the data magnitude of each data table in the FAS database in the monitoring table, calculating the increase of the data magnitude of each data table in a predetermined time interval, and analyzing whether the data level of each data table increases by a preset amount. Amplitude.
The data table archival processing system according to claim 11 or 12, wherein the data table current information includes type information, the type information includes a service type and a non-service type, and the processing rule includes a first process. a rule and a second processing rule, the archiving module is specifically configured to: if the service type of the data table is a non-service type, obtain a first processing rule that is set based on the non-service type, based on the first processing rule The data table is archived; if the service type of the data table is a service type, a second processing rule set based on the service type is obtained, and the data table is archived based on the second processing rule.
The system for data table archiving processing according to claim 13, wherein the first processing rule comprises: assigning a task to the data table, and transplanting data in the data table to a corresponding one based on the assigned task timing Archive the table, or retain the predetermined part of the data in the data table, and transplant other unreserved data to the corresponding archive table based on the assigned task timing;

The second processing rule includes: assigning a task to the data table, retaining a predetermined portion of data in the data table, and migrating other unreserved data to a corresponding archive table based on the assigned task timing.
The system of data table archiving processing according to claim 14, wherein the archiving module is further configured to perform association processing, merge processing, and/or data migration when the data is migrated to the corresponding archive table. Classified save.
A computer readable storage medium, wherein the computer readable storage medium stores a processing system, and when the processing system is executed by the processor, the steps are:

S101: Establish a monitoring table for monitoring each data table in the FAS financial database, and analyze, according to the monitoring table, data change information of each data table;

S102. When a data level of the data table becomes larger and meets a preset condition, generating a prompt message that includes current information of the data table.

S103. Acquire a processing rule set based on current information of the data table, and perform archiving processing on the data table based on the processing rule.
The computer readable storage medium according to claim 16, wherein the analyzing the change information of the data magnitude of each data table based on the monitoring table in the step S101 comprises:

Obtaining, at a time, the data magnitude of each data table in the FAS database in the monitoring table, and analyzing whether the data magnitude of each data table reaches a preset threshold; or

Regularly obtaining the data magnitude of each data table in the FAS database in the monitoring table, calculating the increase of the data magnitude of each data table in a predetermined time interval, and analyzing whether the data level of each data table increases by a preset amount. Amplitude.
The computer readable storage medium according to claim 16 or 17, wherein the data table current information includes type information, the type information includes a service type and a non-service type, and the processing rule includes a first processing rule. And the second processing rule, the step S103 includes:

If the service type of the data table is a non-service type, acquiring a first processing rule that is set based on the non-service type, and performing archiving processing on the data table based on the first processing rule;

If the service type of the data table is a service type, the second processing rule set based on the service type is obtained, and the data table is archived based on the second processing rule.
The computer readable storage medium of claim 18, wherein the first processing rule comprises: assigning a task to the data table, and migrating data in the data table to a corresponding archive based on the assigned task timing In the table, or retain a predetermined part of the data in the data table, and transplant other unreserved data to the corresponding archive table based on the assigned task timing;

The second processing rule includes: assigning a task to the data table, retaining a predetermined portion of data in the data table, and migrating other unreserved data to a corresponding archive table based on the assigned task timing.
The computer readable storage medium according to claim 19, wherein when the data is migrated into the corresponding archive table, the processing system is executed by the processor to implement the following steps: correlating the data , merge processing and/or classification saving.