CN116644068A - Data processing method, device, equipment and medium - Google Patents

Data processing method, device, equipment and medium Download PDF

Info

Publication number
CN116644068A
CN116644068A CN202310632041.1A CN202310632041A CN116644068A CN 116644068 A CN116644068 A CN 116644068A CN 202310632041 A CN202310632041 A CN 202310632041A CN 116644068 A CN116644068 A CN 116644068A
Authority
CN
China
Prior art keywords
data
online transaction
mode
service
main table
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310632041.1A
Other languages
Chinese (zh)
Inventor
陈冬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bank of China Ltd
Original Assignee
Bank of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bank of China Ltd filed Critical Bank of China Ltd
Priority to CN202310632041.1A priority Critical patent/CN116644068A/en
Publication of CN116644068A publication Critical patent/CN116644068A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The application discloses a data processing method, a device, equipment and a medium, which can be applied to the field of big data or the field of finance. Acquiring service data of a service termination time point of the current day, and establishing a main table and a secondary table according to the service data; when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned; when the working mode is the night mode and the online transaction processing request is received, if the target data used for online transaction is not in the secondary table, the secondary table is used for penetrating and accessing the primary table to acquire the target data, the online transaction is carried out according to the target data, and the result data of the online transaction is written into the secondary table; when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table. By establishing two sets of tables of the main table and the auxiliary table and complex day and night mode switching logic, data conflict between the main table and the auxiliary table can be avoided, and 7x24 hours external service can be realized.

Description

Data processing method, device, equipment and medium
Technical Field
The present application relates to the field of big data, and in particular, to a data processing method, apparatus, device, and medium.
Background
Banking industry is used as a service industry, and with rapid development of technology and gradual and vigorous business competition, the continuous expansion of service time and service channels is promoted. Banking services, and particularly core banking services, support all weather, and this day-to-night continuous service is called 7x24 hour service. In order to relieve online pressure, the business application level is that modern banking systems, especially core banking systems, have a large number of regular data processing requirements, and online transaction processing can be carried out at night, and online transaction can be transfer, etc. However, batch processing is also typically performed during the night, which can result in data collisions between batch processing and online transaction processing during the night, which can easily lead to transaction errors. Therefore, it is critical to solve the problem to resolve the data conflict between batch processing and online transaction processing, ensuring that the transaction is correct.
Disclosure of Invention
Accordingly, the present application is directed to a data processing method, apparatus, device, and medium, which process online transactions and batch business processes in different tables, so as to avoid data collision between the two, improve the accuracy of transactions, and realize 7x24 hours external services. The specific scheme is as follows:
in one aspect, the present application provides a data processing method, including:
acquiring service data of a service termination time point of the current day, and establishing a main table and a secondary table according to the service data; the auxiliary table comprises service data updated dynamically, and the main table comprises static service data of a last day service termination time point;
when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned;
when the working mode is the night mode and an online transaction processing request is received, if target data used for online transaction is not in the secondary table, the secondary table is used for penetrating and accessing the primary table to acquire the target data, online transaction is carried out according to the target data, and the result data of the online transaction is written into the secondary table; and when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table.
On the other hand, the embodiment of the application also provides a data processing device, which comprises:
the system comprises an acquisition unit, a service data acquisition unit and a service data generation unit, wherein the acquisition unit is used for acquiring service data of a service termination time of the day and establishing a main table and a secondary table according to the service data; the auxiliary table comprises service data updated dynamically, and the main table comprises static service data of a last day service termination time point;
the first processing unit is used for cleaning the service data in the auxiliary table when the working mode is switched from a day mode to a night mode;
the second processing unit is used for penetrating and accessing the main table by using the auxiliary table to acquire target data when the working mode is a night mode and receiving an online transaction processing request if the target data used for online transaction is not in the auxiliary table, carrying out online transaction according to the target data, and writing the result data of the online transaction into the auxiliary table; and when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table.
In another aspect, an embodiment of the present application further provides a computer device, including a processor and a memory:
the memory is used for storing program codes and transmitting the program codes to the processor;
the processor is configured to execute the data processing method according to instructions in the program code.
In another aspect, an embodiment of the present application further provides a computer readable storage medium, where the computer readable storage medium is used to store a computer program, where the computer program is used to execute the data processing method.
The embodiment of the application provides a data processing method, a device, equipment and a medium, which can acquire service data of a service termination time point of the day and establish a main table and a secondary table according to the service data; the auxiliary table comprises dynamically updated service data, and the main table comprises static service data at the last day service termination time point; when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned; when the working mode is the night mode and the online transaction processing request is received, if the target data used for online transaction is not in the secondary table, the secondary table is used for penetrating and accessing the primary table to acquire the target data, the online transaction is carried out according to the target data, and the result data of the online transaction is written into the secondary table; when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table.
It can be seen that, in the embodiment of the present application, when the working mode is the night mode, for online transaction, when the target data used for online transaction is not performed in the secondary table, the target data is copied from the primary table to the secondary table through the penetration technology, online transaction is performed in the secondary table, and the result data is stored in the secondary table, while batch service processing is performed in the primary table, and the result data may be stored in the primary table. By establishing two sets of tables of the main table and the auxiliary table and complex day-night mode switching logic, online transaction and batch business processing are respectively processed in different tables, so that data conflict between the two tables can be avoided, the accuracy of the transaction is improved, and 7x24 hours external service is realized.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are needed in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are some embodiments of the application and that other drawings may be obtained from these drawings without inventive effort for a person skilled in the art.
Fig. 1 shows a flow chart of a data processing method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of data processing according to an embodiment of the present application;
FIG. 3 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 4 is a block diagram of a computer device according to an embodiment of the present application.
Detailed Description
In order that the above objects, features and advantages of the application will be readily understood, a more particular description of the application will be rendered by reference to the appended drawings.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application, but the present application may be practiced in other ways other than those described herein, and persons skilled in the art will readily appreciate that the present application is not limited to the specific embodiments disclosed below.
As described in the background, since modern banking systems, and particularly core banking systems, have a large number of periodic data processing requirements, these online transaction processes can be carried out at night in order to relieve the online stress. However, batch processing is also typically performed during the night, which can result in data collisions between batch processing and online transaction processing during the night, which can easily lead to transaction errors.
Specifically, there are a business data reading conflict and a business data updating conflict between batch processing and online transaction processing, for the business data reading conflict, the data source requirement of batch processing is static data at the time of business ending of the day, the data requirement of online transaction is dynamic data, although the requirement is theoretically that the data after batch processing is taken as the starting point of online transaction data, the technical limitation is that the data before batch processing is taken as the starting point of online transaction dynamic data generally, and the correctness of online transaction is ensured by technical means, but the error easily occurs, namely, from the effect, the data read by online transaction should be the data after batch processing.
For business data update conflicts, online transaction updates are corrected after batch processing due to business requirements. Generally, the physical write context in the art does not necessarily follow the requirements, which results in update conflicts between online transaction updates and batch updates, but in effect, batch and online data updates should follow a sequential principle, which is not possible in the prior art.
Based on the technical problems, the embodiment of the application provides a data processing method, a device, equipment and a medium, which can acquire service data at the service termination time of the day and establish a main table and a secondary table according to the service data; the auxiliary table comprises dynamically updated service data, and the main table comprises static service data at the last day service termination time point; when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned; when the working mode is the night mode and the online transaction processing request is received, if the target data used for online transaction is not in the secondary table, the secondary table is used for penetrating and accessing the primary table to acquire the target data, the online transaction is carried out according to the target data, and the result data of the online transaction is written into the secondary table; when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table.
It can be seen that, in the embodiment of the present application, when the working mode is the night mode, for online transaction, when the target data used for online transaction is not performed in the secondary table, the target data is copied from the primary table to the secondary table through the penetration technology, online transaction is performed in the secondary table, and the result data is stored in the secondary table, while batch service processing is performed in the primary table, and the result data may be stored in the primary table. By establishing two sets of tables of the main table and the auxiliary table and complex day-night mode switching logic, online transaction and batch business processing are respectively processed in different tables, so that data conflict between the two tables can be avoided, the accuracy of the transaction is improved, and 7x24 hours external service is realized.
For easy understanding, a data processing method, apparatus, device and medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings.
Referring to fig. 1, a flow chart of a data processing method according to an embodiment of the present application is shown, and the method may include the following steps.
S101, acquiring service data of the service termination time of the day, and establishing a main table and a secondary table according to the service data.
In the embodiment of the application, the service data of the service ending time of the current day can be obtained, and the main table and the auxiliary table are established according to the service data, wherein the auxiliary table comprises the dynamically updated service data, and the main table comprises the static service data of the service ending time of the current day.
Specifically, a service data snapshot at the service termination point of the current day can be established, two service data are reserved through a technical means, one service data is dynamically updated (i.e. a secondary table) for online transaction, and the other service data is static data (i.e. a main table) for batch service processing.
S102, when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned.
In the embodiment of the application, the working modes of the system comprise a day mode and a night mode, wherein the day mode can be performed in the daytime and the night mode can be performed in the evening. Wherein online transactions (e.g., transfers) may be conducted in day and night modes, with bulk transactions conducted only in night mode.
Specifically, when the operation mode is switched from the day mode to the night mode, since the service data previously stored in the sub-table has become old data, it is necessary to clear the sub-table, for example, the service data in the sub-table can be cleared.
In one possible implementation, when the working mode is switched from the day mode to the night mode, clearing the service data in the secondary table includes clearing the service data in the secondary table and copying the parameter data in the parameter table to the secondary table when the working mode is switched from the day mode to the night mode.
Specifically, the parameter table is provided with parameter data, the data volume is smaller, and the parameter data can be copied into the parameter table, so that online transaction processing is performed according to the parameter data and the service data, and the accuracy of online transaction is improved.
S103, when the working mode is the night mode and the online transaction processing request is received, if the target data used for online transaction is not in the secondary table, the secondary table is used for penetrating and accessing the primary table to acquire the target data, online transaction is carried out according to the target data, and the result data of the online transaction is written into the secondary table; when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table.
In the embodiment of the application, when the working mode is the night mode and the online transaction processing request is received, online transaction can be performed. When the target data needed by the online transaction does not exist in the secondary table, the primary table is static data, the data volume is large, the target data is provided, the primary table can be accessed by using a penetration technology, and the target data is copied from the primary table to the secondary table, so that the target data needed by the online transaction is also provided in the secondary table. Then, the online transaction is performed in the secondary table according to the target data, and after the online transaction is completed, the result data of the online transaction can be written into the secondary table, so that the online transaction can be completed in the secondary table.
In addition, when the operation mode is the night mode, the batch business processing can be performed when the batch business processing request is received. The main table is provided with related data for batch processing service, batch processing can be performed according to the related data in the main table, and after the batch processing is completed, the result data of the batch processing is written into the main table. That is, bulk business processes may be completed in the master table. In this way, by establishing two sets of tables of the main table and the auxiliary table and complex day-night mode switching logic, online transaction and batch business processing are respectively processed in different tables, so that data conflict between the two tables can be avoided, the accuracy of the transaction is improved, and 7x24 hours external service is realized.
In the embodiment of the application, when online transaction is performed in the night mode, transaction information can be generated at the same time, the transaction information has specific information of online transaction, such as input data, output data and the like, and the transaction information can be log information when online transaction is performed.
Specifically, online reentry may be performed when the operational mode is switched from the night mode to the day mode. According to the transaction information generated when the online transaction is performed in the night mode and the target data used for the online transaction in the main table, online reentry can be performed in the main table, namely, the online transaction performed in the night mode is reworked in the main table, and the result data of the online transaction is written into the main table, so that the result data of the online transaction in the auxiliary table is smoothed into the main table. Therefore, the main table has not only the result data of batch business processing, but also the result data of online transaction, so that the data in the main table is more complete.
Specifically, when online reentry is performed, a plurality of transaction tasks in online transaction can be sequenced from a plurality of dimensions, such as account dimensions, so that multithreading is performed in parallel, and the online reentry efficiency is improved.
In addition, the barrier processing may be performed on the online transaction prior to completion of the reentry. Due to the speed, the influence on the online transaction is reduced by adopting methods such as parallel and priority scheduling.
In the embodiment of the application, when the working mode is the day mode and the online transaction processing request is received, the online transaction can be performed according to the target data used for performing the online transaction in the main table, and the result data of the online transaction is written into the main table, and the batch processing service is not performed in the day mode but only performed in the night mode, so that the online transaction can be directly performed in the main table in the day mode, and the data in the main table are used for reading and writing, thereby simplifying the processing flow.
That is, for online business processing, different tables are accessed according to day and night modes, a main table is accessed in a day mode, a sub table is accessed in a night mode, and if the sub table has no target data, the execution table penetration accesses the main table.
In an embodiment of the present application, referring to fig. 2, a schematic diagram of data processing provided in the embodiment of the present application is shown, in which during a night mode between a night and a day, batch processing may be performed on main table data, copy (sub-table) data may be used during online transactions, in which the copy data may acquire the main table data through a penetration technique, result data of online transactions may be stored in the copy data, and transaction information may be generated during online transactions, during the day, online reentry may be performed according to the transaction information, so as to redo online transactions in the main table, write the main table data, and after completion of reentry, during a day mode, online transactions may be processed using the main table data.
The embodiment of the application provides a data processing method, which can acquire service data at the service termination time of the day and establish a main table and an auxiliary table according to the service data; the auxiliary table comprises dynamically updated service data, and the main table comprises static service data at the last day service termination time point; when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned; when the working mode is the night mode and the online transaction processing request is received, if the target data used for online transaction is not in the secondary table, the secondary table is used for penetrating and accessing the primary table to acquire the target data, the online transaction is carried out according to the target data, and the result data of the online transaction is written into the secondary table; when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table.
It can be seen that, in the embodiment of the present application, when the working mode is the night mode, for online transaction, when the target data used for online transaction is not performed in the secondary table, the target data is copied from the primary table to the secondary table through the penetration technology, online transaction is performed in the secondary table, and the result data is stored in the secondary table, while batch service processing is performed in the primary table, and the result data may be stored in the primary table. By establishing two sets of tables of the main table and the auxiliary table and complex day-night mode switching logic, online transaction and batch business processing are respectively processed in different tables, so that data conflict between the two tables can be avoided, the accuracy of the transaction is improved, and 7x24 hours external service is realized.
Based on the above data processing method, the embodiment of the present application further provides a data processing device, and referring to fig. 3, a block diagram of the data processing device provided in the embodiment of the present application is shown, where the device may include:
an obtaining unit 201, configured to obtain service data at a service termination point of a current day, and establish a primary table and a secondary table according to the service data; the auxiliary table comprises service data updated dynamically, and the main table comprises static service data of a last day service termination time point;
a first processing unit 202, configured to clear service data in the secondary table when the working mode is switched from a day mode to a night mode;
the second processing unit 203 is configured to, when the operation mode is the night mode and the online transaction processing request is received, if the target data used for online transaction is not in the secondary table, access the primary table by using the secondary table to obtain the target data, perform online transaction according to the target data, and write the result data of the online transaction into the secondary table; and when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table.
Specifically, the device further comprises:
and the third processing unit is used for carrying out online reentry in the main table according to the transaction information generated when online transaction is carried out in the night mode and the target data used for carrying out online transaction in the main table when the working mode is switched from the night mode to the day mode so as to redo the online transaction carried out in the night mode in the main table and write the result data of the online transaction into the main table.
Specifically, the device further comprises:
and the fourth processing unit is used for carrying out online transaction according to the target data used for carrying out online transaction in the main table when the working mode is a daily mode and receiving an online transaction processing request, and writing the result data of the online transaction into the main table.
Specifically, the first processing unit is configured to:
when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned, and the parameter data in the parameter table are copied into the auxiliary table.
In the embodiment of the application, when the working mode is the night mode, for online transaction, when target data used for online transaction is not carried out in the secondary table, the target data is copied from the primary table to the secondary table through a penetration technology, the online transaction is carried out in the secondary table, the result data is stored in the secondary table, the batch business processing is carried out in the primary table, and the result data can be stored in the primary table. By establishing two sets of tables of the main table and the auxiliary table and complex day-night mode switching logic, online transaction and batch business processing are respectively processed in different tables, so that data conflict between the two tables can be avoided, the accuracy of the transaction is improved, and 7x24 hours external service is realized.
In yet another aspect, an embodiment of the present application provides a computer device, referring to fig. 4, which shows a structural diagram of the computer device provided by the embodiment of the present application, where the device includes a processor 310 and a memory 320:
the memory 310 is used for storing program codes and transmitting the program codes to the processor;
the processor 320 is configured to execute the data processing method provided in the foregoing embodiment according to the instructions in the program code.
The computer device may comprise a terminal device or a server, in which the aforementioned data processing means may be arranged.
In still another aspect, an embodiment of the present application further provides a storage medium for storing a computer program for executing the data processing method provided in the above embodiment.
Additionally, embodiments of the present application provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the data processing methods provided in the various alternative implementations of the above aspects.
It should be noted that the data processing method, device, equipment and medium provided by the application can be used in the big data field or the financial field. The foregoing is merely exemplary, and the application fields of the data processing method, apparatus, device and medium provided by the present application are not limited.
Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the above method embodiments may be implemented by program instruction hardware, and the above program may be stored in a computer readable storage medium, where the program when executed performs steps including the above method embodiments; and the aforementioned storage medium may be at least one of the following media: read-only Memory (ROM), RAM, magnetic disk or optical disk, etc.
The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented, for example, in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "includes" and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
The foregoing is merely a preferred embodiment of the present application, and the present application has been disclosed in the above description of the preferred embodiment, but is not limited thereto. Any person skilled in the art can make many possible variations and modifications to the technical solution of the present application or modifications to equivalent embodiments using the methods and technical contents disclosed above, without departing from the scope of the technical solution of the present application. Therefore, any simple modification, equivalent variation and modification of the above embodiments according to the technical substance of the present application still fall within the scope of the technical solution of the present application.

Claims (10)

1. A method of data processing, comprising:
acquiring service data of a service termination time point of the current day, and establishing a main table and a secondary table according to the service data; the auxiliary table comprises service data updated dynamically, and the main table comprises static service data of a last day service termination time point;
when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned;
when the working mode is the night mode and an online transaction processing request is received, if target data used for online transaction is not in the secondary table, the secondary table is used for penetrating and accessing the primary table to acquire the target data, online transaction is carried out according to the target data, and the result data of the online transaction is written into the secondary table; and when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table.
2. The data processing method of claim 1, wherein the method further comprises:
and when the working mode is switched from the night mode to the day mode, online reentry is performed in the main table according to transaction information generated when online transaction is performed in the night mode and target data used for online transaction in the main table, so that online transaction performed in the night mode is reworked in the main table, and result data of the online transaction is written in the main table.
3. The data processing method of claim 1, wherein the method further comprises:
when the working mode is a day mode, and when an online transaction processing request is received, online transaction is carried out according to target data used for carrying out online transaction in the main table, and result data of the online transaction is written into the main table.
4. The data processing method according to claim 1, wherein the clearing the service data in the secondary table when the operation mode is switched from the day mode to the night mode comprises:
when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned, and the parameter data in the parameter table are copied into the auxiliary table.
5. A data processing apparatus, comprising:
the system comprises an acquisition unit, a service data acquisition unit and a service data generation unit, wherein the acquisition unit is used for acquiring service data of a service termination time of the day and establishing a main table and a secondary table according to the service data; the auxiliary table comprises service data updated dynamically, and the main table comprises static service data of a last day service termination time point;
the first processing unit is used for cleaning the service data in the auxiliary table when the working mode is switched from a day mode to a night mode;
the second processing unit is used for penetrating and accessing the main table by using the auxiliary table to acquire target data when the working mode is a night mode and receiving an online transaction processing request if the target data used for online transaction is not in the auxiliary table, carrying out online transaction according to the target data, and writing the result data of the online transaction into the auxiliary table; and when receiving a batch service processing request, carrying out batch processing according to the related data in the main table, and writing the result data of batch processing into the main table.
6. The data processing apparatus of claim 5, wherein the apparatus further comprises:
and the third processing unit is used for carrying out online reentry in the main table according to the transaction information generated when online transaction is carried out in the night mode and the target data used for carrying out online transaction in the main table when the working mode is switched from the night mode to the day mode so as to redo the online transaction carried out in the night mode in the main table and write the result data of the online transaction into the main table.
7. The data processing apparatus of claim 5, wherein the apparatus further comprises:
and the fourth processing unit is used for carrying out online transaction according to the target data used for carrying out online transaction in the main table when the working mode is a daily mode and receiving an online transaction processing request, and writing the result data of the online transaction into the main table.
8. The data processing apparatus of claim 5, wherein the first processing unit is configured to:
when the working mode is switched from the day mode to the night mode, the service data in the auxiliary table are cleaned, and the parameter data in the parameter table are copied into the auxiliary table.
9. A computer device, the computer device comprising a processor and a memory:
the memory is used for storing program codes and transmitting the program codes to the processor;
the processor is configured to perform the data processing method of any of claims 1-4 according to instructions in the program code.
10. A computer readable storage medium, characterized in that the computer readable storage medium is for storing a computer program for executing the data processing method according to any one of claims 1-4.
CN202310632041.1A 2023-05-30 2023-05-30 Data processing method, device, equipment and medium Pending CN116644068A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310632041.1A CN116644068A (en) 2023-05-30 2023-05-30 Data processing method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310632041.1A CN116644068A (en) 2023-05-30 2023-05-30 Data processing method, device, equipment and medium

Publications (1)

Publication Number Publication Date
CN116644068A true CN116644068A (en) 2023-08-25

Family

ID=87624329

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310632041.1A Pending CN116644068A (en) 2023-05-30 2023-05-30 Data processing method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN116644068A (en)

Similar Documents

Publication Publication Date Title
US11593337B2 (en) Data processing method, device, and a storage medium
CN110442560B (en) Log replay method, device, server and storage medium
CN103092903A (en) Database Log Parallelization
CN111125040B (en) Method, device and storage medium for managing redo log
US20060004882A1 (en) Custom Atomic Transactions in Programming Environments
CN109690522B (en) Data updating method and device based on B+ tree index and storage device
CN102043859A (en) Data updating method and device
CN111090663A (en) Transaction concurrency control method, device, terminal equipment and medium
CN111208933B (en) Method, device, equipment and storage medium for data access
CN103020304A (en) Data processing method and equipment
CN111737564A (en) Information query method, device, equipment and medium
US7921220B2 (en) Reducing occurrences of two-phase commits in a multi-node computing system
CN111045684A (en) CSS code redundancy detection optimization method, device and equipment and storage medium
CN111125106A (en) Batch running task execution method, device, server and storage medium
CN116644068A (en) Data processing method, device, equipment and medium
US11748078B1 (en) Generating tie code fragments for binary translation
CN115907949A (en) Bank transaction data processing method and device
CN110765144B (en) Distributed heterogeneous database data processing method and device
US20210303339A1 (en) Data backup method, electronic device and computer program product
CN111241191A (en) Database synchronization method and device
CN112286922A (en) Data cleaning method, device, equipment and storage medium
CN114077518A (en) Data snapshot method, device, equipment and storage medium
CN109697216A (en) Exchange information processing method, apparatus and system
EP0445954A2 (en) Synchronising concurrent processes in a computer system
CN111258748B (en) Distributed file system and control method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination