CN114443748A - Data processing method and device, electronic equipment and storage medium - Google Patents

Data processing method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN114443748A
CN114443748A CN202210112939.1A CN202210112939A CN114443748A CN 114443748 A CN114443748 A CN 114443748A CN 202210112939 A CN202210112939 A CN 202210112939A CN 114443748 A CN114443748 A CN 114443748A
Authority
CN
China
Prior art keywords
data
service
processed
instruction
service instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210112939.1A
Other languages
Chinese (zh)
Inventor
涂骋俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Agricultural Bank of China
Original Assignee
Agricultural Bank of China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Agricultural Bank of China filed Critical Agricultural Bank of China
Priority to CN202210112939.1A priority Critical patent/CN114443748A/en
Publication of CN114443748A publication Critical patent/CN114443748A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/256—Integrating or interfacing systems involving database management systems in federated or virtual databases
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange

Abstract

The embodiment of the invention discloses a data processing method, a data processing device, electronic equipment and a storage medium. The method comprises the following steps: receiving a service instruction sent by a distribution server; determining to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction; and performing service operation corresponding to the service instruction on the data to be processed, and storing the service data obtained after the service operation into a physical database. The technical scheme of the embodiment of the invention can ensure the speed of acquiring the data to be processed, avoid generating time delay to block the calculation of the next stage, and improve the efficiency of handling business for clients.

Description

Data processing method and device, electronic equipment and storage medium
Technical Field
The embodiment of the invention relates to the technical field of data processing, in particular to a data processing method and device, electronic equipment and a storage medium.
Background
The current financial market is changeable instantaneously, and a trading system is required to quickly calculate the financial condition of a client and complete the transaction of client business. With the increase of customers, the calculation amount of the system is continuously increased, and the efficient and quick completion of data calculation becomes an important step in the business processing process.
In the prior art, when a large amount of capital data is calculated, capital data such as customer deposit data, transaction data and quotation data are usually directly read from a physical database, and then calculation is performed according to a calculation method for processing services. The calculation process comprises two modes of batch calculation by reading the data of all clients in a memory at one time and calculation one by independently reading the data of each client.
However, whether the client data is read in batch at one time or the data is read one by one in a polling manner, the prior art generates time delay when accessing the database, and particularly when the number of clients and the number of contracts are large, the time delay blocks the calculation process of the next stage, so that the system cannot calculate the client fund situation in time. The client business handling process is influenced, and time and resource waste is generated.
Disclosure of Invention
The embodiment of the invention provides a data processing method, a data processing device, electronic equipment and a storage medium, which are used for accelerating the speed of acquiring data and improving the efficiency of handling business for clients.
In a first aspect, an embodiment of the present invention provides a data processing method, including:
receiving a service instruction sent by a distribution server;
determining to-be-processed data corresponding to the service instruction from a pre-established virtual database simulated by a data structure based on the service instruction;
and performing service operation corresponding to the service instruction on the data to be processed, and storing the service data obtained after the service operation into a physical database.
In a second aspect, an embodiment of the present invention further provides a data processing apparatus, where the apparatus includes:
the receiving service instruction module is used for receiving the service instruction sent by the distribution server;
a data to be processed determining module, configured to determine, based on the service instruction, data to be processed corresponding to the service instruction from a pre-established virtual database simulated by a data structure;
and the business data storage module is used for carrying out business operation corresponding to the business instruction on the data to be processed and storing the business data obtained after the business operation into a physical database.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the data processing method provided by any embodiment of the present invention.
In a fourth aspect, the embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the data processing method provided in any embodiment of the present invention.
When receiving a service instruction sent by a distribution server, the data processing method provided by the embodiment of the invention can determine the data to be processed corresponding to the service instruction from a pre-established virtual database simulated by a data structure based on the service instruction, thereby avoiding reading the data to be processed from a physical database, avoiding generating access delay, performing service operation corresponding to the service instruction on the data to be processed, and storing the service data obtained after the service operation into the physical database. The embodiment of the invention can ensure the speed of acquiring the data to be processed, avoid generating time delay to block the calculation of the next stage, and improve the efficiency of handling business for clients.
In addition, the data processing device, the electronic equipment and the storage medium provided by the invention correspond to the method, and have the same beneficial effects.
Drawings
In order to illustrate the embodiments of the present invention more clearly, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another data processing method according to an embodiment of the present invention;
FIG. 3 is a block diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 4 is a structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Example one
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present invention. The method may be executed by a data processing apparatus, which may be implemented by software and/or hardware, and may be configured in a terminal and/or a server to implement the data processing method in the embodiments of the present invention.
As shown in fig. 1, the method of the embodiment may specifically include:
s101, receiving a service instruction sent by a distribution server.
In a specific implementation, the distribution server may extract the instruction from the instruction queue and distribute the instruction to the corresponding computing nodes, and after receiving the instruction sent by the distribution server, each computing node may perform data processing based on the received instruction. In order to more clearly explain the data processing process, the following description will take an example of a process in which one computing node processes data as an example.
The service content indicated by the service instruction may be data processing performed on transaction data, for example, the service instruction may be an instruction for performing risk measurement and calculation on the transaction service, and the service operation indicated by the service instruction may be completed after the service instruction is received.
Optionally, before receiving the service instruction sent by the distribution server, the method further includes: when receiving a starting initialization instruction, reading the running static parameters stored in the physical database, creating a virtual parameter table in the virtual database, and storing the running static parameters in the virtual parameter table.
In a specific implementation, the virtual database is simulated by the data structure before the business instructions are received. Wherein the data structure comprises a concurrent HashMap (ConcurrentHashMap) data structure. After the virtual database is built, initialization operation is carried out when the system is started based on receiving a large starting initialization instruction. Specifically, the running static parameters stored in the physical database can be read, the database can run normally by running the static data, and the running static data is stored in the virtual data table of the virtual database, so that data operation is performed through the virtual database.
For example, the data structure of the memory of the virtual database may be specifically a four-layer ConcurrentHashMap-type data structure, and when the virtual database is applied to a customer fund transaction application scenario, the virtual database may be organized by a customer as a view, with a customer number and a product number as main keys, and used for storing customer data, such as a customer's deposit and all taken positions of the customer.
The four-layer ConcurrentHashMap data structure is specifically as follows: the key value of the first layer of the data structure is an identification number, such as a client number and a product number; the key value of the second layer is a data table name, and a virtual parameter table is also set and used for storing cache parameters such as the fund abundance rate of the home currency and the fund abundance rate of foreign currency; the key value of the third layer is the primary key of each data table, for example, the primary key string in the form of 'product number + customer number + settlement currency + money collection mark'; the last layer of key values is used for storing each attribute and the corresponding value in the data table. The data structure of the ConcurrentHashMap class has good universality and expansibility, and data tables with different structures can be dynamically added in a memory according to needs so as to meet various types of calculation requirements.
Further, a data structure may further include a QMemDaoSupport-like for supporting various data operations of the virtual database. Understandably, the similar QMamDaoUpport realizes the addition and deletion of a data table and the operation of adding, deleting and modifying data according to a main key by using a Java reflection mechanism, thereby finishing the data operation in a virtual database, avoiding the frequency access to a physical database and reducing the network delay and the communication overhead. In specific implementation, module packaging can be performed on basic data processing operation of the constructed virtual database, and the basic data processing operation can be packaged into an independent processing module based on different functions, so that usability of the virtual database is improved.
Further, after the computing node completes initialization, the customer data can be read from the physical database and loaded into the virtual database. Specifically, the existing data in the virtual database may be compared with the read data, and the stored data in the virtual database may be updated based on the difference data between the existing data and the read data.
S102, determining to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction.
In specific implementation, based on the service instruction, the corresponding service content to be executed is determined. And determining the data to be processed required by executing the service instruction according to the service content. For example, the pending data may be a data indicator such as a fund sufficiency for risk calculation.
Optionally, based on the service instruction, determining to-be-processed data corresponding to the service instruction from a pre-established virtual database simulated by the data structure, including: determining whether a pre-established virtual database simulated by a data structure contains data to be processed corresponding to the service instruction; and if not, reading the physical database, acquiring the data to be processed in the physical database, and updating the virtual database based on the acquired data to be processed.
Specifically, when the data processing process corresponding to the service instruction is executed, in order to ensure that the data processing process can be normally performed, it may be determined whether the virtual database includes data to be processed corresponding to the service instruction. And when the data exists, the data to be processed in the virtual database can be acquired, and corresponding data processing operation is carried out. When the data to be processed does not exist, the data to be processed can be obtained from the physical database for data processing, and in order to facilitate rapid data obtaining later, the virtual database can be updated based on the data to be processed.
S103, performing service operation corresponding to the service instruction on the data to be processed, and storing the service data obtained after the service operation into a physical database.
Specifically, the business operation corresponding to the business instruction can be performed on the data to be processed, and if the business instruction is a risk measurement and calculation instruction, the risk measurement and calculation processing can be performed on the basis of the data to be processed to obtain a risk index of the current business, and the obtained risk index data is stored in the physical database so as to be conveniently provided for a client to view.
When receiving a service instruction sent by a distribution server, the data processing method provided by the embodiment of the invention can determine the data to be processed corresponding to the service instruction from a pre-established virtual database simulated by a data structure based on the service instruction, thereby avoiding reading the data to be processed from a physical database, avoiding generating access delay, performing service operation corresponding to the service instruction on the data to be processed, and storing the service data obtained after the service operation into the physical database. The embodiment of the invention can ensure the speed of acquiring the data to be processed, avoid generating time delay to block the calculation of the next stage, and improve the efficiency of handling business for clients.
Example two
Fig. 2 is a flowchart of another data processing method according to an embodiment of the present invention. The present embodiment is optimized based on the above technical solutions. Optionally, the performing, by the data to be processed, a service operation corresponding to the service instruction includes: and performing service operation corresponding to the service instruction on the data to be processed in a multi-thread parallel mode. The explanations of the same or corresponding terms as those in the above embodiments are omitted.
S201, receiving a service instruction sent by a distribution server.
S202, determining to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction.
S203, performing service operation corresponding to the service instruction on the data to be processed in a multi-thread parallel mode, and storing the service data obtained after the service operation into a physical database.
Where multithreading is understood to mean that multiple threads are running simultaneously in a program. The parallel processing mode can be understood as simultaneously using a plurality of computing resources to solve the computing problem, and can comprise time parallel and space parallel. By adopting a multithreading parallel mode to process the data to be processed, the processing efficiency can be improved, and the business operation required by the client can be completed in time.
In a specific implementation, in order to improve the processing efficiency of the data to be processed, the data to be processed may be processed in a multi-thread parallel processing manner, and the obtained service data may be stored in the physical database. Optionally, performing a service operation corresponding to the service instruction on the data to be processed in a multi-thread parallel manner includes: and controlling each thread to perform service operation corresponding to the service instruction on the data to be processed in parallel according to the preset service processing amount requirement.
Specifically, in the process of multi-thread parallel processing, in order to prevent resource conflict, the data processing operation of each thread may be controlled by presetting the maximum traffic processing amount that each thread can process. For example, an upper limit value of the traffic throughput of each thread may be set to prevent resource conflict. For example, each thread can process up to 50 client risk measurement instructions at a time.
It should be noted that, through the data structure of the ConcurrentHashMap class, the virtual database can divide the data into one segment of storage, and then allocate a lock to each segment of data; when one thread accesses one section of data and occupies the lock, the other sections of data can be accessed by other threads, thereby realizing concurrent access; through the data structure of the ConcurrentHashMap class, lock competition can be reduced, and performance is improved.
Optionally, performing a service operation corresponding to the service instruction on the data to be processed in a multi-thread parallel manner includes: determining each processing thread for processing the current business instruction based on a preset semaphore; and controlling each processing thread to perform service operation corresponding to the service instruction on the data to be processed in parallel.
Specifically, the business operation of each processing thread on the data to be processed can be controlled by setting the semaphore. Specifically, when the thread runs, the semaphore is tried to be acquired, and if the semaphore can be acquired, corresponding business operation is carried out; if the thread cannot be acquired, the other threads are already processed, the other threads can be directly skipped to process other service instructions, and after the processing is completed, the semaphore can be released, so that the synchronization among the threads is completed through the semaphore.
The embodiment of the invention can adopt a mode of multithreading parallel processing data to finish the business operation corresponding to the business instruction, thereby improving the processing efficiency in the data processing process; in a multi-thread high-concurrency service scene, the ConcurrentHashMap data structure can ensure thread safety and avoid faults caused by blocking and resource conflict.
EXAMPLE III
Fig. 3 is a block diagram of a data processing apparatus according to an embodiment of the present invention, which is configured to execute the data processing method according to any of the embodiments. The device and the data processing method of the embodiments belong to the same inventive concept, and details which are not described in detail in the embodiments of the data processing device may refer to the embodiments of the data processing method. The device may specifically comprise:
a service instruction receiving module 10, configured to receive a service instruction sent by a distribution server;
a data to be processed determining module 11, configured to determine, based on the service instruction, data to be processed corresponding to the service instruction from a pre-established virtual database simulated by a data structure;
and the storage service data module 12 is configured to perform a service operation corresponding to the service instruction on the data to be processed, and store the service data obtained after the service operation in a physical database.
On the basis of any optional technical scheme in the embodiment of the present invention, optionally, the method further includes:
and the virtual parameter table creating module is used for reading the running static parameters stored in the physical database when an initialization starting instruction is received before the service instruction sent by the distribution server is received, creating a virtual parameter table in the virtual database, and storing the running static parameters in the virtual parameter table.
On the basis of any optional technical solution in the embodiment of the present invention, optionally, the module for storing service data includes:
and the parallel processing unit is used for performing service operation corresponding to the service instruction on the data to be processed in a multi-thread parallel mode.
On the basis of any optional technical solution in the embodiment of the present invention, optionally, the parallel processing unit includes:
and the parallel processing subunit is used for controlling each thread to perform service operation corresponding to the service instruction on the data to be processed in parallel according to the preset service processing quantity requirement.
On the basis of any optional technical solution in the embodiment of the present invention, optionally, the parallel processing unit includes:
the determining processing thread subunit is used for determining each processing thread for processing the service instruction currently based on a preset semaphore; and controlling each processing thread to perform service operation corresponding to the service instruction on the data to be processed in parallel.
On the basis of any optional technical solution in the embodiment of the present invention, optionally, determining the to-be-processed data module 11 includes:
the updating virtual database unit is used for determining whether the pre-established virtual database simulated by the data structure contains the data to be processed corresponding to the service instruction; and if not, reading the physical database, acquiring the data to be processed in the physical database, and updating the virtual database based on the acquired data to be processed.
On the basis of any optional technical solution in the embodiment of the present invention, optionally, the data structure includes a concurrent hash mapping data structure.
The data processing device provided by the embodiment of the invention can execute the following method: receiving a service instruction sent by a distribution server; determining to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction; and performing service operation corresponding to the service instruction on the data to be processed, and storing the service data obtained after the service operation into a physical database. The embodiment of the invention can ensure the speed of acquiring the data to be processed, avoid generating time delay to block the calculation of the next stage, and improve the efficiency of handling business for clients.
It should be noted that, in the embodiment of the data processing apparatus, the included units and modules are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
Example four
Fig. 4 is a structural diagram of an electronic device according to an embodiment of the present invention. FIG. 4 illustrates a block diagram of an exemplary electronic device 20 suitable for use in implementing embodiments of the present invention. The illustrated electronic device 20 is merely an example and should not be used to limit the functionality or scope of embodiments of the present invention.
As shown in fig. 4, the electronic device 20 is embodied in the form of a general purpose computing device. The components of the electronic device 20 may include, but are not limited to: one or more processors or processing units 201, a system memory 202, and a bus 203 that couples the various system components (including the system memory 202 and the processing unit 201).
Bus 203 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Electronic device 20 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by electronic device 20 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 202 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)204 and/or cache memory 205. The electronic device 20 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, the storage system 206 may be used to read from and write to non-removable, nonvolatile magnetic media. A magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 203 by one or more data media interfaces. Memory 202 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 208 having a set (at least one) of program modules 207 may be stored, for example, in memory 202, such program modules 207 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 207 generally perform the functions and/or methodologies of embodiments of the present invention as described herein.
The electronic device 20 may also communicate with one or more external devices 209 (e.g., keyboard, pointing device, display 210, etc.), with one or more devices that enable a user to interact with the electronic device 20, and/or with any devices (e.g., network card, modem, etc.) that enable the electronic device 20 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 211. Also, the electronic device 20 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet) via the network adapter 212. As shown, the network adapter 212 communicates with other modules of the electronic device 20 over the bus 203. It should be understood that other hardware and/or software modules may be used in conjunction with electronic device 20, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 201 executes various functional applications and data processing by running a program stored in the system memory 202.
The electronic equipment provided by the invention can realize the following method: receiving a service instruction sent by a distribution server; determining to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction; and performing service operation corresponding to the service instruction on the data to be processed, and storing the service data obtained after the service operation into a physical database. The embodiment of the invention can ensure the speed of acquiring the data to be processed, avoid generating time delay to block the calculation of the next stage, and improve the efficiency of handling business for clients.
EXAMPLE five
An embodiment of the invention provides a storage medium containing computer-executable instructions which, when executed by a computer processor, are operable to perform a method of data processing, the method comprising:
receiving a service instruction sent by a distribution server; determining to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction; and performing service operation corresponding to the service instruction on the data to be processed, and storing the service data obtained after the service operation into a physical database. The embodiment of the invention can ensure the speed of acquiring the data to be processed, avoid generating time delay to block the calculation of the next stage, and improve the efficiency of handling business for clients.
Of course, the storage medium provided by the embodiment of the present invention contains computer-executable instructions, and the computer-executable instructions are not limited to the method operations described above, and may also perform related operations in the data method provided by any embodiment of the present invention.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (10)

1. A data processing method, comprising:
receiving a service instruction sent by a distribution server;
determining data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction;
and performing service operation corresponding to the service instruction on the data to be processed, and storing the service data obtained after the service operation into a physical database.
2. The method according to claim 1, wherein before the receiving the service instruction sent by the distribution server, further comprising:
when an initialization starting instruction is received, the running static parameters stored in the physical database are read, a virtual parameter table is created in the virtual database, and the running static parameters are stored in the virtual parameter table.
3. The method according to claim 1, wherein the performing the service operation corresponding to the service instruction on the data to be processed includes:
and performing service operation corresponding to the service instruction on the data to be processed in a multi-thread parallel mode.
4. The method according to claim 3, wherein performing the service operation corresponding to the service instruction on the data to be processed in a multi-thread parallel manner comprises:
and controlling each thread to perform service operation corresponding to the service instruction on the data to be processed in parallel according to a preset service processing capacity requirement.
5. The method according to claim 3, wherein performing the service operation corresponding to the service instruction on the data to be processed in a multi-thread parallel manner comprises:
determining each processing thread for processing the service instruction at present based on a preset semaphore;
and controlling each processing thread to perform service operation corresponding to the service instruction on the data to be processed in parallel.
6. The method of claim 1, wherein the determining, based on the service instruction, the data to be processed corresponding to the service instruction from a pre-established virtual database simulated by a data structure comprises:
determining whether the pre-established virtual database simulated by the data structure contains the data to be processed corresponding to the service instruction;
and if not, reading the physical database, acquiring the data to be processed in the physical database, and updating the virtual database based on the acquired data to be processed.
7. The method of claim 1, wherein the data structure comprises a concurrent hash map data structure.
8. A data processing apparatus, comprising:
the receiving service instruction module is used for receiving the service instruction sent by the distribution server;
a data to be processed determining module, configured to determine, based on the service instruction, data to be processed corresponding to the service instruction from a pre-established virtual database simulated by a data structure;
and the business data storage module is used for carrying out business operation corresponding to the business instruction on the data to be processed and storing the business data obtained after the business operation into a physical database.
9. An electronic device, comprising:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a data processing method as claimed in any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the data processing method of any one of claims 1 to 7.
CN202210112939.1A 2022-01-29 2022-01-29 Data processing method and device, electronic equipment and storage medium Pending CN114443748A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210112939.1A CN114443748A (en) 2022-01-29 2022-01-29 Data processing method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210112939.1A CN114443748A (en) 2022-01-29 2022-01-29 Data processing method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114443748A true CN114443748A (en) 2022-05-06

Family

ID=81372084

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210112939.1A Pending CN114443748A (en) 2022-01-29 2022-01-29 Data processing method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114443748A (en)

Similar Documents

Publication Publication Date Title
US9846590B2 (en) Deploying a virtual machine in a computing environment
US8924561B2 (en) Dynamically resizing a networked computing environment to process a workload
CN113641457A (en) Container creation method, device, apparatus, medium, and program product
US9720824B2 (en) Garbage collection handler to update object pointers
CN110865888A (en) Resource loading method and device, server and storage medium
US11030169B1 (en) Data re-sharding
US10049034B2 (en) Information processing apparatus
US10698785B2 (en) Task management based on an access workload
US20120323821A1 (en) Methods for billing for data storage in a tiered data storage system
US20190361618A1 (en) Maintaining container to storage volume relations
CN110908697A (en) Resource packaging method, device, server and storage medium
CN114327278A (en) Data additional writing method, device, equipment and storage medium
US10713228B2 (en) Generating and accessing a data table
CN111651286A (en) Data communication method, device, computing equipment and storage medium
US20150363441A1 (en) Generating and accessing a data table
US11403026B2 (en) Method, device and computer program product for managing storage system
US10896062B2 (en) Inter-process memory management
US11573823B2 (en) Parallel execution of applications
US10929305B2 (en) Page sharing for containers
CN114443748A (en) Data processing method and device, electronic equipment and storage medium
CN115421922A (en) Current limiting method, device, equipment, medium and product of distributed system
CN110659312B (en) Data processing method, device, equipment and computer storage medium
US10754776B2 (en) Cache balance when using hardware transactional memory
CN107636624B (en) Garbage collection without using special instructions
US11366830B1 (en) Techniques for live repartitioning of cross-service database shards

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination