CN110716911B - Data processing method and device, electronic equipment and storage medium - Google Patents
Data processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110716911B CN110716911B CN201810672854.2A CN201810672854A CN110716911B CN 110716911 B CN110716911 B CN 110716911B CN 201810672854 A CN201810672854 A CN 201810672854A CN 110716911 B CN110716911 B CN 110716911B
- Authority
- CN
- China
- Prior art keywords
- data
- maximum level
- level single
- single number
- target table
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The disclosure provides a data processing method and device, electronic equipment and storage medium, and relates to the technical field of big data, wherein the method comprises the following steps: receiving a query request, wherein the query request comprises a service association identifier; acquiring configuration information of a target table corresponding to the service association identifier from a forwarding record table through the service association identifier; and according to the configuration information of the target table, the forwarding data of the target table is pulled back to the formal library from the history library. The technical scheme of the disclosure can quickly and accurately pull back data.
Description
Technical Field
The present disclosure relates to the field of big data technology, and in particular, to a data processing method, a data processing apparatus, an electronic device, and a computer readable storage medium.
Background
When data processing is performed, the historical data in the database is generally stored in another same database to be used as a backup, so as to realize data transfer. However, in practical application, if documents of 2 systems are found to be inconsistent through some weakly-associated return systems, the data needs to be pulled back to reorganize the message to return the data again, so as to achieve data consistency of 2 or more systems.
In the related art, when the forwarding data are pulled, a plurality of tables related to a certain document need to be pulled together in a service dimension, but when the data are pulled, the data can only be pulled in a form of a single table. Because each bill belongs to different dimensions and different levels, the relation among tables is many-to-many, one-to-many, and the like, the following single numbers need to query the associated fields through the first table and then bring the associated fields into the second table for data query and data pull. In the above manner, when a plurality of tables related to a certain bill are pulled back, each table needs to be pulled back in turn, and when the data of the plurality of tables are pulled back, the whole data structure relationship must be known through codes, for example, the association relationship among the plurality of tables is known, so that the operation is inconvenient and the efficiency is lower; in addition, the situation that the pulled data is incomplete often occurs, and the accuracy is low.
It should be noted that the information disclosed in the above background section is only for enhancing understanding of the background of the present disclosure and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The present disclosure is directed to a data processing method and apparatus, an electronic device, and a storage medium, and thus, at least to some extent, to overcome the problem that data pull-back cannot be performed quickly due to limitations and drawbacks of the related art.
Other features and advantages of the present disclosure will be apparent from the following detailed description, or may be learned in part by the practice of the disclosure.
According to one aspect of the present disclosure, there is provided a data processing method including: receiving a query request, wherein the query request comprises a service association identifier; acquiring configuration information of a target table corresponding to the service association identifier from a forwarding record table through the service association identifier; and according to the configuration information of the target table, the forwarding data of the target table is pulled back to the formal library from the history library.
In an exemplary embodiment of the present disclosure, the method further comprises: and if the data rotation operation aiming at the maximum level single number is detected, generating a rotation record associated with the maximum level single number, and generating a rotation record table through the rotation record.
In one exemplary embodiment of the present disclosure, generating the tie record associated with the maximum level single number includes: respectively generating the service association identifiers associated with the maximum level single numbers in a plurality of data tables of the historic base; and generating the transfer record associated with the maximum level single number according to the maximum level single number and the service association identifier.
In an exemplary embodiment of the present disclosure, the method further comprises: and if the data transfer operation aiming at the maximum level single number is detected, storing the business data in the formal library into the history library, and storing the business association identifier into the transfer record table.
In an exemplary embodiment of the present disclosure, generating the service association identities associated with the maximum level single numbers, respectively, includes: and generating the service association identifier associated with the maximum level single number based on the maximum level dimension when carrying out data forwarding operation on the plurality of data tables of the historic base in the service dimension.
In one exemplary embodiment of the present disclosure, pulling the tie-back data of the target table from the history repository to the formal repository according to the configuration information of the target table includes: and determining a service table name of a target table according to the maximum level single number and the service association identifier corresponding to the maximum level single number, and pulling the forwarding data corresponding to the service table name back to the formal library from the history library.
In an exemplary embodiment of the present disclosure, the method further comprises: and storing the junction transfer data of the target table from a history library to the junction transfer record table, and storing the junction transfer data to the formal library.
In one exemplary embodiment of the present disclosure, after the transferring the tie-down data to the formal library, the method further comprises: and deleting the forwarding data of the target table in the history library and the forwarding record table.
According to an aspect of the present disclosure, there is provided a data processing apparatus comprising: the request receiving module is used for receiving a query request, wherein the query request comprises a service association identifier; the target table determining module is used for acquiring configuration information of a target table corresponding to the service association identifier from a forwarding record table through the service association identifier; and the data pulling-back module is used for pulling back the corotation data of the target table from the history base to the formal base according to the configuration information of the target table.
According to one aspect of the present disclosure, there is provided an electronic device including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the data processing method of any of the above via execution of the executable instructions.
According to one aspect of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the data processing method of any one of the above.
In the data processing method, the data processing device, the electronic equipment and the computer readable storage medium provided in the present exemplary embodiment, on one hand, configuration information of a target table corresponding to a service association identifier is obtained in a forward record table through the service association identifier, forward data of the target table is further pulled back to a formal library from a history library according to the configuration information of the target table, batch pulling back of the target table can be realized, repeated confirmation of whether to pull back each table in the related art is avoided, operation steps are simplified, and data pulling back efficiency and convenience are improved; on the other hand, the configuration information of the target table is obtained through the service association identifier, so that data is pulled back, the integrity of the pulled back data is ensured, and the accuracy is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the disclosure. It will be apparent to those of ordinary skill in the art that the drawings in the following description are merely examples of the disclosure and that other drawings may be derived from them without undue effort.
FIG. 1 schematically illustrates a system architecture diagram for implementing a data processing method in an exemplary embodiment of the present disclosure;
FIG. 2 schematically illustrates a schematic diagram of a data processing method in an exemplary embodiment of the present disclosure;
FIG. 3 schematically illustrates a particular flow chart of a data transfer in an exemplary embodiment of the present disclosure;
FIG. 4 schematically illustrates a particular flow diagram of a data pull back in an exemplary embodiment of the present disclosure;
FIG. 5 schematically illustrates a block diagram of a data processing apparatus in an exemplary embodiment of the present disclosure;
FIG. 6 schematically illustrates a block diagram of an electronic device in an exemplary embodiment of the present disclosure;
fig. 7 schematically illustrates a program product in an exemplary embodiment of the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the present disclosure. One skilled in the relevant art will recognize, however, that the aspects of the disclosure may be practiced without one or more of the specific details, or with other methods, components, devices, steps, etc. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software or in one or more hardware modules or integrated circuits or in different networks and/or processor devices and/or microcontroller devices.
The present exemplary embodiment first provides a system architecture for implementing a data processing method, which can be applied to various scenes and the like in which historical data needs to be pulled back. As shown with reference to fig. 1, the system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is a medium for providing a communication link between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The user may interact with the server 105 via the network 104 using the terminal devices 101, 102, 103 to receive or send request instructions or the like. Various communication client applications, such as a picture processing application, a shopping class application, a web browser application, a search class application, an instant messaging tool, a mailbox client, social platform software, etc., may be installed on the terminal devices 101, 102, 103.
The terminal devices 101, 102, 103 may be a variety of electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.
The server 105 may be a server providing various services, such as a background management server (by way of example only) providing support for shopping-type websites browsed by users using the terminal devices 101, 102, 103. The background management server may analyze and process the received data such as the product information query request, and feedback the processing result (e.g., the target push information, the product information—only an example) to the terminal device.
It should be noted that the data processing method provided in the exemplary embodiment of the present disclosure is generally executed by the server 105, and accordingly, the data processing apparatus is generally provided in the terminal device 101.
Based on the system architecture 100 described above, a data processing method is provided in this example, and referring to fig. 2, the data processing method may include the following steps:
in step S210, a query request is received, where the query request includes a service association identifier;
in step S220, the configuration information of the target table corresponding to the service association identifier is obtained from a forwarding record table through the service association identifier;
in step S230, according to the configuration information of the target table, the forward data of the target table is pulled back to the formal library from the history library.
In the data processing method provided by the exemplary embodiment of the present disclosure, on one hand, configuration information of a target table corresponding to a service association identifier is obtained from a forwarding record table through the service association identifier, forwarding data of the target table is further pulled back to a formal library from a history library according to the configuration information of the target table, batch pulling back of the target table can be achieved, operation of pulling back each table in the related art is avoided, operation steps are simplified, and data pulling back efficiency and convenience are improved; on the other hand, the configuration information of the target table is obtained through the service association identifier, so that data is pulled back, the integrity of the pulled back data is ensured, and the accuracy is improved.
Next, a data processing method provided in the present exemplary embodiment will be described in detail with reference to the accompanying drawings.
In step S210, a query request is received, where the query request includes a service association identifier.
In the present exemplary embodiment, the query request may be a query request for the corotation data to which the corotation operation is performed. The query request may be represented, for example, by SQL (Structured Query Language ). The server may receive a query request sent by any one of the terminal devices in communication with the server for querying the forwarding data stored in, for example, a history repository. A field representing the service association identity, such as the "businesbatched" field, may be included in the query request. Next, in step S220, the configuration information of the target table corresponding to the service association identifier is obtained from a forwarding record table through the service association identifier.
In this exemplary embodiment, the service association identifier may simplify the relationships of multiple tables, for example, simplify the relationships of multiple fields of multiple tables to the relationships between multiple service association identifiers, so that the service association identifier can quickly determine the target table, and finally realize one-key data pull-back. Specifically, first, the service association identifier associated with the maximum level single number may be generated for each of a plurality of data tables of the history library corresponding to the formal library on the basis of the formal library. The structure of the table in the history library and the structure of the table in the formal library and the specific content contained in each table are consistent. Referring to the specific structure of the table in the formal library shown in table 1 and table 2, wherein table 1 is an order table, the order table specifically may include order ID, order number, order type and other contents, and the order type may be, for example, an internal order or a sales order; table 2 is an order list, which may specifically include order ID, commodity SKU, commodity name, commodity number, and the order to which each commodity belongs. For example, one microwave oven and one air conditioner in table 2 belong to sales orders with order number 234, and 2 televisions and 1 refrigerator in table 2 belong to internal orders with order number 123.
| ID | Order number | Order type |
| 1 | 123 | Internally matched order form |
| 2 | 234 | Sales order |
TABLE 1
| ID | Commodity SKU | Commodity name | Quantity of | Order of belonged to |
| 1 | 111 | Television set | 2 | 123 |
| 2 | 222 | Refrigerator with a refrigerator body | 1 | 123 |
| 3 | 333 | Microwave oven | 1 | 234 |
| 4 | 444 | Air conditioner | 1 | 234 |
TABLE 2
After determining the specific structure of the multiple tables in the online formal library, one or more service association identifiers may be added to the multiple tables in the historian consistent with the structure of the multiple tables in the formal library, respectively. Referring to tables 3 and 4, table 3 is consistent with the details in table 1, but table 3 has a "businessbatch id" field for representing a service association identifier added to table 1; table 4 corresponds to the details in table 2, but table 4 adds a "bussinessbatch id" field for representing a service association identifier with respect to table 2. It should be noted that, the service association identifiers corresponding to the same order are the same, and the service association identifiers corresponding to different orders are different. For example, continuing to refer to tables 3 and 4, the business association identifier businessbatch id for an order number 123 for an in-order is 1 and the business association identifier businessbatch id for a sales order of order number 234 is 2.
| ID | Order number | Order type | businessBatchId |
| 1 | 123 | Internally matched order form | 1 |
| 2 | 234 | Sales order | 2 |
TABLE 3 Table 3
| ID | Commodity SKU | Commodity name | Quantity of | Order of belonged to | businessBatchId |
| 1 | 111 | Television set | 2 | 123 | 1 |
| 2 | 222 | Refrigerator with a refrigerator body | 1 | 123 | 1 |
| 3 | 333 | Microwave oven | 1 | 234 | 2 |
| 4 | 444 | Air conditioner | 1 | 234 | 2 |
TABLE 4 Table 4
Wherein the business association identifier may be generated for a maximum level order for which a data tie operation is received based on a maximum level dimension when performing the data tie operation on the plurality of data tables of the history repository in a business dimension. Specifically, if there is a complex table relationship such as a wave number, a wave number detail, a collection sheet detail, an order detail, a task group, etc., and each table represents service data of one dimension, when a data tie operation occurs, a service association identifier is generated in the largest level dimension, that is, the wave number dimension. In the present exemplary embodiment, since the maximum level dimension in the table relationship is the order dimension, when the data transfer operation occurs, a business association identifier may be generated based on the order dimension, so as to associate the order details of each order. Further, when the data forwarding operation occurs, the data forwarding operation can be performed on the multiple tables together based on the service dimension, so as to generate the service association identifier businesbatched. It should be noted that, the business association identifier businessBatchId cannot be simply replaced by the wave number, so that the wave number does not need to be stored in the order list and the order table. After determining the service association identifier corresponding to each order, it may be determined whether a data transfer operation for the maximum level single number is detected. The maximum level single number here may be a wave number, typically generated by seeded sorting. Seeded sorting refers to sorting operations in units of one lot in which multiple orders are aggregated, and this lot of sorting operations may be generally referred to as a wave number. The seeding type sorting enables each wave to gather a plurality of orders, so that the working efficiency can be improved.
If a data transfer operation of the maximum level single number, which is a set single number summarized for a plurality of orders, is detected, one piece of data representing a transfer record associated with the maximum level single number may be generated in response to the data transfer operation. That is, each time a data transfer operation for a maximum level single number is detected, a piece of data is generated to represent a transfer record associated with each maximum level single number. Further, a list table including all the rotation records, namely the rotation record table, can be obtained according to the generated rotation records, and the data is pulled back in a manner of displaying the rotation records through a visual table. The specific structure of the forward record table is shown in table 5, and the single number in table 5 refers to the maximum level single number, for example 123; the service association is identified as the "businessBatchId" field, e.g., 1, corresponding to the maximum level single number 123; the business table names may include, for example, order tables and order details tables, and may correspond to all tables included in the formal library.
| Single number | businessBatchId | Service table name |
| 123 | 1 | Order form, order detail form |
TABLE 5
Based on this, the configuration information of the target table can be quickly determined according to the forward record table as shown in table 5, wherein the target table refers to the table storing forward data or the table to be pulled back, and the configuration information comprises the table name of the target table or the information uniquely representing the target table such as the number of the target table. And the configuration information of the table to be pulled back and the data of all tables corresponding to the maximum level single number can be rapidly acquired from the forwarding record table through the service association identifier.
Meanwhile, when the data transfer operation for the maximum level single number is detected, the business data in the formal library can be stored into the history library and the transfer record table, and the business data in the formal library can be deleted. Referring to fig. 3, the formal library refers to a business library, and the historic library refers to a junction transfer library. The specific data transfer process comprises the following steps: step S301, obtaining business data through a corotation data flow by a formal library in a business dimension batch; step S302, when detecting each data forwarding operation for the maximum level single number, the server generates a corresponding service association identifier businesbatched for each maximum level single number, for example, as shown in table 4, a "businesbatched" field generated for the maximum level single number 123 is 1, and a "businesbatched" field generated for the maximum level single number 234 is 2; step S303, storing the business data in the formal library into a history library; step S304, storing the generated business association identifier businessBatchId into a forwarding record table; in step S305, after transferring the service data in the formal library to the history library, the service data in the formal library may be deleted, so that the formal library continues to store and transfer other service data. For example, when the data is transferred, the service data 1 corresponding to the maximum level single number 1 in the online formal library is transferred to the history library, and the related information is stored in the transfer record table 1, so that the service association identifier 1, the order number and the association list name of the service data 1, such as an order list/order list, are recorded in the transfer record table 1. In this way, a visual tool can be used to provide a premise for one-key pull-back by making a check of table 1.
In step S230, according to the configuration information of the target table, the forward data of the target table is pulled back to the formal library from the history library.
In this exemplary embodiment, if the configuration information corresponding to the target table is obtained, the corresponding one or more target tables may be extracted from all tables in the history base according to the obtained configuration information, and the forwarding data included in each target table may be pulled back to the formal base, so as to complete the data pulling operation. According to the configuration information of the target table, the specific steps of pulling the forward data of the target table back to the formal library from the history library include: and determining a service table name of a target table according to the maximum level single number and the service association identifier corresponding to the maximum level single number, and pulling the forwarding data corresponding to the service table name back to the formal library from the history library. After the formal library transfers the business data to the history library, the business data is changed to transfer data in the history library. Referring to table 5, the service table name of the target table can be quickly determined in the forwarding record table corresponding to the maximum level single number by the service association identifier corresponding to the maximum level single number, so that forwarding data corresponding to the service table name can be obtained in the history base according to the service table name. Further, the forward data corresponding to the target table can be stored from the history database to the forward record table, and the forward data is saved to the formal database through the forward record table so as to complete the data pull-back operation. A specific data pullback procedure is shown with reference to fig. 4, and may include the following steps: step S401, obtaining configuration information of a target table, such as a table name, a number and the like of the target table; step S402, acquiring the corotation data corresponding to the target table according to the configuration information of the target table determined in step S401 in the data corotation flow; step S403, storing the obtained forwarding data to a formal library; step S404, after the forward data is stored in the formal library, deleting the forward data stored in the history library; step S405, delete the generated rotation record table.
For example, the service data 1 is changed to the forwarding data 1 corresponding to the service data 1 after forwarding to the history database, and the attribute information of all the target tables corresponding to the maximum level single number 1 can be obtained from the forwarding record table through the service association identifier 1 corresponding to the maximum level single number 1. In this way, the order list corresponding to the maximum level list number 1 and the transfer data in the order list can be transferred to the formal library according to the attribute information of the target list, so that other data processing operations can be performed in the formal library. By means of the method in the embodiment, operation of one-key pull-back of the forward data in the history library can be achieved, and operation efficiency and accuracy are improved.
Based on the data pull-back step described in the present exemplary embodiment, the specific step of performing data pull-back by the SQL language may be, for example:
Select businessBatchId from obd_group where group_no＝
’GRPGA17112800000216’
Select*from obd_group_line where businessBatchId＝’XXX’
Select*from obd_order where businessBatchId＝’XXX’
Select*from obd_order_line where businessBatchId＝’XXX’
the specific steps of performing data pullback in the SQL language that does not contain a business association identifier may be, for example:
Select*from obd_group where group_no＝’GRPGA17112800000216’
Select*from obd_group_line where group_sys_no＝
’GRPGA17112800000216’
Select*from obd_order where group_sys_no＝581803
Select*from obd_order_line where order_sys_no＝2719512
as can be seen from the comparison of the programs, when the SQL query language written after the businessBatchId is used, as long as the business association identifier businessBatchId corresponding to the table obd_group table with the largest business dimension is detected, all tables associated with the business association identifier can be queried by one key by using the whoerbustBatchId= 'XXX', and when a developer writes the SQL language, the risk and complexity of error brought by the back and forth check parameters can be avoided, and the accuracy is improved.
In addition, after the forward data in the history library is transferred to the formal library, the forward data of the target table stored in the history library and the forward record table can be deleted, so that the calculated amount is reduced, and the forward data query efficiency is improved.
The disclosure also provides a data processing device. Referring to fig. 5, the data processing apparatus 500 may include:
the request receiving module 501 may be configured to receive a query request, where the query request includes a service association identifier;
the target table determining module 502 may be configured to obtain, from a forwarding record table, configuration information of a target table corresponding to the service association identifier through the service association identifier;
the data pulling module 503 may be configured to pull, from the history repository, the forward data of the target table to the formal repository according to the configuration information of the target table.
In an exemplary embodiment of the present disclosure, the apparatus further comprises: and the record table generation module is used for generating a turn record associated with the maximum level single number if the data turn operation aiming at the maximum level single number is detected, and generating a turn record table through the turn record.
In an exemplary embodiment of the present disclosure, the record table generation module includes: the identifier generation module is used for respectively generating the service association identifiers associated with the maximum level single number in a plurality of data tables of the historic base; and the record generation module is used for generating the transfer record associated with the maximum level single number according to the maximum level single number and the service association identifier.
In an exemplary embodiment of the present disclosure, the apparatus further comprises: and the business data transfer module is used for storing the business data in the formal library into the history library and storing the business association identifier into the transfer record table if the data transfer operation aiming at the maximum level single number is detected.
In an exemplary embodiment of the present disclosure, the identification generation module includes: and the identification control module is used for generating the service association identification associated with the maximum level single number based on the maximum level dimension when the data forwarding operation is carried out on the plurality of data tables of the history library in the service dimension.
In one exemplary embodiment of the present disclosure, the data pull module includes: and the pull-back control module is used for determining the service table name of the target table according to the maximum level single number and the service association identifier corresponding to the maximum level single number, and pulling the forwarding data corresponding to the service table name back to the formal library from the history library.
In an exemplary embodiment of the present disclosure, the apparatus further comprises: and the forwarding data storage module is used for storing forwarding data of the target table from a history library to the forwarding record table and forwarding the forwarding data to the formal library.
In one exemplary embodiment of the present disclosure, after the transferring the tie-down data to the formal library, the apparatus further includes: and the rotation data deleting module is used for deleting the history library and the rotation data of the target table in the rotation record table. It should be noted that, the specific details of each module in the above data processing apparatus have been described in detail in the corresponding data processing method, so that the details are not repeated here.
It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit in accordance with embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied.
Furthermore, although the steps of the methods in the present disclosure are depicted in a particular order in the drawings, this does not require or imply that the steps must be performed in that particular order or that all illustrated steps be performed in order to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform, etc.
In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.
Those skilled in the art will appreciate that the various aspects of the application may be implemented as a system, method, or program product. Accordingly, aspects of the application may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects may be referred to herein as a "circuit," module "or" system.
An electronic device 600 according to this embodiment of the application is described below with reference to fig. 6. The electronic device 600 shown in fig. 6 is merely an example and should not be construed to limit the functionality and scope of use of the present disclosure in any way.
As shown in fig. 6, the electronic device 600 is in the form of a general purpose computing device. Components of electronic device 600 may include, but are not limited to: the at least one processing unit 610, the at least one memory unit 620, and a bus 630 that connects the various system components, including the memory unit 620 and the processing unit 610.
Wherein the storage unit stores program code that is executable by the processing unit 610 such that the processing unit 610 performs steps according to various exemplary embodiments of the present application described in the above-described "exemplary methods" section of the present specification. For example, the processing unit 610 may perform the steps as shown in fig. 2: in step S210, a query request is received, where the query request includes a service association identifier; in step S220, the configuration information of the target table corresponding to the service association identifier is obtained from a forwarding record table through the service association identifier; in step S230, according to the configuration information of the target table, the forward data of the target table is pulled back to the formal library from the history library. The storage unit 620 may include readable media in the form of volatile storage units, such as Random Access Memory (RAM) 6201 and/or cache memory unit 6202, and may further include Read Only Memory (ROM) 6203.
The storage unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.
Bus 630 may be a local bus representing one or more of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or using any of a variety of bus architectures.
The electronic device 600 may also communicate with one or more external devices 800 (e.g., keyboard, pointing device, bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 600, and/or any device (e.g., router, modem, etc.) that enables the electronic device 600 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 650. Also, electronic device 600 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through network adapter 660. As shown, network adapter 660 communicates with other modules of electronic device 600 over bus 630. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 600, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
In an exemplary embodiment of the present disclosure, a computer-readable storage medium having stored thereon a program product capable of implementing the method described above in the present specification is also provided. In some possible embodiments, the various aspects of the application may also be implemented in the form of a program product comprising program code for causing a terminal device to carry out the steps according to the various exemplary embodiments of the application as described in the "exemplary methods" section of this specification, when said program product is run on the terminal device.
Referring to fig. 7, a program product 700 for implementing the above-described method according to an embodiment of the present application is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present application is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).
Furthermore, the above-described drawings are only schematic illustrations of processes included in the method according to the exemplary embodiment of the present application, and are not intended to be limiting. It will be readily appreciated that the processes shown in the above figures do not indicate or limit the temporal order of these processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, for example, among a plurality of modules.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
Claims (9)
1. A method of data processing, comprising:
receiving a query request, wherein the query request comprises a service association identifier;
acquiring configuration information of a target table corresponding to the service association identifier from a forwarding record table through the service association identifier;
according to the configuration information of the target table, the forward-reverse data of the target table is pulled back to a formal library from a history library, and the configuration information is used for representing the information uniquely representing the target table;
if the data transfer operation aiming at the maximum level single number is detected, generating a transfer record associated with the maximum level single number, and generating a transfer record table through the transfer record, wherein the maximum level single number is generated according to one batch of multiple orders as a unit;
wherein generating a forward record associated with the maximum level single number comprises:
respectively generating the service association identifiers associated with the maximum level single numbers in a plurality of data tables of the historic base;
and generating the transfer record associated with the maximum level single number according to the maximum level single number and the service association identifier.
2. The data processing method of claim 1, wherein the method further comprises:
and if the data transfer operation aiming at the maximum level single number is detected, storing the business data in the formal library into the history library, and storing the business association identifier into the transfer record table.
3. The data processing method according to claim 1, wherein generating the service association identifications associated with the maximum level single numbers, respectively, comprises:
and generating the service association identifier associated with the maximum level single number based on the maximum level dimension when carrying out data forwarding operation on the plurality of data tables of the historic base in the service dimension.
4. The data processing method according to claim 1, wherein pulling the forward data of the target table from the history repository to the formal repository according to the configuration information of the target table comprises:
and determining a service table name of a target table according to the maximum level single number and the service association identifier corresponding to the maximum level single number, and pulling the forwarding data corresponding to the service table name back to the formal library from the history library.
5. The data processing method of claim 1, wherein the method further comprises:
and storing the junction transfer data of the target table from a history library to the junction transfer record table, and storing the junction transfer data to the formal library.
6. The data processing method according to claim 5, wherein after the transferring of the tie-down data to the formal library, the method further comprises:
and deleting the forwarding data of the target table in the history library and the forwarding record table.
7. A data processing apparatus, comprising:
the request receiving module is used for receiving a query request, wherein the query request comprises a service association identifier;
the target table determining module is used for acquiring configuration information of a target table corresponding to the service association identifier from a forwarding record table through the service association identifier;
the data pulling-back module is used for pulling back the forward data of the target table from the history base to the formal base according to the configuration information of the target table, wherein the configuration information is used for representing the information uniquely representing the target table;
the record table generation module is used for generating a transfer record associated with the maximum level single number if the data transfer operation aiming at the maximum level single number is detected, and generating a transfer record table through the transfer record, wherein the maximum level single number is generated according to a batch of multiple orders;
wherein, the record table generation module includes: the identifier generation module is used for respectively generating the service association identifiers associated with the maximum level single number in a plurality of data tables of the historic base; and the record generation module is used for generating the transfer record associated with the maximum level single number according to the maximum level single number and the service association identifier.
8. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the data processing method of any of claims 1-6 via execution of the executable instructions.
9. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the data processing method of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810672854.2A CN110716911B (en) | 2018-06-26 | 2018-06-26 | Data processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810672854.2A CN110716911B (en) | 2018-06-26 | 2018-06-26 | Data processing method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110716911A CN110716911A (en) | 2020-01-21 |
| CN110716911B true CN110716911B (en) | 2023-09-26 |
Family
ID=69208880
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810672854.2A Active CN110716911B (en) | 2018-06-26 | 2018-06-26 | Data processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110716911B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112860680B (en) * | 2021-03-18 | 2022-07-29 | 杭州云灵科技有限公司 | Data processing method and system, and data query method and system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1525687A (en) * | 2003-02-26 | 2004-09-01 | Network framework and applications for providing notification(s) | |
| CN102592185A (en) * | 2010-10-05 | 2012-07-18 | 埃森哲环球服务有限公司 | Electronic process-driven collaboration system |
| CN104969214A (en) * | 2013-03-12 | 2015-10-07 | 英特尔公司 | Sensor associated data of multiple devices based computing |
| CN105224536A (en) * | 2014-05-29 | 2016-01-06 | 国际商业机器公司 | The method and apparatus of partition database |
| CN106156972A (en) * | 2015-04-21 | 2016-11-23 | 阿里巴巴集团控股有限公司 | Logistics service information providing method and device |
| CN107506356A (en) * | 2016-06-14 | 2017-12-22 | 北京京东尚科信息技术有限公司 | Data processing method and its system |
| CN107766574A (en) * | 2017-11-13 | 2018-03-06 | 天津开心生活科技有限公司 | Data query method and device, date storage method and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8843623B2 (en) * | 2011-02-28 | 2014-09-23 | Mckesson Financial Holdings | Methods, apparatuses, and computer program products for automated remote data collection |
| US10033702B2 (en) * | 2015-08-05 | 2018-07-24 | Intralinks, Inc. | Systems and methods of secure data exchange |
-
2018
- 2018-06-26 CN CN201810672854.2A patent/CN110716911B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1525687A (en) * | 2003-02-26 | 2004-09-01 | Network framework and applications for providing notification(s) | |
| CN102592185A (en) * | 2010-10-05 | 2012-07-18 | 埃森哲环球服务有限公司 | Electronic process-driven collaboration system |
| CN104969214A (en) * | 2013-03-12 | 2015-10-07 | 英特尔公司 | Sensor associated data of multiple devices based computing |
| CN105224536A (en) * | 2014-05-29 | 2016-01-06 | 国际商业机器公司 | The method and apparatus of partition database |
| CN106156972A (en) * | 2015-04-21 | 2016-11-23 | 阿里巴巴集团控股有限公司 | Logistics service information providing method and device |
| CN107506356A (en) * | 2016-06-14 | 2017-12-22 | 北京京东尚科信息技术有限公司 | Data processing method and its system |
| CN107766574A (en) * | 2017-11-13 | 2018-03-06 | 天津开心生活科技有限公司 | Data query method and device, date storage method and device |
Non-Patent Citations (1)
| Title |
|---|
| 许凌艳 ; .论联合编目套录数据存在的问题及本地解决对策.河南图书馆学刊.2016,(第02期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110716911A (en) | 2020-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108519967B (en) | Chart visualization method and device, terminal and storage medium | |
| US11755531B1 (en) | System and method for storage of data utilizing a persistent queue | |
| CN111309550A (en) | Data acquisition method, system, equipment and storage medium of application program | |
| CN114518908B (en) | Service orchestration method, medium, device and computing equipment | |
| WO2021129379A1 (en) | Information sharing chain generation method and apparatus, electronic device, and storage medium | |
| US20150213077A1 (en) | Method and system for causing a web application to obtain a database change | |
| WO2023165256A1 (en) | Information generation method and apparatus, and electronic device | |
| CN110704476A (en) | Data processing method, device, equipment and storage medium | |
| CN111949654A (en) | User label-based quick query method and system and electronic equipment | |
| US10585678B2 (en) | Insertion of custom activities in an orchestrated application suite | |
| CN113076729A (en) | Method and system for importing report, readable storage medium and electronic equipment | |
| US11907264B2 (en) | Data processing method, data querying method, and server device | |
| CN105094857B (en) | Method and system for application load | |
| CN110716911B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN107656999B (en) | Call history tracing method and device, electronic equipment and storage medium | |
| US11676345B1 (en) | Automated adaptive workflows in an extended reality environment | |
| CN116594683A (en) | Code annotation information generation method, device, equipment and storage medium | |
| US20200167133A1 (en) | Web service mashup orchestrator | |
| CN116048987A (en) | Processing method, device, electronic equipment, system and storage medium for flow business | |
| CN116069725A (en) | File migration method, device, apparatus, medium and program product | |
| CN110222070B (en) | Report archiving method, report archiving device, report archiving medium and electronic equipment | |
| CN111309932B (en) | Comment data query method, comment data query device, comment data query equipment and storage medium | |
| CN115292313A (en) | Pseudo-column implementation method and device, electronic equipment and storage medium | |
| US11036456B1 (en) | Control of a display device included in a display grid | |
| CN114153438A (en) | API automatic generation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |