CN111488391A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN111488391A CN111488391A CN202010274532.XA CN202010274532A CN111488391A CN 111488391 A CN111488391 A CN 111488391A CN 202010274532 A CN202010274532 A CN 202010274532A CN 111488391 A CN111488391 A CN 111488391A
- Authority
- CN
- China
- Prior art keywords
- database
- data
- data operation
- target database
- statement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
- G06F9/4482—Procedural
Abstract
The application provides a data processing method and a data processing device, wherein the data processing method comprises the following steps: receiving data operation information sent by a front end through an application program interface; wherein the data operation information at least comprises: operating commands, operating parameters and database identification; assembling the data operation information into a general execution statement conforming to a preset format; analyzing the general execution statement by utilizing analysis information corresponding to a preset target database to obtain a data operation statement meeting the format requirement corresponding to the target database; the target database is a database corresponding to the database identifier; and transmitting the data operation statement to the target database to trigger the target database to execute the data operation statement. Thereby, a data processing method is realized which can effectively combine the advantages of relational and non-relational databases.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data processing method and apparatus.
Background
In this era of rapid development of information technology, enormous amounts of data are produced every day. Under the promotion of emerging technologies such as cloud computing, mobility and big data, enterprises are rapidly migrating to the data era in disputes, so that the data is more and more highly managed.
Because the relational database can realize complex associated query, most enterprises in many fields, particularly in banks, insurance and the like in the financial field, select a relational database management system for data management. However, the storage capacity, the horizontal scalability and the vertical data bearable capacity of the data table are limited, the query time can be exponentially increased due to the mass data, and the relational database cannot well cope with the read-write requests of ten thousand times per second. Therefore, in an application scenario with a large data volume and a large access volume, such as a hot webpage and a mobile client, data management is usually performed based on a non-relational database, and the data management has excellent read-write performance, flexible data model and easy expansion, but complex association query cannot be realized.
However, for the data management requirement nowadays, it is required to have both the complex association query function of the relational database and the excellent data read-write performance of the non-relational database, and for an enterprise, it is also impossible to set two management systems at the same time, because this not only is inconvenient for the management and use of data, but also increases the cost. Therefore, how to effectively combine the advantages of the relational database and the non-relational database is important.
Disclosure of Invention
Based on the above deficiencies of the prior art, the present invention provides a data processing method and apparatus, so as to solve the problem of how to effectively combine the advantages of a relational database and a non-relational database.
In order to achieve the purpose, the invention provides the following technical scheme:
a first aspect of the present application provides a data processing method, including:
receiving data operation information sent by a front end through an application program interface; wherein the data operation information at least comprises: operating commands, operating parameters and database identification;
assembling the data operation information into a general execution statement conforming to a preset format;
analyzing the general execution statement by utilizing analysis information corresponding to a preset target database to obtain a data operation statement meeting the format requirement corresponding to the target database; the target database is a database corresponding to the database identifier;
and transmitting the data operation statement to the target database to trigger the target database to execute the data operation statement.
Optionally, in the above data processing method, the transmitting the data operation statement to the target database includes:
and determining a target connection corresponding to the target database from a database connection pool, and transmitting the data operation statement to the target database through the target connection.
Optionally, in the above data processing method, after the transmitting the data operation statement to the target database to trigger the target database to execute the data operation statement, the method further includes:
receiving a data operation result fed back by the target database;
packaging the data operation result into a response message with a uniform format by utilizing the pre-configured result packaging information corresponding to the target database;
and feeding back the response message to the front end through the application program interface.
Optionally, in the data processing method, the method further includes:
acquiring a rack package supporting a newly added database; the shelf packet is used for realizing interaction with the newly added database;
generating a configuration file corresponding to the newly added database, and deploying a plug-in supporting the newly added database; wherein the configuration file includes the parsing information and the result encapsulation information.
Optionally, in the above data processing method, the receiving, by the application program interface, data operation information sent by the front end includes:
receiving data operation information sent by a front end through the called application program interface; the application program interface at least comprises a data query interface, a data adding interface, a data updating interface and a data deleting interface; each of the application program interfaces is used for uniformly receiving data operation information of one data operation type.
A second aspect of the present application provides a data processing apparatus comprising:
the first receiving unit is used for receiving data operation information sent by the front end through an application program interface; wherein the data operation information at least comprises: operating commands, operating parameters and database identification;
the first packaging unit is used for splicing the data operation information into a general execution statement conforming to a preset format;
the analysis unit is used for analyzing the general execution statement by utilizing analysis information corresponding to a preset target database to obtain a data operation statement meeting the format requirement corresponding to the target database; the target database is a database corresponding to the database identifier;
and the transmission unit is used for transmitting the data operation statement to the target database so as to trigger the target database to execute the data operation statement.
Optionally, in the above data processing apparatus, the transmission unit includes:
and the transmission subunit is used for determining a target connection corresponding to the target database from a database connection pool and transmitting the data operation statement to the target database through the target connection.
Optionally, in the data processing apparatus described above, the apparatus further includes:
the second receiving unit is used for receiving the data operation result fed back by the target database;
the second packaging unit is used for packaging the data operation result into a response message with a uniform format by utilizing the result packaging information corresponding to the target database which is configured in advance;
and the feedback unit is used for feeding back the response message to the front end through the application program interface.
Optionally, in the data processing apparatus described above, the apparatus further includes:
the acquisition unit is used for acquiring the rack package supporting the newly added database; the shelf packet is used for realizing interaction with the newly added database;
the generating unit is used for generating a configuration file corresponding to the newly added database and deploying a plug-in supporting the newly added database; wherein the configuration file includes the parsing information and the result encapsulation information.
Optionally, in the data processing apparatus, the first receiving unit includes:
the first receiving subunit is used for receiving the data operation information sent by the front end through the called application program interface; the application program interface at least comprises a data query interface, a data adding interface, a data updating interface and a data deleting interface; each of the application program interfaces is used for uniformly receiving data operation information of one data operation type.
According to the data processing method, the unified application program interface is provided for the front end, the data operation information is received through the unified interface, and then the data operation information is assembled into the general execution statement which accords with the preset format, so that the difference among different databases is shielded for the front end. Wherein, the data operation information at least comprises: an operating command, an operating parameter, and a database identification. And subsequently, taking the database corresponding to the database identifier as a target database, and analyzing the general execution statement by using the preset analysis information corresponding to the target database to obtain the data operation statement meeting the format requirement corresponding to the target database, so that the general execution statement is dynamically analyzed into the data operation statements corresponding to various databases according to different analysis information. And finally, transmitting the data operation statement to the target database to trigger the target database to point to the data operation statement. Therefore, the method for processing data based on multiple databases simultaneously is realized, so that operations such as data access and the like can be performed based on the relational database and the non-relational database simultaneously, and the advantages of the relational database and the non-relational database are effectively combined.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a data processing framework according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a data processing method according to another embodiment of the present application;
fig. 3 is a schematic flowchart illustrating a method for feeding back data operation results according to another embodiment of the present application;
fig. 4 is a flowchart illustrating a method for adding a database according to another embodiment of the present application;
fig. 5 is a schematic structural diagram of a data processing apparatus according to another embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In this application, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The embodiment of the application provides a data processing method, so as to solve the problem of how to effectively combine the advantages of a relational database and a non-relational database.
First, it needs to be noted that, in order to implement the data processing method provided by the present application, an embodiment of the present application provides a data processing framework, as shown in fig. 1, which mainly includes: an interface layer module 101, a base support layer module 102, and a data processing layer module 103.
The interface layer module 101 is mainly used for providing a uniform application program interface to the front end, so as to shield the difference of interfaces of different databases, and a user can conveniently provide uniform format data operation information to realize data processing by calling the application program interface. The unified application program interface mainly comprises four unified application program interfaces, and specifically comprises the following steps: the data processing system comprises a data query interface, a data adding interface, a data updating interface and a data deleting interface.
It should be noted that when each database is used independently, in order to implement the most basic data adding, deleting, modifying and checking, a data query interface, a data adding interface, a data updating interface, and a data deleting interface are provided, but there are differences in the configuration of different types of databases or interfaces of different databases for implementing the same function. Therefore, in order to shield the difference of the interfaces of different databases, the present application aims at the interface for realizing each function respectively, and obtains the configuration information of the same kind of interface of each database to be supported, and encapsulates the configuration information into a uniform application program interface.
The basic support layer module 102 is mainly used for managing a connection pool of relational data and non-relational databases, loading and analyzing configuration files of the databases, providing the analyzed information to the data processing layer module 103 for data processing, and assembling the data operation information into a general execution statement when the front end transfers the data operation information by calling an application program interface, and transmitting the general execution statement to the data processing layer module 103. And the method is also used for caching the data returned by the database, so that the subsequent query efficiency can be provided conveniently.
The data processing layer module 103 is mainly configured to load the parsed information according to the basic support layer module 102, perform data operation on the data operation statements corresponding to the target database in which the data operation is performed for the time of the parsing cost of the general execution statements, and perform parameter assignment on the parsed data operation statements through a parameter configuration function to obtain final data operation statements. And then selecting a corresponding connection of the target database according to the database connection pool of the pipeline of the basic supporting layer module 102, and transmitting the connection to the target database. The database executes the data operation statement in a single piece or in batch, and feeds back the data processing result to the data processing layer module 103, so that the data processing layer module 103 is further configured to encapsulate the data processing result into a response message in a uniform format, and return the corresponding message to the interface layer module 101 to be provided to the front end.
Optionally, since there is already a frame for persisting the relational database, when developing the data processing frame, the support for persisting the relational database may be directly implemented by introducing an object relational mapping frame Hibernate, so that the development efficiency may be improved to a certain extent, and of course, other frames may also be employed.
Based on the data processing framework provided above, another embodiment of the present application provides a data processing method, as shown in fig. 2, including:
s201, receiving data operation information sent by a front end through an application program interface.
Wherein, the data operation information at least comprises: operation command, operation parameter and database identification. Optionally, the operation command includes at least: four commands of data writing, data query, data modification and data deletion. When the operation command is data writing or data modification, the data operation information should also include data in the database to be written.
Optionally, in another embodiment of the present application, a specific implementation method of step S201 specifically includes: and receiving data operation information sent by the front end through the called application program interface.
The application program interfaces at least comprise a data query interface, a data adding interface, a data updating interface and a data deleting interface, and each application program interface is used for uniformly receiving data operation information of one data operation type. The data operation types comprise data query, data addition, data update and data deletion. The database identifier may be a unique identifier configured for each database in advance.
Specifically, in the embodiment of the present application, in order to simultaneously support the addition, deletion, modification and check of multiple relational databases and non-relational databases, the interfaces of different data at the front end are distinguished, and a corresponding application program interface is obtained by uniformly encapsulating, in advance, for one of a data query interface, a data addition interface, a data update interface and a data deletion interface, according to interface configuration information of each database to be supported. And then the data is provided for the front-end to be called through the interface layer module, so that when the front-end responds to the operation of the user, the corresponding application program interface is called to carry out data operation according to the operation of the user.
S202, assembling the data operation information into a general execution statement conforming to a preset format.
Because the data operation information uploaded by the front end is received through the uniform interface, the received data operation information can be automatically assembled into a universal execution statement with a uniform format.
S203, analyzing the general execution statement by using the preset analysis information corresponding to the target database to obtain a data operation statement meeting the format requirement corresponding to the target database, wherein the target database is a database corresponding to the database identifier.
Because the execution statements supported by each database have corresponding format requirements, and parameters and parameter types required by different format requirements are different, the database cannot directly execute the general execution statements, and the general execution statements need to be converted into the execution statements meeting the corresponding requirements of the database.
In the embodiment of the present application, the analysis information corresponding to each database is configured in advance. The analysis information includes parameter configuration requirements of the execution statements meeting the corresponding requirements of the database, mapping relations between the parameters and the parameters in the general execution statements, corresponding relations of type conversion of the parameters, and the like. Therefore, the general execution statement can be dynamically analyzed into the data operation statements of various databases according to different analysis information, so that the advantages of the databases are fully exerted, and the data access performance is improved.
Specifically, when the data processing framework is started, the basic supporting layer module loads and analyzes the configuration file of the execution statement of the database to obtain the analysis information, and provides the analysis information for the data processing layer module to call.
Specifically, after receiving the general execution statement, the data processing layer module determines a database responding to the data operation according to the database identifier, that is, first, the database corresponding to the database identifier is determined as a target database, and then, configuration information corresponding to the target database is called to perform operations such as parameter mapping, parameter format conversion, parameter assignment and the like on the general execution statement, so that the general execution statement is dynamically analyzed into a data operation statement executable by the target database.
It should be noted that, because the format requirements of the execution statements of the databases of the same type are partially the same. For example, many relational databases use structured query languages for data manipulation, so that different databases may correspond to the same parsed information.
And S204, transmitting the data operation statement to the target database to trigger the target database to execute the data operation statement.
After the execution statement is analyzed into the data operation statement, the execution statement is received when the target database is used alone, and at this time, only the data operation statement needs to be transmitted to the target database, and the target database is triggered to execute the data operation statement, so that corresponding data operation is performed in the target database. Optionally, the database may execute the data operation statements individually or in batches.
Optionally, in another embodiment of the present application, one implementation manner of step S204 is specifically: and determining a target connection corresponding to the target database from the database connection pool, and transmitting the data operation statement to the target database through the target connection.
It should be noted that, since the data processing framework supports multiple databases at the same time, the application manages a database connection pool including connections of each database through the basic support layer module. Therefore, the connection of the database can be increased in the basic support layer module. Therefore, the data processing layer module can select the corresponding database connection from the database connection pool provided by the basic support layer module as the target connection, and then transmit the data operation statement to the target database through the target connection.
After the target data executes the data operation statement, a data operation result is returned to the data processing framework. Similarly, the formats of the data operation results fed back by different databases are different, so that the data processing framework needs to return the data operation results through a uniform application program interface, and the data operation results also need to be converted into a uniform format.
Optionally, another embodiment of the present application provides a method for feeding back a data operation result, as shown in fig. 3, including:
s301, receiving a data operation result fed back by the target database.
S302, the data operation result is packaged into a response message with a uniform format by utilizing the result packaging information corresponding to the preset target database.
The result encapsulation information includes, as with the analysis information, the mapping relationship between each result in the data operation results fed back by the database and each structure of the response message in the unified format, the correspondence relationship between the type conversion of the result, and the like, so that the result encapsulation information corresponding to different databases can be utilized to encapsulate the data operation results fed back by different databases into a response message in the unified format.
And when the data processing frame is started, the basic supporting layer module loads and analyzes the configuration file to obtain the analysis information and the result encapsulation information, and provides the analysis information and the result encapsulation information for the data processing layer module to call.
And S303, feeding back the response message to the front end through the application program interface.
It should be noted that, in order to facilitate subsequent data query, in this embodiment of the application, if the response message includes feedback data, the feedback data in the response message is copied and cached, so that if the response message requests to query the feedback data again, the cached feedback data is directly fed back to the front end.
Specifically, if the data operation is a data reading operation, when the data processing layer module feeds back a response message to the interface layer module, the basic support layer module copies the feedback data and performs caching.
It should also be noted that some commonly used relational and non-relational databases may be configured when the data processing framework is initially developed. Of course, the data processing framework provided in the embodiment of the present application also allows a subsequent user to perform an extension of a database to be supported based on the framework.
Optionally, in another embodiment of the present application, a method for adding a database is provided, as shown in fig. 4, specifically including:
s401, acquiring a rack package supporting the newly added database, wherein the rack package is used for realizing interaction with the newly added database.
Specifically, when a new database is added, in order to implement interaction with the new data, it is necessary to obtain a jar packet of the Java programming language supported by the database, so that the jar packet corresponding to the new database needs to be introduced into the data processing framework.
S402, generating a configuration file corresponding to the newly added database, and deploying plug-ins supporting the newly added database, wherein the configuration file comprises analysis information and result packaging information.
In the specific use process, when the execution statement is analyzed into the data operation statement corresponding to the database, the information needs to be analyzed, and when the data operation result is fed back to the front end, the result encapsulation information is needed, so that the configuration file corresponding to the newly added database needs to be generated by the configuration of the corresponding user. And then, deploying plug-ins supporting the newly added database, such as a configuration parser, for parsing the configuration file, thereby implementing the introduction of the newly added database into the data processing framework.
According to the data processing method provided by the embodiment of the application, the unified application program interface is provided for the front end, so that the data operation information is received through the unified interface, and then the data operation information is assembled into the general execution statement which accords with the preset format, so that the difference among the databases is shielded for the front end. Wherein, the data operation information at least comprises: an operating command, an operating parameter, and a database identification. Subsequently, the general execution statement can be analyzed by utilizing the preset analysis information corresponding to the target database to obtain the data operation statement meeting the format requirement corresponding to the target database, so that the general execution statement can be dynamically analyzed into the data operation statements corresponding to various databases according to different analysis information. And finally, transmitting the data operation statement to the target database to trigger the target database to point to the data operation statement. Therefore, the method for processing data based on multiple databases simultaneously is realized, so that operations such as data access and the like can be performed based on the relational database and the non-relational database simultaneously, and the advantages of the relational database and the non-relational database are effectively combined.
Another embodiment of the present application provides a data processing apparatus, as shown in fig. 5, including:
a first receiving unit 501, configured to receive data operation information sent by a front end through an application program interface.
Wherein, the data operation information at least comprises: operation command, operation parameter and database identification.
The first encapsulating unit 502 is configured to assemble the data operation information into a general execution statement conforming to a preset format.
The parsing unit 503 is configured to parse the general execution statement by using the parsing information corresponding to the pre-configured target database, so as to obtain the data operation statement meeting the format requirement corresponding to the target database.
And the target database is a database corresponding to the database identifier.
The transmission unit 504 is configured to transmit the data operation statement to the target database, so as to trigger the target database to execute the data operation statement.
It should be noted that, for the specific working process of the foregoing unit in the embodiment of the present application, reference may be made to step S201 to step S204 in the foregoing method embodiment, which is not described herein again.
Optionally, in a data processing apparatus provided in another embodiment of the present application, the transmission unit 504 includes:
and the transmission subunit is used for determining a target connection corresponding to the target database from the database connection pool and transmitting the data operation statement to the target database through the target connection.
Optionally, in the data processing apparatus provided in another embodiment of the present application, the data processing apparatus may further include:
and the second receiving unit is used for receiving the data operation result fed back by the target database.
And the second packaging unit is used for packaging the data operation result into a response message in a uniform format by using result packaging information corresponding to a preset target database.
And the feedback unit is used for feeding back the response message to the front end through the application program interface.
It should be noted that, for the specific working process of the foregoing unit in the embodiment of the present application, reference may be made to step S301 to step S303 in the foregoing method embodiment, which is not described herein again.
Optionally, in the data processing apparatus provided in another embodiment of the present application, the data processing apparatus may further include:
and the acquisition unit is used for acquiring the rack package supporting the newly added database.
Wherein, the shelf packet is used for realizing the interaction with the newly added database.
And the generating unit is used for generating a configuration file corresponding to the newly added database and deploying a plug-in supporting the newly added database.
The configuration file comprises analysis information and result packaging information.
It should be noted that, for the specific working process of the foregoing unit in the embodiment of the present application, reference may be made to step S401 to step S402 in the foregoing method embodiment, which is not described herein again.
Optionally, in a data processing apparatus provided in another embodiment of the present application, the first receiving unit 501 includes:
and the first receiving subunit is used for receiving the data operation information sent by the front end through the called application program interface.
The application program interface at least comprises a data query interface, a data adding interface, a data updating interface and a data deleting interface. Each application program interface is used for uniformly receiving data operation information of one data operation type.
According to the data processing device, the first receiving unit receives the data operation information through the unified application program interface, and then the first packaging unit assembles the data operation information into the general execution statements conforming to the preset format, so that differences among different databases are shielded for the front end. Wherein, the data operation information at least comprises: an operating command, an operating parameter, and a database identification. And subsequently, taking the database corresponding to the database identifier as a target database, and analyzing the general execution statement by using the preset analysis information corresponding to the target database by the analysis unit to obtain the data operation statement meeting the format requirement corresponding to the target database, so that the general execution statement is dynamically analyzed into the data operation statements corresponding to various databases according to different analysis information. And finally, the transmission unit transmits the data operation statement to the target database so as to trigger the target database to point to the data operation statement. Therefore, the method for processing data based on multiple databases simultaneously is realized, so that operations such as data access and the like can be performed based on the relational database and the non-relational database simultaneously, and the advantages of the relational database and the non-relational database are effectively combined.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A data processing method, comprising:
receiving data operation information sent by a front end through an application program interface; wherein the data operation information at least comprises: operating commands, operating parameters and database identification;
assembling the data operation information into a general execution statement conforming to a preset format;
analyzing the general execution statement by utilizing analysis information corresponding to a preset target database to obtain a data operation statement meeting the format requirement corresponding to the target database; the target database is a database corresponding to the database identifier;
and transmitting the data operation statement to the target database to trigger the target database to execute the data operation statement.
2. The method of claim 1, wherein the transmitting the data manipulation statement to the target database comprises:
and determining a target connection corresponding to the target database from a database connection pool, and transmitting the data operation statement to the target database through the target connection.
3. The method of claim 1, wherein after transmitting the data operation statement to the target database to trigger the target database to execute the data operation statement, further comprising:
receiving a data operation result fed back by the target database;
packaging the data operation result into a response message with a uniform format by utilizing the pre-configured result packaging information corresponding to the target database;
and feeding back the response message to the front end through the application program interface.
4. The method of claim 3, further comprising:
acquiring a rack package supporting a newly added database; the shelf packet is used for realizing interaction with the newly added database;
generating a configuration file corresponding to the newly added database, and deploying a plug-in supporting the newly added database; wherein the configuration file includes the parsing information and the result encapsulation information.
5. The method of claim 1, wherein receiving the data manipulation information sent by the front end through the application program interface comprises:
receiving data operation information sent by a front end through the called application program interface; the application program interface at least comprises a data query interface, a data adding interface, a data updating interface and a data deleting interface; each of the application program interfaces is used for uniformly receiving data operation information of one data operation type.
6. A data processing apparatus, comprising:
the first receiving unit is used for receiving data operation information sent by the front end through an application program interface; wherein the data operation information at least comprises: operating commands, operating parameters and database identification;
the first packaging unit is used for splicing the data operation information into a general execution statement conforming to a preset format;
the analysis unit is used for analyzing the general execution statement by utilizing analysis information corresponding to a preset target database to obtain a data operation statement meeting the format requirement corresponding to the target database; the target database is a database corresponding to the database identifier;
and the transmission unit is used for transmitting the data operation statement to the target database so as to trigger the target database to execute the data operation statement.
7. The apparatus of claim 6, wherein the transmission unit comprises:
and the transmission subunit is used for determining a target connection corresponding to the target database from a database connection pool and transmitting the data operation statement to the target database through the target connection.
8. The apparatus of claim 6, further comprising:
the second receiving unit is used for receiving the data operation result fed back by the target database;
the second packaging unit is used for packaging the data operation result into a response message with a uniform format by utilizing the result packaging information corresponding to the target database which is configured in advance;
and the feedback unit is used for feeding back the response message to the front end through the application program interface.
9. The apparatus of claim 8, further comprising:
the acquisition unit is used for acquiring the rack package supporting the newly added database; the shelf packet is used for realizing interaction with the newly added database;
the generating unit is used for generating a configuration file corresponding to the newly added database and deploying a plug-in supporting the newly added database; wherein the configuration file includes the parsing information and the result encapsulation information.
10. The apparatus of claim 6, wherein the first receiving unit comprises:
the first receiving subunit is used for receiving the data operation information sent by the front end through the called application program interface; the application program interface at least comprises a data query interface, a data adding interface, a data updating interface and a data deleting interface; each of the application program interfaces is used for uniformly receiving data operation information of one data operation type.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010274532.XA CN111488391A (en) | 2020-04-09 | 2020-04-09 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010274532.XA CN111488391A (en) | 2020-04-09 | 2020-04-09 | Data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111488391A true CN111488391A (en) | 2020-08-04 |
Family
ID=71798744
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010274532.XA Pending CN111488391A (en) | 2020-04-09 | 2020-04-09 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111488391A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112818049A (en) * | 2021-01-28 | 2021-05-18 | 中国人寿保险股份有限公司上海数据中心 | Full link analysis system and method for information system performance |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6226649B1 (en) * | 1997-06-23 | 2001-05-01 | Oracle Corporation | Apparatus and method for transparent access of foreign databases in a heterogeneous database system |
| CN101158975A (en) * | 2007-11-21 | 2008-04-09 | 金蝶软件（中国）有限公司 | Method and system for accessing distinct type data-base |
| CN103823815A (en) * | 2012-11-19 | 2014-05-28 | 中国联合网络通信集团有限公司 | Server and database access method |
| CN104573115A (en) * | 2015-02-04 | 2015-04-29 | 新余兴邦信息产业有限公司 | Method and system for achieving integration interface supporting operation of multi-type databases |
| CN106897467A (en) * | 2017-04-24 | 2017-06-27 | 成都四方伟业软件股份有限公司 | A kind of database adaptation method of big data analysis engine |
| CN107798026A (en) * | 2016-09-05 | 2018-03-13 | 北京京东尚科信息技术有限公司 | Data query method and apparatus |
| CN109766352A (en) * | 2018-11-19 | 2019-05-17 | 成都四方伟业软件股份有限公司 | The method and system that a kind of pair of heterogeneous data source is uniformly processed |
-
2020
- 2020-04-09 CN CN202010274532.XA patent/CN111488391A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6226649B1 (en) * | 1997-06-23 | 2001-05-01 | Oracle Corporation | Apparatus and method for transparent access of foreign databases in a heterogeneous database system |
| CN101158975A (en) * | 2007-11-21 | 2008-04-09 | 金蝶软件（中国）有限公司 | Method and system for accessing distinct type data-base |
| CN103823815A (en) * | 2012-11-19 | 2014-05-28 | 中国联合网络通信集团有限公司 | Server and database access method |
| CN104573115A (en) * | 2015-02-04 | 2015-04-29 | 新余兴邦信息产业有限公司 | Method and system for achieving integration interface supporting operation of multi-type databases |
| CN107798026A (en) * | 2016-09-05 | 2018-03-13 | 北京京东尚科信息技术有限公司 | Data query method and apparatus |
| CN106897467A (en) * | 2017-04-24 | 2017-06-27 | 成都四方伟业软件股份有限公司 | A kind of database adaptation method of big data analysis engine |
| CN109766352A (en) * | 2018-11-19 | 2019-05-17 | 成都四方伟业软件股份有限公司 | The method and system that a kind of pair of heterogeneous data source is uniformly processed |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112818049A (en) * | 2021-01-28 | 2021-05-18 | 中国人寿保险股份有限公司上海数据中心 | Full link analysis system and method for information system performance |
| CN112818049B (en) * | 2021-01-28 | 2024-04-16 | 中国人寿保险股份有限公司上海数据中心 | Information system performance full-link analysis system and method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108037961B (en) | Application program configuration method, device, server and storage medium | |
| CN109840429B (en) | Intelligent contract deployment and calling method and device | |
| CN110069572B (en) | HIVE task scheduling method, device, equipment and storage medium based on big data platform | |
| US5327559A (en) | Remote and batch processing in an object oriented programming system | |
| CN110324169B (en) | Interface management method and device | |
| CN109032631B (en) | Application program patch package obtaining method and device, computer equipment and storage medium | |
| CN109240697B (en) | Call processing method and device and storage medium | |
| WO2020238597A1 (en) | Hadoop-based data updating method, device, system and medium | |
| CN111414350A (en) | Service generation method and device | |
| CN111949693A (en) | Data processing device, data processing method, storage medium and electronic equipment | |
| CN113641700A (en) | Data processing method and device based on Spring boot frame | |
| EP2904520B1 (en) | Reference data segmentation from single to multiple tables | |
| CN110221840B (en) | Function implementation method and device of application program, equipment and storage medium | |
| CN111488391A (en) | Data processing method and device | |
| CN113467972A (en) | Communication interface construction method, communication interface construction device, computer equipment and storage medium | |
| CN110457013B (en) | Program component configuration device and method | |
| CN110620819A (en) | Block chain interaction method and device, computer equipment and readable storage medium | |
| CN112346774A (en) | Method and device for generating application installation package | |
| CN113094429B (en) | Data processing method, data query method, computer device and storage medium | |
| CN113779122B (en) | Method and device for exporting data | |
| CN114968192A (en) | Project creation method and device, computer equipment and storage medium | |
| CN112182083A (en) | File generation method, device, equipment and storage medium | |
| WO2021243665A1 (en) | Compilation method, compilation apparatus, compilation system, storage medium, and electronic device | |
| CN114840574A (en) | Data query method, server, node and storage medium | |
| CN113239014A (en) | Management device and application system for maintaining SQL records |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |