WO2020155760A1

WO2020155760A1 - Multi-database data processing method, apparatus, computer device, and storage medium

Info

Publication number: WO2020155760A1
Application number: PCT/CN2019/117704
Authority: WO
Inventors: 王保军
Original assignee: 平安科技（深圳）有限公司
Priority date: 2019-01-28
Filing date: 2019-11-12
Publication date: 2020-08-06
Also published as: CN109947789A; CN109947789B

Abstract

Provided are a multi-database data processing method, apparatus, computer device, and storage medium, belonging to the technical field of artificial intelligence, said method comprising: receiving a task request instruction inputted by a user (201); determining the type of task receive instruction (202); if the type of the task request instruction is a data export instruction type, then obtaining export configuration information inputted by the user (203); according to the export configuration information, querying and exporting from a designated target database the data to be exported (204). When exporting data by means of the method, connection is made, according to the export configuration information, to different databases for data export, thus replacing the dependence of different databases on different clients.

Description

Method, device, computer equipment and storage medium for data processing of multiple databases

This application is based on the Chinese invention patent application filed on January 28, 2019 with the application number 201910082614.1, titled "Multi-database data processing method, device, computer equipment and storage medium", and claims its priority.

Technical field

This application relates to the field of artificial intelligence technology, and in particular to a method, device, computer equipment and storage medium for data processing of multiple databases.

Background technique

Database is an important foundation of information resource management in modern society. For the convenience of data management and viewing, it is often necessary to export the data in the database to files in other formats. Due to the variety of database products on the market, different database products correspond to different data sources. The inventor realizes that collecting data from a data source is directly connected to the database to execute the results. Different databases depend on different clients, which requires users to install different clients on the terminal corresponding to different databases, which not only occupies terminal resources, but also is inconvenient to operate.

Summary of the invention

The purpose of the embodiments of the present application is to propose a method, device, computer equipment and storage medium for data processing of multiple databases, so as to overcome the inconvenient operation of terminal resources caused by the need to install different clients for different databases in the prior art problem.

In order to solve the above technical problems, an embodiment of the present application provides a method for data processing in multiple databases, which adopts the following technical solutions:

Receiving the task request instruction entered by the user;

Determine the type of the task received instruction;

When the type of the task request instruction is a data export instruction type, acquiring export configuration information input by the user, the export configuration information including target database information and query language;

Query and export the data to be exported from the specified target database according to the export configuration information, including:

Accessing the target database according to the target database information;

Generating executable sentences supported by the target database according to the query language;

Use the executable sentence to query the data to be exported from the target database;

Export the queried data from the target database.

In order to solve the above technical problems, an embodiment of the present application also provides a multi-database data processing device, including:

The configuration information module is used to obtain the export configuration information input by the user when the type of the task request instruction is the data export instruction type;

Data export module; query and export the data to be exported from the designated target database according to the export configuration information.

In order to solve the above technical problems, the embodiments of the present application also provide a computer device, which adopts the following technical solutions:

It includes a memory and a processor, and the memory stores computer readable instructions. When the processor executes the computer readable instructions, the steps of the above-mentioned multi-database data processing method are realized.

In order to solve the foregoing technical problems, the embodiments of the present application further provide one or more non-volatile readable storage media, and adopt the following technical solutions:

The non-volatile readable storage medium stores computer readable instructions, and when the computer readable instructions are executed by a processor, the steps of the above-mentioned multi-database data processing method are realized.

The details of one or more embodiments of the present application are presented in the following drawings and descriptions, and other features and advantages of the present application will become apparent from the description, drawings and claims.

Description of the drawings

In order to explain the solution in this application more clearly, the following will briefly introduce the drawings used in the description of the embodiments of the application. Obviously, the drawings in the following description are some embodiments of the application. Ordinary technical personnel can obtain other drawings based on these drawings without creative work.

Figure 1 is an exemplary system architecture diagram to which this application can be applied;

Fig. 2 is a flowchart of an embodiment of a method for data processing of multiple databases according to the present application;

Fig. 3 is a schematic structural diagram of an embodiment of a multi-database data processing device according to the present application;

Fig. 4 is a schematic structural diagram of an embodiment of a computer device according to the present application.

Reference signs:

detailed description

Unless otherwise defined, all technical and scientific terms used herein have the same meanings as commonly understood by those skilled in the technical field of the application; the terms used in the specification of the application herein are only for describing specific embodiments. The purpose is not to limit the application; the terms "including" and "having" in the description and claims of the application and the above-mentioned description of the drawings and any variations thereof are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of the application or the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific sequence.

Reference to "embodiments" herein means that a specific feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art clearly and implicitly understand that the embodiments described herein can be combined with other embodiments.

In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings.

As shown in FIG. 1, the system architecture 100 may include

terminal devices

101, 102, 103, a network 104, and a server 105. The network 104 is used to provide a medium for communication links between the

terminal devices

101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables.

The user can use the

terminal devices

101, 102, 103 to interact with the server 105 through the network 104 to receive or send messages, and so on. Various communication client applications, such as web browser applications, shopping applications, search applications, instant messaging tools, email clients, and social platform software, may be installed on the

terminal devices

101, 102, and 103.

The

terminal devices

101, 102, 103 may be various electronic devices with a display screen and supporting web browsing, including but not limited to smart phones, tablets, e-book readers, MP3 players (Moving Picture E data processing group Audio Layer III, Motion Picture Expert compresses standard audio layer 3), MP4 (Moving Picture E data processing group Audio Layer IV, Motion Picture Expert compresses standard audio layer 4) Players, laptop portable computers and desktop computers, etc.

The server 105 may be a server that provides various services, for example, a background server that provides support for the pages displayed on the

terminal devices

101, 102, and 103.

It should be noted that the multi-database data processing method provided in the embodiments of the present application is generally executed by a server/terminal device. Accordingly, the data processing device is generally set in the server/terminal device.

It should be understood that the numbers of terminal devices, networks, and servers in FIG. 1 are merely illustrative. According to implementation needs, there can be any number of terminal devices, networks and servers.

Continuing to refer to FIG. 2, there is shown a flowchart of an embodiment of a method for data processing of multiple databases according to the present application. The multi-database data processing method includes the following steps:

Step 201: Receive a task request instruction input by a user;

Step 202: Determine the type of the task receiving instruction, if the type of the task request instruction is a data export instruction type, execute step 203, and if the type of the task receiving instruction is a text data classification instruction, execute step 205;

Step 203: Obtain the export configuration information input by the user;

Step 204: Query and export the data to be exported from the specified target database according to the export configuration information;

Step 205: Acquire text classification configuration information input by the user;

Step 206: Extract the text to be classified and the text of the classification template from the specified target database according to the text classification configuration information;

Step 207: Classify the information in the text to be classified according to the keywords of the classification template text.

In order to describe this embodiment in more detail, the data export and text classification are respectively described in detail below.

The following is a description of the data export process.

In this embodiment, the export configuration information includes target database information and a query language, and the step 204 of querying and exporting data to be exported from a specified target database according to the export configuration information specifically includes:

Accessing the target database according to the target database information;

Export the queried data from the target database.

In practical applications, since commonly used databases such as MySQL, SQL Server, Oracle, and Sybase all support Structured Query Language (SQL), if the target database is the above-mentioned databases, SQL can be used directly for query information Language writing, you can also directly write the filtering conditions of the exported data, and then generate executable statements according to the type of the target database.

In practical applications, you can also start the export monitoring timer, obtain the data export progress through the export monitoring timer, and display the data export progress to the user in real time.

In practical applications, the query language can also be used for verification. If the verification is passed, the database executable statement is generated according to the query language, and if the verification fails, an error message is returned and the operation is ended.

In this embodiment, the target database information further includes the address of the target database and user registration information in the target database. The step 2041, the step of accessing the target database according to the target database information specifically includes:

Determining the path of the target database according to the address;

Sending an access request to the target database to which the access request carries the registration information, so that the target database can verify the registration information;

It is determined whether the verification passed message returned by the target database is received, and if so, the step of using the executable sentence to query the target database for data that needs to be exported is executed.

In this embodiment, the electronic device (such as the terminal device shown in FIG. 1) on which the multi-database data processing method runs can send an access request to the database provided on the server through a wired connection or a wireless connection. It should be pointed out that the above-mentioned wireless connection methods can include but are not limited to 3G/4G connection, WiFi connection, Bluetooth connection, WiMA data processing connection, Zigbee connection, UWB (ultra wideband) connection, and other currently known or future development Wireless connection method.

In actual applications, when verifying based on the address of the database and the user's registration information in the database, the verification can pass only when a connection is established with the database and the database confirms that the registration information is verified correctly. Specifically, when performing connection verification based on the database address in the configuration information, a connection establishment request will be sent to the database, and the request will carry verification information, such as a user name and password. When the database receives the request, it obtains the carried verification information for verification. Only after the verification is passed, the request is received and the connection is established, otherwise the request will be rejected.

In practical applications, if the database is an open database, that is, no verification information is required, as long as a connection is established with the database, the verification can be considered as passed. In this scenario, the related registration information in the configuration information can be empty.

In this embodiment, the configuration information further includes the format information of the exported text and the storage path of the exported text. The specific steps of exporting the queried data from the target database include:

Generate an intermediate result file from the queried data;

Converting the format of the intermediate result file into a specified format file according to the format information;

The file in the specified format is stored in the storage path.

In practical applications, the conversion format converter supported by the multi-database data processing device can be preset, and when the step of converting the format of the intermediate result file into a specified format file according to the format information is executed, the specified format file is directly called The converter performs format conversion.

In practical applications, after the intermediate result file is generated, the intermediate result file can be preprocessed once, and then converted into a specified format file.

Preprocessing includes:

(1) Capture field null values for non-empty processing, which includes loading or replacing with other meaning data;

(2) Replace invalid data and missing data;

(3) Standardize the data format, use the field format constraint definition, customize the export format for data with various formats in the data source, and the data with various formats include time, value, and characters;

(4) Split fields according to business requirements;

(5) Set separators, including row separators, column separators, field brackets, escape characters, etc.

Through preprocessing, it is possible to clean and process the read data that may be wrong or inconsistent, and improve the accuracy and efficiency of conversion.

In actual applications, before executing the step of querying the data to be exported from the target database by using the executable statement, the following processing may also be performed:

Calculate the total data volume of the data that needs to be exported, store the total data volume in the memory, and feed it back to the export monitoring timer. Further, if the storage space of the specified export data storage location is less than the total amount of data that needs to be exported For the occupied space, you can also feedback the lack of storage space in the user interaction interface and prompt the user to change the designated storage location.

When performing the step of storing the file in the specified format in the storage path, the amount of data that has been exported can also be calculated, and the amount of data that has been exported can be updated to the memory, and fed back to the export monitoring timer, so that Export monitoring timer to obtain data export progress.

In this embodiment, the step of obtaining the export configuration information input by the user specifically includes:

Display a data export configuration interface, which provides a user with an input window for data export configuration information;

The input information of the user on the data export configuration interface is extracted, and the input information is the export configuration information.

In actual applications, different configuration interfaces can be set in the user interface according to different tasks. For example, when a user inputs a data export instruction, a data export configuration interface is provided for the user, which can provide the user with an input window for data export configuration information; When the user inputs a document data classification instruction, the user is provided with a data document data classification configuration interface, which can provide the user with an input window for configuration information.

In actual applications, specifically, export configuration information includes but is not limited to the following types of information:

1. The target database information of the data to be exported, such as database address, database type, etc.;

2. The user's registration information in the target database, such as user name, password, etc.;

3. Export data query information. Through the query information, you can know the data information that needs to be exported (such as the location of the data in the data source or the data filter conditions);

4. Query language, such as structured query language;

5. Data export format information of exported data, such as CSV, EXECL, etc.;

6. The type of chart analysis for the exported data. This information can be used to confirm whether chart analysis is required for the exported data and what type of icon analysis is used;

7. The file storage location of the exported data.

If the export configuration data also includes export data chart analysis, after the step 341 generates an intermediate result file from the queried data, the method further includes:

Generate and export chart files according to chart analysis types and exported data.

Specifically, perform icon analysis on the data, and analyze the data in the x dimension (x axis) and y dimension (y axis). For example, if the exported data involves a student, name, test time, and test score, you can The student’s test data is generated with the x-axis as the time axis and the y-axis as the score axis. It is also possible to generate a circular percentage distribution chart, for example, the number of test scores above 90 points accounted for the percentage of all scores, and the number of test scores above 80 points accounted for the percentage of all scores.

Of course, other types of analysis charts can also be generated.

In some optional implementation manners of this embodiment, after judging the type of the task receiving instruction and before obtaining the export configuration information input by the user, the above-mentioned electronic device may also perform the following steps:

Write its corresponding export task into the task queue according to the task request instruction.

In practical applications, after the export platform obtains the task request from the business system, it can return task response information, which can carry task identification, etc., so that subsequent users can query the export platform for the execution status of the task based on the task identification, that is, understand the task status Progress status, and when the task is determined to be completed, obtain the exported result file.

After receiving the task request, the task request can be added to the task list and loaded. When the task is successfully loaded, it becomes an executable task. The task may be in one of the following states.

PREP: Indicates that the task is loaded. The task is in the PREP state when it is just loaded.

RUNNING: indicates that the task is being executed, and the task in the PREP state is in the RUNNING state after being started.

SUSPENDED means that the task is suspended. The task in the RUNNING state is in the SUSPENDED state after being suspended by the user, and the SUSPENDED state can return to the RUNNING state.

SUCCEEDED: Indicates that the task is executed successfully, and the task in the RUNNING state will be in the SUCCEEDED state after the successful execution.

KILLED: Indicates that the task is stopped. The task in the PREP state is in the KILLED state after being deleted. The tasks in the RUNNING state and the SUSPENDED state are also in the KILLED state after being stopped by the user. The stopped task can be executed in the RUNNING state again.

FAILED: Indicates that the task execution failed, and the task in the RUNNING state is in the FAILED state after the execution fails.

When executing list tasks, the tasks in the queue can be executed in a synchronous scheduling or asynchronous scheduling manner.

Specifically, synchronous scheduling is scheduling according to the order in the task list, that is, the tasks at the back end of the list team need to wait for the tasks at the front end of the list queue to be executed before being scheduled, and the tasks are executed according to the first-in first-out principle. Asynchronous scheduling can execute multiple different tasks concurrently without affecting each other. Each task can start a separate thread for processing. It can process multiple data sets for multiple users and multiple tasks at the same time, greatly improving Concurrent processing capabilities are improved, and task processing efficiency is improved.

In actual applications, if there are multiple export tasks in the task list, after executing the step of generating an intermediate result file from the queried data, you can also perform the following processing steps:

Determine whether other export tasks in the task list are related to the currently executed export task;

If associated, load the data content of the intermediate result file of the currently executing export task into the intermediate result file of the associated export task, and convert the format of the intermediate result file into a specified format file according to the format information;

Otherwise, directly convert the format of the intermediate result file into a specified format file according to the format information.

In this embodiment, the data content of the intermediate result files of each export task can be analyzed, and the data content can be judged by whether the data content is related. For example, the intermediate result files of export task 1 and export task 2 can be analyzed. The derived data is the parameter data of a certain product, and the data content of the derived task 2 is the data of the customer who purchased the product, that is, if there are the same keywords (both related to the same product) between the two, then the two tasks can be considered as related.

In this embodiment, if the intermediate data generated by the currently executed export task is an intermediate result file associated with other export tasks in the task, the data of the generated intermediate result file is loaded into the associated file according to the agreed data format. In the data frame of the intermediate result file of the export task, the data format after integration is kept consistent.

In actual applications, if there are multiple export tasks, and these export tasks are not related, the intermediate result file of each export task needs to be converted into a specified format file separately, so that multiple final export result files are obtained. When outputting the export results, you can query the user whether to pack and compress multiple export result files, and then directly output multiple export result files or pack and compress multiple export result files according to the instructions input by the user.

The following is a description of the text classification process.

In this embodiment, the text classification configuration information includes text information to be classified and text information of a classification template. In step 207, the information in the text to be classified is classified according to the keywords of the text of the classification template. The specific steps of the class include:

Extract classification keywords from the classification template document;

Searching in the data content of the documents to be classified according to the classification keywords;

The retrieved content is respectively filled into the positions specified by the corresponding classification keywords in the classification template document.

Take, for example, classifying the word document of the word version of job resume as an excel version of job resume. In practical applications, the format used in the job search report provided by each job applicant may be different. In order to facilitate management and reading, recruiters may wish to unify the job search establishment of all job seekers into the internal excel version of the job search template. This requires extracting all the data content in the Word version document for analysis and classification.

The data content in the word version of the document can include: capital personal information (such as name, gender, age, photos, etc.), education status (such as from high school to the highest degree, majors learned, qualification certificates obtained, and the learning process Participated in scientific research projects), work experience (such as work experience from the first job to the present), etc.

Categorized keywords in Excel documents can include: personal data keywords (name, gender, age, photo), education keywords (school, major, degree), qualification certificate keywords (qualification certificate, title), work experience Keywords (company name, research project name), etc.

Take the name in the personal data keywords in the classification document as an example. After the word "name" is retrieved in the document to be classified, the characters after the "name" are analyzed to retrieve the name.

In one case, the name contained in the document can be judged according to the filling habits of personal information. The few characters after the name are the name. After the name, in order to distinguish it from other content, a space or comma is usually added after the name or in the name. Add underscores, etc., so the analysis can be based on format and symbols.

In another case, it can be judged based on the pre-stored surnames and common names. For example, save Baijia surnames in advance. When characters similar to surnames appear, judge whether the characters after the surnames are included in the set of commonly used names. It can be judged as a name for extraction.

In practical applications, the retrieval methods for different keywords can be different. For example, the extraction of "date" is different from the extraction of "name", which can be extracted according to the writing format of the date.

Since the classification template document is an excel template, the retrieved content is filled in the cell corresponding to the keyword.

In this embodiment, the step of obtaining the text classification configuration information input by the user in step 205 specifically includes:

Displaying a text classification configuration interface, the text classification configuration interface provides a user with an input window for text classification configuration information;

Extract the input information of the user on the text classification configuration interface, and the input information is the text classification configuration information.

Specifically, the text classification configuration information includes but is not limited to the following information:

The storage path of the document to be classified that needs to be classified;

The storage path of the classification template document;

The new document name and storage path.

In some optional implementation manners, after the information in the text to be classified is classified according to the keywords of the classification template text in step 207, the above electronic device may perform the following steps:

According to the new document name and storage path information of the text categorization configuration information, the categorization template document is renamed and saved to the path specified by the user.

In the multi-database data processing method of this embodiment, when exporting data, connect to different databases according to the export configuration information for data export, replacing the dependence of different databases on different clients, and when categorizing text data, according to The text classification configuration information reads the text to be classified and the text of the classification template, and realizes the export of files in different formats.

A person of ordinary skill in the art can understand that all or part of the processes in the methods of the foregoing embodiments can be implemented by instructing relevant hardware through computer-readable instructions, which can be stored in a non-volatile readable storage. In the medium, when the readable instruction is executed, it may include the processes of the above-mentioned method embodiments. Among them, the aforementioned storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

It should be understood that although the various steps in the flowchart of the drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless explicitly stated in this article, the execution of these steps is not strictly limited in order, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the drawings may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the order of execution is also It is not necessarily performed sequentially, but may be performed alternately or alternately with other steps or at least a part of sub-steps or stages of other steps.

With further reference to FIG. 3, as an implementation of the method shown in FIG. 2, this application provides an embodiment of a multi-database data processing device. The device embodiment corresponds to the method embodiment shown in FIG. The device can be applied to various electronic devices.

As shown in FIG. 3, the multi-database data processing device 300 in this embodiment includes: a receiving module 301, a judgment module 302, a configuration information acquisition module 303, a data export module 304, and a text data classification module 305, in which:

The receiving module 301 receives the task request instruction input by the user,

The judging module 302 is used to judge the type of the task receiving instruction;

The configuration information obtaining module 303 is configured to obtain the export configuration information input by the user when the type of the task request instruction is the data export instruction type;

Data export module 304; query and export the data to be exported from the specified target database according to the export configuration information;

The configuration information acquisition module 303 is also used for the task receiving instruction type is a text data classification instruction type, to acquire the text classification configuration information input by the user;

The text data classification module 305 is configured to extract the text to be classified and the text of a classification template from a specified target database according to the text classification configuration information, and to use the information in the text to be classified according to the text of the classification template Of keywords are classified.

In this embodiment, the export configuration information includes target database information and query language, and the data export module 304 further includes the following submodules:

The database access sub-module is used to access the target database according to the target database information;

The execution statement generation sub-module is used to generate executable statements supported by the target database according to the query language;

The query sub-module is used to query the data that needs to be exported from the target database by using the executable sentence;

The export submodule is used to export the queried data from the target database.

In this embodiment, the target database information further includes the address of the target database and user registration information in the target database, and the database access submodule is further used to determine the path of the target database according to the address Sending an access request to the target database to which the access request carries the registration information, so that the target database can verify the registration information.

The execution sentence generation submodule is further configured to execute the use of the executable sentence to query the target database for data that needs to be exported after the receiving module 301 receives the verification message returned by the database.

In this embodiment, the configuration information further includes the format information of the exported text and the storage path of the exported text. The export sub-module is also used to generate an intermediate result file from the queried data, and convert all the files according to the format information. The format of the intermediate result file is converted into a specified format file, and the specified format file is stored in the storage path.

In this embodiment, the configuration information obtaining module 303 further includes the following sub-modules:

The display sub-module is used to display a data export configuration interface, which provides a user with an input window for data export configuration information;

The information extraction sub-module is used to extract the input information of the user on the data export configuration interface, and the input information is the export configuration information.

In this embodiment, the text data classification module 305 further includes the following submodules:

The keyword extraction sub-module is used to extract the classification keywords from the classification template document;

The retrieval sub-module is used to retrieve the data content of the documents to be classified according to the classification keywords;

The classification sub-module is used to respectively fill the retrieved content into the positions specified by the corresponding classification keywords in the classification template document.

In this embodiment, when the instruction is a text data classification instruction type, the display sub-module of the configuration information acquisition module 303 is also used to display a text classification configuration interface. The text classification configuration interface provides users with text classification information. Input window for configuration information;

The information extraction sub-module of the configuration information acquisition module 303 is also used to extract input information of the user on the text classification configuration interface, and the input information is the text classification configuration information.

To solve the above technical problems, the embodiments of the present application also provide computer equipment. Please refer to FIG. 4 for details. FIG. 4 is a block diagram of the basic structure of the computer device in this embodiment.

The computer device 4 includes a memory 41, a processor 42, and a network interface 43 that are connected to each other in communication through a system bus. It should be pointed out that the figure only shows the computer device 4 with the components 41-43, but it should be understood that it is not required to implement all the shown components, and more or fewer components may be implemented instead. Among them, those skilled in the art can understand that the computer device here is a device that can automatically perform numerical calculation and/or information processing in accordance with pre-set or stored instructions. Its hardware includes, but is not limited to, a microprocessor, a dedicated Integrated Circuit (Application Specific Integrated Circuit, ASIC), Programmable Gate Array (Field-Programmable Gate Array, FPGA), Digital Processor (Digital Signal Processor, DSP), embedded equipment, etc.

The computer device may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server. The computer device can interact with the user through a keyboard, a mouse, a remote control, a touch panel, or a voice control device.

The memory 41 includes at least one type of readable storage medium. The readable storage medium includes flash memory, hard disk, multimedia card, card type memory (for example, SD or D data processing memory, etc.), random access memory (RAM ), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disks, optical disks, etc. In some embodiments, the memory 41 may be an internal storage unit of the computer device 4, such as a hard disk or memory of the computer device 4. In other embodiments, the memory 41 may also be an external storage device of the computer device 4, for example, a plug-in hard disk equipped on the computer device 4, a smart media card (SMC), a secure digital (Secure Digital, SD) card, Flash Card, etc. Of course, the memory 41 may also include both the internal storage unit of the computer device 4 and its external storage device. In this embodiment, the memory 41 is generally used to store an operating system and various application software installed in the computer device 4, such as computer readable instructions of a data processing method for multiple databases. In addition, the memory 41 can also be used to temporarily store various types of data that have been output or will be output.

In some embodiments, the processor 42 may be a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, a microprocessor, or other data processing chips. The processor 42 is generally used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is configured to run computer-readable instructions or process data stored in the memory 41, for example, run the computer-readable instructions of the multi-database data processing method.

The network interface 43 may include a wireless network interface or a wired network interface, and the network interface 43 is generally used to establish a communication connection between the computer device 4 and other electronic devices.

The present application also provides another implementation manner, that is, one or more non-volatile readable storage media are provided, and the non-volatile readable storage medium stores readable instructions for data processing. The readable instructions can be executed by at least one processor, so that the at least one processor executes the steps of the method for data processing of multiple databases as described above.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, hardware can also be used, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, The optical disc) includes several instructions to make a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present application.

Obviously, the embodiments described above are only a part of the embodiments of the present application, rather than all of the embodiments. The drawings show the preferred embodiments of the present application, but do not limit the patent scope of the present application. This application can be implemented in many different forms. On the contrary, the purpose of providing these examples is to make the understanding of the disclosure of this application more thorough and comprehensive. Although the application has been described in detail with reference to the foregoing embodiments, for those skilled in the art, it is still possible for those skilled in the art to modify the technical solutions described in the foregoing specific embodiments, or equivalently replace some of the technical features. . All equivalent structures made by using the contents of the description and drawings of this application, directly or indirectly used in other related technical fields, are similarly within the scope of patent protection of this application.

Claims

A method for data processing in multiple databases is characterized in that it comprises the following steps:

Receiving the task request instruction entered by the user;

Determine the type of the task received instruction;

When the type of the task request instruction is a data export instruction type, acquiring export configuration information input by the user, the export configuration information including target database information and query language;

Query and export the data to be exported from the specified target database according to the export configuration information, including:

Accessing the target database according to the target database information;

Generating executable sentences supported by the target database according to the query language;

Use the executable sentence to query the data to be exported from the target database;

Export the queried data from the target database.
The method of multi-database data processing according to claim 1, wherein the target database information further includes the address of the target database and the registration information of the user in the target database, and the information according to the target database The steps to access the target database specifically include:

Determining the path of the target database according to the address;

Sending an access request to the target database to which the access request carries the registration information, so that the target database can verify the registration information;

Judging whether the verification passed message returned by the target database is received;

If the verification pass message is received, the step of generating executable sentences supported by the target database according to the query language is executed.
The method of multi-database data processing according to claim 1, wherein the configuration information further includes format information of the exported text and a storage path of the exported text, and the queried data is retrieved from the target database The specific steps of export include:

Generate an intermediate result file from the queried data;

Converting the format of the intermediate result file into a specified format file according to the format information;

The file in the specified format is stored in the storage path.
The method of multi-database data processing according to claim 1, wherein the step of obtaining the export configuration information input by the user specifically comprises:

Display data export configuration interface;

Extract the input information of the user on the data export configuration interface, and use the input information as the export configuration information.
The method for data processing in multiple databases according to claim 1, wherein after receiving the task request instruction input by the user, the method further comprises: adding the task request instruction to the task list;

If there are multiple export tasks in the task list, after performing the step of generating an intermediate result file from the queried data, the method further includes;

Determine whether other export tasks in the task list are related to the currently executed export task;

If associated, load the data content of the intermediate result file of the currently executing export task into the intermediate result file of the associated export task, and convert the format of the intermediate result file into a specified format file according to the format information;

Otherwise, directly convert the format of the intermediate result file into a specified format file according to the format information.
The method of multi-database data processing according to claim 1, wherein after the step of judging the type of the task receiving instruction, the method further comprises:

When the type of the task receiving instruction is a text data classification instruction type, acquiring text classification configuration information input by the user;

Extracting the text to be classified and the text of the classification template from the specified target database according to the text classification configuration information;

The information in the text to be classified is classified according to the keywords of the classification template text.
The method of multi-database data processing according to claim 6, wherein the specific step of classifying the information in the text to be classified according to the keywords of the classification template text comprises:

Extract classification keywords from the classification template document;

Searching in the data content of the documents to be classified according to the classification keywords;

The retrieved content is respectively filled into the positions specified by the corresponding classification keywords in the classification template document.
A multi-database data processing device, characterized in that it comprises:

The receiving module is used to receive the task request instruction input by the user,

The judgment module is used to judge the type of the task receiving instruction;

The configuration information obtaining module is configured to obtain the export configuration information input by the user when the type of the task request instruction is the data export instruction type;

Data export module; query and export the data to be exported from the specified target database according to the export configuration information.
The multi-database data processing device according to claim 8, wherein the data export module further comprises:

The database access sub-module is used to access the target database according to the target database information;

The execution statement generation sub-module is used to generate executable statements supported by the target database according to the query language;

The query sub-module is used to query the data that needs to be exported from the target database by using the executable sentence;

The export submodule is used to export the queried data from the target database.
The multi-database data processing device according to claim 8, wherein the configuration information acquisition module further comprises:

A display sub-module for displaying a data export configuration interface, which provides a user with an input window for data export configuration information;

The information extraction sub-module is used to extract the input information of the user on the data export configuration interface, and the input information is the export configuration information.
A computer device includes a memory and a processor. The memory stores computer readable instructions. When the processor executes the computer readable instructions, the following steps are implemented:

Receiving the task request instruction entered by the user;

Determine the type of the task received instruction;

When the type of the task request instruction is a data export instruction type, acquiring export configuration information input by the user, the export configuration information including target database information and query language;

Query and export the data to be exported from the specified target database according to the export configuration information, including:

Accessing the target database according to the target database information;

Generating executable sentences supported by the target database according to the query language;

Use the executable sentence to query the data to be exported from the target database;

Export the queried data from the target database.
The computer device according to claim 11, wherein the target database information further includes the address of the target database and user registration information in the target database, and the step of accessing the target database according to the target database information Specifically:

Determining the path of the target database according to the address;

Sending an access request to the target database to which the access request carries the registration information, so that the target database can verify the registration information;

Judging whether the verification passed message returned by the target database is received;

If the verification pass message is received, the step of generating executable sentences supported by the target database according to the query language is executed.
The computer device according to claim 11, wherein the configuration information further includes format information of the exported text and a storage path of the exported text, and the specific steps of exporting the queried data from the target database include :

Generate an intermediate result file from the queried data;

Converting the format of the intermediate result file into a specified format file according to the format information;

The file in the specified format is stored in the storage path.
The computer device according to claim 11, wherein the step of obtaining the export configuration information input by the user specifically comprises:

Display data export configuration interface;

Extract the input information of the user on the data export configuration interface, and use the input information as the export configuration information.
11. The computer device of claim 11, wherein after receiving the task request instruction input by the user, the method further comprises: adding the task request instruction to the task list;

If there are multiple export tasks in the task list, after performing the step of generating an intermediate result file from the queried data, the method further includes;

Determine whether other export tasks in the task list are related to the currently executed export task;

If associated, load the data content of the intermediate result file of the currently executing export task into the intermediate result file of the associated export task, and convert the format of the intermediate result file into a specified format file according to the format information;

Otherwise, directly convert the format of the intermediate result file into a specified format file according to the format information.
One or more non-volatile readable storage media, wherein the non-volatile readable storage medium stores computer readable instructions, and when the computer readable instructions are executed by a processor, the following steps are implemented:

Receiving the task request instruction entered by the user;

Determine the type of the task received instruction;

When the type of the task request instruction is a data export instruction type, acquiring export configuration information input by the user, the export configuration information including target database information and query language;

Query and export the data to be exported from the specified target database according to the export configuration information, including:

Accessing the target database according to the target database information;

Generating executable sentences supported by the target database according to the query language;

Use the executable sentence to query the data to be exported from the target database;

Export the queried data from the target database.
The non-volatile readable storage medium according to claim 16, wherein the target database information further includes the address of the target database and the registration information of the user in the target database, and the information according to the target database The steps for information access to the target database include:

Determining the path of the target database according to the address;

Sending an access request to the target database to which the access request carries the registration information, so that the target database can verify the registration information;

Judging whether the verification passed message returned by the target database is received;

If the verification pass message is received, the step of generating executable sentences supported by the target database according to the query language is executed.
The non-volatile readable storage medium according to claim 16, wherein the configuration information further includes format information of the exported text and a storage path of the exported text, and the queried data is retrieved from the target database The specific steps that are exported in include:

Generate an intermediate result file from the queried data;

Converting the format of the intermediate result file into a specified format file according to the format information;

The file in the specified format is stored in the storage path.
The non-volatile readable storage medium according to claim 16, wherein the step of obtaining the export configuration information input by the user specifically comprises:

Display data export configuration interface;

Extract the input information of the user on the data export configuration interface, and use the input information as the export configuration information.
The non-volatile readable storage medium according to claim 16, wherein after receiving the task request instruction input by the user, the method further comprises: adding the task request instruction to the task list;

If there are multiple export tasks in the task list, after performing the step of generating an intermediate result file from the queried data, the method further includes;

Determine whether other export tasks in the task list are related to the currently executed export task;

If associated, load the data content of the intermediate result file of the currently executing export task into the intermediate result file of the associated export task, and convert the format of the intermediate result file into a specified format file according to the format information;

Otherwise, directly convert the format of the intermediate result file into a specified format file according to the format information.