CN112487025A

CN112487025A - Data query method and device, electronic equipment and storage medium

Info

Publication number: CN112487025A
Application number: CN202011502793.9A
Authority: CN
Inventors: 常远征; 习惠翔; 谢清扬; 曾宪群
Original assignee: Guangzhou Qixiang Technology Co ltd
Current assignee: Guangzhou Qixiang Technology Co ltd
Priority date: 2020-12-18
Filing date: 2020-12-18
Publication date: 2021-03-12

Abstract

The embodiment of the invention discloses a data query method, a data query device, electronic equipment and a storage medium. The method comprises the following steps: after the state of target data updating in the first database is detected, transmitting the target data to a second database to obtain the second database after data updating; determining an index value in the second database after the data is updated according to the field to be queried; and determining the data to be inquired in the second database after the data is updated according to the index value. By adopting the technical means, the purposes of improving the query efficiency and the query information quality can be achieved.

Description

Data query method and device, electronic equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of data processing, in particular to a data query method and device, electronic equipment and a storage medium.

Background

The in-station global search is a very common software development service, and a user can display main service data in a station only by searching once without entering a single service function and then performing single service search.

The traditional solution is that the system respectively carries out a sub-search on the service table corresponding to each service and then aggregates and returns the results of the sub-search to the client, and the data of the service table is usually stored in a traditional relational database. The method has obvious disadvantages: firstly, if the service tables are too many, the number of sub-searches for each search is increased; second, traditional relational database search performance bottlenecks.

Therefore, a data query method is needed to improve query efficiency and query information quality.

Disclosure of Invention

The invention provides a data query method, a data query device, electronic equipment and a storage medium, and aims to improve query efficiency and query information quality.

In a first aspect, an embodiment of the present invention provides a data query method, including:

after the state of target data updating in the first database is detected, transmitting the target data to a second database to obtain the second database after data updating;

determining an index value in the second database after the data is updated according to the field to be queried;

and determining the data to be inquired in the second database after the data is updated according to the index value.

Optionally, after the state of updating the target data in the first database is detected, the method further includes, before transmitting the target data to the second database to obtain the second database after updating the data:

creating a data source connector and a data output connector according to the data synchronization tool;

establishing a connection relation between the first database and the second database through the data source connector;

transmitting the target data in the first database to the second database through the data output connector.

Optionally, the detecting the state of the target data update in the first database includes:

and if the status bit of the target data in the first database is changed into an execution status, the target data in the first database is in an update status.

Optionally, before determining an index value in the second database after the data update according to the field to be queried, the method further includes:

and establishing an index value in the second database after the data updating so as to determine the data to be inquired according to the index value.

Optionally, the determining, according to the field to be queried, an index value in the second database after the data update includes:

if the field to be queried is in a field blacklist, not processing the field to be queried;

and if the field to be queried is not in the field blacklist, determining an index value in the second database after the data updating.

In a second aspect, an embodiment of the present invention further provides a data query apparatus, including:

the second database updating module is used for transmitting the target data to a second database after detecting the updating state of the target data in the first database to obtain the second database after data updating;

the index value determining module is used for determining an index value in the second database after the data is updated according to the field to be queried;

and the data to be queried determining module is used for determining the data to be queried in the second database after the data is updated according to the index value.

Optionally, the apparatus further comprises:

the creating module is used for creating a data source connector and a data output connector according to the data synchronization tool;

the connection relation establishing module is used for establishing the connection relation between the first database and the second database through the data source connector;

and the target data transmission module is used for transmitting the target data in the first database to the second database through the data output connector.

Optionally, the second database updating module is configured to, if the status bit of the target data in the first database is changed to the execution status, determine that the target data in the first database is in the updated status.

The device further comprises:

and the index value establishing module is used for establishing an index value in the second database after the data updating so as to determine the data to be inquired according to the index value.

The index value determining module is used for not processing the field to be queried if the field to be queried is in a field blacklist;

In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the data query method according to any one of the embodiments of the present invention.

In a fourth aspect, the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the data query method according to any one of the embodiments of the present invention.

After the update state of the target data in the first database is detected, the target data is transmitted to the second database to obtain the second database after the data is updated; determining an index value in the second database after the data is updated according to the field to be queried; and determining the data to be inquired in the second database after the data is updated according to the index value. By adopting the technical means, the purposes of improving the query efficiency and the query information quality can be achieved.

Drawings

Fig. 1 is a schematic flow chart of a data query method provided in a first embodiment of the present invention;

fig. 2 is a schematic structural diagram of a data query apparatus provided in a second embodiment of the present invention;

fig. 3 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, subprograms, and the like.

Example one

Fig. 1 is a schematic flowchart of a data query method according to an embodiment of the present invention, where the present embodiment is applicable to a case of searching data in a database, and the method may be executed by a data query device, where the data query device may be implemented in software and/or hardware, and may be integrated in an electronic device, and specifically includes the following steps:

and S110, after the update state of the target data in the first database is detected, transmitting the target data to a second database to obtain the second database after data update.

In this embodiment, the formats of the data stored in the first database and the second database are not the same, and the data stored in the first database and the data stored in the second database are also different. Wherein the target data is service data, including at least one service data table. When the target data is transmitted from the first database to the second database, the format of the target data is changed from the format of the first database to the format of the second database.

In this embodiment, the target data update includes target data replacement, target data addition, and target data deletion. Illustratively, the first database may be a relational database and the second database may be an Elasticsearch database. The Elasticissearch database is a distributed, highly-extended and highly-real-time search and data analysis engine, and can enable a large amount of data to have the capability of searching, analyzing and exploring. The Elasticissearch database divides corresponding sentences into words through the word segmentation controller, stores the weights and word segmentation results into data, ranks and scores the results according to the weights when a user searches data, and presents the returned results to the user.

In this embodiment, the data synchronization tool includes: logstack, debezium, local, etc. The logstash is synchronized based on monitoring the change of field values of the service data table, but the method is more performance-consuming. The cantal tool of acribaba is a database that supports mysql alone. In this embodiment, debezium is used. debezium supports multiple databases and is synchronized based on reading the data modification log of the database.

In this embodiment, the connection between the first database and the second database is established through the data source connector, the data format in the first database can be converted into the data format in the second database through the data source connector, and after the data format conversion is completed, the target data in the format converted in the first database is transmitted to the second database through the data output connector.

And S120, determining an index value in the second database after the data is updated according to the field to be queried.

In this embodiment, the field to be queried may be input by a user, and a mapping relationship exists between the field to be queried and the index value. And determining the index value corresponding to the field to be queried according to the mapping relation between the field to be queried and the index value.

In this embodiment, the index value may be established in advance. And inquiring the service data table according to the rows and columns through the index value so as to determine the data to be inquired.

In this embodiment, the field blacklist may be preset by a user, and the field in the field blacklist is content that the user does not want to query. Therefore, if the field to be queried is not in the field blacklist, the field to be queried is processed.

S130, determining data to be inquired in the second database after the data updating according to the index value.

In this embodiment, the service data table is queried through the index value, and then the data to be queried is determined according to the specific row and column.

Example two

Fig. 2 is a schematic structural diagram of a data query apparatus according to a second embodiment of the present invention. The data query device provided by the embodiment of the invention can execute the data query method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. As shown in fig. 2, the apparatus includes:

the second database updating module 210 is configured to transmit the target data to the second database after detecting an updated state of the target data in the first database, so as to obtain a second database after data update;

an index value determining module 220, configured to determine an index value in the second database after the data update according to the field to be queried;

and a to-be-queried data determining module 230, configured to determine, according to the index value, to-be-queried data in the second database after the data update.

Optionally, the apparatus further comprises:

Optionally, the second database updating module 210 is configured to, if the status bit of the target data in the first database is changed to the execution status, determine that the target data in the first database is in the updated status.

The device further comprises:

An index value determining module 220, configured to not process the field to be queried if the field to be queried is in a field blacklist;

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the above-described apparatus may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.

EXAMPLE III

Fig. 3 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention, and fig. 3 is a schematic structural diagram of an exemplary device suitable for implementing the embodiment of the present invention. The device 12 shown in fig. 3 is only an example and should not bring any limitations to the functionality and scope of use of the embodiments of the present invention.

As shown in FIG. 3, device 12 is in the form of a general purpose computing device. The components of device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.

Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. Device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 3, and commonly referred to as a "hard drive"). Although not shown in FIG. 3, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. System memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of embodiments described herein.

Device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with device 12, and/or with any devices (e.g., network card, modem, etc.) that enable device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, the device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet) via the network adapter 20. As shown in FIG. 3, the network adapter 20 communicates with the other modules of the device 12 via the bus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The processing unit 16 executes various functional applications and data processing by executing programs stored in the system memory 28, for example, implementing a data query method provided by an embodiment of the present invention, including:

Example four

An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program (or referred to as a computer-executable instruction) is stored, where the computer program, when executed by a processor, can implement a data query method according to any of the above embodiments, where the computer program includes:

Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for querying data, comprising:

2. The method of claim 1, wherein after the detecting the status of the target data update in the first database, transmitting the target data to the second database, and before obtaining the second database after the data update, further comprising:

3. The method of claim 1, wherein detecting the status of the update to the target data in the first database comprises:

4. The method according to claim 1, wherein before determining the index value in the updated second database according to the field to be queried, the method further comprises:

5. The method according to claim 1, wherein the determining an index value in the second database after the data update according to the field to be queried comprises:

6. A data query apparatus, comprising:

7. The apparatus of claim 6, further comprising:

8. The apparatus of claim 6, wherein the second database update module is configured to update the target data in the first database if the status bit of the target data in the first database is changed to the execute status.

9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the data query method of any one of claims 1-5 when executing the program.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the data query method according to any one of claims 1 to 5.