CN113688899A

CN113688899A - Data fusion method and device, storage medium and electronic equipment

Info

Publication number: CN113688899A
Application number: CN202110966012.XA
Authority: CN
Inventors: 郭吉光
Original assignee: Beijing Minglue Zhaohui Technology Co Ltd
Current assignee: Beijing Minglue Zhaohui Technology Co Ltd
Priority date: 2021-08-23
Filing date: 2021-08-23
Publication date: 2021-11-23

Abstract

The application provides a data fusion method, a data fusion device, a storage medium and an electronic device, wherein the data fusion method comprises the following steps: displaying a plurality of data sources and candidate fusion rules; wherein each data source comprises a table structure; receiving a current operation, and determining a target data source and a target fusion rule based on the current operation; and fusing the data in the target data source according to the target fusion rule to obtain fused data. According to the application, the data source and the candidate fusion rule are displayed to the user, so that the user can customize the data source to be fused and the target fusion rule used in fusion, developers do not need to set a background for each application scene, and the starting time is greatly reduced; and moreover, a user selects a data source to be fused and a target fusion rule used during fusion before fusion, and then data fusion is directly performed without background maintenance by developers, so that the data fusion efficiency is improved.

Description

Data fusion method and device, storage medium and electronic equipment

Technical Field

The present disclosure relates to the field of data processing technologies, and in particular, to a data fusion method and apparatus, a storage medium, and an electronic device.

Background

The knowledge graph is a structured semantic knowledge base, the current technology generally uses a merging mode, and a common method comprises the steps of grouping through category information of data, for example, grouping can be carried out according to the category information of commodities when commodity data are fused; or the data can be grouped according to key information of the data, such as regions when fusing character data, and the like.

However, developers need to individually set for different application scenarios, which results in a long development time, and once data in an application scenario changes, data fusion needs to be suspended to enable the developers to perform background maintenance, which results in low data fusion efficiency.

Disclosure of Invention

In view of this, embodiments of the present application provide a data fusion method, an apparatus, a storage medium, and an electronic device, so as to solve the problems of long development time and low fusion efficiency in the prior art.

In a first aspect, an embodiment of the present application provides a data fusion method, including:

displaying a plurality of data sources and candidate fusion rules; wherein each of the data sources comprises a table structure;

receiving a current operation, and determining a target data source and a target fusion rule based on the current operation;

and fusing the data in the target data source according to the target fusion rule to obtain fused data.

In one possible embodiment, the presenting the plurality of data sources and the candidate fusion rule includes:

and displaying a plurality of data sources on a display device in a webpage mode so that a user can browse each data source.

In a possible embodiment, the receiving a current operation and determining a target data source and a target fusion rule based on the current operation includes:

receiving current operation executed by a user;

searching for an instruction corresponding to the current operation based on a mapping relation between a preset operation and a preset instruction;

determining the target data source and the target fusion rule based on the instruction.

In a possible implementation manner, before fusing the data in the target data source according to the target fusion rule, the method further includes:

and filtering and/or converting the data in the target data source according to a preset rule.

In a second aspect, an embodiment of the present application further provides a data fusion apparatus, where the apparatus includes:

a presentation module configured to present a plurality of data sources and a candidate fusion rule; wherein each of the data sources comprises a table structure;

the determining module is configured to receive a current operation and determine a target data source and a target fusion rule based on the current operation;

and the fusion module is used for fusing the data in the target data source according to the target fusion rule in a configuration mode to obtain fused data.

In a possible implementation, the display module is specifically configured to:

In a possible implementation manner, the determining module is specifically configured to:

receiving current operation executed by a user;

In one possible embodiment, the data fusion device further comprises a processing module configured to:

In a third aspect, an embodiment of the present application further provides a storage medium, where the computer readable storage medium stores a computer program, and the computer program is executed by a processor to perform the following steps:

In a fourth aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes: a processor and a memory, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over a bus when an electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of:

According to the method and the device, the data source and the candidate fusion rule are displayed to the user, so that the user can customize the data source to be fused and the target fusion rule used in fusion, background setting of developers for each application scene is not needed, and the starting time is greatly reduced; and moreover, a user selects a data source to be fused and a target fusion rule used during fusion before fusion, and then data fusion is directly performed without background maintenance by developers, so that the data fusion efficiency is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative effort.

FIG. 1 is a flow chart illustrating a data fusion method provided herein;

FIG. 2 is a flow chart illustrating a target data source and a target fusion rule determined based on a current operation received in a data fusion method provided by the present application;

FIG. 3 is a schematic structural diagram of a data fusion device provided in the present application;

fig. 4 shows a schematic structural diagram of an electronic device provided in the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings of the embodiments of the present application. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the application without any inventive step, are within the scope of protection of the application.

Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this application belongs. As used in this application, the terms "first," "second," and the like do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used merely to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly.

Detailed descriptions of known functions and known components are omitted in the present application in order to keep the following description of the embodiments of the present application clear and concise.

As shown in fig. 1, which is a flowchart of a data fusion method provided in the first aspect of the present application, the specific steps include S101-S103.

S101, displaying a plurality of data sources and candidate fusion rules; wherein each data source comprises a table structure.

Here, a plurality of fusion rules are set in advance, for example, classification fusion is performed for each function, classification fusion is performed for each material, and the like.

In specific implementation, the method is connected with a plurality of platforms, acquires data generated by each platform, takes each piece of data generated by each platform as a data source, and structures each data source, so that each data source exists in a table form, namely each data source comprises a table structure, the problem of poor classification or fusion accuracy caused by non-uniform data source forms in the subsequent processing process is solved, and the accuracy of subsequent processing is improved.

Preferably, the plurality of data sources and the candidate fusion rule are presented on a display device in the form of a web page to enable a user to browse each data source. Of course, the data source and the candidate fusion rule may be displayed separately, for example, the data source is displayed on the left side of the interface, and the candidate fusion rule is displayed on the right side of the interface; the data source is displayed in black font, the candidate fusion rules are displayed in red font, etc.

S102, receiving the current operation, and determining a target data source and a target fusion rule based on the current operation.

After the data source and the candidate fusion rule are displayed, a user can browse the data source and the candidate fusion rule, further determine the data source to be fused and the target fusion rule required during fusion, and then execute preset operation to select the target data source and the target fusion rule.

Preferably, fig. 2 shows a flowchart of receiving a current operation and determining a target data source and a target fusion rule based on the current operation, and the specific steps include S201-S203.

S201, receiving the current operation executed by the user.

S202, searching for an instruction corresponding to the current operation based on the mapping relation between the preset operation and the preset instruction.

S203, determining a target data source and a target fusion rule based on the instruction.

In a specific implementation, the current operation performed by the user is monitored in real time during the process of presenting the data source and the candidate fusion rule, for example, clicking with a mouse, sliding on a touch screen, and the like.

After the current operation executed by the user is monitored, the current operation is identified, and an instruction corresponding to the current operation is searched based on the mapping relation between the preset operation and the preset instruction.

Thereafter, a target data source and a target fusion rule are determined based on the instructions. For example, if the current operation is determined to be clicking the data source, the data is taken as a target data source; and if the current operation is determined to be the operation of sweeping a plurality of data sources, all the plurality of data are used as target data sources, and the like.

S103, fusing the data in the target data source according to the target fusion rule to obtain fused data.

In specific implementation, before data in the target data source is fused according to the target fusion rule, the data in the target data source is filtered and/or converted according to a preset rule. Here, preset rules may be set, for example, names may be unified, short names may be converted into full names, preset characters may be filtered, and the like according to the requirements of the customers.

And when the result is determined to be the result desired by the user, filtering and/or converting the data in the target data source.

And then, fusing the data in the target data source according to the target fusion rule to obtain fused data, and storing the fused data into the knowledge graph for subsequent use.

Based on the same inventive concept, the second aspect of the present application further provides a data fusion device corresponding to the data fusion method, and because the principle of solving the problem of the data fusion device in the present application is similar to that of the data fusion method in the present application, the implementation of the data fusion device may refer to the implementation of the method, and repeated details are not repeated.

Fig. 3 shows a schematic diagram of an abnormal traffic determination apparatus provided in an embodiment of the present application, which specifically includes:

a presentation module 301 configured to present a plurality of data sources and candidate fusion rules; wherein each of the data sources comprises a table structure;

a determination module 302 configured to receive a current operation and determine a target data source and a target fusion rule based on the current operation;

and the fusion module 303 is configured to fuse the data in the target data source according to the target fusion rule to obtain fused data.

In another embodiment, the display module 301 is specifically configured to:

In another embodiment, the determining module 302 is specifically configured to:

receiving current operation executed by a user;

In yet another embodiment, a processing module 304 is further included that is configured to:

The storage medium is a computer-readable medium, and stores a computer program, and when the computer program is executed by a processor, the method provided in any embodiment of the present application is implemented, including the following steps S11 to S13:

s11, displaying a plurality of data sources and candidate fusion rules; wherein each of the data sources comprises a table structure;

s12, receiving the current operation, and determining a target data source and a target fusion rule based on the current operation;

and S13, fusing the data in the target data source according to the target fusion rule to obtain fused data.

When the computer program is executed by the processor to display the plurality of data sources and the candidate fusion rule, the processor specifically executes the following steps: and displaying a plurality of data sources and the candidate fusion rule on a display device in a webpage mode so that a user can browse each data source.

The computer program is executed by the processor to receive the current operation and further executed by the processor to perform the following steps based on the target data source and the target fusion rule determined by the current operation: receiving current operation executed by a user; searching for an instruction corresponding to the current operation based on a mapping relation between a preset operation and a preset instruction; determining the target data source and the target fusion rule based on the instruction.

Before the computer program is executed by the processor to fuse the data in the target data source according to the target fusion rule, the processor also executes the following steps: and filtering and/or converting the data in the target data source according to a preset rule.

An electronic device is provided in an embodiment of the present application, and a schematic structural diagram of the electronic device may be as shown in fig. 4, where the electronic device at least includes a memory 401 and a processor 402, a computer program is stored on the memory 401, and the processor 402 implements the method provided in any embodiment of the present application when executing the computer program on the memory 401. Illustratively, the electronic device computer program steps are as follows S21-S23:

s21, displaying a plurality of data sources and candidate fusion rules; wherein each of the data sources comprises a table structure;

s22, receiving the current operation, and determining a target data source and a target fusion rule based on the current operation;

and S23, fusing the data in the target data source according to the target fusion rule to obtain fused data.

The processor, when executing the presentation multiple data sources and the candidate fusion rule stored on the memory, further executes the following computer program: and displaying a plurality of data sources and the candidate fusion rule on a display device in a webpage mode so that a user can browse each data source.

The processor, when executing a target data source and a target fusion rule stored on the memory that receive a current operation and are determined based on the current operation, further executes the following computer program: receiving current operation executed by a user; searching for an instruction corresponding to the current operation based on a mapping relation between a preset operation and a preset instruction; determining the target data source and the target fusion rule based on the instruction.

The processor further executes the following computer program before executing the fusion of the data in the target data source according to the target fusion rule stored in the memory: and filtering and/or converting the data in the target data source according to a preset rule.

Optionally, in this embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes. Optionally, in this embodiment, the processor executes the method steps described in the above embodiments according to the program code stored in the storage medium. Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again. It will be apparent to those skilled in the art that the modules or steps of the present application described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present application is not limited to any specific combination of hardware and software.

Moreover, although exemplary embodiments have been described herein, the scope thereof includes any and all embodiments based on the present application with equivalent elements, modifications, omissions, combinations (e.g., of various embodiments across), adaptations or alterations. The elements of the claims are to be interpreted broadly based on the language employed in the claims and not limited to examples described in the present specification or during the prosecution of the application, which examples are to be construed as non-exclusive. It is intended, therefore, that the specification and examples be considered as exemplary only, with a true scope and spirit being indicated by the following claims and their full scope of equivalents.

The above description is intended to be illustrative and not restrictive. For example, the above-described examples (or one or more versions thereof) may be used in combination with each other. For example, other embodiments may be used by those of ordinary skill in the art upon reading the above description. In addition, in the above detailed description, various features may be grouped together to streamline the application. This should not be interpreted as an intention that a disclosed feature not claimed is essential to any claim. Rather, subject matter of the present application can lie in less than all features of a particular disclosed embodiment. Thus, the following claims are hereby incorporated into the detailed description as examples or embodiments, with each claim standing on its own as a separate embodiment, and it is contemplated that these embodiments may be combined with each other in various combinations or permutations. The scope of the application should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.

The embodiments of the present application have been described in detail, but the present application is not limited to these specific embodiments, and those skilled in the art can make various modifications and modified embodiments based on the concept of the present application, and these modifications and modified embodiments should fall within the scope of the present application.

Claims

1. A method of data fusion, comprising:

2. The data fusion method of claim 1, wherein the presenting the plurality of data sources and the candidate fusion rule comprises:

and displaying a plurality of data sources and the candidate fusion rule on a display device in a webpage mode so that a user can browse each data source.

3. The data fusion method of claim 1, wherein receiving the current operation and determining the target data source and the target fusion rule based on the current operation comprises:

receiving current operation executed by a user;

4. The data fusion method of claim 1, further comprising, before fusing the data in the target data source according to the target fusion rule:

5. A data fusion apparatus, comprising:

6. The data fusion device of claim 5, wherein the presentation module is specifically configured to:

7. The data fusion device of claim 5, wherein the determination module is specifically configured to:

receiving current operation executed by a user;

8. The data fusion device of claim 5, further comprising a processing module configured to:

9. A storage medium, having a computer program stored thereon, the computer program when executed by a processor performing the steps of:

10. An electronic device, comprising: a processor and a memory, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over a bus when an electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of: