CN111143412A - Data comparison method and device, computer and computer readable storage medium - Google Patents
Data comparison method and device, computer and computer readable storage medium Download PDFInfo
- Publication number
- CN111143412A CN111143412A CN201911350203.2A CN201911350203A CN111143412A CN 111143412 A CN111143412 A CN 111143412A CN 201911350203 A CN201911350203 A CN 201911350203A CN 111143412 A CN111143412 A CN 111143412A
- Authority
- CN
- China
- Prior art keywords
- data
- target data
- hierarchy
- dimension
- cube
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2237—Vectors, bitmaps or matrices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2264—Multidimensional index structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
Abstract
The application discloses a data comparison method, a data comparison device, computer equipment and a computer readable storage medium, wherein the data comparison method comprises the following steps: preprocessing the acquired target data to obtain hierarchical structure information of the target data; determining the inter-hierarchy corresponding to the target data in the CUBE model based on a preset CUBE model and the hierarchical structure information of the target data; determining a cube corresponding to the target data in the hierarchy according to the hierarchy and the target data; reading the associated data recorded in the cube based on the cube; the target data and the associated data are compared to obtain a comparison result between the target data and the associated data, so that a database or an application server is down without consuming a large amount of resources, and a data comparison result is rapidly obtained.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data comparison method and apparatus, a computer device, and a computer-readable storage medium.
Background
The current data comparison method generally adopts two modes: 1, directly associating through a database table, and performing data comparison through full-table data matching; and 2, querying data in different tables to obtain detailed records, and circularly comparing the detailed records through program codes. The two modes are suitable for the condition that the data size is not large, and whether the data are consistent or not can be accurately checked by 100%. However, when the data amount is large, the databases are scattered, and when the data has multiple dimensions, no matter the direct comparison of the databases or the comparison of the program codes is adopted, a large amount of resources are consumed, even the databases or the application servers are down, and the result of data comparison cannot be obtained.
Disclosure of Invention
The invention mainly aims to provide a data comparison method, a data comparison device, computer equipment and a computer readable storage medium, and aims to solve the problem that when the data volume is huge, a database is scattered, and when data has multiple dimensions, the result of data comparison cannot be obtained.
In a first aspect, the present application provides a data comparison method, including:
preprocessing the acquired target data to obtain hierarchical structure information of the target data;
determining the inter-hierarchy corresponding to the target data in the CUBE model based on a preset CUBE model and the hierarchical structure information of the target data;
determining a cube corresponding to the target data in the hierarchy according to the hierarchy and the target data;
reading the associated data recorded in the cube based on the cube;
and comparing the target data with the associated data to obtain a comparison result between the target data and the associated data.
In a second aspect, the present application further provides a data comparison apparatus, including:
the obtaining unit is used for preprocessing the obtained target data to obtain the hierarchical structure information of the target data;
a first determining unit, configured to determine, based on a preset CUBE model and hierarchy information of the target data, an inter-hierarchy level corresponding to the target data in the CUBE model;
the second determining unit is used for determining a cube corresponding to the target data in the hierarchy according to the hierarchy and the target data;
the reading unit is used for reading the associated data recorded in the cube based on the cube;
and the acquisition unit is used for comparing the target data with the associated data to acquire a comparison result between the target data and the associated data.
In a third aspect, the present application further provides a computer device, including: a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the steps of the data comparison method as described above.
In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, where the computer program, when executed by a processor, implements the steps of the data comparison method as described above.
According to the data comparison method, the data comparison device, the computer equipment and the computer readable storage medium, the hierarchical structure information of the target data is obtained by preprocessing the acquired target data; determining the inter-hierarchy corresponding to the target data in the CUBE model based on a preset CUBE model and the hierarchical structure information of the target data; determining a cube corresponding to the target data in the hierarchy according to the hierarchy and the target data; reading the associated data recorded in the cube based on the cube; the target data and the associated data are compared to obtain a comparison result between the target data and the associated data, so that a database or an application server is down without consuming a large amount of resources, and a data comparison result is rapidly obtained.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a data comparison method according to an embodiment of the present application;
FIG. 2 is a flow chart illustrating sub-steps of the data comparison method of FIG. 1;
fig. 3 is a schematic block diagram of a data comparison apparatus provided in an embodiment of the present application;
fig. 4 is a block diagram illustrating a structure of a computer device according to an embodiment of the present application.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
The embodiment of the application provides a data comparison method, a data comparison device, computer equipment and a computer readable storage medium. The data comparison method can be applied to computer equipment, and the computer equipment can be electronic equipment capable of running a virtual machine, such as a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic flow chart of a data comparison method according to an embodiment of the present application.
As shown in fig. 1, the data comparison method includes steps S101 to S105.
Step S101, preprocessing the acquired target data to obtain hierarchical structure information of the target data;
and preprocessing the acquired target data to obtain the hierarchical structure information of the target data when the target data input by a user is acquired. The hierarchical structure information is a group of hardware or software items that are divided according to the type, level, priority, etc. of the information and arranged according to a specific rule. An example is that, when the acquired target data is vehicle data, the name, color, model, production time, and the like of the vehicle data are acquired. And preprocessing the name, the color and the model of the vehicle data to obtain the hierarchical structure information, the name, the color and the model of the vehicle data. Or acquiring the production time, and preprocessing the production time to obtain the hierarchical structure information of the vehicle data, year-quarter-month-day.
Specifically, when target data is acquired, the association time of the target data and the attribute information of the target data are acquired; obtaining hierarchical structure information of the associated time based on preset time hierarchical structure information and the associated time; and obtaining the hierarchical structure information of the attribute information based on preset attribute hierarchical structure information and the attribute information.
When the target data is acquired, the association time of the target data and the attribute information of the target data are acquired. And processing the associated time according to the preset time hierarchical structure information through the preset time hierarchical structure information to obtain the hierarchical structure information of the associated time. And processing the attribute information according to the attribute hierarchical structure information by presetting the attribute hierarchical structure information to obtain the hierarchical structure information of the attribute information. An example is that, when the acquired target data is vehicle data, the name, color, model, and production time of the vehicle data are obtained. And preprocessing the name, the color and the model of the vehicle data to obtain the hierarchical structure information, the name, the color and the model of the vehicle data. Or acquiring the production time, preprocessing the production time of the vehicle to obtain the hierarchical structure information of the vehicle data, year-quarter-month-day.
Step S102, determining the corresponding hierarchy of the target data in the preset CUBE model based on the preset CUBE model and the hierarchy structure information of the target data.
A preset CUBE model is called as a data CUBE, is a multi-dimensional matrix, can explore and analyze a data set from multiple angles, and usually considers three factors (dimensions) at a time. Tools are needed when extracting information from a pile of data to find relevant and important information, and different scenarios. A report, whether printed on paper or appearing on a screen, is a two-dimensional representation of data, a table of rows and columns, but satisfies only two factors. A data cube is a multi-dimensional extension of a two-dimensional table, as is a three-dimensional extension in which the geometric cube is a square. The data cube is not limited to three dimensions. Most online analytical processes can build datacubes with many dimensions, for example, microsoft's SQL Server 2000Analysis Services tool allows dimensions up to 64. The CUBE model is established in advance, and data are stored in all CUBEs of the CUBE model according to different dimensions. And matching the hierarchical structure information of the target data with the time dimension and the type dimension in the preset CUBE model through the hierarchical structure information of the preset CUBE model and the target data to obtain the corresponding hierarchy of the target data in the preset CUBE model.
In one embodiment, as shown in fig. 2, step S102 includes sub-steps S1021 to S1023.
Substep S1021, acquiring the time dimension and the type dimension of the preset CUBE model;
calling a preset CUBE model, and obtaining the time dimension and the type dimension of the preset CUBE model, wherein the time dimension comprises different levels of time dimensions, such as a year dimension, a quarter dimension, a month dimension and the like; the type dimension includes different levels of type dimensions, such as a name dimension, a color dimension, and the like.
Substep S1022, determining a first hierarchy corresponding to the associated time in the preset CUBE model according to the hierarchical structure information and the time dimension of the associated time;
matching the dimension of each level in the hierarchical structure information of the associated time with the time dimension through the hierarchical structure information of the associated time and the time dimension, wherein an exemplary example is to obtain the dimension name of a first level in the hierarchical structure information of the associated time to be matched with a first dimension in the time dimension, match the dimension name of a second level in the hierarchical structure information of the associated time with a second dimension in the time dimension, match the dimension names until the associated time is matched, and determine the first level corresponding to the associated time in the preset CUBE model.
Specifically, based on the hierarchical structure information of the associated time, drilling is performed on the time dimension; and drilling the time dimension to obtain a time dimension consistent with the associated time in the time dimension, and determining that the interlayer corresponding to the time dimension is a first interlayer.
In one embodiment, the time dimension is drilled by hierarchical information associated with the time of day, drilling being a change between different levels of the dimension, going from the top level down to the next level, or breaking the summary data into more detailed data, such as viewing the consumption data of the second quarter 4, 5, 6 per month of 2010 by drilling through the total sales data of the second quarter of 2010. And matching the dimension name of each layer in the hierarchical structure information of the associated time with each dimension name in the time dimension to obtain the time dimension consistent with the associated time in the time dimension, and taking the layer corresponding to the time dimension as the first layer corresponding to the associated time.
And a substep S1023 of determining a second hierarchy corresponding to the attribute information in the first hierarchy according to the hierarchical structure information of the attribute information and the type dimension.
Matching the dimension and the type dimension of each level in the hierarchical structure information of the attribute information through the hierarchical structure information and the type dimension of the attribute information, wherein an exemplary example is that the dimension name of the first level in the hierarchical structure information of the attribute information is obtained to be matched with the first dimension on the type dimension, then the dimension name of the second level in the hierarchical structure information of the attribute information is matched with the second dimension on the type dimension, and the second level corresponding to the attribute information in the preset CUBE model is determined until the matching is carried out to the associated moment.
Specifically, based on the hierarchical structure information of the attribute information and the type dimension, drilling the type dimension on the first hierarchy; and drilling the type dimension to obtain the attribute dimension consistent with the attribute information in the type dimension, and determining that the interlayer corresponding to the attribute dimension is a second interlayer.
In one embodiment, the type dimensions are drilled through hierarchical information of attribute information, drilling is a change between different levels of the dimensions, going from upper levels to lower levels, or breaking summary data into more detailed data, such as by drilling through total sales data for the second quarter of 2010 to view consumption data for each month in the second quarter of 2010, 4, 5, 6. And matching the dimension name of each layer in the hierarchical structure information of the attribute information with each dimension name in the type dimension in the first layer to obtain the attribute dimension consistent with the attribute information in the type dimension, and taking the layer corresponding to the attribute dimension as the second layer corresponding to the attribute information. And the type dimension in the preset CUBE model is the same as the type dimension in the first hierarchy.
S103, determining a cube corresponding to the target data in the hierarchy according to the hierarchy and the target data;
and determining a cube corresponding to the target data in the hierarchy based on the dimension information and the target data in the hierarchy, wherein a plurality of cubes are arranged in the hierarchy. An example is that when determining a cube of target data, a row of cubes corresponding to the target data in the hierarchy is determined, and the row of cubes is taken as the cube corresponding to the target data, where the number of cubes corresponding to the target data is plural.
Specifically, the second hierarchy is sliced based on the target data, and a cube corresponding to the target data is determined.
In one embodiment, when determining the second level interval corresponding to the target data, slicing the second level interval based on the target data, where slicing is to select data of a specific interval in a dimension or a specific batch of data for analysis, such as selecting sales data of the first quarter 2010 to the second quarter 2010, or sales data of electronic products and daily necessities. And obtaining cubes corresponding to the target data in the second hierarchy by slicing the second hierarchy, wherein the number of the cubes corresponding to the target data is multiple.
Step S104, reading the associated data recorded in the cube based on the cube;
and when the cube corresponding to the target data is determined, reading the associated data recorded in the cube. And if the cubes corresponding to the target data are multiple, reading the associated data recorded in each cube respectively.
And 105, comparing the target data with the associated data to obtain a comparison result between the target data and the associated data.
When reading the associated data recorded in the cube, obtaining a comparison result between the target data and the associated data by comparing the target data with the associated data, which is exemplified by obtaining word meanings of the associated data and word meanings of the target data respectively by presetting encyclopedia, and obtaining a similarity result between the associated data and the target data by comparing the word meanings of the associated data and the word meanings of the target data. And if the associated data recorded in the plurality of cubes are read, respectively obtaining the word meaning of each associated data by presetting an encyclopedia, and comparing the word meaning of each associated data with the word meaning of the target data one by one to obtain the similarity between each associated data and the target data.
In this embodiment, the hierarchy structure information of the target data is obtained by preprocessing the obtained target data, and the associated data corresponding to the target data in the preset CUBE model is read based on the preset CUBE model and the hierarchy structure information of the target data, so as to obtain a similarity result between the associated data and the target data.
Referring to fig. 3, fig. 3 is a schematic block diagram of a data comparison apparatus according to an embodiment of the present disclosure.
As shown in fig. 3, the data comparing apparatus 500 includes: the device comprises a preprocessing unit 501, a first determining unit 502, a second determining unit 503, a reading unit 504 and an acquiring unit 505.
A preprocessing unit 501, configured to preprocess the acquired target data to obtain hierarchical structure information of the target data;
a first determining unit 502, configured to determine, based on a preset CUBE model and hierarchy information of the target data, a hierarchy corresponding to the target data in the preset CUBE model;
a second determining unit 503, configured to determine, according to the hierarchy and the target data, a cube corresponding to the target data in the hierarchy;
a reading unit 504, configured to read, based on the cube, associated data recorded in the cube;
an obtaining unit 505, configured to obtain a comparison result between the target data and the associated data by comparing the target data and the associated data.
The preprocessing unit 501 is specifically configured to:
when target data are acquired, acquiring the association time of the target data and the attribute information of the target data;
obtaining hierarchical structure information of the associated time based on preset time hierarchical structure information and the associated time;
and obtaining the hierarchical structure information of the attribute information based on preset attribute hierarchical structure information and the attribute information.
The first determining unit 502 is specifically configured to:
acquiring the time dimension and the type dimension of a preset CUBE model;
determining a first hierarchy corresponding to the association time in the preset CUBE model according to the hierarchical structure information and the time dimension of the association time;
and determining a second hierarchy corresponding to the attribute information in the first hierarchy according to the hierarchical structure information of the attribute information and the type dimension.
The first determining unit 502 is specifically configured to:
drilling the time dimension based on the hierarchical structure information of the associated time;
and drilling the time dimension to obtain a time dimension consistent with the associated time in the time dimension, and determining that the interlayer corresponding to the time dimension is a first interlayer.
The first determining unit 502 is specifically configured to:
drilling the type dimension on the first hierarchy based on the hierarchical structure information of the attribute information and the type dimension;
and drilling the type dimension to obtain the attribute dimension consistent with the attribute information in the type dimension, and determining that the interlayer corresponding to the attribute dimension is a second interlayer.
The second determining unit 503 is specifically configured to:
and slicing the second hierarchy based on the target data, and determining a cube corresponding to the target data.
The obtaining unit 505 is specifically configured to:
and comparing the associated data with each associated data to obtain the similarity between the target data and each associated data.
It should be noted that, as will be clear to those skilled in the art, for convenience and brevity of description, the specific working processes of the apparatus and each module and unit described above may refer to the corresponding processes in the foregoing embodiments of the fraud identification method, and are not described herein again.
The apparatus provided by the above embodiments may be implemented in the form of a computer program, which can be run on a computer device as shown in fig. 4.
Referring to fig. 4, fig. 4 is a schematic block diagram of a computer device according to an embodiment of the present disclosure. The computer device may be a server or a terminal.
As shown in fig. 4, the computer device includes a processor, a memory, and a network interface connected by a system bus, wherein the memory may include a nonvolatile storage medium and an internal memory.
The non-volatile storage medium may store an operating system and a computer program. The computer program includes program instructions that, when executed, cause a processor to perform any of the data comparison methods.
The processor is used for providing calculation and control capability and supporting the operation of the whole computer equipment.
The internal memory provides an environment for the execution of a computer program on a non-volatile storage medium, which when executed by a processor, causes the processor to perform any of a variety of data comparison methods.
The network interface is used for network communication, such as sending assigned tasks and the like. Those skilled in the art will appreciate that the architecture shown in fig. 4 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
It should be understood that the Processor may be a Central Processing Unit (CPU), and the Processor may be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, etc. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Wherein, in one embodiment, the processor is configured to execute a computer program stored in the memory to implement the steps of:
preprocessing the acquired target data to obtain hierarchical structure information of the target data;
determining the corresponding hierarchy of the target data in a preset CUBE model based on the preset CUBE model and the hierarchy information of the target data;
determining a cube corresponding to the target data in the hierarchy according to the hierarchy and the target data;
reading the associated data recorded in the cube based on the cube;
and comparing the target data with the associated data to obtain a comparison result between the target data and the associated data.
In an embodiment, when the processor implements preprocessing on the acquired target data to obtain the hierarchical structure information of the target data, the processor is configured to implement:
when target data are acquired, acquiring the association time of the target data and the attribute information of the target data;
obtaining hierarchical structure information of the associated time based on preset time hierarchical structure information and the associated time;
and obtaining the hierarchical structure information of the attribute information based on preset attribute hierarchical structure information and the attribute information.
In one embodiment, when determining the hierarchy corresponding to the target data in the preset CUBE model based on the preset CUBE model and the hierarchy information of the target data, the processor is configured to:
acquiring the time dimension and the type dimension of a preset CUBE model;
determining a first hierarchy corresponding to the association time in the preset CUBE model according to the hierarchical structure information and the time dimension of the association time;
and determining a second hierarchy corresponding to the attribute information in the first hierarchy according to the hierarchical structure information of the attribute information and the type dimension.
In an embodiment, when determining, according to the hierarchical structure information and the time dimension of the associated time, the first hierarchy corresponding to the associated time in the preset CUBE model, the processor is configured to implement:
drilling the time dimension based on the hierarchical structure information of the associated time;
and drilling the time dimension to obtain a time dimension consistent with the associated time in the time dimension, and determining that the interlayer corresponding to the time dimension is a first interlayer.
In an embodiment, when determining, according to the hierarchical structure information of the attribute information and the type dimension, a second hierarchical level corresponding to the attribute information in the first hierarchical level, the processor is configured to implement:
drilling the type dimension on the first hierarchy based on the hierarchical structure information of the attribute information and the type dimension;
and drilling the type dimension to obtain the attribute dimension consistent with the attribute information in the type dimension, and determining that the interlayer corresponding to the attribute dimension is a second interlayer.
In one embodiment, when determining the cube corresponding to the target data in the hierarchy according to the hierarchy and the target data, the processor is configured to:
and slicing the second hierarchy based on the target data, and determining a cube corresponding to the target data.
In an embodiment, the processor is configured to implement that the associated data is multiple, and when the target data and the associated data are compared to obtain a comparison result between the target data and the associated data, the processor is configured to implement:
and comparing the associated data with each associated data to obtain the similarity between the target data and each associated data.
Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, where the computer program includes program instructions, and a method implemented when the program instructions are executed may refer to various embodiments of the data comparison method in the present application.
The computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiment, for example, a hard disk or a memory of the computer device. The computer readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the computer device.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A method of data comparison, comprising:
preprocessing the acquired target data to obtain hierarchical structure information of the target data;
determining the corresponding hierarchy of the target data in a preset CUBE model based on the preset CUBE model and the hierarchy information of the target data;
determining a cube corresponding to the target data in the hierarchy according to the hierarchy and the target data;
reading the associated data recorded in the cube based on the cube;
and comparing the target data with the associated data to obtain a comparison result between the target data and the associated data.
2. The data comparison method according to claim 1, wherein the preprocessing the acquired target data to obtain the hierarchical structure information of the target data includes:
when target data are acquired, acquiring the association time of the target data and the attribute information of the target data;
obtaining hierarchical structure information of the associated time based on preset time hierarchical structure information and the associated time;
and obtaining the hierarchical structure information of the attribute information based on preset attribute hierarchical structure information and the attribute information.
3. The data comparing method according to claim 2, wherein the determining the hierarchy corresponding to the target data in the preset CUBE model based on the preset CUBE model and the hierarchy information of the target data comprises:
acquiring the time dimension and the type dimension of a preset CUBE model;
determining a first hierarchy corresponding to the association time in the preset CUBE model according to the hierarchical structure information and the time dimension of the association time;
and determining a second hierarchy corresponding to the attribute information in the first hierarchy according to the hierarchical structure information of the attribute information and the type dimension.
4. The data comparison method of claim 3, wherein the determining a first level in the preset CUBE model corresponding to the associated time according to the hierarchical structure information and the time dimension of the associated time comprises:
drilling the time dimension based on the hierarchical structure information of the associated time;
and drilling the time dimension to obtain a time dimension consistent with the associated time in the time dimension, and determining that the interlayer corresponding to the time dimension is a first interlayer.
5. The data comparison method of claim 3, wherein the determining a second hierarchy of the first hierarchy corresponding to the attribute information according to the hierarchy information of the attribute information and the type dimension comprises:
drilling the type dimension on the first hierarchy based on the hierarchical structure information of the attribute information and the type dimension;
and drilling the type dimension to obtain the attribute dimension consistent with the attribute information in the type dimension, and determining that the interlayer corresponding to the attribute dimension is a second interlayer.
6. The data comparison method of claim 3, wherein said determining a cube corresponding to said target data in said hierarchy based on said hierarchy and said target data comprises:
and slicing the second hierarchy based on the target data, and determining a cube corresponding to the target data.
7. The data comparison method according to any one of claims 1 to 6, wherein the plurality of associated data are provided, and the obtaining of the comparison result between the target data and the associated data by comparing the target data and the associated data includes:
and comparing the associated data with each associated data to obtain the similarity between the target data and each associated data.
8. A data comparison apparatus, characterized in that the data comparison apparatus comprises:
the preprocessing unit is used for preprocessing the acquired target data to obtain the hierarchical structure information of the target data;
a first determining unit, configured to determine, based on a preset CUBE model and hierarchy information of the target data, an inter-hierarchy level corresponding to the target data in the preset CUBE model;
the second determining unit is used for determining a cube corresponding to the target data in the hierarchy according to the hierarchy and the target data;
the reading unit is used for reading the associated data recorded in the cube based on the cube;
and the acquisition unit is used for comparing the target data with the associated data to acquire a comparison result between the target data and the associated data.
9. A computer device comprising a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the steps of the data comparison method of any one of claims 1 to 7.
10. A computer-readable storage medium, having stored thereon a computer program, wherein the computer program, when being executed by a processor, carries out the steps of the data comparison method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911350203.2A CN111143412A (en) | 2019-12-24 | 2019-12-24 | Data comparison method and device, computer and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911350203.2A CN111143412A (en) | 2019-12-24 | 2019-12-24 | Data comparison method and device, computer and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111143412A true CN111143412A (en) | 2020-05-12 |
Family
ID=70519774
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911350203.2A Pending CN111143412A (en) | 2019-12-24 | 2019-12-24 | Data comparison method and device, computer and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111143412A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112002107A (en) * | 2020-09-07 | 2020-11-27 | 广东众科智能科技股份有限公司 | Automatic overheat alarm control box safety detection system based on 5G technology |
| CN112650819A (en) * | 2020-12-29 | 2021-04-13 | 清华大学 | Method, device and equipment for constructing metadata cube and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105808766A (en) * | 2016-03-21 | 2016-07-27 | 西南科技大学 | Multilevel association rule mining method based on transaction item constraint expansion |
| US20170116228A1 (en) * | 2015-10-23 | 2017-04-27 | Oracle International Corporation | System and method for automatic inference of a cube schema from a tabular data for use in a multidimensional database environment |
| CN107704608A (en) * | 2017-10-17 | 2018-02-16 | 北京览群智数据科技有限责任公司 | A kind of OLAP multidimensional analyses and data digging system |
| CN110275920A (en) * | 2019-06-27 | 2019-09-24 | 中国石油集团东方地球物理勘探有限责任公司 | Data query method, apparatus, electronic equipment and computer readable storage medium |
| CN110442653A (en) * | 2019-07-03 | 2019-11-12 | 平安科技（深圳）有限公司 | Method, apparatus, server and the storage medium of incremental build CUBE model |
-
2019
- 2019-12-24 CN CN201911350203.2A patent/CN111143412A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170116228A1 (en) * | 2015-10-23 | 2017-04-27 | Oracle International Corporation | System and method for automatic inference of a cube schema from a tabular data for use in a multidimensional database environment |
| CN105808766A (en) * | 2016-03-21 | 2016-07-27 | 西南科技大学 | Multilevel association rule mining method based on transaction item constraint expansion |
| CN107704608A (en) * | 2017-10-17 | 2018-02-16 | 北京览群智数据科技有限责任公司 | A kind of OLAP multidimensional analyses and data digging system |
| CN110275920A (en) * | 2019-06-27 | 2019-09-24 | 中国石油集团东方地球物理勘探有限责任公司 | Data query method, apparatus, electronic equipment and computer readable storage medium |
| CN110442653A (en) * | 2019-07-03 | 2019-11-12 | 平安科技（深圳）有限公司 | Method, apparatus, server and the storage medium of incremental build CUBE model |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112002107A (en) * | 2020-09-07 | 2020-11-27 | 广东众科智能科技股份有限公司 | Automatic overheat alarm control box safety detection system based on 5G technology |
| CN112002107B (en) * | 2020-09-07 | 2021-12-10 | 广东众科智能科技股份有限公司 | Automatic overheat alarm control box safety detection system based on 5G technology |
| CN112650819A (en) * | 2020-12-29 | 2021-04-13 | 清华大学 | Method, device and equipment for constructing metadata cube and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109241374B (en) | Book information base updating method and library book positioning method | |
| WO2020024356A1 (en) | Warehouse asset inventory method and apparatus, computer device and storage medium | |
| CN112965645B (en) | Page dragging method and device, computer equipment and storage medium | |
| CN109933502B (en) | Electronic device, user operation record processing method and storage medium | |
| CN111143412A (en) | Data comparison method and device, computer and computer readable storage medium | |
| CN112052891A (en) | Machine behavior recognition method, device, equipment and computer readable storage medium | |
| CN111414740A (en) | Electronic experiment record book report generation system | |
| US9639587B2 (en) | Social network analyzer | |
| CN111625567A (en) | Data model matching method, device, computer system and readable storage medium | |
| CN110598123A (en) | Information retrieval recommendation method and device based on portrait similarity and storage medium | |
| CN116719822B (en) | Method and system for storing massive structured data | |
| CN110287459B (en) | Form batch processing method, system, device and storage medium | |
| US9098559B2 (en) | Optimized visualization and analysis of tabular and multidimensional data | |
| CN112329409B (en) | Cell color conversion method and device and electronic equipment | |
| CN117150138A (en) | Scientific and technological resource organization method and system based on high-dimensional space mapping | |
| CN114861614A (en) | Method and device for filling data, electronic equipment and medium | |
| CN102117324A (en) | File management method and management system applying fuzzy matrice | |
| CN111736939A (en) | Page self-adaptive adjusting method and device, storage medium and computer equipment | |
| CN111400289A (en) | Intelligent user classification method, server and storage medium | |
| CN111209312A (en) | Page data processing method and device, computer equipment and storage medium | |
| CN112487039B (en) | Data processing method, device, equipment and readable storage medium | |
| CN110704762A (en) | Data presentation method and device, computer equipment and storage medium | |
| CN108763442B (en) | Workbook filtering method and device, computer equipment and storage medium | |
| US11036927B1 (en) | Relative positional parsing of documents using trees | |
| CN116136839B (en) | Method, system and related equipment for generating legal document face manuscript |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |