CN108182204A - The processing method and processing device of data query based on house prosperity transaction multi-dimensional data - Google Patents
The processing method and processing device of data query based on house prosperity transaction multi-dimensional data Download PDFInfo
- Publication number
- CN108182204A CN108182204A CN201711320241.4A CN201711320241A CN108182204A CN 108182204 A CN108182204 A CN 108182204A CN 201711320241 A CN201711320241 A CN 201711320241A CN 108182204 A CN108182204 A CN 108182204A
- Authority
- CN
- China
- Prior art keywords
- data
- prosperity transaction
- house prosperity
- cube
- theme
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24553—Query execution of query operations
- G06F16/24561—Intermediate data storage techniques for performance improvement
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the present invention provides a kind of processing method and processing device of the data query based on house prosperity transaction multi-dimensional data, the method includes：Receive the inquiry request of house prosperity transaction multi-dimensional data；It is obtained and the corresponding data cube of type of theme of the house prosperity transaction multi-dimensional data from first database according to the inquiry request；According to the querying condition of the inquiry request, the achievement data for meeting the querying condition is obtained in the data cube, and using the achievement data as the response results of the inquiry request.Described device performs the above method.The processing method and processing device of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data, meet the achievement data of querying condition by being obtained in data cube, and using achievement data as query result, it can realize the query demand to multi-dimensional data and improve efficiency data query.
Description
Technical field
The present embodiments relate to house prosperity transaction technical field of data processing, and in particular to one kind is based on house prosperity transaction multidimensional
The processing method and processing device of the data query of degrees of data.
Background technology
In the data analysis process to house prosperity transaction, since the content that house prosperity transaction data are related to is quite extensive, such as：
Regional Distribution, source of houses data, the owner being related to, customer data etc., so that data scale is huge, database of the prior art is past
Toward to carry out comprehensive inquiry to thousands of in multiple tables of data or even more than one hundred million datas, on the one hand cause search efficiency low,
On the other hand it can not meet the query demand to multi-dimensional data.
Therefore, how drawbacks described above is avoided, realize the query demand to multi-dimensional data and improves efficiency data query,
As need solve the problems, such as.
Invention content
In view of the problems of the existing technology, the embodiment of the present invention provides a kind of number based on house prosperity transaction multi-dimensional data
It is investigated that the processing method and processing device ask.
In a first aspect, the embodiment of the present invention provides a kind of processing side of the data query based on house prosperity transaction multi-dimensional data
Method, the method includes：
Receive the inquiry request of house prosperity transaction multi-dimensional data；
It is obtained and the type of theme of the house prosperity transaction multi-dimensional data from first database according to the inquiry request
Corresponding data cube；The first database is previously stored with the house prosperity transaction multi-dimensional data phase with each type of theme
Corresponding data cube；
According to the querying condition of the inquiry request, the index for meeting the querying condition is obtained in the data cube
Data, and using the achievement data as the response results of the inquiry request；The achievement data is stored in advance in the number
According to cube in.
Second aspect, the embodiment of the present invention provide a kind of processing dress of data query based on house prosperity transaction multi-dimensional data
It puts, described device includes：
First acquisition unit, for receiving the inquiry request of house prosperity transaction multi-dimensional data；
Second acquisition unit, for being obtained from first database according to the inquiry request and the house prosperity transaction multidimensional
The corresponding data cube of type of theme of degrees of data；The first database is previously stored with the house property with each type of theme
The transaction corresponding data cube of multi-dimensional data；
Third acquiring unit for the querying condition according to the inquiry request, is obtained in the data cube and is met
The achievement data of the querying condition, and using the achievement data as the response results of the inquiry request；The index number
According to being stored in advance in the data cube.
The third aspect, the embodiment of the present invention provide a kind of electronic equipment, including：Processor, memory and bus, wherein,
The processor and the memory complete mutual communication by the bus；
The memory is stored with the program instruction that can be performed by the processor, and the processor calls described program to refer to
Order is able to carry out following method：
Receive the inquiry request of house prosperity transaction multi-dimensional data；
It is obtained and the type of theme of the house prosperity transaction multi-dimensional data from first database according to the inquiry request
Corresponding data cube；The first database is previously stored with the house prosperity transaction multi-dimensional data phase with each type of theme
Corresponding data cube；
According to the querying condition of the inquiry request, the index for meeting the querying condition is obtained in the data cube
Data, and using the achievement data as the response results of the inquiry request；The achievement data is stored in advance in the number
According to cube in.
Fourth aspect, the embodiment of the present invention provide a kind of non-transient computer readable storage medium storing program for executing, including：
The non-transient computer readable storage medium storing program for executing stores computer instruction, and the computer instruction makes the computer
Perform following method：
Receive the inquiry request of house prosperity transaction multi-dimensional data；
It is obtained and the type of theme of the house prosperity transaction multi-dimensional data from first database according to the inquiry request
Corresponding data cube；The first database is previously stored with the house prosperity transaction multi-dimensional data phase with each type of theme
Corresponding data cube；
According to the querying condition of the inquiry request, the index for meeting the querying condition is obtained in the data cube
Data, and using the achievement data as the response results of the inquiry request；The achievement data is stored in advance in the number
According to cube in.
The processing method and processing device of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data is led to
It crosses to obtain in data cube and meets the achievement data of querying condition, and using achievement data as query result, can realize pair
The query demand of multi-dimensional data simultaneously improves efficiency data query.
Description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Some bright embodiments, for those of ordinary skill in the art, without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is that the process flow of data query of the embodiment of the present invention based on house prosperity transaction multi-dimensional data is illustrated
Figure；
Fig. 2 is the main-process stream of the processing method of data query of the embodiment of the present invention based on house prosperity transaction multi-dimensional data
Figure；
Fig. 3 is the processing unit structural representation of data query of the embodiment of the present invention based on house prosperity transaction multi-dimensional data
Figure；
Fig. 4 is electronic equipment entity structure schematic diagram provided in an embodiment of the present invention.
Specific embodiment
Purpose, technical scheme and advantage to make the embodiment of the present invention are clearer, below in conjunction with the embodiment of the present invention
In attached drawing, the technical solution in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
All other embodiments obtained without creative efforts shall fall within the protection scope of the present invention.
Fig. 1 is that the process flow of data query of the embodiment of the present invention based on house prosperity transaction multi-dimensional data is illustrated
Figure, as shown in Figure 1, a kind of processing side of data query based on house prosperity transaction multi-dimensional data provided in an embodiment of the present invention
Method includes the following steps：
S1：Receive the inquiry request of house prosperity transaction multi-dimensional data.
Specifically, device receives the inquiry request of house prosperity transaction multi-dimensional data.There are many house prosperity transaction multi-dimensional datas
Type of theme can include house prosperity transaction source of houses data, house prosperity transaction fetched data and house prosperity transaction customer data.
S2：It is obtained and the theme class of the house prosperity transaction multi-dimensional data from first database according to the inquiry request
The corresponding data cube of type；The first database is previously stored with the house prosperity transaction multi-dimensional data with each type of theme
Corresponding data cube.
Specifically, device obtains and the house prosperity transaction multi-dimensional data according to the inquiry request from first database
The corresponding data cube of type of theme；The first database is previously stored with more with the house prosperity transaction of each type of theme
The corresponding data cube of dimension data.First database can be that Apache Kylin, Apache Kylin are one and increase income
Distributed analysis engine, provide SQL query interface and multidimensional analysis (OLAP) ability on Hadoop so that super large to be supported to advise
Modulus evidence, it can inquire huge Hive tables in submicrosecond.Data cube can be Kylin Cube, be illustrated below：It is main
It is house prosperity transaction source of houses data, house prosperity transaction fetched data and house prosperity transaction customer data to inscribe type, can correspond to one respectively
Data cube, i.e. data cube A correspond to house prosperity transaction source of houses data；Data cube B corresponds to house prosperity transaction fetched data；Data are stood
Square C corresponds to room house prosperity transaction customer data.Can in first database using key assignments storage by the way of prestore with each
The corresponding data cube of house prosperity transaction multi-dimensional data of type of theme, so as to rapidly be obtained from first database
Data.
S3：According to the querying condition of the inquiry request, obtained in the data cube and meet the querying condition
Achievement data, and using the achievement data as the response results of the inquiry request；The achievement data is stored in advance in institute
It states in data cube.
Specifically, querying condition of the device according to the inquiry request, obtains in the data cube and is looked into described in meeting
The achievement data of inquiry condition, and using the achievement data as the response results of the inquiry request；The achievement data is advance
It is stored in the data cube.Querying condition can include inquiring the period of data and/or inquire where data
Region (province, city, area, county etc.), by above-mentioned type of theme for house prosperity transaction fetched data, to be described as follows：Inquiry request people
Input inquiry condition is：Average value of the Haidian District, Beijing City in the house prosperity transaction fetched data in October, 2017 is looked into
It askes, then achievement data is exactly average value of the Haidian District, Beijing City in the house prosperity transaction fetched data in October, 2017.It needs
Bright is：The house prosperity transaction multi-dimensional data of each type of theme can correspond to multiple achievement datas, and each data cube can be with
Prestore multiple achievement datas.With reference to the example above, achievement data is in addition to above-mentioned Haidian District, Beijing City is in October, 2017
Other than the average value of the house prosperity transaction fetched data of part, house prosperity transaction of the Haidian District, Beijing City in October, 2017 can also be
Maximum value, minimum value, standard deviation, mean square deviation of fetched data etc..
The processing method of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data, by number
According to cube in obtain and meet the achievement data of querying condition, and using achievement data as query result, can realize to various dimensions
The query demand of data simultaneously improves efficiency data query.
On the basis of above-described embodiment, the achievement data prestores, including：
House prosperity transaction data are obtained from the second database.
Specifically, device obtains house prosperity transaction data from the second database.Second database can include HDFS,
Hive, Hbase etc..
The house prosperity transaction data are divided into multiple type of theme, each type of theme pair of the multiple type of theme
Each dimension data of house prosperity transaction multi-dimensional data described in Ying Yu.
Specifically, the house prosperity transaction data are divided into multiple type of theme by device, the multiple type of theme it is every
One type of theme corresponds to each dimension data of the house prosperity transaction multi-dimensional data.With reference to the example above：That is type of theme a
Corresponding house prosperity transaction source of houses data (one of dimension data of multi-dimensional data)；Type of theme b corresponds to house prosperity transaction conclusion of the business
Data (one of dimension data of multi-dimensional data)；Type of theme c corresponds to room house prosperity transaction customer data (multi-dimensional data
One of dimension data).
Calculate the corresponding various dimensions statistical data of each dimension data, and by each statistics of the various dimensions statistical data
Data are stored in as the achievement data, and by the achievement data in the data cube.
Specifically, device calculates the corresponding various dimensions statistical data of each dimension data, and by the various dimensions statistical number
According to each statistical data be stored in the data cube as the achievement data, and by the achievement data.With reference to upper
State it is bright, by type of theme for for house prosperity transaction fetched data：Haidian District, Beijing City is in the house prosperity transaction in October, 2017
Each statistical data of average value, maximum value, minimum value, standard deviation, the mean square deviation of fetched data etc. can be used as achievement data.
Above-mentioned average value, maximum value, minimum value, standard deviation, mean square deviation etc. are used as various dimensions statistical data.Type of theme is handed over for house property
The situation of easy source of houses data and house prosperity transaction customer data, similarly repeats no more.
The processing method of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data, can realize
Achievement data prestores, and ensure that being smoothed out for this method.
On the basis of above-described embodiment, the various dimensions statistical data is including statistical data temporally and/or by area
The statistical data in domain；Correspondingly, the achievement data is the achievement data and/or the index number by range statistics temporally counted
According to.
Specifically, the various dimensions statistical data includes statistical data temporally and/or the statistical data by region；Phase
Ying Di, the achievement data are the achievement datas and/or the achievement data by range statistics temporally counted.It can refer to above-mentioned reality
Example is applied, is repeated no more.
The processing method of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data, by will be more
Dimension statistical data is specifically chosen to be statistical data and/or the statistical data by region temporally, so as to temporally be united
The achievement data of meter and/or the achievement data by range statistics, further ensure being smoothed out for this method.
On the basis of above-described embodiment, before described the step of house prosperity transaction data are obtained from the second database, institute
The method of stating further includes：
The update operation log to the house prosperity transaction data is obtained from third database.
Specifically, device obtains the update operation log to the house prosperity transaction data from third database.Third number
Can be MySQL according to library.Update operation can include data increase, data deletion, data modification etc., and update operation log is pair
Above-mentioned data increase, data are deleted, data modification operation record.
Parse the update operation log, and the house prosperity transaction in the second database according to analysis result synchronized update
Data.
Specifically, device parses the update operation log, and the second database according to analysis result synchronized update
In house prosperity transaction data.The Binlog daily records of MySQL can be parsed, and pass through a kind of canal (the Binlog processing of MySQL
Tool) update operation log is parsed, analysis result can include data increase, data deletion, data modification etc., according to
House prosperity transaction data in the second database of analysis result synchronized update, specifically include：If analysis result, which is data, to be increased,
The synchronous house prosperity transaction data increased in the second database, data are deleted, data modification situations such as, repeat no more.
It, can also will update operation log distribution for the house prosperity transaction data in preferably the second database of synchronized update
Into Kafka message queues, the data in Kafka are read using Apache Spark Streaming, which is synchronized to
In second database Hbase, it is further ensured that real-time property and accuracy.
Newer house prosperity transaction data are divided into multiple type of theme, each type of theme of the multiple type of theme
Corresponding to each dimension data of newer house prosperity transaction multi-dimensional data.
Specifically, newer house prosperity transaction data are divided into multiple type of theme by device, the multiple type of theme
Each type of theme corresponds to each dimension data of newer house prosperity transaction multi-dimensional data.It can refer in above-described embodiment not
Newer situation, repeats no more.
Recalculate the corresponding newer various dimensions statistical data of newer each dimension data, and by newer various dimensions
Each statistical data of statistical data is stored in the data cube as newer achievement data, and by newer achievement data
In.
Specifically, device recalculates the corresponding newer various dimensions statistical data of newer each dimension data, and will
Each statistical data of newer various dimensions statistical data is stored in as newer achievement data, and by newer achievement data
In the data cube.Not newer situation in above-described embodiment is can refer to, is repeated no more.
The processing method of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data, passes through update
Achievement data can be better achieved the query demand to multi-dimensional data and improve efficiency data query.
On the basis of above-described embodiment, the type of theme of the house prosperity transaction multi-dimensional data, including：
House prosperity transaction source of houses data, house prosperity transaction fetched data and house prosperity transaction customer data.
Specifically, the type of theme of the house prosperity transaction multi-dimensional data in device, including：House prosperity transaction source of houses number
According to, house prosperity transaction fetched data and house prosperity transaction customer data.Above-described embodiment is can refer to, is repeated no more.
The processing method of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data, by that will lead
Topic type is selected as house prosperity transaction source of houses data, house prosperity transaction fetched data and house prosperity transaction customer data, has further expanded more
The type of theme of dimension data.
On the basis of above-described embodiment, the method further includes：
It is prestored by the way of key assignments storage corresponding with the house prosperity transaction multi-dimensional data of each type of theme
Data cube.
Specifically, device prestores the house prosperity transaction multidimensional number of degrees with each type of theme by the way of key assignments storage
According to corresponding data cube.Above-described embodiment is can refer to, is repeated no more.
The processing method of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data, by using
The mode of key assignments storage prestores the corresponding data cube of house prosperity transaction multi-dimensional data with each type of theme, into one
Step can improve efficiency data query.
On the basis of above-described embodiment, the data cube is Kylin Cube.
Specifically, the data cube in device is Kylin Cube.Above-described embodiment is can refer to, is repeated no more.
The processing method of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data, by that will count
Kylin Cube are selected as according to cube, be further able to realize the query demand to multi-dimensional data and improve efficiency data query.
Fig. 2 is the main-process stream of the processing method of data query of the embodiment of the present invention based on house prosperity transaction multi-dimensional data
Figure, is briefly described the processing method of the data query based on house prosperity transaction multi-dimensional data with reference to Fig. 2：
(1) the update operation log to the house prosperity transaction data is obtained from MySQL (third database).
(2) update operation log is distributed in Kafka message queues.
(3) data (update in Kafka is read using Spark Streaming (Apache Spark Streaming)
Operation log), which is synchronized in the second database Hbase.
(4) the newer house prosperity transaction data in the second database are divided into multiple type of theme, multiple type of theme
Each type of theme correspond to newer house prosperity transaction multi-dimensional data each dimension data (" multidimensional number in corresponding diagram 2
According to definition " and " task scheduling ").
(5) the corresponding newer various dimensions statistical data of newer each dimension data is recalculated (in corresponding diagram 2
" index calculates partially ").
(6) using each statistical data of newer various dimensions statistical data as newer achievement data, and will be newer
Achievement data is stored in data cube (" structure data cube " in corresponding diagram 2).
(7) inquiry request (" Kylin Query " in corresponding diagram 2) of house prosperity transaction multi-dimensional data is obtained.
(8) first database (Fig. 2 is shows) is transferred, and is obtained and the house prosperity transaction various dimensions from first database
The corresponding data cube of type of theme (" Kylin Cube " in corresponding diagram 2) of data.
(9) according to the querying condition of inquiry request, the achievement data for meeting querying condition is obtained in data cube, and will
Response results of the achievement data as inquiry request.
Fig. 3 is the processing unit structural representation of data query of the embodiment of the present invention based on house prosperity transaction multi-dimensional data
Figure, as shown in figure 3, the processing dress an embodiment of the present invention provides a kind of data query based on house prosperity transaction multi-dimensional data
It puts, including first acquisition unit 1, second acquisition unit 2 and third acquiring unit 3, wherein：
First acquisition unit 1 is used to receive the inquiry request of house prosperity transaction multi-dimensional data；Second acquisition unit 2 is used for root
It is obtained and the corresponding number of type of theme of the house prosperity transaction multi-dimensional data from first database according to the inquiry request
According to cube；The first database is previously stored with the corresponding data of house prosperity transaction multi-dimensional data with each type of theme
Cube；Third acquiring unit 3 is used for the querying condition according to the inquiry request, is obtained in the data cube described in meeting
The achievement data of querying condition, and using the achievement data as the response results of the inquiry request；The achievement data is pre-
It is first stored in the data cube.
Specifically, first acquisition unit 1 is used to receive the inquiry request of house prosperity transaction multi-dimensional data；Second acquisition unit
2 is opposite with the type of theme of the house prosperity transaction multi-dimensional data for being obtained from first database according to the inquiry request
The data cube answered；The first database is previously stored with corresponding with the house prosperity transaction multi-dimensional data of each type of theme
Data cube；Third acquiring unit 3 is used for the querying condition according to the inquiry request, is obtained in the data cube full
The achievement data of the foot querying condition, and using the achievement data as the response results of the inquiry request；The index
Data are stored in advance in the data cube.
The processing unit of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data, by number
According to cube in obtain and meet the achievement data of querying condition, and using achievement data as query result, can realize to various dimensions
The query demand of data simultaneously improves efficiency data query.
The processing unit of data query provided in an embodiment of the present invention based on house prosperity transaction multi-dimensional data specifically can be with
For performing the process flow of above-mentioned each method embodiment, details are not described herein for function, is referred to above method embodiment
Detailed description.
Fig. 4 is electronic equipment entity structure schematic diagram provided in an embodiment of the present invention, as shown in figure 4, the electronic equipment
Including：Processor (processor) 401, memory (memory) 402 and bus 403；
Wherein, the processor 401, memory 402 complete mutual communication by bus 403；
The processor 401 is used to call the program instruction in the memory 402, to perform above-mentioned each method embodiment
The method provided, such as including：Receive the inquiry request of house prosperity transaction multi-dimensional data；According to the inquiry request from first
The corresponding data cube of type of theme with the house prosperity transaction multi-dimensional data is obtained in database；The first database
It is previously stored with the corresponding data cube of house prosperity transaction multi-dimensional data with each type of theme；According to the inquiry request
Querying condition, obtained in the data cube and meet the achievement data of the querying condition, and the achievement data is made
Response results for the inquiry request；The achievement data is stored in advance in the data cube.
The present embodiment discloses a kind of computer program product, and the computer program product includes being stored in non-transient calculating
Computer program on machine readable storage medium storing program for executing, the computer program include program instruction, when described program instruction is calculated
When machine performs, computer is able to carry out the method that above-mentioned each method embodiment is provided, such as including：Receive house prosperity transaction multidimensional
The inquiry request of degrees of data；It is obtained and the house prosperity transaction multi-dimensional data from first database according to the inquiry request
The corresponding data cube of type of theme；The first database is previously stored with the house prosperity transaction multidimensional with each type of theme
The corresponding data cube of degrees of data；According to the querying condition of the inquiry request, obtained in the data cube and meet institute
The achievement data of querying condition is stated, and using the achievement data as the response results of the inquiry request；The achievement data
It is stored in advance in the data cube.
The present embodiment provides a kind of non-transient computer readable storage medium storing program for executing, the non-transient computer readable storage medium storing program for executing
Computer instruction is stored, the computer instruction makes the computer perform the method that above-mentioned each method embodiment is provided, example
Such as include：Receive the inquiry request of house prosperity transaction multi-dimensional data；Obtained from first database according to the inquiry request with
The corresponding data cube of type of theme of the house prosperity transaction multi-dimensional data；The first database be previously stored with often
The corresponding data cube of house prosperity transaction multi-dimensional data of a type of theme；According to the querying condition of the inquiry request,
The achievement data for meeting the querying condition is obtained in the data cube, and using the achievement data as the inquiry request
Response results；The achievement data is stored in advance in the data cube.
One of ordinary skill in the art will appreciate that：Realizing all or part of step of above method embodiment can pass through
The relevant hardware of program instruction is completed, and aforementioned program can be stored in a computer read/write memory medium, the program
When being executed, step including the steps of the foregoing method embodiments is performed；And aforementioned storage medium includes：ROM, RAM, magnetic disc or light
The various media that can store program code such as disk.
The embodiments such as electronic equipment described above are only schematical, illustrate wherein described as separating component
Unit may or may not be physically separate, and the component shown as unit may or may not be object
Manage unit, you can be located at a place or can also be distributed in multiple network element.It can select according to the actual needs
Some or all of module therein is selected to realize the purpose of this embodiment scheme.Those of ordinary skill in the art are not paying wound
In the case of the labour for the property made, you can to understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It is realized by the mode of software plus required general hardware platform, naturally it is also possible to pass through hardware.Based on such understanding, on
Technical solution is stated substantially in other words to embody the part that the prior art contributes in the form of software product, it should
Computer software product can store in a computer-readable storage medium, such as ROM/RAM, magnetic disc, CD, including several fingers
It enables and (can be personal computer, server or the network equipment etc.) so that computer equipment is used to perform each implementation
Method described in certain parts of example or embodiment.
Finally it should be noted that：The above various embodiments is only to illustrate the technical solution of the embodiment of the present invention rather than right
It is limited；Although the embodiment of the present invention is described in detail with reference to foregoing embodiments, the ordinary skill of this field
Personnel should understand that：It can still modify to the technical solution recorded in foregoing embodiments or to which part
Or all technical features carries out equivalent replacement；And these modifications or replacement, it does not separate the essence of the corresponding technical solution
The range of each embodiment technical solution of the embodiment of the present invention.
Claims (10)
1. a kind of processing method of the data query based on house prosperity transaction multi-dimensional data, which is characterized in that including：
Receive the inquiry request of house prosperity transaction multi-dimensional data；
It is obtained from first database according to the inquiry request opposite with the type of theme of the house prosperity transaction multi-dimensional data
The data cube answered；The first database is previously stored with corresponding with the house prosperity transaction multi-dimensional data of each type of theme
Data cube；
According to the querying condition of the inquiry request, the index number for meeting the querying condition is obtained in the data cube
According to, and using the achievement data as the response results of the inquiry request；The achievement data is stored in advance in the data
In cube.
2. according to the method described in claim 1, it is characterized in that, the achievement data prestores, including：
House prosperity transaction data are obtained from the second database；
The house prosperity transaction data are divided into multiple type of theme, each type of theme of the multiple type of theme corresponds to
Each dimension data of the house prosperity transaction multi-dimensional data；
Calculate the corresponding various dimensions statistical data of each dimension data, and by each statistical data of the various dimensions statistical data
It is stored in the data cube as the achievement data, and by the achievement data.
3. according to the method described in claim 2, it is characterized in that, the various dimensions statistical data includes statistical number temporally
According to and/or by region statistical data；Correspondingly, the achievement data is the achievement data that temporally counts and/or by region
The achievement data of statistics.
4. according to the method described in claim 2, it is characterized in that, described obtain house prosperity transaction data from the second database
Before step, the method further includes：
The update operation log to the house prosperity transaction data is obtained from third database；
Parse the update operation log, and the house prosperity transaction number in the second database according to analysis result synchronized update
According to；
Newer house prosperity transaction data are divided into multiple type of theme, each type of theme of the multiple type of theme corresponds to
In each dimension data of newer house prosperity transaction multi-dimensional data；
The corresponding newer various dimensions statistical data of newer each dimension data is recalculated, and newer various dimensions are counted
Each statistical data of data is stored in as newer achievement data, and by newer achievement data in the data cube.
5. method according to any one of claims 1 to 4, which is characterized in that the theme of the house prosperity transaction multi-dimensional data
Type, including：
House prosperity transaction source of houses data, house prosperity transaction fetched data and house prosperity transaction customer data.
6. method according to any one of claims 1 to 4, which is characterized in that the method further includes：
The corresponding data of house prosperity transaction multi-dimensional data with each type of theme are prestored by the way of key assignments storage
Cube.
7. method according to any one of claims 1 to 4, which is characterized in that the data cube is Kylin Cube.
8. a kind of processing unit of the data query based on house prosperity transaction multi-dimensional data, which is characterized in that including：
First acquisition unit, for receiving the inquiry request of house prosperity transaction multi-dimensional data；
Second acquisition unit, for being obtained from first database according to the inquiry request and the house prosperity transaction multidimensional number of degrees
According to the corresponding data cube of type of theme；The first database is previously stored with the house prosperity transaction with each type of theme
The corresponding data cube of multi-dimensional data；
Third acquiring unit for the querying condition according to the inquiry request, obtains described in meeting in the data cube
The achievement data of querying condition, and using the achievement data as the response results of the inquiry request；The achievement data is pre-
It is first stored in the data cube.
9. a kind of electronic equipment, which is characterized in that including：Processor, memory and bus, wherein,
The processor and the memory complete mutual communication by the bus；
The memory is stored with the program instruction that can be performed by the processor, and the processor calls described program instruction energy
Enough methods performed as described in claim 1 to 7 is any.
10. a kind of non-transient computer readable storage medium storing program for executing, which is characterized in that the non-transient computer readable storage medium storing program for executing is deposited
Computer instruction is stored up, the computer instruction makes the computer perform the method as described in claim 1 to 7 is any.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711320241.4A CN108182204A (en) | 2017-12-12 | 2017-12-12 | The processing method and processing device of data query based on house prosperity transaction multi-dimensional data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711320241.4A CN108182204A (en) | 2017-12-12 | 2017-12-12 | The processing method and processing device of data query based on house prosperity transaction multi-dimensional data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108182204A true CN108182204A (en) | 2018-06-19 |
Family
ID=62546141
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711320241.4A Withdrawn CN108182204A (en) | 2017-12-12 | 2017-12-12 | The processing method and processing device of data query based on house prosperity transaction multi-dimensional data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108182204A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108920670A (en) * | 2018-07-06 | 2018-11-30 | 深圳市小牛在线互联网信息咨询有限公司 | Cache synchronization method, device, system and storage medium |
| CN110032591A (en) * | 2018-12-28 | 2019-07-19 | 国网浙江省电力有限公司信息通信分公司 | A kind of assets big data intelligent analysis method |
| CN110347788A (en) * | 2019-06-12 | 2019-10-18 | 平安科技（深圳）有限公司 | Service inquiry method, apparatus and storage medium, computer equipment |
| CN117539920A (en) * | 2024-01-04 | 2024-02-09 | 上海途里信息科技有限公司 | Data query method and system based on real estate transaction multidimensional data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130339291A1 (en) * | 2012-06-14 | 2013-12-19 | Jason Steven Hasner | Presentation of Data Cube |
| US8880459B2 (en) * | 2008-03-07 | 2014-11-04 | Microsoft Corporation | Navigation across datasets from multiple data sources based on a common reference dimension |
| CN106126604A (en) * | 2016-06-20 | 2016-11-16 | 华南理工大学 | A kind of social security data log analysis process system based on Distributed Data Warehouse |
| CN107169070A (en) * | 2017-05-08 | 2017-09-15 | 山大地纬软件股份有限公司 | The constructing system and its method in a kind of social security index warehouse based on big data |
-
2017
- 2017-12-12 CN CN201711320241.4A patent/CN108182204A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8880459B2 (en) * | 2008-03-07 | 2014-11-04 | Microsoft Corporation | Navigation across datasets from multiple data sources based on a common reference dimension |
| US20130339291A1 (en) * | 2012-06-14 | 2013-12-19 | Jason Steven Hasner | Presentation of Data Cube |
| CN106126604A (en) * | 2016-06-20 | 2016-11-16 | 华南理工大学 | A kind of social security data log analysis process system based on Distributed Data Warehouse |
| CN107169070A (en) * | 2017-05-08 | 2017-09-15 | 山大地纬软件股份有限公司 | The constructing system and its method in a kind of social security index warehouse based on big data |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108920670A (en) * | 2018-07-06 | 2018-11-30 | 深圳市小牛在线互联网信息咨询有限公司 | Cache synchronization method, device, system and storage medium |
| CN110032591A (en) * | 2018-12-28 | 2019-07-19 | 国网浙江省电力有限公司信息通信分公司 | A kind of assets big data intelligent analysis method |
| CN110347788A (en) * | 2019-06-12 | 2019-10-18 | 平安科技（深圳）有限公司 | Service inquiry method, apparatus and storage medium, computer equipment |
| CN117539920A (en) * | 2024-01-04 | 2024-02-09 | 上海途里信息科技有限公司 | Data query method and system based on real estate transaction multidimensional data |
| CN117539920B (en) * | 2024-01-04 | 2024-04-05 | 上海途里信息科技有限公司 | Data query method and system based on real estate transaction multidimensional data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11281793B2 (en) | User permission data query method and apparatus, electronic device and medium | |
| CN110427434B (en) | Multidimensional data query method and device | |
| CN104123374B (en) | The method and device of aggregate query in distributed data base | |
| JP6697392B2 (en) | Transparent discovery of semi-structured data schema | |
| CN105183735B (en) | The querying method and inquiry unit of data | |
| CN107688500A (en) | A kind of distributed task scheduling processing method, device, system and equipment | |
| CN108182204A (en) | The processing method and processing device of data query based on house prosperity transaction multi-dimensional data | |
| CN108733713A (en) | Data query method and device in data warehouse | |
| CN109492012A (en) | A kind of method, apparatus and storage medium of data real-time statistics and retrieval | |
| CN104899295B (en) | A kind of heterogeneous data source data relation analysis method | |
| CN108052635A (en) | A kind of heterogeneous data source unifies conjunctive query method | |
| CN109241159B (en) | Partition query method and system for data cube and terminal equipment | |
| CN108664516A (en) | Enquiring and optimizing method and relevant apparatus | |
| Ahmed et al. | A literature review on NoSQL database for big data processing | |
| CN106293891B (en) | Multidimensional investment index monitoring method | |
| CN109033109A (en) | Data processing method and system | |
| EP2526479A1 (en) | Accessing large collection object tables in a database | |
| US11321318B2 (en) | Dynamic access paths | |
| CN110716950A (en) | Method, device and equipment for establishing aperture system and computer storage medium | |
| CN105138676A (en) | Sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation | |
| CN109829003A (en) | Database backup method and device | |
| CN104866603A (en) | Calling method of metadata and metadata managing system | |
| CN110888909B (en) | Data statistical processing method and device for evaluation content | |
| CN115827646A (en) | Index configuration method and device and electronic equipment | |
| CN109063201B (en) | Impala online interactive query method based on mixed storage scheme |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20180619 |