CN106294826B - A kind of company-data Query method in real time and system - Google Patents
A kind of company-data Query method in real time and system Download PDFInfo
- Publication number
- CN106294826B CN106294826B CN201610681964.6A CN201610681964A CN106294826B CN 106294826 B CN106294826 B CN 106294826B CN 201610681964 A CN201610681964 A CN 201610681964A CN 106294826 B CN106294826 B CN 106294826B
- Authority
- CN
- China
- Prior art keywords
- data
- inquiry
- company
- module
- real time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of company-data Query method in real time and systems, wherein for company-data Query method in real time the following steps are included: obtaining the inquiry request of client, the inquiry request carries the address contents of the inquiry data;The inquiry request is sent to the Hbase database interface of Hadoop company-data platform and reads inquiry data;The inquiry data are written in temporary file, the temporary file is located in the caching of query service device;The temporary file is sent to the client.The embodiment of the present invention is reduced by the setting of caching realizes the real-time query of company-data so that the query time of company-data be made to become second grade from minute grade to the inquiry times of database and the speed with client data transmission.
Description
Technical field
The present invention relates to technical field of data processing, in particular to a kind of company-data Query method in real time and are
System.
Background technique
With popularizing for large-scale internet application, the magnanimity of network information data increases severely, and big data is quietly to people
The everyway lived produce tremendous influence.Feature Hadoop cheap with its, stable, general is increasingly becoming each row
Industry carries out the main platform of mass data collection, storage and analysis;HBase is stored using Hadoop HDFS as its file
The PostgreSQL databases distributed, towards column of system.
Under the big data background epoch, data volume presents T grades of growth, meets people to the need of various data
It asks;But then, the sharp increase of data volume results in the increase of data query time, and traditional data query mode cannot expire
Sufficient people are for the real-time query demand of company-data, and inefficient data query mode makes platform user be difficult to be based on
Real-time, effectively platform data, which is made, quickly, timely reacts.
Summary of the invention
In view of this, can be realized the purpose of the present invention is to provide a kind of company-data Query method in real time and system
The real-time query of company-data.
In a first aspect, the embodiment of the invention provides a kind of company-data Query method in real time, comprising the following steps:
The inquiry request of client is obtained, inquiry request carries the address contents of inquiry data;
Inquiry request is sent to the Hbase database interface of Hadoop company-data platform and reads inquiry data;
Inquiry data are written in temporary file, temporary file is located in the caching of query service device;
Temporary file is sent to client.
With reference to first aspect, the embodiment of the invention provides the first possible embodiments of first aspect, wherein also
Including data processing step, the specific steps are as follows:
Duplicate removal step carries out duplicate removal to the inquiry data in temporary file, the repeated data in removal inquiry data;
Inquiry data after duplicate removal are carried out collect statistics by statistic procedure;
Inquiry data after duplicate removal are associated analysis, excavate the inner link of inquiry data by associated steps;
Inquiry data after association analysis are carried out integrity verification analysis, ensure that data by integrity verifying step
Integrality and safety.
The possible real-time mode of with reference to first aspect the first, the embodiment of the invention provides second of first aspect
Possible embodiment, wherein in associated steps, the range of the support of association analysis is 1-10, and the range of confidence level is 0-
1。
With reference to first aspect, the embodiment of the invention provides the third possible embodiments of first aspect, wherein also
Including warning step, the process of reading and write-in temporary file to inquiry data is measured in real time, and to write-in time-out
Early warning is carried out, so that administrative staff be made to take corresponding Disposal Measures in time.
With reference to first aspect and its first to three kind of possible embodiment, the embodiment of the invention provides first aspects
4th kind of possible embodiment, wherein caching is by Java EHCache module creation.
Second aspect, the embodiment of the present invention also provide a kind of company-data real time inquiry system, including client, inquiry clothes
Business device and Hadoop company-data platform, Hadoop company-data platform include Hbase database;
Client is requested for input inquiry, and inquiry request carries the address contents of inquiry data;
Query service device includes receiving module, interactive module, temporary storage module, cache module and sending module;
Receiving module is for receiving inquiry request;
Interactive module is for being sent to the Hbase database interface of Hadoop company-data platform for inquiry request and reading
Inquire data;
For that will inquire in data write-in temporary file, temporary file is located in cache module temporary storage module;
Sending module is used to temporary file being sent to client.
In conjunction with second aspect, the embodiment of the invention provides the first possible embodiments of second aspect, wherein looks into
Asking server further includes data processing module, and data processing module includes duplicate removal unit, statistic unit, associative cell and integrality
Authentication unit:
Duplicate removal unit is used to carry out duplicate removal to the inquiry data in temporary file;
The inquiry data that statistic unit is used to export duplicate removal unit carry out collect statistics;
The inquiry data that associative cell is used to export duplicate removal unit are associated analysis;
The inquiry data that integrity verifying unit is used to export associative cell carry out integrity verification analysis.
In conjunction with the first possible embodiment of second aspect, the embodiment of the invention provides second of second aspect
Possible embodiment, wherein in associative cell, the range of the support of association analysis is 1-10, and the range of confidence level is 0-
1。
In conjunction with second aspect, the embodiment of the invention provides the third possible embodiments of second aspect, wherein looks into
Asking server further includes warning module, for keeping in text to interactive module reading inquiry data and by inquiry data write-in
The process of part is measured in real time, and carries out early warning to write-in time-out.
In conjunction with second aspect and its first to the third possible embodiment, the embodiment of the invention provides second aspects
The 4th kind of possible embodiment, wherein cache module is by Java EHCache module creation.
Present invention offers following the utility model has the advantages that
Query service device obtains the inquiry request of client in the present invention;Then inquiry request is sent to Hadoop cluster
The Hbase database interface of data platform simultaneously reads inquiry data, and will inquire the temporary of data write-in query service device caching
In file;Temporary file is finally sent to client.It is specified that the setting of query service device caching substantially increases data write-in
The speed of file, and then the data transmission bauds of server Yu Hbase database is improved, make query service device in the threshold of setting
More data can be disposably read in the value time, the gradation for avoiding big data obtains, the efficiency of data acquisition is improved,
On the other hand, the setting of caching also improves the data transmission bauds of server and client, obtains client in moment
Inquiry data in query service device caching.Therefore, the speed that temporary file is written in inquiry data is improved by the setting of caching
Degree and the speed transmitted with client data, and then it is no more than the query time of single company-data 1 minute, realize collection
The real-time query of group's data, and daily data-handling capacity reaches 500G or more.
Further, it retransmits after carrying out duplicate removal, statistics, association and integrity verification to the data in temporary file to client
End both improves the validity of inquiry data, in turn ensures the integrality and safety of inquiry data.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention are in specification, claims
And specifically noted structure is achieved and obtained in attached drawing.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate
Appended attached drawing, is described in detail below.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair
The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 shows a kind of flow chart of company-data Query method in real time provided by the embodiment of the present invention 1;
Fig. 2 shows a kind of schematic diagrames of company-data real time inquiry system provided by the embodiment of the present invention 2;
Fig. 3 shows query service device in a kind of company-data real time inquiry system provided by the embodiment of the present invention 2
Schematic diagram.
1- client;2- query service device;21- receiving module;22- interactive module;23- cache module;24- keeps in mould
Block;25- data processing module;26- warning module;27- sending module;3-Hbase database.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
Middle attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only
It is a part of the embodiment of the present invention, instead of all the embodiments.Therefore, the implementation of the invention to providing in the accompanying drawings below
The detailed description of example is not intended to limit the range of claimed invention, but is merely representative of selected implementation of the invention
Example.Based on the embodiment of the present invention, those skilled in the art are obtained all without making creative work
Other embodiments shall fall within the protection scope of the present invention.
Current company-data inquiry mode is unable to satisfy people for the demand of company-data real-time query, is based on this,
A kind of company-data Query method in real time provided in an embodiment of the present invention and system, can be improved the search efficiency of company-data,
Meets the needs of people are for company-data real-time query.
To be looked into real time a kind of company-data disclosed in the embodiment of the present invention first convenient for understanding the present embodiment
Inquiry method describes in detail.
A kind of company-data Query method in real time, comprising the following steps:
S11. the inquiry request of client is obtained.
From client input inquiry request, if inquiry request be internet information, inquiry request include IP address and/or
The address mac.
S12. inquiry request is sent to the Hbase database interface of Hadoop company-data platform and reads inquiry number
According to.
Inquiry request is parsed to obtain inquiry address, inquiry address is then sent to Hbase database
Native Java API, Zookeeper server is sought after obtaining inquiry address by Root, META and Client progress three-level
Then the inquiry data being stored in HDFS corresponding to the Store in Region pointed by inquiry address, this reality are read in location
Applying the inquiry data in example is website information data.
S13. it will inquire in the temporary file in data write-in query service device caching.
Query service device is cached to be created by the cache module EHCache of Java, inquires data for temporarily storing, caching
The speed for substantially increasing data write-in specified file is set, and then the data for improving server and Hbase database are transmitted
Speed makes query service device that can disposably read more data in the threshold time of setting, avoids point of big data
Secondary acquisition improves the efficiency of data acquisition, and on the other hand, the setting of caching also improves server and the data of client pass
Defeated speed allows client to obtain the inquiry data in query service device caching in moment.Therefore, the setting of caching passes through raising
When the speed of data base querying data write-in temporary file and the speed transmitted with client data make the inquiry of company-data
Between be no more than 1 minute, realize the real-time query of company-data.
S14. the process of warning step, reading and write-in temporary file to inquiry data is measured in real time, and right
Write-in time-out carries out early warning.
Query service device real-time monitoring inquires the reading of data and the process of temporary file is written, if inquiry data are in threshold
Do not have to complete to read the operation with write-in in the value time, then query service device pops up early warning dialog box, it is preferable that threshold time
The upper limit is 2-3s;It is highly preferred that if inquiry data do not have to complete to read the operation with write-in, query service device in threshold time
Also issue early warning auditory tone cues information.
S15. data processing step, for handling the inquiry data in temporary file, the specific steps are as follows:
Duplicate removal step realizes the duplicate removal of inquiry data, removal inquiry data by Bloom Filter Hash Duplicate Removal Algorithm
In coincidence item, improve the validity of data;
Inquiry data after duplicate removal are carried out collect statistics, count the quantity of valid data by statistic procedure;
Associated steps carry out successively search using Aprior algorithm to realize association analysis;
Using the website information data after duplicate removal as Candidate Set, it is 2 that support, which is then arranged, confidence level 0.7, then not
It is carried out disconnectedly from connection and beta pruning, until obtaining final Frequent Set, termination condition is, if obtained from connection
It is no longer Frequent Set, then the Frequent Set for taking last time to obtain is result.Frequent Set in the present embodiment is some relevant
Website, such as the website a, the website b, the website c, the website d etc., and the result that relevance is verified in the present embodiment is to have accessed a
Website will access b and website c.
Inquiry data after association analysis are carried out integrity verification point using MD5 or null value method by integrity verifying step
Analysis.
S16. temporary file is sent to client.
Inquiry data in temporary file after data processing are sent to client, since temporary file is located at inquiry
In temporary file in server, therefore query service device can be by temporary file high-speed transfer to client.On the other hand, objective
Family can be directly based upon that treated, and inquiry data make corresponding Disposal Measures, improve the utilization efficiency of inquiry data.
The present invention also provides a kind of embodiments of company-data real time inquiry system, shown referring to figure 2-3, the embodiment
Provided company-data real time inquiry system includes client 1, query service device 2 and Hadoop company-data platform,
Hadoop company-data platform includes Hbase database 3;
Client 1 is requested for input inquiry, and inquiry request carries the address contents of inquiry data;
Query service device 2 includes receiving module 21, interactive module 22, temporary storage module 24, cache module 23 and sending module
27;
Receiving module 21 is for receiving inquiry request;
Interactive module 22 is used to inquiry request being sent to 3 interface of Hbase database of Hadoop company-data platform simultaneously
Read inquiry data;
For that will inquire in data write-in temporary file, temporary file is located in cache module 23 temporary storage module 24;
Sending module 27 is used to temporary file being sent to client 1.
User is requested by the Tomcat Web server input inquiry of client 1, uses the side Post in HTML form
Formula submits the data to the receiving module 21 of query service device 2, and interactive module 22 sends the inquiry request in receiving module 21
It is looked into after to Native Java API, the Zookeeper server acquisition inquiry address of Hbase database 3 through three-level addressing reading
Ask the inquiry data being stored in HDFS corresponding to the Store in Region pointed by address, the inquiry in the present embodiment
Data are website information data.Temporary storage module 24 will inquire in data write-in temporary file, and temporary file is located at query service device 2
In the cache module 23 of memory, client 1 then is sent it to via sending module 27.
The another embodiment of the present embodiment, query service device 2 further include data processing module 25, data processing module
25 include duplicate removal unit, statistic unit, associative cell and integrity verifying unit:
Duplicate removal unit realizes the duplicate removal of inquiry data by Bloom Filter Hash Duplicate Removal Algorithm, and removal is inquired in data
Coincidence item, improve the validity of data;
Inquiry data after duplicate removal are carried out collect statistics by statistic unit, count the quantity of valid data;
Associative cell successively search for realize association analysis, with the website information after duplicate removal using Aprior algorithm
For data as Candidate Set, the range of the support of association analysis is 1-10, and the range of confidence level is 0-1, it is preferable that association analysis
Support be 5, confidence level 0.4;Then it constantly carries out from connection and beta pruning, until obtaining final Frequent Set,
Termination condition is, if what is obtained from connection is no longer Frequent Set, the Frequent Set for taking last time to obtain is result.
Frequent Set in the present embodiment is some relevant station addresses, such as the website a, the website b, the website c, the website d etc., and this implementation
In example the result of relevance verifying be have accessed the website a will access b and website c.
Inquiry data after association analysis are carried out integrity verification point using MD5 or null value method by integrity verifying unit
Analysis.
The another embodiment of the present embodiment, query service device 2 further include warning module 26, and real-time monitoring inquires data
Reading and the process of temporary file is written, if inquiry data in threshold time without completing write operation, pop-up is pre-
Alert dialog box, it is preferable that threshold value 2s;It is highly preferred that if inquiry data can also in threshold time without completing write operation
Issue early warning sound.
In addition, the cache module 23 of above embodiment is by Java EHCache module creation.
The computer program product of a kind of company-data Query method in real time and system provided by the embodiment of the present invention, packet
The computer readable storage medium for storing program code is included, the instruction that said program code includes can be used for executing previous methods
Method as described in the examples, specific implementation can be found in embodiment of the method, and details are not described herein.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description
It with the specific work process of device, can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
Term " first ", " second ", " third " are used for description purposes only, and are not understood to indicate or imply relatively important
Property.
In addition, in the description of the embodiment of the present invention unless specifically defined or limited otherwise, term " installation ", " phase
Even ", " connection " shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or be integrally connected;It can
To be mechanical connection, it is also possible to be electrically connected;It can be directly connected, can also can be indirectly connected through an intermediary
Connection inside two elements.For the ordinary skill in the art, above-mentioned term can be understood at this with concrete condition
Concrete meaning in invention.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (8)
1. a kind of company-data Query method in real time, which comprises the following steps:
The inquiry request of client is obtained, the inquiry request carries the address contents of inquiry data;
The inquiry request is sent to the Hbase database interface of Hadoop company-data platform and reads inquiry data;
The inquiry data are written in temporary file, the temporary file is located in the caching of query service device;It will be described temporary
It deposits file and is sent to the client;
Further include data processing step, the specific steps are as follows: duplicate removal step, to the inquiry data in the temporary file into
Row duplicate removal;The inquiry data after duplicate removal are carried out collect statistics by statistic procedure;Associated steps will be looked into described in after duplicate removal
It askes data and is associated analysis;The inquiry data after association analysis are carried out integrity verification point by integrity verifying step
Analysis.
2. company-data Query method in real time according to claim 1, which is characterized in that in the associated steps, association
The range of the support of analysis is 1-10, and the range of confidence level is 0-1.
3. company-data Query method in real time according to claim 1, which is characterized in that further include:
The process of warning step, reading and the write-in temporary file to the inquiry data is measured in real time, and right
Write-in time-out carries out early warning.
4. company-data Query method in real time according to claim 1-3, which is characterized in that it is described caching by
Java EHCache module creation.
5. a kind of company-data real time inquiry system, which is characterized in that including client, query service device and Hadoop cluster number
According to platform, the Hadoop company-data platform includes Hbase database;
The client is requested for input inquiry, and the inquiry request carries the address contents of inquiry data;
The query service device includes receiving module, interactive module, temporary storage module, cache module and sending module;
The receiving module is for receiving the inquiry request;
The interactive module is for connecing the Hbase database that the inquiry request is sent to the Hadoop company-data platform
Mouth simultaneously reads inquiry data;
The temporary storage module is used to the inquiry data be written in temporary file, and the temporary file is located at the cache module
In;The sending module is used to the temporary file being sent to the client;
The query service device further includes data processing module, and the data processing module includes duplicate removal unit, statistic unit, pass
Receipts or other documents in duplicate member and integrity verifying unit:
The duplicate removal unit is used to carry out duplicate removal to the inquiry data in the temporary file;
The inquiry data that the statistic unit is used to export the duplicate removal unit carry out collect statistics;
The inquiry data that the associative cell is used to export the duplicate removal unit are associated analysis;
The inquiry data that the integrity verifying unit is used to export the associative cell carry out integrity verification analysis.
6. company-data real time inquiry system according to claim 5, which is characterized in that in the associative cell, association
The range of the support of analysis is 1-10, and the range of confidence level is 0-1.
7. company-data real time inquiry system according to claim 5, which is characterized in that the query service device further includes
Warning module, for reading the inquiry data to the interactive module and the temporary file being written in the inquiry data
Process be measured in real time, and to write-in time-out carry out early warning.
8. according to the described in any item company-data real time inquiry systems of claim 5-7, which is characterized in that the cache module
By Java EHCache module creation.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610681964.6A CN106294826B (en) | 2016-08-17 | 2016-08-17 | A kind of company-data Query method in real time and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610681964.6A CN106294826B (en) | 2016-08-17 | 2016-08-17 | A kind of company-data Query method in real time and system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106294826A CN106294826A (en) | 2017-01-04 |
CN106294826B true CN106294826B (en) | 2019-06-21 |
Family
ID=57678848
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610681964.6A Active CN106294826B (en) | 2016-08-17 | 2016-08-17 | A kind of company-data Query method in real time and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106294826B (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107480268A (en) * | 2017-08-17 | 2017-12-15 | 北京奇虎科技有限公司 | Data query method and device |
CN108446985A (en) * | 2018-03-21 | 2018-08-24 | 张家林 | The share system and method for Portfolio Selection |
CN108763300B (en) * | 2018-04-19 | 2020-07-31 | 北京奇艺世纪科技有限公司 | Data query method and device |
CN110474938B (en) * | 2018-05-09 | 2022-08-16 | 视联动力信息技术股份有限公司 | Information query method and device |
CN110727727B (en) * | 2019-10-15 | 2023-01-10 | 深圳前海微众银行股份有限公司 | Statistical method and device for database |
CN110942599A (en) * | 2019-11-22 | 2020-03-31 | 中国民航信息网络股份有限公司 | Data monitoring method and system |
CN111309702A (en) * | 2020-02-28 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Method and system for aggregation between files |
CN111522791B (en) * | 2020-04-30 | 2023-05-30 | 电子科技大学 | Distributed file repeated data deleting system and method |
CN112463755B (en) * | 2020-12-11 | 2023-08-18 | 同济大学 | System and method for storing and reading big data of heterogeneous Internet of things based on HDFS |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104252536A (en) * | 2014-09-16 | 2014-12-31 | 福建新大陆软件工程有限公司 | Hbase-based internet log data inquiring method and device |
CN104408084A (en) * | 2014-11-06 | 2015-03-11 | 北京锐安科技有限公司 | Method and device for screening big data |
CN104598503A (en) * | 2014-05-14 | 2015-05-06 | 腾讯科技(深圳)有限公司 | Geographic information data inquiry method, device and system |
CN105069151A (en) * | 2015-08-24 | 2015-11-18 | 用友网络科技股份有限公司 | HBase secondary index construction apparatus and method |
CN105243072A (en) * | 2014-07-11 | 2016-01-13 | 北京神州泰岳软件股份有限公司 | Database query method and system |
-
2016
- 2016-08-17 CN CN201610681964.6A patent/CN106294826B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104598503A (en) * | 2014-05-14 | 2015-05-06 | 腾讯科技(深圳)有限公司 | Geographic information data inquiry method, device and system |
CN105243072A (en) * | 2014-07-11 | 2016-01-13 | 北京神州泰岳软件股份有限公司 | Database query method and system |
CN104252536A (en) * | 2014-09-16 | 2014-12-31 | 福建新大陆软件工程有限公司 | Hbase-based internet log data inquiring method and device |
CN104408084A (en) * | 2014-11-06 | 2015-03-11 | 北京锐安科技有限公司 | Method and device for screening big data |
CN105069151A (en) * | 2015-08-24 | 2015-11-18 | 用友网络科技股份有限公司 | HBase secondary index construction apparatus and method |
Also Published As
Publication number | Publication date |
---|---|
CN106294826A (en) | 2017-01-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106294826B (en) | A kind of company-data Query method in real time and system | |
CN104794162B (en) | Real-time data memory and querying method | |
CN103955502B (en) | A kind of visualization OLAP application realization method and system | |
CN105183912B (en) | Abnormal log determines method and apparatus | |
CN101202966B (en) | Method, system and apparatus for collecting user information | |
CN110147398A (en) | A kind of data processing method, device, medium and electronic equipment | |
CN104092770B (en) | Enterprises book management method and system based on cloud computing | |
CN104714965B (en) | Static resource De-weight method, static resource management method and device | |
US20030093645A1 (en) | Methods and apparatus for implementing host-based object storage schemes | |
CN101282342B (en) | Method and system for fetching network contents | |
CN107251526A (en) | The network address translation | |
CN105354251B (en) | Electric power cloud data management indexing means based on Hadoop in electric system | |
CN105611000B (en) | A kind of DNS domain name method for quickly retrieving of name server | |
CN112699154B (en) | Multi-level caching method for large-flow data | |
CN103546517B (en) | Network information push system and method | |
CN102307206A (en) | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage | |
CN111258978A (en) | Data storage method | |
CN104424258A (en) | Multidimensional data query method and system, query server and column storage server | |
CN106649828A (en) | Data query method and system | |
CN103139301A (en) | Internet access accelerating method and device which are used in content distribution network system | |
CN106933614A (en) | A kind of single-page application upgrade method and device | |
CN104778229A (en) | Telecommunication service small file storage system and method based on Hadoop | |
CN110472004A (en) | A kind of method and system of scientific and technological information data multilevel cache management | |
CN108616581A (en) | Data-storage system and method based on OLAP/OLTP mixing applications | |
CN104426838A (en) | Internet cache scheduling method and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |