CN106294826B - A kind of company-data Query method in real time and system - Google Patents

A kind of company-data Query method in real time and system Download PDF

Info

Publication number
CN106294826B
CN106294826B CN201610681964.6A CN201610681964A CN106294826B CN 106294826 B CN106294826 B CN 106294826B CN 201610681964 A CN201610681964 A CN 201610681964A CN 106294826 B CN106294826 B CN 106294826B
Authority
CN
China
Prior art keywords
data
inquiry
company
module
real time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610681964.6A
Other languages
Chinese (zh)
Other versions
CN106294826A (en
Inventor
孙肇华
高洪涛
蒙进财
唐兵兵
白志凌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing VRV Software Corp Ltd
Original Assignee
Beijing VRV Software Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing VRV Software Corp Ltd filed Critical Beijing VRV Software Corp Ltd
Priority to CN201610681964.6A priority Critical patent/CN106294826B/en
Publication of CN106294826A publication Critical patent/CN106294826A/en
Application granted granted Critical
Publication of CN106294826B publication Critical patent/CN106294826B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention provides a kind of company-data Query method in real time and systems, wherein for company-data Query method in real time the following steps are included: obtaining the inquiry request of client, the inquiry request carries the address contents of the inquiry data;The inquiry request is sent to the Hbase database interface of Hadoop company-data platform and reads inquiry data;The inquiry data are written in temporary file, the temporary file is located in the caching of query service device;The temporary file is sent to the client.The embodiment of the present invention is reduced by the setting of caching realizes the real-time query of company-data so that the query time of company-data be made to become second grade from minute grade to the inquiry times of database and the speed with client data transmission.

Description

A kind of company-data Query method in real time and system
Technical field
The present invention relates to technical field of data processing, in particular to a kind of company-data Query method in real time and are System.
Background technique
With popularizing for large-scale internet application, the magnanimity of network information data increases severely, and big data is quietly to people The everyway lived produce tremendous influence.Feature Hadoop cheap with its, stable, general is increasingly becoming each row Industry carries out the main platform of mass data collection, storage and analysis;HBase is stored using Hadoop HDFS as its file The PostgreSQL databases distributed, towards column of system.
Under the big data background epoch, data volume presents T grades of growth, meets people to the need of various data It asks;But then, the sharp increase of data volume results in the increase of data query time, and traditional data query mode cannot expire Sufficient people are for the real-time query demand of company-data, and inefficient data query mode makes platform user be difficult to be based on Real-time, effectively platform data, which is made, quickly, timely reacts.
Summary of the invention
In view of this, can be realized the purpose of the present invention is to provide a kind of company-data Query method in real time and system The real-time query of company-data.
In a first aspect, the embodiment of the invention provides a kind of company-data Query method in real time, comprising the following steps:
The inquiry request of client is obtained, inquiry request carries the address contents of inquiry data;
Inquiry request is sent to the Hbase database interface of Hadoop company-data platform and reads inquiry data;
Inquiry data are written in temporary file, temporary file is located in the caching of query service device;
Temporary file is sent to client.
With reference to first aspect, the embodiment of the invention provides the first possible embodiments of first aspect, wherein also Including data processing step, the specific steps are as follows:
Duplicate removal step carries out duplicate removal to the inquiry data in temporary file, the repeated data in removal inquiry data;
Inquiry data after duplicate removal are carried out collect statistics by statistic procedure;
Inquiry data after duplicate removal are associated analysis, excavate the inner link of inquiry data by associated steps;
Inquiry data after association analysis are carried out integrity verification analysis, ensure that data by integrity verifying step Integrality and safety.
The possible real-time mode of with reference to first aspect the first, the embodiment of the invention provides second of first aspect Possible embodiment, wherein in associated steps, the range of the support of association analysis is 1-10, and the range of confidence level is 0- 1。
With reference to first aspect, the embodiment of the invention provides the third possible embodiments of first aspect, wherein also Including warning step, the process of reading and write-in temporary file to inquiry data is measured in real time, and to write-in time-out Early warning is carried out, so that administrative staff be made to take corresponding Disposal Measures in time.
With reference to first aspect and its first to three kind of possible embodiment, the embodiment of the invention provides first aspects 4th kind of possible embodiment, wherein caching is by Java EHCache module creation.
Second aspect, the embodiment of the present invention also provide a kind of company-data real time inquiry system, including client, inquiry clothes Business device and Hadoop company-data platform, Hadoop company-data platform include Hbase database;
Client is requested for input inquiry, and inquiry request carries the address contents of inquiry data;
Query service device includes receiving module, interactive module, temporary storage module, cache module and sending module;
Receiving module is for receiving inquiry request;
Interactive module is for being sent to the Hbase database interface of Hadoop company-data platform for inquiry request and reading Inquire data;
For that will inquire in data write-in temporary file, temporary file is located in cache module temporary storage module;
Sending module is used to temporary file being sent to client.
In conjunction with second aspect, the embodiment of the invention provides the first possible embodiments of second aspect, wherein looks into Asking server further includes data processing module, and data processing module includes duplicate removal unit, statistic unit, associative cell and integrality Authentication unit:
Duplicate removal unit is used to carry out duplicate removal to the inquiry data in temporary file;
The inquiry data that statistic unit is used to export duplicate removal unit carry out collect statistics;
The inquiry data that associative cell is used to export duplicate removal unit are associated analysis;
The inquiry data that integrity verifying unit is used to export associative cell carry out integrity verification analysis.
In conjunction with the first possible embodiment of second aspect, the embodiment of the invention provides second of second aspect Possible embodiment, wherein in associative cell, the range of the support of association analysis is 1-10, and the range of confidence level is 0- 1。
In conjunction with second aspect, the embodiment of the invention provides the third possible embodiments of second aspect, wherein looks into Asking server further includes warning module, for keeping in text to interactive module reading inquiry data and by inquiry data write-in The process of part is measured in real time, and carries out early warning to write-in time-out.
In conjunction with second aspect and its first to the third possible embodiment, the embodiment of the invention provides second aspects The 4th kind of possible embodiment, wherein cache module is by Java EHCache module creation.
Present invention offers following the utility model has the advantages that
Query service device obtains the inquiry request of client in the present invention;Then inquiry request is sent to Hadoop cluster The Hbase database interface of data platform simultaneously reads inquiry data, and will inquire the temporary of data write-in query service device caching In file;Temporary file is finally sent to client.It is specified that the setting of query service device caching substantially increases data write-in The speed of file, and then the data transmission bauds of server Yu Hbase database is improved, make query service device in the threshold of setting More data can be disposably read in the value time, the gradation for avoiding big data obtains, the efficiency of data acquisition is improved, On the other hand, the setting of caching also improves the data transmission bauds of server and client, obtains client in moment Inquiry data in query service device caching.Therefore, the speed that temporary file is written in inquiry data is improved by the setting of caching Degree and the speed transmitted with client data, and then it is no more than the query time of single company-data 1 minute, realize collection The real-time query of group's data, and daily data-handling capacity reaches 500G or more.
Further, it retransmits after carrying out duplicate removal, statistics, association and integrity verification to the data in temporary file to client End both improves the validity of inquiry data, in turn ensures the integrality and safety of inquiry data.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention are in specification, claims And specifically noted structure is achieved and obtained in attached drawing.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate Appended attached drawing, is described in detail below.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this A little attached drawings obtain other relevant attached drawings.
Fig. 1 shows a kind of flow chart of company-data Query method in real time provided by the embodiment of the present invention 1;
Fig. 2 shows a kind of schematic diagrames of company-data real time inquiry system provided by the embodiment of the present invention 2;
Fig. 3 shows query service device in a kind of company-data real time inquiry system provided by the embodiment of the present invention 2 Schematic diagram.
1- client;2- query service device;21- receiving module;22- interactive module;23- cache module;24- keeps in mould Block;25- data processing module;26- warning module;27- sending module;3-Hbase database.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention Middle attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only It is a part of the embodiment of the present invention, instead of all the embodiments.Therefore, the implementation of the invention to providing in the accompanying drawings below The detailed description of example is not intended to limit the range of claimed invention, but is merely representative of selected implementation of the invention Example.Based on the embodiment of the present invention, those skilled in the art are obtained all without making creative work Other embodiments shall fall within the protection scope of the present invention.
Current company-data inquiry mode is unable to satisfy people for the demand of company-data real-time query, is based on this, A kind of company-data Query method in real time provided in an embodiment of the present invention and system, can be improved the search efficiency of company-data, Meets the needs of people are for company-data real-time query.
To be looked into real time a kind of company-data disclosed in the embodiment of the present invention first convenient for understanding the present embodiment Inquiry method describes in detail.
A kind of company-data Query method in real time, comprising the following steps:
S11. the inquiry request of client is obtained.
From client input inquiry request, if inquiry request be internet information, inquiry request include IP address and/or The address mac.
S12. inquiry request is sent to the Hbase database interface of Hadoop company-data platform and reads inquiry number According to.
Inquiry request is parsed to obtain inquiry address, inquiry address is then sent to Hbase database Native Java API, Zookeeper server is sought after obtaining inquiry address by Root, META and Client progress three-level Then the inquiry data being stored in HDFS corresponding to the Store in Region pointed by inquiry address, this reality are read in location Applying the inquiry data in example is website information data.
S13. it will inquire in the temporary file in data write-in query service device caching.
Query service device is cached to be created by the cache module EHCache of Java, inquires data for temporarily storing, caching The speed for substantially increasing data write-in specified file is set, and then the data for improving server and Hbase database are transmitted Speed makes query service device that can disposably read more data in the threshold time of setting, avoids point of big data Secondary acquisition improves the efficiency of data acquisition, and on the other hand, the setting of caching also improves server and the data of client pass Defeated speed allows client to obtain the inquiry data in query service device caching in moment.Therefore, the setting of caching passes through raising When the speed of data base querying data write-in temporary file and the speed transmitted with client data make the inquiry of company-data Between be no more than 1 minute, realize the real-time query of company-data.
S14. the process of warning step, reading and write-in temporary file to inquiry data is measured in real time, and right Write-in time-out carries out early warning.
Query service device real-time monitoring inquires the reading of data and the process of temporary file is written, if inquiry data are in threshold Do not have to complete to read the operation with write-in in the value time, then query service device pops up early warning dialog box, it is preferable that threshold time The upper limit is 2-3s;It is highly preferred that if inquiry data do not have to complete to read the operation with write-in, query service device in threshold time Also issue early warning auditory tone cues information.
S15. data processing step, for handling the inquiry data in temporary file, the specific steps are as follows:
Duplicate removal step realizes the duplicate removal of inquiry data, removal inquiry data by Bloom Filter Hash Duplicate Removal Algorithm In coincidence item, improve the validity of data;
Inquiry data after duplicate removal are carried out collect statistics, count the quantity of valid data by statistic procedure;
Associated steps carry out successively search using Aprior algorithm to realize association analysis;
Using the website information data after duplicate removal as Candidate Set, it is 2 that support, which is then arranged, confidence level 0.7, then not It is carried out disconnectedly from connection and beta pruning, until obtaining final Frequent Set, termination condition is, if obtained from connection It is no longer Frequent Set, then the Frequent Set for taking last time to obtain is result.Frequent Set in the present embodiment is some relevant Website, such as the website a, the website b, the website c, the website d etc., and the result that relevance is verified in the present embodiment is to have accessed a Website will access b and website c.
Inquiry data after association analysis are carried out integrity verification point using MD5 or null value method by integrity verifying step Analysis.
S16. temporary file is sent to client.
Inquiry data in temporary file after data processing are sent to client, since temporary file is located at inquiry In temporary file in server, therefore query service device can be by temporary file high-speed transfer to client.On the other hand, objective Family can be directly based upon that treated, and inquiry data make corresponding Disposal Measures, improve the utilization efficiency of inquiry data.
The present invention also provides a kind of embodiments of company-data real time inquiry system, shown referring to figure 2-3, the embodiment Provided company-data real time inquiry system includes client 1, query service device 2 and Hadoop company-data platform, Hadoop company-data platform includes Hbase database 3;
Client 1 is requested for input inquiry, and inquiry request carries the address contents of inquiry data;
Query service device 2 includes receiving module 21, interactive module 22, temporary storage module 24, cache module 23 and sending module 27;
Receiving module 21 is for receiving inquiry request;
Interactive module 22 is used to inquiry request being sent to 3 interface of Hbase database of Hadoop company-data platform simultaneously Read inquiry data;
For that will inquire in data write-in temporary file, temporary file is located in cache module 23 temporary storage module 24;
Sending module 27 is used to temporary file being sent to client 1.
User is requested by the Tomcat Web server input inquiry of client 1, uses the side Post in HTML form Formula submits the data to the receiving module 21 of query service device 2, and interactive module 22 sends the inquiry request in receiving module 21 It is looked into after to Native Java API, the Zookeeper server acquisition inquiry address of Hbase database 3 through three-level addressing reading Ask the inquiry data being stored in HDFS corresponding to the Store in Region pointed by address, the inquiry in the present embodiment Data are website information data.Temporary storage module 24 will inquire in data write-in temporary file, and temporary file is located at query service device 2 In the cache module 23 of memory, client 1 then is sent it to via sending module 27.
The another embodiment of the present embodiment, query service device 2 further include data processing module 25, data processing module 25 include duplicate removal unit, statistic unit, associative cell and integrity verifying unit:
Duplicate removal unit realizes the duplicate removal of inquiry data by Bloom Filter Hash Duplicate Removal Algorithm, and removal is inquired in data Coincidence item, improve the validity of data;
Inquiry data after duplicate removal are carried out collect statistics by statistic unit, count the quantity of valid data;
Associative cell successively search for realize association analysis, with the website information after duplicate removal using Aprior algorithm For data as Candidate Set, the range of the support of association analysis is 1-10, and the range of confidence level is 0-1, it is preferable that association analysis Support be 5, confidence level 0.4;Then it constantly carries out from connection and beta pruning, until obtaining final Frequent Set, Termination condition is, if what is obtained from connection is no longer Frequent Set, the Frequent Set for taking last time to obtain is result. Frequent Set in the present embodiment is some relevant station addresses, such as the website a, the website b, the website c, the website d etc., and this implementation In example the result of relevance verifying be have accessed the website a will access b and website c.
Inquiry data after association analysis are carried out integrity verification point using MD5 or null value method by integrity verifying unit Analysis.
The another embodiment of the present embodiment, query service device 2 further include warning module 26, and real-time monitoring inquires data Reading and the process of temporary file is written, if inquiry data in threshold time without completing write operation, pop-up is pre- Alert dialog box, it is preferable that threshold value 2s;It is highly preferred that if inquiry data can also in threshold time without completing write operation Issue early warning sound.
In addition, the cache module 23 of above embodiment is by Java EHCache module creation.
The computer program product of a kind of company-data Query method in real time and system provided by the embodiment of the present invention, packet The computer readable storage medium for storing program code is included, the instruction that said program code includes can be used for executing previous methods Method as described in the examples, specific implementation can be found in embodiment of the method, and details are not described herein.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description It with the specific work process of device, can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
Term " first ", " second ", " third " are used for description purposes only, and are not understood to indicate or imply relatively important Property.
In addition, in the description of the embodiment of the present invention unless specifically defined or limited otherwise, term " installation ", " phase Even ", " connection " shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or be integrally connected;It can To be mechanical connection, it is also possible to be electrically connected;It can be directly connected, can also can be indirectly connected through an intermediary Connection inside two elements.For the ordinary skill in the art, above-mentioned term can be understood at this with concrete condition Concrete meaning in invention.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention. And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (8)

1. a kind of company-data Query method in real time, which comprises the following steps:
The inquiry request of client is obtained, the inquiry request carries the address contents of inquiry data;
The inquiry request is sent to the Hbase database interface of Hadoop company-data platform and reads inquiry data;
The inquiry data are written in temporary file, the temporary file is located in the caching of query service device;It will be described temporary It deposits file and is sent to the client;
Further include data processing step, the specific steps are as follows: duplicate removal step, to the inquiry data in the temporary file into Row duplicate removal;The inquiry data after duplicate removal are carried out collect statistics by statistic procedure;Associated steps will be looked into described in after duplicate removal It askes data and is associated analysis;The inquiry data after association analysis are carried out integrity verification point by integrity verifying step Analysis.
2. company-data Query method in real time according to claim 1, which is characterized in that in the associated steps, association The range of the support of analysis is 1-10, and the range of confidence level is 0-1.
3. company-data Query method in real time according to claim 1, which is characterized in that further include:
The process of warning step, reading and the write-in temporary file to the inquiry data is measured in real time, and right Write-in time-out carries out early warning.
4. company-data Query method in real time according to claim 1-3, which is characterized in that it is described caching by Java EHCache module creation.
5. a kind of company-data real time inquiry system, which is characterized in that including client, query service device and Hadoop cluster number According to platform, the Hadoop company-data platform includes Hbase database;
The client is requested for input inquiry, and the inquiry request carries the address contents of inquiry data;
The query service device includes receiving module, interactive module, temporary storage module, cache module and sending module;
The receiving module is for receiving the inquiry request;
The interactive module is for connecing the Hbase database that the inquiry request is sent to the Hadoop company-data platform Mouth simultaneously reads inquiry data;
The temporary storage module is used to the inquiry data be written in temporary file, and the temporary file is located at the cache module In;The sending module is used to the temporary file being sent to the client;
The query service device further includes data processing module, and the data processing module includes duplicate removal unit, statistic unit, pass Receipts or other documents in duplicate member and integrity verifying unit:
The duplicate removal unit is used to carry out duplicate removal to the inquiry data in the temporary file;
The inquiry data that the statistic unit is used to export the duplicate removal unit carry out collect statistics;
The inquiry data that the associative cell is used to export the duplicate removal unit are associated analysis;
The inquiry data that the integrity verifying unit is used to export the associative cell carry out integrity verification analysis.
6. company-data real time inquiry system according to claim 5, which is characterized in that in the associative cell, association The range of the support of analysis is 1-10, and the range of confidence level is 0-1.
7. company-data real time inquiry system according to claim 5, which is characterized in that the query service device further includes Warning module, for reading the inquiry data to the interactive module and the temporary file being written in the inquiry data Process be measured in real time, and to write-in time-out carry out early warning.
8. according to the described in any item company-data real time inquiry systems of claim 5-7, which is characterized in that the cache module By Java EHCache module creation.
CN201610681964.6A 2016-08-17 2016-08-17 A kind of company-data Query method in real time and system Active CN106294826B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610681964.6A CN106294826B (en) 2016-08-17 2016-08-17 A kind of company-data Query method in real time and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610681964.6A CN106294826B (en) 2016-08-17 2016-08-17 A kind of company-data Query method in real time and system

Publications (2)

Publication Number Publication Date
CN106294826A CN106294826A (en) 2017-01-04
CN106294826B true CN106294826B (en) 2019-06-21

Family

ID=57678848

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610681964.6A Active CN106294826B (en) 2016-08-17 2016-08-17 A kind of company-data Query method in real time and system

Country Status (1)

Country Link
CN (1) CN106294826B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107480268A (en) * 2017-08-17 2017-12-15 北京奇虎科技有限公司 Data query method and device
CN108446985A (en) * 2018-03-21 2018-08-24 张家林 The share system and method for Portfolio Selection
CN108763300B (en) * 2018-04-19 2020-07-31 北京奇艺世纪科技有限公司 Data query method and device
CN110474938B (en) * 2018-05-09 2022-08-16 视联动力信息技术股份有限公司 Information query method and device
CN110727727B (en) * 2019-10-15 2023-01-10 深圳前海微众银行股份有限公司 Statistical method and device for database
CN110942599A (en) * 2019-11-22 2020-03-31 中国民航信息网络股份有限公司 Data monitoring method and system
CN111309702A (en) * 2020-02-28 2020-06-19 苏州浪潮智能科技有限公司 Method and system for aggregation between files
CN111522791B (en) * 2020-04-30 2023-05-30 电子科技大学 Distributed file repeated data deleting system and method
CN112463755B (en) * 2020-12-11 2023-08-18 同济大学 System and method for storing and reading big data of heterogeneous Internet of things based on HDFS

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104252536A (en) * 2014-09-16 2014-12-31 福建新大陆软件工程有限公司 Hbase-based internet log data inquiring method and device
CN104408084A (en) * 2014-11-06 2015-03-11 北京锐安科技有限公司 Method and device for screening big data
CN104598503A (en) * 2014-05-14 2015-05-06 腾讯科技(深圳)有限公司 Geographic information data inquiry method, device and system
CN105069151A (en) * 2015-08-24 2015-11-18 用友网络科技股份有限公司 HBase secondary index construction apparatus and method
CN105243072A (en) * 2014-07-11 2016-01-13 北京神州泰岳软件股份有限公司 Database query method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104598503A (en) * 2014-05-14 2015-05-06 腾讯科技(深圳)有限公司 Geographic information data inquiry method, device and system
CN105243072A (en) * 2014-07-11 2016-01-13 北京神州泰岳软件股份有限公司 Database query method and system
CN104252536A (en) * 2014-09-16 2014-12-31 福建新大陆软件工程有限公司 Hbase-based internet log data inquiring method and device
CN104408084A (en) * 2014-11-06 2015-03-11 北京锐安科技有限公司 Method and device for screening big data
CN105069151A (en) * 2015-08-24 2015-11-18 用友网络科技股份有限公司 HBase secondary index construction apparatus and method

Also Published As

Publication number Publication date
CN106294826A (en) 2017-01-04

Similar Documents

Publication Publication Date Title
CN106294826B (en) A kind of company-data Query method in real time and system
CN104794162B (en) Real-time data memory and querying method
CN103955502B (en) A kind of visualization OLAP application realization method and system
CN105183912B (en) Abnormal log determines method and apparatus
CN101202966B (en) Method, system and apparatus for collecting user information
CN110147398A (en) A kind of data processing method, device, medium and electronic equipment
CN104092770B (en) Enterprises book management method and system based on cloud computing
CN104714965B (en) Static resource De-weight method, static resource management method and device
US20030093645A1 (en) Methods and apparatus for implementing host-based object storage schemes
CN101282342B (en) Method and system for fetching network contents
CN107251526A (en) The network address translation
CN105354251B (en) Electric power cloud data management indexing means based on Hadoop in electric system
CN105611000B (en) A kind of DNS domain name method for quickly retrieving of name server
CN112699154B (en) Multi-level caching method for large-flow data
CN103546517B (en) Network information push system and method
CN102307206A (en) Caching system and caching method for rapidly accessing virtual machine images based on cloud storage
CN111258978A (en) Data storage method
CN104424258A (en) Multidimensional data query method and system, query server and column storage server
CN106649828A (en) Data query method and system
CN103139301A (en) Internet access accelerating method and device which are used in content distribution network system
CN106933614A (en) A kind of single-page application upgrade method and device
CN104778229A (en) Telecommunication service small file storage system and method based on Hadoop
CN110472004A (en) A kind of method and system of scientific and technological information data multilevel cache management
CN108616581A (en) Data-storage system and method based on OLAP/OLTP mixing applications
CN104426838A (en) Internet cache scheduling method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant