CN106294826A - A kind of company-data Query method in real time and system - Google Patents
A kind of company-data Query method in real time and system Download PDFInfo
- Publication number
- CN106294826A CN106294826A CN201610681964.6A CN201610681964A CN106294826A CN 106294826 A CN106294826 A CN 106294826A CN 201610681964 A CN201610681964 A CN 201610681964A CN 106294826 A CN106294826 A CN 106294826A
- Authority
- CN
- China
- Prior art keywords
- data
- inquiry
- company
- real time
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
The invention provides a kind of company-data Query method in real time and system, wherein, company-data Query method in real time comprises the following steps: obtaining the inquiry request of client, described inquiry request carries the address contents of described inquiry data；Described inquiry request is sent to the Hbase data base interface of Hadoop company-data platform and reads inquiry data；By in described inquiry data write temporary file, described temporary file is positioned in the caching of inquiry server；Described temporary file is sent to described client.The embodiment of the present invention decreases the inquiry times to data base and the speed with client data transmission by the setting of caching, so that the query time of company-data is become second level from a minute level, it is achieved that the real-time query of company-data.
Description
Technical field
The present invention relates to technical field of data processing, in particular to a kind of company-data Query method in real time and be
System.
Background technology
Along with popularizing of large-scale internet application, the magnanimity of network information data increases severely, and big data are the most quietly to people
The everyway lived create tremendous influence.Hadoop is cheap with it, stable, general feature is increasingly becoming each row
Industry carries out mass data collection, the main platform storing and analyzing；HBase is to utilize Hadoop HDFS to store as its file
System distributed, towards row PostgreSQL database.
Under the big data background epoch, data volume presents the growth of T level, meets people's need to various data
Ask；But then, the sharp increase of data volume result in the increase of data query time, and traditional data query mode can not expire
Foot people for the real-time query demand of company-data, and the data query mode of poor efficiency make platform user be difficult to based on
In real time, effective platform data is made quickly, is reacted timely.
Summary of the invention
In view of this, it is an object of the invention to provide a kind of company-data Query method in real time and system, it is possible to realize
The real-time query of company-data.
First aspect, embodiments provides a kind of company-data Query method in real time, comprises the following steps:
Obtaining the inquiry request of client, inquiry request carries the address contents of inquiry data；
Inquiry request is sent to the Hbase data base interface of Hadoop company-data platform and reads inquiry data；
Writing in temporary file by inquiry data, temporary file is positioned in the caching of inquiry server；
Temporary file is sent to client.
In conjunction with first aspect, embodiments provide the first possible embodiment of first aspect, wherein, also
Including data processing step, specifically comprise the following steps that
Inquiry data in temporary file are carried out duplicate removal by duplicate removal step, remove the repetition data in inquiry data；
Inquiry data after duplicate removal are carried out collecting statistics by statistic procedure；
Inquiry data after duplicate removal are associated analyzing, excavate the internal relation of inquiry data by associated steps；
Inquiry data after association analysis are carried out integrity verification analysis, it is ensured that data by integrity verifying step
Integrity and safety.
In conjunction with the first possible real-time mode of first aspect, embodiments provide the second of first aspect
Possible embodiment, wherein, in associated steps, the support of association analysis is in the range of 1-10, and confidence level is in the range of 0-
1。
In conjunction with first aspect, embodiments provide the third possible embodiment of first aspect, wherein, also
Including warning step, the reading of inquiry data and the process of write temporary file are detected in real time, and to write time-out
Carry out early warning, so that management personnel take corresponding Disposal Measures in time.
In conjunction with the embodiment that first aspect and the first to three kind are possible, embodiments provide first aspect
4th kind of possible embodiment, wherein, caching is by Java EHCache module creation.
Second aspect, the embodiment of the present invention also provides for a kind of company-data real time inquiry system, including client, inquiry clothes
Business device and Hadoop company-data platform, Hadoop company-data platform includes Hbase data base；
Client is asked for input inquiry, and inquiry request carries the address contents of inquiry data；
Inquiry server includes receiver module, interactive module, temporary storage module, cache module and sending module；
Receiver module is used for receiving inquiry request；
Interactive module is for sending inquiry request to the Hbase data base interface of Hadoop company-data platform and reading
Inquiry data；
Temporary storage module is for writing inquiry data in temporary file, and temporary file is positioned in cache module；
Sending module is for sending temporary file to client.
In conjunction with second aspect, embodiments provide the first possible embodiment of second aspect, wherein, look into
Asking server and also include data processing module, data processing module includes duplicate removal unit, statistic unit, associative cell and integrity
Authentication unit:
Duplicate removal unit is for carrying out duplicate removal to the inquiry data in temporary file；
Statistic unit is for collecting statistics to the inquiry data of duplicate removal unit output；
Associative cell is for being associated analyzing to the inquiry data of duplicate removal unit output；
Integrity verifying unit is for carrying out integrity verification analysis to the inquiry data of associative cell output.
In conjunction with the first possible embodiment of second aspect, embodiments provide the second of second aspect
Possible embodiment, wherein, in associative cell, the support of association analysis is in the range of 1-10, and confidence level is in the range of 0-
1。
In conjunction with second aspect, embodiments provide the third possible embodiment of second aspect, wherein, look into
Ask server and also include warning module, for described interactive module being read inquiry data and by the inquiry temporary literary composition of data write
The process of part detects in real time, and write time-out is carried out early warning.
In conjunction with second aspect and first to the third possible embodiment, embodiments provide second aspect
The 4th kind of possible embodiment, wherein, cache module is by Java EHCache module creation.
Present invention offers following beneficial effect:
The present invention inquires about server and obtains the inquiry request of client；Then inquiry request is sent to Hadoop cluster
The Hbase data base interface of data platform also reads inquiry data, and will inquiry data write inquiry server buffer temporary
In file；Finally temporary file is sent to client.The setting of inquiry server buffer substantially increases data write and specifies
The speed of file, and then improve the data transmission bauds of server and Hbase data base, make inquiry server at the threshold set
More data can be disposably read, it is to avoid the gradation of big data obtains, and improves the efficiency of data acquisition in the value time,
On the other hand, the setting of caching also improves the data transmission bauds of server and client, makes client can obtain in moment
Inquiry data in inquiry server buffer.Therefore, the speed of inquiry data write temporary file is improve by the setting of caching
Degree and the speed with client data transmission, and then make the query time of single company-data less than 1 minute, it is achieved that collection
The real-time query of group's data, and the data-handling capacity of every day reaches more than 500G.
Further, the data in temporary file are carried out duplicate removal, adds up, associate and retransmit to client after integrity verification
End, had both improve the effectiveness of inquiry data, in turn ensure that integrity and the safety of inquiry data.
Other features and advantages of the present invention will illustrate in the following description, and, partly become from description
Obtain it is clear that or understand by implementing the present invention.The purpose of the present invention and other advantages are at description, claims
And specifically noted structure realizes and obtains in accompanying drawing.
For making the above-mentioned purpose of the present invention, feature and advantage to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by embodiment required use attached
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, and it is right to be therefore not construed as
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to according to this
A little accompanying drawings obtain other relevant accompanying drawings.
Fig. 1 shows the flow chart of a kind of company-data Query method in real time that the embodiment of the present invention 1 provided；
Fig. 2 shows the schematic diagram of a kind of company-data real time inquiry system that the embodiment of the present invention 2 provided；
Fig. 3 shows and inquires about server in a kind of company-data real time inquiry system that the embodiment of the present invention 2 is provided
Schematic diagram.
1-client；2-inquires about server；21-receiver module；22-interactive module；23-cache module；24-keeps in mould
Block；25-data processing module；26-warning module；27-sending module；3-Hbase data base.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with the embodiment of the present invention
Middle accompanying drawing, is clearly and completely described the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only
It is a part of embodiment of the present invention rather than whole embodiments.Therefore, enforcement to the present invention provided in the accompanying drawings below
The detailed description of example is not intended to limit the scope of claimed invention, but is merely representative of the selected enforcement of the present invention
Example.Based on embodiments of the invention, it is all that those skilled in the art are obtained on the premise of not making creative work
Other embodiments, broadly fall into the scope of protection of the invention.
Current company-data inquiry mode cannot meet people's demand for company-data real-time query, based on this,
A kind of company-data Query method in real time of embodiment of the present invention offer and system, can improve the search efficiency of company-data,
Meet people's demand for company-data real-time query.
For ease of the present embodiment is understood, first a kind of company-data disclosed in the embodiment of the present invention is looked in real time
Inquiry method describes in detail.
A kind of company-data Query method in real time, comprises the following steps:
S11. the inquiry request of client is obtained.
From client input inquiry ask, if inquiry request is internet information, then inquiry request include IP address and/or
Mac address.
S12. inquiry request sent to the Hbase data base interface of Hadoop company-data platform and read inquiry number
According to.
Inquiry request is carried out parsing and obtains inquiring about address, then inquiry address is sent to Hbase data base's
Native Java API, Zookeeper server carries out three grades by Root, META and Client after obtaining inquiry address and seeks
Location, then reads the inquiry data in the inquiry HDFS corresponding to the Store being stored in Region pointed by address, this reality
Executing the inquiry data in example is website information data.
S13. by the temporary file in inquiry data write inquiry server buffer.
Inquiry server buffer is created by the cache module EHCache of Java, for temporarily depositing inquiry data, caching
The speed substantially increasing data write specified file is set, and then improves the data transmission of server and Hbase data base
Speed, makes inquiry server can disposably read more data in the threshold time set, it is to avoid big data point
Secondary acquisition, improves the efficiency of data acquisition, and on the other hand, the setting of caching also improves the data biography of server and client
Defeated speed, makes client can obtain the inquiry data in inquiry server buffer in moment.Therefore, the setting of caching is by improving
When the speed of data base querying data write temporary file and the speed with client data transmission make the inquiry of company-data
Between less than 1 minute, it is achieved that the real-time query of company-data.
S14. warning step, detects in real time to the reading of inquiry data and the process of write temporary file, and right
Write time-out carries out early warning.
Inquiry server monitors reading and the process of write temporary file of inquiry data in real time, if inquiry data are at threshold
Do not complete in the value time to read and the operation of write, then inquiry server ejects early warning dialog box, it is preferable that threshold time
The upper limit is 2-3s；If it is highly preferred that inquiry data do not complete to read and the operation of write in threshold time, inquiring about server
Also send early warning auditory tone cues information.
S15. data processing step, for processing the inquiry data in temporary file, specifically comprises the following steps that
Duplicate removal step, realizes the duplicate removal of inquiry data by Bloom Filter Hash Duplicate Removal Algorithm, removes inquiry data
In coincidence item, improve data effectiveness；
Inquiry data after duplicate removal are carried out collecting statistics, the quantity of statistics valid data by statistic procedure；
Associated steps, uses Aprior algorithm successively to search for realize correlation analysis；
Using the website information data after duplicate removal as Candidate Set, then arranging support is 2, and confidence level is 0.7, the most not
Carrying out from connecting and beta pruning, until obtaining final Frequent Set, end condition is disconnectedly, if obtained from connecting
It is no longer Frequent Set, then taking the Frequent Set obtained for the last time is result.Frequent Set in the present embodiment is that some are relevant
Website, such as a website, b website, c website, d website etc., and the result that in the present embodiment, relatedness is verified is for have accessed a
Website will access b and website c.
Integrity verifying step, uses MD5 or null value method the inquiry data after association analysis to be carried out integrity verification and divides
Analysis.
S16. temporary file is sent to client.
By in temporary file through data process after inquiry data send to client, owing to temporary file is positioned at inquiry
In temporary file in server, therefore inquiry server can be by temporary file high-speed transfer to client.On the other hand, visitor
Inquiry data after family can be directly based upon process make corresponding Disposal Measures, improve the utilization ratio of inquiry data.
Present invention also offers the embodiment of a kind of company-data real time inquiry system, see shown in Fig. 2-3, this embodiment
The company-data real time inquiry system provided includes client 1, inquiry server 2 and Hadoop company-data platform,
Hadoop company-data platform includes Hbase data base 3；
Client 1 is asked for input inquiry, and inquiry request carries the address contents of inquiry data；
Inquiry server 2 includes receiver module 21, interactive module 22, temporary storage module 24, cache module 23 and sending module
27；
Receiver module 21 is used for receiving inquiry request；
Interactive module 22 is for by Hbase data base 3 interface of inquiry request transmission to Hadoop company-data platform also
Read inquiry data；
Temporary storage module 24 is for writing inquiry data in temporary file, and temporary file is positioned in cache module 23；
Sending module 27 is for sending temporary file to client 1.
User is asked by the Tomcat Web server input inquiry of client 1, uses the Post side in HTML form
Formula submits the data to inquire about the receiver module 21 of server 2, and the inquiry request in receiver module 21 is sent by interactive module 22
To the Native Java API of Hbase data base 3, Zookeeper server is looked into through three-level addressing reading after obtaining inquiry address
Ask the inquiry data in the HDFS corresponding to the Store being stored in Region pointed by address, the inquiry in the present embodiment
Data are website information data.Inquiry data are write in temporary file by temporary storage module 24, and temporary file is positioned at inquiry server 2
In the cache module 23 of internal memory, then send it to client 1 via sending module 27.
The another embodiment of the present embodiment, inquiry server 2 also includes data processing module 25, data processing module
25 include duplicate removal unit, statistic unit, associative cell and integrity verifying unit:
Duplicate removal unit realizes the duplicate removal of inquiry data by Bloom Filter Hash Duplicate Removal Algorithm, removes in inquiry data
Coincidence item, improve data effectiveness；
Inquiry data after duplicate removal are carried out collecting statistics, the quantity of statistics valid data by statistic unit；
Associative cell uses Aprior algorithm successively to search for realize correlation analysis, with the website information after duplicate removal
Data are as Candidate Set, and the support of association analysis is in the range of 1-10, and confidence level is in the range of 0-1, it is preferable that association analysis
Support be 5, confidence level is 0.4；The most constantly carry out from connecting and beta pruning, until obtaining final Frequent Set,
End condition is, if being the most no longer Frequent Set from connecting obtain, then taking the Frequent Set obtained for the last time is result.
Frequent Set in the present embodiment is the station address that some are relevant, such as a website, b website, c website, d website etc., and this enforcement
In example the result of relatedness checking be have accessed a website will access b and website c.
Integrity verifying unit uses MD5 or null value method the inquiry data after association analysis to be carried out integrity verification and divides
Analysis.
The another embodiment of the present embodiment, inquiry server 2 also includes warning module 26, the data of monitoring inquiry in real time
Reading and the process of write temporary file, if inquiry data do not complete write operation in threshold time, then eject pre-
Alert dialog box, it is preferable that threshold value is 2s；If it is highly preferred that inquiry data do not complete write operation in threshold time and also can
Send early warning sound.
Additionally, the cache module 23 of above-mentioned embodiment is by Java EHCache module creation.
A kind of company-data Query method in real time that the embodiment of the present invention is provided and the computer program of system, bag
Including the computer-readable recording medium storing program code, the instruction that described program code includes can be used for performing previous methods
Method described in embodiment, implements and can be found in embodiment of the method, does not repeats them here.
Those skilled in the art is it can be understood that arrive, for convenience and simplicity of description, and the system of foregoing description
With the specific works process of device, it is referred to the corresponding process in preceding method embodiment, does not repeats them here.
Term " first ", " second ", " the 3rd " are only used for describing purpose, and it is not intended that indicate or imply relatively important
Property.
It addition, in the description of the embodiment of the present invention, unless otherwise clearly defined and limited, term " is installed ", " phase
Even ", " connection " should be interpreted broadly, for example, it may be fixing connection, it is also possible to be to removably connect, or be integrally connected；Can
To be mechanical connection, it is also possible to be electrical connection；Can be to be joined directly together, it is also possible to be indirectly connected to by intermediary, Ke Yishi
The connection of two element internals.For the ordinary skill in the art, can understand that above-mentioned term is at this with concrete condition
Concrete meaning in invention.
If described function is using the form realization of SFU software functional unit and as independent production marketing or use, permissible
It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is the most in other words
The part contributing prior art or the part of this technical scheme can embody with the form of software product, this meter
Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment (can be individual
People's computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.
And aforesaid storage medium includes: USB flash disk, portable hard drive, read only memory (ROM, Read-Only Memory), random access memory are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic disc or CD.
The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited thereto, and any
Those familiar with the art, in the technical scope that the invention discloses, can readily occur in change or replace, should contain
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should described be as the criterion with scope of the claims.
Claims (10)
1. a company-data Query method in real time, it is characterised in that comprise the following steps:
Obtaining the inquiry request of client, described inquiry request carries the address contents of inquiry data；
Described inquiry request is sent to the Hbase data base interface of Hadoop company-data platform and reads inquiry data；
By in described inquiry data write temporary file, described temporary file is positioned in the caching of inquiry server；
Described temporary file is sent to described client.
Company-data Query method in real time the most according to claim 1, it is characterised in that also include data processing step,
Specifically comprise the following steps that
Described inquiry data in described temporary file are carried out duplicate removal by duplicate removal step；
Described inquiry data after duplicate removal are carried out collecting statistics by statistic procedure；
Described inquiry data after duplicate removal are associated analyzing by associated steps；
Described inquiry data after association analysis are carried out integrity verification analysis by integrity verifying step.
Company-data Query method in real time the most according to claim 2, it is characterised in that in described associated steps, association
The support analyzed is in the range of 1-10, and confidence level is in the range of 0-1.
Company-data Query method in real time the most according to claim 1, it is characterised in that also include:
Warning step, to the reading of described inquiry data and write the process of described temporary file and detect in real time and right
Write time-out carries out early warning.
5. according to the company-data Query method in real time described in any one of claim 1-4, it is characterised in that described caching by
Java EHCache module creation.
6. a company-data real time inquiry system, it is characterised in that include client, inquiry server and Hadoop cluster number
According to platform, described Hadoop company-data platform includes Hbase data base；
Described client is asked for input inquiry, and described inquiry request carries the address contents of described inquiry data；
Described inquiry server includes receiver module, interactive module, temporary storage module, cache module and sending module；
Described receiver module is used for receiving described inquiry request；
Described interactive module connects for the Hbase data base that described inquiry request sends extremely described Hadoop company-data platform
Mouth also reads inquiry data；
Described temporary storage module is for writing described inquiry data in described temporary file, and described temporary file is positioned at described caching
In module；
Described sending module is for sending described temporary file to described client.
Company-data real time inquiry system the most according to claim 6, it is characterised in that described inquiry server also includes
Data processing module, described data processing module includes duplicate removal unit, statistic unit, associative cell and integrity verifying unit:
Described duplicate removal unit is for carrying out duplicate removal to the described inquiry data in described temporary file；
Described statistic unit is for collecting statistics to the described inquiry data of described duplicate removal unit output；
Described associative cell is for being associated analyzing to the described inquiry data of described duplicate removal unit output；
Described integrity verifying unit carries out integrity verification analysis for the described inquiry data exporting described associative cell.
Company-data real time inquiry system the most according to claim 7, it is characterised in that in described associative cell, association
The support analyzed is in the range of 1-10, and confidence level is in the range of 0-1.
Company-data real time inquiry system the most according to claim 6, it is characterised in that described inquiry server also includes
Warning module, for reading described inquiry data and described inquiry data being write described temporary file to described interactive module
Process detect in real time, and to write time-out carry out early warning.
10. according to the company-data real time inquiry system described in any one of claim 6-9, it is characterised in that described caching mould
Block is by Java EHCache module creation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610681964.6A CN106294826B (en) | 2016-08-17 | 2016-08-17 | A kind of company-data Query method in real time and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610681964.6A CN106294826B (en) | 2016-08-17 | 2016-08-17 | A kind of company-data Query method in real time and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106294826A true CN106294826A (en) | 2017-01-04 |
| CN106294826B CN106294826B (en) | 2019-06-21 |
Family
ID=57678848
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610681964.6A Active CN106294826B (en) | 2016-08-17 | 2016-08-17 | A kind of company-data Query method in real time and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106294826B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107480268A (en) * | 2017-08-17 | 2017-12-15 | 北京奇虎科技有限公司 | Data query method and device |
| CN108446985A (en) * | 2018-03-21 | 2018-08-24 | 张家林 | The share system and method for Portfolio Selection |
| CN108763300A (en) * | 2018-04-19 | 2018-11-06 | 北京奇艺世纪科技有限公司 | A kind of data query method and device |
| CN110474938A (en) * | 2018-05-09 | 2019-11-19 | 视联动力信息技术股份有限公司 | Information query method and device |
| CN110727727A (en) * | 2019-10-15 | 2020-01-24 | 深圳前海微众银行股份有限公司 | Statistical method and device for database |
| CN110942599A (en) * | 2019-11-22 | 2020-03-31 | 中国民航信息网络股份有限公司 | Data monitoring method and system |
| CN111309702A (en) * | 2020-02-28 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Method and system for aggregation between files |
| CN111522791A (en) * | 2020-04-30 | 2020-08-11 | 电子科技大学 | Distributed file repeating data deleting system and method |
| CN112463755A (en) * | 2020-12-11 | 2021-03-09 | 同济大学 | Heterogeneous Internet of things big data storage and reading system and method based on HDFS |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104252536A (en) * | 2014-09-16 | 2014-12-31 | 福建新大陆软件工程有限公司 | Hbase-based internet log data inquiring method and device |
| CN104408084A (en) * | 2014-11-06 | 2015-03-11 | 北京锐安科技有限公司 | Method and device for screening big data |
| CN104598503A (en) * | 2014-05-14 | 2015-05-06 | 腾讯科技（深圳）有限公司 | Geographic information data inquiry method, device and system |
| CN105069151A (en) * | 2015-08-24 | 2015-11-18 | 用友网络科技股份有限公司 | HBase secondary index construction apparatus and method |
| CN105243072A (en) * | 2014-07-11 | 2016-01-13 | 北京神州泰岳软件股份有限公司 | Database query method and system |
-
2016
- 2016-08-17 CN CN201610681964.6A patent/CN106294826B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104598503A (en) * | 2014-05-14 | 2015-05-06 | 腾讯科技（深圳）有限公司 | Geographic information data inquiry method, device and system |
| CN105243072A (en) * | 2014-07-11 | 2016-01-13 | 北京神州泰岳软件股份有限公司 | Database query method and system |
| CN104252536A (en) * | 2014-09-16 | 2014-12-31 | 福建新大陆软件工程有限公司 | Hbase-based internet log data inquiring method and device |
| CN104408084A (en) * | 2014-11-06 | 2015-03-11 | 北京锐安科技有限公司 | Method and device for screening big data |
| CN105069151A (en) * | 2015-08-24 | 2015-11-18 | 用友网络科技股份有限公司 | HBase secondary index construction apparatus and method |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107480268A (en) * | 2017-08-17 | 2017-12-15 | 北京奇虎科技有限公司 | Data query method and device |
| CN108446985A (en) * | 2018-03-21 | 2018-08-24 | 张家林 | The share system and method for Portfolio Selection |
| CN108763300A (en) * | 2018-04-19 | 2018-11-06 | 北京奇艺世纪科技有限公司 | A kind of data query method and device |
| CN108763300B (en) * | 2018-04-19 | 2020-07-31 | 北京奇艺世纪科技有限公司 | Data query method and device |
| CN110474938A (en) * | 2018-05-09 | 2019-11-19 | 视联动力信息技术股份有限公司 | Information query method and device |
| CN110727727A (en) * | 2019-10-15 | 2020-01-24 | 深圳前海微众银行股份有限公司 | Statistical method and device for database |
| CN110727727B (en) * | 2019-10-15 | 2023-01-10 | 深圳前海微众银行股份有限公司 | Statistical method and device for database |
| CN110942599A (en) * | 2019-11-22 | 2020-03-31 | 中国民航信息网络股份有限公司 | Data monitoring method and system |
| CN111309702A (en) * | 2020-02-28 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Method and system for aggregation between files |
| CN111522791A (en) * | 2020-04-30 | 2020-08-11 | 电子科技大学 | Distributed file repeating data deleting system and method |
| CN112463755A (en) * | 2020-12-11 | 2021-03-09 | 同济大学 | Heterogeneous Internet of things big data storage and reading system and method based on HDFS |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106294826B (en) | 2019-06-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106294826A (en) | A kind of company-data Query method in real time and system | |
| CN102436513B (en) | Distributed search method and system | |
| CN103064933B (en) | Data query method and system | |
| CN103778148B (en) | Life cycle management method and equipment for data file of Hadoop distributed file system | |
| CN102902775B (en) | The method and system that internet calculates in real time | |
| CN111258978B (en) | Data storage method | |
| CN104516979A (en) | Data query method and data query system based on quadratic search | |
| CN104572781B (en) | A kind of transaction log production method and device | |
| CN109522328A (en) | A kind of data processing method and its device, medium, terminal | |
| CN102710795A (en) | Hotspot collecting method and device | |
| CN106649828A (en) | Data query method and system | |
| CN104462096B (en) | Public sentiment method for monitoring and analyzing and device | |
| US20190050435A1 (en) | Object data association index system and methods for the construction and applications thereof | |
| CN109145040A (en) | A kind of data administering method based on double message queues | |
| CN102279891A (en) | Retrieval method, device and system for concurrently searching information technology (IT) logs | |
| CN109947729A (en) | A kind of real-time data analysis method and device | |
| CN104426838A (en) | Internet cache scheduling method and system | |
| CN102253948B (en) | Method and device for searching information in multi-source information system | |
| CN110428153A (en) | Message polymerization and device | |
| CN102325143B (en) | Cloud platform based information collection, storage, encryption and retrieval system | |
| CN104636368A (en) | Data retrieval method and device and server | |
| CN107180043A (en) | Paging implementation method and paging system | |
| WO2017000592A1 (en) | Data processing method, apparatus and system | |
| CN105975599A (en) | Method and device monitoring website page event tracking | |
| CN103902614A (en) | Data processing method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |