CN110309162A - A kind of optimization method and server-side of ES more new data - Google Patents

A kind of optimization method and server-side of ES more new data Download PDF

Info

Publication number
CN110309162A
CN110309162A CN201910513718.3A CN201910513718A CN110309162A CN 110309162 A CN110309162 A CN 110309162A CN 201910513718 A CN201910513718 A CN 201910513718A CN 110309162 A CN110309162 A CN 110309162A
Authority
CN
China
Prior art keywords
data
query result
full dose
time
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910513718.3A
Other languages
Chinese (zh)
Inventor
刘德建
林伟
郭玉湖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujian Tianquan Educational Technology Ltd
Original Assignee
Fujian Tianquan Educational Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujian Tianquan Educational Technology Ltd filed Critical Fujian Tianquan Educational Technology Ltd
Priority to CN201910513718.3A priority Critical patent/CN110309162A/en
Publication of CN110309162A publication Critical patent/CN110309162A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2358Change logging, detection, and notification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2365Ensuring data consistency and integrity

Abstract

The invention discloses the optimization methods and server-side of a kind of ES more new data, obtain index data more new information, and index data is updated information update to real time data library unit;Judge whether to reach default renewal time, if so, the index data in real time data library unit is updated information update to full dose Database Unit;The present invention is indexed data by real time data library unit and updates, then timing is updated into full dose Database Unit again, it ensure that the data integrity of full dose Database Unit, simultaneously, when system is based on full dose Database Unit and real time data library unit progress data query, since the data volume being indexed in the real time data library unit of update and data query simultaneously is smaller, so when carrying out data update, influence for the search efficiency of user will be much smaller than the prior art, to realize in the case where big data quantity, the quick update of data and efficiently inquiry are supported simultaneously.

Description

A kind of optimization method and server-side of ES more new data
Technical field
The present invention relates to ES technical field, in particular to the optimization method and server-side of a kind of ES more new data.
Background technique
ElasticSearch, abbreviation ES, it is the search server based on Lucene.It is based on RESTful web Interface simultaneously provides the full-text search engine of a distributed multi-user ability, ElasticSearch be developed with Java, and It is Enterprise search engine currently popular as the open source code publication under Apache license terms.Designed for cloud computing In, real-time search can be reached, stablized, it is reliably, quickly, easy to install and use.
In existing many projects, index storage is all to accelerate the efficiency of inquiry with this using ES.Although big In most cases, the search efficiency of ES is very high and uses the project of ES and can also be basically completed relevant query function.Than in full According to amount within 1,000,000,000 rank magnitudes, then the requirement of most projects, the inquiry and correlation of index can be substantially completed Updating operation can also be normally carried out.But high concurrent request application scenarios under, if data volume continues to increase, into When line index data update, then server regular hour and resource can be occupied, so that the search efficiency of user is affected, so that Quick data query is unable to reach using the project of ES.
Summary of the invention
The technical problems to be solved by the present invention are: the optimization method and server-side of a kind of ES more new data are provided, so that It obtains in big data quantity, supports the quick update of data and efficiently inquiry.
In order to solve the above-mentioned technical problem, the technical solution adopted by the present invention are as follows:
A kind of optimization method of ES more new data, comprising steps of
S1, index data more new information is obtained, the index data is updated into information update to real time data library unit;
S2, judge whether to reach default renewal time, if so, by the index number in the real time data library unit According to update information update to full dose Database Unit.
In order to solve the above-mentioned technical problem, the another technical solution that the present invention uses are as follows:
A kind of optimization server-side of ES more new data, including memory, processor and storage on a memory and can located The computer program run on reason device, the processor perform the steps of when executing the computer program
S1, index data more new information is obtained, the index data is updated into information update to real time data library unit;
S2, judge whether to reach default renewal time, if so, by the index number in the real time data library unit According to update information update to full dose Database Unit.
The beneficial effects of the present invention are: a kind of optimization method and server-side of ES more new data pass through real-time data base Unit is indexed data update, and then timing is updated into full dose Database Unit again, ensure that full dose Database Unit Data integrity, meanwhile, when system is based on full dose Database Unit and real time data library unit progress data query, due to simultaneously The data volume being indexed in the real time data library unit of update and data query is smaller, so when carrying out data update, it is right It to be much smaller than the prior art in the influence of the search efficiency of user, to realize in the case where big data quantity, while supporting number According to it is quick update with efficiently inquiry.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of the optimization method of ES more new data of the embodiment of the present invention;
Fig. 2 is a kind of structural schematic diagram of the optimization server-side of ES more new data of the embodiment of the present invention;
Fig. 3 is a kind of optimization server-side of ES more new data of the embodiment of the present invention and the connection schematic diagram of other modules.
Label declaration:
1, the optimization server-side of a kind of ES more new data;2, processor;3, memory.
Specific embodiment
To explain the technical content, the achieved purpose and the effect of the present invention in detail, below in conjunction with embodiment and cooperate attached Figure is explained.
Please refer to Fig. 1, a kind of optimization method of ES more new data, comprising steps of
S1, index data more new information is obtained, the index data is updated into information update to real time data library unit;
S2, judge whether to reach default renewal time, if so, by the index number in the real time data library unit According to update information update to full dose Database Unit.
As can be seen from the above description, the beneficial effects of the present invention are: data are indexed more by real time data library unit Newly, then timing is updated into full dose Database Unit again, ensure that the data integrity of full dose Database Unit, meanwhile, it is When system carries out data query based on full dose Database Unit and real time data library unit, due to being indexed update and data simultaneously Data volume in the real time data library unit of inquiry is smaller, so when carrying out data update, for the search efficiency of user Influence to be much smaller than the prior art, to realize in the case where big data quantity, while support the quick update of data with it is efficient Inquiry.
Further, the step S1 specifically:
S1, index data more new information is obtained, the index data is updated into information update to hour data library unit;
It is further comprised the steps of: between the step S1 and the step S2
S20, judge whether current time and the time difference of previous renewal time hour are super after an hour, if so, by institute The index data stated in hour data library unit updates information update Summer Solstice or the Winter Solstice Database Unit;
The step S2 specifically:
S2, current time and the time difference of proxima luce (prox. luc) renewal time are judged whether more than one day, if so, by the number of days Information update is updated to full dose Database Unit according to the index data in library unit.
As can be seen from the above description, i.e. by subdivision day Database Unit and hour data library unit, when index data carries out When update, data in real-time update hour data library unit, then timing is updated to day Database Unit, day database list Timing is updated to full dose Database Unit member again.When day Database Unit is updated to full dose Database Unit, due to being logical The operation of batch updating index is crossed to carry out, overall request number of times is fewer than the number that existing frequent updating indexes very much.Separately Outside for repeatedly updating same index in the short time, the application only needs only to be updated within one day time once, phase For existing frequent updating index, so the influence that the application requests high concurrent will be much smaller than the prior art, thus The search efficiency of user can be improved.
Further, the step S2 further include:
After index data update information update is finished to full dose Database Unit, the real-time data base is deleted The index data more new information in unit.
As can be seen from the above description, the data in real time data library unit are deleted after having updated, to reduce real time data The storage pressure of library unit, while will receive the last influence updated but also update not next time, it ensure that renewal speed With update accuracy.
Further, it further comprises the steps of:
S3, obtain data inquiry request, from the full dose Database Unit obtain full dose query result, from it is described in real time Real-time query result is obtained in Database Unit;
S4, judge the full dose query result and the real-time query result with the presence or absence of identical first ID, and if it exists, Then data cover corresponding to the first ID described in the real-time query result is fallen first described in the full dose query result Data corresponding to ID, have been updated query result;
Query result has been updated described in S5, return.
As can be seen from the above description, i.e. when carrying out data query, in order to guarantee the data of customer inquiries be it is newest, understand from Inquire simultaneously duplicate removal in full dose Database Unit and real time data library unit, although real time data library unit is to carry out at the same time Index data updates and data query, but the data volume of real time data library unit is very small, so being indexed data Also very small for the influence of data query while update, data query twice adds duplicate removal also can be than frequent updating rope again Delay caused by drawing will more efficiently.
Further, the step S4 specifically:
The full dose query result and the real-time query result are put into set and gathered, to have been updated inquiry knot Fruit.
Wherein, set set includes HashSet, LinkedHashSet and TreeSet, and the characteristics of HashSet is unordered And the element in set does not repeat, the HashSet that LinkedHashSet is ordered into, TreeSet can go to reorder automatically no matter Be it is wherein any, all have the function of duplicate removal, all query results can be covered, with guarantee obtain newest inquiry As a result.
As can be seen from the above description, carrying out covering operation automatically by set set, guarantee the efficiency of data query.
Referring to figure 2. and Fig. 3, a kind of optimization server-side of ES more new data, including memory, processor and it is stored in On memory and the computer program that can run on a processor, the processor are realized following when executing the computer program Step:
S1, index data more new information is obtained, the index data is updated into information update to real time data library unit;
S2, judge whether to reach default renewal time, if so, by the index number in the real time data library unit According to update information update to full dose Database Unit.
As can be seen from the above description, the beneficial effects of the present invention are: data are indexed more by real time data library unit Newly, then timing is updated into full dose Database Unit again, ensure that the data integrity of full dose Database Unit, meanwhile, it is When system carries out data query based on full dose Database Unit and real time data library unit, due to being indexed update and data simultaneously Data volume in the real time data library unit of inquiry is smaller, so when carrying out data update, for the search efficiency of user Influence to be much smaller than the prior art, to realize in the case where big data quantity, while support the quick update of data with it is efficient Inquiry.
Further, the step S1 specifically:
S1, index data more new information is obtained, the index data is updated into information update to hour data library unit;
It is further comprised the steps of: between the step S1 and the step S2
S20, judge whether current time and the time difference of previous renewal time hour are super after an hour, if so, by institute The index data stated in hour data library unit updates information update Summer Solstice or the Winter Solstice Database Unit;
The step S2 specifically:
S2, current time and the time difference of proxima luce (prox. luc) renewal time are judged whether more than one day, if so, by the number of days Information update is updated to full dose Database Unit according to the index data in library unit.
As can be seen from the above description, i.e. by subdivision day Database Unit and hour data library unit, when index data carries out When update, data in real-time update hour data library unit, then timing is updated to day Database Unit, day database list Timing is updated to full dose Database Unit member again.When day Database Unit is updated to full dose Database Unit, due to being logical The operation of batch updating index is crossed to carry out, overall request number of times is fewer than the number that existing frequent updating indexes very much.Separately Outside for repeatedly updating same index in the short time, the application only needs only to be updated within one day time once, phase For existing frequent updating index, so the influence that the application requests high concurrent will be much smaller than the prior art, thus The search efficiency of user can be improved.
Further, the step S2 further include:
After index data update information update is finished to full dose Database Unit, the real-time data base is deleted The index data more new information in unit.
As can be seen from the above description, the data in real time data library unit are deleted after having updated, to reduce real time data The storage pressure of library unit, while will receive the last influence updated but also update not next time, it ensure that renewal speed With update accuracy.
Further, it further comprises the steps of:
S3, obtain data inquiry request, from the full dose Database Unit obtain full dose query result, from it is described in real time Real-time query result is obtained in Database Unit;
S4, judge the full dose query result and the real-time query result with the presence or absence of identical first ID, and if it exists, Then data cover corresponding to the first ID described in the real-time query result is fallen first described in the full dose query result Data corresponding to ID, have been updated query result;
Query result has been updated described in S5, return.
As can be seen from the above description, i.e. when carrying out data query, in order to guarantee the data of customer inquiries be it is newest, understand from Inquire simultaneously duplicate removal in full dose Database Unit and real time data library unit, although real time data library unit is to carry out at the same time Index data updates and data query, but the data volume of real time data library unit is very small, so being indexed data Also very small for the influence of data query while update, data query twice adds duplicate removal also can be than frequent updating rope again Delay caused by drawing will more efficiently.
Further, the step S4 specifically:
The full dose query result and the real-time query result are put into set and gathered, to have been updated inquiry knot Fruit.
As can be seen from the above description, carrying out covering operation automatically by set set, guarantee the efficiency of data query.
Please refer to Fig. 1, the embodiment of the present invention one are as follows:
The application scenarios of the present embodiment are that scene more than 1,000,000,000 data amounts uses, and following full dose database lists Member is the storage recording unit of total data, and real time data library unit is the storage recording unit of real-time update.
A kind of optimization method of ES more new data, comprising steps of
S1, index data more new information is obtained, index data is updated into information update to real time data library unit;
S2, judge whether to reach default renewal time, if so, the index data in real time data library unit is updated letter Breath is updated to full dose Database Unit, after index data update information update is finished to full dose Database Unit, deletes real When Database Unit in index data more new information.
When needing to carry out data query, following steps are executed:
S3, data inquiry request is obtained, full dose query result is obtained from full dose Database Unit, from real-time data base list Real-time query result is obtained in member;
S4, judge full dose query result and real-time query result with the presence or absence of identical first ID, and if it exists, then will be real-time Data cover corresponding to the first ID falls data corresponding to the first ID in full dose query result in query result, has been updated Query result, in the present embodiment, the step specifically: full dose query result and real-time query result are put into set and gathered, To have been updated query result;
S5, return have updated query result.
Referring to figure 2., the embodiment of the present invention two are as follows:
The application scenarios of the present embodiment are that scene more than 1,000,000,000 data amounts uses, and following full dose database lists Member is the storage recording unit of total data, and day Database Unit is the storage recording unit of daily more new data, hour data Library unit is the storage recording unit of more new data per hour.
A kind of optimization method of ES more new data, on the basis of the above embodiment 1, real-time data base in the present embodiment Unit includes day Database Unit and hour data library unit, the specific implementation process is as follows:
Step S1 specifically: obtain index data more new information, index data is updated into information update to hour data library When unit, i.e. each data change, the information in full dose Database Unit and day Database Unit will not be modified, it will according to small When mode only record update data information into hour data library unit;
It is further comprised the steps of: between step S1 and step S2
S20, judge whether current time and the time difference of previous renewal time hour are super after an hour, if so, by small When Database Unit in index data update information update Summer Solstice or the Winter Solstice Database Unit, and delete hour data after the completion of update All index datas more new information stored in library unit;
Step S2 specifically: judge current time and the time difference of proxima luce (prox. luc) renewal time whether more than one day, if so, By the index data update information update in day Database Unit to full dose Database Unit, and number of days is deleted after the completion of update According to all index datas more new information stored in library unit.
It in the present embodiment, is the acquisition full dose query result from full dose Database Unit when carrying out data query, from Day query result is obtained in day Database Unit, and hour query result is inquired from hour data library unit;
S4, judge full dose query result and day query result with the presence or absence of identical first ID, and if it exists, then to inquire day As a result data cover corresponding to the first ID falls data corresponding to the first ID in full dose query result in, obtains day updating inquiry As a result;Judge to update day query result and hour query result again with the presence or absence of identical first ID, and if it exists, then look into hour It askes data cover corresponding to the first ID in result and falls to update data corresponding to the first ID in query result day, to obtain Update query result.
In order to make it easy to understand, the present embodiment concrete example is as follows: in certain inquiry, being inquired from full dose Database Unit A The data of 10 ID come out out, to obtain a set;Later, 4 ID can be inquired in day Database Unit B, to obtain b set, Wherein there are 3 ID to gather in a in b set;Later, 2 ID can be inquired from hour data library unit C, to obtain c set, Wherein there is 1 ID to gather in b in c set;Then, using b gather in latest data covering a gather, at this time a set in number According to being full dose Database Unit plus the latest data in day Database Unit;Data in c set are reused to gather to cover a, Data will be that full dose Database Unit adds day Database Unit plus the newest number in hour data library unit in a set at this time According to finally obtained 10 ID after merging, and data therein have all been that day Database Unit or hour data library are single Latest data in member.
Referring to figure 2. and Fig. 3, the embodiment of the present invention three are as follows:
A kind of optimization server-side 1 of ES more new data, including memory 3, processor 2 and be stored on memory 3 and can The step of computer program run on processor 2, processor 2 realizes above-described embodiment one when executing computer program.
As shown in figure 3, a kind of optimization server-side 1 of ES more new data includes ES and data transferring module, wherein ES includes Full dose Database Unit, day Database Unit and hour data library unit are by Data Migration module periodically by hour data library Data in unit are updated to day Database Unit, and then timing updates the data in day Database Unit to full dose database Unit.
As shown in figure 3, the process of entire data query is as follows: client request api interface, api interface request are relevant ES cluster is assembled, and finally return that user with carrying out the acquisitions of data after getting related data.
Referring to figure 2. and Fig. 3, the embodiment of the present invention four are as follows:
A kind of optimization server-side 1 of ES more new data, on the basis of above-described embodiment three, processor 2 executes computer The step of above-described embodiment two are realized when program.
In conclusion the optimization method and server-side of a kind of ES more new data provided by the invention, when index data carries out When update, data in real-time update hour data library unit, then timing is updated to day Database Unit, day database list Timing is updated to full dose Database Unit member again, ensure that the data integrity of full dose Database Unit, meanwhile, it is based on full dose number Data query is carried out according to library unit, day Database Unit and hour data library unit, although hour data library unit is same When be indexed data and update and data query, but the data volume of hour data library unit is very small, so carrying out rope Argument is also very small according to influence while update for data query, and data query three times adds duplicate removal also can be than frequent again Updating delay caused by index will more efficiently;In addition, when day Database Unit is updated to full dose Database Unit, by The operation of batch updating index is then passed through to carry out, overall request number of times is fewer than the number that existing frequent updating indexes very It is more.In addition for repeatedly updating same index in the short time, the application only needs only to be updated one within one day time It is secondary, for relatively existing frequent updating index, so the influence that the application requests high concurrent will be much smaller than the prior art, To realize in the case where big data quantity, while supporting the quick update of data and efficiently inquiry;In addition, having updated it Afterwards, the data in real time data library unit are deleted, to reduce the storage pressure of real time data library unit, while but also next time The influence that not will receive last update or not, ensure that renewal speed and updates accuracy.
The above description is only an embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair Equivalents made by bright specification and accompanying drawing content are applied directly or indirectly in relevant technical field, similarly include In scope of patent protection of the invention.

Claims (10)

1. a kind of optimization method of ES more new data, which is characterized in that comprising steps of
S1, index data more new information is obtained, the index data is updated into information update to real time data library unit;
S2, judge whether to reach default renewal time, if so, more by the index data in the real time data library unit New information is updated to full dose Database Unit.
2. a kind of optimization method of ES more new data according to claim 1, which is characterized in that the step S1 is specific Are as follows:
S1, index data more new information is obtained, the index data is updated into information update to hour data library unit;
It is further comprised the steps of: between the step S1 and the step S2
S20, judge whether current time and the time difference of previous renewal time hour are super after an hour, if so, by described small When Database Unit in the index data update information update Summer Solstice or the Winter Solstice Database Unit;
The step S2 specifically:
S2, current time and the time difference of proxima luce (prox. luc) renewal time are judged whether more than one day, if so, by the day database The index data in unit updates information update to full dose Database Unit.
3. a kind of optimization method of ES more new data according to claim 1, which is characterized in that the step S2 is also wrapped It includes:
After index data update information update is finished to full dose Database Unit, the real time data library unit is deleted In the index data more new information.
4. a kind of optimization method of ES more new data according to claim 1, which is characterized in that further comprise the steps of:
S3, data inquiry request is obtained, full dose query result is obtained from the full dose Database Unit, from the real time data Real-time query result is obtained in library unit;
S4, judge the full dose query result and the real-time query result with the presence or absence of identical first ID, and if it exists, then will Data cover corresponding to first ID described in the real-time query result falls the first ID institute described in the full dose query result Corresponding data, have been updated query result;
Query result has been updated described in S5, return.
5. a kind of optimization method of ES more new data according to claim 4, which is characterized in that the step S4 is specific Are as follows:
The full dose query result and the real-time query result are put into set and gathered, to have been updated query result.
6. a kind of optimization server-side of ES more new data, including memory, processor and storage on a memory and can handled The computer program run on device, which is characterized in that the processor performs the steps of when executing the computer program
S1, index data more new information is obtained, the index data is updated into information update to real time data library unit;
S2, judge whether to reach default renewal time, if so, more by the index data in the real time data library unit New information is updated to full dose Database Unit.
7. a kind of optimization server-side of ES more new data according to claim 6, which is characterized in that the step S1 is specific Are as follows:
S1, index data more new information is obtained, the index data is updated into information update to hour data library unit;
It is further comprised the steps of: between the step S1 and the step S2
S20, judge whether current time and the time difference of previous renewal time hour are super after an hour, if so, by described small When Database Unit in the index data update information update Summer Solstice or the Winter Solstice Database Unit;
The step S2 specifically:
S2, current time and the time difference of proxima luce (prox. luc) renewal time are judged whether more than one day, if so, by the day database The index data in unit updates information update to full dose Database Unit.
8. a kind of optimization server-side of ES more new data according to claim 6, which is characterized in that the step S2 is also wrapped It includes:
After index data update information update is finished to full dose Database Unit, the real time data library unit is deleted In the index data more new information.
9. a kind of optimization server-side of ES more new data according to claim 6, which is characterized in that further comprise the steps of:
S3, data inquiry request is obtained, full dose query result is obtained from the full dose Database Unit, from the real time data Real-time query result is obtained in library unit;
S4, judge the full dose query result and the real-time query result with the presence or absence of identical first ID, and if it exists, then will Data cover corresponding to first ID described in the real-time query result falls the first ID institute described in the full dose query result Corresponding data, have been updated query result;
Query result has been updated described in S5, return.
10. a kind of optimization server-side of ES more new data according to claim 9, which is characterized in that the step S4 tool Body are as follows:
The full dose query result and the real-time query result are put into set and gathered, to have been updated query result.
CN201910513718.3A 2019-06-14 2019-06-14 A kind of optimization method and server-side of ES more new data Pending CN110309162A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910513718.3A CN110309162A (en) 2019-06-14 2019-06-14 A kind of optimization method and server-side of ES more new data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910513718.3A CN110309162A (en) 2019-06-14 2019-06-14 A kind of optimization method and server-side of ES more new data

Publications (1)

Publication Number Publication Date
CN110309162A true CN110309162A (en) 2019-10-08

Family

ID=68075850

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910513718.3A Pending CN110309162A (en) 2019-06-14 2019-06-14 A kind of optimization method and server-side of ES more new data

Country Status (1)

Country Link
CN (1) CN110309162A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116959656A (en) * 2023-08-18 2023-10-27 成都医星科技有限公司 Medical main index extraction merging method and system based on ES

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102339315A (en) * 2011-09-30 2012-02-01 亿赞普(北京)科技有限公司 Index updating method and system of advertisement data
CN103294731A (en) * 2012-03-05 2013-09-11 阿里巴巴集团控股有限公司 Real-time index creating and real-time searching method and device
US20150012632A1 (en) * 2013-07-04 2015-01-08 Varonis Systems, Inc. Distributed indexing in an enterprise
CN104794177A (en) * 2015-04-02 2015-07-22 广州神马移动信息科技有限公司 Data storing method and device
CN108846121A (en) * 2018-06-27 2018-11-20 中国建设银行股份有限公司 A kind of data search method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102339315A (en) * 2011-09-30 2012-02-01 亿赞普(北京)科技有限公司 Index updating method and system of advertisement data
CN103294731A (en) * 2012-03-05 2013-09-11 阿里巴巴集团控股有限公司 Real-time index creating and real-time searching method and device
US20150012632A1 (en) * 2013-07-04 2015-01-08 Varonis Systems, Inc. Distributed indexing in an enterprise
CN104794177A (en) * 2015-04-02 2015-07-22 广州神马移动信息科技有限公司 Data storing method and device
CN108846121A (en) * 2018-06-27 2018-11-20 中国建设银行股份有限公司 A kind of data search method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116959656A (en) * 2023-08-18 2023-10-27 成都医星科技有限公司 Medical main index extraction merging method and system based on ES
CN116959656B (en) * 2023-08-18 2024-04-23 成都医星科技有限公司 Medical main index extraction merging method and system based on ES

Similar Documents

Publication Publication Date Title
US7827167B2 (en) Database management system and method including a query executor for generating multiple tasks
US10558615B2 (en) Atomic incremental load for map-reduce systems on append-only file systems
US10489181B2 (en) Entity database browser
CN108694195B (en) Management method and system of distributed data warehouse
CN103049556B (en) A kind of fast statistical query method of magnanimity medical data
KR101721892B1 (en) Managing queries
CN107844388B (en) Streaming restore of database from backup system
Lim et al. How to Fit when No One Size Fits.
US20160125000A1 (en) History preserving data pipeline
CN105279261B (en) Dynamic scalable database filing method and system
US10261888B2 (en) Emulating an environment of a target database system
CN111324610A (en) Data synchronization method and device
US10303785B2 (en) Optimizing online schema processing for busy database objects
US20230342353A1 (en) Targeted sweep method for key-value data storage
CN109885642B (en) Hierarchical storage method and device for full-text retrieval
CN103365740A (en) Data cold standby method and device
CN110309162A (en) A kind of optimization method and server-side of ES more new data
WO2014141355A1 (en) Computer system, data management method, and recording medium for storing program
Venner et al. Pro apache hadoop
Pineda-Morales et al. Managing hot metadata for scientific workflows on multisite clouds
Vernik et al. Stocator: Providing high performance and fault tolerance for apache spark over object storage
Popescu et al. Adaptive query execution for data management in the cloud
CN106909319B (en) A kind of Hadoop framework and scheduling strategy based on virtual memory disk
US20140136480A1 (en) Fast replication of an enterprise system to a remote computing environment
CN113553320B (en) Data quality monitoring method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination