CN108694188B - Index data updating method and related device - Google Patents
Index data updating method and related device Download PDFInfo
- Publication number
- CN108694188B CN108694188B CN201710225105.0A CN201710225105A CN108694188B CN 108694188 B CN108694188 B CN 108694188B CN 201710225105 A CN201710225105 A CN 201710225105A CN 108694188 B CN108694188 B CN 108694188B
- Authority
- CN
- China
- Prior art keywords
- index data
- updating
- data
- search result
- index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 81
- 238000012545 processing Methods 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 18
- 230000008569 process Effects 0.000 description 15
- 238000004364 calculation method Methods 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a method for updating index data, which can be applied to an index data updating device, wherein the index data updating device comprises a memory area and a hard disk area, and the method comprises the steps of receiving an index data updating request; updating the index data in the memory area according to the index data updating request, and obtaining first index data; and if the first index data meets the preset index data updating condition, updating the index data in the hard disk area according to the first index data, and obtaining second index data. The invention also provides an index data updating device. According to the embodiment of the invention, the index data can be stored in a grading manner, and different storage modes are respectively adopted for different index data types, so that the first index data is updated in real time, and the second index data is updated periodically, thereby effectively balancing the updating of the index data, reducing the memory consumption and the computing resource and reducing the computing cost.
Description
Technical Field
The present invention relates to the field of internet technologies, and in particular, to a method for updating index data and a related device.
Background
With the continuous development of internet technology, users search by using the internet is becoming more and more popular. For searching, it is generally necessary to index the search data in the database. An index is a structure that orders the values of one or more columns in a database table, with which specific information in the database table can be accessed quickly. In the process of accessing each vertical service, the retrieval platform generally adopts different index storage solutions according to the specific types of the service, such as data volume, data update volume, retrieval volume and other service characteristics.
Currently, for services with large data volume and infrequent index updating, a storage mode of a solid state disk (Solid State Drives, SSD) or a magnetic disk is generally adopted, that is, a full index is stored in the SSD or the hard disk, and the online validation time of updating data is almost equal to the full update time of the index data.
However, the index storage method using the SSD or the hard disk reduces the cost to some extent, but is limited by the physical characteristics of the SSD or the hard disk, and performing the index update and the query simultaneously brings the problem of simultaneously "reading" and "writing" to the hard disk. To solve the problem of simultaneous "reading" and "writing", the index is generally not allowed to be updated in real time, but a full-volume update mode with an overlong period is adopted. In this case, in order to enable the incremental update of the index data to be brought on line as soon as possible, the period of the total update of the index needs to be reduced as much as possible, which leads to an increase in the calculation cost.
Disclosure of Invention
The embodiment of the invention provides a method for updating index data and a related device, which can be used for carrying out hierarchical storage on the index data, namely dividing the index data into first index data and second index data, and adopting different storage modes aiming at different index data types, so that the first index data is updated in real time and the second index data is updated periodically, thereby effectively balancing the updating of the index data, reducing memory consumption and calculation resources and reducing calculation cost.
In view of the foregoing, a first aspect of the present invention provides a method for updating index data, the method being applied to an index data updating device, the index data updating device including a memory area and a hard disk area, the method comprising:
receiving an index data update request;
updating the index data in the memory area according to the index data updating request, and obtaining first index data;
and if the first index data meets the preset index data updating condition, updating the index data in the hard disk area according to the first index data, and obtaining second index data.
The second aspect of the present invention provides an index data updating apparatus, the index data updating apparatus including a memory area and a hard disk area, the index data updating apparatus comprising:
the first receiving module is used for receiving an index data updating request;
the first updating module is used for updating the index data in the memory area according to the index data updating request received by the first receiving module and obtaining first index data;
and the second updating module is used for updating the index data in the hard disk area according to the first index data if the first index data updated by the first updating module meets the preset index data updating condition, and obtaining second index data.
From the above technical solutions, the embodiment of the present invention has the following advantages:
the embodiment of the invention provides an index data updating method which can be applied to an index data updating device, wherein the index data updating device comprises a memory area and a hard disk area, firstly the index data updating device receives an index data updating request, then the index data in the memory area is updated according to the index data updating request, first index data is obtained, and if the first index data meets the preset index data updating condition, the index data in the hard disk area is updated according to the first index data, and second index data is obtained. By the method, the index data can be stored in a grading manner, namely, the index data is divided into the first index data and the second index data, and different storage modes can be adopted for different index data types respectively, so that the second index data is periodically updated while the first index data is updated in real time, the updating of the index data can be effectively balanced, the memory consumption and the computing resources are reduced, and the computing cost is reduced.
Drawings
FIG. 1 is a topology diagram of an independent memory index storage scheme in an embodiment of the present invention;
FIG. 2 is a topology diagram of a hard disk index independent storage scheme in an embodiment of the invention;
FIG. 3 is a topology diagram of memory index and hard disk index combined storage in an embodiment of the invention;
FIG. 4 is a diagram of one embodiment of a method for updating index data according to an embodiment of the present invention;
FIG. 5 is a schematic flow chart of data retrieval in an embodiment of the present invention;
FIG. 6 is a schematic diagram of an index data update apparatus according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an index data update apparatus according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of an index data update apparatus according to an embodiment of the present invention;
FIG. 9 is a schematic diagram of an index data update apparatus according to an embodiment of the present invention;
FIG. 10 is a schematic diagram of an index data update apparatus according to an embodiment of the present invention;
FIG. 11 is a schematic diagram of an index data update apparatus according to an embodiment of the present invention;
FIG. 12 is a diagram illustrating an index data update apparatus according to an embodiment of the present invention;
FIG. 13 is a diagram illustrating an embodiment of an index data update apparatus according to an embodiment of the present invention;
Fig. 14 is a schematic structural diagram of an index data updating device according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a method for updating index data and a related device, which can be used for carrying out hierarchical storage on the index data, namely dividing the index data into first index data and second index data, and adopting different storage modes aiming at different index data types, so that the first index data is updated in real time and the second index data is updated periodically, thereby effectively balancing the updating of the index data, reducing memory consumption and calculation resources and reducing calculation cost.
The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented, for example, in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be understood that the present invention can be applied to a memory area of a server and a hard disk area, wherein the memory area is a memory, the hard disk area is a hard disk, and currently, there are two ways to store index data, one is stored in the memory, and the other is stored in the hard disk. These two separate storage schemes will be briefly described below.
Referring to fig. 1, fig. 1 is a topology diagram of an independent memory index storage scheme in an embodiment of the present invention, where an increment index and a full index are stored in a memory, and a search engine may call information in the memory index. When the user performs data retrieval, the corresponding index data can be searched from the memory index through the search engine, the corresponding retrieval result is determined according to the index data, and then the retrieval result is sent to the client side to be displayed to the user. When data is updated, the increment index in the memory index is updated in real time, and the full index is updated in the same step.
Referring to fig. 2, fig. 2 is a topological diagram of an independent storage scheme of a hard disk index according to an embodiment of the present invention, where a full-scale index is stored in the hard disk, and a search engine may call information in the full-scale index. When a user performs data retrieval, the corresponding index data can be searched from the hard disk index through a search engine, the corresponding retrieval result is determined according to the index data, and then the retrieval result is sent to the client side to be displayed to the user. When data is updated, the full index in the hard disk index is updated.
Compared with the two storage schemes, the index data storage scheme adopted by the invention can greatly reduce the index storage cost. Referring to fig. 3, fig. 3 is a topology diagram of a memory index and a hard disk index combined and stored in an embodiment of the present invention, and as shown in the figure, the topology diagram can be divided into three layers in a search service, namely a search access layer, a search engine implementation layer and a data linking layer. The retrieval access layer is mainly used for shielding implementation details of an internal search engine, and main functions comprise: search access, merging of search results, duplication removal of search results, and access of data update requests. The search engine implementation layer is mainly used for dividing all the storage into two parts, namely a memory index and a hard disk index, when in internal implementation, the memory index storage part is used for keeping updated data in the last period, mainly receiving real-time data updating requests and data retrieval requests, and the hard disk index storage part is used for keeping the latest full index data, mainly receiving data retrieval requests and not receiving real-time data updating requests. The data linking layer is mainly used for linking the memory with the index data of the hard disk, merging the whole data regularly and updating the whole data regularly.
Referring to fig. 4, an embodiment of a method for updating index data according to the present invention includes:
101. the index data updating device receives an index data updating request, wherein the index data updating device comprises a memory area and a hard disk area;
in this embodiment, the index data updating device deployed in the server first receives an index data updating request, and the index data updating request is synchronized to the memory area and the hard disk area. The memory area stores the latest update data, which is mainly used for receiving the index data update request and the data retrieval request in real time, and the hard disk area stores the latest full index data, which is mainly used for receiving the data retrieval request but not receiving the index data update request in real time.
Index data is a decentralized storage structure created to speed up the retrieval of data lines in a table. The index is built against a table that is made up of index pages other than the data page, with rows in each index page containing logical pointers to speed up the retrieval of physical data.
The index data mainly comprises forward data, backward data, abstract data and the like. Because of the differences of different services in terms of data size, update frequency, and search volume, the index storage and update model employed for different service types are different. For example: for a service with more frequent data update, the storage model of the index data should ensure the performance of the data update and the integrity of the data as much as possible. Where an in-line index refers to a mapping of a document to all words contained in the document. An inverted index refers to a mapping of a term to all documents that contain the term.
102. The index data updating device updates the index data in the memory area according to the index data updating request, and obtains first index data;
in this embodiment, the index data updating device updates the index data in the memory area in real time according to the index data update request, where the first index data includes an incremental index, and the incremental index may specifically be adding new index data in the memory area. For example, the list a in the memory area originally has index data a and index data b, and index data c is added after the list a is updated, where the index data c is an incremental index. The index data a, the index data b, and the index data c then collectively constitute first index data.
103. If the first index data meets the preset index data updating condition, the index data updating device updates the index data in the hard disk area according to the first index data and obtains second index data.
In this embodiment, if the first index data stored in the memory area satisfies the preset index data updating condition, the index data updating device updates the index data in the hard disk area with the first index data, and obtains second index data, which may also be referred to as full-size data.
Similarly, assuming that the B list in the hard disk area has index data x, index data y, and index data z, the first index data (i.e., index data a, index data B, and index data c) in the memory area is now combined with the data in the B list, so that second index data, i.e., index data a, index data B, index data c, index data x, index data y, and index data z are obtained.
The embodiment of the invention provides an index data updating method which can be applied to an index data updating device, wherein the index data updating device comprises a memory area and a hard disk area, firstly the index data updating device receives an index data updating request, then the index data in the memory area is updated according to the index data updating request, first index data is obtained, and if the first index data meets the preset index data updating condition, the index data in the hard disk area is updated according to the first index data, and second index data is obtained. By the method, the index data can be stored in a grading manner, namely, the index data is divided into the first index data and the second index data, and different storage modes can be adopted for different index data types respectively, so that the second index data is periodically updated while the first index data is updated in real time, the updating of the index data can be effectively balanced, the memory consumption and the computing resources are reduced, and the computing cost is reduced.
Optionally, in a first optional embodiment of the method for updating index data according to the embodiment of fig. 4, after updating index data in a memory area according to an index data update request and obtaining first index data, the method may further include:
acquiring a data amount corresponding to the first index data;
judging whether the data quantity corresponding to the first index data reaches a storage capacity threshold value, and if so, determining that the first index data meets a preset index data updating condition.
In this embodiment, the index data updating device may further acquire the data amount corresponding to the first index data first, then determine whether the data amount corresponding to the first index data reaches a preset storage capacity threshold, and when the data amount reaches the storage capacity threshold, update the index data in the hard disk area with the first index data, and obtain the second index data.
Since the memory area has limited memory resources, it is generally necessary to set a storage capacity threshold for the occupied amount of the memory area, and if the storage capacity threshold is 80%, when the storage capacity of the index data in the memory area reaches a certain storage capacity threshold (for example, 80%), it is necessary to combine the index data in the memory area with the index data in the hard disk area, to generate new full amount of data, and reload the new full amount of data.
In the embodiment of the invention, a method for judging whether the first index data meets the preset index data updating condition is provided, specifically, the data quantity corresponding to the first index data is firstly obtained, then whether the data quantity reaches the storage capacity threshold value is judged, and only if the data quantity reaches the storage capacity threshold value, the first index data is determined to meet the preset index data updating condition. By the method, on one hand, a reasonable storage capacity threshold value can be set, the purpose of fully utilizing the memory space is achieved, waste of the memory space is not caused, and on the other hand, when the data volume of the first index data in the memory reaches the storage capacity threshold value, the first index data can be automatically sent to the hard disk, so that sufficient memory space is ensured.
Optionally, in a second optional embodiment of the method for updating index data according to the embodiment of fig. 4, after updating index data in a memory area according to an index data update request and obtaining first index data, the method may further include:
detecting a time value corresponding to the first index data;
judging whether the moment value corresponding to the first index data reaches the target moment or not, if so, determining that the first index data meets the preset index data updating condition.
In this embodiment, in addition to the manner described in the first embodiment corresponding to fig. 4, the second index data may be updated periodically. Specifically, the time value when the first index data is acquired is detected first, the time value is assumed to be 12:00:00, if the time value reaches the preset target time, the update period is considered to have arrived, so that it can be determined that the first index data meets the preset index data update condition, and then the first index data is sent to the hard disk area, so that the hard disk area is updated according to the first index data, and the second index data is acquired.
In the embodiment of the invention, a method for judging whether the first index data meets the preset index data updating condition is provided, specifically, a time value corresponding to the first index data is detected first, then whether the time value reaches a target time is judged, and only when the target time is reached, it is determined that the first index data meets the preset index data updating condition. By the method, the first index data can be periodically sent to the hard disk by using the memory space under the condition of limited memory resources, so that the hard disk can also periodically update the index data, the effect of updating the index data in the memory and the hard disk is not affected, and the flexibility and the practicability of the scheme are improved.
Optionally, on the basis of the first or second embodiment corresponding to fig. 4 and fig. 4, a third optional embodiment of the method for updating index data provided in the embodiment of the present invention updates index data in a hard disk area according to first index data, and obtains second index data, which may include:
and merging the first index data with the index data in the hard disk area to obtain second index data.
In this embodiment, how to update index data in a hard disk area will be specifically described.
Specifically, it is assumed that the current memory area stores an a list, and the a list includes index data in a period of time, referring to table 1, table 1 is the index data in the a list.
TABLE 1
As can be seen from table 1, the first index data includes a, B, c and d, and then the first index data is combined with the index data stored in the hard disk area, that is, the second index data obtained after the combination is displayed in the B list, please refer to table 2, and table 2 is the index data in the B list.
TABLE 2
As can be seen from table 2, the second index data also includes a, b, c, d and x. The updating of the index data in the hard disk area is completed.
In the embodiment of the present invention, the index data updating device updates the index data in the hard disk area, and then obtains the second index data, where the process may be to add the first index data in the memory area to the hard disk area, and form the second index data together with the index data originally stored in the hard disk area. By the method, the index data in the hard disk area can be updated, so that feasibility and operability of the scheme are improved, and a specific basis is provided for implementation of the scheme.
Optionally, on the basis of the third embodiment corresponding to fig. 4, in a fourth optional embodiment of the method for updating index data provided by the embodiment of the present invention, after updating index data in a hard disk area according to first index data and obtaining second index data, the method may further include:
determining third index data according to the retrieval frequency of the second index data, wherein the third index data is part of index data in the second index data;
and replacing the first index data with the third index data to store the third index data to the memory area.
In this embodiment, after obtaining the second index data, the index data updating apparatus may further select a part of index data with higher retrieval frequency from the second index data as the third index data, and then send the third index data to the memory area, where the first index data in the memory area is emptied, and the third index data is replaced by the first index data.
It can be understood that, whether the index data is updated in the hard disk area to obtain the second index data or the third index data is selected from the second index data, the offline processing mode may be adopted, and the routing online scheme may be switched after the processing is completed.
Further, in the embodiment of the present invention, after the second index data is obtained by the index data updating device, the third index data may be determined according to the search frequency of the second index data, and then the third index data is synchronized to the memory area, so that the first index data originally stored in the memory area is replaced by the third index data. By the method, when a user searches, the possibility of directly extracting the corresponding search result from the memory area is higher, and in general, the efficiency of searching information from the memory is higher than that of searching information from the hard disk, so that the third index data with higher search frequency is stored in the memory, the improvement of the search efficiency is more facilitated, and the practicability of the scheme is improved.
Optionally, on the basis of the embodiment corresponding to fig. 4, a fifth optional embodiment of the method for updating index data provided in the embodiment of the present invention may further include:
Receiving a data retrieval request;
acquiring a first search result corresponding to the first index data from the memory area according to the data search request, and acquiring a second search result corresponding to the second index data from the hard disk area;
and if the first search result is consistent with the second search result, sending the first search result or the second search result.
In this embodiment, a way of performing data retrieval using index data will be described. Firstly, the index data updating device receives a data retrieval request initiated by a user through a client, and then the index data updating device simultaneously sends the data retrieval request to a memory area and a hard disk area. In the memory area, a first search result corresponding to the data search request is obtained by using the first index data, and meanwhile, in the hard disk area, a second search result corresponding to the data search request is obtained by using the second index data.
For example, suppose that the user carries "2016-year olympic basketball game" in the data retrieval request, then the user will query the directory, i.e., index data, associated with "2016-year olympic basketball game" in the memory area and hard disk area, and the desired retrieval result can be obtained by the index data.
If the first search result obtained in the memory area is consistent with the second search result obtained in the hard disk area, one of the search results is selected and sent to the user.
Secondly, in the embodiment of the invention, a data retrieval process is introduced, wherein the process is to firstly receive a data retrieval request sent by a user, then according to the data retrieval request, not only can a first retrieval result corresponding to first index data be obtained from a memory area, but also a second retrieval result corresponding to second index data be obtained from a hard disk area, and if the first retrieval result is detected to be consistent with the second retrieval result, one of the retrieval results is selected. Through the method, the search results corresponding to the increment indexes and the search results corresponding to the full indexes can be obtained, so that the reliability and the comprehensiveness of search are improved, and in practical application, one of the first search results and the second search results can be selected for transmission, so that the transmitted search results are ensured not to be repeated, and the rationality of search is improved.
Optionally, on the basis of the fifth embodiment corresponding to fig. 4, in a sixth optional embodiment of the method for updating index data provided by the embodiment of the present invention, before sending the first search result or the second search result, the method may further include:
Acquiring a first updating time length of a first search result and a second updating time length of a second search result, wherein the first updating time length is the time length from the moment of acquiring the first search result to the current moment, and the second updating time length is the time length from the moment of acquiring the second search result to the current moment;
the sending the first search result or the second search result may include:
if the first updating duration is smaller than the second updating duration, a first search result is sent;
and if the first updating time length is longer than the second updating time length, sending a second search result.
In this embodiment, since the search engine internally divides all index data into two stores (i.e., a memory store and a hard disk store) in terms of implementation, when a data retrieval request arrives, it is highly likely that the same query result exists in two index data simultaneously. At this time, the latest result needs to be selected according to the update time of the result, and returned to the user as the final result, and the next new result is directly discarded.
Specifically, assuming that the timing at which the index data updating means acquires the first search result is 2017, 3, 18, 10, 15 minutes and 35 seconds and the timing at which the second search result is 2017, 3, 17, 12, 38 minutes and 27 seconds, it is easy to see that the time for acquiring the second search result is longer, and then the first search result will be preferentially transmitted. Thus, updated search results can be selected. And if the first updating time period is longer than the second updating time period, sending a second retrieval result to the user.
In the embodiment of the invention, when the first search result is consistent with the second search result, one of the search results can be selected by further utilizing the update time of the first search result and the second search result, namely, the first update time of the first search result and the second update time of the second search result are acquired first, the first update time is the time length from the moment of acquiring the first search result to the current moment, the second update time is the time length from the moment of acquiring the second search result to the current moment, and finally, the search result with shorter update time length is selected as the sending object. Through the method, the index data updating device can provide the retrieval results with timeliness for the user, meanwhile, the first retrieval results are usually stored in the memory, if the first updating time is shorter than the second updating time, the first retrieval results are preferentially called from the memory, and the time for extracting the required first retrieval results from the memory is shorter, so that the operability and the practicability of the scheme are improved.
Optionally, on the basis of the embodiment corresponding to fig. 4, a seventh optional embodiment of the method for updating index data according to the embodiment of the present invention may further include:
Receiving a data retrieval request;
obtaining a retrieval result corresponding to the second index data from the hard disk area according to the data retrieval request;
and sending a search result corresponding to the second index data.
In this embodiment, another way of performing data retrieval using index data will be described. Firstly, the index data updating device receives a data retrieval request initiated by a user through a client, and then the index data updating device sends the data retrieval request to the hard disk area, because in many cases, the index data which can be stored in the memory area is limited, so in order to overcome the problem, the index data with larger data volume can be stored in the hard disk area. In this way, the index data updating device may directly obtain the search result corresponding to the second index data from the hard disk area according to the data search request, and finally send the search data to the user through the client
In the embodiment of the invention, a data retrieval process is introduced, wherein the process is to firstly receive a data retrieval request sent by a user, and then directly retrieve a retrieval result from a hard disk area according to the data retrieval request, wherein the retrieval result is only stored in the hard disk area and is not stored in a memory area, so that the retrieval result is not required to be searched from the memory area by consuming time and resources. By the method, consumption of memory resources can be reduced as much as possible, and corresponding search results are directly extracted from the hard disk area, so that application efficiency and feasibility of the scheme are improved.
For easy understanding, the following may describe the process of implementing data retrieval in the present invention in a specific application scenario, specifically:
the index data updating device abstracts the search engine to form a self-service access search service platform developed after the search engine is assembled. Building a search engine using the index data updating means makes implementation of the search function simpler. The core of the search engine is index data, wherein the operation of multiple index data mainly comprises storage, updating, retrieval and the like of the index data, and particularly when the service data volume is large, the problems of storage and updating of the index data are more prominent. Therefore, how to store and update the index data becomes a key issue in the process of building the search service. The specific flow of data retrieval will be described below.
Referring to fig. 5, fig. 5 is a schematic flow chart of data retrieval in the embodiment of the invention, specifically:
in step 201, firstly, an index data updating device receives a data retrieval request sent by a user through a client, wherein the request carries content which the user wants to retrieve;
in step 202, the index data updating device will determine whether the first search result corresponding to the first index data can be obtained from the memory area according to the data search request, and also need to determine whether the second search result corresponding to the second index data can be obtained from the hard disk area, if both search results can be obtained at the same time, step 203 is entered, otherwise, step 204 is skipped;
In step 203, if the index data updating device obtains the first search result and the second search result at the same time, one of the two search results should be selected as the final search result;
in step 204, the index data updating device transmits the selected search result to the client.
Referring to fig. 6, the index data updating device of the present invention includes a memory area and a hard disk area, and the index data updating device 30 includes:
a first receiving module 301, configured to receive an index data update request;
a first updating module 302, configured to update the index data in the memory area according to the index data update request received by the first receiving module 301, and obtain first index data;
and a second updating module 303, configured to update the index data in the hard disk area according to the first index data if the first index data updated by the first updating module 302 meets a preset index data updating condition, and obtain second index data.
In this embodiment, the first receiving module 301 receives an index data update request, the first updating module 302 updates the index data in the memory area according to the index data update request received by the first receiving module 301, and obtains first index data, and if the first index data obtained by updating the first updating module 302 meets a preset index data update condition, the second updating module 303 updates the index data in the hard disk area according to the first index data, and obtains second index data.
In an embodiment of the present invention, an index data updating device is provided, where the index data updating device includes a memory area and a hard disk area, and first the index data updating device receives an index data updating request, then updates index data in the memory area according to the index data updating request, and obtains first index data, and if the first index data meets a preset index data updating condition, updates index data in the hard disk area according to the first index data, and obtains second index data. By the method, the index data can be stored in a grading manner, namely, the index data is divided into the first index data and the second index data, and different storage modes can be adopted for different index data types respectively, so that the second index data is periodically updated while the first index data is updated in real time, the updating of the index data can be effectively balanced, the memory consumption and the computing resources are reduced, and the computing cost is reduced.
Optionally, referring to fig. 7 on the basis of the embodiment corresponding to fig. 6, in another embodiment of the index data updating device 30 provided in the embodiment of the present invention,
The index data updating means 30 further comprises:
a first obtaining module 304A, configured to obtain, after the first updating module 302 updates the index data in the memory area according to the index data update request and obtains first index data, a data amount corresponding to the first index data;
the first determining module 304B is configured to determine whether the data amount corresponding to the first index data acquired by the first acquiring module 304A reaches a storage capacity threshold, and if yes, determine that the first index data meets the preset index data updating condition.
In the embodiment of the invention, a method for judging whether the first index data meets the preset index data updating condition is provided, specifically, the data quantity corresponding to the first index data is firstly obtained, then whether the data quantity reaches the storage capacity threshold value is judged, and only if the data quantity reaches the storage capacity threshold value, the first index data is determined to meet the preset index data updating condition. By the method, on one hand, a reasonable storage capacity threshold value can be set, the purpose of fully utilizing the memory space is achieved, waste of the memory space is not caused, and on the other hand, when the data volume of the first index data in the memory reaches the storage capacity threshold value, the first index data can be automatically sent to the hard disk, so that sufficient memory space is ensured.
Optionally, referring to fig. 8, in another embodiment of the index data updating device 30 provided in the embodiment of the present invention based on the embodiment corresponding to fig. 6,
the index data updating means 30 further comprises:
a detection module 305A, configured to detect a time value corresponding to the first index data after the first update module 302 updates the index data in the memory area according to the index data update request and obtains the first index data;
a second determining module 305B, configured to determine whether the time value corresponding to the first index data detected by the detecting module 305A reaches a target time, and if yes, determine that the first index data meets the preset index data update condition.
In the embodiment of the invention, a method for judging whether the first index data meets the preset index data updating condition is provided, specifically, a time value corresponding to the first index data is detected first, then whether the time value reaches a target time is judged, and only when the target time is reached, it is determined that the first index data meets the preset index data updating condition. By the method, the first index data can be periodically sent to the hard disk by using the memory space under the condition of limited memory resources, so that the hard disk can also periodically update the index data, the effect of updating the index data in the memory and the hard disk is not affected, and the flexibility and the practicability of the scheme are improved.
Optionally, referring to fig. 9, based on the embodiment corresponding to fig. 6, 7 or 8, in another embodiment of the index data updating device 30 provided in the embodiment of the present invention,
the second update module 303 includes:
and a processing unit 3031, configured to combine the first index data with the index data in the hard disk area, and obtain the second index data.
In the embodiment of the present invention, the index data updating device updates the index data in the hard disk area, and then obtains the second index data, where the process may be to add the first index data in the memory area to the hard disk area, and form the second index data together with the index data originally stored in the hard disk area. By the method, the index data in the hard disk area can be updated, so that feasibility and operability of the scheme are improved, and a specific basis is provided for implementation of the scheme.
Alternatively, referring to fig. 10 on the basis of the embodiment corresponding to fig. 9, in another embodiment of the index data updating device 30 provided in the embodiment of the present invention,
the index data updating means 30 further comprises:
a determining module 306A, configured to determine, after the second updating module 303 updates the index data in the hard disk area according to the first index data and obtains second index data, third index data according to a search frequency of the second index data, where the third index data is a part of index data in the second index data;
And a replacing module 306B, configured to replace the first index data with the third index data determined by the determining module 306A, so as to store the third index data in the memory area.
Further, in the embodiment of the present invention, after the second index data is obtained by the index data updating device, the third index data may be determined according to the search frequency of the second index data, and then the third index data is synchronized to the memory area, so that the first index data originally stored in the memory area is replaced by the third index data. By the method, when a user searches, the possibility of directly extracting the corresponding search result from the memory area is higher, and in general, the efficiency of searching information from the memory is higher than that of searching information from the hard disk, so that the third index data with higher search frequency is stored in the memory, the improvement of the search efficiency is more facilitated, and the practicability of the scheme is improved.
Optionally, referring to fig. 11, in another embodiment of the index data updating device 30 provided in the embodiment of the present invention based on the embodiment corresponding to fig. 6,
the index data updating means 30 further comprises:
A second receiving module 307A for receiving a data retrieval request;
a second obtaining module 307B, configured to obtain, according to the data retrieval request received by the second receiving module 307A, a first retrieval result corresponding to the first index data from the memory area, and obtain, from the hard disk area, a second retrieval result corresponding to the second index data;
a first sending module 307C, configured to send the first search result or the second search result if the first search result acquired by the second acquiring module 307B is consistent with the second search result.
Secondly, in the embodiment of the invention, a data retrieval process is introduced, wherein the process is to firstly receive a data retrieval request sent by a user, then according to the data retrieval request, not only can a first retrieval result corresponding to first index data be obtained from a memory area, but also a second retrieval result corresponding to second index data be obtained from a hard disk area, and if the first retrieval result is detected to be consistent with the second retrieval result, one of the retrieval results is selected. Through the method, the search results corresponding to the increment indexes and the search results corresponding to the full indexes can be obtained, so that the reliability and the comprehensiveness of search are improved, and in practical application, one of the first search results and the second search results can be selected for transmission, so that the transmitted search results are ensured not to be repeated, and the rationality of search is improved.
Alternatively, referring to fig. 12 based on the embodiment corresponding to fig. 11, in another embodiment of the index data updating device 30 provided in the embodiment of the present invention,
the index data updating means 30 further comprises:
a third obtaining module 308, configured to obtain, before the first sending module 307C sends the first search result or the second search result, a first update duration of the first search result and a second update duration of the second search result, where the first update duration is a time length between a time point when the first search result is obtained and a current time point, and the second update duration is a time length between a time point when the second search result is obtained and the current time point;
the first transmitting module 307C includes:
a first sending unit 307C1, configured to send the first search result if the first update duration is less than the second update duration;
and a second sending unit 307C2, configured to send the second search result if the first update time period is longer than the second update time period.
In the embodiment of the invention, when the first search result is consistent with the second search result, one of the search results can be selected by further utilizing the update time of the first search result and the second search result, namely, the first update time of the first search result and the second update time of the second search result are acquired first, the first update time is the time length from the moment of acquiring the first search result to the current moment, the second update time is the time length from the moment of acquiring the second search result to the current moment, and finally, the search result with shorter update time length is selected as the sending object. Through the method, the index data updating device can provide the retrieval results with timeliness for the user, meanwhile, the first retrieval results are usually stored in the memory, if the first updating time is shorter than the second updating time, the first retrieval results are preferentially called from the memory, and the time for extracting the required first retrieval results from the memory is shorter, so that the operability and the practicability of the scheme are improved.
Optionally, referring to fig. 13, in another embodiment of the index data updating device 30 according to the embodiment of the present invention,
the index data updating means 30 further comprises:
a third receiving module 309A for receiving a data retrieval request;
a fourth obtaining module 309B, configured to obtain, according to the data retrieval request received by the third receiving module 309A, a retrieval result corresponding to the second index data from the hard disk area;
a second sending module 309C, configured to send a search result corresponding to the second index data acquired by the fourth acquiring module 309B.
In the embodiment of the invention, a data retrieval process is introduced, wherein the process is to firstly receive a data retrieval request sent by a user, and then directly retrieve a retrieval result from a hard disk area according to the data retrieval request, wherein the retrieval result is only stored in the hard disk area and is not stored in a memory area, so that the retrieval result is not required to be searched from the memory area by consuming time and resources. By the method, consumption of memory resources can be reduced as much as possible, and corresponding search results are directly extracted from the hard disk area, so that application efficiency and feasibility of the scheme are improved.
Fig. 14 is a schematic structural diagram of an index data updating device according to an embodiment of the present invention, where the index data updating device 400 may have a relatively large difference due to different configurations or performances, and may include one or more central processing units (central processing units, CPU) 422 (e.g., one or more processors) and a memory 432, and one or more storage media 430 (e.g., one or more mass storage devices) storing application programs 442 or data 444. Wherein memory 432 and storage medium 430 may be transitory or persistent storage. The program stored on the storage medium 430 may include one or more modules (not shown), each of which may include a series of instruction operations on a server. Still further, the central processor 422 may be configured to communicate with the storage medium 430, and to perform a series of instruction operations on the storage medium 430 on the index data updating device 400.
Index data updating means 400 may also include one or more power supplies 426, one or more wired or wireless network interfaces 450, one or more input/output interfaces 458, and/or one or more operating systems 441, such as Windows ServerTM, mac OS XTM, unixTM, linuxTM, freeBSDTM, and the like.
The steps performed by the server in the above embodiments may be based on the server structure shown in fig. 14.
Wherein the central processor 422 is operable to perform the steps of:
receiving an index data update request;
updating the index data in the memory area according to the index data updating request, and obtaining first index data;
and if the first index data meets the preset index data updating condition, updating the index data in the hard disk area according to the first index data, and obtaining second index data.
The central processor 422 may also be configured to perform the following steps:
acquiring the data quantity corresponding to the first index data;
judging whether the data quantity corresponding to the first index data reaches a storage capacity threshold value, if so, determining that the first index data meets the preset index data updating condition.
The central processor 422 may also be configured to perform the following steps:
detecting a time value corresponding to the first index data;
judging whether the time value corresponding to the first index data reaches a target time or not, if so, determining that the first index data meets the preset index data updating condition.
The cpu 422 is specifically configured to perform the following steps:
and merging the first index data with the index data in the hard disk area to obtain the second index data.
The central processor 422 may also be configured to perform the following steps:
determining third index data according to the retrieval frequency of the second index data, wherein the third index data is part of index data in the second index data;
and replacing the first index data with the third index data to store the third index data into the memory area.
The central processor 422 may also be configured to perform the following steps:
receiving a data retrieval request;
acquiring a first search result corresponding to the first index data from the memory area according to the data search request, and acquiring a second search result corresponding to the second index data from the hard disk area;
and if the first search result is consistent with the second search result, sending the first search result or the second search result.
The central processor 422 may also be configured to perform the following steps:
acquiring a first updating time length of the first search result and a second updating time length of the second search result, wherein the first updating time length is the time length from the moment of acquiring the first search result to the current moment, and the second updating time length is the time length from the moment of acquiring the second search result to the current moment;
The cpu 422 is specifically configured to perform the following steps:
if the first updating duration is smaller than the second updating duration, the first search result is sent;
and if the first updating time length is longer than the second updating time length, sending the second search result.
The central processor 422 may also be configured to perform the following steps:
receiving a data retrieval request;
obtaining a retrieval result corresponding to the second index data from the hard disk area according to the data retrieval request;
and sending a search result corresponding to the second index data.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein.
In the several embodiments provided in the present invention, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only memory (ROM), a random access memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (12)
1. A method for updating index data, the method being applied to an index data updating device, the index data updating device comprising a memory area and a hard disk area, the method comprising:
receiving an index data update request;
updating the index data in the memory area according to the index data updating request, and obtaining first index data;
if the first index data meets the preset index data updating condition, updating the index data in the hard disk area according to the first index data, and obtaining second index data;
receiving a data retrieval request;
acquiring a first search result corresponding to the first index data from the memory area according to the data search request, and acquiring a second search result corresponding to the second index data from the hard disk area;
If the first search result is consistent with the second search result, acquiring a first update time length of the first search result and a second update time length of the second search result, wherein the first update time length is the time length from the moment of acquiring the first search result to the current moment, and the second update time length is the time length from the moment of acquiring the second search result to the current moment;
if the first updating duration is smaller than the second updating duration, the first search result is sent;
and if the first updating time length is longer than the second updating time length, sending the second search result.
2. The method of claim 1, wherein after updating the index data in the memory area according to the index data update request and obtaining the first index data, the method further comprises:
acquiring the data quantity corresponding to the first index data;
judging whether the data quantity corresponding to the first index data reaches a storage capacity threshold value, if so, determining that the first index data meets the preset index data updating condition.
3. The method of claim 1, wherein after updating the index data in the memory area according to the index data update request and obtaining the first index data, the method further comprises:
detecting a time value corresponding to the first index data;
judging whether the time value corresponding to the first index data reaches a target time or not, if so, determining that the first index data meets the preset index data updating condition.
4. A method according to any one of claims 1 to 3, wherein updating the index data in the hard disk area according to the first index data and obtaining second index data comprises:
and merging the first index data with the index data in the hard disk area to obtain the second index data.
5. The method of claim 4, wherein after updating the index data in the hard disk area according to the first index data and obtaining the second index data, the method further comprises:
determining third index data according to the retrieval frequency of the second index data, wherein the third index data is part of index data in the second index data;
And replacing the first index data with the third index data to store the third index data into the memory area.
6. An index data updating device, wherein the index data updating device includes a memory area and a hard disk area, the index data updating device includes:
the first receiving module is used for receiving an index data updating request;
the first updating module is used for updating the index data in the memory area according to the index data updating request received by the first receiving module and obtaining first index data;
the second updating module is used for updating the index data in the hard disk area according to the first index data if the first index data updated by the first updating module meets the preset index data updating condition, and obtaining second index data;
the second receiving module is used for receiving a data retrieval request;
the second acquisition module is used for acquiring a first search result corresponding to the first index data from the memory area according to the data search request received by the second receiving module, and acquiring a second search result corresponding to the second index data from the hard disk area;
A third obtaining module, configured to obtain a first update duration of the first search result and a second update duration of the second search result if the first search result obtained by the second obtaining module is consistent with the second search result, where the first update duration is a time length from a time point when the first search result is obtained to a current time point, and the second update duration is a time length from a time point when the second search result is obtained to the current time point;
a first sending unit, configured to send the first search result if the first update duration is less than the second update duration;
and the second sending unit is used for sending the second search result if the first updating time length is longer than the second updating time length.
7. The index data updating device according to claim 6, characterized in that the index data updating device further comprises:
the first acquisition module is used for acquiring the data quantity corresponding to the first index data after the first update module updates the index data in the memory area according to the index data update request and obtains the first index data;
The first judging module is used for judging whether the data volume corresponding to the first index data acquired by the first acquiring module reaches a storage capacity threshold or not, and if yes, determining that the first index data meets the preset index data updating condition.
8. The index data updating device according to claim 6, characterized in that the index data updating device further comprises:
the detection module is used for detecting a time value corresponding to the first index data after the first update module updates the index data in the memory area according to the index data update request and obtains the first index data;
and the second judging module is used for judging whether the moment value corresponding to the first index data detected by the detecting module reaches the target moment or not, and if so, determining that the first index data meets the preset index data updating condition.
9. The index data updating apparatus according to any one of claims 6 to 8, wherein said second updating module includes:
and the processing unit is used for merging the first index data with the index data in the hard disk area and obtaining the second index data.
10. The index data updating device according to claim 9, characterized in that the index data updating device further comprises:
the determining module is used for determining third index data according to the retrieval frequency of the second index data after the second updating module updates the index data in the hard disk area according to the first index data and obtains the second index data, wherein the third index data is part of index data in the second index data;
and the replacing module is used for replacing the first index data by the third index data determined by the determining module so as to store the third index data into the memory area.
11. A server comprising a memory and a processor;
the memory stores a program;
the processor is configured to execute the program to implement the method for updating index data according to any one of claims 1 to 5.
12. A computer readable storage medium, wherein a program is stored in the computer readable storage medium, which when executed by a computer device, implements the method for updating index data according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710225105.0A CN108694188B (en) | 2017-04-07 | 2017-04-07 | Index data updating method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710225105.0A CN108694188B (en) | 2017-04-07 | 2017-04-07 | Index data updating method and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108694188A CN108694188A (en) | 2018-10-23 |
| CN108694188B true CN108694188B (en) | 2023-05-12 |
Family
ID=63842129
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710225105.0A Active CN108694188B (en) | 2017-04-07 | 2017-04-07 | Index data updating method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108694188B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110737747A (en) * | 2019-09-12 | 2020-01-31 | 苏宁云计算有限公司 | data operation method, device and system |
| CN112069175B (en) * | 2020-08-25 | 2024-03-29 | 北京五八信息技术有限公司 | Data query method and device and electronic equipment |
| CN112115154A (en) * | 2020-09-27 | 2020-12-22 | 北京有竹居网络技术有限公司 | Data processing and data query method, device, equipment and computer readable medium |
| CN113076456A (en) * | 2021-03-25 | 2021-07-06 | 咪咕文化科技有限公司 | Data search processing method and device, electronic equipment and storage medium |
| CN113449155B (en) * | 2021-07-16 | 2024-02-27 | 百度在线网络技术（北京）有限公司 | Method, apparatus, device and medium for feature representation processing |
| US20240054102A1 (en) * | 2022-08-12 | 2024-02-15 | Google Llc | Scalable and Cost-Efficient Information Retrieval Architecture for Massive Datasets |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102081625A (en) * | 2009-11-30 | 2011-06-01 | 中国移动通信集团北京有限公司 | Data query method and query server |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101295323B (en) * | 2008-06-30 | 2011-11-02 | 腾讯科技（深圳）有限公司 | Processing method and system for index updating |
| US9262526B2 (en) * | 2010-01-28 | 2016-02-16 | Karl Muth | System and method for compiling search results using information regarding length of time users spend interacting with individual search results |
| CN102169507B (en) * | 2011-05-26 | 2013-03-20 | 厦门雅迅网络股份有限公司 | Implementation method of distributed real-time search engine |
| CN102339315B (en) * | 2011-09-30 | 2014-11-19 | 亿赞普(北京)科技有限公司 | Index updating method and system of advertisement data |
| CN103473229A (en) * | 2012-06-06 | 2013-12-25 | 深圳市世纪光速信息技术有限公司 | Memory retrieval system and method, and real-time retrieval system and method |
| CN103942289B (en) * | 2014-04-12 | 2017-01-25 | 广西师范大学 | Memory caching method oriented to range querying on Hadoop |
| CN104021223B (en) * | 2014-06-25 | 2017-07-25 | 国家电网公司 | The access method and device of a kind of Cluster Database measuring point |
| CN104199892B (en) * | 2014-08-26 | 2018-01-30 | 上海爱数信息技术股份有限公司 | A kind of index reading/writing method for merging asynchronous refresh based on compression |
| CN104537112B (en) * | 2015-01-20 | 2017-07-14 | 成都携恩科技有限公司 | A kind of method of safe cloud computing |
| CN104899249B (en) * | 2015-05-04 | 2018-07-13 | 中国科学院信息工程研究所 | Reliable index upgrade system and method under a kind of mass data |
-
2017
- 2017-04-07 CN CN201710225105.0A patent/CN108694188B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102081625A (en) * | 2009-11-30 | 2011-06-01 | 中国移动通信集团北京有限公司 | Data query method and query server |
Non-Patent Citations (2)
| Title |
|---|
| An integrated system for building enterprise taxonomies;Li Zhang 等;Information Retrieval;第10卷;1-55 * |
| 一种基于共享执行策略的间隔查询优化技术;周新 等;软件学报;第27卷(第12期);3067-3084 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108694188A (en) | 2018-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108694188B (en) | Index data updating method and related device | |
| CN110704453B (en) | Data query method and device, storage medium and electronic equipment | |
| CN105447075B (en) | The computer implemented method divided for dynamic | |
| CN108304444B (en) | Information query method and device | |
| CN102667761B (en) | Scalable cluster database | |
| CN104301360A (en) | Method, log server and system for recording log data | |
| US20100161780A1 (en) | Hot data management method based on hit counter | |
| WO2007068600B1 (en) | Generating backup sets to a specific point in time | |
| KR20080106194A (en) | Serving cached query results based on a query portion | |
| RU2733482C2 (en) | Method and system for updating search index database | |
| CN110347651A (en) | Method of data synchronization, device, equipment and storage medium based on cloud storage | |
| CN110399348A (en) | File deletes method, apparatus, system and computer readable storage medium again | |
| JP2008305225A (en) | Control computer, computer system, and access control method | |
| US9195745B2 (en) | Dynamic query master agent for query execution | |
| CN107391600A (en) | Method and apparatus for accessing time series data in internal memory | |
| CN105205143A (en) | File storage and processing method, device and system | |
| CN108540510B (en) | Cloud host creation method and device and cloud service system | |
| CN102929958A (en) | Metadata processing method, agenting and forwarding equipment, server and computing system | |
| CN111651424B (en) | Data processing method, device, data node and storage medium | |
| CN108319634B (en) | Directory access method and device for distributed file system | |
| CN111159130A (en) | Small file merging method and electronic equipment | |
| CN101247405A (en) | Method, system and device for calculating download time and resource downloading | |
| CN105069139B (en) | File access method, file access device and server | |
| US8996512B2 (en) | Search engine optimization using a find operation | |
| CN114610680A (en) | Method, device and equipment for managing metadata of distributed file system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TG01 | Patent term adjustment |